Dec 04 11:35:14.212239 master-0 systemd[1]: Starting Kubernetes Kubelet... Dec 04 11:35:14.401042 master-0 kubenswrapper[4745]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 11:35:14.401042 master-0 kubenswrapper[4745]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Dec 04 11:35:14.401042 master-0 kubenswrapper[4745]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 11:35:14.401042 master-0 kubenswrapper[4745]: Flag --register-with-taints has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 11:35:14.401042 master-0 kubenswrapper[4745]: Flag --pod-infra-container-image has been deprecated, will be removed in a future release. Image garbage collector will get sandbox image information from CRI. Dec 04 11:35:14.401042 master-0 kubenswrapper[4745]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 11:35:14.402054 master-0 kubenswrapper[4745]: I1204 11:35:14.401231 4745 server.go:211] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Dec 04 11:35:14.406746 master-0 kubenswrapper[4745]: W1204 11:35:14.406632 4745 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 11:35:14.406746 master-0 kubenswrapper[4745]: W1204 11:35:14.406703 4745 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 11:35:14.406746 master-0 kubenswrapper[4745]: W1204 11:35:14.406709 4745 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 11:35:14.406746 master-0 kubenswrapper[4745]: W1204 11:35:14.406714 4745 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 11:35:14.406746 master-0 kubenswrapper[4745]: W1204 11:35:14.406718 4745 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 11:35:14.406746 master-0 kubenswrapper[4745]: W1204 11:35:14.406725 4745 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 11:35:14.406746 master-0 kubenswrapper[4745]: W1204 11:35:14.406729 4745 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 11:35:14.406746 master-0 kubenswrapper[4745]: W1204 11:35:14.406733 4745 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 11:35:14.406746 master-0 kubenswrapper[4745]: W1204 11:35:14.406737 4745 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 11:35:14.406746 master-0 kubenswrapper[4745]: W1204 11:35:14.406741 4745 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 11:35:14.406746 master-0 kubenswrapper[4745]: W1204 11:35:14.406745 4745 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 11:35:14.406746 master-0 kubenswrapper[4745]: W1204 11:35:14.406748 4745 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 11:35:14.406746 master-0 kubenswrapper[4745]: W1204 11:35:14.406752 4745 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 11:35:14.406746 master-0 kubenswrapper[4745]: W1204 11:35:14.406760 4745 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 11:35:14.406746 master-0 kubenswrapper[4745]: W1204 11:35:14.406764 4745 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 11:35:14.406746 master-0 kubenswrapper[4745]: W1204 11:35:14.406769 4745 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 11:35:14.406746 master-0 kubenswrapper[4745]: W1204 11:35:14.406773 4745 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 11:35:14.406746 master-0 kubenswrapper[4745]: W1204 11:35:14.406776 4745 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 11:35:14.407394 master-0 kubenswrapper[4745]: W1204 11:35:14.406783 4745 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 11:35:14.407394 master-0 kubenswrapper[4745]: W1204 11:35:14.406791 4745 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 11:35:14.407394 master-0 kubenswrapper[4745]: W1204 11:35:14.406797 4745 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 11:35:14.407394 master-0 kubenswrapper[4745]: W1204 11:35:14.406801 4745 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 11:35:14.407394 master-0 kubenswrapper[4745]: W1204 11:35:14.406821 4745 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 11:35:14.407394 master-0 kubenswrapper[4745]: W1204 11:35:14.406826 4745 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 11:35:14.407394 master-0 kubenswrapper[4745]: W1204 11:35:14.406833 4745 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 11:35:14.407394 master-0 kubenswrapper[4745]: W1204 11:35:14.406836 4745 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 11:35:14.407394 master-0 kubenswrapper[4745]: W1204 11:35:14.406841 4745 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 11:35:14.407394 master-0 kubenswrapper[4745]: W1204 11:35:14.406844 4745 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 11:35:14.407394 master-0 kubenswrapper[4745]: W1204 11:35:14.406848 4745 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 11:35:14.407394 master-0 kubenswrapper[4745]: W1204 11:35:14.406851 4745 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 11:35:14.407394 master-0 kubenswrapper[4745]: W1204 11:35:14.406854 4745 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 11:35:14.407394 master-0 kubenswrapper[4745]: W1204 11:35:14.406858 4745 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 11:35:14.407394 master-0 kubenswrapper[4745]: W1204 11:35:14.406861 4745 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 11:35:14.407394 master-0 kubenswrapper[4745]: W1204 11:35:14.406865 4745 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 11:35:14.407394 master-0 kubenswrapper[4745]: W1204 11:35:14.406868 4745 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 11:35:14.407394 master-0 kubenswrapper[4745]: W1204 11:35:14.406875 4745 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 11:35:14.407394 master-0 kubenswrapper[4745]: W1204 11:35:14.406880 4745 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 11:35:14.407394 master-0 kubenswrapper[4745]: W1204 11:35:14.406885 4745 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 11:35:14.407797 master-0 kubenswrapper[4745]: W1204 11:35:14.406889 4745 feature_gate.go:330] unrecognized feature gate: Example Dec 04 11:35:14.407797 master-0 kubenswrapper[4745]: W1204 11:35:14.406894 4745 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 11:35:14.407797 master-0 kubenswrapper[4745]: W1204 11:35:14.406899 4745 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 11:35:14.407797 master-0 kubenswrapper[4745]: W1204 11:35:14.406903 4745 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 11:35:14.407797 master-0 kubenswrapper[4745]: W1204 11:35:14.406908 4745 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 11:35:14.407797 master-0 kubenswrapper[4745]: W1204 11:35:14.406913 4745 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 11:35:14.407797 master-0 kubenswrapper[4745]: W1204 11:35:14.406917 4745 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 11:35:14.407797 master-0 kubenswrapper[4745]: W1204 11:35:14.406921 4745 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 11:35:14.407797 master-0 kubenswrapper[4745]: W1204 11:35:14.406924 4745 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 11:35:14.407797 master-0 kubenswrapper[4745]: W1204 11:35:14.406930 4745 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 11:35:14.407797 master-0 kubenswrapper[4745]: W1204 11:35:14.406936 4745 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 11:35:14.407797 master-0 kubenswrapper[4745]: W1204 11:35:14.406941 4745 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 11:35:14.407797 master-0 kubenswrapper[4745]: W1204 11:35:14.406945 4745 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 11:35:14.407797 master-0 kubenswrapper[4745]: W1204 11:35:14.406951 4745 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 11:35:14.407797 master-0 kubenswrapper[4745]: W1204 11:35:14.406956 4745 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 11:35:14.407797 master-0 kubenswrapper[4745]: W1204 11:35:14.406959 4745 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 11:35:14.407797 master-0 kubenswrapper[4745]: W1204 11:35:14.406963 4745 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 11:35:14.407797 master-0 kubenswrapper[4745]: W1204 11:35:14.406966 4745 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 11:35:14.407797 master-0 kubenswrapper[4745]: W1204 11:35:14.406970 4745 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 11:35:14.407797 master-0 kubenswrapper[4745]: W1204 11:35:14.406974 4745 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 11:35:14.408218 master-0 kubenswrapper[4745]: W1204 11:35:14.406977 4745 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 11:35:14.408218 master-0 kubenswrapper[4745]: W1204 11:35:14.406980 4745 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 11:35:14.408218 master-0 kubenswrapper[4745]: W1204 11:35:14.406984 4745 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 11:35:14.408218 master-0 kubenswrapper[4745]: W1204 11:35:14.406987 4745 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 11:35:14.408218 master-0 kubenswrapper[4745]: W1204 11:35:14.406995 4745 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 11:35:14.408218 master-0 kubenswrapper[4745]: W1204 11:35:14.407001 4745 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 11:35:14.408218 master-0 kubenswrapper[4745]: W1204 11:35:14.407006 4745 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 11:35:14.408218 master-0 kubenswrapper[4745]: W1204 11:35:14.407010 4745 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 11:35:14.408218 master-0 kubenswrapper[4745]: W1204 11:35:14.407015 4745 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 11:35:14.408218 master-0 kubenswrapper[4745]: W1204 11:35:14.407019 4745 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 11:35:14.408218 master-0 kubenswrapper[4745]: W1204 11:35:14.407024 4745 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 11:35:14.408218 master-0 kubenswrapper[4745]: W1204 11:35:14.407030 4745 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 11:35:14.408218 master-0 kubenswrapper[4745]: W1204 11:35:14.407034 4745 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 11:35:14.408218 master-0 kubenswrapper[4745]: W1204 11:35:14.407040 4745 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 11:35:14.408218 master-0 kubenswrapper[4745]: I1204 11:35:14.407212 4745 flags.go:64] FLAG: --address="0.0.0.0" Dec 04 11:35:14.408218 master-0 kubenswrapper[4745]: I1204 11:35:14.407230 4745 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Dec 04 11:35:14.408218 master-0 kubenswrapper[4745]: I1204 11:35:14.407243 4745 flags.go:64] FLAG: --anonymous-auth="true" Dec 04 11:35:14.408218 master-0 kubenswrapper[4745]: I1204 11:35:14.407250 4745 flags.go:64] FLAG: --application-metrics-count-limit="100" Dec 04 11:35:14.408218 master-0 kubenswrapper[4745]: I1204 11:35:14.407259 4745 flags.go:64] FLAG: --authentication-token-webhook="false" Dec 04 11:35:14.408218 master-0 kubenswrapper[4745]: I1204 11:35:14.407264 4745 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407273 4745 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407281 4745 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407285 4745 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407290 4745 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407295 4745 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407303 4745 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407308 4745 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407313 4745 flags.go:64] FLAG: --cgroup-root="" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407317 4745 flags.go:64] FLAG: --cgroups-per-qos="true" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407322 4745 flags.go:64] FLAG: --client-ca-file="" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407327 4745 flags.go:64] FLAG: --cloud-config="" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407332 4745 flags.go:64] FLAG: --cloud-provider="" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407336 4745 flags.go:64] FLAG: --cluster-dns="[]" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407343 4745 flags.go:64] FLAG: --cluster-domain="" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407348 4745 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407352 4745 flags.go:64] FLAG: --config-dir="" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407357 4745 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407362 4745 flags.go:64] FLAG: --container-log-max-files="5" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407369 4745 flags.go:64] FLAG: --container-log-max-size="10Mi" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407373 4745 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407379 4745 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407384 4745 flags.go:64] FLAG: --containerd-namespace="k8s.io" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407389 4745 flags.go:64] FLAG: --contention-profiling="false" Dec 04 11:35:14.408619 master-0 kubenswrapper[4745]: I1204 11:35:14.407393 4745 flags.go:64] FLAG: --cpu-cfs-quota="true" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407398 4745 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407403 4745 flags.go:64] FLAG: --cpu-manager-policy="none" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407408 4745 flags.go:64] FLAG: --cpu-manager-policy-options="" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407416 4745 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407421 4745 flags.go:64] FLAG: --enable-controller-attach-detach="true" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407425 4745 flags.go:64] FLAG: --enable-debugging-handlers="true" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407432 4745 flags.go:64] FLAG: --enable-load-reader="false" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407437 4745 flags.go:64] FLAG: --enable-server="true" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407442 4745 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407451 4745 flags.go:64] FLAG: --event-burst="100" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407456 4745 flags.go:64] FLAG: --event-qps="50" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407460 4745 flags.go:64] FLAG: --event-storage-age-limit="default=0" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407465 4745 flags.go:64] FLAG: --event-storage-event-limit="default=0" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407472 4745 flags.go:64] FLAG: --eviction-hard="" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407478 4745 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407483 4745 flags.go:64] FLAG: --eviction-minimum-reclaim="" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407488 4745 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407493 4745 flags.go:64] FLAG: --eviction-soft="" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407497 4745 flags.go:64] FLAG: --eviction-soft-grace-period="" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407502 4745 flags.go:64] FLAG: --exit-on-lock-contention="false" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407506 4745 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407511 4745 flags.go:64] FLAG: --experimental-mounter-path="" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407515 4745 flags.go:64] FLAG: --fail-cgroupv1="false" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407519 4745 flags.go:64] FLAG: --fail-swap-on="true" Dec 04 11:35:14.409107 master-0 kubenswrapper[4745]: I1204 11:35:14.407524 4745 flags.go:64] FLAG: --feature-gates="" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407529 4745 flags.go:64] FLAG: --file-check-frequency="20s" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407534 4745 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407538 4745 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407543 4745 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407548 4745 flags.go:64] FLAG: --healthz-port="10248" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407552 4745 flags.go:64] FLAG: --help="false" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407557 4745 flags.go:64] FLAG: --hostname-override="" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407561 4745 flags.go:64] FLAG: --housekeeping-interval="10s" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407565 4745 flags.go:64] FLAG: --http-check-frequency="20s" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407569 4745 flags.go:64] FLAG: --image-credential-provider-bin-dir="" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407574 4745 flags.go:64] FLAG: --image-credential-provider-config="" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407578 4745 flags.go:64] FLAG: --image-gc-high-threshold="85" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407582 4745 flags.go:64] FLAG: --image-gc-low-threshold="80" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407588 4745 flags.go:64] FLAG: --image-service-endpoint="" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407593 4745 flags.go:64] FLAG: --kernel-memcg-notification="false" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407597 4745 flags.go:64] FLAG: --kube-api-burst="100" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407602 4745 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407607 4745 flags.go:64] FLAG: --kube-api-qps="50" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407611 4745 flags.go:64] FLAG: --kube-reserved="" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407616 4745 flags.go:64] FLAG: --kube-reserved-cgroup="" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407621 4745 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407626 4745 flags.go:64] FLAG: --kubelet-cgroups="" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407630 4745 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407636 4745 flags.go:64] FLAG: --lock-file="" Dec 04 11:35:14.409647 master-0 kubenswrapper[4745]: I1204 11:35:14.407640 4745 flags.go:64] FLAG: --log-cadvisor-usage="false" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407645 4745 flags.go:64] FLAG: --log-flush-frequency="5s" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407650 4745 flags.go:64] FLAG: --log-json-info-buffer-size="0" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407661 4745 flags.go:64] FLAG: --log-json-split-stream="false" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407666 4745 flags.go:64] FLAG: --log-text-info-buffer-size="0" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407671 4745 flags.go:64] FLAG: --log-text-split-stream="false" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407675 4745 flags.go:64] FLAG: --logging-format="text" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407680 4745 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407685 4745 flags.go:64] FLAG: --make-iptables-util-chains="true" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407689 4745 flags.go:64] FLAG: --manifest-url="" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407694 4745 flags.go:64] FLAG: --manifest-url-header="" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407701 4745 flags.go:64] FLAG: --max-housekeeping-interval="15s" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407706 4745 flags.go:64] FLAG: --max-open-files="1000000" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407711 4745 flags.go:64] FLAG: --max-pods="110" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407716 4745 flags.go:64] FLAG: --maximum-dead-containers="-1" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407720 4745 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407725 4745 flags.go:64] FLAG: --memory-manager-policy="None" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407729 4745 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407733 4745 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407738 4745 flags.go:64] FLAG: --node-ip="192.168.32.10" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407742 4745 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/control-plane=,node-role.kubernetes.io/master=,node.openshift.io/os_id=rhcos" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407760 4745 flags.go:64] FLAG: --node-status-max-images="50" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407765 4745 flags.go:64] FLAG: --node-status-update-frequency="10s" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407769 4745 flags.go:64] FLAG: --oom-score-adj="-999" Dec 04 11:35:14.410185 master-0 kubenswrapper[4745]: I1204 11:35:14.407774 4745 flags.go:64] FLAG: --pod-cidr="" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407779 4745 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a70b2a95140d1e90978f36cc9889013ae34bd232662c5424002274385669ed9" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407787 4745 flags.go:64] FLAG: --pod-manifest-path="" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407791 4745 flags.go:64] FLAG: --pod-max-pids="-1" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407795 4745 flags.go:64] FLAG: --pods-per-core="0" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407800 4745 flags.go:64] FLAG: --port="10250" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407820 4745 flags.go:64] FLAG: --protect-kernel-defaults="false" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407825 4745 flags.go:64] FLAG: --provider-id="" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407830 4745 flags.go:64] FLAG: --qos-reserved="" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407834 4745 flags.go:64] FLAG: --read-only-port="10255" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407838 4745 flags.go:64] FLAG: --register-node="true" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407843 4745 flags.go:64] FLAG: --register-schedulable="true" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407847 4745 flags.go:64] FLAG: --register-with-taints="node-role.kubernetes.io/master=:NoSchedule" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407858 4745 flags.go:64] FLAG: --registry-burst="10" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407862 4745 flags.go:64] FLAG: --registry-qps="5" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407868 4745 flags.go:64] FLAG: --reserved-cpus="" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407872 4745 flags.go:64] FLAG: --reserved-memory="" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407880 4745 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407886 4745 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407892 4745 flags.go:64] FLAG: --rotate-certificates="false" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407897 4745 flags.go:64] FLAG: --rotate-server-certificates="false" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407902 4745 flags.go:64] FLAG: --runonce="false" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407908 4745 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407913 4745 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407917 4745 flags.go:64] FLAG: --seccomp-default="false" Dec 04 11:35:14.410666 master-0 kubenswrapper[4745]: I1204 11:35:14.407922 4745 flags.go:64] FLAG: --serialize-image-pulls="true" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.407926 4745 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.407930 4745 flags.go:64] FLAG: --storage-driver-db="cadvisor" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.407935 4745 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.407940 4745 flags.go:64] FLAG: --storage-driver-password="root" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.407944 4745 flags.go:64] FLAG: --storage-driver-secure="false" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.407948 4745 flags.go:64] FLAG: --storage-driver-table="stats" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.407953 4745 flags.go:64] FLAG: --storage-driver-user="root" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.407957 4745 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.407962 4745 flags.go:64] FLAG: --sync-frequency="1m0s" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.407966 4745 flags.go:64] FLAG: --system-cgroups="" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.407971 4745 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.407979 4745 flags.go:64] FLAG: --system-reserved-cgroup="" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.407984 4745 flags.go:64] FLAG: --tls-cert-file="" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.407988 4745 flags.go:64] FLAG: --tls-cipher-suites="[]" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.407995 4745 flags.go:64] FLAG: --tls-min-version="" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.407999 4745 flags.go:64] FLAG: --tls-private-key-file="" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.408003 4745 flags.go:64] FLAG: --topology-manager-policy="none" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.408008 4745 flags.go:64] FLAG: --topology-manager-policy-options="" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.408012 4745 flags.go:64] FLAG: --topology-manager-scope="container" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.408017 4745 flags.go:64] FLAG: --v="2" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.408025 4745 flags.go:64] FLAG: --version="false" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.408031 4745 flags.go:64] FLAG: --vmodule="" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.408037 4745 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: I1204 11:35:14.408043 4745 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Dec 04 11:35:14.411197 master-0 kubenswrapper[4745]: W1204 11:35:14.408173 4745 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 11:35:14.411696 master-0 kubenswrapper[4745]: W1204 11:35:14.408179 4745 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 11:35:14.411696 master-0 kubenswrapper[4745]: W1204 11:35:14.408184 4745 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 11:35:14.411696 master-0 kubenswrapper[4745]: W1204 11:35:14.408189 4745 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 11:35:14.411696 master-0 kubenswrapper[4745]: W1204 11:35:14.408194 4745 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 11:35:14.411696 master-0 kubenswrapper[4745]: W1204 11:35:14.408199 4745 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 11:35:14.411696 master-0 kubenswrapper[4745]: W1204 11:35:14.408204 4745 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 11:35:14.411696 master-0 kubenswrapper[4745]: W1204 11:35:14.408209 4745 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 11:35:14.411696 master-0 kubenswrapper[4745]: W1204 11:35:14.408214 4745 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 11:35:14.411696 master-0 kubenswrapper[4745]: W1204 11:35:14.408219 4745 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 11:35:14.411696 master-0 kubenswrapper[4745]: W1204 11:35:14.408224 4745 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 11:35:14.411696 master-0 kubenswrapper[4745]: W1204 11:35:14.408229 4745 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 11:35:14.411696 master-0 kubenswrapper[4745]: W1204 11:35:14.408234 4745 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 11:35:14.411696 master-0 kubenswrapper[4745]: W1204 11:35:14.408238 4745 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 11:35:14.411696 master-0 kubenswrapper[4745]: W1204 11:35:14.408242 4745 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 11:35:14.411696 master-0 kubenswrapper[4745]: W1204 11:35:14.408251 4745 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 11:35:14.411696 master-0 kubenswrapper[4745]: W1204 11:35:14.408255 4745 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 11:35:14.411696 master-0 kubenswrapper[4745]: W1204 11:35:14.408259 4745 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 11:35:14.411696 master-0 kubenswrapper[4745]: W1204 11:35:14.408265 4745 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 11:35:14.411696 master-0 kubenswrapper[4745]: W1204 11:35:14.408269 4745 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 11:35:14.411696 master-0 kubenswrapper[4745]: W1204 11:35:14.408274 4745 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 11:35:14.412306 master-0 kubenswrapper[4745]: W1204 11:35:14.408278 4745 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 11:35:14.412306 master-0 kubenswrapper[4745]: W1204 11:35:14.408281 4745 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 11:35:14.412306 master-0 kubenswrapper[4745]: W1204 11:35:14.408285 4745 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 11:35:14.412306 master-0 kubenswrapper[4745]: W1204 11:35:14.408289 4745 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 11:35:14.412306 master-0 kubenswrapper[4745]: W1204 11:35:14.408293 4745 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 11:35:14.412306 master-0 kubenswrapper[4745]: W1204 11:35:14.408296 4745 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 11:35:14.412306 master-0 kubenswrapper[4745]: W1204 11:35:14.408300 4745 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 11:35:14.412306 master-0 kubenswrapper[4745]: W1204 11:35:14.408303 4745 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 11:35:14.412306 master-0 kubenswrapper[4745]: W1204 11:35:14.408307 4745 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 11:35:14.412306 master-0 kubenswrapper[4745]: W1204 11:35:14.408311 4745 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 11:35:14.412306 master-0 kubenswrapper[4745]: W1204 11:35:14.408315 4745 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 11:35:14.412306 master-0 kubenswrapper[4745]: W1204 11:35:14.408319 4745 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 11:35:14.412306 master-0 kubenswrapper[4745]: W1204 11:35:14.408323 4745 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 11:35:14.412306 master-0 kubenswrapper[4745]: W1204 11:35:14.408327 4745 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 11:35:14.412306 master-0 kubenswrapper[4745]: W1204 11:35:14.408330 4745 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 11:35:14.412306 master-0 kubenswrapper[4745]: W1204 11:35:14.408334 4745 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 11:35:14.412306 master-0 kubenswrapper[4745]: W1204 11:35:14.408338 4745 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 11:35:14.412306 master-0 kubenswrapper[4745]: W1204 11:35:14.408342 4745 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 11:35:14.412306 master-0 kubenswrapper[4745]: W1204 11:35:14.408346 4745 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 11:35:14.412306 master-0 kubenswrapper[4745]: W1204 11:35:14.408350 4745 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 11:35:14.412719 master-0 kubenswrapper[4745]: W1204 11:35:14.408355 4745 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 11:35:14.412719 master-0 kubenswrapper[4745]: W1204 11:35:14.408360 4745 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 11:35:14.412719 master-0 kubenswrapper[4745]: W1204 11:35:14.408364 4745 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 11:35:14.412719 master-0 kubenswrapper[4745]: W1204 11:35:14.408368 4745 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 11:35:14.412719 master-0 kubenswrapper[4745]: W1204 11:35:14.408372 4745 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 11:35:14.412719 master-0 kubenswrapper[4745]: W1204 11:35:14.408376 4745 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 11:35:14.412719 master-0 kubenswrapper[4745]: W1204 11:35:14.408382 4745 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 11:35:14.412719 master-0 kubenswrapper[4745]: W1204 11:35:14.408386 4745 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 11:35:14.412719 master-0 kubenswrapper[4745]: W1204 11:35:14.408392 4745 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 11:35:14.412719 master-0 kubenswrapper[4745]: W1204 11:35:14.408396 4745 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 11:35:14.412719 master-0 kubenswrapper[4745]: W1204 11:35:14.408401 4745 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 11:35:14.412719 master-0 kubenswrapper[4745]: W1204 11:35:14.408406 4745 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 11:35:14.412719 master-0 kubenswrapper[4745]: W1204 11:35:14.408410 4745 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 11:35:14.412719 master-0 kubenswrapper[4745]: W1204 11:35:14.408414 4745 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 11:35:14.412719 master-0 kubenswrapper[4745]: W1204 11:35:14.408418 4745 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 11:35:14.412719 master-0 kubenswrapper[4745]: W1204 11:35:14.408422 4745 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 11:35:14.412719 master-0 kubenswrapper[4745]: W1204 11:35:14.408425 4745 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 11:35:14.412719 master-0 kubenswrapper[4745]: W1204 11:35:14.408429 4745 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 11:35:14.412719 master-0 kubenswrapper[4745]: W1204 11:35:14.408432 4745 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 11:35:14.413125 master-0 kubenswrapper[4745]: W1204 11:35:14.408436 4745 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 11:35:14.413125 master-0 kubenswrapper[4745]: W1204 11:35:14.408440 4745 feature_gate.go:330] unrecognized feature gate: Example Dec 04 11:35:14.413125 master-0 kubenswrapper[4745]: W1204 11:35:14.408444 4745 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 11:35:14.413125 master-0 kubenswrapper[4745]: W1204 11:35:14.408447 4745 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 11:35:14.413125 master-0 kubenswrapper[4745]: W1204 11:35:14.408451 4745 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 11:35:14.413125 master-0 kubenswrapper[4745]: W1204 11:35:14.408454 4745 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 11:35:14.413125 master-0 kubenswrapper[4745]: W1204 11:35:14.408458 4745 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 11:35:14.413125 master-0 kubenswrapper[4745]: W1204 11:35:14.408462 4745 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 11:35:14.413125 master-0 kubenswrapper[4745]: W1204 11:35:14.408466 4745 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 11:35:14.413125 master-0 kubenswrapper[4745]: W1204 11:35:14.408469 4745 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 11:35:14.413125 master-0 kubenswrapper[4745]: W1204 11:35:14.408473 4745 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 11:35:14.413125 master-0 kubenswrapper[4745]: W1204 11:35:14.408476 4745 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 11:35:14.413125 master-0 kubenswrapper[4745]: I1204 11:35:14.408491 4745 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false StreamingCollectionEncodingToJSON:false StreamingCollectionEncodingToProtobuf:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Dec 04 11:35:14.417072 master-0 kubenswrapper[4745]: I1204 11:35:14.417028 4745 server.go:491] "Kubelet version" kubeletVersion="v1.31.13" Dec 04 11:35:14.417072 master-0 kubenswrapper[4745]: I1204 11:35:14.417068 4745 server.go:493] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Dec 04 11:35:14.417180 master-0 kubenswrapper[4745]: W1204 11:35:14.417160 4745 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 11:35:14.417180 master-0 kubenswrapper[4745]: W1204 11:35:14.417176 4745 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 11:35:14.417237 master-0 kubenswrapper[4745]: W1204 11:35:14.417181 4745 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 11:35:14.417237 master-0 kubenswrapper[4745]: W1204 11:35:14.417187 4745 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 11:35:14.417237 master-0 kubenswrapper[4745]: W1204 11:35:14.417192 4745 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 11:35:14.417237 master-0 kubenswrapper[4745]: W1204 11:35:14.417197 4745 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 11:35:14.417237 master-0 kubenswrapper[4745]: W1204 11:35:14.417204 4745 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 11:35:14.417237 master-0 kubenswrapper[4745]: W1204 11:35:14.417211 4745 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 11:35:14.417237 master-0 kubenswrapper[4745]: W1204 11:35:14.417215 4745 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 11:35:14.417237 master-0 kubenswrapper[4745]: W1204 11:35:14.417220 4745 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 11:35:14.417237 master-0 kubenswrapper[4745]: W1204 11:35:14.417224 4745 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 11:35:14.417237 master-0 kubenswrapper[4745]: W1204 11:35:14.417229 4745 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 11:35:14.417237 master-0 kubenswrapper[4745]: W1204 11:35:14.417233 4745 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 11:35:14.417237 master-0 kubenswrapper[4745]: W1204 11:35:14.417237 4745 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 11:35:14.417237 master-0 kubenswrapper[4745]: W1204 11:35:14.417242 4745 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 11:35:14.417496 master-0 kubenswrapper[4745]: W1204 11:35:14.417245 4745 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 11:35:14.417496 master-0 kubenswrapper[4745]: W1204 11:35:14.417250 4745 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 11:35:14.417496 master-0 kubenswrapper[4745]: W1204 11:35:14.417255 4745 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 11:35:14.417496 master-0 kubenswrapper[4745]: W1204 11:35:14.417258 4745 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 11:35:14.417496 master-0 kubenswrapper[4745]: W1204 11:35:14.417262 4745 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 11:35:14.417496 master-0 kubenswrapper[4745]: W1204 11:35:14.417266 4745 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 11:35:14.417496 master-0 kubenswrapper[4745]: W1204 11:35:14.417270 4745 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 11:35:14.417496 master-0 kubenswrapper[4745]: W1204 11:35:14.417274 4745 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 11:35:14.417496 master-0 kubenswrapper[4745]: W1204 11:35:14.417277 4745 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 11:35:14.417496 master-0 kubenswrapper[4745]: W1204 11:35:14.417281 4745 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 11:35:14.417496 master-0 kubenswrapper[4745]: W1204 11:35:14.417286 4745 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 11:35:14.417496 master-0 kubenswrapper[4745]: W1204 11:35:14.417290 4745 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 11:35:14.417496 master-0 kubenswrapper[4745]: W1204 11:35:14.417294 4745 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 11:35:14.417496 master-0 kubenswrapper[4745]: W1204 11:35:14.417297 4745 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 11:35:14.417496 master-0 kubenswrapper[4745]: W1204 11:35:14.417301 4745 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 11:35:14.417496 master-0 kubenswrapper[4745]: W1204 11:35:14.417304 4745 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 11:35:14.417496 master-0 kubenswrapper[4745]: W1204 11:35:14.417308 4745 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 11:35:14.417496 master-0 kubenswrapper[4745]: W1204 11:35:14.417312 4745 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 11:35:14.417496 master-0 kubenswrapper[4745]: W1204 11:35:14.417315 4745 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 11:35:14.417496 master-0 kubenswrapper[4745]: W1204 11:35:14.417327 4745 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 11:35:14.417961 master-0 kubenswrapper[4745]: W1204 11:35:14.417331 4745 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 11:35:14.417961 master-0 kubenswrapper[4745]: W1204 11:35:14.417335 4745 feature_gate.go:330] unrecognized feature gate: Example Dec 04 11:35:14.417961 master-0 kubenswrapper[4745]: W1204 11:35:14.417338 4745 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 11:35:14.417961 master-0 kubenswrapper[4745]: W1204 11:35:14.417342 4745 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 11:35:14.417961 master-0 kubenswrapper[4745]: W1204 11:35:14.417346 4745 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 11:35:14.417961 master-0 kubenswrapper[4745]: W1204 11:35:14.417349 4745 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 11:35:14.417961 master-0 kubenswrapper[4745]: W1204 11:35:14.417353 4745 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 11:35:14.417961 master-0 kubenswrapper[4745]: W1204 11:35:14.417356 4745 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 11:35:14.417961 master-0 kubenswrapper[4745]: W1204 11:35:14.417360 4745 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 11:35:14.417961 master-0 kubenswrapper[4745]: W1204 11:35:14.417363 4745 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 11:35:14.417961 master-0 kubenswrapper[4745]: W1204 11:35:14.417366 4745 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 11:35:14.417961 master-0 kubenswrapper[4745]: W1204 11:35:14.417370 4745 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 11:35:14.417961 master-0 kubenswrapper[4745]: W1204 11:35:14.417373 4745 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 11:35:14.417961 master-0 kubenswrapper[4745]: W1204 11:35:14.417379 4745 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 11:35:14.417961 master-0 kubenswrapper[4745]: W1204 11:35:14.417383 4745 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 11:35:14.417961 master-0 kubenswrapper[4745]: W1204 11:35:14.417388 4745 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 11:35:14.417961 master-0 kubenswrapper[4745]: W1204 11:35:14.417391 4745 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 11:35:14.417961 master-0 kubenswrapper[4745]: W1204 11:35:14.417395 4745 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 11:35:14.417961 master-0 kubenswrapper[4745]: W1204 11:35:14.417399 4745 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 11:35:14.418474 master-0 kubenswrapper[4745]: W1204 11:35:14.417403 4745 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 11:35:14.418474 master-0 kubenswrapper[4745]: W1204 11:35:14.417406 4745 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 11:35:14.418474 master-0 kubenswrapper[4745]: W1204 11:35:14.417410 4745 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 11:35:14.418474 master-0 kubenswrapper[4745]: W1204 11:35:14.417413 4745 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 11:35:14.418474 master-0 kubenswrapper[4745]: W1204 11:35:14.417417 4745 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 11:35:14.418474 master-0 kubenswrapper[4745]: W1204 11:35:14.417420 4745 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 11:35:14.418474 master-0 kubenswrapper[4745]: W1204 11:35:14.417423 4745 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 11:35:14.418474 master-0 kubenswrapper[4745]: W1204 11:35:14.417427 4745 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 11:35:14.418474 master-0 kubenswrapper[4745]: W1204 11:35:14.417430 4745 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 11:35:14.418474 master-0 kubenswrapper[4745]: W1204 11:35:14.417434 4745 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 11:35:14.418474 master-0 kubenswrapper[4745]: W1204 11:35:14.417437 4745 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 11:35:14.418474 master-0 kubenswrapper[4745]: W1204 11:35:14.417440 4745 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 11:35:14.418474 master-0 kubenswrapper[4745]: W1204 11:35:14.417444 4745 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 11:35:14.418474 master-0 kubenswrapper[4745]: W1204 11:35:14.417447 4745 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 11:35:14.418474 master-0 kubenswrapper[4745]: W1204 11:35:14.417451 4745 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 11:35:14.418474 master-0 kubenswrapper[4745]: W1204 11:35:14.417454 4745 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 11:35:14.418474 master-0 kubenswrapper[4745]: W1204 11:35:14.417458 4745 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 11:35:14.418474 master-0 kubenswrapper[4745]: W1204 11:35:14.417462 4745 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 11:35:14.418875 master-0 kubenswrapper[4745]: I1204 11:35:14.417469 4745 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false StreamingCollectionEncodingToJSON:false StreamingCollectionEncodingToProtobuf:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Dec 04 11:35:14.418875 master-0 kubenswrapper[4745]: W1204 11:35:14.417592 4745 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 11:35:14.418875 master-0 kubenswrapper[4745]: W1204 11:35:14.417596 4745 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 11:35:14.418875 master-0 kubenswrapper[4745]: W1204 11:35:14.417600 4745 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 11:35:14.418875 master-0 kubenswrapper[4745]: W1204 11:35:14.417604 4745 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 11:35:14.418875 master-0 kubenswrapper[4745]: W1204 11:35:14.417607 4745 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 11:35:14.418875 master-0 kubenswrapper[4745]: W1204 11:35:14.417611 4745 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 11:35:14.418875 master-0 kubenswrapper[4745]: W1204 11:35:14.417615 4745 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 11:35:14.418875 master-0 kubenswrapper[4745]: W1204 11:35:14.417619 4745 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 11:35:14.418875 master-0 kubenswrapper[4745]: W1204 11:35:14.417623 4745 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 11:35:14.418875 master-0 kubenswrapper[4745]: W1204 11:35:14.417627 4745 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 11:35:14.418875 master-0 kubenswrapper[4745]: W1204 11:35:14.417631 4745 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 11:35:14.418875 master-0 kubenswrapper[4745]: W1204 11:35:14.417634 4745 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 11:35:14.418875 master-0 kubenswrapper[4745]: W1204 11:35:14.417638 4745 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 11:35:14.418875 master-0 kubenswrapper[4745]: W1204 11:35:14.417642 4745 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 11:35:14.419199 master-0 kubenswrapper[4745]: W1204 11:35:14.417645 4745 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 11:35:14.419199 master-0 kubenswrapper[4745]: W1204 11:35:14.417648 4745 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 11:35:14.419199 master-0 kubenswrapper[4745]: W1204 11:35:14.417653 4745 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 11:35:14.419199 master-0 kubenswrapper[4745]: W1204 11:35:14.417658 4745 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 11:35:14.419199 master-0 kubenswrapper[4745]: W1204 11:35:14.417662 4745 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 11:35:14.419199 master-0 kubenswrapper[4745]: W1204 11:35:14.417666 4745 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 11:35:14.419199 master-0 kubenswrapper[4745]: W1204 11:35:14.417670 4745 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 11:35:14.419199 master-0 kubenswrapper[4745]: W1204 11:35:14.417674 4745 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 11:35:14.419199 master-0 kubenswrapper[4745]: W1204 11:35:14.417683 4745 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 11:35:14.419199 master-0 kubenswrapper[4745]: W1204 11:35:14.417687 4745 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 11:35:14.419199 master-0 kubenswrapper[4745]: W1204 11:35:14.417691 4745 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 11:35:14.419199 master-0 kubenswrapper[4745]: W1204 11:35:14.417695 4745 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 11:35:14.419199 master-0 kubenswrapper[4745]: W1204 11:35:14.417699 4745 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 11:35:14.419199 master-0 kubenswrapper[4745]: W1204 11:35:14.417703 4745 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 11:35:14.419199 master-0 kubenswrapper[4745]: W1204 11:35:14.417706 4745 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 11:35:14.419199 master-0 kubenswrapper[4745]: W1204 11:35:14.417710 4745 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 11:35:14.419199 master-0 kubenswrapper[4745]: W1204 11:35:14.417713 4745 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 11:35:14.419199 master-0 kubenswrapper[4745]: W1204 11:35:14.417716 4745 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 11:35:14.419199 master-0 kubenswrapper[4745]: W1204 11:35:14.417720 4745 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 11:35:14.419199 master-0 kubenswrapper[4745]: W1204 11:35:14.417724 4745 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 11:35:14.419614 master-0 kubenswrapper[4745]: W1204 11:35:14.417728 4745 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 11:35:14.419614 master-0 kubenswrapper[4745]: W1204 11:35:14.417732 4745 feature_gate.go:330] unrecognized feature gate: Example Dec 04 11:35:14.419614 master-0 kubenswrapper[4745]: W1204 11:35:14.417735 4745 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 11:35:14.419614 master-0 kubenswrapper[4745]: W1204 11:35:14.417739 4745 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 11:35:14.419614 master-0 kubenswrapper[4745]: W1204 11:35:14.417742 4745 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 11:35:14.419614 master-0 kubenswrapper[4745]: W1204 11:35:14.417747 4745 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 11:35:14.419614 master-0 kubenswrapper[4745]: W1204 11:35:14.417750 4745 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 11:35:14.419614 master-0 kubenswrapper[4745]: W1204 11:35:14.417754 4745 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 11:35:14.419614 master-0 kubenswrapper[4745]: W1204 11:35:14.417758 4745 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 11:35:14.419614 master-0 kubenswrapper[4745]: W1204 11:35:14.417761 4745 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 11:35:14.419614 master-0 kubenswrapper[4745]: W1204 11:35:14.417764 4745 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 11:35:14.419614 master-0 kubenswrapper[4745]: W1204 11:35:14.417768 4745 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 11:35:14.419614 master-0 kubenswrapper[4745]: W1204 11:35:14.417772 4745 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 11:35:14.419614 master-0 kubenswrapper[4745]: W1204 11:35:14.417775 4745 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 11:35:14.419614 master-0 kubenswrapper[4745]: W1204 11:35:14.417779 4745 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 11:35:14.419614 master-0 kubenswrapper[4745]: W1204 11:35:14.417782 4745 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 11:35:14.419614 master-0 kubenswrapper[4745]: W1204 11:35:14.417786 4745 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 11:35:14.419614 master-0 kubenswrapper[4745]: W1204 11:35:14.417789 4745 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 11:35:14.419614 master-0 kubenswrapper[4745]: W1204 11:35:14.417793 4745 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 11:35:14.419614 master-0 kubenswrapper[4745]: W1204 11:35:14.417797 4745 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 11:35:14.420264 master-0 kubenswrapper[4745]: W1204 11:35:14.417814 4745 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 11:35:14.420264 master-0 kubenswrapper[4745]: W1204 11:35:14.417818 4745 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 11:35:14.420264 master-0 kubenswrapper[4745]: W1204 11:35:14.417822 4745 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 11:35:14.420264 master-0 kubenswrapper[4745]: W1204 11:35:14.417825 4745 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 11:35:14.420264 master-0 kubenswrapper[4745]: W1204 11:35:14.417828 4745 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 11:35:14.420264 master-0 kubenswrapper[4745]: W1204 11:35:14.417832 4745 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 11:35:14.420264 master-0 kubenswrapper[4745]: W1204 11:35:14.417837 4745 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 11:35:14.420264 master-0 kubenswrapper[4745]: W1204 11:35:14.417842 4745 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 11:35:14.420264 master-0 kubenswrapper[4745]: W1204 11:35:14.417846 4745 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 11:35:14.420264 master-0 kubenswrapper[4745]: W1204 11:35:14.417875 4745 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 11:35:14.420264 master-0 kubenswrapper[4745]: W1204 11:35:14.417880 4745 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 11:35:14.420264 master-0 kubenswrapper[4745]: W1204 11:35:14.417884 4745 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 11:35:14.420264 master-0 kubenswrapper[4745]: W1204 11:35:14.417890 4745 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 11:35:14.420264 master-0 kubenswrapper[4745]: W1204 11:35:14.417895 4745 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 11:35:14.420264 master-0 kubenswrapper[4745]: W1204 11:35:14.417900 4745 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 11:35:14.420264 master-0 kubenswrapper[4745]: W1204 11:35:14.417907 4745 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 11:35:14.420264 master-0 kubenswrapper[4745]: W1204 11:35:14.417912 4745 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 11:35:14.420264 master-0 kubenswrapper[4745]: W1204 11:35:14.417916 4745 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 11:35:14.420692 master-0 kubenswrapper[4745]: I1204 11:35:14.417922 4745 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false StreamingCollectionEncodingToJSON:false StreamingCollectionEncodingToProtobuf:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Dec 04 11:35:14.420692 master-0 kubenswrapper[4745]: I1204 11:35:14.418130 4745 server.go:940] "Client rotation is on, will bootstrap in background" Dec 04 11:35:14.420692 master-0 kubenswrapper[4745]: I1204 11:35:14.419946 4745 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Dec 04 11:35:14.420764 master-0 kubenswrapper[4745]: I1204 11:35:14.420728 4745 server.go:997] "Starting client certificate rotation" Dec 04 11:35:14.420764 master-0 kubenswrapper[4745]: I1204 11:35:14.420752 4745 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Certificate rotation is enabled Dec 04 11:35:14.421021 master-0 kubenswrapper[4745]: I1204 11:35:14.420944 4745 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Rotating certificates Dec 04 11:35:14.427047 master-0 kubenswrapper[4745]: I1204 11:35:14.426975 4745 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Dec 04 11:35:14.428834 master-0 kubenswrapper[4745]: I1204 11:35:14.428733 4745 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Dec 04 11:35:14.430028 master-0 kubenswrapper[4745]: E1204 11:35:14.429969 4745 certificate_manager.go:562] "Unhandled Error" err="kubernetes.io/kube-apiserver-client-kubelet: Failed while requesting a signed certificate from the control plane: cannot create certificate signing request: Post \"https://api-int.sno.openstack.lab:6443/apis/certificates.k8s.io/v1/certificatesigningrequests\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:35:14.439542 master-0 kubenswrapper[4745]: I1204 11:35:14.439476 4745 log.go:25] "Validated CRI v1 runtime API" Dec 04 11:35:14.442411 master-0 kubenswrapper[4745]: I1204 11:35:14.442366 4745 log.go:25] "Validated CRI v1 image API" Dec 04 11:35:14.444160 master-0 kubenswrapper[4745]: I1204 11:35:14.444123 4745 server.go:1437] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Dec 04 11:35:14.446794 master-0 kubenswrapper[4745]: I1204 11:35:14.446754 4745 fs.go:135] Filesystem UUIDs: map[1a7dfbc4-59c8-49fb-a376-2f3ae5e5e818:/dev/vda3 7B77-95E7:/dev/vda2 910678ff-f77e-4a7d-8d53-86f2ac47a823:/dev/vda4] Dec 04 11:35:14.446794 master-0 kubenswrapper[4745]: I1204 11:35:14.446782 4745 fs.go:136] Filesystem partitions: map[/dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /dev/vda3:{mountpoint:/boot major:252 minor:3 fsType:ext4 blockSize:0} /dev/vda4:{mountpoint:/var major:252 minor:4 fsType:xfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:30 fsType:tmpfs blockSize:0}] Dec 04 11:35:14.465718 master-0 kubenswrapper[4745]: I1204 11:35:14.465332 4745 manager.go:217] Machine: {Timestamp:2025-12-04 11:35:14.463985614 +0000 UTC m=+0.165974029 CPUVendorID:AuthenticAMD NumCores:16 NumPhysicalCores:1 NumSockets:16 CpuFrequency:2800000 MemoryCapacity:50514153472 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:27b5ee8bfd7d412e99796c008843ed23 SystemUUID:27b5ee8b-fd7d-412e-9979-6c008843ed23 BootID:8fe75f05-5c88-4c1f-b39c-b984078f0689 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:10102833152 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/vda4 DeviceMajor:252 DeviceMinor:4 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:30 Capacity:25257078784 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/vda3 DeviceMajor:252 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:25257074688 Type:vfs Inodes:6166278 HasInodes:true}] DiskMap:map[252:0:{Name:vda Major:252 Minor:0 Size:214748364800 Scheduler:none} 252:16:{Name:vdb Major:252 Minor:16 Size:21474836480 Scheduler:none} 252:32:{Name:vdc Major:252 Minor:32 Size:21474836480 Scheduler:none} 252:48:{Name:vdd Major:252 Minor:48 Size:21474836480 Scheduler:none} 252:64:{Name:vde Major:252 Minor:64 Size:21474836480 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:fa:16:9e:81:f6:10 Speed:0 Mtu:9000} {Name:eth0 MacAddress:fa:16:9e:81:f6:10 Speed:-1 Mtu:9000} {Name:eth1 MacAddress:fa:16:3e:d8:74:65 Speed:-1 Mtu:9000} {Name:eth2 MacAddress:fa:16:3e:d4:99:db Speed:-1 Mtu:9000} {Name:ovs-system MacAddress:ce:07:4b:8f:0c:d7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:50514153472 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:0 Size:16777216 Type:Unified Level:3}] SocketID:0 BookID: DrawerID:} {Id:0 Threads:[1] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:1 Size:16777216 Type:Unified Level:3}] SocketID:1 BookID: DrawerID:} {Id:0 Threads:[10] Caches:[{Id:10 Size:32768 Type:Data Level:1} {Id:10 Size:32768 Type:Instruction Level:1} {Id:10 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:10 Size:16777216 Type:Unified Level:3}] SocketID:10 BookID: DrawerID:} {Id:0 Threads:[11] Caches:[{Id:11 Size:32768 Type:Data Level:1} {Id:11 Size:32768 Type:Instruction Level:1} {Id:11 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:11 Size:16777216 Type:Unified Level:3}] SocketID:11 BookID: DrawerID:} {Id:0 Threads:[12] Caches:[{Id:12 Size:32768 Type:Data Level:1} {Id:12 Size:32768 Type:Instruction Level:1} {Id:12 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:12 Size:16777216 Type:Unified Level:3}] SocketID:12 BookID: DrawerID:} {Id:0 Threads:[13] Caches:[{Id:13 Size:32768 Type:Data Level:1} {Id:13 Size:32768 Type:Instruction Level:1} {Id:13 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:13 Size:16777216 Type:Unified Level:3}] SocketID:13 BookID: DrawerID:} {Id:0 Threads:[14] Caches:[{Id:14 Size:32768 Type:Data Level:1} {Id:14 Size:32768 Type:Instruction Level:1} {Id:14 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:14 Size:16777216 Type:Unified Level:3}] SocketID:14 BookID: DrawerID:} {Id:0 Threads:[15] Caches:[{Id:15 Size:32768 Type:Data Level:1} {Id:15 Size:32768 Type:Instruction Level:1} {Id:15 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:15 Size:16777216 Type:Unified Level:3}] SocketID:15 BookID: DrawerID:} {Id:0 Threads:[2] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:2 Size:16777216 Type:Unified Level:3}] SocketID:2 BookID: DrawerID:} {Id:0 Threads:[3] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:3 Size:16777216 Type:Unified Level:3}] SocketID:3 BookID: DrawerID:} {Id:0 Threads:[4] Caches:[{Id:4 Size:32768 Type:Data Level:1} {Id:4 Size:32768 Type:Instruction Level:1} {Id:4 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:4 Size:16777216 Type:Unified Level:3}] SocketID:4 BookID: DrawerID:} {Id:0 Threads:[5] Caches:[{Id:5 Size:32768 Type:Data Level:1} {Id:5 Size:32768 Type:Instruction Level:1} {Id:5 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:5 Size:16777216 Type:Unified Level:3}] SocketID:5 BookID: DrawerID:} {Id:0 Threads:[6] Caches:[{Id:6 Size:32768 Type:Data Level:1} {Id:6 Size:32768 Type:Instruction Level:1} {Id:6 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:6 Size:16777216 Type:Unified Level:3}] SocketID:6 BookID: DrawerID:} {Id:0 Threads:[7] Caches:[{Id:7 Size:32768 Type:Data Level:1} {Id:7 Size:32768 Type:Instruction Level:1} {Id:7 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:7 Size:16777216 Type:Unified Level:3}] SocketID:7 BookID: DrawerID:} {Id:0 Threads:[8] Caches:[{Id:8 Size:32768 Type:Data Level:1} {Id:8 Size:32768 Type:Instruction Level:1} {Id:8 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:8 Size:16777216 Type:Unified Level:3}] SocketID:8 BookID: DrawerID:} {Id:0 Threads:[9] Caches:[{Id:9 Size:32768 Type:Data Level:1} {Id:9 Size:32768 Type:Instruction Level:1} {Id:9 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:9 Size:16777216 Type:Unified Level:3}] SocketID:9 BookID: DrawerID:}] Caches:[] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Dec 04 11:35:14.465718 master-0 kubenswrapper[4745]: I1204 11:35:14.465625 4745 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Dec 04 11:35:14.466037 master-0 kubenswrapper[4745]: I1204 11:35:14.465828 4745 manager.go:233] Version: {KernelVersion:5.14.0-427.100.1.el9_4.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 418.94.202511170715-0 DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Dec 04 11:35:14.466419 master-0 kubenswrapper[4745]: I1204 11:35:14.466391 4745 swap_util.go:113] "Swap is on" /proc/swaps contents="Filename\t\t\t\tType\t\tSize\t\tUsed\t\tPriority" Dec 04 11:35:14.466633 master-0 kubenswrapper[4745]: I1204 11:35:14.466589 4745 container_manager_linux.go:267] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Dec 04 11:35:14.466839 master-0 kubenswrapper[4745]: I1204 11:35:14.466626 4745 container_manager_linux.go:272] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"master-0","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"ExperimentalMemoryManagerPolicy":"None","ExperimentalMemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Dec 04 11:35:14.466839 master-0 kubenswrapper[4745]: I1204 11:35:14.466839 4745 topology_manager.go:138] "Creating topology manager with none policy" Dec 04 11:35:14.466934 master-0 kubenswrapper[4745]: I1204 11:35:14.466848 4745 container_manager_linux.go:303] "Creating device plugin manager" Dec 04 11:35:14.467036 master-0 kubenswrapper[4745]: I1204 11:35:14.467013 4745 manager.go:142] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Dec 04 11:35:14.467066 master-0 kubenswrapper[4745]: I1204 11:35:14.467040 4745 server.go:66] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Dec 04 11:35:14.467320 master-0 kubenswrapper[4745]: I1204 11:35:14.467298 4745 state_mem.go:36] "Initialized new in-memory state store" Dec 04 11:35:14.467413 master-0 kubenswrapper[4745]: I1204 11:35:14.467384 4745 server.go:1245] "Using root directory" path="/var/lib/kubelet" Dec 04 11:35:14.468082 master-0 kubenswrapper[4745]: I1204 11:35:14.468055 4745 kubelet.go:418] "Attempting to sync node with API server" Dec 04 11:35:14.468082 master-0 kubenswrapper[4745]: I1204 11:35:14.468074 4745 kubelet.go:313] "Adding static pod path" path="/etc/kubernetes/manifests" Dec 04 11:35:14.468169 master-0 kubenswrapper[4745]: I1204 11:35:14.468108 4745 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Dec 04 11:35:14.468169 master-0 kubenswrapper[4745]: I1204 11:35:14.468122 4745 kubelet.go:324] "Adding apiserver pod source" Dec 04 11:35:14.468169 master-0 kubenswrapper[4745]: I1204 11:35:14.468139 4745 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Dec 04 11:35:14.470143 master-0 kubenswrapper[4745]: I1204 11:35:14.470110 4745 kuberuntime_manager.go:262] "Container runtime initialized" containerRuntime="cri-o" version="1.31.13-2.rhaos4.18.git15789b8.el9" apiVersion="v1" Dec 04 11:35:14.470789 master-0 kubenswrapper[4745]: W1204 11:35:14.470658 4745 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://api-int.sno.openstack.lab:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:14.470789 master-0 kubenswrapper[4745]: W1204 11:35:14.470714 4745 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://api-int.sno.openstack.lab:6443/api/v1/nodes?fieldSelector=metadata.name%3Dmaster-0&limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:14.471093 master-0 kubenswrapper[4745]: E1204 11:35:14.470820 4745 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get \"https://api-int.sno.openstack.lab:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:35:14.471093 master-0 kubenswrapper[4745]: E1204 11:35:14.470825 4745 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes?fieldSelector=metadata.name%3Dmaster-0&limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:35:14.471146 master-0 kubenswrapper[4745]: I1204 11:35:14.471097 4745 kubelet.go:854] "Not starting ClusterTrustBundle informer because we are in static kubelet mode" Dec 04 11:35:14.471323 master-0 kubenswrapper[4745]: I1204 11:35:14.471290 4745 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Dec 04 11:35:14.471323 master-0 kubenswrapper[4745]: I1204 11:35:14.471320 4745 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Dec 04 11:35:14.471449 master-0 kubenswrapper[4745]: I1204 11:35:14.471334 4745 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Dec 04 11:35:14.471449 master-0 kubenswrapper[4745]: I1204 11:35:14.471343 4745 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Dec 04 11:35:14.471449 master-0 kubenswrapper[4745]: I1204 11:35:14.471352 4745 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Dec 04 11:35:14.471449 master-0 kubenswrapper[4745]: I1204 11:35:14.471360 4745 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/secret" Dec 04 11:35:14.471449 master-0 kubenswrapper[4745]: I1204 11:35:14.471369 4745 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Dec 04 11:35:14.471449 master-0 kubenswrapper[4745]: I1204 11:35:14.471377 4745 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Dec 04 11:35:14.471449 master-0 kubenswrapper[4745]: I1204 11:35:14.471389 4745 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/fc" Dec 04 11:35:14.471449 master-0 kubenswrapper[4745]: I1204 11:35:14.471397 4745 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Dec 04 11:35:14.471449 master-0 kubenswrapper[4745]: I1204 11:35:14.471409 4745 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/projected" Dec 04 11:35:14.471449 master-0 kubenswrapper[4745]: I1204 11:35:14.471422 4745 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Dec 04 11:35:14.471731 master-0 kubenswrapper[4745]: I1204 11:35:14.471653 4745 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/csi" Dec 04 11:35:14.472157 master-0 kubenswrapper[4745]: I1204 11:35:14.472133 4745 server.go:1280] "Started kubelet" Dec 04 11:35:14.472638 master-0 kubenswrapper[4745]: I1204 11:35:14.472591 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:14.472954 master-0 kubenswrapper[4745]: I1204 11:35:14.472878 4745 server.go:163] "Starting to listen" address="0.0.0.0" port=10250 Dec 04 11:35:14.473008 master-0 kubenswrapper[4745]: I1204 11:35:14.472950 4745 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Dec 04 11:35:14.473046 master-0 kubenswrapper[4745]: I1204 11:35:14.473028 4745 server_v1.go:47] "podresources" method="list" useActivePods=true Dec 04 11:35:14.473682 master-0 systemd[1]: Started Kubernetes Kubelet. Dec 04 11:35:14.474689 master-0 kubenswrapper[4745]: I1204 11:35:14.474645 4745 server.go:236] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Dec 04 11:35:14.476437 master-0 kubenswrapper[4745]: I1204 11:35:14.476398 4745 certificate_manager.go:356] kubernetes.io/kubelet-serving: Certificate rotation is enabled Dec 04 11:35:14.476503 master-0 kubenswrapper[4745]: I1204 11:35:14.476457 4745 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Dec 04 11:35:14.477017 master-0 kubenswrapper[4745]: E1204 11:35:14.476990 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:14.477136 master-0 kubenswrapper[4745]: I1204 11:35:14.477102 4745 volume_manager.go:287] "The desired_state_of_world populator starts" Dec 04 11:35:14.477136 master-0 kubenswrapper[4745]: I1204 11:35:14.477128 4745 volume_manager.go:289] "Starting Kubelet Volume Manager" Dec 04 11:35:14.477228 master-0 kubenswrapper[4745]: I1204 11:35:14.477199 4745 server.go:449] "Adding debug handlers to kubelet server" Dec 04 11:35:14.480238 master-0 kubenswrapper[4745]: E1204 11:35:14.476355 4745 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/default/events\": dial tcp 192.168.32.10:6443: connect: connection refused" event="&Event{ObjectMeta:{master-0.187e000271a0a2e3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.472100579 +0000 UTC m=+0.174088984,LastTimestamp:2025-12-04 11:35:14.472100579 +0000 UTC m=+0.174088984,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:14.480649 master-0 kubenswrapper[4745]: I1204 11:35:14.480625 4745 desired_state_of_world_populator.go:147] "Desired state populator starts to run" Dec 04 11:35:14.481012 master-0 kubenswrapper[4745]: I1204 11:35:14.480986 4745 reconstruct.go:97] "Volume reconstruction finished" Dec 04 11:35:14.481012 master-0 kubenswrapper[4745]: I1204 11:35:14.481009 4745 reconciler.go:26] "Reconciler: start to sync state" Dec 04 11:35:14.481604 master-0 kubenswrapper[4745]: W1204 11:35:14.481512 4745 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:14.481649 master-0 kubenswrapper[4745]: I1204 11:35:14.481618 4745 factory.go:55] Registering systemd factory Dec 04 11:35:14.481649 master-0 kubenswrapper[4745]: I1204 11:35:14.481646 4745 factory.go:221] Registration of the systemd container factory successfully Dec 04 11:35:14.481709 master-0 kubenswrapper[4745]: E1204 11:35:14.481629 4745 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get \"https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:35:14.481709 master-0 kubenswrapper[4745]: E1204 11:35:14.481566 4745 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="200ms" Dec 04 11:35:14.483358 master-0 kubenswrapper[4745]: I1204 11:35:14.483325 4745 factory.go:153] Registering CRI-O factory Dec 04 11:35:14.483358 master-0 kubenswrapper[4745]: I1204 11:35:14.483351 4745 factory.go:221] Registration of the crio container factory successfully Dec 04 11:35:14.483463 master-0 kubenswrapper[4745]: I1204 11:35:14.483439 4745 factory.go:219] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Dec 04 11:35:14.483510 master-0 kubenswrapper[4745]: I1204 11:35:14.483478 4745 factory.go:103] Registering Raw factory Dec 04 11:35:14.483510 master-0 kubenswrapper[4745]: I1204 11:35:14.483500 4745 manager.go:1196] Started watching for new ooms in manager Dec 04 11:35:14.484169 master-0 kubenswrapper[4745]: I1204 11:35:14.484144 4745 manager.go:319] Starting recovery of all containers Dec 04 11:35:14.488610 master-0 kubenswrapper[4745]: E1204 11:35:14.488566 4745 kubelet.go:1495] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Dec 04 11:35:14.504761 master-0 kubenswrapper[4745]: I1204 11:35:14.504486 4745 manager.go:324] Recovery completed Dec 04 11:35:14.516176 master-0 kubenswrapper[4745]: I1204 11:35:14.516106 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:14.517503 master-0 kubenswrapper[4745]: I1204 11:35:14.517475 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:14.517568 master-0 kubenswrapper[4745]: I1204 11:35:14.517513 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:14.517568 master-0 kubenswrapper[4745]: I1204 11:35:14.517528 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:14.518777 master-0 kubenswrapper[4745]: I1204 11:35:14.518747 4745 cpu_manager.go:225] "Starting CPU manager" policy="none" Dec 04 11:35:14.518777 master-0 kubenswrapper[4745]: I1204 11:35:14.518776 4745 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" Dec 04 11:35:14.518916 master-0 kubenswrapper[4745]: I1204 11:35:14.518846 4745 state_mem.go:36] "Initialized new in-memory state store" Dec 04 11:35:14.545397 master-0 kubenswrapper[4745]: I1204 11:35:14.545311 4745 policy_none.go:49] "None policy: Start" Dec 04 11:35:14.546766 master-0 kubenswrapper[4745]: I1204 11:35:14.546727 4745 memory_manager.go:170] "Starting memorymanager" policy="None" Dec 04 11:35:14.546766 master-0 kubenswrapper[4745]: I1204 11:35:14.546764 4745 state_mem.go:35] "Initializing new in-memory state store" Dec 04 11:35:14.577166 master-0 kubenswrapper[4745]: E1204 11:35:14.577056 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:14.619056 master-0 kubenswrapper[4745]: I1204 11:35:14.605125 4745 manager.go:334] "Starting Device Plugin manager" Dec 04 11:35:14.619056 master-0 kubenswrapper[4745]: I1204 11:35:14.605259 4745 manager.go:513] "Failed to read data from checkpoint" checkpoint="kubelet_internal_checkpoint" err="checkpoint is not found" Dec 04 11:35:14.619056 master-0 kubenswrapper[4745]: I1204 11:35:14.605271 4745 server.go:79] "Starting device plugin registration server" Dec 04 11:35:14.619056 master-0 kubenswrapper[4745]: I1204 11:35:14.605765 4745 eviction_manager.go:189] "Eviction manager: starting control loop" Dec 04 11:35:14.619056 master-0 kubenswrapper[4745]: I1204 11:35:14.605780 4745 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Dec 04 11:35:14.619056 master-0 kubenswrapper[4745]: I1204 11:35:14.606058 4745 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Dec 04 11:35:14.619056 master-0 kubenswrapper[4745]: I1204 11:35:14.606139 4745 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Dec 04 11:35:14.619056 master-0 kubenswrapper[4745]: I1204 11:35:14.606148 4745 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Dec 04 11:35:14.619056 master-0 kubenswrapper[4745]: E1204 11:35:14.607924 4745 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"master-0\" not found" Dec 04 11:35:14.623292 master-0 kubenswrapper[4745]: I1204 11:35:14.623224 4745 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv4" Dec 04 11:35:14.625222 master-0 kubenswrapper[4745]: I1204 11:35:14.625181 4745 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv6" Dec 04 11:35:14.625299 master-0 kubenswrapper[4745]: I1204 11:35:14.625231 4745 status_manager.go:217] "Starting to sync pod status with apiserver" Dec 04 11:35:14.625299 master-0 kubenswrapper[4745]: I1204 11:35:14.625256 4745 kubelet.go:2335] "Starting kubelet main sync loop" Dec 04 11:35:14.625383 master-0 kubenswrapper[4745]: E1204 11:35:14.625300 4745 kubelet.go:2359] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Dec 04 11:35:14.626835 master-0 kubenswrapper[4745]: W1204 11:35:14.626729 4745 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: Get "https://api-int.sno.openstack.lab:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:14.626907 master-0 kubenswrapper[4745]: E1204 11:35:14.626846 4745 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get \"https://api-int.sno.openstack.lab:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:35:14.683180 master-0 kubenswrapper[4745]: E1204 11:35:14.682973 4745 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="400ms" Dec 04 11:35:14.708188 master-0 kubenswrapper[4745]: I1204 11:35:14.708070 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:14.709487 master-0 kubenswrapper[4745]: I1204 11:35:14.709433 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:14.709487 master-0 kubenswrapper[4745]: I1204 11:35:14.709478 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:14.709487 master-0 kubenswrapper[4745]: I1204 11:35:14.709488 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:14.709687 master-0 kubenswrapper[4745]: I1204 11:35:14.709510 4745 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 11:35:14.710233 master-0 kubenswrapper[4745]: E1204 11:35:14.710191 4745 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/nodes\": dial tcp 192.168.32.10:6443: connect: connection refused" node="master-0" Dec 04 11:35:14.726452 master-0 kubenswrapper[4745]: I1204 11:35:14.726349 4745 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-master-0","openshift-etcd/etcd-master-0-master-0","openshift-kube-apiserver/bootstrap-kube-apiserver-master-0","kube-system/bootstrap-kube-controller-manager-master-0","kube-system/bootstrap-kube-scheduler-master-0"] Dec 04 11:35:14.726452 master-0 kubenswrapper[4745]: I1204 11:35:14.726454 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:14.727311 master-0 kubenswrapper[4745]: I1204 11:35:14.727258 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:14.727311 master-0 kubenswrapper[4745]: I1204 11:35:14.727283 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:14.727311 master-0 kubenswrapper[4745]: I1204 11:35:14.727291 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:14.727600 master-0 kubenswrapper[4745]: I1204 11:35:14.727358 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:14.727600 master-0 kubenswrapper[4745]: I1204 11:35:14.727548 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 11:35:14.727600 master-0 kubenswrapper[4745]: I1204 11:35:14.727574 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:14.728081 master-0 kubenswrapper[4745]: I1204 11:35:14.728025 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:14.728141 master-0 kubenswrapper[4745]: I1204 11:35:14.728094 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:14.728141 master-0 kubenswrapper[4745]: I1204 11:35:14.728103 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:14.728197 master-0 kubenswrapper[4745]: I1204 11:35:14.728047 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:14.728197 master-0 kubenswrapper[4745]: I1204 11:35:14.728164 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:14.728197 master-0 kubenswrapper[4745]: I1204 11:35:14.728172 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:14.728270 master-0 kubenswrapper[4745]: I1204 11:35:14.728216 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:14.728380 master-0 kubenswrapper[4745]: I1204 11:35:14.728350 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:35:14.728421 master-0 kubenswrapper[4745]: I1204 11:35:14.728386 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:14.729009 master-0 kubenswrapper[4745]: I1204 11:35:14.728977 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:14.729009 master-0 kubenswrapper[4745]: I1204 11:35:14.729002 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:14.729156 master-0 kubenswrapper[4745]: I1204 11:35:14.729015 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:14.729156 master-0 kubenswrapper[4745]: I1204 11:35:14.729028 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:14.729156 master-0 kubenswrapper[4745]: I1204 11:35:14.729061 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:14.729156 master-0 kubenswrapper[4745]: I1204 11:35:14.729072 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:14.729299 master-0 kubenswrapper[4745]: I1204 11:35:14.729240 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:14.729336 master-0 kubenswrapper[4745]: I1204 11:35:14.729313 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:14.729374 master-0 kubenswrapper[4745]: I1204 11:35:14.729341 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:14.729957 master-0 kubenswrapper[4745]: I1204 11:35:14.729926 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:14.729957 master-0 kubenswrapper[4745]: I1204 11:35:14.729956 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:14.730064 master-0 kubenswrapper[4745]: I1204 11:35:14.729970 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:14.730100 master-0 kubenswrapper[4745]: I1204 11:35:14.730067 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:14.730100 master-0 kubenswrapper[4745]: I1204 11:35:14.730093 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:14.730156 master-0 kubenswrapper[4745]: I1204 11:35:14.730112 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:14.730156 master-0 kubenswrapper[4745]: I1204 11:35:14.730120 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:14.730352 master-0 kubenswrapper[4745]: I1204 11:35:14.730324 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:14.730352 master-0 kubenswrapper[4745]: I1204 11:35:14.730351 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:14.730517 master-0 kubenswrapper[4745]: I1204 11:35:14.730490 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:14.730517 master-0 kubenswrapper[4745]: I1204 11:35:14.730510 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:14.730517 master-0 kubenswrapper[4745]: I1204 11:35:14.730518 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:14.730612 master-0 kubenswrapper[4745]: I1204 11:35:14.730597 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 11:35:14.730612 master-0 kubenswrapper[4745]: I1204 11:35:14.730612 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:14.730996 master-0 kubenswrapper[4745]: I1204 11:35:14.730843 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:14.730996 master-0 kubenswrapper[4745]: I1204 11:35:14.730865 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:14.730996 master-0 kubenswrapper[4745]: I1204 11:35:14.730873 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:14.731158 master-0 kubenswrapper[4745]: I1204 11:35:14.731131 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:14.731158 master-0 kubenswrapper[4745]: I1204 11:35:14.731154 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:14.731229 master-0 kubenswrapper[4745]: I1204 11:35:14.731163 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:14.782636 master-0 kubenswrapper[4745]: I1204 11:35:14.782582 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-secrets\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:14.782735 master-0 kubenswrapper[4745]: I1204 11:35:14.782638 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-audit-dir\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:14.782735 master-0 kubenswrapper[4745]: I1204 11:35:14.782674 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-config\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:14.782800 master-0 kubenswrapper[4745]: I1204 11:35:14.782738 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-logs\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:14.782800 master-0 kubenswrapper[4745]: I1204 11:35:14.782766 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/host-path/cc0396a9a2689b3e8c132c12640cbe83-certs\") pod \"etcd-master-0-master-0\" (UID: \"cc0396a9a2689b3e8c132c12640cbe83\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:35:14.782800 master-0 kubenswrapper[4745]: I1204 11:35:14.782794 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-etc-kubernetes-cloud\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:14.782909 master-0 kubenswrapper[4745]: I1204 11:35:14.782835 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-ssl-certs-host\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:14.782909 master-0 kubenswrapper[4745]: I1204 11:35:14.782858 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/5e09e2af7200e6f9be469dbfd9bb1127-logs\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"5e09e2af7200e6f9be469dbfd9bb1127\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 11:35:14.782909 master-0 kubenswrapper[4745]: I1204 11:35:14.782877 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3169f44496ed8a28c6d6a15511ab0eec-etc-kube\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"3169f44496ed8a28c6d6a15511ab0eec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 11:35:14.782909 master-0 kubenswrapper[4745]: I1204 11:35:14.782897 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/cc0396a9a2689b3e8c132c12640cbe83-data-dir\") pod \"etcd-master-0-master-0\" (UID: \"cc0396a9a2689b3e8c132c12640cbe83\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:35:14.783014 master-0 kubenswrapper[4745]: I1204 11:35:14.782937 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-config\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:14.783014 master-0 kubenswrapper[4745]: I1204 11:35:14.782962 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-secrets\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:14.783068 master-0 kubenswrapper[4745]: I1204 11:35:14.783004 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-ssl-certs-host\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:14.783068 master-0 kubenswrapper[4745]: I1204 11:35:14.783044 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3169f44496ed8a28c6d6a15511ab0eec-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"3169f44496ed8a28c6d6a15511ab0eec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 11:35:14.783118 master-0 kubenswrapper[4745]: I1204 11:35:14.783073 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-logs\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:14.783118 master-0 kubenswrapper[4745]: I1204 11:35:14.783101 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-etc-kubernetes-cloud\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:14.783172 master-0 kubenswrapper[4745]: I1204 11:35:14.783129 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/5e09e2af7200e6f9be469dbfd9bb1127-secrets\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"5e09e2af7200e6f9be469dbfd9bb1127\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 11:35:14.884217 master-0 kubenswrapper[4745]: I1204 11:35:14.884081 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-secrets\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:14.884217 master-0 kubenswrapper[4745]: I1204 11:35:14.884146 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-audit-dir\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:14.884217 master-0 kubenswrapper[4745]: I1204 11:35:14.884164 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-config\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:14.884502 master-0 kubenswrapper[4745]: I1204 11:35:14.884312 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-secrets\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:14.884502 master-0 kubenswrapper[4745]: I1204 11:35:14.884339 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-logs\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:14.884502 master-0 kubenswrapper[4745]: I1204 11:35:14.884387 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/host-path/cc0396a9a2689b3e8c132c12640cbe83-certs\") pod \"etcd-master-0-master-0\" (UID: \"cc0396a9a2689b3e8c132c12640cbe83\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:35:14.884502 master-0 kubenswrapper[4745]: I1204 11:35:14.884371 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-logs\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:14.884502 master-0 kubenswrapper[4745]: I1204 11:35:14.884417 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-etc-kubernetes-cloud\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:14.884502 master-0 kubenswrapper[4745]: I1204 11:35:14.884446 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-etc-kubernetes-cloud\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:14.884502 master-0 kubenswrapper[4745]: I1204 11:35:14.884454 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-ssl-certs-host\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:14.884502 master-0 kubenswrapper[4745]: I1204 11:35:14.884506 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/5e09e2af7200e6f9be469dbfd9bb1127-logs\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"5e09e2af7200e6f9be469dbfd9bb1127\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 11:35:14.884705 master-0 kubenswrapper[4745]: I1204 11:35:14.884528 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-ssl-certs-host\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:14.884705 master-0 kubenswrapper[4745]: I1204 11:35:14.884558 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-ssl-certs-host\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:14.884705 master-0 kubenswrapper[4745]: I1204 11:35:14.884598 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"certs\" (UniqueName: \"kubernetes.io/host-path/cc0396a9a2689b3e8c132c12640cbe83-certs\") pod \"etcd-master-0-master-0\" (UID: \"cc0396a9a2689b3e8c132c12640cbe83\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:35:14.884705 master-0 kubenswrapper[4745]: I1204 11:35:14.884602 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-config\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:14.884705 master-0 kubenswrapper[4745]: I1204 11:35:14.884621 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3169f44496ed8a28c6d6a15511ab0eec-etc-kube\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"3169f44496ed8a28c6d6a15511ab0eec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 11:35:14.884705 master-0 kubenswrapper[4745]: I1204 11:35:14.884669 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/5e09e2af7200e6f9be469dbfd9bb1127-logs\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"5e09e2af7200e6f9be469dbfd9bb1127\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 11:35:14.884705 master-0 kubenswrapper[4745]: I1204 11:35:14.884681 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3169f44496ed8a28c6d6a15511ab0eec-etc-kube\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"3169f44496ed8a28c6d6a15511ab0eec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 11:35:14.884705 master-0 kubenswrapper[4745]: I1204 11:35:14.884658 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-audit-dir\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:14.884705 master-0 kubenswrapper[4745]: I1204 11:35:14.884644 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-ssl-certs-host\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:14.884705 master-0 kubenswrapper[4745]: I1204 11:35:14.884684 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/cc0396a9a2689b3e8c132c12640cbe83-data-dir\") pod \"etcd-master-0-master-0\" (UID: \"cc0396a9a2689b3e8c132c12640cbe83\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:35:14.884705 master-0 kubenswrapper[4745]: I1204 11:35:14.884712 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/cc0396a9a2689b3e8c132c12640cbe83-data-dir\") pod \"etcd-master-0-master-0\" (UID: \"cc0396a9a2689b3e8c132c12640cbe83\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:35:14.885017 master-0 kubenswrapper[4745]: I1204 11:35:14.884732 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-config\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:14.885017 master-0 kubenswrapper[4745]: I1204 11:35:14.884765 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-secrets\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:14.885017 master-0 kubenswrapper[4745]: I1204 11:35:14.884775 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-config\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:14.885017 master-0 kubenswrapper[4745]: I1204 11:35:14.884829 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-secrets\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:14.885017 master-0 kubenswrapper[4745]: I1204 11:35:14.884800 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3169f44496ed8a28c6d6a15511ab0eec-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"3169f44496ed8a28c6d6a15511ab0eec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 11:35:14.885017 master-0 kubenswrapper[4745]: I1204 11:35:14.884868 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3169f44496ed8a28c6d6a15511ab0eec-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"3169f44496ed8a28c6d6a15511ab0eec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 11:35:14.885017 master-0 kubenswrapper[4745]: I1204 11:35:14.884881 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-logs\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:14.885017 master-0 kubenswrapper[4745]: I1204 11:35:14.884908 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-etc-kubernetes-cloud\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:14.885017 master-0 kubenswrapper[4745]: I1204 11:35:14.884927 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-logs\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:14.885017 master-0 kubenswrapper[4745]: I1204 11:35:14.884935 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/5e09e2af7200e6f9be469dbfd9bb1127-secrets\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"5e09e2af7200e6f9be469dbfd9bb1127\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 11:35:14.885017 master-0 kubenswrapper[4745]: I1204 11:35:14.884970 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/5e09e2af7200e6f9be469dbfd9bb1127-secrets\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"5e09e2af7200e6f9be469dbfd9bb1127\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 11:35:14.885017 master-0 kubenswrapper[4745]: I1204 11:35:14.884970 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-etc-kubernetes-cloud\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:14.911310 master-0 kubenswrapper[4745]: I1204 11:35:14.911198 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:14.913029 master-0 kubenswrapper[4745]: I1204 11:35:14.912986 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:14.913085 master-0 kubenswrapper[4745]: I1204 11:35:14.913037 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:14.913085 master-0 kubenswrapper[4745]: I1204 11:35:14.913048 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:14.913143 master-0 kubenswrapper[4745]: I1204 11:35:14.913094 4745 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 11:35:14.913962 master-0 kubenswrapper[4745]: E1204 11:35:14.913913 4745 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/nodes\": dial tcp 192.168.32.10:6443: connect: connection refused" node="master-0" Dec 04 11:35:15.066743 master-0 kubenswrapper[4745]: I1204 11:35:15.066643 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 11:35:15.083697 master-0 kubenswrapper[4745]: E1204 11:35:15.083615 4745 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="800ms" Dec 04 11:35:15.087986 master-0 kubenswrapper[4745]: I1204 11:35:15.087940 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:35:15.115193 master-0 kubenswrapper[4745]: I1204 11:35:15.115098 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:15.126102 master-0 kubenswrapper[4745]: I1204 11:35:15.125977 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:15.131055 master-0 kubenswrapper[4745]: I1204 11:35:15.130969 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 11:35:15.301949 master-0 kubenswrapper[4745]: W1204 11:35:15.301760 4745 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://api-int.sno.openstack.lab:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:15.301949 master-0 kubenswrapper[4745]: E1204 11:35:15.301884 4745 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get \"https://api-int.sno.openstack.lab:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:35:15.314458 master-0 kubenswrapper[4745]: I1204 11:35:15.314367 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:15.316397 master-0 kubenswrapper[4745]: I1204 11:35:15.316325 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:15.316397 master-0 kubenswrapper[4745]: I1204 11:35:15.316371 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:15.316397 master-0 kubenswrapper[4745]: I1204 11:35:15.316386 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:15.316846 master-0 kubenswrapper[4745]: I1204 11:35:15.316463 4745 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 11:35:15.317603 master-0 kubenswrapper[4745]: E1204 11:35:15.317546 4745 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/nodes\": dial tcp 192.168.32.10:6443: connect: connection refused" node="master-0" Dec 04 11:35:15.474302 master-0 kubenswrapper[4745]: I1204 11:35:15.474200 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:15.489026 master-0 kubenswrapper[4745]: W1204 11:35:15.488932 4745 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://api-int.sno.openstack.lab:6443/api/v1/nodes?fieldSelector=metadata.name%3Dmaster-0&limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:15.489218 master-0 kubenswrapper[4745]: E1204 11:35:15.489035 4745 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes?fieldSelector=metadata.name%3Dmaster-0&limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:35:15.624578 master-0 kubenswrapper[4745]: W1204 11:35:15.624351 4745 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: Get "https://api-int.sno.openstack.lab:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:15.624578 master-0 kubenswrapper[4745]: E1204 11:35:15.624450 4745 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get \"https://api-int.sno.openstack.lab:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:35:15.708204 master-0 kubenswrapper[4745]: W1204 11:35:15.708117 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b47694fcc32464ab24d09c23d6efb57.slice/crio-adbccd36bc5c65e5e88e6060aa8c07788d2d0acd9edee809c8e2d70678390332 WatchSource:0}: Error finding container adbccd36bc5c65e5e88e6060aa8c07788d2d0acd9edee809c8e2d70678390332: Status 404 returned error can't find the container with id adbccd36bc5c65e5e88e6060aa8c07788d2d0acd9edee809c8e2d70678390332 Dec 04 11:35:15.713481 master-0 kubenswrapper[4745]: I1204 11:35:15.713433 4745 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Dec 04 11:35:15.721076 master-0 kubenswrapper[4745]: W1204 11:35:15.721021 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd75143d9bc4a2dc15781dc51ccff632a.slice/crio-59191695c89f8cecbba881756b5ffc5e4c892fd02facf20cc198ade1bf4ec267 WatchSource:0}: Error finding container 59191695c89f8cecbba881756b5ffc5e4c892fd02facf20cc198ade1bf4ec267: Status 404 returned error can't find the container with id 59191695c89f8cecbba881756b5ffc5e4c892fd02facf20cc198ade1bf4ec267 Dec 04 11:35:15.761429 master-0 kubenswrapper[4745]: W1204 11:35:15.761338 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc0396a9a2689b3e8c132c12640cbe83.slice/crio-1118687f000f059298fcb4f89292520334eab60bb7e784774b74bdb9bc2421bc WatchSource:0}: Error finding container 1118687f000f059298fcb4f89292520334eab60bb7e784774b74bdb9bc2421bc: Status 404 returned error can't find the container with id 1118687f000f059298fcb4f89292520334eab60bb7e784774b74bdb9bc2421bc Dec 04 11:35:15.780507 master-0 kubenswrapper[4745]: W1204 11:35:15.780420 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3169f44496ed8a28c6d6a15511ab0eec.slice/crio-870c232b93a5ee37a81fedb1347de97a51e51c964baa741a79bf8da03ca09932 WatchSource:0}: Error finding container 870c232b93a5ee37a81fedb1347de97a51e51c964baa741a79bf8da03ca09932: Status 404 returned error can't find the container with id 870c232b93a5ee37a81fedb1347de97a51e51c964baa741a79bf8da03ca09932 Dec 04 11:35:15.811249 master-0 kubenswrapper[4745]: W1204 11:35:15.811196 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e09e2af7200e6f9be469dbfd9bb1127.slice/crio-6080c82a1de6439e859491a681111c8d2ae9907c581f1c30e651428ab5f16038 WatchSource:0}: Error finding container 6080c82a1de6439e859491a681111c8d2ae9907c581f1c30e651428ab5f16038: Status 404 returned error can't find the container with id 6080c82a1de6439e859491a681111c8d2ae9907c581f1c30e651428ab5f16038 Dec 04 11:35:15.885508 master-0 kubenswrapper[4745]: E1204 11:35:15.885296 4745 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="1.6s" Dec 04 11:35:15.955490 master-0 kubenswrapper[4745]: W1204 11:35:15.955335 4745 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:15.955490 master-0 kubenswrapper[4745]: E1204 11:35:15.955484 4745 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get \"https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:35:16.118591 master-0 kubenswrapper[4745]: I1204 11:35:16.118504 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:16.120001 master-0 kubenswrapper[4745]: I1204 11:35:16.119945 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:16.120077 master-0 kubenswrapper[4745]: I1204 11:35:16.120013 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:16.120077 master-0 kubenswrapper[4745]: I1204 11:35:16.120030 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:16.120160 master-0 kubenswrapper[4745]: I1204 11:35:16.120094 4745 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 11:35:16.121069 master-0 kubenswrapper[4745]: E1204 11:35:16.121020 4745 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/nodes\": dial tcp 192.168.32.10:6443: connect: connection refused" node="master-0" Dec 04 11:35:16.474870 master-0 kubenswrapper[4745]: I1204 11:35:16.474782 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:16.516555 master-0 kubenswrapper[4745]: I1204 11:35:16.516496 4745 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Rotating certificates Dec 04 11:35:16.518590 master-0 kubenswrapper[4745]: E1204 11:35:16.518523 4745 certificate_manager.go:562] "Unhandled Error" err="kubernetes.io/kube-apiserver-client-kubelet: Failed while requesting a signed certificate from the control plane: cannot create certificate signing request: Post \"https://api-int.sno.openstack.lab:6443/apis/certificates.k8s.io/v1/certificatesigningrequests\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:35:16.632030 master-0 kubenswrapper[4745]: I1204 11:35:16.631846 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"3169f44496ed8a28c6d6a15511ab0eec","Type":"ContainerStarted","Data":"870c232b93a5ee37a81fedb1347de97a51e51c964baa741a79bf8da03ca09932"} Dec 04 11:35:16.633280 master-0 kubenswrapper[4745]: I1204 11:35:16.633217 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0-master-0" event={"ID":"cc0396a9a2689b3e8c132c12640cbe83","Type":"ContainerStarted","Data":"1118687f000f059298fcb4f89292520334eab60bb7e784774b74bdb9bc2421bc"} Dec 04 11:35:16.634443 master-0 kubenswrapper[4745]: I1204 11:35:16.634366 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" event={"ID":"d75143d9bc4a2dc15781dc51ccff632a","Type":"ContainerStarted","Data":"59191695c89f8cecbba881756b5ffc5e4c892fd02facf20cc198ade1bf4ec267"} Dec 04 11:35:16.635728 master-0 kubenswrapper[4745]: I1204 11:35:16.635580 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"8b47694fcc32464ab24d09c23d6efb57","Type":"ContainerStarted","Data":"adbccd36bc5c65e5e88e6060aa8c07788d2d0acd9edee809c8e2d70678390332"} Dec 04 11:35:16.637055 master-0 kubenswrapper[4745]: I1204 11:35:16.637026 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-scheduler-master-0" event={"ID":"5e09e2af7200e6f9be469dbfd9bb1127","Type":"ContainerStarted","Data":"6080c82a1de6439e859491a681111c8d2ae9907c581f1c30e651428ab5f16038"} Dec 04 11:35:17.415628 master-0 kubenswrapper[4745]: W1204 11:35:17.415145 4745 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: Get "https://api-int.sno.openstack.lab:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:17.415885 master-0 kubenswrapper[4745]: E1204 11:35:17.415643 4745 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get \"https://api-int.sno.openstack.lab:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:35:17.474483 master-0 kubenswrapper[4745]: I1204 11:35:17.474387 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:17.486878 master-0 kubenswrapper[4745]: E1204 11:35:17.486780 4745 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="3.2s" Dec 04 11:35:17.722242 master-0 kubenswrapper[4745]: I1204 11:35:17.722156 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:17.723621 master-0 kubenswrapper[4745]: I1204 11:35:17.723586 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:17.723914 master-0 kubenswrapper[4745]: I1204 11:35:17.723632 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:17.723914 master-0 kubenswrapper[4745]: I1204 11:35:17.723649 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:17.723914 master-0 kubenswrapper[4745]: I1204 11:35:17.723905 4745 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 11:35:17.726018 master-0 kubenswrapper[4745]: E1204 11:35:17.725918 4745 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/nodes\": dial tcp 192.168.32.10:6443: connect: connection refused" node="master-0" Dec 04 11:35:17.743159 master-0 kubenswrapper[4745]: W1204 11:35:17.743049 4745 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://api-int.sno.openstack.lab:6443/api/v1/nodes?fieldSelector=metadata.name%3Dmaster-0&limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:17.743159 master-0 kubenswrapper[4745]: E1204 11:35:17.743115 4745 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes?fieldSelector=metadata.name%3Dmaster-0&limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:35:18.427258 master-0 kubenswrapper[4745]: W1204 11:35:18.427202 4745 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:18.427368 master-0 kubenswrapper[4745]: E1204 11:35:18.427267 4745 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get \"https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:35:18.474660 master-0 kubenswrapper[4745]: I1204 11:35:18.474597 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:18.504617 master-0 kubenswrapper[4745]: W1204 11:35:18.504541 4745 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://api-int.sno.openstack.lab:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:18.504617 master-0 kubenswrapper[4745]: E1204 11:35:18.504617 4745 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get \"https://api-int.sno.openstack.lab:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:35:18.643108 master-0 kubenswrapper[4745]: I1204 11:35:18.643044 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0-master-0" event={"ID":"cc0396a9a2689b3e8c132c12640cbe83","Type":"ContainerStarted","Data":"2486b68bc3517ab1664fcb1823dbcafa72bb90a8386d8e6780a8a95866e68263"} Dec 04 11:35:18.645526 master-0 kubenswrapper[4745]: I1204 11:35:18.645390 4745 generic.go:334] "Generic (PLEG): container finished" podID="3169f44496ed8a28c6d6a15511ab0eec" containerID="fe978e3c9349858cb4986d59a0d297668af47052f5667b090a002d76ebcd619e" exitCode=0 Dec 04 11:35:18.645526 master-0 kubenswrapper[4745]: I1204 11:35:18.645470 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"3169f44496ed8a28c6d6a15511ab0eec","Type":"ContainerDied","Data":"fe978e3c9349858cb4986d59a0d297668af47052f5667b090a002d76ebcd619e"} Dec 04 11:35:18.645526 master-0 kubenswrapper[4745]: I1204 11:35:18.645491 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:18.646515 master-0 kubenswrapper[4745]: I1204 11:35:18.646486 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:18.646669 master-0 kubenswrapper[4745]: I1204 11:35:18.646563 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:18.646669 master-0 kubenswrapper[4745]: I1204 11:35:18.646580 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:18.722587 master-0 kubenswrapper[4745]: E1204 11:35:18.722402 4745 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/default/events\": dial tcp 192.168.32.10:6443: connect: connection refused" event="&Event{ObjectMeta:{master-0.187e000271a0a2e3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.472100579 +0000 UTC m=+0.174088984,LastTimestamp:2025-12-04 11:35:14.472100579 +0000 UTC m=+0.174088984,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:19.474275 master-0 kubenswrapper[4745]: I1204 11:35:19.474215 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:19.648635 master-0 kubenswrapper[4745]: I1204 11:35:19.648506 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_3169f44496ed8a28c6d6a15511ab0eec/kube-rbac-proxy-crio/0.log" Dec 04 11:35:19.649298 master-0 kubenswrapper[4745]: I1204 11:35:19.649267 4745 generic.go:334] "Generic (PLEG): container finished" podID="3169f44496ed8a28c6d6a15511ab0eec" containerID="7609ccd8730136b93355d505bfb0d9dab511cf4a89b173e9132897bdcdb77a2a" exitCode=1 Dec 04 11:35:19.649376 master-0 kubenswrapper[4745]: I1204 11:35:19.649337 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:19.649376 master-0 kubenswrapper[4745]: I1204 11:35:19.649343 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"3169f44496ed8a28c6d6a15511ab0eec","Type":"ContainerDied","Data":"7609ccd8730136b93355d505bfb0d9dab511cf4a89b173e9132897bdcdb77a2a"} Dec 04 11:35:19.650110 master-0 kubenswrapper[4745]: I1204 11:35:19.650091 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:19.650187 master-0 kubenswrapper[4745]: I1204 11:35:19.650121 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:19.650187 master-0 kubenswrapper[4745]: I1204 11:35:19.650132 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:19.650530 master-0 kubenswrapper[4745]: I1204 11:35:19.650515 4745 scope.go:117] "RemoveContainer" containerID="7609ccd8730136b93355d505bfb0d9dab511cf4a89b173e9132897bdcdb77a2a" Dec 04 11:35:19.653416 master-0 kubenswrapper[4745]: I1204 11:35:19.653226 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0-master-0" event={"ID":"cc0396a9a2689b3e8c132c12640cbe83","Type":"ContainerStarted","Data":"4ed3912e9d934219e324f1b3be9ecb2f87f15e4be5f71ebe6a2e74f6f7ff9948"} Dec 04 11:35:19.653416 master-0 kubenswrapper[4745]: I1204 11:35:19.653408 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:19.654368 master-0 kubenswrapper[4745]: I1204 11:35:19.654339 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:19.654427 master-0 kubenswrapper[4745]: I1204 11:35:19.654371 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:19.654427 master-0 kubenswrapper[4745]: I1204 11:35:19.654382 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:20.474272 master-0 kubenswrapper[4745]: I1204 11:35:20.474200 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:20.655651 master-0 kubenswrapper[4745]: I1204 11:35:20.655604 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:20.656723 master-0 kubenswrapper[4745]: I1204 11:35:20.656694 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:20.656786 master-0 kubenswrapper[4745]: I1204 11:35:20.656734 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:20.656786 master-0 kubenswrapper[4745]: I1204 11:35:20.656744 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:20.688688 master-0 kubenswrapper[4745]: E1204 11:35:20.688635 4745 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="6.4s" Dec 04 11:35:20.799503 master-0 kubenswrapper[4745]: I1204 11:35:20.799352 4745 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Rotating certificates Dec 04 11:35:20.801300 master-0 kubenswrapper[4745]: E1204 11:35:20.801255 4745 certificate_manager.go:562] "Unhandled Error" err="kubernetes.io/kube-apiserver-client-kubelet: Failed while requesting a signed certificate from the control plane: cannot create certificate signing request: Post \"https://api-int.sno.openstack.lab:6443/apis/certificates.k8s.io/v1/certificatesigningrequests\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:35:20.927068 master-0 kubenswrapper[4745]: I1204 11:35:20.926295 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:20.927669 master-0 kubenswrapper[4745]: I1204 11:35:20.927621 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:20.927760 master-0 kubenswrapper[4745]: I1204 11:35:20.927689 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:20.927760 master-0 kubenswrapper[4745]: I1204 11:35:20.927704 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:20.927836 master-0 kubenswrapper[4745]: I1204 11:35:20.927772 4745 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 11:35:20.929054 master-0 kubenswrapper[4745]: E1204 11:35:20.929001 4745 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/nodes\": dial tcp 192.168.32.10:6443: connect: connection refused" node="master-0" Dec 04 11:35:20.945916 master-0 kubenswrapper[4745]: W1204 11:35:20.945835 4745 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: Get "https://api-int.sno.openstack.lab:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:20.946134 master-0 kubenswrapper[4745]: E1204 11:35:20.945924 4745 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get \"https://api-int.sno.openstack.lab:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:35:21.474874 master-0 kubenswrapper[4745]: I1204 11:35:21.474764 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:21.674330 master-0 kubenswrapper[4745]: W1204 11:35:21.674151 4745 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:21.674330 master-0 kubenswrapper[4745]: E1204 11:35:21.674275 4745 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get \"https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:35:22.473760 master-0 kubenswrapper[4745]: I1204 11:35:22.473674 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:23.475071 master-0 kubenswrapper[4745]: I1204 11:35:23.474989 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:23.531885 master-0 kubenswrapper[4745]: W1204 11:35:23.531785 4745 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://api-int.sno.openstack.lab:6443/api/v1/nodes?fieldSelector=metadata.name%3Dmaster-0&limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:23.532092 master-0 kubenswrapper[4745]: E1204 11:35:23.532075 4745 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes?fieldSelector=metadata.name%3Dmaster-0&limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:35:24.475084 master-0 kubenswrapper[4745]: I1204 11:35:24.474467 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:24.485919 master-0 kubenswrapper[4745]: W1204 11:35:24.485777 4745 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://api-int.sno.openstack.lab:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:35:24.485919 master-0 kubenswrapper[4745]: E1204 11:35:24.485883 4745 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get \"https://api-int.sno.openstack.lab:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:35:24.608347 master-0 kubenswrapper[4745]: E1204 11:35:24.608259 4745 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"master-0\" not found" Dec 04 11:35:24.668143 master-0 kubenswrapper[4745]: I1204 11:35:24.666010 4745 generic.go:334] "Generic (PLEG): container finished" podID="d75143d9bc4a2dc15781dc51ccff632a" containerID="9c7529c8ca2d0c98a54eee2915f7d9cb961fdd0ba295047dca3baa0a51ae6a4b" exitCode=0 Dec 04 11:35:24.668143 master-0 kubenswrapper[4745]: I1204 11:35:24.666092 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" event={"ID":"d75143d9bc4a2dc15781dc51ccff632a","Type":"ContainerDied","Data":"9c7529c8ca2d0c98a54eee2915f7d9cb961fdd0ba295047dca3baa0a51ae6a4b"} Dec 04 11:35:24.668143 master-0 kubenswrapper[4745]: I1204 11:35:24.666138 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:24.668143 master-0 kubenswrapper[4745]: I1204 11:35:24.666939 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:24.668143 master-0 kubenswrapper[4745]: I1204 11:35:24.666964 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:24.668143 master-0 kubenswrapper[4745]: I1204 11:35:24.666978 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:24.668143 master-0 kubenswrapper[4745]: I1204 11:35:24.667624 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"8b47694fcc32464ab24d09c23d6efb57","Type":"ContainerStarted","Data":"b371ad607ffd3e5ee045c3b072b5398e7b47188ceda9be737847471999ef8986"} Dec 04 11:35:24.668938 master-0 kubenswrapper[4745]: I1204 11:35:24.668906 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-scheduler-master-0" event={"ID":"5e09e2af7200e6f9be469dbfd9bb1127","Type":"ContainerStarted","Data":"28bd405676e81717d938eefd29fce0475230f84557116212e1a3920f34143d20"} Dec 04 11:35:24.669003 master-0 kubenswrapper[4745]: I1204 11:35:24.668957 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:24.669585 master-0 kubenswrapper[4745]: I1204 11:35:24.669555 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:24.669585 master-0 kubenswrapper[4745]: I1204 11:35:24.669592 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:24.669690 master-0 kubenswrapper[4745]: I1204 11:35:24.669601 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:24.670501 master-0 kubenswrapper[4745]: I1204 11:35:24.670479 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_3169f44496ed8a28c6d6a15511ab0eec/kube-rbac-proxy-crio/1.log" Dec 04 11:35:24.670561 master-0 kubenswrapper[4745]: I1204 11:35:24.670520 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:24.670965 master-0 kubenswrapper[4745]: I1204 11:35:24.670944 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_3169f44496ed8a28c6d6a15511ab0eec/kube-rbac-proxy-crio/0.log" Dec 04 11:35:24.671429 master-0 kubenswrapper[4745]: I1204 11:35:24.671405 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:24.671484 master-0 kubenswrapper[4745]: I1204 11:35:24.671438 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:24.671484 master-0 kubenswrapper[4745]: I1204 11:35:24.671449 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:24.671719 master-0 kubenswrapper[4745]: I1204 11:35:24.671650 4745 generic.go:334] "Generic (PLEG): container finished" podID="3169f44496ed8a28c6d6a15511ab0eec" containerID="1c0427f947157f04878c30047e252e4b875cfdd89e58fea9d60ac1e90c4ba60c" exitCode=1 Dec 04 11:35:24.671719 master-0 kubenswrapper[4745]: I1204 11:35:24.671697 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"3169f44496ed8a28c6d6a15511ab0eec","Type":"ContainerDied","Data":"1c0427f947157f04878c30047e252e4b875cfdd89e58fea9d60ac1e90c4ba60c"} Dec 04 11:35:24.671719 master-0 kubenswrapper[4745]: I1204 11:35:24.671714 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:24.671888 master-0 kubenswrapper[4745]: I1204 11:35:24.671750 4745 scope.go:117] "RemoveContainer" containerID="7609ccd8730136b93355d505bfb0d9dab511cf4a89b173e9132897bdcdb77a2a" Dec 04 11:35:24.672327 master-0 kubenswrapper[4745]: I1204 11:35:24.672309 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:24.672384 master-0 kubenswrapper[4745]: I1204 11:35:24.672331 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:24.672384 master-0 kubenswrapper[4745]: I1204 11:35:24.672341 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:24.672733 master-0 kubenswrapper[4745]: I1204 11:35:24.672596 4745 scope.go:117] "RemoveContainer" containerID="1c0427f947157f04878c30047e252e4b875cfdd89e58fea9d60ac1e90c4ba60c" Dec 04 11:35:24.672822 master-0 kubenswrapper[4745]: E1204 11:35:24.672729 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-master-0_openshift-machine-config-operator(3169f44496ed8a28c6d6a15511ab0eec)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" podUID="3169f44496ed8a28c6d6a15511ab0eec" Dec 04 11:35:25.678045 master-0 kubenswrapper[4745]: I1204 11:35:25.677962 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" event={"ID":"d75143d9bc4a2dc15781dc51ccff632a","Type":"ContainerStarted","Data":"14ac45f5991606821dff758d708720469710a75e4bb098390a3a5689b8ae0ee8"} Dec 04 11:35:25.679762 master-0 kubenswrapper[4745]: I1204 11:35:25.679722 4745 generic.go:334] "Generic (PLEG): container finished" podID="8b47694fcc32464ab24d09c23d6efb57" containerID="b371ad607ffd3e5ee045c3b072b5398e7b47188ceda9be737847471999ef8986" exitCode=1 Dec 04 11:35:25.679861 master-0 kubenswrapper[4745]: I1204 11:35:25.679785 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"8b47694fcc32464ab24d09c23d6efb57","Type":"ContainerDied","Data":"b371ad607ffd3e5ee045c3b072b5398e7b47188ceda9be737847471999ef8986"} Dec 04 11:35:25.681762 master-0 kubenswrapper[4745]: I1204 11:35:25.681478 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_3169f44496ed8a28c6d6a15511ab0eec/kube-rbac-proxy-crio/1.log" Dec 04 11:35:25.682156 master-0 kubenswrapper[4745]: I1204 11:35:25.682086 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:25.682202 master-0 kubenswrapper[4745]: I1204 11:35:25.682098 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:25.683107 master-0 kubenswrapper[4745]: I1204 11:35:25.683074 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:25.683165 master-0 kubenswrapper[4745]: I1204 11:35:25.683116 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:25.683165 master-0 kubenswrapper[4745]: I1204 11:35:25.683129 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:25.683165 master-0 kubenswrapper[4745]: I1204 11:35:25.683109 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:25.683248 master-0 kubenswrapper[4745]: I1204 11:35:25.683168 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:25.683248 master-0 kubenswrapper[4745]: I1204 11:35:25.683182 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:25.683719 master-0 kubenswrapper[4745]: I1204 11:35:25.683690 4745 scope.go:117] "RemoveContainer" containerID="1c0427f947157f04878c30047e252e4b875cfdd89e58fea9d60ac1e90c4ba60c" Dec 04 11:35:25.683892 master-0 kubenswrapper[4745]: E1204 11:35:25.683860 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-master-0_openshift-machine-config-operator(3169f44496ed8a28c6d6a15511ab0eec)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" podUID="3169f44496ed8a28c6d6a15511ab0eec" Dec 04 11:35:26.351359 master-0 kubenswrapper[4745]: I1204 11:35:26.351271 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:26.496922 master-0 kubenswrapper[4745]: I1204 11:35:26.490571 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:26.687152 master-0 kubenswrapper[4745]: I1204 11:35:26.686988 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"8b47694fcc32464ab24d09c23d6efb57","Type":"ContainerStarted","Data":"a573a12b7e61507c596e1178d09644f02ee9de55d89553ed9fce32978b18dcf3"} Dec 04 11:35:27.094869 master-0 kubenswrapper[4745]: E1204 11:35:27.094766 4745 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"master-0\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" Dec 04 11:35:27.331091 master-0 kubenswrapper[4745]: I1204 11:35:27.330529 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:27.332107 master-0 kubenswrapper[4745]: I1204 11:35:27.332020 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:27.332165 master-0 kubenswrapper[4745]: I1204 11:35:27.332133 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:27.332165 master-0 kubenswrapper[4745]: I1204 11:35:27.332148 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:27.332263 master-0 kubenswrapper[4745]: I1204 11:35:27.332244 4745 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 11:35:27.337162 master-0 kubenswrapper[4745]: E1204 11:35:27.337112 4745 kubelet_node_status.go:99] "Unable to register node with API server" err="nodes is forbidden: User \"system:anonymous\" cannot create resource \"nodes\" in API group \"\" at the cluster scope" node="master-0" Dec 04 11:35:27.477937 master-0 kubenswrapper[4745]: I1204 11:35:27.477844 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:27.688710 master-0 kubenswrapper[4745]: I1204 11:35:27.688648 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:27.689612 master-0 kubenswrapper[4745]: I1204 11:35:27.689592 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:27.689665 master-0 kubenswrapper[4745]: I1204 11:35:27.689636 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:27.689665 master-0 kubenswrapper[4745]: I1204 11:35:27.689653 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:27.690009 master-0 kubenswrapper[4745]: I1204 11:35:27.689983 4745 scope.go:117] "RemoveContainer" containerID="b371ad607ffd3e5ee045c3b072b5398e7b47188ceda9be737847471999ef8986" Dec 04 11:35:28.477392 master-0 kubenswrapper[4745]: I1204 11:35:28.477345 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:28.727779 master-0 kubenswrapper[4745]: E1204 11:35:28.727539 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e000271a0a2e3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.472100579 +0000 UTC m=+0.174088984,LastTimestamp:2025-12-04 11:35:14.472100579 +0000 UTC m=+0.174088984,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.731766 master-0 kubenswrapper[4745]: E1204 11:35:28.731638 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455609a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517500058 +0000 UTC m=+0.219488453,LastTimestamp:2025-12-04 11:35:14.517500058 +0000 UTC m=+0.219488453,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.737116 master-0 kubenswrapper[4745]: E1204 11:35:28.736882 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455bcfd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517523709 +0000 UTC m=+0.219512104,LastTimestamp:2025-12-04 11:35:14.517523709 +0000 UTC m=+0.219512104,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.741778 master-0 kubenswrapper[4745]: E1204 11:35:28.741264 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455e403 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node master-0 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517533699 +0000 UTC m=+0.219522094,LastTimestamp:2025-12-04 11:35:14.517533699 +0000 UTC m=+0.219522094,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.745797 master-0 kubenswrapper[4745]: E1204 11:35:28.745625 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e000279ceacca default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.609335498 +0000 UTC m=+0.311323893,LastTimestamp:2025-12-04 11:35:14.609335498 +0000 UTC m=+0.311323893,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.750614 master-0 kubenswrapper[4745]: E1204 11:35:28.750497 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187e00027455609a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455609a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517500058 +0000 UTC m=+0.219488453,LastTimestamp:2025-12-04 11:35:14.70946318 +0000 UTC m=+0.411451575,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.756514 master-0 kubenswrapper[4745]: E1204 11:35:28.756364 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187e00027455bcfd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455bcfd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517523709 +0000 UTC m=+0.219512104,LastTimestamp:2025-12-04 11:35:14.709485141 +0000 UTC m=+0.411473526,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.761075 master-0 kubenswrapper[4745]: E1204 11:35:28.760899 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187e00027455e403\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455e403 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node master-0 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517533699 +0000 UTC m=+0.219522094,LastTimestamp:2025-12-04 11:35:14.709493741 +0000 UTC m=+0.411482126,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.765776 master-0 kubenswrapper[4745]: E1204 11:35:28.765696 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187e00027455609a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455609a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517500058 +0000 UTC m=+0.219488453,LastTimestamp:2025-12-04 11:35:14.727271227 +0000 UTC m=+0.429259622,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.769599 master-0 kubenswrapper[4745]: E1204 11:35:28.769463 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187e00027455bcfd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455bcfd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517523709 +0000 UTC m=+0.219512104,LastTimestamp:2025-12-04 11:35:14.727288608 +0000 UTC m=+0.429277003,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.773528 master-0 kubenswrapper[4745]: E1204 11:35:28.773398 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187e00027455e403\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455e403 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node master-0 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517533699 +0000 UTC m=+0.219522094,LastTimestamp:2025-12-04 11:35:14.727296178 +0000 UTC m=+0.429284573,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.778286 master-0 kubenswrapper[4745]: E1204 11:35:28.778139 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187e00027455609a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455609a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517500058 +0000 UTC m=+0.219488453,LastTimestamp:2025-12-04 11:35:14.728080861 +0000 UTC m=+0.430069256,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.783505 master-0 kubenswrapper[4745]: E1204 11:35:28.783359 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187e00027455bcfd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455bcfd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517523709 +0000 UTC m=+0.219512104,LastTimestamp:2025-12-04 11:35:14.728100122 +0000 UTC m=+0.430088517,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.789178 master-0 kubenswrapper[4745]: E1204 11:35:28.789022 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187e00027455e403\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455e403 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node master-0 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517533699 +0000 UTC m=+0.219522094,LastTimestamp:2025-12-04 11:35:14.728109862 +0000 UTC m=+0.430098257,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.793777 master-0 kubenswrapper[4745]: E1204 11:35:28.793602 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187e00027455609a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455609a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517500058 +0000 UTC m=+0.219488453,LastTimestamp:2025-12-04 11:35:14.728157684 +0000 UTC m=+0.430146079,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.797947 master-0 kubenswrapper[4745]: E1204 11:35:28.797776 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187e00027455bcfd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455bcfd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517523709 +0000 UTC m=+0.219512104,LastTimestamp:2025-12-04 11:35:14.728169905 +0000 UTC m=+0.430158300,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.801961 master-0 kubenswrapper[4745]: E1204 11:35:28.801849 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187e00027455e403\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455e403 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node master-0 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517533699 +0000 UTC m=+0.219522094,LastTimestamp:2025-12-04 11:35:14.728177095 +0000 UTC m=+0.430165490,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.805955 master-0 kubenswrapper[4745]: E1204 11:35:28.805831 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187e00027455609a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455609a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517500058 +0000 UTC m=+0.219488453,LastTimestamp:2025-12-04 11:35:14.728993109 +0000 UTC m=+0.430981504,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.809619 master-0 kubenswrapper[4745]: E1204 11:35:28.809530 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187e00027455bcfd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455bcfd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517523709 +0000 UTC m=+0.219512104,LastTimestamp:2025-12-04 11:35:14.72901077 +0000 UTC m=+0.430999165,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.813438 master-0 kubenswrapper[4745]: E1204 11:35:28.813312 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187e00027455e403\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455e403 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node master-0 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517533699 +0000 UTC m=+0.219522094,LastTimestamp:2025-12-04 11:35:14.72902567 +0000 UTC m=+0.431014085,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.819919 master-0 kubenswrapper[4745]: E1204 11:35:28.819846 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187e00027455609a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455609a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517500058 +0000 UTC m=+0.219488453,LastTimestamp:2025-12-04 11:35:14.729052181 +0000 UTC m=+0.431040576,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.823615 master-0 kubenswrapper[4745]: E1204 11:35:28.823460 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187e00027455bcfd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455bcfd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517523709 +0000 UTC m=+0.219512104,LastTimestamp:2025-12-04 11:35:14.729068461 +0000 UTC m=+0.431056856,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.827543 master-0 kubenswrapper[4745]: E1204 11:35:28.827460 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187e00027455e403\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455e403 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node master-0 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517533699 +0000 UTC m=+0.219522094,LastTimestamp:2025-12-04 11:35:14.729078622 +0000 UTC m=+0.431067017,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.830997 master-0 kubenswrapper[4745]: E1204 11:35:28.830924 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187e00027455609a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455609a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517500058 +0000 UTC m=+0.219488453,LastTimestamp:2025-12-04 11:35:14.729948458 +0000 UTC m=+0.431936873,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.834468 master-0 kubenswrapper[4745]: E1204 11:35:28.834398 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.187e00027455bcfd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.187e00027455bcfd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:14.517523709 +0000 UTC m=+0.219512104,LastTimestamp:2025-12-04 11:35:14.729966169 +0000 UTC m=+0.431954564,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.838763 master-0 kubenswrapper[4745]: E1204 11:35:28.838679 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187e0002bb9d113c kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:8b47694fcc32464ab24d09c23d6efb57,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d5891cdd7dcf7c9081de8b364b4c96446b7f946f7880fbae291a4592a198264\",Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:15.713380668 +0000 UTC m=+1.415369063,LastTimestamp:2025-12-04 11:35:15.713380668 +0000 UTC m=+1.415369063,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.842232 master-0 kubenswrapper[4745]: E1204 11:35:28.842132 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187e0002bc33a3c9 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:d75143d9bc4a2dc15781dc51ccff632a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d5891cdd7dcf7c9081de8b364b4c96446b7f946f7880fbae291a4592a198264\",Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:15.723248585 +0000 UTC m=+1.425236980,LastTimestamp:2025-12-04 11:35:15.723248585 +0000 UTC m=+1.425236980,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.845568 master-0 kubenswrapper[4745]: E1204 11:35:28.845493 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-master-0-master-0.187e0002be974f0c openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0-master-0,UID:cc0396a9a2689b3e8c132c12640cbe83,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcdctl},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:188637a52cafee61ec461e92fb0c605e28be325b9ac1f2ac8a37d68e97654718\",Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:15.763334924 +0000 UTC m=+1.465323329,LastTimestamp:2025-12-04 11:35:15.763334924 +0000 UTC m=+1.465323329,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.849554 master-0 kubenswrapper[4745]: E1204 11:35:28.849434 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187e0002bfc0fe89 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:3169f44496ed8a28c6d6a15511ab0eec,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c69ffd8f8dcceedc2d6eb306cea33f8beabc1be1308cd5f4ee8b9a8e3eab9843\",Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:15.782844041 +0000 UTC m=+1.484832446,LastTimestamp:2025-12-04 11:35:15.782844041 +0000 UTC m=+1.484832446,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.855341 master-0 kubenswrapper[4745]: E1204 11:35:28.855139 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-scheduler-master-0.187e0002c1924d87 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-scheduler-master-0,UID:5e09e2af7200e6f9be469dbfd9bb1127,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d5891cdd7dcf7c9081de8b364b4c96446b7f946f7880fbae291a4592a198264\",Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:15.813338503 +0000 UTC m=+1.515326898,LastTimestamp:2025-12-04 11:35:15.813338503 +0000 UTC m=+1.515326898,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.862991 master-0 kubenswrapper[4745]: E1204 11:35:28.862774 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187e000321fd52d6 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:3169f44496ed8a28c6d6a15511ab0eec,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c69ffd8f8dcceedc2d6eb306cea33f8beabc1be1308cd5f4ee8b9a8e3eab9843\" in 1.648s (1.648s including waiting). Image size: 459552216 bytes.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:17.43096495 +0000 UTC m=+3.132953335,LastTimestamp:2025-12-04 11:35:17.43096495 +0000 UTC m=+3.132953335,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.867752 master-0 kubenswrapper[4745]: E1204 11:35:28.867608 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187e00032f9c643d openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:3169f44496ed8a28c6d6a15511ab0eec,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:17.659493437 +0000 UTC m=+3.361481832,LastTimestamp:2025-12-04 11:35:17.659493437 +0000 UTC m=+3.361481832,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.872525 master-0 kubenswrapper[4745]: E1204 11:35:28.872417 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187e000330920b8b openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:3169f44496ed8a28c6d6a15511ab0eec,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:17.675592587 +0000 UTC m=+3.377580982,LastTimestamp:2025-12-04 11:35:17.675592587 +0000 UTC m=+3.377580982,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.877839 master-0 kubenswrapper[4745]: E1204 11:35:28.877651 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-master-0-master-0.187e00035c8cca7f openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0-master-0,UID:cc0396a9a2689b3e8c132c12640cbe83,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcdctl},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:188637a52cafee61ec461e92fb0c605e28be325b9ac1f2ac8a37d68e97654718\" in 2.65s (2.65s including waiting). Image size: 532719167 bytes.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:18.413445759 +0000 UTC m=+4.115434154,LastTimestamp:2025-12-04 11:35:18.413445759 +0000 UTC m=+4.115434154,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.883077 master-0 kubenswrapper[4745]: E1204 11:35:28.882894 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-master-0-master-0.187e00036717856e openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0-master-0,UID:cc0396a9a2689b3e8c132c12640cbe83,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcdctl},},Reason:Created,Message:Created container: etcdctl,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:18.590309742 +0000 UTC m=+4.292298137,LastTimestamp:2025-12-04 11:35:18.590309742 +0000 UTC m=+4.292298137,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.887293 master-0 kubenswrapper[4745]: E1204 11:35:28.887156 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-master-0-master-0.187e000368729583 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0-master-0,UID:cc0396a9a2689b3e8c132c12640cbe83,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcdctl},},Reason:Started,Message:Started container etcdctl,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:18.613054851 +0000 UTC m=+4.315043246,LastTimestamp:2025-12-04 11:35:18.613054851 +0000 UTC m=+4.315043246,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.891208 master-0 kubenswrapper[4745]: E1204 11:35:28.891077 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-master-0-master-0.187e000368aea0d9 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0-master-0,UID:cc0396a9a2689b3e8c132c12640cbe83,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:188637a52cafee61ec461e92fb0c605e28be325b9ac1f2ac8a37d68e97654718\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:18.616989913 +0000 UTC m=+4.318978308,LastTimestamp:2025-12-04 11:35:18.616989913 +0000 UTC m=+4.318978308,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.895585 master-0 kubenswrapper[4745]: E1204 11:35:28.895483 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187e00036ab69ed8 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:3169f44496ed8a28c6d6a15511ab0eec,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c69ffd8f8dcceedc2d6eb306cea33f8beabc1be1308cd5f4ee8b9a8e3eab9843\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:18.65106812 +0000 UTC m=+4.353056515,LastTimestamp:2025-12-04 11:35:18.65106812 +0000 UTC m=+4.353056515,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.900700 master-0 kubenswrapper[4745]: E1204 11:35:28.900595 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-master-0-master-0.187e0003755c8003 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0-master-0,UID:cc0396a9a2689b3e8c132c12640cbe83,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd},},Reason:Created,Message:Created container: etcd,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:18.829711363 +0000 UTC m=+4.531699758,LastTimestamp:2025-12-04 11:35:18.829711363 +0000 UTC m=+4.531699758,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.904632 master-0 kubenswrapper[4745]: E1204 11:35:28.904520 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187e000376022f31 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:3169f44496ed8a28c6d6a15511ab0eec,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Created,Message:Created container: kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:18.840569649 +0000 UTC m=+4.542558034,LastTimestamp:2025-12-04 11:35:18.840569649 +0000 UTC m=+4.542558034,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.908898 master-0 kubenswrapper[4745]: E1204 11:35:28.908759 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-master-0-master-0.187e00037638cb63 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0-master-0,UID:cc0396a9a2689b3e8c132c12640cbe83,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd},},Reason:Started,Message:Started container etcd,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:18.844148579 +0000 UTC m=+4.546136974,LastTimestamp:2025-12-04 11:35:18.844148579 +0000 UTC m=+4.546136974,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.914230 master-0 kubenswrapper[4745]: E1204 11:35:28.914053 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187e000376e3455b openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:3169f44496ed8a28c6d6a15511ab0eec,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Started,Message:Started container kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:18.855320923 +0000 UTC m=+4.557309318,LastTimestamp:2025-12-04 11:35:18.855320923 +0000 UTC m=+4.557309318,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.920282 master-0 kubenswrapper[4745]: E1204 11:35:28.920124 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-master-0.187e00036ab69ed8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187e00036ab69ed8 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:3169f44496ed8a28c6d6a15511ab0eec,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c69ffd8f8dcceedc2d6eb306cea33f8beabc1be1308cd5f4ee8b9a8e3eab9843\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:18.65106812 +0000 UTC m=+4.353056515,LastTimestamp:2025-12-04 11:35:23.726479157 +0000 UTC m=+9.428467572,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.925241 master-0 kubenswrapper[4745]: E1204 11:35:28.925061 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187e00049e6db544 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:d75143d9bc4a2dc15781dc51ccff632a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d5891cdd7dcf7c9081de8b364b4c96446b7f946f7880fbae291a4592a198264\" in 8.09s (8.09s including waiting). Image size: 938303566 bytes.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:23.81367226 +0000 UTC m=+9.515660655,LastTimestamp:2025-12-04 11:35:23.81367226 +0000 UTC m=+9.515660655,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.930117 master-0 kubenswrapper[4745]: E1204 11:35:28.929935 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187e0004a01ac372 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:8b47694fcc32464ab24d09c23d6efb57,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d5891cdd7dcf7c9081de8b364b4c96446b7f946f7880fbae291a4592a198264\" in 8.128s (8.128s including waiting). Image size: 938303566 bytes.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:23.841790834 +0000 UTC m=+9.543779229,LastTimestamp:2025-12-04 11:35:23.841790834 +0000 UTC m=+9.543779229,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.935227 master-0 kubenswrapper[4745]: E1204 11:35:28.935017 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-scheduler-master-0.187e0004a1957038 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-scheduler-master-0,UID:5e09e2af7200e6f9be469dbfd9bb1127,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d5891cdd7dcf7c9081de8b364b4c96446b7f946f7880fbae291a4592a198264\" in 8.053s (8.053s including waiting). Image size: 938303566 bytes.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:23.866607672 +0000 UTC m=+9.568596067,LastTimestamp:2025-12-04 11:35:23.866607672 +0000 UTC m=+9.568596067,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.940747 master-0 kubenswrapper[4745]: E1204 11:35:28.940586 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-master-0.187e000376022f31\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187e000376022f31 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:3169f44496ed8a28c6d6a15511ab0eec,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Created,Message:Created container: kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:18.840569649 +0000 UTC m=+4.542558034,LastTimestamp:2025-12-04 11:35:23.920143242 +0000 UTC m=+9.622131627,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.945285 master-0 kubenswrapper[4745]: E1204 11:35:28.945147 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-master-0.187e000376e3455b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187e000376e3455b openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:3169f44496ed8a28c6d6a15511ab0eec,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Started,Message:Started container kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:18.855320923 +0000 UTC m=+4.557309318,LastTimestamp:2025-12-04 11:35:23.934466606 +0000 UTC m=+9.636455001,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.949949 master-0 kubenswrapper[4745]: E1204 11:35:28.949781 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187e0004a8aba39e openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:d75143d9bc4a2dc15781dc51ccff632a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:23.985503134 +0000 UTC m=+9.687491559,LastTimestamp:2025-12-04 11:35:23.985503134 +0000 UTC m=+9.687491559,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.953616 master-0 kubenswrapper[4745]: E1204 11:35:28.953511 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187e0004a959cc6c openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:d75143d9bc4a2dc15781dc51ccff632a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:23.996916844 +0000 UTC m=+9.698905239,LastTimestamp:2025-12-04 11:35:23.996916844 +0000 UTC m=+9.698905239,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.958043 master-0 kubenswrapper[4745]: E1204 11:35:28.957883 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187e0004afe3816d kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:8b47694fcc32464ab24d09c23d6efb57,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager},},Reason:Created,Message:Created container: kube-controller-manager,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:24.106604909 +0000 UTC m=+9.808593304,LastTimestamp:2025-12-04 11:35:24.106604909 +0000 UTC m=+9.808593304,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.962308 master-0 kubenswrapper[4745]: E1204 11:35:28.962183 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-scheduler-master-0.187e0004b04b9a70 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-scheduler-master-0,UID:5e09e2af7200e6f9be469dbfd9bb1127,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler},},Reason:Created,Message:Created container: kube-scheduler,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:24.113427056 +0000 UTC m=+9.815415451,LastTimestamp:2025-12-04 11:35:24.113427056 +0000 UTC m=+9.815415451,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.966139 master-0 kubenswrapper[4745]: E1204 11:35:28.966054 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187e0004b082d5e9 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:8b47694fcc32464ab24d09c23d6efb57,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager},},Reason:Started,Message:Started container kube-controller-manager,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:24.117046761 +0000 UTC m=+9.819035176,LastTimestamp:2025-12-04 11:35:24.117046761 +0000 UTC m=+9.819035176,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.969788 master-0 kubenswrapper[4745]: E1204 11:35:28.969676 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187e0004b0928cba kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:8b47694fcc32464ab24d09c23d6efb57,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{cluster-policy-controller},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d64c13fe7663a0b4ae61d103b1b7598adcf317a01826f296bcb66b1a2de83c96\",Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:24.118076602 +0000 UTC m=+9.820064997,LastTimestamp:2025-12-04 11:35:24.118076602 +0000 UTC m=+9.820064997,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.973103 master-0 kubenswrapper[4745]: E1204 11:35:28.972970 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-scheduler-master-0.187e0004b0e0668f kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-scheduler-master-0,UID:5e09e2af7200e6f9be469dbfd9bb1127,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler},},Reason:Started,Message:Started container kube-scheduler,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:24.123178639 +0000 UTC m=+9.825167034,LastTimestamp:2025-12-04 11:35:24.123178639 +0000 UTC m=+9.825167034,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.978062 master-0 kubenswrapper[4745]: E1204 11:35:28.977909 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187e0004d17df6ad openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:d75143d9bc4a2dc15781dc51ccff632a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d5891cdd7dcf7c9081de8b364b4c96446b7f946f7880fbae291a4592a198264\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:24.670375597 +0000 UTC m=+10.372363992,LastTimestamp:2025-12-04 11:35:24.670375597 +0000 UTC m=+10.372363992,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.982583 master-0 kubenswrapper[4745]: E1204 11:35:28.982500 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187e0004d1a18eb4 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:3169f44496ed8a28c6d6a15511ab0eec,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:BackOff,Message:Back-off restarting failed container kube-rbac-proxy-crio in pod kube-rbac-proxy-crio-master-0_openshift-machine-config-operator(3169f44496ed8a28c6d6a15511ab0eec),Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:24.672708276 +0000 UTC m=+10.374696671,LastTimestamp:2025-12-04 11:35:24.672708276 +0000 UTC m=+10.374696671,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.986715 master-0 kubenswrapper[4745]: E1204 11:35:28.986640 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187e0004dd84f5b0 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:d75143d9bc4a2dc15781dc51ccff632a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver},},Reason:Created,Message:Created container: kube-apiserver,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:24.872160688 +0000 UTC m=+10.574149073,LastTimestamp:2025-12-04 11:35:24.872160688 +0000 UTC m=+10.574149073,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.991472 master-0 kubenswrapper[4745]: E1204 11:35:28.991341 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187e0004de25298b openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:d75143d9bc4a2dc15781dc51ccff632a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver},},Reason:Started,Message:Started container kube-apiserver,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:24.882659723 +0000 UTC m=+10.584648118,LastTimestamp:2025-12-04 11:35:24.882659723 +0000 UTC m=+10.584648118,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:28.997161 master-0 kubenswrapper[4745]: E1204 11:35:28.996919 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187e0004de385d9f openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:d75143d9bc4a2dc15781dc51ccff632a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-insecure-readyz},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0f43c31aa3359159d4557dad3cfaf812d8ce44db9cb9ae970e06d3479070b660\",Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:24.883918239 +0000 UTC m=+10.585906624,LastTimestamp:2025-12-04 11:35:24.883918239 +0000 UTC m=+10.585906624,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:29.003528 master-0 kubenswrapper[4745]: E1204 11:35:29.003365 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-master-0.187e0004d1a18eb4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187e0004d1a18eb4 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:3169f44496ed8a28c6d6a15511ab0eec,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:BackOff,Message:Back-off restarting failed container kube-rbac-proxy-crio in pod kube-rbac-proxy-crio-master-0_openshift-machine-config-operator(3169f44496ed8a28c6d6a15511ab0eec),Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:24.672708276 +0000 UTC m=+10.374696671,LastTimestamp:2025-12-04 11:35:25.683834512 +0000 UTC m=+11.385822907,Count:2,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:29.008936 master-0 kubenswrapper[4745]: E1204 11:35:29.008751 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187e000518c0da5a kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:8b47694fcc32464ab24d09c23d6efb57,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{cluster-policy-controller},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d64c13fe7663a0b4ae61d103b1b7598adcf317a01826f296bcb66b1a2de83c96\" in 1.747s (1.747s including waiting). Image size: 499705918 bytes.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:25.865941594 +0000 UTC m=+11.567929989,LastTimestamp:2025-12-04 11:35:25.865941594 +0000 UTC m=+11.567929989,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:29.018120 master-0 kubenswrapper[4745]: E1204 11:35:29.017784 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187e00054409d2c0 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:8b47694fcc32464ab24d09c23d6efb57,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{cluster-policy-controller},},Reason:Created,Message:Created container: cluster-policy-controller,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:26.592144064 +0000 UTC m=+12.294132459,LastTimestamp:2025-12-04 11:35:26.592144064 +0000 UTC m=+12.294132459,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:29.023026 master-0 kubenswrapper[4745]: E1204 11:35:29.022888 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187e00054c8cf30e kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:8b47694fcc32464ab24d09c23d6efb57,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{cluster-policy-controller},},Reason:Started,Message:Started container cluster-policy-controller,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:26.734955278 +0000 UTC m=+12.436943683,LastTimestamp:2025-12-04 11:35:26.734955278 +0000 UTC m=+12.436943683,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:29.028587 master-0 kubenswrapper[4745]: E1204 11:35:29.028408 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187e0005b7db0c40 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:8b47694fcc32464ab24d09c23d6efb57,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d5891cdd7dcf7c9081de8b364b4c96446b7f946f7880fbae291a4592a198264\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:28.535235648 +0000 UTC m=+14.237224043,LastTimestamp:2025-12-04 11:35:28.535235648 +0000 UTC m=+14.237224043,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:29.033646 master-0 kubenswrapper[4745]: E1204 11:35:29.033523 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187e0005ba198d91 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:d75143d9bc4a2dc15781dc51ccff632a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-insecure-readyz},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0f43c31aa3359159d4557dad3cfaf812d8ce44db9cb9ae970e06d3479070b660\" in 3.688s (3.688s including waiting). Image size: 509437356 bytes.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:28.572886417 +0000 UTC m=+14.274874812,LastTimestamp:2025-12-04 11:35:28.572886417 +0000 UTC m=+14.274874812,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:29.038321 master-0 kubenswrapper[4745]: E1204 11:35:29.038188 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"bootstrap-kube-controller-manager-master-0.187e0004afe3816d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187e0004afe3816d kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:8b47694fcc32464ab24d09c23d6efb57,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager},},Reason:Created,Message:Created container: kube-controller-manager,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:24.106604909 +0000 UTC m=+9.808593304,LastTimestamp:2025-12-04 11:35:28.682373116 +0000 UTC m=+14.384361511,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:29.042589 master-0 kubenswrapper[4745]: E1204 11:35:29.042465 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"bootstrap-kube-controller-manager-master-0.187e0004b082d5e9\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187e0004b082d5e9 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:8b47694fcc32464ab24d09c23d6efb57,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager},},Reason:Started,Message:Started container kube-controller-manager,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:24.117046761 +0000 UTC m=+9.819035176,LastTimestamp:2025-12-04 11:35:28.69599299 +0000 UTC m=+14.397981385,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:29.047743 master-0 kubenswrapper[4745]: E1204 11:35:29.047604 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187e0005c1890512 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:d75143d9bc4a2dc15781dc51ccff632a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-insecure-readyz},},Reason:Created,Message:Created container: kube-apiserver-insecure-readyz,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:28.697632018 +0000 UTC m=+14.399620413,LastTimestamp:2025-12-04 11:35:28.697632018 +0000 UTC m=+14.399620413,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:29.052111 master-0 kubenswrapper[4745]: E1204 11:35:29.051946 4745 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{bootstrap-kube-apiserver-master-0.187e0005c2162d33 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:bootstrap-kube-apiserver-master-0,UID:d75143d9bc4a2dc15781dc51ccff632a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-insecure-readyz},},Reason:Started,Message:Started container kube-apiserver-insecure-readyz,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:28.706882867 +0000 UTC m=+14.408871272,LastTimestamp:2025-12-04 11:35:28.706882867 +0000 UTC m=+14.408871272,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:29.250447 master-0 kubenswrapper[4745]: I1204 11:35:29.250298 4745 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Rotating certificates Dec 04 11:35:29.268540 master-0 kubenswrapper[4745]: I1204 11:35:29.268470 4745 reflector.go:368] Caches populated for *v1.CertificateSigningRequest from k8s.io/client-go/tools/watch/informerwatcher.go:146 Dec 04 11:35:29.478926 master-0 kubenswrapper[4745]: I1204 11:35:29.478538 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:29.698686 master-0 kubenswrapper[4745]: I1204 11:35:29.698609 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" event={"ID":"d75143d9bc4a2dc15781dc51ccff632a","Type":"ContainerStarted","Data":"cb6defb2f3057900b70ffad997ff544ea8c575bd9817b1a99621b2f9c63061e6"} Dec 04 11:35:29.698686 master-0 kubenswrapper[4745]: I1204 11:35:29.698640 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:29.699706 master-0 kubenswrapper[4745]: I1204 11:35:29.699670 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:29.699772 master-0 kubenswrapper[4745]: I1204 11:35:29.699722 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:29.699772 master-0 kubenswrapper[4745]: I1204 11:35:29.699732 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:29.701443 master-0 kubenswrapper[4745]: I1204 11:35:29.701400 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"8b47694fcc32464ab24d09c23d6efb57","Type":"ContainerStarted","Data":"9f168b6e831554c513b271c722d3ec7e4db28ab5d11f8b57803ff03a30c8af06"} Dec 04 11:35:29.701609 master-0 kubenswrapper[4745]: I1204 11:35:29.701578 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:29.702482 master-0 kubenswrapper[4745]: I1204 11:35:29.702431 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:29.702547 master-0 kubenswrapper[4745]: I1204 11:35:29.702495 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:29.702547 master-0 kubenswrapper[4745]: I1204 11:35:29.702516 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:30.478090 master-0 kubenswrapper[4745]: I1204 11:35:30.478038 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:30.703371 master-0 kubenswrapper[4745]: I1204 11:35:30.703335 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:30.704121 master-0 kubenswrapper[4745]: I1204 11:35:30.704095 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:30.704173 master-0 kubenswrapper[4745]: I1204 11:35:30.704133 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:30.704173 master-0 kubenswrapper[4745]: I1204 11:35:30.704143 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:31.263092 master-0 kubenswrapper[4745]: W1204 11:35:31.263061 4745 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:anonymous" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:31.263304 master-0 kubenswrapper[4745]: E1204 11:35:31.263284 4745 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" Dec 04 11:35:31.477309 master-0 kubenswrapper[4745]: I1204 11:35:31.477260 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:31.550532 master-0 kubenswrapper[4745]: I1204 11:35:31.550409 4745 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:31.555486 master-0 kubenswrapper[4745]: I1204 11:35:31.555451 4745 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:31.691534 master-0 kubenswrapper[4745]: W1204 11:35:31.691484 4745 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes "master-0" is forbidden: User "system:anonymous" cannot list resource "nodes" in API group "" at the cluster scope Dec 04 11:35:31.691740 master-0 kubenswrapper[4745]: E1204 11:35:31.691546 4745 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes \"master-0\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" Dec 04 11:35:31.705321 master-0 kubenswrapper[4745]: I1204 11:35:31.705251 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:31.705493 master-0 kubenswrapper[4745]: I1204 11:35:31.705465 4745 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:31.706198 master-0 kubenswrapper[4745]: I1204 11:35:31.706176 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:31.706296 master-0 kubenswrapper[4745]: I1204 11:35:31.706284 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:31.706357 master-0 kubenswrapper[4745]: I1204 11:35:31.706348 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:31.708839 master-0 kubenswrapper[4745]: I1204 11:35:31.708799 4745 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:35:32.477960 master-0 kubenswrapper[4745]: I1204 11:35:32.477898 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:32.706694 master-0 kubenswrapper[4745]: I1204 11:35:32.706641 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:32.707770 master-0 kubenswrapper[4745]: I1204 11:35:32.707667 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:32.707770 master-0 kubenswrapper[4745]: I1204 11:35:32.707698 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:32.707770 master-0 kubenswrapper[4745]: I1204 11:35:32.707722 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:32.964486 master-0 kubenswrapper[4745]: W1204 11:35:32.964418 4745 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User "system:anonymous" cannot list resource "runtimeclasses" in API group "node.k8s.io" at the cluster scope Dec 04 11:35:32.964700 master-0 kubenswrapper[4745]: E1204 11:35:32.964498 4745 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" Dec 04 11:35:33.481494 master-0 kubenswrapper[4745]: I1204 11:35:33.481388 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:33.709531 master-0 kubenswrapper[4745]: I1204 11:35:33.709399 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:33.710673 master-0 kubenswrapper[4745]: I1204 11:35:33.710634 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:33.710673 master-0 kubenswrapper[4745]: I1204 11:35:33.710674 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:33.710763 master-0 kubenswrapper[4745]: I1204 11:35:33.710684 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:34.016559 master-0 kubenswrapper[4745]: I1204 11:35:34.016499 4745 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:34.016786 master-0 kubenswrapper[4745]: I1204 11:35:34.016666 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:34.017707 master-0 kubenswrapper[4745]: I1204 11:35:34.017669 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:34.017707 master-0 kubenswrapper[4745]: I1204 11:35:34.017699 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:34.017707 master-0 kubenswrapper[4745]: I1204 11:35:34.017709 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:34.021150 master-0 kubenswrapper[4745]: I1204 11:35:34.021120 4745 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:34.100026 master-0 kubenswrapper[4745]: E1204 11:35:34.099962 4745 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"master-0\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" Dec 04 11:35:34.337407 master-0 kubenswrapper[4745]: I1204 11:35:34.337309 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:34.338893 master-0 kubenswrapper[4745]: I1204 11:35:34.338790 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:34.339042 master-0 kubenswrapper[4745]: I1204 11:35:34.338927 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:34.339042 master-0 kubenswrapper[4745]: I1204 11:35:34.338955 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:34.339199 master-0 kubenswrapper[4745]: I1204 11:35:34.339070 4745 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 11:35:34.345527 master-0 kubenswrapper[4745]: E1204 11:35:34.345453 4745 kubelet_node_status.go:99] "Unable to register node with API server" err="nodes is forbidden: User \"system:anonymous\" cannot create resource \"nodes\" in API group \"\" at the cluster scope" node="master-0" Dec 04 11:35:34.480928 master-0 kubenswrapper[4745]: I1204 11:35:34.480711 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:34.530747 master-0 kubenswrapper[4745]: I1204 11:35:34.530653 4745 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:34.535280 master-0 kubenswrapper[4745]: I1204 11:35:34.535230 4745 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:34.608589 master-0 kubenswrapper[4745]: E1204 11:35:34.608500 4745 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"master-0\" not found" Dec 04 11:35:34.711800 master-0 kubenswrapper[4745]: I1204 11:35:34.711758 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:34.712195 master-0 kubenswrapper[4745]: I1204 11:35:34.711875 4745 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:34.712195 master-0 kubenswrapper[4745]: I1204 11:35:34.712015 4745 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:34.712494 master-0 kubenswrapper[4745]: I1204 11:35:34.712459 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:34.712548 master-0 kubenswrapper[4745]: I1204 11:35:34.712498 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:34.712548 master-0 kubenswrapper[4745]: I1204 11:35:34.712511 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:34.970535 master-0 kubenswrapper[4745]: I1204 11:35:34.970434 4745 csr.go:261] certificate signing request csr-4xbx2 is approved, waiting to be issued Dec 04 11:35:35.478251 master-0 kubenswrapper[4745]: I1204 11:35:35.478180 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:35.602830 master-0 kubenswrapper[4745]: W1204 11:35:35.602765 4745 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:anonymous" cannot list resource "services" in API group "" at the cluster scope Dec 04 11:35:35.602830 master-0 kubenswrapper[4745]: E1204 11:35:35.602828 4745 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" Dec 04 11:35:35.713914 master-0 kubenswrapper[4745]: I1204 11:35:35.713872 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:35.714632 master-0 kubenswrapper[4745]: I1204 11:35:35.714595 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:35.714678 master-0 kubenswrapper[4745]: I1204 11:35:35.714639 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:35.714678 master-0 kubenswrapper[4745]: I1204 11:35:35.714650 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:36.477584 master-0 kubenswrapper[4745]: I1204 11:35:36.477520 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:37.479079 master-0 kubenswrapper[4745]: I1204 11:35:37.479008 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:37.588450 master-0 kubenswrapper[4745]: I1204 11:35:37.588387 4745 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:37.588830 master-0 kubenswrapper[4745]: I1204 11:35:37.588503 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:37.589539 master-0 kubenswrapper[4745]: I1204 11:35:37.589471 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:37.589539 master-0 kubenswrapper[4745]: I1204 11:35:37.589563 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:37.589539 master-0 kubenswrapper[4745]: I1204 11:35:37.589576 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:38.477594 master-0 kubenswrapper[4745]: I1204 11:35:38.477510 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:39.478429 master-0 kubenswrapper[4745]: I1204 11:35:39.478320 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:39.672367 master-0 kubenswrapper[4745]: I1204 11:35:39.672303 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:39.673434 master-0 kubenswrapper[4745]: I1204 11:35:39.673393 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:39.673434 master-0 kubenswrapper[4745]: I1204 11:35:39.673433 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:39.673514 master-0 kubenswrapper[4745]: I1204 11:35:39.673441 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:39.673830 master-0 kubenswrapper[4745]: I1204 11:35:39.673789 4745 scope.go:117] "RemoveContainer" containerID="1c0427f947157f04878c30047e252e4b875cfdd89e58fea9d60ac1e90c4ba60c" Dec 04 11:35:39.681552 master-0 kubenswrapper[4745]: E1204 11:35:39.681414 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-master-0.187e00036ab69ed8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187e00036ab69ed8 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:3169f44496ed8a28c6d6a15511ab0eec,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c69ffd8f8dcceedc2d6eb306cea33f8beabc1be1308cd5f4ee8b9a8e3eab9843\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:18.65106812 +0000 UTC m=+4.353056515,LastTimestamp:2025-12-04 11:35:39.676173276 +0000 UTC m=+25.378161671,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:39.842277 master-0 kubenswrapper[4745]: E1204 11:35:39.841819 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-master-0.187e000376022f31\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187e000376022f31 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:3169f44496ed8a28c6d6a15511ab0eec,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Created,Message:Created container: kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:18.840569649 +0000 UTC m=+4.542558034,LastTimestamp:2025-12-04 11:35:39.834951113 +0000 UTC m=+25.536939508,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:39.850914 master-0 kubenswrapper[4745]: E1204 11:35:39.850693 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-master-0.187e000376e3455b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187e000376e3455b openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:3169f44496ed8a28c6d6a15511ab0eec,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Started,Message:Started container kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:18.855320923 +0000 UTC m=+4.557309318,LastTimestamp:2025-12-04 11:35:39.845017614 +0000 UTC m=+25.547006009,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:40.477468 master-0 kubenswrapper[4745]: I1204 11:35:40.477419 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:40.725209 master-0 kubenswrapper[4745]: I1204 11:35:40.725148 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_3169f44496ed8a28c6d6a15511ab0eec/kube-rbac-proxy-crio/2.log" Dec 04 11:35:40.725957 master-0 kubenswrapper[4745]: I1204 11:35:40.725552 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_3169f44496ed8a28c6d6a15511ab0eec/kube-rbac-proxy-crio/1.log" Dec 04 11:35:40.726051 master-0 kubenswrapper[4745]: I1204 11:35:40.726014 4745 generic.go:334] "Generic (PLEG): container finished" podID="3169f44496ed8a28c6d6a15511ab0eec" containerID="3ed798c104f2e301f0961443f8ab6df6e17ec4caae5f1436b2b93d415a28f796" exitCode=1 Dec 04 11:35:40.726103 master-0 kubenswrapper[4745]: I1204 11:35:40.726051 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"3169f44496ed8a28c6d6a15511ab0eec","Type":"ContainerDied","Data":"3ed798c104f2e301f0961443f8ab6df6e17ec4caae5f1436b2b93d415a28f796"} Dec 04 11:35:40.726103 master-0 kubenswrapper[4745]: I1204 11:35:40.726087 4745 scope.go:117] "RemoveContainer" containerID="1c0427f947157f04878c30047e252e4b875cfdd89e58fea9d60ac1e90c4ba60c" Dec 04 11:35:40.726241 master-0 kubenswrapper[4745]: I1204 11:35:40.726215 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:40.726923 master-0 kubenswrapper[4745]: I1204 11:35:40.726888 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:40.726923 master-0 kubenswrapper[4745]: I1204 11:35:40.726919 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:40.726923 master-0 kubenswrapper[4745]: I1204 11:35:40.726927 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:40.727291 master-0 kubenswrapper[4745]: I1204 11:35:40.727265 4745 scope.go:117] "RemoveContainer" containerID="3ed798c104f2e301f0961443f8ab6df6e17ec4caae5f1436b2b93d415a28f796" Dec 04 11:35:40.727455 master-0 kubenswrapper[4745]: E1204 11:35:40.727426 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-master-0_openshift-machine-config-operator(3169f44496ed8a28c6d6a15511ab0eec)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" podUID="3169f44496ed8a28c6d6a15511ab0eec" Dec 04 11:35:40.732818 master-0 kubenswrapper[4745]: E1204 11:35:40.732680 4745 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-master-0.187e0004d1a18eb4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.187e0004d1a18eb4 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:3169f44496ed8a28c6d6a15511ab0eec,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:BackOff,Message:Back-off restarting failed container kube-rbac-proxy-crio in pod kube-rbac-proxy-crio-master-0_openshift-machine-config-operator(3169f44496ed8a28c6d6a15511ab0eec),Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:35:24.672708276 +0000 UTC m=+10.374696671,LastTimestamp:2025-12-04 11:35:40.727392495 +0000 UTC m=+26.429380890,Count:3,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:35:41.104914 master-0 kubenswrapper[4745]: E1204 11:35:41.104823 4745 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"master-0\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" Dec 04 11:35:41.345838 master-0 kubenswrapper[4745]: I1204 11:35:41.345742 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:41.346931 master-0 kubenswrapper[4745]: I1204 11:35:41.346886 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:41.346931 master-0 kubenswrapper[4745]: I1204 11:35:41.346923 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:41.346931 master-0 kubenswrapper[4745]: I1204 11:35:41.346931 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:41.347088 master-0 kubenswrapper[4745]: I1204 11:35:41.346972 4745 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 11:35:41.351186 master-0 kubenswrapper[4745]: E1204 11:35:41.351143 4745 kubelet_node_status.go:99] "Unable to register node with API server" err="nodes is forbidden: User \"system:anonymous\" cannot create resource \"nodes\" in API group \"\" at the cluster scope" node="master-0" Dec 04 11:35:41.477889 master-0 kubenswrapper[4745]: I1204 11:35:41.477670 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:41.731574 master-0 kubenswrapper[4745]: I1204 11:35:41.731445 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_3169f44496ed8a28c6d6a15511ab0eec/kube-rbac-proxy-crio/2.log" Dec 04 11:35:42.478339 master-0 kubenswrapper[4745]: I1204 11:35:42.478285 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:43.482128 master-0 kubenswrapper[4745]: I1204 11:35:43.481993 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:44.478137 master-0 kubenswrapper[4745]: I1204 11:35:44.478069 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:44.609033 master-0 kubenswrapper[4745]: E1204 11:35:44.608923 4745 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"master-0\" not found" Dec 04 11:35:45.199455 master-0 kubenswrapper[4745]: W1204 11:35:45.199354 4745 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes "master-0" is forbidden: User "system:anonymous" cannot list resource "nodes" in API group "" at the cluster scope Dec 04 11:35:45.199455 master-0 kubenswrapper[4745]: E1204 11:35:45.199437 4745 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes \"master-0\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" Dec 04 11:35:45.479552 master-0 kubenswrapper[4745]: I1204 11:35:45.479321 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:46.479942 master-0 kubenswrapper[4745]: I1204 11:35:46.479855 4745 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Dec 04 11:35:46.941531 master-0 kubenswrapper[4745]: I1204 11:35:46.941475 4745 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:35:46.941766 master-0 kubenswrapper[4745]: I1204 11:35:46.941688 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:46.943079 master-0 kubenswrapper[4745]: I1204 11:35:46.943053 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:46.943147 master-0 kubenswrapper[4745]: I1204 11:35:46.943092 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:46.943147 master-0 kubenswrapper[4745]: I1204 11:35:46.943112 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:47.034576 master-0 kubenswrapper[4745]: I1204 11:35:47.034514 4745 csr.go:257] certificate signing request csr-4xbx2 is issued Dec 04 11:35:47.421644 master-0 kubenswrapper[4745]: I1204 11:35:47.421549 4745 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Dec 04 11:35:47.483040 master-0 kubenswrapper[4745]: I1204 11:35:47.482960 4745 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 11:35:47.499819 master-0 kubenswrapper[4745]: I1204 11:35:47.499713 4745 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 11:35:47.557642 master-0 kubenswrapper[4745]: I1204 11:35:47.557584 4745 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 11:35:47.826302 master-0 kubenswrapper[4745]: I1204 11:35:47.826237 4745 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 11:35:47.826302 master-0 kubenswrapper[4745]: E1204 11:35:47.826286 4745 csi_plugin.go:305] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "master-0" not found Dec 04 11:35:47.848072 master-0 kubenswrapper[4745]: I1204 11:35:47.848008 4745 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 11:35:47.863756 master-0 kubenswrapper[4745]: I1204 11:35:47.863712 4745 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 11:35:47.921334 master-0 kubenswrapper[4745]: I1204 11:35:47.921245 4745 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 11:35:48.036490 master-0 kubenswrapper[4745]: I1204 11:35:48.036424 4745 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Certificate expiration is 2025-12-05 11:26:53 +0000 UTC, rotation deadline is 2025-12-05 08:50:37.669173384 +0000 UTC Dec 04 11:35:48.036490 master-0 kubenswrapper[4745]: I1204 11:35:48.036476 4745 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Waiting 21h14m49.632700176s for next certificate rotation Dec 04 11:35:48.115012 master-0 kubenswrapper[4745]: E1204 11:35:48.114845 4745 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"master-0\" not found" node="master-0" Dec 04 11:35:48.192466 master-0 kubenswrapper[4745]: I1204 11:35:48.192398 4745 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 11:35:48.192466 master-0 kubenswrapper[4745]: E1204 11:35:48.192436 4745 csi_plugin.go:305] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "master-0" not found Dec 04 11:35:48.295903 master-0 kubenswrapper[4745]: I1204 11:35:48.295843 4745 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 11:35:48.310136 master-0 kubenswrapper[4745]: I1204 11:35:48.310071 4745 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Dec 04 11:35:48.352319 master-0 kubenswrapper[4745]: I1204 11:35:48.352233 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:48.353351 master-0 kubenswrapper[4745]: I1204 11:35:48.353307 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:48.353351 master-0 kubenswrapper[4745]: I1204 11:35:48.353342 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:48.353351 master-0 kubenswrapper[4745]: I1204 11:35:48.353352 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:48.353500 master-0 kubenswrapper[4745]: I1204 11:35:48.353414 4745 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 11:35:48.362469 master-0 kubenswrapper[4745]: I1204 11:35:48.362378 4745 kubelet_node_status.go:79] "Successfully registered node" node="master-0" Dec 04 11:35:48.362469 master-0 kubenswrapper[4745]: E1204 11:35:48.362446 4745 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": node \"master-0\" not found" Dec 04 11:35:48.373251 master-0 kubenswrapper[4745]: E1204 11:35:48.373133 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:48.473449 master-0 kubenswrapper[4745]: E1204 11:35:48.473407 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:48.574072 master-0 kubenswrapper[4745]: E1204 11:35:48.574000 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:48.675197 master-0 kubenswrapper[4745]: E1204 11:35:48.675058 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:48.678448 master-0 kubenswrapper[4745]: I1204 11:35:48.678322 4745 certificate_manager.go:356] kubernetes.io/kubelet-serving: Rotating certificates Dec 04 11:35:48.689173 master-0 kubenswrapper[4745]: I1204 11:35:48.689113 4745 reflector.go:368] Caches populated for *v1.CertificateSigningRequest from k8s.io/client-go/tools/watch/informerwatcher.go:146 Dec 04 11:35:48.775728 master-0 kubenswrapper[4745]: E1204 11:35:48.775607 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:48.831362 master-0 kubenswrapper[4745]: I1204 11:35:48.831253 4745 reflector.go:368] Caches populated for *v1.Service from k8s.io/client-go/informers/factory.go:160 Dec 04 11:35:48.876843 master-0 kubenswrapper[4745]: E1204 11:35:48.876753 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:48.977953 master-0 kubenswrapper[4745]: E1204 11:35:48.977758 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:49.078410 master-0 kubenswrapper[4745]: E1204 11:35:49.078340 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:49.179262 master-0 kubenswrapper[4745]: E1204 11:35:49.179176 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:49.280259 master-0 kubenswrapper[4745]: E1204 11:35:49.280089 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:49.380918 master-0 kubenswrapper[4745]: E1204 11:35:49.380868 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:49.481264 master-0 kubenswrapper[4745]: E1204 11:35:49.481158 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:49.582004 master-0 kubenswrapper[4745]: E1204 11:35:49.581921 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:49.683296 master-0 kubenswrapper[4745]: E1204 11:35:49.683154 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:49.783591 master-0 kubenswrapper[4745]: E1204 11:35:49.783496 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:49.884439 master-0 kubenswrapper[4745]: E1204 11:35:49.884191 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:49.984982 master-0 kubenswrapper[4745]: E1204 11:35:49.984863 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:50.085383 master-0 kubenswrapper[4745]: E1204 11:35:50.085291 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:50.186192 master-0 kubenswrapper[4745]: E1204 11:35:50.185971 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:50.287106 master-0 kubenswrapper[4745]: E1204 11:35:50.287004 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:50.387754 master-0 kubenswrapper[4745]: E1204 11:35:50.387642 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:50.488837 master-0 kubenswrapper[4745]: E1204 11:35:50.488600 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:50.589270 master-0 kubenswrapper[4745]: E1204 11:35:50.589185 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:50.690259 master-0 kubenswrapper[4745]: E1204 11:35:50.690150 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:50.790692 master-0 kubenswrapper[4745]: E1204 11:35:50.790435 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:50.890791 master-0 kubenswrapper[4745]: E1204 11:35:50.890643 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:50.991197 master-0 kubenswrapper[4745]: E1204 11:35:50.991065 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:51.002632 master-0 kubenswrapper[4745]: I1204 11:35:51.002558 4745 reflector.go:368] Caches populated for *v1.CSIDriver from k8s.io/client-go/informers/factory.go:160 Dec 04 11:35:51.092336 master-0 kubenswrapper[4745]: E1204 11:35:51.092183 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:51.193095 master-0 kubenswrapper[4745]: E1204 11:35:51.193009 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:51.294074 master-0 kubenswrapper[4745]: E1204 11:35:51.293934 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:51.395231 master-0 kubenswrapper[4745]: E1204 11:35:51.394962 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:51.495579 master-0 kubenswrapper[4745]: E1204 11:35:51.495478 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:51.596725 master-0 kubenswrapper[4745]: E1204 11:35:51.596655 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:51.697076 master-0 kubenswrapper[4745]: E1204 11:35:51.696921 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:51.797470 master-0 kubenswrapper[4745]: E1204 11:35:51.797397 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:51.898310 master-0 kubenswrapper[4745]: E1204 11:35:51.898239 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:51.998556 master-0 kubenswrapper[4745]: E1204 11:35:51.998424 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:52.099479 master-0 kubenswrapper[4745]: E1204 11:35:52.099161 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:52.199997 master-0 kubenswrapper[4745]: E1204 11:35:52.199912 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:52.257112 master-0 kubenswrapper[4745]: I1204 11:35:52.256952 4745 reflector.go:368] Caches populated for *v1.RuntimeClass from k8s.io/client-go/informers/factory.go:160 Dec 04 11:35:52.300557 master-0 kubenswrapper[4745]: E1204 11:35:52.300486 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:52.401135 master-0 kubenswrapper[4745]: E1204 11:35:52.401039 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:52.501502 master-0 kubenswrapper[4745]: E1204 11:35:52.501438 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:52.602004 master-0 kubenswrapper[4745]: E1204 11:35:52.601931 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:52.702958 master-0 kubenswrapper[4745]: E1204 11:35:52.702871 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:52.803390 master-0 kubenswrapper[4745]: E1204 11:35:52.803077 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:52.904224 master-0 kubenswrapper[4745]: E1204 11:35:52.904080 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:53.004302 master-0 kubenswrapper[4745]: E1204 11:35:53.004228 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:53.105075 master-0 kubenswrapper[4745]: E1204 11:35:53.104960 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:53.205910 master-0 kubenswrapper[4745]: E1204 11:35:53.205634 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:53.306766 master-0 kubenswrapper[4745]: E1204 11:35:53.306657 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:53.407608 master-0 kubenswrapper[4745]: E1204 11:35:53.407483 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:53.508917 master-0 kubenswrapper[4745]: E1204 11:35:53.508606 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:53.609359 master-0 kubenswrapper[4745]: E1204 11:35:53.609294 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:53.625646 master-0 kubenswrapper[4745]: I1204 11:35:53.625562 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:35:53.626924 master-0 kubenswrapper[4745]: I1204 11:35:53.626895 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:35:53.626924 master-0 kubenswrapper[4745]: I1204 11:35:53.626926 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:35:53.627046 master-0 kubenswrapper[4745]: I1204 11:35:53.626936 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:35:53.627310 master-0 kubenswrapper[4745]: I1204 11:35:53.627284 4745 scope.go:117] "RemoveContainer" containerID="3ed798c104f2e301f0961443f8ab6df6e17ec4caae5f1436b2b93d415a28f796" Dec 04 11:35:53.627465 master-0 kubenswrapper[4745]: E1204 11:35:53.627431 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-master-0_openshift-machine-config-operator(3169f44496ed8a28c6d6a15511ab0eec)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" podUID="3169f44496ed8a28c6d6a15511ab0eec" Dec 04 11:35:53.710193 master-0 kubenswrapper[4745]: E1204 11:35:53.710116 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:53.810948 master-0 kubenswrapper[4745]: E1204 11:35:53.810888 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:53.911074 master-0 kubenswrapper[4745]: E1204 11:35:53.910993 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:54.011653 master-0 kubenswrapper[4745]: E1204 11:35:54.011569 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:54.112122 master-0 kubenswrapper[4745]: E1204 11:35:54.111973 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:54.212737 master-0 kubenswrapper[4745]: E1204 11:35:54.212657 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:54.313372 master-0 kubenswrapper[4745]: E1204 11:35:54.313284 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:54.414574 master-0 kubenswrapper[4745]: E1204 11:35:54.414448 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:54.515579 master-0 kubenswrapper[4745]: E1204 11:35:54.515509 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:54.609973 master-0 kubenswrapper[4745]: E1204 11:35:54.609901 4745 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"master-0\" not found" Dec 04 11:35:54.616004 master-0 kubenswrapper[4745]: E1204 11:35:54.615859 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:54.717216 master-0 kubenswrapper[4745]: E1204 11:35:54.717002 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:54.817412 master-0 kubenswrapper[4745]: E1204 11:35:54.817335 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:54.918343 master-0 kubenswrapper[4745]: E1204 11:35:54.918230 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:55.019237 master-0 kubenswrapper[4745]: E1204 11:35:55.019033 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:55.119967 master-0 kubenswrapper[4745]: E1204 11:35:55.119895 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:55.220938 master-0 kubenswrapper[4745]: E1204 11:35:55.220847 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:55.321990 master-0 kubenswrapper[4745]: E1204 11:35:55.321916 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:55.422656 master-0 kubenswrapper[4745]: E1204 11:35:55.422588 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:55.522775 master-0 kubenswrapper[4745]: E1204 11:35:55.522711 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:55.615781 master-0 kubenswrapper[4745]: I1204 11:35:55.615653 4745 csr.go:261] certificate signing request csr-brmvj is approved, waiting to be issued Dec 04 11:35:55.624062 master-0 kubenswrapper[4745]: E1204 11:35:55.623991 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:55.625200 master-0 kubenswrapper[4745]: I1204 11:35:55.625157 4745 csr.go:257] certificate signing request csr-brmvj is issued Dec 04 11:35:55.724490 master-0 kubenswrapper[4745]: E1204 11:35:55.724410 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:55.825363 master-0 kubenswrapper[4745]: E1204 11:35:55.825231 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:55.926257 master-0 kubenswrapper[4745]: E1204 11:35:55.925981 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:56.027196 master-0 kubenswrapper[4745]: E1204 11:35:56.027116 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:56.127920 master-0 kubenswrapper[4745]: E1204 11:35:56.127840 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:56.228176 master-0 kubenswrapper[4745]: E1204 11:35:56.228025 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:56.329248 master-0 kubenswrapper[4745]: E1204 11:35:56.329157 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:56.430060 master-0 kubenswrapper[4745]: E1204 11:35:56.429997 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:56.530347 master-0 kubenswrapper[4745]: E1204 11:35:56.530202 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:56.627336 master-0 kubenswrapper[4745]: I1204 11:35:56.627208 4745 certificate_manager.go:356] kubernetes.io/kubelet-serving: Certificate expiration is 2025-12-05 11:26:53 +0000 UTC, rotation deadline is 2025-12-05 06:26:06.094027127 +0000 UTC Dec 04 11:35:56.627336 master-0 kubenswrapper[4745]: I1204 11:35:56.627283 4745 certificate_manager.go:356] kubernetes.io/kubelet-serving: Waiting 18h50m9.466747845s for next certificate rotation Dec 04 11:35:56.631469 master-0 kubenswrapper[4745]: E1204 11:35:56.631398 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:56.732405 master-0 kubenswrapper[4745]: E1204 11:35:56.732343 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:56.833140 master-0 kubenswrapper[4745]: E1204 11:35:56.833046 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:56.934288 master-0 kubenswrapper[4745]: E1204 11:35:56.934173 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:57.035272 master-0 kubenswrapper[4745]: E1204 11:35:57.035171 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:57.136477 master-0 kubenswrapper[4745]: E1204 11:35:57.136331 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:57.237276 master-0 kubenswrapper[4745]: E1204 11:35:57.237183 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:57.338064 master-0 kubenswrapper[4745]: E1204 11:35:57.337965 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:57.439126 master-0 kubenswrapper[4745]: E1204 11:35:57.438911 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:57.539587 master-0 kubenswrapper[4745]: E1204 11:35:57.539460 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:57.628034 master-0 kubenswrapper[4745]: I1204 11:35:57.627935 4745 certificate_manager.go:356] kubernetes.io/kubelet-serving: Certificate expiration is 2025-12-05 11:26:53 +0000 UTC, rotation deadline is 2025-12-05 09:02:12.807437551 +0000 UTC Dec 04 11:35:57.628034 master-0 kubenswrapper[4745]: I1204 11:35:57.627993 4745 certificate_manager.go:356] kubernetes.io/kubelet-serving: Waiting 21h26m15.179446643s for next certificate rotation Dec 04 11:35:57.640197 master-0 kubenswrapper[4745]: E1204 11:35:57.640111 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:57.741443 master-0 kubenswrapper[4745]: E1204 11:35:57.741286 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:57.842478 master-0 kubenswrapper[4745]: E1204 11:35:57.842376 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:57.943388 master-0 kubenswrapper[4745]: E1204 11:35:57.943305 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:58.043582 master-0 kubenswrapper[4745]: E1204 11:35:58.043441 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:58.144300 master-0 kubenswrapper[4745]: E1204 11:35:58.144236 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:58.245304 master-0 kubenswrapper[4745]: E1204 11:35:58.245204 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:58.346021 master-0 kubenswrapper[4745]: E1204 11:35:58.345909 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:58.447065 master-0 kubenswrapper[4745]: E1204 11:35:58.446989 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:58.547635 master-0 kubenswrapper[4745]: E1204 11:35:58.547551 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:58.648900 master-0 kubenswrapper[4745]: E1204 11:35:58.648710 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:58.697521 master-0 kubenswrapper[4745]: E1204 11:35:58.697439 4745 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": node \"master-0\" not found" Dec 04 11:35:58.749975 master-0 kubenswrapper[4745]: E1204 11:35:58.749874 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:58.851053 master-0 kubenswrapper[4745]: E1204 11:35:58.850991 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:58.951415 master-0 kubenswrapper[4745]: E1204 11:35:58.951293 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:59.052111 master-0 kubenswrapper[4745]: E1204 11:35:59.051993 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:59.152755 master-0 kubenswrapper[4745]: E1204 11:35:59.152646 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:59.253613 master-0 kubenswrapper[4745]: E1204 11:35:59.253410 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:59.354454 master-0 kubenswrapper[4745]: E1204 11:35:59.354283 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:59.454851 master-0 kubenswrapper[4745]: E1204 11:35:59.454640 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:59.555079 master-0 kubenswrapper[4745]: E1204 11:35:59.554890 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:59.655913 master-0 kubenswrapper[4745]: E1204 11:35:59.655836 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:59.756471 master-0 kubenswrapper[4745]: E1204 11:35:59.756347 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:59.856654 master-0 kubenswrapper[4745]: E1204 11:35:59.856543 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:35:59.957572 master-0 kubenswrapper[4745]: E1204 11:35:59.957462 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:00.057698 master-0 kubenswrapper[4745]: E1204 11:36:00.057613 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:00.158601 master-0 kubenswrapper[4745]: E1204 11:36:00.158377 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:00.259143 master-0 kubenswrapper[4745]: E1204 11:36:00.259059 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:00.359887 master-0 kubenswrapper[4745]: E1204 11:36:00.359768 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:00.461071 master-0 kubenswrapper[4745]: E1204 11:36:00.460832 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:00.561730 master-0 kubenswrapper[4745]: E1204 11:36:00.561590 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:00.661923 master-0 kubenswrapper[4745]: E1204 11:36:00.661766 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:00.763157 master-0 kubenswrapper[4745]: E1204 11:36:00.762854 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:00.863313 master-0 kubenswrapper[4745]: E1204 11:36:00.863059 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:00.963989 master-0 kubenswrapper[4745]: E1204 11:36:00.963888 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:01.064870 master-0 kubenswrapper[4745]: E1204 11:36:01.064783 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:01.165492 master-0 kubenswrapper[4745]: E1204 11:36:01.165413 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:01.266490 master-0 kubenswrapper[4745]: E1204 11:36:01.266387 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:01.367181 master-0 kubenswrapper[4745]: E1204 11:36:01.367014 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:01.468257 master-0 kubenswrapper[4745]: E1204 11:36:01.468168 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:01.568984 master-0 kubenswrapper[4745]: E1204 11:36:01.568858 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:01.669400 master-0 kubenswrapper[4745]: E1204 11:36:01.669253 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:01.770336 master-0 kubenswrapper[4745]: E1204 11:36:01.770205 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:01.871147 master-0 kubenswrapper[4745]: E1204 11:36:01.871073 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:01.971338 master-0 kubenswrapper[4745]: E1204 11:36:01.971182 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:02.072073 master-0 kubenswrapper[4745]: E1204 11:36:02.071985 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:02.172555 master-0 kubenswrapper[4745]: E1204 11:36:02.172476 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:02.273574 master-0 kubenswrapper[4745]: E1204 11:36:02.273218 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:02.374356 master-0 kubenswrapper[4745]: E1204 11:36:02.374236 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:02.474828 master-0 kubenswrapper[4745]: E1204 11:36:02.474708 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:02.575972 master-0 kubenswrapper[4745]: E1204 11:36:02.575875 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:02.676327 master-0 kubenswrapper[4745]: E1204 11:36:02.676255 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:02.776507 master-0 kubenswrapper[4745]: E1204 11:36:02.776435 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:02.877118 master-0 kubenswrapper[4745]: E1204 11:36:02.876928 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:02.977996 master-0 kubenswrapper[4745]: E1204 11:36:02.977883 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:03.078984 master-0 kubenswrapper[4745]: E1204 11:36:03.078873 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:03.179766 master-0 kubenswrapper[4745]: E1204 11:36:03.179535 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:03.280403 master-0 kubenswrapper[4745]: E1204 11:36:03.280274 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:03.381107 master-0 kubenswrapper[4745]: E1204 11:36:03.381031 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:03.481549 master-0 kubenswrapper[4745]: E1204 11:36:03.481304 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:03.582546 master-0 kubenswrapper[4745]: E1204 11:36:03.582422 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:03.682967 master-0 kubenswrapper[4745]: E1204 11:36:03.682888 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:03.784066 master-0 kubenswrapper[4745]: E1204 11:36:03.783913 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:03.884661 master-0 kubenswrapper[4745]: E1204 11:36:03.884550 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:03.985144 master-0 kubenswrapper[4745]: E1204 11:36:03.985031 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:04.085659 master-0 kubenswrapper[4745]: E1204 11:36:04.085546 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:04.185842 master-0 kubenswrapper[4745]: E1204 11:36:04.185700 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:04.286206 master-0 kubenswrapper[4745]: E1204 11:36:04.286122 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:04.386904 master-0 kubenswrapper[4745]: E1204 11:36:04.386699 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:04.487427 master-0 kubenswrapper[4745]: E1204 11:36:04.487302 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:04.588347 master-0 kubenswrapper[4745]: E1204 11:36:04.588224 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:04.610713 master-0 kubenswrapper[4745]: E1204 11:36:04.610575 4745 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"master-0\" not found" Dec 04 11:36:04.688943 master-0 kubenswrapper[4745]: E1204 11:36:04.688694 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:04.789502 master-0 kubenswrapper[4745]: E1204 11:36:04.789399 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:04.889868 master-0 kubenswrapper[4745]: E1204 11:36:04.889755 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:04.990048 master-0 kubenswrapper[4745]: E1204 11:36:04.989866 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:05.091005 master-0 kubenswrapper[4745]: E1204 11:36:05.090880 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:05.191956 master-0 kubenswrapper[4745]: E1204 11:36:05.191869 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:05.292642 master-0 kubenswrapper[4745]: E1204 11:36:05.292165 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:05.393023 master-0 kubenswrapper[4745]: E1204 11:36:05.392895 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:05.493711 master-0 kubenswrapper[4745]: E1204 11:36:05.493594 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:05.594414 master-0 kubenswrapper[4745]: E1204 11:36:05.594264 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:05.694774 master-0 kubenswrapper[4745]: E1204 11:36:05.694654 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:05.795124 master-0 kubenswrapper[4745]: E1204 11:36:05.795050 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:05.896287 master-0 kubenswrapper[4745]: E1204 11:36:05.896059 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:05.996281 master-0 kubenswrapper[4745]: E1204 11:36:05.996216 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:06.096770 master-0 kubenswrapper[4745]: E1204 11:36:06.096678 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:06.197790 master-0 kubenswrapper[4745]: E1204 11:36:06.197636 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:06.297882 master-0 kubenswrapper[4745]: E1204 11:36:06.297764 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:06.398557 master-0 kubenswrapper[4745]: E1204 11:36:06.398486 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:06.499012 master-0 kubenswrapper[4745]: E1204 11:36:06.498866 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:06.599976 master-0 kubenswrapper[4745]: E1204 11:36:06.599911 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:06.626314 master-0 kubenswrapper[4745]: I1204 11:36:06.626246 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:36:06.627185 master-0 kubenswrapper[4745]: I1204 11:36:06.627153 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:36:06.627232 master-0 kubenswrapper[4745]: I1204 11:36:06.627195 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:36:06.627232 master-0 kubenswrapper[4745]: I1204 11:36:06.627210 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:36:06.627547 master-0 kubenswrapper[4745]: I1204 11:36:06.627522 4745 scope.go:117] "RemoveContainer" containerID="3ed798c104f2e301f0961443f8ab6df6e17ec4caae5f1436b2b93d415a28f796" Dec 04 11:36:06.700601 master-0 kubenswrapper[4745]: E1204 11:36:06.700497 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:06.801228 master-0 kubenswrapper[4745]: E1204 11:36:06.801125 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:06.901640 master-0 kubenswrapper[4745]: E1204 11:36:06.901564 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:07.002497 master-0 kubenswrapper[4745]: E1204 11:36:07.002349 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:07.103432 master-0 kubenswrapper[4745]: E1204 11:36:07.103361 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:07.204571 master-0 kubenswrapper[4745]: E1204 11:36:07.204478 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:07.305660 master-0 kubenswrapper[4745]: E1204 11:36:07.305585 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:07.406188 master-0 kubenswrapper[4745]: E1204 11:36:07.405860 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:07.507046 master-0 kubenswrapper[4745]: E1204 11:36:07.506915 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:07.607485 master-0 kubenswrapper[4745]: E1204 11:36:07.607364 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:07.708287 master-0 kubenswrapper[4745]: E1204 11:36:07.708082 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:07.791475 master-0 kubenswrapper[4745]: I1204 11:36:07.791395 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_3169f44496ed8a28c6d6a15511ab0eec/kube-rbac-proxy-crio/2.log" Dec 04 11:36:07.791851 master-0 kubenswrapper[4745]: I1204 11:36:07.791793 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"3169f44496ed8a28c6d6a15511ab0eec","Type":"ContainerStarted","Data":"cdc388259d8085154ae8e01bcad3dcfe7d469aa6e6aee3f021b6d2209453f2f4"} Dec 04 11:36:07.791957 master-0 kubenswrapper[4745]: I1204 11:36:07.791936 4745 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:36:07.792909 master-0 kubenswrapper[4745]: I1204 11:36:07.792782 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:36:07.792909 master-0 kubenswrapper[4745]: I1204 11:36:07.792894 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:36:07.792909 master-0 kubenswrapper[4745]: I1204 11:36:07.792909 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:36:07.808643 master-0 kubenswrapper[4745]: E1204 11:36:07.808562 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:07.909675 master-0 kubenswrapper[4745]: E1204 11:36:07.909600 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:08.010973 master-0 kubenswrapper[4745]: E1204 11:36:08.010736 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:08.111707 master-0 kubenswrapper[4745]: E1204 11:36:08.111622 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:08.212712 master-0 kubenswrapper[4745]: E1204 11:36:08.212639 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:08.313490 master-0 kubenswrapper[4745]: E1204 11:36:08.313436 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:08.414482 master-0 kubenswrapper[4745]: E1204 11:36:08.414292 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:08.515085 master-0 kubenswrapper[4745]: E1204 11:36:08.514942 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:08.615307 master-0 kubenswrapper[4745]: E1204 11:36:08.615107 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:08.715384 master-0 kubenswrapper[4745]: E1204 11:36:08.715263 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:08.816123 master-0 kubenswrapper[4745]: E1204 11:36:08.815981 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:08.856300 master-0 kubenswrapper[4745]: E1204 11:36:08.856208 4745 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": node \"master-0\" not found" Dec 04 11:36:08.916903 master-0 kubenswrapper[4745]: E1204 11:36:08.916648 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:09.017555 master-0 kubenswrapper[4745]: E1204 11:36:09.017406 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:09.118253 master-0 kubenswrapper[4745]: E1204 11:36:09.118129 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:09.219410 master-0 kubenswrapper[4745]: E1204 11:36:09.219166 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:09.320189 master-0 kubenswrapper[4745]: E1204 11:36:09.320056 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:09.420508 master-0 kubenswrapper[4745]: E1204 11:36:09.420393 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:09.521451 master-0 kubenswrapper[4745]: E1204 11:36:09.521109 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:09.621620 master-0 kubenswrapper[4745]: E1204 11:36:09.621524 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:09.721953 master-0 kubenswrapper[4745]: E1204 11:36:09.721781 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:09.822899 master-0 kubenswrapper[4745]: E1204 11:36:09.822759 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:09.923580 master-0 kubenswrapper[4745]: E1204 11:36:09.923490 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:10.023838 master-0 kubenswrapper[4745]: E1204 11:36:10.023723 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:10.124627 master-0 kubenswrapper[4745]: E1204 11:36:10.124479 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:10.225295 master-0 kubenswrapper[4745]: E1204 11:36:10.225215 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:10.325473 master-0 kubenswrapper[4745]: E1204 11:36:10.325392 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:10.426393 master-0 kubenswrapper[4745]: E1204 11:36:10.426219 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:10.527399 master-0 kubenswrapper[4745]: E1204 11:36:10.527287 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:10.628474 master-0 kubenswrapper[4745]: E1204 11:36:10.628373 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:10.729105 master-0 kubenswrapper[4745]: E1204 11:36:10.728919 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:10.829637 master-0 kubenswrapper[4745]: E1204 11:36:10.829544 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:10.929858 master-0 kubenswrapper[4745]: E1204 11:36:10.929720 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:11.030172 master-0 kubenswrapper[4745]: E1204 11:36:11.029942 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:11.131208 master-0 kubenswrapper[4745]: E1204 11:36:11.131073 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:11.231373 master-0 kubenswrapper[4745]: E1204 11:36:11.231241 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:11.331659 master-0 kubenswrapper[4745]: E1204 11:36:11.331559 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:11.432192 master-0 kubenswrapper[4745]: E1204 11:36:11.432066 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:11.533235 master-0 kubenswrapper[4745]: E1204 11:36:11.533127 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:11.634027 master-0 kubenswrapper[4745]: E1204 11:36:11.633696 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:11.734452 master-0 kubenswrapper[4745]: E1204 11:36:11.734287 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:11.835710 master-0 kubenswrapper[4745]: E1204 11:36:11.835400 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:11.935860 master-0 kubenswrapper[4745]: E1204 11:36:11.935590 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:12.035855 master-0 kubenswrapper[4745]: E1204 11:36:12.035724 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:12.136757 master-0 kubenswrapper[4745]: E1204 11:36:12.136637 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:12.237510 master-0 kubenswrapper[4745]: E1204 11:36:12.237309 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:12.338339 master-0 kubenswrapper[4745]: E1204 11:36:12.338245 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:12.439376 master-0 kubenswrapper[4745]: E1204 11:36:12.439248 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:12.540132 master-0 kubenswrapper[4745]: E1204 11:36:12.539925 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:12.640202 master-0 kubenswrapper[4745]: E1204 11:36:12.640092 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:12.740359 master-0 kubenswrapper[4745]: E1204 11:36:12.740275 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:12.840924 master-0 kubenswrapper[4745]: E1204 11:36:12.840798 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:12.941084 master-0 kubenswrapper[4745]: E1204 11:36:12.940974 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:13.041470 master-0 kubenswrapper[4745]: E1204 11:36:13.041358 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:13.142260 master-0 kubenswrapper[4745]: E1204 11:36:13.141945 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:13.242559 master-0 kubenswrapper[4745]: E1204 11:36:13.242439 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:13.343542 master-0 kubenswrapper[4745]: E1204 11:36:13.343420 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:13.444625 master-0 kubenswrapper[4745]: E1204 11:36:13.444390 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:13.544737 master-0 kubenswrapper[4745]: E1204 11:36:13.544597 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:13.644957 master-0 kubenswrapper[4745]: E1204 11:36:13.644800 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:13.746164 master-0 kubenswrapper[4745]: E1204 11:36:13.745899 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:13.846407 master-0 kubenswrapper[4745]: E1204 11:36:13.846261 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:13.947096 master-0 kubenswrapper[4745]: E1204 11:36:13.946960 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:14.048067 master-0 kubenswrapper[4745]: E1204 11:36:14.047789 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:14.148651 master-0 kubenswrapper[4745]: E1204 11:36:14.148532 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:14.249294 master-0 kubenswrapper[4745]: E1204 11:36:14.249180 4745 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:36:14.320790 master-0 kubenswrapper[4745]: I1204 11:36:14.320687 4745 reflector.go:368] Caches populated for *v1.Node from k8s.io/client-go/informers/factory.go:160 Dec 04 11:36:14.508218 master-0 kubenswrapper[4745]: I1204 11:36:14.508140 4745 apiserver.go:52] "Watching apiserver" Dec 04 11:36:14.511380 master-0 kubenswrapper[4745]: I1204 11:36:14.511313 4745 reflector.go:368] Caches populated for *v1.Pod from pkg/kubelet/config/apiserver.go:66 Dec 04 11:36:14.511745 master-0 kubenswrapper[4745]: I1204 11:36:14.511671 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-network-operator/network-operator-79767b7ff9-5bgzx","assisted-installer/assisted-installer-controller-lj5rn","openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd"] Dec 04 11:36:14.512417 master-0 kubenswrapper[4745]: I1204 11:36:14.512355 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="assisted-installer/assisted-installer-controller-lj5rn" Dec 04 11:36:14.512417 master-0 kubenswrapper[4745]: I1204 11:36:14.512390 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:36:14.513260 master-0 kubenswrapper[4745]: I1204 11:36:14.512582 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:36:14.514619 master-0 kubenswrapper[4745]: I1204 11:36:14.514573 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-version"/"cluster-version-operator-serving-cert" Dec 04 11:36:14.515242 master-0 kubenswrapper[4745]: I1204 11:36:14.515214 4745 reflector.go:368] Caches populated for *v1.Secret from object-"assisted-installer"/"assisted-installer-controller-secret" Dec 04 11:36:14.515242 master-0 kubenswrapper[4745]: I1204 11:36:14.515230 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"assisted-installer"/"assisted-installer-controller-config" Dec 04 11:36:14.515989 master-0 kubenswrapper[4745]: I1204 11:36:14.515629 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"openshift-service-ca.crt" Dec 04 11:36:14.515989 master-0 kubenswrapper[4745]: I1204 11:36:14.515878 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"openshift-service-ca.crt" Dec 04 11:36:14.516248 master-0 kubenswrapper[4745]: I1204 11:36:14.516037 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"assisted-installer"/"kube-root-ca.crt" Dec 04 11:36:14.517144 master-0 kubenswrapper[4745]: I1204 11:36:14.517107 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"kube-root-ca.crt" Dec 04 11:36:14.517717 master-0 kubenswrapper[4745]: I1204 11:36:14.517256 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"kube-root-ca.crt" Dec 04 11:36:14.517717 master-0 kubenswrapper[4745]: I1204 11:36:14.517312 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-operator"/"metrics-tls" Dec 04 11:36:14.517717 master-0 kubenswrapper[4745]: I1204 11:36:14.517443 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"assisted-installer"/"openshift-service-ca.crt" Dec 04 11:36:14.582003 master-0 kubenswrapper[4745]: I1204 11:36:14.581859 4745 desired_state_of_world_populator.go:155] "Finished populating initial desired state of world" Dec 04 11:36:14.624298 master-0 kubenswrapper[4745]: I1204 11:36:14.624209 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69640270-09e6-4217-b1c8-3d3465c0c3ae-service-ca\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:36:14.624298 master-0 kubenswrapper[4745]: I1204 11:36:14.624269 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/69640270-09e6-4217-b1c8-3d3465c0c3ae-etc-cvo-updatepayloads\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:36:14.624617 master-0 kubenswrapper[4745]: I1204 11:36:14.624461 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-run-resolv-conf\" (UniqueName: \"kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-host-var-run-resolv-conf\") pod \"assisted-installer-controller-lj5rn\" (UID: \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\") " pod="assisted-installer/assisted-installer-controller-lj5rn" Dec 04 11:36:14.624617 master-0 kubenswrapper[4745]: I1204 11:36:14.624551 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sno-bootstrap-files\" (UniqueName: \"kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-sno-bootstrap-files\") pod \"assisted-installer-controller-lj5rn\" (UID: \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\") " pod="assisted-installer/assisted-installer-controller-lj5rn" Dec 04 11:36:14.624617 master-0 kubenswrapper[4745]: I1204 11:36:14.624611 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrb6d\" (UniqueName: \"kubernetes.io/projected/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-kube-api-access-zrb6d\") pod \"assisted-installer-controller-lj5rn\" (UID: \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\") " pod="assisted-installer/assisted-installer-controller-lj5rn" Dec 04 11:36:14.624788 master-0 kubenswrapper[4745]: I1204 11:36:14.624674 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/69640270-09e6-4217-b1c8-3d3465c0c3ae-kube-api-access\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:36:14.624788 master-0 kubenswrapper[4745]: I1204 11:36:14.624727 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/69640270-09e6-4217-b1c8-3d3465c0c3ae-etc-ssl-certs\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:36:14.624788 master-0 kubenswrapper[4745]: I1204 11:36:14.624775 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-host-etc-kube\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:36:14.624907 master-0 kubenswrapper[4745]: I1204 11:36:14.624847 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-ca-bundle\" (UniqueName: \"kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-host-ca-bundle\") pod \"assisted-installer-controller-lj5rn\" (UID: \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\") " pod="assisted-installer/assisted-installer-controller-lj5rn" Dec 04 11:36:14.625033 master-0 kubenswrapper[4745]: I1204 11:36:14.624972 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-resolv-conf\" (UniqueName: \"kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-host-resolv-conf\") pod \"assisted-installer-controller-lj5rn\" (UID: \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\") " pod="assisted-installer/assisted-installer-controller-lj5rn" Dec 04 11:36:14.625133 master-0 kubenswrapper[4745]: I1204 11:36:14.625091 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:36:14.625909 master-0 kubenswrapper[4745]: I1204 11:36:14.625833 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-metrics-tls\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:36:14.625971 master-0 kubenswrapper[4745]: I1204 11:36:14.625941 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6bkg\" (UniqueName: \"kubernetes.io/projected/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-kube-api-access-t6bkg\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:36:14.726477 master-0 kubenswrapper[4745]: I1204 11:36:14.726358 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-run-resolv-conf\" (UniqueName: \"kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-host-var-run-resolv-conf\") pod \"assisted-installer-controller-lj5rn\" (UID: \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\") " pod="assisted-installer/assisted-installer-controller-lj5rn" Dec 04 11:36:14.726477 master-0 kubenswrapper[4745]: I1204 11:36:14.726451 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sno-bootstrap-files\" (UniqueName: \"kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-sno-bootstrap-files\") pod \"assisted-installer-controller-lj5rn\" (UID: \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\") " pod="assisted-installer/assisted-installer-controller-lj5rn" Dec 04 11:36:14.726850 master-0 kubenswrapper[4745]: I1204 11:36:14.726503 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-run-resolv-conf\" (UniqueName: \"kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-host-var-run-resolv-conf\") pod \"assisted-installer-controller-lj5rn\" (UID: \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\") " pod="assisted-installer/assisted-installer-controller-lj5rn" Dec 04 11:36:14.726850 master-0 kubenswrapper[4745]: I1204 11:36:14.726520 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zrb6d\" (UniqueName: \"kubernetes.io/projected/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-kube-api-access-zrb6d\") pod \"assisted-installer-controller-lj5rn\" (UID: \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\") " pod="assisted-installer/assisted-installer-controller-lj5rn" Dec 04 11:36:14.726850 master-0 kubenswrapper[4745]: I1204 11:36:14.726635 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sno-bootstrap-files\" (UniqueName: \"kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-sno-bootstrap-files\") pod \"assisted-installer-controller-lj5rn\" (UID: \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\") " pod="assisted-installer/assisted-installer-controller-lj5rn" Dec 04 11:36:14.726850 master-0 kubenswrapper[4745]: I1204 11:36:14.726647 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/69640270-09e6-4217-b1c8-3d3465c0c3ae-kube-api-access\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:36:14.726850 master-0 kubenswrapper[4745]: I1204 11:36:14.726779 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/69640270-09e6-4217-b1c8-3d3465c0c3ae-etc-ssl-certs\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:36:14.726850 master-0 kubenswrapper[4745]: I1204 11:36:14.726836 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-host-etc-kube\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:36:14.727167 master-0 kubenswrapper[4745]: I1204 11:36:14.726859 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-metrics-tls\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:36:14.727167 master-0 kubenswrapper[4745]: I1204 11:36:14.726882 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t6bkg\" (UniqueName: \"kubernetes.io/projected/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-kube-api-access-t6bkg\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:36:14.727167 master-0 kubenswrapper[4745]: I1204 11:36:14.726898 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/69640270-09e6-4217-b1c8-3d3465c0c3ae-etc-ssl-certs\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:36:14.727167 master-0 kubenswrapper[4745]: I1204 11:36:14.726911 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-ca-bundle\" (UniqueName: \"kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-host-ca-bundle\") pod \"assisted-installer-controller-lj5rn\" (UID: \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\") " pod="assisted-installer/assisted-installer-controller-lj5rn" Dec 04 11:36:14.727167 master-0 kubenswrapper[4745]: I1204 11:36:14.726946 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-resolv-conf\" (UniqueName: \"kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-host-resolv-conf\") pod \"assisted-installer-controller-lj5rn\" (UID: \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\") " pod="assisted-installer/assisted-installer-controller-lj5rn" Dec 04 11:36:14.727167 master-0 kubenswrapper[4745]: I1204 11:36:14.726967 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:36:14.727167 master-0 kubenswrapper[4745]: I1204 11:36:14.726979 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-host-etc-kube\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:36:14.727167 master-0 kubenswrapper[4745]: I1204 11:36:14.727114 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/69640270-09e6-4217-b1c8-3d3465c0c3ae-etc-cvo-updatepayloads\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:36:14.727167 master-0 kubenswrapper[4745]: I1204 11:36:14.727148 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69640270-09e6-4217-b1c8-3d3465c0c3ae-service-ca\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:36:14.727489 master-0 kubenswrapper[4745]: I1204 11:36:14.727168 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/69640270-09e6-4217-b1c8-3d3465c0c3ae-etc-cvo-updatepayloads\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:36:14.727489 master-0 kubenswrapper[4745]: I1204 11:36:14.727205 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-ca-bundle\" (UniqueName: \"kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-host-ca-bundle\") pod \"assisted-installer-controller-lj5rn\" (UID: \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\") " pod="assisted-installer/assisted-installer-controller-lj5rn" Dec 04 11:36:14.727489 master-0 kubenswrapper[4745]: I1204 11:36:14.727380 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-resolv-conf\" (UniqueName: \"kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-host-resolv-conf\") pod \"assisted-installer-controller-lj5rn\" (UID: \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\") " pod="assisted-installer/assisted-installer-controller-lj5rn" Dec 04 11:36:14.727489 master-0 kubenswrapper[4745]: E1204 11:36:14.727483 4745 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 11:36:14.727640 master-0 kubenswrapper[4745]: E1204 11:36:14.727593 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert podName:69640270-09e6-4217-b1c8-3d3465c0c3ae nodeName:}" failed. No retries permitted until 2025-12-04 11:36:15.227536749 +0000 UTC m=+60.929525144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert") pod "cluster-version-operator-77dfcc565f-nqpsd" (UID: "69640270-09e6-4217-b1c8-3d3465c0c3ae") : secret "cluster-version-operator-serving-cert" not found Dec 04 11:36:14.728118 master-0 kubenswrapper[4745]: I1204 11:36:14.728090 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69640270-09e6-4217-b1c8-3d3465c0c3ae-service-ca\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:36:14.728210 master-0 kubenswrapper[4745]: I1204 11:36:14.728181 4745 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Dec 04 11:36:14.733706 master-0 kubenswrapper[4745]: I1204 11:36:14.733523 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-metrics-tls\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:36:14.743474 master-0 kubenswrapper[4745]: I1204 11:36:14.743427 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrb6d\" (UniqueName: \"kubernetes.io/projected/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-kube-api-access-zrb6d\") pod \"assisted-installer-controller-lj5rn\" (UID: \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\") " pod="assisted-installer/assisted-installer-controller-lj5rn" Dec 04 11:36:14.744659 master-0 kubenswrapper[4745]: I1204 11:36:14.744613 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/69640270-09e6-4217-b1c8-3d3465c0c3ae-kube-api-access\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:36:14.745690 master-0 kubenswrapper[4745]: I1204 11:36:14.745646 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6bkg\" (UniqueName: \"kubernetes.io/projected/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-kube-api-access-t6bkg\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:36:14.837639 master-0 kubenswrapper[4745]: I1204 11:36:14.837457 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="assisted-installer/assisted-installer-controller-lj5rn" Dec 04 11:36:14.853020 master-0 kubenswrapper[4745]: W1204 11:36:14.852920 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e64e99a_b3b9_4db7_aec4_8e61d1370e7e.slice/crio-e53241da78dfcc827440e729a29c6a711ab284ebcb1ae27338b43e1937314aa2 WatchSource:0}: Error finding container e53241da78dfcc827440e729a29c6a711ab284ebcb1ae27338b43e1937314aa2: Status 404 returned error can't find the container with id e53241da78dfcc827440e729a29c6a711ab284ebcb1ae27338b43e1937314aa2 Dec 04 11:36:14.853981 master-0 kubenswrapper[4745]: I1204 11:36:14.853466 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:36:14.867470 master-0 kubenswrapper[4745]: W1204 11:36:14.867411 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffaf95be_586c_40fa_b15f_1beaffe7ff1c.slice/crio-25835b8cd52c0d1fb7ed133702ef424c403a978f32d5722b14d0bf7744915891 WatchSource:0}: Error finding container 25835b8cd52c0d1fb7ed133702ef424c403a978f32d5722b14d0bf7744915891: Status 404 returned error can't find the container with id 25835b8cd52c0d1fb7ed133702ef424c403a978f32d5722b14d0bf7744915891 Dec 04 11:36:15.231207 master-0 kubenswrapper[4745]: I1204 11:36:15.231014 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:36:15.231427 master-0 kubenswrapper[4745]: E1204 11:36:15.231260 4745 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 11:36:15.231427 master-0 kubenswrapper[4745]: E1204 11:36:15.231380 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert podName:69640270-09e6-4217-b1c8-3d3465c0c3ae nodeName:}" failed. No retries permitted until 2025-12-04 11:36:16.231355617 +0000 UTC m=+61.933344012 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert") pod "cluster-version-operator-77dfcc565f-nqpsd" (UID: "69640270-09e6-4217-b1c8-3d3465c0c3ae") : secret "cluster-version-operator-serving-cert" not found Dec 04 11:36:15.812892 master-0 kubenswrapper[4745]: I1204 11:36:15.812770 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" event={"ID":"ffaf95be-586c-40fa-b15f-1beaffe7ff1c","Type":"ContainerStarted","Data":"25835b8cd52c0d1fb7ed133702ef424c403a978f32d5722b14d0bf7744915891"} Dec 04 11:36:15.813835 master-0 kubenswrapper[4745]: I1204 11:36:15.813773 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="assisted-installer/assisted-installer-controller-lj5rn" event={"ID":"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e","Type":"ContainerStarted","Data":"e53241da78dfcc827440e729a29c6a711ab284ebcb1ae27338b43e1937314aa2"} Dec 04 11:36:16.239300 master-0 kubenswrapper[4745]: I1204 11:36:16.239224 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:36:16.240000 master-0 kubenswrapper[4745]: E1204 11:36:16.239407 4745 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 11:36:16.240000 master-0 kubenswrapper[4745]: E1204 11:36:16.239522 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert podName:69640270-09e6-4217-b1c8-3d3465c0c3ae nodeName:}" failed. No retries permitted until 2025-12-04 11:36:18.239497559 +0000 UTC m=+63.941485964 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert") pod "cluster-version-operator-77dfcc565f-nqpsd" (UID: "69640270-09e6-4217-b1c8-3d3465c0c3ae") : secret "cluster-version-operator-serving-cert" not found Dec 04 11:36:18.252944 master-0 kubenswrapper[4745]: I1204 11:36:18.252878 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:36:18.253464 master-0 kubenswrapper[4745]: E1204 11:36:18.253007 4745 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 11:36:18.253464 master-0 kubenswrapper[4745]: E1204 11:36:18.253080 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert podName:69640270-09e6-4217-b1c8-3d3465c0c3ae nodeName:}" failed. No retries permitted until 2025-12-04 11:36:22.253061232 +0000 UTC m=+67.955049627 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert") pod "cluster-version-operator-77dfcc565f-nqpsd" (UID: "69640270-09e6-4217-b1c8-3d3465c0c3ae") : secret "cluster-version-operator-serving-cert" not found Dec 04 11:36:18.822231 master-0 kubenswrapper[4745]: I1204 11:36:18.822182 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" event={"ID":"ffaf95be-586c-40fa-b15f-1beaffe7ff1c","Type":"ContainerStarted","Data":"38994ab2ae9659964fed86de7d58ee76405c493bf0a90b3260a8bc5301b5819a"} Dec 04 11:36:18.844124 master-0 kubenswrapper[4745]: I1204 11:36:18.844016 4745 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" podStartSLOduration=25.256431393 podStartE2EDuration="28.843984809s" podCreationTimestamp="2025-12-04 11:35:50 +0000 UTC" firstStartedPulling="2025-12-04 11:36:14.869406835 +0000 UTC m=+60.571395230" lastFinishedPulling="2025-12-04 11:36:18.456960251 +0000 UTC m=+64.158948646" observedRunningTime="2025-12-04 11:36:18.842729232 +0000 UTC m=+64.544717647" watchObservedRunningTime="2025-12-04 11:36:18.843984809 +0000 UTC m=+64.545973204" Dec 04 11:36:20.829832 master-0 kubenswrapper[4745]: I1204 11:36:20.829745 4745 generic.go:334] "Generic (PLEG): container finished" podID="3e64e99a-b3b9-4db7-aec4-8e61d1370e7e" containerID="db84ab590d59181aff119f26f2f6597b685567de9008996795746da92ab70ad5" exitCode=0 Dec 04 11:36:20.829832 master-0 kubenswrapper[4745]: I1204 11:36:20.829852 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="assisted-installer/assisted-installer-controller-lj5rn" event={"ID":"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e","Type":"ContainerDied","Data":"db84ab590d59181aff119f26f2f6597b685567de9008996795746da92ab70ad5"} Dec 04 11:36:21.135158 master-0 kubenswrapper[4745]: I1204 11:36:21.134999 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-network-operator/mtu-prober-4tf99"] Dec 04 11:36:21.135451 master-0 kubenswrapper[4745]: I1204 11:36:21.135390 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/mtu-prober-4tf99" Dec 04 11:36:21.279706 master-0 kubenswrapper[4745]: I1204 11:36:21.279585 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bwn9\" (UniqueName: \"kubernetes.io/projected/cca0c8b5-4833-4e29-8a5b-d5fd891635e6-kube-api-access-9bwn9\") pod \"mtu-prober-4tf99\" (UID: \"cca0c8b5-4833-4e29-8a5b-d5fd891635e6\") " pod="openshift-network-operator/mtu-prober-4tf99" Dec 04 11:36:21.380223 master-0 kubenswrapper[4745]: I1204 11:36:21.380154 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9bwn9\" (UniqueName: \"kubernetes.io/projected/cca0c8b5-4833-4e29-8a5b-d5fd891635e6-kube-api-access-9bwn9\") pod \"mtu-prober-4tf99\" (UID: \"cca0c8b5-4833-4e29-8a5b-d5fd891635e6\") " pod="openshift-network-operator/mtu-prober-4tf99" Dec 04 11:36:21.399089 master-0 kubenswrapper[4745]: I1204 11:36:21.398911 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bwn9\" (UniqueName: \"kubernetes.io/projected/cca0c8b5-4833-4e29-8a5b-d5fd891635e6-kube-api-access-9bwn9\") pod \"mtu-prober-4tf99\" (UID: \"cca0c8b5-4833-4e29-8a5b-d5fd891635e6\") " pod="openshift-network-operator/mtu-prober-4tf99" Dec 04 11:36:21.447136 master-0 kubenswrapper[4745]: I1204 11:36:21.447005 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/mtu-prober-4tf99" Dec 04 11:36:21.461101 master-0 kubenswrapper[4745]: W1204 11:36:21.461033 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca0c8b5_4833_4e29_8a5b_d5fd891635e6.slice/crio-26ccf7a34e6643ad55af1366a3b1dbada6c9287b33079aa7a4ffa9382040181c WatchSource:0}: Error finding container 26ccf7a34e6643ad55af1366a3b1dbada6c9287b33079aa7a4ffa9382040181c: Status 404 returned error can't find the container with id 26ccf7a34e6643ad55af1366a3b1dbada6c9287b33079aa7a4ffa9382040181c Dec 04 11:36:21.834750 master-0 kubenswrapper[4745]: I1204 11:36:21.834625 4745 generic.go:334] "Generic (PLEG): container finished" podID="cca0c8b5-4833-4e29-8a5b-d5fd891635e6" containerID="0d3125af9f225e916c36216370812055c372bf043dda0792009085c501b96333" exitCode=0 Dec 04 11:36:21.834750 master-0 kubenswrapper[4745]: I1204 11:36:21.834717 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/mtu-prober-4tf99" event={"ID":"cca0c8b5-4833-4e29-8a5b-d5fd891635e6","Type":"ContainerDied","Data":"0d3125af9f225e916c36216370812055c372bf043dda0792009085c501b96333"} Dec 04 11:36:21.834750 master-0 kubenswrapper[4745]: I1204 11:36:21.834770 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/mtu-prober-4tf99" event={"ID":"cca0c8b5-4833-4e29-8a5b-d5fd891635e6","Type":"ContainerStarted","Data":"26ccf7a34e6643ad55af1366a3b1dbada6c9287b33079aa7a4ffa9382040181c"} Dec 04 11:36:21.850117 master-0 kubenswrapper[4745]: I1204 11:36:21.850069 4745 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="assisted-installer/assisted-installer-controller-lj5rn" Dec 04 11:36:21.983980 master-0 kubenswrapper[4745]: I1204 11:36:21.983691 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sno-bootstrap-files\" (UniqueName: \"kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-sno-bootstrap-files\") pod \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\" (UID: \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\") " Dec 04 11:36:21.983980 master-0 kubenswrapper[4745]: I1204 11:36:21.983766 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-ca-bundle\" (UniqueName: \"kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-host-ca-bundle\") pod \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\" (UID: \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\") " Dec 04 11:36:21.983980 master-0 kubenswrapper[4745]: I1204 11:36:21.983839 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-resolv-conf\" (UniqueName: \"kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-host-resolv-conf\") pod \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\" (UID: \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\") " Dec 04 11:36:21.983980 master-0 kubenswrapper[4745]: I1204 11:36:21.983882 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrb6d\" (UniqueName: \"kubernetes.io/projected/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-kube-api-access-zrb6d\") pod \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\" (UID: \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\") " Dec 04 11:36:21.983980 master-0 kubenswrapper[4745]: I1204 11:36:21.983908 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-var-run-resolv-conf\" (UniqueName: \"kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-host-var-run-resolv-conf\") pod \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\" (UID: \"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e\") " Dec 04 11:36:21.983980 master-0 kubenswrapper[4745]: I1204 11:36:21.983874 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-sno-bootstrap-files" (OuterVolumeSpecName: "sno-bootstrap-files") pod "3e64e99a-b3b9-4db7-aec4-8e61d1370e7e" (UID: "3e64e99a-b3b9-4db7-aec4-8e61d1370e7e"). InnerVolumeSpecName "sno-bootstrap-files". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:36:21.984430 master-0 kubenswrapper[4745]: I1204 11:36:21.983904 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-host-resolv-conf" (OuterVolumeSpecName: "host-resolv-conf") pod "3e64e99a-b3b9-4db7-aec4-8e61d1370e7e" (UID: "3e64e99a-b3b9-4db7-aec4-8e61d1370e7e"). InnerVolumeSpecName "host-resolv-conf". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:36:21.984430 master-0 kubenswrapper[4745]: I1204 11:36:21.984025 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-host-ca-bundle" (OuterVolumeSpecName: "host-ca-bundle") pod "3e64e99a-b3b9-4db7-aec4-8e61d1370e7e" (UID: "3e64e99a-b3b9-4db7-aec4-8e61d1370e7e"). InnerVolumeSpecName "host-ca-bundle". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:36:21.984430 master-0 kubenswrapper[4745]: I1204 11:36:21.984055 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-host-var-run-resolv-conf" (OuterVolumeSpecName: "host-var-run-resolv-conf") pod "3e64e99a-b3b9-4db7-aec4-8e61d1370e7e" (UID: "3e64e99a-b3b9-4db7-aec4-8e61d1370e7e"). InnerVolumeSpecName "host-var-run-resolv-conf". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:36:21.989615 master-0 kubenswrapper[4745]: I1204 11:36:21.989518 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-kube-api-access-zrb6d" (OuterVolumeSpecName: "kube-api-access-zrb6d") pod "3e64e99a-b3b9-4db7-aec4-8e61d1370e7e" (UID: "3e64e99a-b3b9-4db7-aec4-8e61d1370e7e"). InnerVolumeSpecName "kube-api-access-zrb6d". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:36:22.085124 master-0 kubenswrapper[4745]: I1204 11:36:22.084975 4745 reconciler_common.go:293] "Volume detached for volume \"sno-bootstrap-files\" (UniqueName: \"kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-sno-bootstrap-files\") on node \"master-0\" DevicePath \"\"" Dec 04 11:36:22.085124 master-0 kubenswrapper[4745]: I1204 11:36:22.085064 4745 reconciler_common.go:293] "Volume detached for volume \"host-resolv-conf\" (UniqueName: \"kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-host-resolv-conf\") on node \"master-0\" DevicePath \"\"" Dec 04 11:36:22.085124 master-0 kubenswrapper[4745]: I1204 11:36:22.085084 4745 reconciler_common.go:293] "Volume detached for volume \"host-ca-bundle\" (UniqueName: \"kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-host-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 11:36:22.085124 master-0 kubenswrapper[4745]: I1204 11:36:22.085101 4745 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zrb6d\" (UniqueName: \"kubernetes.io/projected/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-kube-api-access-zrb6d\") on node \"master-0\" DevicePath \"\"" Dec 04 11:36:22.085124 master-0 kubenswrapper[4745]: I1204 11:36:22.085119 4745 reconciler_common.go:293] "Volume detached for volume \"host-var-run-resolv-conf\" (UniqueName: \"kubernetes.io/host-path/3e64e99a-b3b9-4db7-aec4-8e61d1370e7e-host-var-run-resolv-conf\") on node \"master-0\" DevicePath \"\"" Dec 04 11:36:22.287180 master-0 kubenswrapper[4745]: I1204 11:36:22.287000 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:36:22.287442 master-0 kubenswrapper[4745]: E1204 11:36:22.287201 4745 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 11:36:22.287442 master-0 kubenswrapper[4745]: E1204 11:36:22.287283 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert podName:69640270-09e6-4217-b1c8-3d3465c0c3ae nodeName:}" failed. No retries permitted until 2025-12-04 11:36:30.287260537 +0000 UTC m=+75.989248932 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert") pod "cluster-version-operator-77dfcc565f-nqpsd" (UID: "69640270-09e6-4217-b1c8-3d3465c0c3ae") : secret "cluster-version-operator-serving-cert" not found Dec 04 11:36:22.839299 master-0 kubenswrapper[4745]: I1204 11:36:22.839238 4745 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="assisted-installer/assisted-installer-controller-lj5rn" Dec 04 11:36:22.839901 master-0 kubenswrapper[4745]: I1204 11:36:22.839277 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="assisted-installer/assisted-installer-controller-lj5rn" event={"ID":"3e64e99a-b3b9-4db7-aec4-8e61d1370e7e","Type":"ContainerDied","Data":"e53241da78dfcc827440e729a29c6a711ab284ebcb1ae27338b43e1937314aa2"} Dec 04 11:36:22.839901 master-0 kubenswrapper[4745]: I1204 11:36:22.839367 4745 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e53241da78dfcc827440e729a29c6a711ab284ebcb1ae27338b43e1937314aa2" Dec 04 11:36:22.855546 master-0 kubenswrapper[4745]: I1204 11:36:22.855504 4745 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/mtu-prober-4tf99" Dec 04 11:36:22.992162 master-0 kubenswrapper[4745]: I1204 11:36:22.992012 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bwn9\" (UniqueName: \"kubernetes.io/projected/cca0c8b5-4833-4e29-8a5b-d5fd891635e6-kube-api-access-9bwn9\") pod \"cca0c8b5-4833-4e29-8a5b-d5fd891635e6\" (UID: \"cca0c8b5-4833-4e29-8a5b-d5fd891635e6\") " Dec 04 11:36:22.996479 master-0 kubenswrapper[4745]: I1204 11:36:22.996391 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cca0c8b5-4833-4e29-8a5b-d5fd891635e6-kube-api-access-9bwn9" (OuterVolumeSpecName: "kube-api-access-9bwn9") pod "cca0c8b5-4833-4e29-8a5b-d5fd891635e6" (UID: "cca0c8b5-4833-4e29-8a5b-d5fd891635e6"). InnerVolumeSpecName "kube-api-access-9bwn9". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:36:23.093060 master-0 kubenswrapper[4745]: I1204 11:36:23.092976 4745 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9bwn9\" (UniqueName: \"kubernetes.io/projected/cca0c8b5-4833-4e29-8a5b-d5fd891635e6-kube-api-access-9bwn9\") on node \"master-0\" DevicePath \"\"" Dec 04 11:36:23.844188 master-0 kubenswrapper[4745]: I1204 11:36:23.844114 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/mtu-prober-4tf99" event={"ID":"cca0c8b5-4833-4e29-8a5b-d5fd891635e6","Type":"ContainerDied","Data":"26ccf7a34e6643ad55af1366a3b1dbada6c9287b33079aa7a4ffa9382040181c"} Dec 04 11:36:23.844188 master-0 kubenswrapper[4745]: I1204 11:36:23.844169 4745 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26ccf7a34e6643ad55af1366a3b1dbada6c9287b33079aa7a4ffa9382040181c" Dec 04 11:36:23.844188 master-0 kubenswrapper[4745]: I1204 11:36:23.844169 4745 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/mtu-prober-4tf99" Dec 04 11:36:24.641140 master-0 kubenswrapper[4745]: W1204 11:36:24.641082 4745 warnings.go:70] would violate PodSecurity "restricted:latest": host namespaces (hostNetwork=true), hostPort (container "etcd" uses hostPorts 2379, 2380), privileged (containers "etcdctl", "etcd" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (containers "etcdctl", "etcd" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (containers "etcdctl", "etcd" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volumes "certs", "data-dir" use restricted volume type "hostPath"), runAsNonRoot != true (pod or containers "etcdctl", "etcd" must set securityContext.runAsNonRoot=true), seccompProfile (pod or containers "etcdctl", "etcd" must set securityContext.seccompProfile.type to "RuntimeDefault" or "Localhost") Dec 04 11:36:24.641570 master-0 kubenswrapper[4745]: I1204 11:36:24.641519 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd/etcd-master-0-master-0"] Dec 04 11:36:26.213841 master-0 kubenswrapper[4745]: I1204 11:36:26.213706 4745 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-network-operator/mtu-prober-4tf99"] Dec 04 11:36:26.218932 master-0 kubenswrapper[4745]: I1204 11:36:26.218798 4745 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-network-operator/mtu-prober-4tf99"] Dec 04 11:36:26.635754 master-0 kubenswrapper[4745]: I1204 11:36:26.635127 4745 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cca0c8b5-4833-4e29-8a5b-d5fd891635e6" path="/var/lib/kubelet/pods/cca0c8b5-4833-4e29-8a5b-d5fd891635e6/volumes" Dec 04 11:36:30.351017 master-0 kubenswrapper[4745]: I1204 11:36:30.350887 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:36:30.351651 master-0 kubenswrapper[4745]: E1204 11:36:30.351186 4745 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 11:36:30.351651 master-0 kubenswrapper[4745]: E1204 11:36:30.351307 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert podName:69640270-09e6-4217-b1c8-3d3465c0c3ae nodeName:}" failed. No retries permitted until 2025-12-04 11:36:46.351277053 +0000 UTC m=+92.053265448 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert") pod "cluster-version-operator-77dfcc565f-nqpsd" (UID: "69640270-09e6-4217-b1c8-3d3465c0c3ae") : secret "cluster-version-operator-serving-cert" not found Dec 04 11:36:31.682323 master-0 kubenswrapper[4745]: I1204 11:36:31.682257 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-twxbl"] Dec 04 11:36:31.682323 master-0 kubenswrapper[4745]: E1204 11:36:31.682342 4745 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3e64e99a-b3b9-4db7-aec4-8e61d1370e7e" containerName="assisted-installer-controller" Dec 04 11:36:31.683427 master-0 kubenswrapper[4745]: I1204 11:36:31.682357 4745 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e64e99a-b3b9-4db7-aec4-8e61d1370e7e" containerName="assisted-installer-controller" Dec 04 11:36:31.683427 master-0 kubenswrapper[4745]: E1204 11:36:31.682368 4745 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cca0c8b5-4833-4e29-8a5b-d5fd891635e6" containerName="prober" Dec 04 11:36:31.683427 master-0 kubenswrapper[4745]: I1204 11:36:31.682376 4745 state_mem.go:107] "Deleted CPUSet assignment" podUID="cca0c8b5-4833-4e29-8a5b-d5fd891635e6" containerName="prober" Dec 04 11:36:31.683427 master-0 kubenswrapper[4745]: I1204 11:36:31.682423 4745 memory_manager.go:354] "RemoveStaleState removing state" podUID="3e64e99a-b3b9-4db7-aec4-8e61d1370e7e" containerName="assisted-installer-controller" Dec 04 11:36:31.683427 master-0 kubenswrapper[4745]: I1204 11:36:31.682433 4745 memory_manager.go:354] "RemoveStaleState removing state" podUID="cca0c8b5-4833-4e29-8a5b-d5fd891635e6" containerName="prober" Dec 04 11:36:31.683427 master-0 kubenswrapper[4745]: I1204 11:36:31.682664 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.686616 master-0 kubenswrapper[4745]: I1204 11:36:31.686562 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"multus-daemon-config" Dec 04 11:36:31.686884 master-0 kubenswrapper[4745]: I1204 11:36:31.686834 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"kube-root-ca.crt" Dec 04 11:36:31.686955 master-0 kubenswrapper[4745]: I1204 11:36:31.686908 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"cni-copy-resources" Dec 04 11:36:31.687005 master-0 kubenswrapper[4745]: I1204 11:36:31.686860 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"openshift-service-ca.crt" Dec 04 11:36:31.762223 master-0 kubenswrapper[4745]: I1204 11:36:31.762106 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-kubelet\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.762223 master-0 kubenswrapper[4745]: I1204 11:36:31.762199 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c790c174-dc60-4f34-8818-3b367fbe3a5f-cni-binary-copy\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.762223 master-0 kubenswrapper[4745]: I1204 11:36:31.762229 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-socket-dir-parent\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.762558 master-0 kubenswrapper[4745]: I1204 11:36:31.762279 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-multus-certs\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.762558 master-0 kubenswrapper[4745]: I1204 11:36:31.762303 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lxhl\" (UniqueName: \"kubernetes.io/projected/c790c174-dc60-4f34-8818-3b367fbe3a5f-kube-api-access-6lxhl\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.762558 master-0 kubenswrapper[4745]: I1204 11:36:31.762355 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-cni-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.762558 master-0 kubenswrapper[4745]: I1204 11:36:31.762397 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-os-release\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.762558 master-0 kubenswrapper[4745]: I1204 11:36:31.762426 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-hostroot\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.762558 master-0 kubenswrapper[4745]: I1204 11:36:31.762491 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-conf-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.762558 master-0 kubenswrapper[4745]: I1204 11:36:31.762517 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-cnibin\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.762794 master-0 kubenswrapper[4745]: I1204 11:36:31.762584 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-netns\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.762794 master-0 kubenswrapper[4745]: I1204 11:36:31.762677 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-cni-multus\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.762794 master-0 kubenswrapper[4745]: I1204 11:36:31.762779 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-system-cni-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.762794 master-0 kubenswrapper[4745]: I1204 11:36:31.762831 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-daemon-config\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.762997 master-0 kubenswrapper[4745]: I1204 11:36:31.762848 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-etc-kubernetes\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.762997 master-0 kubenswrapper[4745]: I1204 11:36:31.762865 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-k8s-cni-cncf-io\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.762997 master-0 kubenswrapper[4745]: I1204 11:36:31.762880 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-cni-bin\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.863281 master-0 kubenswrapper[4745]: I1204 11:36:31.863180 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-cnibin\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.863281 master-0 kubenswrapper[4745]: I1204 11:36:31.863248 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-netns\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.863566 master-0 kubenswrapper[4745]: I1204 11:36:31.863338 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-cnibin\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.863566 master-0 kubenswrapper[4745]: I1204 11:36:31.863377 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-cni-multus\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.863566 master-0 kubenswrapper[4745]: I1204 11:36:31.863397 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-daemon-config\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.863566 master-0 kubenswrapper[4745]: I1204 11:36:31.863416 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-etc-kubernetes\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.863566 master-0 kubenswrapper[4745]: I1204 11:36:31.863433 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-system-cni-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.863566 master-0 kubenswrapper[4745]: I1204 11:36:31.863443 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-netns\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.863566 master-0 kubenswrapper[4745]: I1204 11:36:31.863452 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-k8s-cni-cncf-io\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.863848 master-0 kubenswrapper[4745]: I1204 11:36:31.863618 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-etc-kubernetes\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.863848 master-0 kubenswrapper[4745]: I1204 11:36:31.863654 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-cni-multus\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.863848 master-0 kubenswrapper[4745]: I1204 11:36:31.863695 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-cni-bin\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.863848 master-0 kubenswrapper[4745]: I1204 11:36:31.863724 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-cni-bin\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.863997 master-0 kubenswrapper[4745]: I1204 11:36:31.863875 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-k8s-cni-cncf-io\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.863997 master-0 kubenswrapper[4745]: I1204 11:36:31.863953 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-kubelet\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.863997 master-0 kubenswrapper[4745]: I1204 11:36:31.863969 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-system-cni-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.863997 master-0 kubenswrapper[4745]: I1204 11:36:31.863983 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c790c174-dc60-4f34-8818-3b367fbe3a5f-cni-binary-copy\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.864155 master-0 kubenswrapper[4745]: I1204 11:36:31.864059 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-kubelet\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.864155 master-0 kubenswrapper[4745]: I1204 11:36:31.864100 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-socket-dir-parent\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.864155 master-0 kubenswrapper[4745]: I1204 11:36:31.864135 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-multus-certs\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.864269 master-0 kubenswrapper[4745]: I1204 11:36:31.864159 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6lxhl\" (UniqueName: \"kubernetes.io/projected/c790c174-dc60-4f34-8818-3b367fbe3a5f-kube-api-access-6lxhl\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.864269 master-0 kubenswrapper[4745]: I1204 11:36:31.864175 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-hostroot\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.864269 master-0 kubenswrapper[4745]: I1204 11:36:31.864193 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-conf-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.864269 master-0 kubenswrapper[4745]: I1204 11:36:31.864223 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-hostroot\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.864539 master-0 kubenswrapper[4745]: I1204 11:36:31.864502 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-multus-certs\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.864846 master-0 kubenswrapper[4745]: I1204 11:36:31.864545 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-cni-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.864846 master-0 kubenswrapper[4745]: I1204 11:36:31.864587 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-conf-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.864846 master-0 kubenswrapper[4745]: I1204 11:36:31.864615 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-cni-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.864846 master-0 kubenswrapper[4745]: I1204 11:36:31.864642 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-socket-dir-parent\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.864846 master-0 kubenswrapper[4745]: I1204 11:36:31.864713 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-os-release\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.865005 master-0 kubenswrapper[4745]: I1204 11:36:31.864872 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-os-release\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.865005 master-0 kubenswrapper[4745]: I1204 11:36:31.864895 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-daemon-config\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:31.865060 master-0 kubenswrapper[4745]: I1204 11:36:31.865022 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c790c174-dc60-4f34-8818-3b367fbe3a5f-cni-binary-copy\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:33.273937 master-0 kubenswrapper[4745]: I1204 11:36:33.273877 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lxhl\" (UniqueName: \"kubernetes.io/projected/c790c174-dc60-4f34-8818-3b367fbe3a5f-kube-api-access-6lxhl\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:36:33.496460 master-0 kubenswrapper[4745]: I1204 11:36:33.496364 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-twxbl" Dec 04 11:36:33.676655 master-0 kubenswrapper[4745]: I1204 11:36:33.676559 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-6pk59"] Dec 04 11:36:33.677395 master-0 kubenswrapper[4745]: I1204 11:36:33.677369 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.680390 master-0 kubenswrapper[4745]: I1204 11:36:33.680334 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"default-cni-sysctl-allowlist" Dec 04 11:36:33.680493 master-0 kubenswrapper[4745]: I1204 11:36:33.680451 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"whereabouts-config" Dec 04 11:36:33.681070 master-0 kubenswrapper[4745]: I1204 11:36:33.680992 4745 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd/etcd-master-0-master-0" podStartSLOduration=9.680966426 podStartE2EDuration="9.680966426s" podCreationTimestamp="2025-12-04 11:36:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:36:33.680731709 +0000 UTC m=+79.382720164" watchObservedRunningTime="2025-12-04 11:36:33.680966426 +0000 UTC m=+79.382954831" Dec 04 11:36:33.721898 master-0 kubenswrapper[4745]: I1204 11:36:33.721712 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-gp57t"] Dec 04 11:36:33.722190 master-0 kubenswrapper[4745]: I1204 11:36:33.722101 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:33.722232 master-0 kubenswrapper[4745]: E1204 11:36:33.722178 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:36:33.781343 master-0 kubenswrapper[4745]: I1204 11:36:33.781284 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.781343 master-0 kubenswrapper[4745]: I1204 11:36:33.781330 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-system-cni-dir\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.781343 master-0 kubenswrapper[4745]: I1204 11:36:33.781347 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-cni-binary-copy\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.781580 master-0 kubenswrapper[4745]: I1204 11:36:33.781394 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-cnibin\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.781580 master-0 kubenswrapper[4745]: I1204 11:36:33.781461 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4w2j\" (UniqueName: \"kubernetes.io/projected/bdfcb644-24ef-4a33-93ae-a855e872d29a-kube-api-access-f4w2j\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.781580 master-0 kubenswrapper[4745]: I1204 11:36:33.781482 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.781659 master-0 kubenswrapper[4745]: I1204 11:36:33.781616 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-os-release\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.781745 master-0 kubenswrapper[4745]: I1204 11:36:33.781690 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-configmap\" (UniqueName: \"kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-whereabouts-configmap\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.871461 master-0 kubenswrapper[4745]: I1204 11:36:33.871306 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-twxbl" event={"ID":"c790c174-dc60-4f34-8818-3b367fbe3a5f","Type":"ContainerStarted","Data":"cd9dab7f7f5afa841cd8a4ded039df1dd1c65380acd9d3f01a8545a60b7ba60d"} Dec 04 11:36:33.882367 master-0 kubenswrapper[4745]: I1204 11:36:33.882314 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-cnibin\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.882367 master-0 kubenswrapper[4745]: I1204 11:36:33.882360 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f4w2j\" (UniqueName: \"kubernetes.io/projected/bdfcb644-24ef-4a33-93ae-a855e872d29a-kube-api-access-f4w2j\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.882590 master-0 kubenswrapper[4745]: I1204 11:36:33.882381 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.882590 master-0 kubenswrapper[4745]: I1204 11:36:33.882447 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-cnibin\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.882590 master-0 kubenswrapper[4745]: I1204 11:36:33.882498 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ncf9\" (UniqueName: \"kubernetes.io/projected/d8fca733-45c8-45b8-8653-ac204e7c6098-kube-api-access-2ncf9\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:33.882706 master-0 kubenswrapper[4745]: I1204 11:36:33.882684 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:33.882739 master-0 kubenswrapper[4745]: I1204 11:36:33.882716 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-os-release\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.882768 master-0 kubenswrapper[4745]: I1204 11:36:33.882744 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"whereabouts-configmap\" (UniqueName: \"kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-whereabouts-configmap\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.882821 master-0 kubenswrapper[4745]: I1204 11:36:33.882770 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.882821 master-0 kubenswrapper[4745]: I1204 11:36:33.882791 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-system-cni-dir\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.882889 master-0 kubenswrapper[4745]: I1204 11:36:33.882860 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-cni-binary-copy\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.882924 master-0 kubenswrapper[4745]: I1204 11:36:33.882863 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-system-cni-dir\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.882924 master-0 kubenswrapper[4745]: I1204 11:36:33.882898 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-os-release\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.882924 master-0 kubenswrapper[4745]: I1204 11:36:33.882885 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.883621 master-0 kubenswrapper[4745]: I1204 11:36:33.883586 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.883774 master-0 kubenswrapper[4745]: I1204 11:36:33.883729 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-cni-binary-copy\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.883834 master-0 kubenswrapper[4745]: I1204 11:36:33.883734 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"whereabouts-configmap\" (UniqueName: \"kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-whereabouts-configmap\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.900727 master-0 kubenswrapper[4745]: I1204 11:36:33.900653 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4w2j\" (UniqueName: \"kubernetes.io/projected/bdfcb644-24ef-4a33-93ae-a855e872d29a-kube-api-access-f4w2j\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:33.984082 master-0 kubenswrapper[4745]: I1204 11:36:33.983961 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2ncf9\" (UniqueName: \"kubernetes.io/projected/d8fca733-45c8-45b8-8653-ac204e7c6098-kube-api-access-2ncf9\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:33.984082 master-0 kubenswrapper[4745]: I1204 11:36:33.984016 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:33.984384 master-0 kubenswrapper[4745]: E1204 11:36:33.984265 4745 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 11:36:33.984384 master-0 kubenswrapper[4745]: E1204 11:36:33.984346 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs podName:d8fca733-45c8-45b8-8653-ac204e7c6098 nodeName:}" failed. No retries permitted until 2025-12-04 11:36:34.484326073 +0000 UTC m=+80.186314468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs") pod "network-metrics-daemon-gp57t" (UID: "d8fca733-45c8-45b8-8653-ac204e7c6098") : object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 11:36:33.989869 master-0 kubenswrapper[4745]: I1204 11:36:33.989833 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:36:34.001164 master-0 kubenswrapper[4745]: I1204 11:36:34.001123 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ncf9\" (UniqueName: \"kubernetes.io/projected/d8fca733-45c8-45b8-8653-ac204e7c6098-kube-api-access-2ncf9\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:34.002372 master-0 kubenswrapper[4745]: W1204 11:36:34.002278 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdfcb644_24ef_4a33_93ae_a855e872d29a.slice/crio-adbbc7afd8e54e79f29b174cb989cf3e7455023359f413af406ae4a4afbf2ab4 WatchSource:0}: Error finding container adbbc7afd8e54e79f29b174cb989cf3e7455023359f413af406ae4a4afbf2ab4: Status 404 returned error can't find the container with id adbbc7afd8e54e79f29b174cb989cf3e7455023359f413af406ae4a4afbf2ab4 Dec 04 11:36:34.488856 master-0 kubenswrapper[4745]: I1204 11:36:34.488763 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:34.489402 master-0 kubenswrapper[4745]: E1204 11:36:34.488982 4745 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 11:36:34.489402 master-0 kubenswrapper[4745]: E1204 11:36:34.489122 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs podName:d8fca733-45c8-45b8-8653-ac204e7c6098 nodeName:}" failed. No retries permitted until 2025-12-04 11:36:35.48909589 +0000 UTC m=+81.191084285 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs") pod "network-metrics-daemon-gp57t" (UID: "d8fca733-45c8-45b8-8653-ac204e7c6098") : object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 11:36:34.876038 master-0 kubenswrapper[4745]: I1204 11:36:34.875960 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pk59" event={"ID":"bdfcb644-24ef-4a33-93ae-a855e872d29a","Type":"ContainerStarted","Data":"adbbc7afd8e54e79f29b174cb989cf3e7455023359f413af406ae4a4afbf2ab4"} Dec 04 11:36:35.496428 master-0 kubenswrapper[4745]: I1204 11:36:35.496339 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:35.497015 master-0 kubenswrapper[4745]: E1204 11:36:35.496522 4745 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 11:36:35.497015 master-0 kubenswrapper[4745]: E1204 11:36:35.496594 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs podName:d8fca733-45c8-45b8-8653-ac204e7c6098 nodeName:}" failed. No retries permitted until 2025-12-04 11:36:37.496576503 +0000 UTC m=+83.198564888 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs") pod "network-metrics-daemon-gp57t" (UID: "d8fca733-45c8-45b8-8653-ac204e7c6098") : object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 11:36:35.627932 master-0 kubenswrapper[4745]: I1204 11:36:35.627684 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:35.628242 master-0 kubenswrapper[4745]: E1204 11:36:35.627957 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:36:37.512568 master-0 kubenswrapper[4745]: I1204 11:36:37.512458 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:37.513288 master-0 kubenswrapper[4745]: E1204 11:36:37.512744 4745 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 11:36:37.513288 master-0 kubenswrapper[4745]: E1204 11:36:37.512902 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs podName:d8fca733-45c8-45b8-8653-ac204e7c6098 nodeName:}" failed. No retries permitted until 2025-12-04 11:36:41.512870269 +0000 UTC m=+87.214858684 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs") pod "network-metrics-daemon-gp57t" (UID: "d8fca733-45c8-45b8-8653-ac204e7c6098") : object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 11:36:37.626203 master-0 kubenswrapper[4745]: I1204 11:36:37.626120 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:37.626555 master-0 kubenswrapper[4745]: E1204 11:36:37.626301 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:36:37.884716 master-0 kubenswrapper[4745]: I1204 11:36:37.884595 4745 generic.go:334] "Generic (PLEG): container finished" podID="bdfcb644-24ef-4a33-93ae-a855e872d29a" containerID="4f5e35a41648fd33f62ab41661b91852c5163f0f30c4978159e0c3c22f526438" exitCode=0 Dec 04 11:36:37.884716 master-0 kubenswrapper[4745]: I1204 11:36:37.884644 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pk59" event={"ID":"bdfcb644-24ef-4a33-93ae-a855e872d29a","Type":"ContainerDied","Data":"4f5e35a41648fd33f62ab41661b91852c5163f0f30c4978159e0c3c22f526438"} Dec 04 11:36:39.625751 master-0 kubenswrapper[4745]: I1204 11:36:39.625669 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:39.626463 master-0 kubenswrapper[4745]: E1204 11:36:39.626149 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:36:41.543494 master-0 kubenswrapper[4745]: I1204 11:36:41.543404 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:41.544054 master-0 kubenswrapper[4745]: E1204 11:36:41.543592 4745 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 11:36:41.544054 master-0 kubenswrapper[4745]: E1204 11:36:41.543686 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs podName:d8fca733-45c8-45b8-8653-ac204e7c6098 nodeName:}" failed. No retries permitted until 2025-12-04 11:36:49.543666917 +0000 UTC m=+95.245655312 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs") pod "network-metrics-daemon-gp57t" (UID: "d8fca733-45c8-45b8-8653-ac204e7c6098") : object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 11:36:41.625714 master-0 kubenswrapper[4745]: I1204 11:36:41.625633 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:41.626042 master-0 kubenswrapper[4745]: E1204 11:36:41.625775 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:36:43.626375 master-0 kubenswrapper[4745]: I1204 11:36:43.626282 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:43.627006 master-0 kubenswrapper[4745]: E1204 11:36:43.626490 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:36:43.805856 master-0 kubenswrapper[4745]: I1204 11:36:43.805756 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq"] Dec 04 11:36:43.806463 master-0 kubenswrapper[4745]: I1204 11:36:43.806419 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:36:43.810368 master-0 kubenswrapper[4745]: I1204 11:36:43.810313 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-control-plane-metrics-cert" Dec 04 11:36:43.810368 master-0 kubenswrapper[4745]: I1204 11:36:43.810335 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"openshift-service-ca.crt" Dec 04 11:36:43.810623 master-0 kubenswrapper[4745]: I1204 11:36:43.810586 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"env-overrides" Dec 04 11:36:43.810723 master-0 kubenswrapper[4745]: I1204 11:36:43.810664 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"kube-root-ca.crt" Dec 04 11:36:43.810769 master-0 kubenswrapper[4745]: I1204 11:36:43.810599 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-config" Dec 04 11:36:43.888405 master-0 kubenswrapper[4745]: I1204 11:36:43.888295 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-9xxhr"] Dec 04 11:36:43.889668 master-0 kubenswrapper[4745]: I1204 11:36:43.889645 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:43.895305 master-0 kubenswrapper[4745]: I1204 11:36:43.895177 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-node-metrics-cert" Dec 04 11:36:43.897025 master-0 kubenswrapper[4745]: I1204 11:36:43.896956 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-script-lib" Dec 04 11:36:43.985018 master-0 kubenswrapper[4745]: I1204 11:36:43.984947 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-run-systemd\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:43.985018 master-0 kubenswrapper[4745]: I1204 11:36:43.985019 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/287fba2d-f56d-4ec0-b796-7849a68fb411-env-overrides\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:36:43.985396 master-0 kubenswrapper[4745]: I1204 11:36:43.985049 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-node-log\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:43.985396 master-0 kubenswrapper[4745]: I1204 11:36:43.985069 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-log-socket\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:43.985396 master-0 kubenswrapper[4745]: I1204 11:36:43.985088 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-systemd-units\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:43.985396 master-0 kubenswrapper[4745]: I1204 11:36:43.985111 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-run-netns\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:43.985396 master-0 kubenswrapper[4745]: I1204 11:36:43.985206 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-kubelet\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:43.985396 master-0 kubenswrapper[4745]: I1204 11:36:43.985292 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-run-ovn\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:43.985396 master-0 kubenswrapper[4745]: I1204 11:36:43.985328 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-run-ovn-kubernetes\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:43.985396 master-0 kubenswrapper[4745]: I1204 11:36:43.985357 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/591ce05d-0b49-40ab-b82a-741f54010725-env-overrides\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:43.985396 master-0 kubenswrapper[4745]: I1204 11:36:43.985380 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-etc-openvswitch\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:43.985396 master-0 kubenswrapper[4745]: I1204 11:36:43.985404 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/591ce05d-0b49-40ab-b82a-741f54010725-ovn-node-metrics-cert\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:43.985749 master-0 kubenswrapper[4745]: I1204 11:36:43.985434 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-cni-bin\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:43.985749 master-0 kubenswrapper[4745]: I1204 11:36:43.985462 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc2sc\" (UniqueName: \"kubernetes.io/projected/591ce05d-0b49-40ab-b82a-741f54010725-kube-api-access-tc2sc\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:43.985749 master-0 kubenswrapper[4745]: I1204 11:36:43.985512 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmdvf\" (UniqueName: \"kubernetes.io/projected/287fba2d-f56d-4ec0-b796-7849a68fb411-kube-api-access-gmdvf\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:36:43.985749 master-0 kubenswrapper[4745]: I1204 11:36:43.985539 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-var-lib-openvswitch\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:43.985749 master-0 kubenswrapper[4745]: I1204 11:36:43.985596 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-run-openvswitch\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:43.985749 master-0 kubenswrapper[4745]: I1204 11:36:43.985623 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-cni-netd\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:43.985749 master-0 kubenswrapper[4745]: I1204 11:36:43.985653 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/287fba2d-f56d-4ec0-b796-7849a68fb411-ovnkube-config\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:36:43.985749 master-0 kubenswrapper[4745]: I1204 11:36:43.985682 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/287fba2d-f56d-4ec0-b796-7849a68fb411-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:36:43.985749 master-0 kubenswrapper[4745]: I1204 11:36:43.985723 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:43.985749 master-0 kubenswrapper[4745]: I1204 11:36:43.985752 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/591ce05d-0b49-40ab-b82a-741f54010725-ovnkube-config\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:43.986187 master-0 kubenswrapper[4745]: I1204 11:36:43.985782 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-slash\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:43.986187 master-0 kubenswrapper[4745]: I1204 11:36:43.985836 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/591ce05d-0b49-40ab-b82a-741f54010725-ovnkube-script-lib\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.086602 master-0 kubenswrapper[4745]: I1204 11:36:44.086498 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-node-log\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.086602 master-0 kubenswrapper[4745]: I1204 11:36:44.086564 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-log-socket\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.086602 master-0 kubenswrapper[4745]: I1204 11:36:44.086588 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-systemd-units\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.087315 master-0 kubenswrapper[4745]: I1204 11:36:44.086684 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-node-log\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.087315 master-0 kubenswrapper[4745]: I1204 11:36:44.086887 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-run-netns\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.087315 master-0 kubenswrapper[4745]: I1204 11:36:44.086941 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-run-netns\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.087315 master-0 kubenswrapper[4745]: I1204 11:36:44.086922 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-log-socket\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.087315 master-0 kubenswrapper[4745]: I1204 11:36:44.086903 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-systemd-units\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.087315 master-0 kubenswrapper[4745]: I1204 11:36:44.086982 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-kubelet\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.087315 master-0 kubenswrapper[4745]: I1204 11:36:44.087018 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-run-ovn\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.087315 master-0 kubenswrapper[4745]: I1204 11:36:44.087047 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-run-ovn-kubernetes\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.087315 master-0 kubenswrapper[4745]: I1204 11:36:44.087070 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/591ce05d-0b49-40ab-b82a-741f54010725-env-overrides\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.087315 master-0 kubenswrapper[4745]: I1204 11:36:44.087128 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-run-ovn\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.087315 master-0 kubenswrapper[4745]: I1204 11:36:44.087165 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/591ce05d-0b49-40ab-b82a-741f54010725-ovn-node-metrics-cert\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.087315 master-0 kubenswrapper[4745]: I1204 11:36:44.087196 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-etc-openvswitch\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.087315 master-0 kubenswrapper[4745]: I1204 11:36:44.087220 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-cni-bin\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.088155 master-0 kubenswrapper[4745]: I1204 11:36:44.087434 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tc2sc\" (UniqueName: \"kubernetes.io/projected/591ce05d-0b49-40ab-b82a-741f54010725-kube-api-access-tc2sc\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.088155 master-0 kubenswrapper[4745]: I1204 11:36:44.087629 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-kubelet\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.088155 master-0 kubenswrapper[4745]: I1204 11:36:44.087693 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-etc-openvswitch\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.088155 master-0 kubenswrapper[4745]: I1204 11:36:44.087725 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-cni-bin\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.088155 master-0 kubenswrapper[4745]: I1204 11:36:44.087767 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-run-ovn-kubernetes\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.088155 master-0 kubenswrapper[4745]: I1204 11:36:44.087799 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gmdvf\" (UniqueName: \"kubernetes.io/projected/287fba2d-f56d-4ec0-b796-7849a68fb411-kube-api-access-gmdvf\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:36:44.088155 master-0 kubenswrapper[4745]: I1204 11:36:44.087861 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-var-lib-openvswitch\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.088155 master-0 kubenswrapper[4745]: I1204 11:36:44.087918 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/287fba2d-f56d-4ec0-b796-7849a68fb411-ovnkube-config\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:36:44.088155 master-0 kubenswrapper[4745]: I1204 11:36:44.087940 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/287fba2d-f56d-4ec0-b796-7849a68fb411-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:36:44.088155 master-0 kubenswrapper[4745]: I1204 11:36:44.087966 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-run-openvswitch\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.088155 master-0 kubenswrapper[4745]: I1204 11:36:44.087985 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-cni-netd\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.088155 master-0 kubenswrapper[4745]: I1204 11:36:44.088012 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.088155 master-0 kubenswrapper[4745]: I1204 11:36:44.088092 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-run-openvswitch\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.088155 master-0 kubenswrapper[4745]: I1204 11:36:44.088171 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/591ce05d-0b49-40ab-b82a-741f54010725-env-overrides\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.089334 master-0 kubenswrapper[4745]: I1204 11:36:44.088223 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/591ce05d-0b49-40ab-b82a-741f54010725-ovnkube-config\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.089334 master-0 kubenswrapper[4745]: I1204 11:36:44.088374 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.089334 master-0 kubenswrapper[4745]: I1204 11:36:44.088441 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-var-lib-openvswitch\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.089334 master-0 kubenswrapper[4745]: I1204 11:36:44.088478 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-cni-netd\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.089334 master-0 kubenswrapper[4745]: I1204 11:36:44.088920 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/287fba2d-f56d-4ec0-b796-7849a68fb411-ovnkube-config\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:36:44.089990 master-0 kubenswrapper[4745]: I1204 11:36:44.089016 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-slash\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.089990 master-0 kubenswrapper[4745]: I1204 11:36:44.089900 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/591ce05d-0b49-40ab-b82a-741f54010725-ovnkube-script-lib\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.089990 master-0 kubenswrapper[4745]: I1204 11:36:44.089101 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-slash\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.090209 master-0 kubenswrapper[4745]: I1204 11:36:44.090120 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-run-systemd\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.090209 master-0 kubenswrapper[4745]: I1204 11:36:44.090173 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/591ce05d-0b49-40ab-b82a-741f54010725-ovnkube-config\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.090692 master-0 kubenswrapper[4745]: I1204 11:36:44.090522 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/287fba2d-f56d-4ec0-b796-7849a68fb411-env-overrides\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:36:44.091079 master-0 kubenswrapper[4745]: I1204 11:36:44.091020 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-run-systemd\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.091207 master-0 kubenswrapper[4745]: I1204 11:36:44.091109 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/591ce05d-0b49-40ab-b82a-741f54010725-ovnkube-script-lib\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.091282 master-0 kubenswrapper[4745]: I1204 11:36:44.091231 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/287fba2d-f56d-4ec0-b796-7849a68fb411-env-overrides\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:36:44.094641 master-0 kubenswrapper[4745]: I1204 11:36:44.093911 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/287fba2d-f56d-4ec0-b796-7849a68fb411-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:36:44.098124 master-0 kubenswrapper[4745]: I1204 11:36:44.098084 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/591ce05d-0b49-40ab-b82a-741f54010725-ovn-node-metrics-cert\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.213152 master-0 kubenswrapper[4745]: I1204 11:36:44.212741 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc2sc\" (UniqueName: \"kubernetes.io/projected/591ce05d-0b49-40ab-b82a-741f54010725-kube-api-access-tc2sc\") pod \"ovnkube-node-9xxhr\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:44.225604 master-0 kubenswrapper[4745]: I1204 11:36:44.225504 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmdvf\" (UniqueName: \"kubernetes.io/projected/287fba2d-f56d-4ec0-b796-7849a68fb411-kube-api-access-gmdvf\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:36:44.429159 master-0 kubenswrapper[4745]: I1204 11:36:44.429087 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:36:44.506965 master-0 kubenswrapper[4745]: I1204 11:36:44.506818 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:36:45.626266 master-0 kubenswrapper[4745]: I1204 11:36:45.626179 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:45.626848 master-0 kubenswrapper[4745]: E1204 11:36:45.626330 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:36:45.787856 master-0 kubenswrapper[4745]: W1204 11:36:45.787732 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod591ce05d_0b49_40ab_b82a_741f54010725.slice/crio-9fbdb7f82e6e6abb4f5215b275fdf2bc40ea4d65f7fb361a517df32aae2da0f0 WatchSource:0}: Error finding container 9fbdb7f82e6e6abb4f5215b275fdf2bc40ea4d65f7fb361a517df32aae2da0f0: Status 404 returned error can't find the container with id 9fbdb7f82e6e6abb4f5215b275fdf2bc40ea4d65f7fb361a517df32aae2da0f0 Dec 04 11:36:45.906739 master-0 kubenswrapper[4745]: I1204 11:36:45.906690 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" event={"ID":"591ce05d-0b49-40ab-b82a-741f54010725","Type":"ContainerStarted","Data":"9fbdb7f82e6e6abb4f5215b275fdf2bc40ea4d65f7fb361a517df32aae2da0f0"} Dec 04 11:36:45.908214 master-0 kubenswrapper[4745]: I1204 11:36:45.908184 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" event={"ID":"287fba2d-f56d-4ec0-b796-7849a68fb411","Type":"ContainerStarted","Data":"b05c03ee7421430935dd045065b562c6c4243474d783822f7feef789f201d335"} Dec 04 11:36:46.408986 master-0 kubenswrapper[4745]: I1204 11:36:46.408360 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:36:46.409339 master-0 kubenswrapper[4745]: E1204 11:36:46.408640 4745 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 11:36:46.409339 master-0 kubenswrapper[4745]: E1204 11:36:46.409145 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert podName:69640270-09e6-4217-b1c8-3d3465c0c3ae nodeName:}" failed. No retries permitted until 2025-12-04 11:37:18.409109242 +0000 UTC m=+124.111097637 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert") pod "cluster-version-operator-77dfcc565f-nqpsd" (UID: "69640270-09e6-4217-b1c8-3d3465c0c3ae") : secret "cluster-version-operator-serving-cert" not found Dec 04 11:36:46.869443 master-0 kubenswrapper[4745]: I1204 11:36:46.869348 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-w2lss"] Dec 04 11:36:46.870226 master-0 kubenswrapper[4745]: I1204 11:36:46.869790 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:36:46.870226 master-0 kubenswrapper[4745]: E1204 11:36:46.869890 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2lss" podUID="a3558de2-46f8-48b5-a961-95decb7805cf" Dec 04 11:36:46.913464 master-0 kubenswrapper[4745]: I1204 11:36:46.913319 4745 generic.go:334] "Generic (PLEG): container finished" podID="bdfcb644-24ef-4a33-93ae-a855e872d29a" containerID="eadce23f3de74bb3fa383956febe6a31a7bf48f1c04ed7c5a031f480449f38e8" exitCode=0 Dec 04 11:36:46.913653 master-0 kubenswrapper[4745]: I1204 11:36:46.913440 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pk59" event={"ID":"bdfcb644-24ef-4a33-93ae-a855e872d29a","Type":"ContainerDied","Data":"eadce23f3de74bb3fa383956febe6a31a7bf48f1c04ed7c5a031f480449f38e8"} Dec 04 11:36:46.918687 master-0 kubenswrapper[4745]: I1204 11:36:46.918387 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" event={"ID":"287fba2d-f56d-4ec0-b796-7849a68fb411","Type":"ContainerStarted","Data":"02af7a9b6d867ad6c9efbe5f71625ff71d4bf99ade92c914099d7a85fd7f5109"} Dec 04 11:36:46.923614 master-0 kubenswrapper[4745]: I1204 11:36:46.923529 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-twxbl" event={"ID":"c790c174-dc60-4f34-8818-3b367fbe3a5f","Type":"ContainerStarted","Data":"70b6acb3fbdaa4a708bdcf482f86e6d6d1585dbd3a3d8d48502bdcdafebcad37"} Dec 04 11:36:46.962007 master-0 kubenswrapper[4745]: I1204 11:36:46.961923 4745 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-twxbl" podStartSLOduration=4.6386410940000005 podStartE2EDuration="16.961903432s" podCreationTimestamp="2025-12-04 11:36:30 +0000 UTC" firstStartedPulling="2025-12-04 11:36:33.508079549 +0000 UTC m=+79.210067944" lastFinishedPulling="2025-12-04 11:36:45.831341887 +0000 UTC m=+91.533330282" observedRunningTime="2025-12-04 11:36:46.961773108 +0000 UTC m=+92.663761513" watchObservedRunningTime="2025-12-04 11:36:46.961903432 +0000 UTC m=+92.663891817" Dec 04 11:36:47.013080 master-0 kubenswrapper[4745]: I1204 11:36:47.013020 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbt5w\" (UniqueName: \"kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w\") pod \"network-check-target-w2lss\" (UID: \"a3558de2-46f8-48b5-a961-95decb7805cf\") " pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:36:47.114353 master-0 kubenswrapper[4745]: I1204 11:36:47.114259 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tbt5w\" (UniqueName: \"kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w\") pod \"network-check-target-w2lss\" (UID: \"a3558de2-46f8-48b5-a961-95decb7805cf\") " pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:36:47.128413 master-0 kubenswrapper[4745]: E1204 11:36:47.128306 4745 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Dec 04 11:36:47.128413 master-0 kubenswrapper[4745]: E1204 11:36:47.128372 4745 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Dec 04 11:36:47.128413 master-0 kubenswrapper[4745]: E1204 11:36:47.128388 4745 projected.go:194] Error preparing data for projected volume kube-api-access-tbt5w for pod openshift-network-diagnostics/network-check-target-w2lss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 11:36:47.128599 master-0 kubenswrapper[4745]: E1204 11:36:47.128455 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w podName:a3558de2-46f8-48b5-a961-95decb7805cf nodeName:}" failed. No retries permitted until 2025-12-04 11:36:47.628436174 +0000 UTC m=+93.330424569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tbt5w" (UniqueName: "kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w") pod "network-check-target-w2lss" (UID: "a3558de2-46f8-48b5-a961-95decb7805cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 11:36:47.626107 master-0 kubenswrapper[4745]: I1204 11:36:47.626054 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:47.626472 master-0 kubenswrapper[4745]: E1204 11:36:47.626204 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:36:47.721091 master-0 kubenswrapper[4745]: I1204 11:36:47.721037 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tbt5w\" (UniqueName: \"kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w\") pod \"network-check-target-w2lss\" (UID: \"a3558de2-46f8-48b5-a961-95decb7805cf\") " pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:36:47.721302 master-0 kubenswrapper[4745]: E1204 11:36:47.721237 4745 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Dec 04 11:36:47.721302 master-0 kubenswrapper[4745]: E1204 11:36:47.721262 4745 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Dec 04 11:36:47.721302 master-0 kubenswrapper[4745]: E1204 11:36:47.721275 4745 projected.go:194] Error preparing data for projected volume kube-api-access-tbt5w for pod openshift-network-diagnostics/network-check-target-w2lss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 11:36:47.721421 master-0 kubenswrapper[4745]: E1204 11:36:47.721338 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w podName:a3558de2-46f8-48b5-a961-95decb7805cf nodeName:}" failed. No retries permitted until 2025-12-04 11:36:48.721320193 +0000 UTC m=+94.423308598 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tbt5w" (UniqueName: "kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w") pod "network-check-target-w2lss" (UID: "a3558de2-46f8-48b5-a961-95decb7805cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 11:36:48.625928 master-0 kubenswrapper[4745]: I1204 11:36:48.625852 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:36:48.626544 master-0 kubenswrapper[4745]: E1204 11:36:48.626024 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2lss" podUID="a3558de2-46f8-48b5-a961-95decb7805cf" Dec 04 11:36:48.740736 master-0 kubenswrapper[4745]: I1204 11:36:48.739916 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tbt5w\" (UniqueName: \"kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w\") pod \"network-check-target-w2lss\" (UID: \"a3558de2-46f8-48b5-a961-95decb7805cf\") " pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:36:48.740736 master-0 kubenswrapper[4745]: E1204 11:36:48.740212 4745 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Dec 04 11:36:48.740736 master-0 kubenswrapper[4745]: E1204 11:36:48.740237 4745 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Dec 04 11:36:48.740736 master-0 kubenswrapper[4745]: E1204 11:36:48.740252 4745 projected.go:194] Error preparing data for projected volume kube-api-access-tbt5w for pod openshift-network-diagnostics/network-check-target-w2lss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 11:36:48.740736 master-0 kubenswrapper[4745]: E1204 11:36:48.740321 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w podName:a3558de2-46f8-48b5-a961-95decb7805cf nodeName:}" failed. No retries permitted until 2025-12-04 11:36:50.740300638 +0000 UTC m=+96.442289033 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tbt5w" (UniqueName: "kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w") pod "network-check-target-w2lss" (UID: "a3558de2-46f8-48b5-a961-95decb7805cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 11:36:48.932346 master-0 kubenswrapper[4745]: I1204 11:36:48.932267 4745 generic.go:334] "Generic (PLEG): container finished" podID="bdfcb644-24ef-4a33-93ae-a855e872d29a" containerID="180c9014500168f2c0f5e0532e1a0a716b6e343af71b25614526bc3a4db81fe9" exitCode=0 Dec 04 11:36:48.932664 master-0 kubenswrapper[4745]: I1204 11:36:48.932617 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pk59" event={"ID":"bdfcb644-24ef-4a33-93ae-a855e872d29a","Type":"ContainerDied","Data":"180c9014500168f2c0f5e0532e1a0a716b6e343af71b25614526bc3a4db81fe9"} Dec 04 11:36:49.474381 master-0 kubenswrapper[4745]: I1204 11:36:49.474328 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-network-node-identity/network-node-identity-f8hvq"] Dec 04 11:36:49.474683 master-0 kubenswrapper[4745]: I1204 11:36:49.474664 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:36:49.477696 master-0 kubenswrapper[4745]: I1204 11:36:49.477327 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-node-identity"/"network-node-identity-cert" Dec 04 11:36:49.477696 master-0 kubenswrapper[4745]: I1204 11:36:49.477611 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"kube-root-ca.crt" Dec 04 11:36:49.478923 master-0 kubenswrapper[4745]: I1204 11:36:49.477759 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"env-overrides" Dec 04 11:36:49.478923 master-0 kubenswrapper[4745]: I1204 11:36:49.477920 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"openshift-service-ca.crt" Dec 04 11:36:49.478923 master-0 kubenswrapper[4745]: I1204 11:36:49.478157 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"ovnkube-identity-cm" Dec 04 11:36:49.547571 master-0 kubenswrapper[4745]: I1204 11:36:49.547377 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:49.547905 master-0 kubenswrapper[4745]: E1204 11:36:49.547601 4745 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 11:36:49.547905 master-0 kubenswrapper[4745]: E1204 11:36:49.547693 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs podName:d8fca733-45c8-45b8-8653-ac204e7c6098 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:05.547675259 +0000 UTC m=+111.249663654 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs") pod "network-metrics-daemon-gp57t" (UID: "d8fca733-45c8-45b8-8653-ac204e7c6098") : object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 11:36:49.625557 master-0 kubenswrapper[4745]: I1204 11:36:49.625482 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:49.625909 master-0 kubenswrapper[4745]: E1204 11:36:49.625653 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:36:49.647949 master-0 kubenswrapper[4745]: I1204 11:36:49.647886 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/7203ec93-6572-4032-825c-140029a86058-ovnkube-identity-cm\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:36:49.647949 master-0 kubenswrapper[4745]: I1204 11:36:49.647951 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7203ec93-6572-4032-825c-140029a86058-env-overrides\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:36:49.647949 master-0 kubenswrapper[4745]: I1204 11:36:49.647982 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7203ec93-6572-4032-825c-140029a86058-webhook-cert\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:36:49.648714 master-0 kubenswrapper[4745]: I1204 11:36:49.648093 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkcj4\" (UniqueName: \"kubernetes.io/projected/7203ec93-6572-4032-825c-140029a86058-kube-api-access-gkcj4\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:36:49.748724 master-0 kubenswrapper[4745]: I1204 11:36:49.748591 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/7203ec93-6572-4032-825c-140029a86058-ovnkube-identity-cm\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:36:49.748724 master-0 kubenswrapper[4745]: I1204 11:36:49.748661 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7203ec93-6572-4032-825c-140029a86058-env-overrides\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:36:49.748724 master-0 kubenswrapper[4745]: I1204 11:36:49.748682 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7203ec93-6572-4032-825c-140029a86058-webhook-cert\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:36:49.748724 master-0 kubenswrapper[4745]: I1204 11:36:49.748712 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gkcj4\" (UniqueName: \"kubernetes.io/projected/7203ec93-6572-4032-825c-140029a86058-kube-api-access-gkcj4\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:36:49.749985 master-0 kubenswrapper[4745]: E1204 11:36:49.749943 4745 secret.go:189] Couldn't get secret openshift-network-node-identity/network-node-identity-cert: secret "network-node-identity-cert" not found Dec 04 11:36:49.750053 master-0 kubenswrapper[4745]: E1204 11:36:49.750030 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7203ec93-6572-4032-825c-140029a86058-webhook-cert podName:7203ec93-6572-4032-825c-140029a86058 nodeName:}" failed. No retries permitted until 2025-12-04 11:36:50.250010049 +0000 UTC m=+95.951998454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/7203ec93-6572-4032-825c-140029a86058-webhook-cert") pod "network-node-identity-f8hvq" (UID: "7203ec93-6572-4032-825c-140029a86058") : secret "network-node-identity-cert" not found Dec 04 11:36:49.750375 master-0 kubenswrapper[4745]: I1204 11:36:49.750338 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/7203ec93-6572-4032-825c-140029a86058-ovnkube-identity-cm\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:36:49.753049 master-0 kubenswrapper[4745]: I1204 11:36:49.750349 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7203ec93-6572-4032-825c-140029a86058-env-overrides\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:36:49.770606 master-0 kubenswrapper[4745]: I1204 11:36:49.770532 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkcj4\" (UniqueName: \"kubernetes.io/projected/7203ec93-6572-4032-825c-140029a86058-kube-api-access-gkcj4\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:36:50.255027 master-0 kubenswrapper[4745]: I1204 11:36:50.254199 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7203ec93-6572-4032-825c-140029a86058-webhook-cert\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:36:50.257792 master-0 kubenswrapper[4745]: I1204 11:36:50.257738 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7203ec93-6572-4032-825c-140029a86058-webhook-cert\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:36:50.389868 master-0 kubenswrapper[4745]: I1204 11:36:50.389666 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:36:50.403117 master-0 kubenswrapper[4745]: W1204 11:36:50.403051 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7203ec93_6572_4032_825c_140029a86058.slice/crio-b19546f46eaddad7163bb8c25c987ab9b0d1e6ccae50bd40bb5bd44e80ea64cb WatchSource:0}: Error finding container b19546f46eaddad7163bb8c25c987ab9b0d1e6ccae50bd40bb5bd44e80ea64cb: Status 404 returned error can't find the container with id b19546f46eaddad7163bb8c25c987ab9b0d1e6ccae50bd40bb5bd44e80ea64cb Dec 04 11:36:50.626067 master-0 kubenswrapper[4745]: I1204 11:36:50.626002 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:36:50.626400 master-0 kubenswrapper[4745]: E1204 11:36:50.626199 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2lss" podUID="a3558de2-46f8-48b5-a961-95decb7805cf" Dec 04 11:36:50.638168 master-0 kubenswrapper[4745]: I1204 11:36:50.638115 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["kube-system/bootstrap-kube-scheduler-master-0"] Dec 04 11:36:50.640559 master-0 kubenswrapper[4745]: I1204 11:36:50.640463 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/bootstrap-kube-apiserver-master-0"] Dec 04 11:36:50.758983 master-0 kubenswrapper[4745]: I1204 11:36:50.758771 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tbt5w\" (UniqueName: \"kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w\") pod \"network-check-target-w2lss\" (UID: \"a3558de2-46f8-48b5-a961-95decb7805cf\") " pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:36:50.760532 master-0 kubenswrapper[4745]: E1204 11:36:50.759096 4745 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Dec 04 11:36:50.760532 master-0 kubenswrapper[4745]: E1204 11:36:50.759145 4745 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Dec 04 11:36:50.760532 master-0 kubenswrapper[4745]: E1204 11:36:50.759163 4745 projected.go:194] Error preparing data for projected volume kube-api-access-tbt5w for pod openshift-network-diagnostics/network-check-target-w2lss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 11:36:50.760532 master-0 kubenswrapper[4745]: E1204 11:36:50.759264 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w podName:a3558de2-46f8-48b5-a961-95decb7805cf nodeName:}" failed. No retries permitted until 2025-12-04 11:36:54.759235196 +0000 UTC m=+100.461223731 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tbt5w" (UniqueName: "kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w") pod "network-check-target-w2lss" (UID: "a3558de2-46f8-48b5-a961-95decb7805cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 11:36:50.938936 master-0 kubenswrapper[4745]: I1204 11:36:50.938824 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-f8hvq" event={"ID":"7203ec93-6572-4032-825c-140029a86058","Type":"ContainerStarted","Data":"b19546f46eaddad7163bb8c25c987ab9b0d1e6ccae50bd40bb5bd44e80ea64cb"} Dec 04 11:36:50.942722 master-0 kubenswrapper[4745]: I1204 11:36:50.942687 4745 generic.go:334] "Generic (PLEG): container finished" podID="bdfcb644-24ef-4a33-93ae-a855e872d29a" containerID="c09e207d8873c7c6bd85b10d3d0b68a6f4de01726a36fb157635378662fe6ac7" exitCode=0 Dec 04 11:36:50.942847 master-0 kubenswrapper[4745]: I1204 11:36:50.942756 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pk59" event={"ID":"bdfcb644-24ef-4a33-93ae-a855e872d29a","Type":"ContainerDied","Data":"c09e207d8873c7c6bd85b10d3d0b68a6f4de01726a36fb157635378662fe6ac7"} Dec 04 11:36:50.957766 master-0 kubenswrapper[4745]: I1204 11:36:50.957665 4745 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" podStartSLOduration=0.957640676 podStartE2EDuration="957.640676ms" podCreationTimestamp="2025-12-04 11:36:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:36:50.956461149 +0000 UTC m=+96.658449554" watchObservedRunningTime="2025-12-04 11:36:50.957640676 +0000 UTC m=+96.659629071" Dec 04 11:36:50.972047 master-0 kubenswrapper[4745]: I1204 11:36:50.971506 4745 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/bootstrap-kube-scheduler-master-0" podStartSLOduration=0.971475169 podStartE2EDuration="971.475169ms" podCreationTimestamp="2025-12-04 11:36:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:36:50.970978794 +0000 UTC m=+96.672967199" watchObservedRunningTime="2025-12-04 11:36:50.971475169 +0000 UTC m=+96.673463564" Dec 04 11:36:51.625950 master-0 kubenswrapper[4745]: I1204 11:36:51.625887 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:51.626214 master-0 kubenswrapper[4745]: E1204 11:36:51.626034 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:36:52.625947 master-0 kubenswrapper[4745]: I1204 11:36:52.625829 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:36:52.626623 master-0 kubenswrapper[4745]: E1204 11:36:52.626032 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2lss" podUID="a3558de2-46f8-48b5-a961-95decb7805cf" Dec 04 11:36:53.626308 master-0 kubenswrapper[4745]: I1204 11:36:53.626222 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:53.627028 master-0 kubenswrapper[4745]: E1204 11:36:53.626429 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:36:54.625640 master-0 kubenswrapper[4745]: I1204 11:36:54.625582 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:36:54.626142 master-0 kubenswrapper[4745]: E1204 11:36:54.626104 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2lss" podUID="a3558de2-46f8-48b5-a961-95decb7805cf" Dec 04 11:36:54.796903 master-0 kubenswrapper[4745]: I1204 11:36:54.796826 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tbt5w\" (UniqueName: \"kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w\") pod \"network-check-target-w2lss\" (UID: \"a3558de2-46f8-48b5-a961-95decb7805cf\") " pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:36:54.797463 master-0 kubenswrapper[4745]: E1204 11:36:54.796982 4745 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Dec 04 11:36:54.797463 master-0 kubenswrapper[4745]: E1204 11:36:54.797012 4745 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Dec 04 11:36:54.797463 master-0 kubenswrapper[4745]: E1204 11:36:54.797027 4745 projected.go:194] Error preparing data for projected volume kube-api-access-tbt5w for pod openshift-network-diagnostics/network-check-target-w2lss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 11:36:54.797463 master-0 kubenswrapper[4745]: E1204 11:36:54.797147 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w podName:a3558de2-46f8-48b5-a961-95decb7805cf nodeName:}" failed. No retries permitted until 2025-12-04 11:37:02.797129371 +0000 UTC m=+108.499117776 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tbt5w" (UniqueName: "kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w") pod "network-check-target-w2lss" (UID: "a3558de2-46f8-48b5-a961-95decb7805cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 11:36:55.625692 master-0 kubenswrapper[4745]: I1204 11:36:55.625634 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:55.625921 master-0 kubenswrapper[4745]: E1204 11:36:55.625793 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:36:56.627100 master-0 kubenswrapper[4745]: I1204 11:36:56.627036 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:36:56.627551 master-0 kubenswrapper[4745]: E1204 11:36:56.627195 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2lss" podUID="a3558de2-46f8-48b5-a961-95decb7805cf" Dec 04 11:36:57.625592 master-0 kubenswrapper[4745]: I1204 11:36:57.625505 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:57.625844 master-0 kubenswrapper[4745]: E1204 11:36:57.625728 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:36:58.625594 master-0 kubenswrapper[4745]: I1204 11:36:58.625511 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:36:58.626636 master-0 kubenswrapper[4745]: E1204 11:36:58.625670 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2lss" podUID="a3558de2-46f8-48b5-a961-95decb7805cf" Dec 04 11:36:59.625864 master-0 kubenswrapper[4745]: I1204 11:36:59.625782 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:36:59.626502 master-0 kubenswrapper[4745]: E1204 11:36:59.625953 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:36:59.900827 master-0 kubenswrapper[4745]: I1204 11:36:59.900668 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["kube-system/bootstrap-kube-controller-manager-master-0"] Dec 04 11:37:00.626507 master-0 kubenswrapper[4745]: I1204 11:37:00.626367 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:00.627267 master-0 kubenswrapper[4745]: E1204 11:37:00.626611 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2lss" podUID="a3558de2-46f8-48b5-a961-95decb7805cf" Dec 04 11:37:01.626103 master-0 kubenswrapper[4745]: I1204 11:37:01.625990 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:01.626415 master-0 kubenswrapper[4745]: E1204 11:37:01.626151 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:37:02.626252 master-0 kubenswrapper[4745]: I1204 11:37:02.626136 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:02.627030 master-0 kubenswrapper[4745]: E1204 11:37:02.626369 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2lss" podUID="a3558de2-46f8-48b5-a961-95decb7805cf" Dec 04 11:37:02.876062 master-0 kubenswrapper[4745]: I1204 11:37:02.875942 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tbt5w\" (UniqueName: \"kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w\") pod \"network-check-target-w2lss\" (UID: \"a3558de2-46f8-48b5-a961-95decb7805cf\") " pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:02.876451 master-0 kubenswrapper[4745]: E1204 11:37:02.876168 4745 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Dec 04 11:37:02.876451 master-0 kubenswrapper[4745]: E1204 11:37:02.876194 4745 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Dec 04 11:37:02.876451 master-0 kubenswrapper[4745]: E1204 11:37:02.876209 4745 projected.go:194] Error preparing data for projected volume kube-api-access-tbt5w for pod openshift-network-diagnostics/network-check-target-w2lss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 11:37:02.876451 master-0 kubenswrapper[4745]: E1204 11:37:02.876276 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w podName:a3558de2-46f8-48b5-a961-95decb7805cf nodeName:}" failed. No retries permitted until 2025-12-04 11:37:18.876255454 +0000 UTC m=+124.578243849 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tbt5w" (UniqueName: "kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w") pod "network-check-target-w2lss" (UID: "a3558de2-46f8-48b5-a961-95decb7805cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 11:37:03.626441 master-0 kubenswrapper[4745]: I1204 11:37:03.626374 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:03.626989 master-0 kubenswrapper[4745]: E1204 11:37:03.626552 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:37:04.625687 master-0 kubenswrapper[4745]: I1204 11:37:04.625583 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:04.626625 master-0 kubenswrapper[4745]: E1204 11:37:04.626479 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2lss" podUID="a3558de2-46f8-48b5-a961-95decb7805cf" Dec 04 11:37:05.600881 master-0 kubenswrapper[4745]: I1204 11:37:05.600801 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:05.601243 master-0 kubenswrapper[4745]: E1204 11:37:05.601013 4745 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 11:37:05.601243 master-0 kubenswrapper[4745]: E1204 11:37:05.601100 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs podName:d8fca733-45c8-45b8-8653-ac204e7c6098 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:37.601082283 +0000 UTC m=+143.303070678 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs") pod "network-metrics-daemon-gp57t" (UID: "d8fca733-45c8-45b8-8653-ac204e7c6098") : object "openshift-multus"/"metrics-daemon-secret" not registered Dec 04 11:37:05.626104 master-0 kubenswrapper[4745]: I1204 11:37:05.626011 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:05.626328 master-0 kubenswrapper[4745]: E1204 11:37:05.626178 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:37:06.626859 master-0 kubenswrapper[4745]: I1204 11:37:06.626712 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:06.628022 master-0 kubenswrapper[4745]: E1204 11:37:06.627037 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2lss" podUID="a3558de2-46f8-48b5-a961-95decb7805cf" Dec 04 11:37:07.538274 master-0 kubenswrapper[4745]: I1204 11:37:07.538204 4745 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/bootstrap-kube-controller-manager-master-0" podStartSLOduration=9.538186673 podStartE2EDuration="9.538186673s" podCreationTimestamp="2025-12-04 11:36:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:37:07.537692828 +0000 UTC m=+113.239681223" watchObservedRunningTime="2025-12-04 11:37:07.538186673 +0000 UTC m=+113.240175068" Dec 04 11:37:07.626359 master-0 kubenswrapper[4745]: I1204 11:37:07.626232 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:07.626617 master-0 kubenswrapper[4745]: E1204 11:37:07.626384 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:37:08.626853 master-0 kubenswrapper[4745]: I1204 11:37:08.626348 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:08.627472 master-0 kubenswrapper[4745]: E1204 11:37:08.626950 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2lss" podUID="a3558de2-46f8-48b5-a961-95decb7805cf" Dec 04 11:37:08.998660 master-0 kubenswrapper[4745]: I1204 11:37:08.998516 4745 generic.go:334] "Generic (PLEG): container finished" podID="bdfcb644-24ef-4a33-93ae-a855e872d29a" containerID="7d222cce1ac64b8e7a610b554b283ef4b4d0fcbf566ec67f8a7637ab6af91dcb" exitCode=0 Dec 04 11:37:08.998660 master-0 kubenswrapper[4745]: I1204 11:37:08.998640 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pk59" event={"ID":"bdfcb644-24ef-4a33-93ae-a855e872d29a","Type":"ContainerDied","Data":"7d222cce1ac64b8e7a610b554b283ef4b4d0fcbf566ec67f8a7637ab6af91dcb"} Dec 04 11:37:09.000356 master-0 kubenswrapper[4745]: I1204 11:37:08.999990 4745 generic.go:334] "Generic (PLEG): container finished" podID="591ce05d-0b49-40ab-b82a-741f54010725" containerID="1c0b0896d08e7dc327d1d524be686614444e3ac802a4323e6eb1508ed4e8e705" exitCode=0 Dec 04 11:37:09.000356 master-0 kubenswrapper[4745]: I1204 11:37:09.000044 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" event={"ID":"591ce05d-0b49-40ab-b82a-741f54010725","Type":"ContainerDied","Data":"1c0b0896d08e7dc327d1d524be686614444e3ac802a4323e6eb1508ed4e8e705"} Dec 04 11:37:09.002739 master-0 kubenswrapper[4745]: I1204 11:37:09.002676 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" event={"ID":"287fba2d-f56d-4ec0-b796-7849a68fb411","Type":"ContainerStarted","Data":"a98c972089f945f20cf6cc807089551b4b9f89664b6a5a78412dd79091e473a5"} Dec 04 11:37:09.005837 master-0 kubenswrapper[4745]: I1204 11:37:09.005779 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-f8hvq" event={"ID":"7203ec93-6572-4032-825c-140029a86058","Type":"ContainerStarted","Data":"9b4ba98e62019491fc3009d22881e8502c26c25aed860943c3e8a4e83ac5e2e1"} Dec 04 11:37:09.005837 master-0 kubenswrapper[4745]: I1204 11:37:09.005824 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-f8hvq" event={"ID":"7203ec93-6572-4032-825c-140029a86058","Type":"ContainerStarted","Data":"7dac80bd5755cc3e7a057bbde1ce5a77a32ead50c320b8fbd76da84cd7e15c2f"} Dec 04 11:37:09.040943 master-0 kubenswrapper[4745]: I1204 11:37:09.040537 4745 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" podStartSLOduration=4.020373384 podStartE2EDuration="26.040501561s" podCreationTimestamp="2025-12-04 11:36:43 +0000 UTC" firstStartedPulling="2025-12-04 11:36:45.969622444 +0000 UTC m=+91.671610829" lastFinishedPulling="2025-12-04 11:37:07.989750581 +0000 UTC m=+113.691739006" observedRunningTime="2025-12-04 11:37:09.039914922 +0000 UTC m=+114.741903327" watchObservedRunningTime="2025-12-04 11:37:09.040501561 +0000 UTC m=+114.742489966" Dec 04 11:37:09.079079 master-0 kubenswrapper[4745]: I1204 11:37:09.078684 4745 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-node-identity/network-node-identity-f8hvq" podStartSLOduration=2.274384062 podStartE2EDuration="20.078661189s" podCreationTimestamp="2025-12-04 11:36:49 +0000 UTC" firstStartedPulling="2025-12-04 11:36:50.406212568 +0000 UTC m=+96.108200963" lastFinishedPulling="2025-12-04 11:37:08.210489695 +0000 UTC m=+113.912478090" observedRunningTime="2025-12-04 11:37:09.077859115 +0000 UTC m=+114.779847510" watchObservedRunningTime="2025-12-04 11:37:09.078661189 +0000 UTC m=+114.780649584" Dec 04 11:37:09.626064 master-0 kubenswrapper[4745]: I1204 11:37:09.625541 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:09.626200 master-0 kubenswrapper[4745]: E1204 11:37:09.626173 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:37:10.015970 master-0 kubenswrapper[4745]: I1204 11:37:10.015905 4745 generic.go:334] "Generic (PLEG): container finished" podID="bdfcb644-24ef-4a33-93ae-a855e872d29a" containerID="1d5a311d3baeca56657213d2436c5cd5a6f19236b17d29ba3c96c8778083bdb3" exitCode=0 Dec 04 11:37:10.016678 master-0 kubenswrapper[4745]: I1204 11:37:10.015993 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pk59" event={"ID":"bdfcb644-24ef-4a33-93ae-a855e872d29a","Type":"ContainerDied","Data":"1d5a311d3baeca56657213d2436c5cd5a6f19236b17d29ba3c96c8778083bdb3"} Dec 04 11:37:10.022161 master-0 kubenswrapper[4745]: I1204 11:37:10.021611 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" event={"ID":"591ce05d-0b49-40ab-b82a-741f54010725","Type":"ContainerStarted","Data":"af2ab51fb9e897d2980dda27a576094e62a969b78bb5ad6af3e9cbe3c6c7450f"} Dec 04 11:37:10.022161 master-0 kubenswrapper[4745]: I1204 11:37:10.021673 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" event={"ID":"591ce05d-0b49-40ab-b82a-741f54010725","Type":"ContainerStarted","Data":"e009187b7c41aa9027c4ca2ef7abc2e3b889e7b7371758982de474f980bf76bb"} Dec 04 11:37:10.022161 master-0 kubenswrapper[4745]: I1204 11:37:10.021687 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" event={"ID":"591ce05d-0b49-40ab-b82a-741f54010725","Type":"ContainerStarted","Data":"1367e6102c67cd450bcb5890d72fd48148aee7dbf7a966bd4e0b3e32c53d45f3"} Dec 04 11:37:10.022161 master-0 kubenswrapper[4745]: I1204 11:37:10.021699 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" event={"ID":"591ce05d-0b49-40ab-b82a-741f54010725","Type":"ContainerStarted","Data":"bca45471f0e0d38b028fdfde7a46a55c4e42745ee78c7ad49b6e526ec11689fb"} Dec 04 11:37:10.022161 master-0 kubenswrapper[4745]: I1204 11:37:10.021710 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" event={"ID":"591ce05d-0b49-40ab-b82a-741f54010725","Type":"ContainerStarted","Data":"da6354a8fb1e72f8f8b643a44af98c7b664ff9536018b92dc0aa0c71ef0cc7b4"} Dec 04 11:37:10.022161 master-0 kubenswrapper[4745]: I1204 11:37:10.021720 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" event={"ID":"591ce05d-0b49-40ab-b82a-741f54010725","Type":"ContainerStarted","Data":"7a560069e504f6de568792656358e7dee2995f8499bef81bcb1c0120eeb34fc3"} Dec 04 11:37:10.626307 master-0 kubenswrapper[4745]: I1204 11:37:10.626190 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:10.626715 master-0 kubenswrapper[4745]: E1204 11:37:10.626386 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2lss" podUID="a3558de2-46f8-48b5-a961-95decb7805cf" Dec 04 11:37:11.030122 master-0 kubenswrapper[4745]: I1204 11:37:11.029743 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6pk59" event={"ID":"bdfcb644-24ef-4a33-93ae-a855e872d29a","Type":"ContainerStarted","Data":"2b1bb40de8ab8812af4c0cc3cf2a7391e23ba030633633713921492fe2d34fa1"} Dec 04 11:37:11.625743 master-0 kubenswrapper[4745]: I1204 11:37:11.625624 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:11.626145 master-0 kubenswrapper[4745]: E1204 11:37:11.625876 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:37:12.040931 master-0 kubenswrapper[4745]: I1204 11:37:12.040717 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" event={"ID":"591ce05d-0b49-40ab-b82a-741f54010725","Type":"ContainerStarted","Data":"d74258cf1634f5731c9c335f3a9dbd7ed7467dcff1fc912cb39df2b8ce1bdc2f"} Dec 04 11:37:12.626478 master-0 kubenswrapper[4745]: I1204 11:37:12.626361 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:12.626843 master-0 kubenswrapper[4745]: E1204 11:37:12.626594 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2lss" podUID="a3558de2-46f8-48b5-a961-95decb7805cf" Dec 04 11:37:13.626398 master-0 kubenswrapper[4745]: I1204 11:37:13.626294 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:13.627004 master-0 kubenswrapper[4745]: E1204 11:37:13.626519 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:37:14.495180 master-0 kubenswrapper[4745]: E1204 11:37:14.494826 4745 kubelet_node_status.go:497] "Node not becoming ready in time after startup" Dec 04 11:37:14.625674 master-0 kubenswrapper[4745]: I1204 11:37:14.625572 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:14.626369 master-0 kubenswrapper[4745]: E1204 11:37:14.626306 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2lss" podUID="a3558de2-46f8-48b5-a961-95decb7805cf" Dec 04 11:37:14.699244 master-0 kubenswrapper[4745]: E1204 11:37:14.699042 4745 kubelet.go:2916] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" Dec 04 11:37:15.058013 master-0 kubenswrapper[4745]: I1204 11:37:15.057953 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" event={"ID":"591ce05d-0b49-40ab-b82a-741f54010725","Type":"ContainerStarted","Data":"144709b670104d48a49acf64ba34e7e5850cd06ce826b7571ec41b0b6dd55b42"} Dec 04 11:37:15.058351 master-0 kubenswrapper[4745]: I1204 11:37:15.058319 4745 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:37:15.084486 master-0 kubenswrapper[4745]: I1204 11:37:15.084378 4745 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6pk59" podStartSLOduration=7.830450663 podStartE2EDuration="42.084362446s" podCreationTimestamp="2025-12-04 11:36:33 +0000 UTC" firstStartedPulling="2025-12-04 11:36:34.003962374 +0000 UTC m=+79.705950769" lastFinishedPulling="2025-12-04 11:37:08.257874147 +0000 UTC m=+113.959862552" observedRunningTime="2025-12-04 11:37:11.047967446 +0000 UTC m=+116.749955851" watchObservedRunningTime="2025-12-04 11:37:15.084362446 +0000 UTC m=+120.786350841" Dec 04 11:37:15.084797 master-0 kubenswrapper[4745]: I1204 11:37:15.084606 4745 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" podStartSLOduration=9.902873605 podStartE2EDuration="32.084601464s" podCreationTimestamp="2025-12-04 11:36:43 +0000 UTC" firstStartedPulling="2025-12-04 11:36:45.790734282 +0000 UTC m=+91.492722687" lastFinishedPulling="2025-12-04 11:37:07.972462151 +0000 UTC m=+113.674450546" observedRunningTime="2025-12-04 11:37:15.083903562 +0000 UTC m=+120.785891957" watchObservedRunningTime="2025-12-04 11:37:15.084601464 +0000 UTC m=+120.786589859" Dec 04 11:37:15.087888 master-0 kubenswrapper[4745]: I1204 11:37:15.087827 4745 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:37:15.625707 master-0 kubenswrapper[4745]: I1204 11:37:15.625605 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:15.625995 master-0 kubenswrapper[4745]: E1204 11:37:15.625847 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:37:16.062033 master-0 kubenswrapper[4745]: I1204 11:37:16.061946 4745 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:37:16.062033 master-0 kubenswrapper[4745]: I1204 11:37:16.062008 4745 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:37:16.086991 master-0 kubenswrapper[4745]: I1204 11:37:16.086912 4745 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:37:16.471847 master-0 kubenswrapper[4745]: I1204 11:37:16.471199 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gp57t"] Dec 04 11:37:16.472102 master-0 kubenswrapper[4745]: I1204 11:37:16.471857 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:16.472102 master-0 kubenswrapper[4745]: E1204 11:37:16.471971 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:37:16.474117 master-0 kubenswrapper[4745]: I1204 11:37:16.474081 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w2lss"] Dec 04 11:37:16.474358 master-0 kubenswrapper[4745]: I1204 11:37:16.474341 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:16.474581 master-0 kubenswrapper[4745]: E1204 11:37:16.474550 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2lss" podUID="a3558de2-46f8-48b5-a961-95decb7805cf" Dec 04 11:37:17.625884 master-0 kubenswrapper[4745]: I1204 11:37:17.625702 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:17.626889 master-0 kubenswrapper[4745]: E1204 11:37:17.625945 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2lss" podUID="a3558de2-46f8-48b5-a961-95decb7805cf" Dec 04 11:37:18.110111 master-0 kubenswrapper[4745]: I1204 11:37:18.108964 4745 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-9xxhr"] Dec 04 11:37:18.433563 master-0 kubenswrapper[4745]: I1204 11:37:18.433426 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:37:18.434025 master-0 kubenswrapper[4745]: E1204 11:37:18.433639 4745 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 11:37:18.434025 master-0 kubenswrapper[4745]: E1204 11:37:18.433736 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert podName:69640270-09e6-4217-b1c8-3d3465c0c3ae nodeName:}" failed. No retries permitted until 2025-12-04 11:38:22.433713431 +0000 UTC m=+188.135701816 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert") pod "cluster-version-operator-77dfcc565f-nqpsd" (UID: "69640270-09e6-4217-b1c8-3d3465c0c3ae") : secret "cluster-version-operator-serving-cert" not found Dec 04 11:37:18.626291 master-0 kubenswrapper[4745]: I1204 11:37:18.626064 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:18.627143 master-0 kubenswrapper[4745]: E1204 11:37:18.626311 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:37:18.938517 master-0 kubenswrapper[4745]: E1204 11:37:18.938203 4745 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Dec 04 11:37:18.938517 master-0 kubenswrapper[4745]: E1204 11:37:18.938283 4745 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Dec 04 11:37:18.938517 master-0 kubenswrapper[4745]: E1204 11:37:18.938302 4745 projected.go:194] Error preparing data for projected volume kube-api-access-tbt5w for pod openshift-network-diagnostics/network-check-target-w2lss: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 11:37:18.938517 master-0 kubenswrapper[4745]: E1204 11:37:18.938393 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w podName:a3558de2-46f8-48b5-a961-95decb7805cf nodeName:}" failed. No retries permitted until 2025-12-04 11:37:50.938363066 +0000 UTC m=+156.640351461 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tbt5w" (UniqueName: "kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w") pod "network-check-target-w2lss" (UID: "a3558de2-46f8-48b5-a961-95decb7805cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Dec 04 11:37:18.939993 master-0 kubenswrapper[4745]: I1204 11:37:18.938588 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tbt5w\" (UniqueName: \"kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w\") pod \"network-check-target-w2lss\" (UID: \"a3558de2-46f8-48b5-a961-95decb7805cf\") " pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:19.071612 master-0 kubenswrapper[4745]: I1204 11:37:19.071285 4745 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="ovn-controller" containerID="cri-o://7a560069e504f6de568792656358e7dee2995f8499bef81bcb1c0120eeb34fc3" gracePeriod=30 Dec 04 11:37:19.071612 master-0 kubenswrapper[4745]: I1204 11:37:19.071406 4745 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="kube-rbac-proxy-node" containerID="cri-o://bca45471f0e0d38b028fdfde7a46a55c4e42745ee78c7ad49b6e526ec11689fb" gracePeriod=30 Dec 04 11:37:19.071612 master-0 kubenswrapper[4745]: I1204 11:37:19.071406 4745 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="ovn-acl-logging" containerID="cri-o://da6354a8fb1e72f8f8b643a44af98c7b664ff9536018b92dc0aa0c71ef0cc7b4" gracePeriod=30 Dec 04 11:37:19.071612 master-0 kubenswrapper[4745]: I1204 11:37:19.071515 4745 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="nbdb" containerID="cri-o://af2ab51fb9e897d2980dda27a576094e62a969b78bb5ad6af3e9cbe3c6c7450f" gracePeriod=30 Dec 04 11:37:19.071612 master-0 kubenswrapper[4745]: I1204 11:37:19.071372 4745 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="northd" containerID="cri-o://e009187b7c41aa9027c4ca2ef7abc2e3b889e7b7371758982de474f980bf76bb" gracePeriod=30 Dec 04 11:37:19.071612 master-0 kubenswrapper[4745]: I1204 11:37:19.071561 4745 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="sbdb" containerID="cri-o://d74258cf1634f5731c9c335f3a9dbd7ed7467dcff1fc912cb39df2b8ce1bdc2f" gracePeriod=30 Dec 04 11:37:19.071612 master-0 kubenswrapper[4745]: I1204 11:37:19.071533 4745 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="kube-rbac-proxy-ovn-metrics" containerID="cri-o://1367e6102c67cd450bcb5890d72fd48148aee7dbf7a966bd4e0b3e32c53d45f3" gracePeriod=30 Dec 04 11:37:19.090455 master-0 kubenswrapper[4745]: I1204 11:37:19.090239 4745 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="ovnkube-controller" probeResult="failure" output="" Dec 04 11:37:19.091406 master-0 kubenswrapper[4745]: I1204 11:37:19.091339 4745 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="ovnkube-controller" containerID="cri-o://144709b670104d48a49acf64ba34e7e5850cd06ce826b7571ec41b0b6dd55b42" gracePeriod=30 Dec 04 11:37:19.626469 master-0 kubenswrapper[4745]: I1204 11:37:19.626379 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:19.627293 master-0 kubenswrapper[4745]: E1204 11:37:19.626571 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2lss" podUID="a3558de2-46f8-48b5-a961-95decb7805cf" Dec 04 11:37:19.701498 master-0 kubenswrapper[4745]: E1204 11:37:19.701343 4745 kubelet.go:2916] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" Dec 04 11:37:20.076582 master-0 kubenswrapper[4745]: I1204 11:37:20.076548 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xxhr_591ce05d-0b49-40ab-b82a-741f54010725/kube-rbac-proxy-ovn-metrics/0.log" Dec 04 11:37:20.077182 master-0 kubenswrapper[4745]: I1204 11:37:20.077148 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xxhr_591ce05d-0b49-40ab-b82a-741f54010725/kube-rbac-proxy-node/0.log" Dec 04 11:37:20.077579 master-0 kubenswrapper[4745]: I1204 11:37:20.077558 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xxhr_591ce05d-0b49-40ab-b82a-741f54010725/ovn-acl-logging/0.log" Dec 04 11:37:20.078080 master-0 kubenswrapper[4745]: I1204 11:37:20.078058 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xxhr_591ce05d-0b49-40ab-b82a-741f54010725/ovn-controller/0.log" Dec 04 11:37:20.078636 master-0 kubenswrapper[4745]: I1204 11:37:20.078419 4745 generic.go:334] "Generic (PLEG): container finished" podID="591ce05d-0b49-40ab-b82a-741f54010725" containerID="d74258cf1634f5731c9c335f3a9dbd7ed7467dcff1fc912cb39df2b8ce1bdc2f" exitCode=0 Dec 04 11:37:20.078636 master-0 kubenswrapper[4745]: I1204 11:37:20.078445 4745 generic.go:334] "Generic (PLEG): container finished" podID="591ce05d-0b49-40ab-b82a-741f54010725" containerID="af2ab51fb9e897d2980dda27a576094e62a969b78bb5ad6af3e9cbe3c6c7450f" exitCode=0 Dec 04 11:37:20.078636 master-0 kubenswrapper[4745]: I1204 11:37:20.078448 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" event={"ID":"591ce05d-0b49-40ab-b82a-741f54010725","Type":"ContainerDied","Data":"d74258cf1634f5731c9c335f3a9dbd7ed7467dcff1fc912cb39df2b8ce1bdc2f"} Dec 04 11:37:20.078636 master-0 kubenswrapper[4745]: I1204 11:37:20.078497 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" event={"ID":"591ce05d-0b49-40ab-b82a-741f54010725","Type":"ContainerDied","Data":"af2ab51fb9e897d2980dda27a576094e62a969b78bb5ad6af3e9cbe3c6c7450f"} Dec 04 11:37:20.078636 master-0 kubenswrapper[4745]: I1204 11:37:20.078509 4745 generic.go:334] "Generic (PLEG): container finished" podID="591ce05d-0b49-40ab-b82a-741f54010725" containerID="e009187b7c41aa9027c4ca2ef7abc2e3b889e7b7371758982de474f980bf76bb" exitCode=0 Dec 04 11:37:20.078636 master-0 kubenswrapper[4745]: I1204 11:37:20.078527 4745 generic.go:334] "Generic (PLEG): container finished" podID="591ce05d-0b49-40ab-b82a-741f54010725" containerID="1367e6102c67cd450bcb5890d72fd48148aee7dbf7a966bd4e0b3e32c53d45f3" exitCode=143 Dec 04 11:37:20.078636 master-0 kubenswrapper[4745]: I1204 11:37:20.078537 4745 generic.go:334] "Generic (PLEG): container finished" podID="591ce05d-0b49-40ab-b82a-741f54010725" containerID="bca45471f0e0d38b028fdfde7a46a55c4e42745ee78c7ad49b6e526ec11689fb" exitCode=143 Dec 04 11:37:20.078636 master-0 kubenswrapper[4745]: I1204 11:37:20.078545 4745 generic.go:334] "Generic (PLEG): container finished" podID="591ce05d-0b49-40ab-b82a-741f54010725" containerID="da6354a8fb1e72f8f8b643a44af98c7b664ff9536018b92dc0aa0c71ef0cc7b4" exitCode=143 Dec 04 11:37:20.078636 master-0 kubenswrapper[4745]: I1204 11:37:20.078553 4745 generic.go:334] "Generic (PLEG): container finished" podID="591ce05d-0b49-40ab-b82a-741f54010725" containerID="7a560069e504f6de568792656358e7dee2995f8499bef81bcb1c0120eeb34fc3" exitCode=143 Dec 04 11:37:20.078636 master-0 kubenswrapper[4745]: I1204 11:37:20.078509 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" event={"ID":"591ce05d-0b49-40ab-b82a-741f54010725","Type":"ContainerDied","Data":"e009187b7c41aa9027c4ca2ef7abc2e3b889e7b7371758982de474f980bf76bb"} Dec 04 11:37:20.078636 master-0 kubenswrapper[4745]: I1204 11:37:20.078579 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" event={"ID":"591ce05d-0b49-40ab-b82a-741f54010725","Type":"ContainerDied","Data":"1367e6102c67cd450bcb5890d72fd48148aee7dbf7a966bd4e0b3e32c53d45f3"} Dec 04 11:37:20.078636 master-0 kubenswrapper[4745]: I1204 11:37:20.078593 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" event={"ID":"591ce05d-0b49-40ab-b82a-741f54010725","Type":"ContainerDied","Data":"bca45471f0e0d38b028fdfde7a46a55c4e42745ee78c7ad49b6e526ec11689fb"} Dec 04 11:37:20.078636 master-0 kubenswrapper[4745]: I1204 11:37:20.078606 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" event={"ID":"591ce05d-0b49-40ab-b82a-741f54010725","Type":"ContainerDied","Data":"da6354a8fb1e72f8f8b643a44af98c7b664ff9536018b92dc0aa0c71ef0cc7b4"} Dec 04 11:37:20.078636 master-0 kubenswrapper[4745]: I1204 11:37:20.078617 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" event={"ID":"591ce05d-0b49-40ab-b82a-741f54010725","Type":"ContainerDied","Data":"7a560069e504f6de568792656358e7dee2995f8499bef81bcb1c0120eeb34fc3"} Dec 04 11:37:20.540108 master-0 kubenswrapper[4745]: I1204 11:37:20.540019 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xxhr_591ce05d-0b49-40ab-b82a-741f54010725/ovnkube-controller/0.log" Dec 04 11:37:20.541962 master-0 kubenswrapper[4745]: I1204 11:37:20.541921 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xxhr_591ce05d-0b49-40ab-b82a-741f54010725/kube-rbac-proxy-ovn-metrics/0.log" Dec 04 11:37:20.542443 master-0 kubenswrapper[4745]: I1204 11:37:20.542396 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xxhr_591ce05d-0b49-40ab-b82a-741f54010725/kube-rbac-proxy-node/0.log" Dec 04 11:37:20.542987 master-0 kubenswrapper[4745]: I1204 11:37:20.542953 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xxhr_591ce05d-0b49-40ab-b82a-741f54010725/ovn-acl-logging/0.log" Dec 04 11:37:20.543399 master-0 kubenswrapper[4745]: I1204 11:37:20.543366 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xxhr_591ce05d-0b49-40ab-b82a-741f54010725/ovn-controller/0.log" Dec 04 11:37:20.543881 master-0 kubenswrapper[4745]: I1204 11:37:20.543847 4745 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:37:20.626669 master-0 kubenswrapper[4745]: I1204 11:37:20.626572 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:20.627221 master-0 kubenswrapper[4745]: E1204 11:37:20.626826 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:37:20.653724 master-0 kubenswrapper[4745]: I1204 11:37:20.653665 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-cni-bin\") pod \"591ce05d-0b49-40ab-b82a-741f54010725\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " Dec 04 11:37:20.653724 master-0 kubenswrapper[4745]: I1204 11:37:20.653727 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc2sc\" (UniqueName: \"kubernetes.io/projected/591ce05d-0b49-40ab-b82a-741f54010725-kube-api-access-tc2sc\") pod \"591ce05d-0b49-40ab-b82a-741f54010725\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " Dec 04 11:37:20.653984 master-0 kubenswrapper[4745]: I1204 11:37:20.653749 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-run-openvswitch\") pod \"591ce05d-0b49-40ab-b82a-741f54010725\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " Dec 04 11:37:20.653984 master-0 kubenswrapper[4745]: I1204 11:37:20.653777 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-var-lib-cni-networks-ovn-kubernetes\") pod \"591ce05d-0b49-40ab-b82a-741f54010725\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " Dec 04 11:37:20.653984 master-0 kubenswrapper[4745]: I1204 11:37:20.653824 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/591ce05d-0b49-40ab-b82a-741f54010725-ovnkube-config\") pod \"591ce05d-0b49-40ab-b82a-741f54010725\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " Dec 04 11:37:20.653984 master-0 kubenswrapper[4745]: I1204 11:37:20.653850 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-run-systemd\") pod \"591ce05d-0b49-40ab-b82a-741f54010725\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " Dec 04 11:37:20.653984 master-0 kubenswrapper[4745]: I1204 11:37:20.653876 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-log-socket\") pod \"591ce05d-0b49-40ab-b82a-741f54010725\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " Dec 04 11:37:20.653984 master-0 kubenswrapper[4745]: I1204 11:37:20.653858 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-cni-bin" (OuterVolumeSpecName: "host-cni-bin") pod "591ce05d-0b49-40ab-b82a-741f54010725" (UID: "591ce05d-0b49-40ab-b82a-741f54010725"). InnerVolumeSpecName "host-cni-bin". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:37:20.653984 master-0 kubenswrapper[4745]: I1204 11:37:20.653902 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-var-lib-cni-networks-ovn-kubernetes" (OuterVolumeSpecName: "host-var-lib-cni-networks-ovn-kubernetes") pod "591ce05d-0b49-40ab-b82a-741f54010725" (UID: "591ce05d-0b49-40ab-b82a-741f54010725"). InnerVolumeSpecName "host-var-lib-cni-networks-ovn-kubernetes". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:37:20.653984 master-0 kubenswrapper[4745]: I1204 11:37:20.653924 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-run-openvswitch" (OuterVolumeSpecName: "run-openvswitch") pod "591ce05d-0b49-40ab-b82a-741f54010725" (UID: "591ce05d-0b49-40ab-b82a-741f54010725"). InnerVolumeSpecName "run-openvswitch". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:37:20.654274 master-0 kubenswrapper[4745]: I1204 11:37:20.653936 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-run-ovn\") pod \"591ce05d-0b49-40ab-b82a-741f54010725\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " Dec 04 11:37:20.654274 master-0 kubenswrapper[4745]: I1204 11:37:20.654004 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-run-ovn" (OuterVolumeSpecName: "run-ovn") pod "591ce05d-0b49-40ab-b82a-741f54010725" (UID: "591ce05d-0b49-40ab-b82a-741f54010725"). InnerVolumeSpecName "run-ovn". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:37:20.654274 master-0 kubenswrapper[4745]: I1204 11:37:20.654109 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-var-lib-openvswitch\") pod \"591ce05d-0b49-40ab-b82a-741f54010725\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " Dec 04 11:37:20.654274 master-0 kubenswrapper[4745]: I1204 11:37:20.654154 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-node-log\") pod \"591ce05d-0b49-40ab-b82a-741f54010725\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " Dec 04 11:37:20.654274 master-0 kubenswrapper[4745]: I1204 11:37:20.654179 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-kubelet\") pod \"591ce05d-0b49-40ab-b82a-741f54010725\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " Dec 04 11:37:20.654274 master-0 kubenswrapper[4745]: I1204 11:37:20.654204 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-etc-openvswitch\") pod \"591ce05d-0b49-40ab-b82a-741f54010725\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " Dec 04 11:37:20.654274 master-0 kubenswrapper[4745]: I1204 11:37:20.654211 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-var-lib-openvswitch" (OuterVolumeSpecName: "var-lib-openvswitch") pod "591ce05d-0b49-40ab-b82a-741f54010725" (UID: "591ce05d-0b49-40ab-b82a-741f54010725"). InnerVolumeSpecName "var-lib-openvswitch". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:37:20.654274 master-0 kubenswrapper[4745]: I1204 11:37:20.654243 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/591ce05d-0b49-40ab-b82a-741f54010725-ovn-node-metrics-cert\") pod \"591ce05d-0b49-40ab-b82a-741f54010725\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " Dec 04 11:37:20.654274 master-0 kubenswrapper[4745]: I1204 11:37:20.654262 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-kubelet" (OuterVolumeSpecName: "host-kubelet") pod "591ce05d-0b49-40ab-b82a-741f54010725" (UID: "591ce05d-0b49-40ab-b82a-741f54010725"). InnerVolumeSpecName "host-kubelet". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:37:20.654274 master-0 kubenswrapper[4745]: I1204 11:37:20.654274 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-cni-netd\") pod \"591ce05d-0b49-40ab-b82a-741f54010725\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " Dec 04 11:37:20.654613 master-0 kubenswrapper[4745]: I1204 11:37:20.654298 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-run-netns\") pod \"591ce05d-0b49-40ab-b82a-741f54010725\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " Dec 04 11:37:20.654613 master-0 kubenswrapper[4745]: I1204 11:37:20.654470 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/591ce05d-0b49-40ab-b82a-741f54010725-env-overrides\") pod \"591ce05d-0b49-40ab-b82a-741f54010725\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " Dec 04 11:37:20.654613 master-0 kubenswrapper[4745]: I1204 11:37:20.654495 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-run-ovn-kubernetes\") pod \"591ce05d-0b49-40ab-b82a-741f54010725\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " Dec 04 11:37:20.654613 master-0 kubenswrapper[4745]: I1204 11:37:20.654521 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-systemd-units\") pod \"591ce05d-0b49-40ab-b82a-741f54010725\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " Dec 04 11:37:20.654613 master-0 kubenswrapper[4745]: I1204 11:37:20.654544 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-slash\") pod \"591ce05d-0b49-40ab-b82a-741f54010725\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " Dec 04 11:37:20.654788 master-0 kubenswrapper[4745]: I1204 11:37:20.654669 4745 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/591ce05d-0b49-40ab-b82a-741f54010725-ovnkube-script-lib\") pod \"591ce05d-0b49-40ab-b82a-741f54010725\" (UID: \"591ce05d-0b49-40ab-b82a-741f54010725\") " Dec 04 11:37:20.654788 master-0 kubenswrapper[4745]: I1204 11:37:20.654328 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-cni-netd" (OuterVolumeSpecName: "host-cni-netd") pod "591ce05d-0b49-40ab-b82a-741f54010725" (UID: "591ce05d-0b49-40ab-b82a-741f54010725"). InnerVolumeSpecName "host-cni-netd". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:37:20.654788 master-0 kubenswrapper[4745]: I1204 11:37:20.654318 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-etc-openvswitch" (OuterVolumeSpecName: "etc-openvswitch") pod "591ce05d-0b49-40ab-b82a-741f54010725" (UID: "591ce05d-0b49-40ab-b82a-741f54010725"). InnerVolumeSpecName "etc-openvswitch". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:37:20.654929 master-0 kubenswrapper[4745]: I1204 11:37:20.654332 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-node-log" (OuterVolumeSpecName: "node-log") pod "591ce05d-0b49-40ab-b82a-741f54010725" (UID: "591ce05d-0b49-40ab-b82a-741f54010725"). InnerVolumeSpecName "node-log". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:37:20.654929 master-0 kubenswrapper[4745]: I1204 11:37:20.654399 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-run-netns" (OuterVolumeSpecName: "host-run-netns") pod "591ce05d-0b49-40ab-b82a-741f54010725" (UID: "591ce05d-0b49-40ab-b82a-741f54010725"). InnerVolumeSpecName "host-run-netns". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:37:20.654929 master-0 kubenswrapper[4745]: I1204 11:37:20.654528 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/591ce05d-0b49-40ab-b82a-741f54010725-ovnkube-config" (OuterVolumeSpecName: "ovnkube-config") pod "591ce05d-0b49-40ab-b82a-741f54010725" (UID: "591ce05d-0b49-40ab-b82a-741f54010725"). InnerVolumeSpecName "ovnkube-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:37:20.654929 master-0 kubenswrapper[4745]: I1204 11:37:20.654596 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-systemd-units" (OuterVolumeSpecName: "systemd-units") pod "591ce05d-0b49-40ab-b82a-741f54010725" (UID: "591ce05d-0b49-40ab-b82a-741f54010725"). InnerVolumeSpecName "systemd-units". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:37:20.654929 master-0 kubenswrapper[4745]: I1204 11:37:20.654585 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-log-socket" (OuterVolumeSpecName: "log-socket") pod "591ce05d-0b49-40ab-b82a-741f54010725" (UID: "591ce05d-0b49-40ab-b82a-741f54010725"). InnerVolumeSpecName "log-socket". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:37:20.654929 master-0 kubenswrapper[4745]: I1204 11:37:20.654602 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-run-ovn-kubernetes" (OuterVolumeSpecName: "host-run-ovn-kubernetes") pod "591ce05d-0b49-40ab-b82a-741f54010725" (UID: "591ce05d-0b49-40ab-b82a-741f54010725"). InnerVolumeSpecName "host-run-ovn-kubernetes". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:37:20.654929 master-0 kubenswrapper[4745]: I1204 11:37:20.654617 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-slash" (OuterVolumeSpecName: "host-slash") pod "591ce05d-0b49-40ab-b82a-741f54010725" (UID: "591ce05d-0b49-40ab-b82a-741f54010725"). InnerVolumeSpecName "host-slash". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:37:20.655173 master-0 kubenswrapper[4745]: I1204 11:37:20.654960 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/591ce05d-0b49-40ab-b82a-741f54010725-env-overrides" (OuterVolumeSpecName: "env-overrides") pod "591ce05d-0b49-40ab-b82a-741f54010725" (UID: "591ce05d-0b49-40ab-b82a-741f54010725"). InnerVolumeSpecName "env-overrides". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:37:20.655173 master-0 kubenswrapper[4745]: I1204 11:37:20.655056 4745 reconciler_common.go:293] "Volume detached for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-run-ovn-kubernetes\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:20.655173 master-0 kubenswrapper[4745]: I1204 11:37:20.655088 4745 reconciler_common.go:293] "Volume detached for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-systemd-units\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:20.655173 master-0 kubenswrapper[4745]: I1204 11:37:20.655105 4745 reconciler_common.go:293] "Volume detached for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-slash\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:20.655173 master-0 kubenswrapper[4745]: I1204 11:37:20.655117 4745 reconciler_common.go:293] "Volume detached for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-cni-bin\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:20.655173 master-0 kubenswrapper[4745]: I1204 11:37:20.655128 4745 reconciler_common.go:293] "Volume detached for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-run-openvswitch\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:20.655173 master-0 kubenswrapper[4745]: I1204 11:37:20.655140 4745 reconciler_common.go:293] "Volume detached for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-var-lib-cni-networks-ovn-kubernetes\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:20.655173 master-0 kubenswrapper[4745]: I1204 11:37:20.655154 4745 reconciler_common.go:293] "Volume detached for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/591ce05d-0b49-40ab-b82a-741f54010725-ovnkube-config\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:20.655173 master-0 kubenswrapper[4745]: I1204 11:37:20.655166 4745 reconciler_common.go:293] "Volume detached for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-log-socket\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:20.655173 master-0 kubenswrapper[4745]: I1204 11:37:20.655178 4745 reconciler_common.go:293] "Volume detached for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-run-ovn\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:20.655173 master-0 kubenswrapper[4745]: I1204 11:37:20.655190 4745 reconciler_common.go:293] "Volume detached for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-var-lib-openvswitch\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:20.655550 master-0 kubenswrapper[4745]: I1204 11:37:20.655203 4745 reconciler_common.go:293] "Volume detached for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-node-log\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:20.655550 master-0 kubenswrapper[4745]: I1204 11:37:20.655214 4745 reconciler_common.go:293] "Volume detached for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-kubelet\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:20.655550 master-0 kubenswrapper[4745]: I1204 11:37:20.655225 4745 reconciler_common.go:293] "Volume detached for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-etc-openvswitch\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:20.655550 master-0 kubenswrapper[4745]: I1204 11:37:20.655235 4745 reconciler_common.go:293] "Volume detached for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-cni-netd\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:20.655550 master-0 kubenswrapper[4745]: I1204 11:37:20.655245 4745 reconciler_common.go:293] "Volume detached for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-host-run-netns\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:20.655550 master-0 kubenswrapper[4745]: I1204 11:37:20.655254 4745 reconciler_common.go:293] "Volume detached for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/591ce05d-0b49-40ab-b82a-741f54010725-env-overrides\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:20.655550 master-0 kubenswrapper[4745]: I1204 11:37:20.655323 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/591ce05d-0b49-40ab-b82a-741f54010725-ovnkube-script-lib" (OuterVolumeSpecName: "ovnkube-script-lib") pod "591ce05d-0b49-40ab-b82a-741f54010725" (UID: "591ce05d-0b49-40ab-b82a-741f54010725"). InnerVolumeSpecName "ovnkube-script-lib". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:37:20.660835 master-0 kubenswrapper[4745]: I1204 11:37:20.660722 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/591ce05d-0b49-40ab-b82a-741f54010725-ovn-node-metrics-cert" (OuterVolumeSpecName: "ovn-node-metrics-cert") pod "591ce05d-0b49-40ab-b82a-741f54010725" (UID: "591ce05d-0b49-40ab-b82a-741f54010725"). InnerVolumeSpecName "ovn-node-metrics-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 11:37:20.661131 master-0 kubenswrapper[4745]: I1204 11:37:20.661068 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/591ce05d-0b49-40ab-b82a-741f54010725-kube-api-access-tc2sc" (OuterVolumeSpecName: "kube-api-access-tc2sc") pod "591ce05d-0b49-40ab-b82a-741f54010725" (UID: "591ce05d-0b49-40ab-b82a-741f54010725"). InnerVolumeSpecName "kube-api-access-tc2sc". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:37:20.662931 master-0 kubenswrapper[4745]: I1204 11:37:20.662840 4745 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-run-systemd" (OuterVolumeSpecName: "run-systemd") pod "591ce05d-0b49-40ab-b82a-741f54010725" (UID: "591ce05d-0b49-40ab-b82a-741f54010725"). InnerVolumeSpecName "run-systemd". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:37:20.675345 master-0 kubenswrapper[4745]: I1204 11:37:20.675298 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-z4qvm"] Dec 04 11:37:20.675460 master-0 kubenswrapper[4745]: E1204 11:37:20.675412 4745 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="kube-rbac-proxy-node" Dec 04 11:37:20.675460 master-0 kubenswrapper[4745]: I1204 11:37:20.675428 4745 state_mem.go:107] "Deleted CPUSet assignment" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="kube-rbac-proxy-node" Dec 04 11:37:20.675460 master-0 kubenswrapper[4745]: E1204 11:37:20.675439 4745 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="ovn-controller" Dec 04 11:37:20.675460 master-0 kubenswrapper[4745]: I1204 11:37:20.675448 4745 state_mem.go:107] "Deleted CPUSet assignment" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="ovn-controller" Dec 04 11:37:20.675460 master-0 kubenswrapper[4745]: E1204 11:37:20.675456 4745 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="kubecfg-setup" Dec 04 11:37:20.675460 master-0 kubenswrapper[4745]: I1204 11:37:20.675464 4745 state_mem.go:107] "Deleted CPUSet assignment" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="kubecfg-setup" Dec 04 11:37:20.675661 master-0 kubenswrapper[4745]: E1204 11:37:20.675474 4745 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="ovn-acl-logging" Dec 04 11:37:20.675661 master-0 kubenswrapper[4745]: I1204 11:37:20.675482 4745 state_mem.go:107] "Deleted CPUSet assignment" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="ovn-acl-logging" Dec 04 11:37:20.675661 master-0 kubenswrapper[4745]: E1204 11:37:20.675489 4745 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="kube-rbac-proxy-ovn-metrics" Dec 04 11:37:20.675661 master-0 kubenswrapper[4745]: I1204 11:37:20.675497 4745 state_mem.go:107] "Deleted CPUSet assignment" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="kube-rbac-proxy-ovn-metrics" Dec 04 11:37:20.675661 master-0 kubenswrapper[4745]: E1204 11:37:20.675504 4745 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="nbdb" Dec 04 11:37:20.675661 master-0 kubenswrapper[4745]: I1204 11:37:20.675511 4745 state_mem.go:107] "Deleted CPUSet assignment" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="nbdb" Dec 04 11:37:20.675661 master-0 kubenswrapper[4745]: E1204 11:37:20.675520 4745 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="ovnkube-controller" Dec 04 11:37:20.675661 master-0 kubenswrapper[4745]: I1204 11:37:20.675529 4745 state_mem.go:107] "Deleted CPUSet assignment" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="ovnkube-controller" Dec 04 11:37:20.675661 master-0 kubenswrapper[4745]: E1204 11:37:20.675537 4745 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="northd" Dec 04 11:37:20.675661 master-0 kubenswrapper[4745]: I1204 11:37:20.675544 4745 state_mem.go:107] "Deleted CPUSet assignment" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="northd" Dec 04 11:37:20.675661 master-0 kubenswrapper[4745]: E1204 11:37:20.675553 4745 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="sbdb" Dec 04 11:37:20.675661 master-0 kubenswrapper[4745]: I1204 11:37:20.675561 4745 state_mem.go:107] "Deleted CPUSet assignment" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="sbdb" Dec 04 11:37:20.675661 master-0 kubenswrapper[4745]: I1204 11:37:20.675604 4745 memory_manager.go:354] "RemoveStaleState removing state" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="northd" Dec 04 11:37:20.675661 master-0 kubenswrapper[4745]: I1204 11:37:20.675618 4745 memory_manager.go:354] "RemoveStaleState removing state" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="kube-rbac-proxy-node" Dec 04 11:37:20.675661 master-0 kubenswrapper[4745]: I1204 11:37:20.675628 4745 memory_manager.go:354] "RemoveStaleState removing state" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="ovn-acl-logging" Dec 04 11:37:20.675661 master-0 kubenswrapper[4745]: I1204 11:37:20.675638 4745 memory_manager.go:354] "RemoveStaleState removing state" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="ovn-controller" Dec 04 11:37:20.675661 master-0 kubenswrapper[4745]: I1204 11:37:20.675648 4745 memory_manager.go:354] "RemoveStaleState removing state" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="sbdb" Dec 04 11:37:20.675661 master-0 kubenswrapper[4745]: I1204 11:37:20.675655 4745 memory_manager.go:354] "RemoveStaleState removing state" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="nbdb" Dec 04 11:37:20.675661 master-0 kubenswrapper[4745]: I1204 11:37:20.675665 4745 memory_manager.go:354] "RemoveStaleState removing state" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="ovnkube-controller" Dec 04 11:37:20.675661 master-0 kubenswrapper[4745]: I1204 11:37:20.675674 4745 memory_manager.go:354] "RemoveStaleState removing state" podUID="591ce05d-0b49-40ab-b82a-741f54010725" containerName="kube-rbac-proxy-ovn-metrics" Dec 04 11:37:20.676493 master-0 kubenswrapper[4745]: I1204 11:37:20.676461 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.756411 master-0 kubenswrapper[4745]: I1204 11:37:20.756174 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.756411 master-0 kubenswrapper[4745]: I1204 11:37:20.756287 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-cni-bin\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.756411 master-0 kubenswrapper[4745]: I1204 11:37:20.756320 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-log-socket\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.756967 master-0 kubenswrapper[4745]: I1204 11:37:20.756432 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-run-netns\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.756967 master-0 kubenswrapper[4745]: I1204 11:37:20.756509 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-var-lib-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.756967 master-0 kubenswrapper[4745]: I1204 11:37:20.756557 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-node-log\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.756967 master-0 kubenswrapper[4745]: I1204 11:37:20.756592 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.756967 master-0 kubenswrapper[4745]: I1204 11:37:20.756626 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-systemd-units\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.756967 master-0 kubenswrapper[4745]: I1204 11:37:20.756648 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-etc-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.756967 master-0 kubenswrapper[4745]: I1204 11:37:20.756684 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovnkube-config\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.756967 master-0 kubenswrapper[4745]: I1204 11:37:20.756759 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-slash\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.756967 master-0 kubenswrapper[4745]: I1204 11:37:20.756796 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-cni-netd\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.756967 master-0 kubenswrapper[4745]: I1204 11:37:20.756843 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovnkube-script-lib\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.756967 master-0 kubenswrapper[4745]: I1204 11:37:20.756874 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-kubelet\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.756967 master-0 kubenswrapper[4745]: I1204 11:37:20.756897 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-ovn\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.756967 master-0 kubenswrapper[4745]: I1204 11:37:20.756929 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2mhg\" (UniqueName: \"kubernetes.io/projected/157eab0c-0d8d-486b-a349-c2e466e18e0c-kube-api-access-p2mhg\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.756967 master-0 kubenswrapper[4745]: I1204 11:37:20.756965 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-run-ovn-kubernetes\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.756967 master-0 kubenswrapper[4745]: I1204 11:37:20.756986 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-env-overrides\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.757622 master-0 kubenswrapper[4745]: I1204 11:37:20.757011 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-systemd\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.757622 master-0 kubenswrapper[4745]: I1204 11:37:20.757129 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovn-node-metrics-cert\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.757622 master-0 kubenswrapper[4745]: I1204 11:37:20.757190 4745 reconciler_common.go:293] "Volume detached for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/591ce05d-0b49-40ab-b82a-741f54010725-ovnkube-script-lib\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:20.757622 master-0 kubenswrapper[4745]: I1204 11:37:20.757206 4745 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tc2sc\" (UniqueName: \"kubernetes.io/projected/591ce05d-0b49-40ab-b82a-741f54010725-kube-api-access-tc2sc\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:20.757622 master-0 kubenswrapper[4745]: I1204 11:37:20.757222 4745 reconciler_common.go:293] "Volume detached for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/591ce05d-0b49-40ab-b82a-741f54010725-run-systemd\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:20.757622 master-0 kubenswrapper[4745]: I1204 11:37:20.757237 4745 reconciler_common.go:293] "Volume detached for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/591ce05d-0b49-40ab-b82a-741f54010725-ovn-node-metrics-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:20.858013 master-0 kubenswrapper[4745]: I1204 11:37:20.857926 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-run-netns\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.858013 master-0 kubenswrapper[4745]: I1204 11:37:20.857973 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-var-lib-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.858013 master-0 kubenswrapper[4745]: I1204 11:37:20.858030 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-var-lib-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.859502 master-0 kubenswrapper[4745]: I1204 11:37:20.858073 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-node-log\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.859502 master-0 kubenswrapper[4745]: I1204 11:37:20.858095 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.859502 master-0 kubenswrapper[4745]: I1204 11:37:20.858113 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-etc-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.859502 master-0 kubenswrapper[4745]: I1204 11:37:20.858183 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-node-log\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.859502 master-0 kubenswrapper[4745]: I1204 11:37:20.858216 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-run-netns\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.859502 master-0 kubenswrapper[4745]: I1204 11:37:20.858344 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovnkube-config\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.859502 master-0 kubenswrapper[4745]: I1204 11:37:20.858412 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.859502 master-0 kubenswrapper[4745]: I1204 11:37:20.858426 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-systemd-units\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.859502 master-0 kubenswrapper[4745]: I1204 11:37:20.858380 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-etc-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.859502 master-0 kubenswrapper[4745]: I1204 11:37:20.858457 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-slash\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.859502 master-0 kubenswrapper[4745]: I1204 11:37:20.858497 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-cni-netd\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.859502 master-0 kubenswrapper[4745]: I1204 11:37:20.858499 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-systemd-units\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.859502 master-0 kubenswrapper[4745]: I1204 11:37:20.858517 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovnkube-script-lib\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.859502 master-0 kubenswrapper[4745]: I1204 11:37:20.858530 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-slash\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.859502 master-0 kubenswrapper[4745]: I1204 11:37:20.858540 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p2mhg\" (UniqueName: \"kubernetes.io/projected/157eab0c-0d8d-486b-a349-c2e466e18e0c-kube-api-access-p2mhg\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.859502 master-0 kubenswrapper[4745]: I1204 11:37:20.858678 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-cni-netd\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.859502 master-0 kubenswrapper[4745]: I1204 11:37:20.859086 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-kubelet\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.860449 master-0 kubenswrapper[4745]: I1204 11:37:20.859126 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-ovn\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.860449 master-0 kubenswrapper[4745]: I1204 11:37:20.859153 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-env-overrides\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.860449 master-0 kubenswrapper[4745]: I1204 11:37:20.859187 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-run-ovn-kubernetes\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.860449 master-0 kubenswrapper[4745]: I1204 11:37:20.859226 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-ovn\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.860449 master-0 kubenswrapper[4745]: I1204 11:37:20.859249 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-systemd\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.860449 master-0 kubenswrapper[4745]: I1204 11:37:20.859274 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-kubelet\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.860449 master-0 kubenswrapper[4745]: I1204 11:37:20.859324 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovn-node-metrics-cert\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.860449 master-0 kubenswrapper[4745]: I1204 11:37:20.859356 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.860449 master-0 kubenswrapper[4745]: I1204 11:37:20.859395 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovnkube-config\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.860449 master-0 kubenswrapper[4745]: I1204 11:37:20.859399 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-cni-bin\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.860449 master-0 kubenswrapper[4745]: I1204 11:37:20.859444 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-cni-bin\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.860449 master-0 kubenswrapper[4745]: I1204 11:37:20.859486 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-run-ovn-kubernetes\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.860449 master-0 kubenswrapper[4745]: I1204 11:37:20.859488 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-log-socket\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.860449 master-0 kubenswrapper[4745]: I1204 11:37:20.859513 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-log-socket\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.860449 master-0 kubenswrapper[4745]: I1204 11:37:20.859570 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-systemd\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.860449 master-0 kubenswrapper[4745]: I1204 11:37:20.859610 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.860449 master-0 kubenswrapper[4745]: I1204 11:37:20.859734 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovnkube-script-lib\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.860449 master-0 kubenswrapper[4745]: I1204 11:37:20.859949 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-env-overrides\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.862863 master-0 kubenswrapper[4745]: I1204 11:37:20.862797 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovn-node-metrics-cert\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.878638 master-0 kubenswrapper[4745]: I1204 11:37:20.878542 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2mhg\" (UniqueName: \"kubernetes.io/projected/157eab0c-0d8d-486b-a349-c2e466e18e0c-kube-api-access-p2mhg\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:20.991962 master-0 kubenswrapper[4745]: I1204 11:37:20.991880 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:21.084644 master-0 kubenswrapper[4745]: I1204 11:37:21.084102 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" event={"ID":"157eab0c-0d8d-486b-a349-c2e466e18e0c","Type":"ContainerStarted","Data":"853c784d56688f268e88966f202d566476596a385a8e279f2c38cf8e7278c8d9"} Dec 04 11:37:21.087277 master-0 kubenswrapper[4745]: I1204 11:37:21.087178 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xxhr_591ce05d-0b49-40ab-b82a-741f54010725/ovnkube-controller/0.log" Dec 04 11:37:21.090316 master-0 kubenswrapper[4745]: I1204 11:37:21.090260 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xxhr_591ce05d-0b49-40ab-b82a-741f54010725/kube-rbac-proxy-ovn-metrics/0.log" Dec 04 11:37:21.091136 master-0 kubenswrapper[4745]: I1204 11:37:21.091104 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xxhr_591ce05d-0b49-40ab-b82a-741f54010725/kube-rbac-proxy-node/0.log" Dec 04 11:37:21.091635 master-0 kubenswrapper[4745]: I1204 11:37:21.091602 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xxhr_591ce05d-0b49-40ab-b82a-741f54010725/ovn-acl-logging/0.log" Dec 04 11:37:21.093280 master-0 kubenswrapper[4745]: I1204 11:37:21.092423 4745 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xxhr_591ce05d-0b49-40ab-b82a-741f54010725/ovn-controller/0.log" Dec 04 11:37:21.093280 master-0 kubenswrapper[4745]: I1204 11:37:21.093070 4745 generic.go:334] "Generic (PLEG): container finished" podID="591ce05d-0b49-40ab-b82a-741f54010725" containerID="144709b670104d48a49acf64ba34e7e5850cd06ce826b7571ec41b0b6dd55b42" exitCode=1 Dec 04 11:37:21.093280 master-0 kubenswrapper[4745]: I1204 11:37:21.093135 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" event={"ID":"591ce05d-0b49-40ab-b82a-741f54010725","Type":"ContainerDied","Data":"144709b670104d48a49acf64ba34e7e5850cd06ce826b7571ec41b0b6dd55b42"} Dec 04 11:37:21.093280 master-0 kubenswrapper[4745]: I1204 11:37:21.093263 4745 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" Dec 04 11:37:21.093770 master-0 kubenswrapper[4745]: I1204 11:37:21.093511 4745 scope.go:117] "RemoveContainer" containerID="144709b670104d48a49acf64ba34e7e5850cd06ce826b7571ec41b0b6dd55b42" Dec 04 11:37:21.093770 master-0 kubenswrapper[4745]: I1204 11:37:21.093509 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xxhr" event={"ID":"591ce05d-0b49-40ab-b82a-741f54010725","Type":"ContainerDied","Data":"9fbdb7f82e6e6abb4f5215b275fdf2bc40ea4d65f7fb361a517df32aae2da0f0"} Dec 04 11:37:21.154188 master-0 kubenswrapper[4745]: I1204 11:37:21.154133 4745 scope.go:117] "RemoveContainer" containerID="d74258cf1634f5731c9c335f3a9dbd7ed7467dcff1fc912cb39df2b8ce1bdc2f" Dec 04 11:37:21.164783 master-0 kubenswrapper[4745]: I1204 11:37:21.164703 4745 scope.go:117] "RemoveContainer" containerID="af2ab51fb9e897d2980dda27a576094e62a969b78bb5ad6af3e9cbe3c6c7450f" Dec 04 11:37:21.172869 master-0 kubenswrapper[4745]: I1204 11:37:21.172577 4745 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-9xxhr"] Dec 04 11:37:21.176298 master-0 kubenswrapper[4745]: I1204 11:37:21.176218 4745 scope.go:117] "RemoveContainer" containerID="e009187b7c41aa9027c4ca2ef7abc2e3b889e7b7371758982de474f980bf76bb" Dec 04 11:37:21.180040 master-0 kubenswrapper[4745]: I1204 11:37:21.179467 4745 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-9xxhr"] Dec 04 11:37:21.191764 master-0 kubenswrapper[4745]: I1204 11:37:21.191703 4745 scope.go:117] "RemoveContainer" containerID="1367e6102c67cd450bcb5890d72fd48148aee7dbf7a966bd4e0b3e32c53d45f3" Dec 04 11:37:21.203708 master-0 kubenswrapper[4745]: I1204 11:37:21.203654 4745 scope.go:117] "RemoveContainer" containerID="bca45471f0e0d38b028fdfde7a46a55c4e42745ee78c7ad49b6e526ec11689fb" Dec 04 11:37:21.216258 master-0 kubenswrapper[4745]: I1204 11:37:21.216218 4745 scope.go:117] "RemoveContainer" containerID="da6354a8fb1e72f8f8b643a44af98c7b664ff9536018b92dc0aa0c71ef0cc7b4" Dec 04 11:37:21.225942 master-0 kubenswrapper[4745]: I1204 11:37:21.225860 4745 scope.go:117] "RemoveContainer" containerID="7a560069e504f6de568792656358e7dee2995f8499bef81bcb1c0120eeb34fc3" Dec 04 11:37:21.236888 master-0 kubenswrapper[4745]: I1204 11:37:21.236764 4745 scope.go:117] "RemoveContainer" containerID="1c0b0896d08e7dc327d1d524be686614444e3ac802a4323e6eb1508ed4e8e705" Dec 04 11:37:21.246655 master-0 kubenswrapper[4745]: I1204 11:37:21.246523 4745 scope.go:117] "RemoveContainer" containerID="144709b670104d48a49acf64ba34e7e5850cd06ce826b7571ec41b0b6dd55b42" Dec 04 11:37:21.247092 master-0 kubenswrapper[4745]: E1204 11:37:21.247046 4745 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"144709b670104d48a49acf64ba34e7e5850cd06ce826b7571ec41b0b6dd55b42\": container with ID starting with 144709b670104d48a49acf64ba34e7e5850cd06ce826b7571ec41b0b6dd55b42 not found: ID does not exist" containerID="144709b670104d48a49acf64ba34e7e5850cd06ce826b7571ec41b0b6dd55b42" Dec 04 11:37:21.247158 master-0 kubenswrapper[4745]: I1204 11:37:21.247084 4745 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"144709b670104d48a49acf64ba34e7e5850cd06ce826b7571ec41b0b6dd55b42"} err="failed to get container status \"144709b670104d48a49acf64ba34e7e5850cd06ce826b7571ec41b0b6dd55b42\": rpc error: code = NotFound desc = could not find container \"144709b670104d48a49acf64ba34e7e5850cd06ce826b7571ec41b0b6dd55b42\": container with ID starting with 144709b670104d48a49acf64ba34e7e5850cd06ce826b7571ec41b0b6dd55b42 not found: ID does not exist" Dec 04 11:37:21.247158 master-0 kubenswrapper[4745]: I1204 11:37:21.247129 4745 scope.go:117] "RemoveContainer" containerID="d74258cf1634f5731c9c335f3a9dbd7ed7467dcff1fc912cb39df2b8ce1bdc2f" Dec 04 11:37:21.247507 master-0 kubenswrapper[4745]: E1204 11:37:21.247462 4745 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d74258cf1634f5731c9c335f3a9dbd7ed7467dcff1fc912cb39df2b8ce1bdc2f\": container with ID starting with d74258cf1634f5731c9c335f3a9dbd7ed7467dcff1fc912cb39df2b8ce1bdc2f not found: ID does not exist" containerID="d74258cf1634f5731c9c335f3a9dbd7ed7467dcff1fc912cb39df2b8ce1bdc2f" Dec 04 11:37:21.247507 master-0 kubenswrapper[4745]: I1204 11:37:21.247496 4745 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d74258cf1634f5731c9c335f3a9dbd7ed7467dcff1fc912cb39df2b8ce1bdc2f"} err="failed to get container status \"d74258cf1634f5731c9c335f3a9dbd7ed7467dcff1fc912cb39df2b8ce1bdc2f\": rpc error: code = NotFound desc = could not find container \"d74258cf1634f5731c9c335f3a9dbd7ed7467dcff1fc912cb39df2b8ce1bdc2f\": container with ID starting with d74258cf1634f5731c9c335f3a9dbd7ed7467dcff1fc912cb39df2b8ce1bdc2f not found: ID does not exist" Dec 04 11:37:21.247607 master-0 kubenswrapper[4745]: I1204 11:37:21.247518 4745 scope.go:117] "RemoveContainer" containerID="af2ab51fb9e897d2980dda27a576094e62a969b78bb5ad6af3e9cbe3c6c7450f" Dec 04 11:37:21.248027 master-0 kubenswrapper[4745]: E1204 11:37:21.247985 4745 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af2ab51fb9e897d2980dda27a576094e62a969b78bb5ad6af3e9cbe3c6c7450f\": container with ID starting with af2ab51fb9e897d2980dda27a576094e62a969b78bb5ad6af3e9cbe3c6c7450f not found: ID does not exist" containerID="af2ab51fb9e897d2980dda27a576094e62a969b78bb5ad6af3e9cbe3c6c7450f" Dec 04 11:37:21.248083 master-0 kubenswrapper[4745]: I1204 11:37:21.248025 4745 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af2ab51fb9e897d2980dda27a576094e62a969b78bb5ad6af3e9cbe3c6c7450f"} err="failed to get container status \"af2ab51fb9e897d2980dda27a576094e62a969b78bb5ad6af3e9cbe3c6c7450f\": rpc error: code = NotFound desc = could not find container \"af2ab51fb9e897d2980dda27a576094e62a969b78bb5ad6af3e9cbe3c6c7450f\": container with ID starting with af2ab51fb9e897d2980dda27a576094e62a969b78bb5ad6af3e9cbe3c6c7450f not found: ID does not exist" Dec 04 11:37:21.248083 master-0 kubenswrapper[4745]: I1204 11:37:21.248047 4745 scope.go:117] "RemoveContainer" containerID="e009187b7c41aa9027c4ca2ef7abc2e3b889e7b7371758982de474f980bf76bb" Dec 04 11:37:21.248694 master-0 kubenswrapper[4745]: E1204 11:37:21.248636 4745 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e009187b7c41aa9027c4ca2ef7abc2e3b889e7b7371758982de474f980bf76bb\": container with ID starting with e009187b7c41aa9027c4ca2ef7abc2e3b889e7b7371758982de474f980bf76bb not found: ID does not exist" containerID="e009187b7c41aa9027c4ca2ef7abc2e3b889e7b7371758982de474f980bf76bb" Dec 04 11:37:21.248740 master-0 kubenswrapper[4745]: I1204 11:37:21.248707 4745 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e009187b7c41aa9027c4ca2ef7abc2e3b889e7b7371758982de474f980bf76bb"} err="failed to get container status \"e009187b7c41aa9027c4ca2ef7abc2e3b889e7b7371758982de474f980bf76bb\": rpc error: code = NotFound desc = could not find container \"e009187b7c41aa9027c4ca2ef7abc2e3b889e7b7371758982de474f980bf76bb\": container with ID starting with e009187b7c41aa9027c4ca2ef7abc2e3b889e7b7371758982de474f980bf76bb not found: ID does not exist" Dec 04 11:37:21.248783 master-0 kubenswrapper[4745]: I1204 11:37:21.248751 4745 scope.go:117] "RemoveContainer" containerID="1367e6102c67cd450bcb5890d72fd48148aee7dbf7a966bd4e0b3e32c53d45f3" Dec 04 11:37:21.249192 master-0 kubenswrapper[4745]: E1204 11:37:21.249145 4745 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1367e6102c67cd450bcb5890d72fd48148aee7dbf7a966bd4e0b3e32c53d45f3\": container with ID starting with 1367e6102c67cd450bcb5890d72fd48148aee7dbf7a966bd4e0b3e32c53d45f3 not found: ID does not exist" containerID="1367e6102c67cd450bcb5890d72fd48148aee7dbf7a966bd4e0b3e32c53d45f3" Dec 04 11:37:21.249192 master-0 kubenswrapper[4745]: I1204 11:37:21.249185 4745 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1367e6102c67cd450bcb5890d72fd48148aee7dbf7a966bd4e0b3e32c53d45f3"} err="failed to get container status \"1367e6102c67cd450bcb5890d72fd48148aee7dbf7a966bd4e0b3e32c53d45f3\": rpc error: code = NotFound desc = could not find container \"1367e6102c67cd450bcb5890d72fd48148aee7dbf7a966bd4e0b3e32c53d45f3\": container with ID starting with 1367e6102c67cd450bcb5890d72fd48148aee7dbf7a966bd4e0b3e32c53d45f3 not found: ID does not exist" Dec 04 11:37:21.249283 master-0 kubenswrapper[4745]: I1204 11:37:21.249207 4745 scope.go:117] "RemoveContainer" containerID="bca45471f0e0d38b028fdfde7a46a55c4e42745ee78c7ad49b6e526ec11689fb" Dec 04 11:37:21.249595 master-0 kubenswrapper[4745]: E1204 11:37:21.249548 4745 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bca45471f0e0d38b028fdfde7a46a55c4e42745ee78c7ad49b6e526ec11689fb\": container with ID starting with bca45471f0e0d38b028fdfde7a46a55c4e42745ee78c7ad49b6e526ec11689fb not found: ID does not exist" containerID="bca45471f0e0d38b028fdfde7a46a55c4e42745ee78c7ad49b6e526ec11689fb" Dec 04 11:37:21.249595 master-0 kubenswrapper[4745]: I1204 11:37:21.249582 4745 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bca45471f0e0d38b028fdfde7a46a55c4e42745ee78c7ad49b6e526ec11689fb"} err="failed to get container status \"bca45471f0e0d38b028fdfde7a46a55c4e42745ee78c7ad49b6e526ec11689fb\": rpc error: code = NotFound desc = could not find container \"bca45471f0e0d38b028fdfde7a46a55c4e42745ee78c7ad49b6e526ec11689fb\": container with ID starting with bca45471f0e0d38b028fdfde7a46a55c4e42745ee78c7ad49b6e526ec11689fb not found: ID does not exist" Dec 04 11:37:21.249722 master-0 kubenswrapper[4745]: I1204 11:37:21.249633 4745 scope.go:117] "RemoveContainer" containerID="da6354a8fb1e72f8f8b643a44af98c7b664ff9536018b92dc0aa0c71ef0cc7b4" Dec 04 11:37:21.250007 master-0 kubenswrapper[4745]: E1204 11:37:21.249967 4745 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da6354a8fb1e72f8f8b643a44af98c7b664ff9536018b92dc0aa0c71ef0cc7b4\": container with ID starting with da6354a8fb1e72f8f8b643a44af98c7b664ff9536018b92dc0aa0c71ef0cc7b4 not found: ID does not exist" containerID="da6354a8fb1e72f8f8b643a44af98c7b664ff9536018b92dc0aa0c71ef0cc7b4" Dec 04 11:37:21.250064 master-0 kubenswrapper[4745]: I1204 11:37:21.250003 4745 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da6354a8fb1e72f8f8b643a44af98c7b664ff9536018b92dc0aa0c71ef0cc7b4"} err="failed to get container status \"da6354a8fb1e72f8f8b643a44af98c7b664ff9536018b92dc0aa0c71ef0cc7b4\": rpc error: code = NotFound desc = could not find container \"da6354a8fb1e72f8f8b643a44af98c7b664ff9536018b92dc0aa0c71ef0cc7b4\": container with ID starting with da6354a8fb1e72f8f8b643a44af98c7b664ff9536018b92dc0aa0c71ef0cc7b4 not found: ID does not exist" Dec 04 11:37:21.250064 master-0 kubenswrapper[4745]: I1204 11:37:21.250025 4745 scope.go:117] "RemoveContainer" containerID="7a560069e504f6de568792656358e7dee2995f8499bef81bcb1c0120eeb34fc3" Dec 04 11:37:21.250356 master-0 kubenswrapper[4745]: E1204 11:37:21.250313 4745 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a560069e504f6de568792656358e7dee2995f8499bef81bcb1c0120eeb34fc3\": container with ID starting with 7a560069e504f6de568792656358e7dee2995f8499bef81bcb1c0120eeb34fc3 not found: ID does not exist" containerID="7a560069e504f6de568792656358e7dee2995f8499bef81bcb1c0120eeb34fc3" Dec 04 11:37:21.250356 master-0 kubenswrapper[4745]: I1204 11:37:21.250348 4745 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a560069e504f6de568792656358e7dee2995f8499bef81bcb1c0120eeb34fc3"} err="failed to get container status \"7a560069e504f6de568792656358e7dee2995f8499bef81bcb1c0120eeb34fc3\": rpc error: code = NotFound desc = could not find container \"7a560069e504f6de568792656358e7dee2995f8499bef81bcb1c0120eeb34fc3\": container with ID starting with 7a560069e504f6de568792656358e7dee2995f8499bef81bcb1c0120eeb34fc3 not found: ID does not exist" Dec 04 11:37:21.250449 master-0 kubenswrapper[4745]: I1204 11:37:21.250367 4745 scope.go:117] "RemoveContainer" containerID="1c0b0896d08e7dc327d1d524be686614444e3ac802a4323e6eb1508ed4e8e705" Dec 04 11:37:21.250669 master-0 kubenswrapper[4745]: E1204 11:37:21.250627 4745 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c0b0896d08e7dc327d1d524be686614444e3ac802a4323e6eb1508ed4e8e705\": container with ID starting with 1c0b0896d08e7dc327d1d524be686614444e3ac802a4323e6eb1508ed4e8e705 not found: ID does not exist" containerID="1c0b0896d08e7dc327d1d524be686614444e3ac802a4323e6eb1508ed4e8e705" Dec 04 11:37:21.250669 master-0 kubenswrapper[4745]: I1204 11:37:21.250660 4745 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c0b0896d08e7dc327d1d524be686614444e3ac802a4323e6eb1508ed4e8e705"} err="failed to get container status \"1c0b0896d08e7dc327d1d524be686614444e3ac802a4323e6eb1508ed4e8e705\": rpc error: code = NotFound desc = could not find container \"1c0b0896d08e7dc327d1d524be686614444e3ac802a4323e6eb1508ed4e8e705\": container with ID starting with 1c0b0896d08e7dc327d1d524be686614444e3ac802a4323e6eb1508ed4e8e705 not found: ID does not exist" Dec 04 11:37:21.625649 master-0 kubenswrapper[4745]: I1204 11:37:21.625501 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:21.626035 master-0 kubenswrapper[4745]: E1204 11:37:21.625794 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2lss" podUID="a3558de2-46f8-48b5-a961-95decb7805cf" Dec 04 11:37:22.098798 master-0 kubenswrapper[4745]: I1204 11:37:22.098688 4745 generic.go:334] "Generic (PLEG): container finished" podID="157eab0c-0d8d-486b-a349-c2e466e18e0c" containerID="aa46a13fdd928fc26792c9ef2cde5780818c25c59ca4872fc97dad5a0d213287" exitCode=0 Dec 04 11:37:22.100034 master-0 kubenswrapper[4745]: I1204 11:37:22.098863 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" event={"ID":"157eab0c-0d8d-486b-a349-c2e466e18e0c","Type":"ContainerDied","Data":"aa46a13fdd928fc26792c9ef2cde5780818c25c59ca4872fc97dad5a0d213287"} Dec 04 11:37:22.626963 master-0 kubenswrapper[4745]: I1204 11:37:22.626368 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:22.627226 master-0 kubenswrapper[4745]: E1204 11:37:22.627105 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:37:22.630952 master-0 kubenswrapper[4745]: I1204 11:37:22.630837 4745 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="591ce05d-0b49-40ab-b82a-741f54010725" path="/var/lib/kubelet/pods/591ce05d-0b49-40ab-b82a-741f54010725/volumes" Dec 04 11:37:23.108494 master-0 kubenswrapper[4745]: I1204 11:37:23.108408 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" event={"ID":"157eab0c-0d8d-486b-a349-c2e466e18e0c","Type":"ContainerStarted","Data":"df8ad139a738c438e674c744e85b86284caa5f4dcf3f653cc94d56f8fbc84f66"} Dec 04 11:37:23.108494 master-0 kubenswrapper[4745]: I1204 11:37:23.108491 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" event={"ID":"157eab0c-0d8d-486b-a349-c2e466e18e0c","Type":"ContainerStarted","Data":"b8443e54a6259a7f83aea9e33c5c93ef4fa1282be96323960b9d676ce0f86764"} Dec 04 11:37:23.108494 master-0 kubenswrapper[4745]: I1204 11:37:23.108508 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" event={"ID":"157eab0c-0d8d-486b-a349-c2e466e18e0c","Type":"ContainerStarted","Data":"5ea6734213c53d454e852a62d1e4e77a16b2c6b5593f961aa9f79185ee8db7df"} Dec 04 11:37:23.109048 master-0 kubenswrapper[4745]: I1204 11:37:23.108525 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" event={"ID":"157eab0c-0d8d-486b-a349-c2e466e18e0c","Type":"ContainerStarted","Data":"48a2fc4d8baa79ab1afa8ad6f921fe0c41fa1f17eaaac3cd1875521b68ee7fac"} Dec 04 11:37:23.109048 master-0 kubenswrapper[4745]: I1204 11:37:23.108538 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" event={"ID":"157eab0c-0d8d-486b-a349-c2e466e18e0c","Type":"ContainerStarted","Data":"785795f44f68fe251006851be8a078aab4d4c5af6905855da50931322bee0954"} Dec 04 11:37:23.109048 master-0 kubenswrapper[4745]: I1204 11:37:23.108550 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" event={"ID":"157eab0c-0d8d-486b-a349-c2e466e18e0c","Type":"ContainerStarted","Data":"09b24bd0f44fc9bf2b30141b55601a05604c191cd0661ee59b246b49e7ffcff8"} Dec 04 11:37:23.625722 master-0 kubenswrapper[4745]: I1204 11:37:23.625601 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:23.626113 master-0 kubenswrapper[4745]: E1204 11:37:23.625794 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2lss" podUID="a3558de2-46f8-48b5-a961-95decb7805cf" Dec 04 11:37:24.626214 master-0 kubenswrapper[4745]: I1204 11:37:24.626090 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:24.627129 master-0 kubenswrapper[4745]: E1204 11:37:24.626749 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gp57t" podUID="d8fca733-45c8-45b8-8653-ac204e7c6098" Dec 04 11:37:25.626432 master-0 kubenswrapper[4745]: I1204 11:37:25.626365 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:25.629412 master-0 kubenswrapper[4745]: I1204 11:37:25.629334 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"openshift-service-ca.crt" Dec 04 11:37:25.630059 master-0 kubenswrapper[4745]: I1204 11:37:25.629872 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"kube-root-ca.crt" Dec 04 11:37:26.122129 master-0 kubenswrapper[4745]: I1204 11:37:26.122056 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" event={"ID":"157eab0c-0d8d-486b-a349-c2e466e18e0c","Type":"ContainerStarted","Data":"16592979deec36e910feaa8b364785f961672821b6fe83f4f5518c131a689a10"} Dec 04 11:37:26.122129 master-0 kubenswrapper[4745]: I1204 11:37:26.122108 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" event={"ID":"157eab0c-0d8d-486b-a349-c2e466e18e0c","Type":"ContainerStarted","Data":"dc3f9cb9acdc9008485388d47b16dc4968001c97ca283ae91e424e385b290454"} Dec 04 11:37:26.122660 master-0 kubenswrapper[4745]: I1204 11:37:26.122416 4745 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:26.122660 master-0 kubenswrapper[4745]: I1204 11:37:26.122438 4745 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:26.147142 master-0 kubenswrapper[4745]: I1204 11:37:26.147092 4745 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:26.625584 master-0 kubenswrapper[4745]: I1204 11:37:26.625517 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:26.627477 master-0 kubenswrapper[4745]: I1204 11:37:26.627417 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"metrics-daemon-secret" Dec 04 11:37:26.670507 master-0 kubenswrapper[4745]: I1204 11:37:26.670370 4745 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" podStartSLOduration=6.670346201 podStartE2EDuration="6.670346201s" podCreationTimestamp="2025-12-04 11:37:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:37:26.643946683 +0000 UTC m=+132.345935088" watchObservedRunningTime="2025-12-04 11:37:26.670346201 +0000 UTC m=+132.372334606" Dec 04 11:37:27.125407 master-0 kubenswrapper[4745]: I1204 11:37:27.125342 4745 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:27.152845 master-0 kubenswrapper[4745]: I1204 11:37:27.152747 4745 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:30.292593 master-0 kubenswrapper[4745]: I1204 11:37:30.292030 4745 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeReady" Dec 04 11:37:30.718451 master-0 kubenswrapper[4745]: I1204 11:37:30.718339 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf"] Dec 04 11:37:30.719239 master-0 kubenswrapper[4745]: I1204 11:37:30.719193 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/csi-snapshot-controller-operator-6bc8656fdc-2q7f5"] Dec 04 11:37:30.719409 master-0 kubenswrapper[4745]: I1204 11:37:30.719342 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:37:30.719942 master-0 kubenswrapper[4745]: I1204 11:37:30.719717 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-6bc8656fdc-2q7f5" Dec 04 11:37:30.722303 master-0 kubenswrapper[4745]: I1204 11:37:30.722259 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-config" Dec 04 11:37:30.722303 master-0 kubenswrapper[4745]: I1204 11:37:30.722268 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-storage-operator"/"openshift-service-ca.crt" Dec 04 11:37:30.722725 master-0 kubenswrapper[4745]: I1204 11:37:30.722665 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-service-ca.crt" Dec 04 11:37:30.722827 master-0 kubenswrapper[4745]: I1204 11:37:30.722788 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-storage-operator"/"kube-root-ca.crt" Dec 04 11:37:30.722885 master-0 kubenswrapper[4745]: I1204 11:37:30.722849 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-serving-cert" Dec 04 11:37:30.722885 master-0 kubenswrapper[4745]: I1204 11:37:30.722857 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"kube-root-ca.crt" Dec 04 11:37:30.754571 master-0 kubenswrapper[4745]: I1204 11:37:30.754506 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5b826c3-8638-4cf5-b974-b24e4282ce00-serving-cert\") pod \"openshift-apiserver-operator-7bf7f6b755-sh6qf\" (UID: \"a5b826c3-8638-4cf5-b974-b24e4282ce00\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:37:30.754689 master-0 kubenswrapper[4745]: I1204 11:37:30.754586 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7bhn\" (UniqueName: \"kubernetes.io/projected/031d300e-24b4-481c-8b82-fe8cdb3fcef7-kube-api-access-k7bhn\") pod \"csi-snapshot-controller-operator-6bc8656fdc-2q7f5\" (UID: \"031d300e-24b4-481c-8b82-fe8cdb3fcef7\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-6bc8656fdc-2q7f5" Dec 04 11:37:30.754732 master-0 kubenswrapper[4745]: I1204 11:37:30.754683 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhmlm\" (UniqueName: \"kubernetes.io/projected/a5b826c3-8638-4cf5-b974-b24e4282ce00-kube-api-access-rhmlm\") pod \"openshift-apiserver-operator-7bf7f6b755-sh6qf\" (UID: \"a5b826c3-8638-4cf5-b974-b24e4282ce00\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:37:30.754832 master-0 kubenswrapper[4745]: I1204 11:37:30.754778 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5b826c3-8638-4cf5-b974-b24e4282ce00-config\") pod \"openshift-apiserver-operator-7bf7f6b755-sh6qf\" (UID: \"a5b826c3-8638-4cf5-b974-b24e4282ce00\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:37:30.855070 master-0 kubenswrapper[4745]: I1204 11:37:30.854979 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j"] Dec 04 11:37:30.855435 master-0 kubenswrapper[4745]: I1204 11:37:30.855320 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5b826c3-8638-4cf5-b974-b24e4282ce00-serving-cert\") pod \"openshift-apiserver-operator-7bf7f6b755-sh6qf\" (UID: \"a5b826c3-8638-4cf5-b974-b24e4282ce00\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:37:30.855435 master-0 kubenswrapper[4745]: I1204 11:37:30.855387 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k7bhn\" (UniqueName: \"kubernetes.io/projected/031d300e-24b4-481c-8b82-fe8cdb3fcef7-kube-api-access-k7bhn\") pod \"csi-snapshot-controller-operator-6bc8656fdc-2q7f5\" (UID: \"031d300e-24b4-481c-8b82-fe8cdb3fcef7\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-6bc8656fdc-2q7f5" Dec 04 11:37:30.855435 master-0 kubenswrapper[4745]: I1204 11:37:30.855421 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn"] Dec 04 11:37:30.855435 master-0 kubenswrapper[4745]: I1204 11:37:30.855435 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rhmlm\" (UniqueName: \"kubernetes.io/projected/a5b826c3-8638-4cf5-b974-b24e4282ce00-kube-api-access-rhmlm\") pod \"openshift-apiserver-operator-7bf7f6b755-sh6qf\" (UID: \"a5b826c3-8638-4cf5-b974-b24e4282ce00\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:37:30.855595 master-0 kubenswrapper[4745]: I1204 11:37:30.855464 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5b826c3-8638-4cf5-b974-b24e4282ce00-config\") pod \"openshift-apiserver-operator-7bf7f6b755-sh6qf\" (UID: \"a5b826c3-8638-4cf5-b974-b24e4282ce00\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:37:30.855648 master-0 kubenswrapper[4745]: I1204 11:37:30.855617 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2"] Dec 04 11:37:30.856070 master-0 kubenswrapper[4745]: I1204 11:37:30.856045 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:37:30.856448 master-0 kubenswrapper[4745]: I1204 11:37:30.856425 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:30.857025 master-0 kubenswrapper[4745]: I1204 11:37:30.857004 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:37:30.857874 master-0 kubenswrapper[4745]: I1204 11:37:30.856422 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5b826c3-8638-4cf5-b974-b24e4282ce00-config\") pod \"openshift-apiserver-operator-7bf7f6b755-sh6qf\" (UID: \"a5b826c3-8638-4cf5-b974-b24e4282ce00\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:37:30.858036 master-0 kubenswrapper[4745]: I1204 11:37:30.857964 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948"] Dec 04 11:37:30.858654 master-0 kubenswrapper[4745]: I1204 11:37:30.858617 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr"] Dec 04 11:37:30.859020 master-0 kubenswrapper[4745]: I1204 11:37:30.858993 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:30.859068 master-0 kubenswrapper[4745]: I1204 11:37:30.859002 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:37:30.860346 master-0 kubenswrapper[4745]: I1204 11:37:30.860312 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-dns-operator/dns-operator-7c56cf9b74-xz27r"] Dec 04 11:37:30.860741 master-0 kubenswrapper[4745]: I1204 11:37:30.860710 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k"] Dec 04 11:37:30.861169 master-0 kubenswrapper[4745]: I1204 11:37:30.861137 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:37:30.861241 master-0 kubenswrapper[4745]: I1204 11:37:30.861205 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"openshift-service-ca.crt" Dec 04 11:37:30.861588 master-0 kubenswrapper[4745]: I1204 11:37:30.861546 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5"] Dec 04 11:37:30.861588 master-0 kubenswrapper[4745]: I1204 11:37:30.861572 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:37:30.862355 master-0 kubenswrapper[4745]: I1204 11:37:30.862330 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:37:30.863043 master-0 kubenswrapper[4745]: I1204 11:37:30.862616 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw"] Dec 04 11:37:30.863139 master-0 kubenswrapper[4745]: I1204 11:37:30.863094 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5b826c3-8638-4cf5-b974-b24e4282ce00-serving-cert\") pod \"openshift-apiserver-operator-7bf7f6b755-sh6qf\" (UID: \"a5b826c3-8638-4cf5-b974-b24e4282ce00\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:37:30.863233 master-0 kubenswrapper[4745]: I1204 11:37:30.863203 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:30.867003 master-0 kubenswrapper[4745]: I1204 11:37:30.866927 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn"] Dec 04 11:37:30.868177 master-0 kubenswrapper[4745]: I1204 11:37:30.868137 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:30.870117 master-0 kubenswrapper[4745]: I1204 11:37:30.870072 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-olm-operator"/"cluster-olm-operator-serving-cert" Dec 04 11:37:30.870224 master-0 kubenswrapper[4745]: I1204 11:37:30.870140 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca-operator"/"serving-cert" Dec 04 11:37:30.871412 master-0 kubenswrapper[4745]: I1204 11:37:30.871358 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv"] Dec 04 11:37:30.872185 master-0 kubenswrapper[4745]: I1204 11:37:30.871476 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"openshift-service-ca.crt" Dec 04 11:37:30.872185 master-0 kubenswrapper[4745]: I1204 11:37:30.871839 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"service-ca-operator-config" Dec 04 11:37:30.872185 master-0 kubenswrapper[4745]: I1204 11:37:30.871883 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-olm-operator"/"openshift-service-ca.crt" Dec 04 11:37:30.872941 master-0 kubenswrapper[4745]: I1204 11:37:30.872281 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-olm-operator"/"kube-root-ca.crt" Dec 04 11:37:30.872941 master-0 kubenswrapper[4745]: I1204 11:37:30.872378 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-serving-cert" Dec 04 11:37:30.872941 master-0 kubenswrapper[4745]: I1204 11:37:30.872398 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-service-ca.crt" Dec 04 11:37:30.872941 master-0 kubenswrapper[4745]: I1204 11:37:30.872407 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"node-tuning-operator-tls" Dec 04 11:37:30.872941 master-0 kubenswrapper[4745]: I1204 11:37:30.872457 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-operator-config" Dec 04 11:37:30.872941 master-0 kubenswrapper[4745]: I1204 11:37:30.872549 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-client" Dec 04 11:37:30.872941 master-0 kubenswrapper[4745]: I1204 11:37:30.872687 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"performance-addon-operator-webhook-cert" Dec 04 11:37:30.872941 master-0 kubenswrapper[4745]: I1204 11:37:30.872897 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-config-operator"/"config-operator-serving-cert" Dec 04 11:37:30.872941 master-0 kubenswrapper[4745]: I1204 11:37:30.872952 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-operator-serving-cert" Dec 04 11:37:30.874203 master-0 kubenswrapper[4745]: I1204 11:37:30.873187 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"service-ca-bundle" Dec 04 11:37:30.874203 master-0 kubenswrapper[4745]: I1204 11:37:30.874009 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"openshift-service-ca.crt" Dec 04 11:37:30.874203 master-0 kubenswrapper[4745]: I1204 11:37:30.874038 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:37:30.874338 master-0 kubenswrapper[4745]: I1204 11:37:30.874306 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-config" Dec 04 11:37:30.883650 master-0 kubenswrapper[4745]: I1204 11:37:30.879300 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-serving-cert" Dec 04 11:37:30.883650 master-0 kubenswrapper[4745]: I1204 11:37:30.879746 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns-operator"/"metrics-tls" Dec 04 11:37:30.883650 master-0 kubenswrapper[4745]: I1204 11:37:30.880244 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"telemetry-config" Dec 04 11:37:30.883650 master-0 kubenswrapper[4745]: I1204 11:37:30.880251 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"authentication-operator-config" Dec 04 11:37:30.886239 master-0 kubenswrapper[4745]: I1204 11:37:30.883766 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl"] Dec 04 11:37:30.887026 master-0 kubenswrapper[4745]: I1204 11:37:30.880397 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"kube-root-ca.crt" Dec 04 11:37:30.887026 master-0 kubenswrapper[4745]: I1204 11:37:30.880431 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication-operator"/"serving-cert" Dec 04 11:37:30.887399 master-0 kubenswrapper[4745]: I1204 11:37:30.880462 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"cluster-monitoring-operator-tls" Dec 04 11:37:30.887399 master-0 kubenswrapper[4745]: I1204 11:37:30.880574 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-service-ca-bundle" Dec 04 11:37:30.887399 master-0 kubenswrapper[4745]: I1204 11:37:30.880663 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"openshift-service-ca.crt" Dec 04 11:37:30.887399 master-0 kubenswrapper[4745]: I1204 11:37:30.880774 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"openshift-service-ca.crt" Dec 04 11:37:30.887549 master-0 kubenswrapper[4745]: I1204 11:37:30.880932 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-config" Dec 04 11:37:30.887549 master-0 kubenswrapper[4745]: I1204 11:37:30.880971 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"kube-root-ca.crt" Dec 04 11:37:30.887633 master-0 kubenswrapper[4745]: I1204 11:37:30.881056 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"kube-root-ca.crt" Dec 04 11:37:30.887727 master-0 kubenswrapper[4745]: I1204 11:37:30.881193 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"kube-root-ca.crt" Dec 04 11:37:30.887727 master-0 kubenswrapper[4745]: I1204 11:37:30.881244 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"openshift-service-ca.crt" Dec 04 11:37:30.887833 master-0 kubenswrapper[4745]: I1204 11:37:30.881274 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kube-root-ca.crt" Dec 04 11:37:30.887833 master-0 kubenswrapper[4745]: I1204 11:37:30.881316 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"kube-root-ca.crt" Dec 04 11:37:30.887833 master-0 kubenswrapper[4745]: I1204 11:37:30.881255 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"openshift-service-ca.crt" Dec 04 11:37:30.887960 master-0 kubenswrapper[4745]: I1204 11:37:30.881364 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-ca-bundle" Dec 04 11:37:30.887960 master-0 kubenswrapper[4745]: I1204 11:37:30.881570 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"kube-root-ca.crt" Dec 04 11:37:30.888041 master-0 kubenswrapper[4745]: I1204 11:37:30.881901 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-root-ca.crt" Dec 04 11:37:30.888121 master-0 kubenswrapper[4745]: I1204 11:37:30.882322 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"kube-root-ca.crt" Dec 04 11:37:30.890624 master-0 kubenswrapper[4745]: I1204 11:37:30.890568 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:30.890730 master-0 kubenswrapper[4745]: I1204 11:37:30.890644 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-ingress-operator/ingress-operator-8649c48786-cx2b2"] Dec 04 11:37:30.891369 master-0 kubenswrapper[4745]: I1204 11:37:30.891328 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:30.892103 master-0 kubenswrapper[4745]: I1204 11:37:30.892035 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf"] Dec 04 11:37:30.892428 master-0 kubenswrapper[4745]: I1204 11:37:30.892355 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-scheduler-operator"/"kube-scheduler-operator-serving-cert" Dec 04 11:37:30.892655 master-0 kubenswrapper[4745]: I1204 11:37:30.892618 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:37:30.892995 master-0 kubenswrapper[4745]: I1204 11:37:30.892935 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/marketplace-operator-f797b99b6-hjjrk"] Dec 04 11:37:30.893167 master-0 kubenswrapper[4745]: I1204 11:37:30.892949 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"openshift-kube-scheduler-operator-config" Dec 04 11:37:30.893305 master-0 kubenswrapper[4745]: I1204 11:37:30.893267 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"kube-root-ca.crt" Dec 04 11:37:30.893571 master-0 kubenswrapper[4745]: I1204 11:37:30.893506 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:30.894531 master-0 kubenswrapper[4745]: I1204 11:37:30.894007 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll"] Dec 04 11:37:30.895735 master-0 kubenswrapper[4745]: I1204 11:37:30.894576 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q"] Dec 04 11:37:30.895735 master-0 kubenswrapper[4745]: I1204 11:37:30.894795 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:30.895735 master-0 kubenswrapper[4745]: I1204 11:37:30.895009 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:30.898048 master-0 kubenswrapper[4745]: I1204 11:37:30.896475 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"kube-root-ca.crt" Dec 04 11:37:30.898048 master-0 kubenswrapper[4745]: I1204 11:37:30.896898 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"openshift-service-ca.crt" Dec 04 11:37:30.898048 master-0 kubenswrapper[4745]: I1204 11:37:30.897294 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"kube-root-ca.crt" Dec 04 11:37:30.898048 master-0 kubenswrapper[4745]: I1204 11:37:30.897417 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"openshift-service-ca.crt" Dec 04 11:37:30.899972 master-0 kubenswrapper[4745]: I1204 11:37:30.898171 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"marketplace-operator-metrics" Dec 04 11:37:30.899972 master-0 kubenswrapper[4745]: I1204 11:37:30.898754 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"kube-root-ca.crt" Dec 04 11:37:30.899972 master-0 kubenswrapper[4745]: I1204 11:37:30.898865 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"openshift-service-ca.crt" Dec 04 11:37:30.899972 master-0 kubenswrapper[4745]: I1204 11:37:30.898989 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"package-server-manager-serving-cert" Dec 04 11:37:30.899972 master-0 kubenswrapper[4745]: I1204 11:37:30.899094 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"catalog-operator-serving-cert" Dec 04 11:37:30.899972 master-0 kubenswrapper[4745]: I1204 11:37:30.899143 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg"] Dec 04 11:37:30.899972 master-0 kubenswrapper[4745]: I1204 11:37:30.899313 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"image-registry-operator-tls" Dec 04 11:37:30.899972 master-0 kubenswrapper[4745]: I1204 11:37:30.899622 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:37:30.900993 master-0 kubenswrapper[4745]: I1204 11:37:30.900439 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"openshift-service-ca.crt" Dec 04 11:37:30.900993 master-0 kubenswrapper[4745]: I1204 11:37:30.900515 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-operator"/"metrics-tls" Dec 04 11:37:30.900993 master-0 kubenswrapper[4745]: I1204 11:37:30.900644 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"kube-root-ca.crt" Dec 04 11:37:30.900993 master-0 kubenswrapper[4745]: I1204 11:37:30.900939 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw"] Dec 04 11:37:30.905751 master-0 kubenswrapper[4745]: I1204 11:37:30.901285 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:37:30.905751 master-0 kubenswrapper[4745]: I1204 11:37:30.901709 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-admission-controller-7dfc5b745f-258xq"] Dec 04 11:37:30.905751 master-0 kubenswrapper[4745]: I1204 11:37:30.902388 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:37:30.905751 master-0 kubenswrapper[4745]: I1204 11:37:30.904406 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"pprof-cert" Dec 04 11:37:30.905751 master-0 kubenswrapper[4745]: I1204 11:37:30.905064 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"olm-operator-serving-cert" Dec 04 11:37:30.905751 master-0 kubenswrapper[4745]: I1204 11:37:30.905588 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-root-ca.crt" Dec 04 11:37:30.905751 master-0 kubenswrapper[4745]: I1204 11:37:30.905596 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"config" Dec 04 11:37:30.909154 master-0 kubenswrapper[4745]: I1204 11:37:30.906211 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"openshift-service-ca.crt" Dec 04 11:37:30.909154 master-0 kubenswrapper[4745]: I1204 11:37:30.906397 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-storage-version-migrator-operator"/"serving-cert" Dec 04 11:37:30.909154 master-0 kubenswrapper[4745]: I1204 11:37:30.906464 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-config" Dec 04 11:37:30.909154 master-0 kubenswrapper[4745]: I1204 11:37:30.906787 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"multus-admission-controller-secret" Dec 04 11:37:30.909154 master-0 kubenswrapper[4745]: I1204 11:37:30.907023 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"kube-root-ca.crt" Dec 04 11:37:30.909154 master-0 kubenswrapper[4745]: I1204 11:37:30.908987 4745 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-serving-cert" Dec 04 11:37:30.912172 master-0 kubenswrapper[4745]: I1204 11:37:30.912000 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"trusted-ca-bundle" Dec 04 11:37:30.913821 master-0 kubenswrapper[4745]: I1204 11:37:30.913439 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"trusted-ca" Dec 04 11:37:30.915400 master-0 kubenswrapper[4745]: I1204 11:37:30.915344 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"trusted-ca" Dec 04 11:37:30.921672 master-0 kubenswrapper[4745]: I1204 11:37:30.921019 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"trusted-ca" Dec 04 11:37:30.922916 master-0 kubenswrapper[4745]: I1204 11:37:30.922204 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"marketplace-trusted-ca" Dec 04 11:37:30.956310 master-0 kubenswrapper[4745]: I1204 11:37:30.956254 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkjzz\" (UniqueName: \"kubernetes.io/projected/6f15dcdb-c968-429c-9d1d-63c2becad337-kube-api-access-kkjzz\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:30.956416 master-0 kubenswrapper[4745]: I1204 11:37:30.956314 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2ab26ae5-0607-4dfd-840e-531d204b5030-telemetry-config\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:30.956449 master-0 kubenswrapper[4745]: I1204 11:37:30.956406 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k449s\" (UniqueName: \"kubernetes.io/projected/3322cc5a-f1f7-4522-b423-19fb7f38cd43-kube-api-access-k449s\") pod \"openshift-controller-manager-operator-6c8676f99d-7z948\" (UID: \"3322cc5a-f1f7-4522-b423-19fb7f38cd43\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:37:30.956477 master-0 kubenswrapper[4745]: I1204 11:37:30.956455 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj4dt\" (UniqueName: \"kubernetes.io/projected/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-kube-api-access-rj4dt\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:30.956700 master-0 kubenswrapper[4745]: I1204 11:37:30.956490 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggzfm\" (UniqueName: \"kubernetes.io/projected/434ed9b9-715b-455b-867c-775b256df40f-kube-api-access-ggzfm\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:30.956700 master-0 kubenswrapper[4745]: I1204 11:37:30.956516 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-config\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:30.956700 master-0 kubenswrapper[4745]: I1204 11:37:30.956580 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b011b1f1-3235-4e20-825b-ce711c052407-trusted-ca\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:30.956700 master-0 kubenswrapper[4745]: I1204 11:37:30.956613 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-profile-collector-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:30.956700 master-0 kubenswrapper[4745]: I1204 11:37:30.956650 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llscb\" (UniqueName: \"kubernetes.io/projected/fd9f8671-8066-4990-b45d-8b619aa5d9ec-kube-api-access-llscb\") pod \"kube-storage-version-migrator-operator-b9c5dfc78-dcxkw\" (UID: \"fd9f8671-8066-4990-b45d-8b619aa5d9ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:37:30.956847 master-0 kubenswrapper[4745]: I1204 11:37:30.956703 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cxbd\" (UniqueName: \"kubernetes.io/projected/0158c2f3-20e5-43f4-875d-c5ad8f6112df-kube-api-access-8cxbd\") pod \"cluster-olm-operator-56fcb6cc5f-4xwp2\" (UID: \"0158c2f3-20e5-43f4-875d-c5ad8f6112df\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:37:30.956847 master-0 kubenswrapper[4745]: I1204 11:37:30.956737 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bac00ac5-0371-48fd-b1cc-60438f08ae94-config\") pod \"kube-controller-manager-operator-848f645654-7hmhg\" (UID: \"bac00ac5-0371-48fd-b1cc-60438f08ae94\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:37:30.956847 master-0 kubenswrapper[4745]: I1204 11:37:30.956767 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:30.956847 master-0 kubenswrapper[4745]: I1204 11:37:30.956795 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:30.956847 master-0 kubenswrapper[4745]: I1204 11:37:30.956844 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-trusted-ca-bundle\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:30.956979 master-0 kubenswrapper[4745]: I1204 11:37:30.956865 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-service-ca-bundle\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:30.956979 master-0 kubenswrapper[4745]: I1204 11:37:30.956952 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7xwd\" (UniqueName: \"kubernetes.io/projected/42b3be0f-1d82-4a64-abb4-0118a6960efd-kube-api-access-c7xwd\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:30.957034 master-0 kubenswrapper[4745]: I1204 11:37:30.956999 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3322cc5a-f1f7-4522-b423-19fb7f38cd43-config\") pod \"openshift-controller-manager-operator-6c8676f99d-7z948\" (UID: \"3322cc5a-f1f7-4522-b423-19fb7f38cd43\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:37:30.957065 master-0 kubenswrapper[4745]: I1204 11:37:30.957033 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccf81538-4d5a-4c26-8e54-fe39331a625d-config\") pod \"kube-apiserver-operator-765d9ff747-gr68k\" (UID: \"ccf81538-4d5a-4c26-8e54-fe39331a625d\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:37:30.957065 master-0 kubenswrapper[4745]: I1204 11:37:30.957060 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvzrc\" (UniqueName: \"kubernetes.io/projected/2ab26ae5-0607-4dfd-840e-531d204b5030-kube-api-access-mvzrc\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:30.957121 master-0 kubenswrapper[4745]: I1204 11:37:30.957093 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fd9f8671-8066-4990-b45d-8b619aa5d9ec-serving-cert\") pod \"kube-storage-version-migrator-operator-b9c5dfc78-dcxkw\" (UID: \"fd9f8671-8066-4990-b45d-8b619aa5d9ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:37:30.957191 master-0 kubenswrapper[4745]: I1204 11:37:30.957156 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ccf81538-4d5a-4c26-8e54-fe39331a625d-serving-cert\") pod \"kube-apiserver-operator-765d9ff747-gr68k\" (UID: \"ccf81538-4d5a-4c26-8e54-fe39331a625d\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:37:30.957275 master-0 kubenswrapper[4745]: I1204 11:37:30.957239 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f15dcdb-c968-429c-9d1d-63c2becad337-trusted-ca\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:30.957307 master-0 kubenswrapper[4745]: I1204 11:37:30.957290 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42b3be0f-1d82-4a64-abb4-0118a6960efd-serving-cert\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:30.957339 master-0 kubenswrapper[4745]: I1204 11:37:30.957323 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/00601c1a-efd4-4366-bdc9-d768afa252b0-available-featuregates\") pod \"openshift-config-operator-68758cbcdb-zh8g5\" (UID: \"00601c1a-efd4-4366-bdc9-d768afa252b0\") " pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:37:30.957366 master-0 kubenswrapper[4745]: I1204 11:37:30.957355 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6e9271a-44ea-4612-ab60-4a9d489ed062-serving-cert\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:30.957482 master-0 kubenswrapper[4745]: I1204 11:37:30.957443 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:37:30.957517 master-0 kubenswrapper[4745]: I1204 11:37:30.957484 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckwnn\" (UniqueName: \"kubernetes.io/projected/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-kube-api-access-ckwnn\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:37:30.957517 master-0 kubenswrapper[4745]: I1204 11:37:30.957506 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t46k7\" (UniqueName: \"kubernetes.io/projected/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-kube-api-access-t46k7\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:30.957596 master-0 kubenswrapper[4745]: I1204 11:37:30.957567 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-serving-cert\") pod \"service-ca-operator-77758bc754-8smqn\" (UID: \"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8\") " pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:37:30.957660 master-0 kubenswrapper[4745]: I1204 11:37:30.957605 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlr76\" (UniqueName: \"kubernetes.io/projected/7c017c69-b24e-4a7a-b888-133bed34c174-kube-api-access-tlr76\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:37:30.957660 master-0 kubenswrapper[4745]: I1204 11:37:30.957623 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:30.957660 master-0 kubenswrapper[4745]: I1204 11:37:30.957649 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27576028-d64a-47cd-b76b-d524e41efe37-config\") pod \"openshift-kube-scheduler-operator-5f85974995-g4rwv\" (UID: \"27576028-d64a-47cd-b76b-d524e41efe37\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:37:30.957899 master-0 kubenswrapper[4745]: I1204 11:37:30.957677 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cffn\" (UniqueName: \"kubernetes.io/projected/08550069-c1a1-475e-84a2-e56905f1ed38-kube-api-access-8cffn\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:37:30.957899 master-0 kubenswrapper[4745]: I1204 11:37:30.957702 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g7bh\" (UniqueName: \"kubernetes.io/projected/00601c1a-efd4-4366-bdc9-d768afa252b0-kube-api-access-2g7bh\") pod \"openshift-config-operator-68758cbcdb-zh8g5\" (UID: \"00601c1a-efd4-4366-bdc9-d768afa252b0\") " pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:37:30.957899 master-0 kubenswrapper[4745]: I1204 11:37:30.957722 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b011b1f1-3235-4e20-825b-ce711c052407-bound-sa-token\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:30.957899 master-0 kubenswrapper[4745]: I1204 11:37:30.957765 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-client\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:30.957899 master-0 kubenswrapper[4745]: I1204 11:37:30.957838 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/ccf81538-4d5a-4c26-8e54-fe39331a625d-kube-api-access\") pod \"kube-apiserver-operator-765d9ff747-gr68k\" (UID: \"ccf81538-4d5a-4c26-8e54-fe39331a625d\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:37:30.957899 master-0 kubenswrapper[4745]: I1204 11:37:30.957882 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bac00ac5-0371-48fd-b1cc-60438f08ae94-serving-cert\") pod \"kube-controller-manager-operator-848f645654-7hmhg\" (UID: \"bac00ac5-0371-48fd-b1cc-60438f08ae94\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:37:30.958062 master-0 kubenswrapper[4745]: I1204 11:37:30.957905 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-bound-sa-token\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:30.958062 master-0 kubenswrapper[4745]: I1204 11:37:30.957935 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:30.958062 master-0 kubenswrapper[4745]: I1204 11:37:30.957962 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-trusted-ca\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:30.958062 master-0 kubenswrapper[4745]: I1204 11:37:30.957987 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/27576028-d64a-47cd-b76b-d524e41efe37-kube-api-access\") pod \"openshift-kube-scheduler-operator-5f85974995-g4rwv\" (UID: \"27576028-d64a-47cd-b76b-d524e41efe37\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:37:30.958062 master-0 kubenswrapper[4745]: I1204 11:37:30.958012 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-profile-collector-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:30.958193 master-0 kubenswrapper[4745]: I1204 11:37:30.958108 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00601c1a-efd4-4366-bdc9-d768afa252b0-serving-cert\") pod \"openshift-config-operator-68758cbcdb-zh8g5\" (UID: \"00601c1a-efd4-4366-bdc9-d768afa252b0\") " pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:37:30.958193 master-0 kubenswrapper[4745]: I1204 11:37:30.958159 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq49f\" (UniqueName: \"kubernetes.io/projected/b011b1f1-3235-4e20-825b-ce711c052407-kube-api-access-jq49f\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:30.958193 master-0 kubenswrapper[4745]: I1204 11:37:30.958183 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-service-ca\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:30.958341 master-0 kubenswrapper[4745]: I1204 11:37:30.958223 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr454\" (UniqueName: \"kubernetes.io/projected/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-kube-api-access-zr454\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:30.958341 master-0 kubenswrapper[4745]: I1204 11:37:30.958244 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:37:30.958341 master-0 kubenswrapper[4745]: I1204 11:37:30.958277 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/bac00ac5-0371-48fd-b1cc-60438f08ae94-kube-api-access\") pod \"kube-controller-manager-operator-848f645654-7hmhg\" (UID: \"bac00ac5-0371-48fd-b1cc-60438f08ae94\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:37:30.958341 master-0 kubenswrapper[4745]: I1204 11:37:30.958304 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-olm-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/0158c2f3-20e5-43f4-875d-c5ad8f6112df-cluster-olm-operator-serving-cert\") pod \"cluster-olm-operator-56fcb6cc5f-4xwp2\" (UID: \"0158c2f3-20e5-43f4-875d-c5ad8f6112df\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:37:30.958341 master-0 kubenswrapper[4745]: I1204 11:37:30.958328 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:30.958463 master-0 kubenswrapper[4745]: I1204 11:37:30.958348 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-config\") pod \"service-ca-operator-77758bc754-8smqn\" (UID: \"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8\") " pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:37:30.958463 master-0 kubenswrapper[4745]: I1204 11:37:30.958368 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operand-assets\" (UniqueName: \"kubernetes.io/empty-dir/0158c2f3-20e5-43f4-875d-c5ad8f6112df-operand-assets\") pod \"cluster-olm-operator-56fcb6cc5f-4xwp2\" (UID: \"0158c2f3-20e5-43f4-875d-c5ad8f6112df\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:37:30.958463 master-0 kubenswrapper[4745]: I1204 11:37:30.958389 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27576028-d64a-47cd-b76b-d524e41efe37-serving-cert\") pod \"openshift-kube-scheduler-operator-5f85974995-g4rwv\" (UID: \"27576028-d64a-47cd-b76b-d524e41efe37\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:37:30.958463 master-0 kubenswrapper[4745]: I1204 11:37:30.958446 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6bhm\" (UniqueName: \"kubernetes.io/projected/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-kube-api-access-n6bhm\") pod \"service-ca-operator-77758bc754-8smqn\" (UID: \"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8\") " pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:37:30.958563 master-0 kubenswrapper[4745]: I1204 11:37:30.958479 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:30.958563 master-0 kubenswrapper[4745]: I1204 11:37:30.958501 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-config\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:30.958563 master-0 kubenswrapper[4745]: I1204 11:37:30.958524 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:30.958563 master-0 kubenswrapper[4745]: I1204 11:37:30.958554 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:30.958658 master-0 kubenswrapper[4745]: I1204 11:37:30.958582 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdsq5\" (UniqueName: \"kubernetes.io/projected/c6e9271a-44ea-4612-ab60-4a9d489ed062-kube-api-access-cdsq5\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:30.958658 master-0 kubenswrapper[4745]: I1204 11:37:30.958603 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fd9f8671-8066-4990-b45d-8b619aa5d9ec-config\") pod \"kube-storage-version-migrator-operator-b9c5dfc78-dcxkw\" (UID: \"fd9f8671-8066-4990-b45d-8b619aa5d9ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:37:30.958658 master-0 kubenswrapper[4745]: I1204 11:37:30.958625 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-ca\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:30.958658 master-0 kubenswrapper[4745]: I1204 11:37:30.958647 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3322cc5a-f1f7-4522-b423-19fb7f38cd43-serving-cert\") pod \"openshift-controller-manager-operator-6c8676f99d-7z948\" (UID: \"3322cc5a-f1f7-4522-b423-19fb7f38cd43\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:37:30.958831 master-0 kubenswrapper[4745]: I1204 11:37:30.958682 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:37:30.958831 master-0 kubenswrapper[4745]: I1204 11:37:30.958705 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-trusted-ca\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:31.060284 master-0 kubenswrapper[4745]: I1204 11:37:31.060204 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:31.060386 master-0 kubenswrapper[4745]: E1204 11:37:31.060356 4745 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-operator-tls: secret "image-registry-operator-tls" not found Dec 04 11:37:31.060386 master-0 kubenswrapper[4745]: I1204 11:37:31.060375 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/bac00ac5-0371-48fd-b1cc-60438f08ae94-kube-api-access\") pod \"kube-controller-manager-operator-848f645654-7hmhg\" (UID: \"bac00ac5-0371-48fd-b1cc-60438f08ae94\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:37:31.060460 master-0 kubenswrapper[4745]: I1204 11:37:31.060406 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-olm-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/0158c2f3-20e5-43f4-875d-c5ad8f6112df-cluster-olm-operator-serving-cert\") pod \"cluster-olm-operator-56fcb6cc5f-4xwp2\" (UID: \"0158c2f3-20e5-43f4-875d-c5ad8f6112df\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:37:31.060460 master-0 kubenswrapper[4745]: E1204 11:37:31.060425 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls podName:1ade9186-b262-4b5e-9c6f-ba89f0130fb6 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:31.560406684 +0000 UTC m=+137.262395079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "image-registry-operator-tls" (UniqueName: "kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls") pod "cluster-image-registry-operator-6fb9f88b7-tgvfl" (UID: "1ade9186-b262-4b5e-9c6f-ba89f0130fb6") : secret "image-registry-operator-tls" not found Dec 04 11:37:31.060518 master-0 kubenswrapper[4745]: I1204 11:37:31.060461 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27576028-d64a-47cd-b76b-d524e41efe37-serving-cert\") pod \"openshift-kube-scheduler-operator-5f85974995-g4rwv\" (UID: \"27576028-d64a-47cd-b76b-d524e41efe37\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:37:31.060518 master-0 kubenswrapper[4745]: I1204 11:37:31.060492 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-config\") pod \"service-ca-operator-77758bc754-8smqn\" (UID: \"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8\") " pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:37:31.060518 master-0 kubenswrapper[4745]: I1204 11:37:31.060511 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operand-assets\" (UniqueName: \"kubernetes.io/empty-dir/0158c2f3-20e5-43f4-875d-c5ad8f6112df-operand-assets\") pod \"cluster-olm-operator-56fcb6cc5f-4xwp2\" (UID: \"0158c2f3-20e5-43f4-875d-c5ad8f6112df\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:37:31.060600 master-0 kubenswrapper[4745]: I1204 11:37:31.060534 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n6bhm\" (UniqueName: \"kubernetes.io/projected/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-kube-api-access-n6bhm\") pod \"service-ca-operator-77758bc754-8smqn\" (UID: \"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8\") " pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:37:31.060600 master-0 kubenswrapper[4745]: I1204 11:37:31.060557 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:31.060600 master-0 kubenswrapper[4745]: I1204 11:37:31.060576 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-config\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:31.060600 master-0 kubenswrapper[4745]: I1204 11:37:31.060597 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:31.060701 master-0 kubenswrapper[4745]: I1204 11:37:31.060620 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:31.060701 master-0 kubenswrapper[4745]: I1204 11:37:31.060640 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-ca\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:31.060701 master-0 kubenswrapper[4745]: I1204 11:37:31.060660 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cdsq5\" (UniqueName: \"kubernetes.io/projected/c6e9271a-44ea-4612-ab60-4a9d489ed062-kube-api-access-cdsq5\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:31.060701 master-0 kubenswrapper[4745]: I1204 11:37:31.060679 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fd9f8671-8066-4990-b45d-8b619aa5d9ec-config\") pod \"kube-storage-version-migrator-operator-b9c5dfc78-dcxkw\" (UID: \"fd9f8671-8066-4990-b45d-8b619aa5d9ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:37:31.060701 master-0 kubenswrapper[4745]: I1204 11:37:31.060698 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-trusted-ca\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:31.060849 master-0 kubenswrapper[4745]: I1204 11:37:31.060718 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3322cc5a-f1f7-4522-b423-19fb7f38cd43-serving-cert\") pod \"openshift-controller-manager-operator-6c8676f99d-7z948\" (UID: \"3322cc5a-f1f7-4522-b423-19fb7f38cd43\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:37:31.060849 master-0 kubenswrapper[4745]: I1204 11:37:31.060740 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:37:31.060849 master-0 kubenswrapper[4745]: I1204 11:37:31.060758 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k449s\" (UniqueName: \"kubernetes.io/projected/3322cc5a-f1f7-4522-b423-19fb7f38cd43-kube-api-access-k449s\") pod \"openshift-controller-manager-operator-6c8676f99d-7z948\" (UID: \"3322cc5a-f1f7-4522-b423-19fb7f38cd43\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:37:31.061043 master-0 kubenswrapper[4745]: I1204 11:37:31.060972 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rj4dt\" (UniqueName: \"kubernetes.io/projected/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-kube-api-access-rj4dt\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:31.062468 master-0 kubenswrapper[4745]: I1204 11:37:31.061067 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kkjzz\" (UniqueName: \"kubernetes.io/projected/6f15dcdb-c968-429c-9d1d-63c2becad337-kube-api-access-kkjzz\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:31.062468 master-0 kubenswrapper[4745]: E1204 11:37:31.061318 4745 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/package-server-manager-serving-cert: secret "package-server-manager-serving-cert" not found Dec 04 11:37:31.062468 master-0 kubenswrapper[4745]: E1204 11:37:31.061340 4745 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Dec 04 11:37:31.062468 master-0 kubenswrapper[4745]: E1204 11:37:31.061350 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert podName:72faf6d6-e8ca-43d1-b93e-67c11f8d3b46 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:31.561341254 +0000 UTC m=+137.263329649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "package-server-manager-serving-cert" (UniqueName: "kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert") pod "package-server-manager-67477646d4-7hndf" (UID: "72faf6d6-e8ca-43d1-b93e-67c11f8d3b46") : secret "package-server-manager-serving-cert" not found Dec 04 11:37:31.062468 master-0 kubenswrapper[4745]: I1204 11:37:31.061520 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2ab26ae5-0607-4dfd-840e-531d204b5030-telemetry-config\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:31.062468 master-0 kubenswrapper[4745]: E1204 11:37:31.061558 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls podName:2ab26ae5-0607-4dfd-840e-531d204b5030 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:31.561545181 +0000 UTC m=+137.263533576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-7ff994598c-p82nn" (UID: "2ab26ae5-0607-4dfd-840e-531d204b5030") : secret "cluster-monitoring-operator-tls" not found Dec 04 11:37:31.062468 master-0 kubenswrapper[4745]: E1204 11:37:31.062022 4745 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/olm-operator-serving-cert: secret "olm-operator-serving-cert" not found Dec 04 11:37:31.062468 master-0 kubenswrapper[4745]: E1204 11:37:31.062068 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert podName:7bf67a51-9759-4e2a-a2ae-ef7416cad43f nodeName:}" failed. No retries permitted until 2025-12-04 11:37:31.562053276 +0000 UTC m=+137.264041671 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert") pod "olm-operator-7cd7dbb44c-vzj4q" (UID: "7bf67a51-9759-4e2a-a2ae-ef7416cad43f") : secret "olm-operator-serving-cert" not found Dec 04 11:37:31.062468 master-0 kubenswrapper[4745]: I1204 11:37:31.062310 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-ca\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:31.062468 master-0 kubenswrapper[4745]: I1204 11:37:31.062456 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operand-assets\" (UniqueName: \"kubernetes.io/empty-dir/0158c2f3-20e5-43f4-875d-c5ad8f6112df-operand-assets\") pod \"cluster-olm-operator-56fcb6cc5f-4xwp2\" (UID: \"0158c2f3-20e5-43f4-875d-c5ad8f6112df\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:37:31.062468 master-0 kubenswrapper[4745]: I1204 11:37:31.062493 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2ab26ae5-0607-4dfd-840e-531d204b5030-telemetry-config\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:31.062949 master-0 kubenswrapper[4745]: E1204 11:37:31.062501 4745 secret.go:189] Couldn't get secret openshift-ingress-operator/metrics-tls: secret "metrics-tls" not found Dec 04 11:37:31.062949 master-0 kubenswrapper[4745]: E1204 11:37:31.062549 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls podName:b011b1f1-3235-4e20-825b-ce711c052407 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:31.562537652 +0000 UTC m=+137.264526147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls") pod "ingress-operator-8649c48786-cx2b2" (UID: "b011b1f1-3235-4e20-825b-ce711c052407") : secret "metrics-tls" not found Dec 04 11:37:31.062949 master-0 kubenswrapper[4745]: I1204 11:37:31.062581 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fd9f8671-8066-4990-b45d-8b619aa5d9ec-config\") pod \"kube-storage-version-migrator-operator-b9c5dfc78-dcxkw\" (UID: \"fd9f8671-8066-4990-b45d-8b619aa5d9ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:37:31.062949 master-0 kubenswrapper[4745]: I1204 11:37:31.062645 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-trusted-ca\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:31.063269 master-0 kubenswrapper[4745]: I1204 11:37:31.063152 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-config\") pod \"service-ca-operator-77758bc754-8smqn\" (UID: \"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8\") " pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:37:31.063697 master-0 kubenswrapper[4745]: I1204 11:37:31.063647 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-config\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:31.063897 master-0 kubenswrapper[4745]: I1204 11:37:31.063853 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b011b1f1-3235-4e20-825b-ce711c052407-trusted-ca\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:31.064143 master-0 kubenswrapper[4745]: I1204 11:37:31.064099 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ggzfm\" (UniqueName: \"kubernetes.io/projected/434ed9b9-715b-455b-867c-775b256df40f-kube-api-access-ggzfm\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:31.064213 master-0 kubenswrapper[4745]: I1204 11:37:31.064155 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-config\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:31.064213 master-0 kubenswrapper[4745]: I1204 11:37:31.064190 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-profile-collector-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:31.064268 master-0 kubenswrapper[4745]: I1204 11:37:31.064213 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-llscb\" (UniqueName: \"kubernetes.io/projected/fd9f8671-8066-4990-b45d-8b619aa5d9ec-kube-api-access-llscb\") pod \"kube-storage-version-migrator-operator-b9c5dfc78-dcxkw\" (UID: \"fd9f8671-8066-4990-b45d-8b619aa5d9ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:37:31.064300 master-0 kubenswrapper[4745]: I1204 11:37:31.064283 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8cxbd\" (UniqueName: \"kubernetes.io/projected/0158c2f3-20e5-43f4-875d-c5ad8f6112df-kube-api-access-8cxbd\") pod \"cluster-olm-operator-56fcb6cc5f-4xwp2\" (UID: \"0158c2f3-20e5-43f4-875d-c5ad8f6112df\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:37:31.064329 master-0 kubenswrapper[4745]: I1204 11:37:31.064304 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27576028-d64a-47cd-b76b-d524e41efe37-serving-cert\") pod \"openshift-kube-scheduler-operator-5f85974995-g4rwv\" (UID: \"27576028-d64a-47cd-b76b-d524e41efe37\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:37:31.064364 master-0 kubenswrapper[4745]: I1204 11:37:31.064306 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:31.064394 master-0 kubenswrapper[4745]: I1204 11:37:31.064367 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-trusted-ca-bundle\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:31.064394 master-0 kubenswrapper[4745]: I1204 11:37:31.064390 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-service-ca-bundle\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:31.064453 master-0 kubenswrapper[4745]: I1204 11:37:31.064418 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bac00ac5-0371-48fd-b1cc-60438f08ae94-config\") pod \"kube-controller-manager-operator-848f645654-7hmhg\" (UID: \"bac00ac5-0371-48fd-b1cc-60438f08ae94\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:37:31.064453 master-0 kubenswrapper[4745]: E1204 11:37:31.064428 4745 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/node-tuning-operator-tls: secret "node-tuning-operator-tls" not found Dec 04 11:37:31.064453 master-0 kubenswrapper[4745]: I1204 11:37:31.064440 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:31.064535 master-0 kubenswrapper[4745]: I1204 11:37:31.064464 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c7xwd\" (UniqueName: \"kubernetes.io/projected/42b3be0f-1d82-4a64-abb4-0118a6960efd-kube-api-access-c7xwd\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:31.064535 master-0 kubenswrapper[4745]: E1204 11:37:31.064493 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls podName:6f15dcdb-c968-429c-9d1d-63c2becad337 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:31.564474955 +0000 UTC m=+137.266463350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-tuning-operator-tls" (UniqueName: "kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls") pod "cluster-node-tuning-operator-85cff47f46-4gv5j" (UID: "6f15dcdb-c968-429c-9d1d-63c2becad337") : secret "node-tuning-operator-tls" not found Dec 04 11:37:31.064535 master-0 kubenswrapper[4745]: I1204 11:37:31.064513 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3322cc5a-f1f7-4522-b423-19fb7f38cd43-config\") pod \"openshift-controller-manager-operator-6c8676f99d-7z948\" (UID: \"3322cc5a-f1f7-4522-b423-19fb7f38cd43\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:37:31.064646 master-0 kubenswrapper[4745]: I1204 11:37:31.064523 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cluster-olm-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/0158c2f3-20e5-43f4-875d-c5ad8f6112df-cluster-olm-operator-serving-cert\") pod \"cluster-olm-operator-56fcb6cc5f-4xwp2\" (UID: \"0158c2f3-20e5-43f4-875d-c5ad8f6112df\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:37:31.064646 master-0 kubenswrapper[4745]: I1204 11:37:31.064544 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccf81538-4d5a-4c26-8e54-fe39331a625d-config\") pod \"kube-apiserver-operator-765d9ff747-gr68k\" (UID: \"ccf81538-4d5a-4c26-8e54-fe39331a625d\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:37:31.064735 master-0 kubenswrapper[4745]: I1204 11:37:31.064647 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mvzrc\" (UniqueName: \"kubernetes.io/projected/2ab26ae5-0607-4dfd-840e-531d204b5030-kube-api-access-mvzrc\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:31.064735 master-0 kubenswrapper[4745]: I1204 11:37:31.064685 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fd9f8671-8066-4990-b45d-8b619aa5d9ec-serving-cert\") pod \"kube-storage-version-migrator-operator-b9c5dfc78-dcxkw\" (UID: \"fd9f8671-8066-4990-b45d-8b619aa5d9ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:37:31.064842 master-0 kubenswrapper[4745]: I1204 11:37:31.064742 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42b3be0f-1d82-4a64-abb4-0118a6960efd-serving-cert\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:31.064842 master-0 kubenswrapper[4745]: I1204 11:37:31.064778 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/00601c1a-efd4-4366-bdc9-d768afa252b0-available-featuregates\") pod \"openshift-config-operator-68758cbcdb-zh8g5\" (UID: \"00601c1a-efd4-4366-bdc9-d768afa252b0\") " pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:37:31.064842 master-0 kubenswrapper[4745]: I1204 11:37:31.064840 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6e9271a-44ea-4612-ab60-4a9d489ed062-serving-cert\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:31.064954 master-0 kubenswrapper[4745]: I1204 11:37:31.064867 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ccf81538-4d5a-4c26-8e54-fe39331a625d-serving-cert\") pod \"kube-apiserver-operator-765d9ff747-gr68k\" (UID: \"ccf81538-4d5a-4c26-8e54-fe39331a625d\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:37:31.064954 master-0 kubenswrapper[4745]: I1204 11:37:31.064913 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f15dcdb-c968-429c-9d1d-63c2becad337-trusted-ca\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:31.064954 master-0 kubenswrapper[4745]: I1204 11:37:31.064947 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:37:31.065063 master-0 kubenswrapper[4745]: I1204 11:37:31.064994 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ckwnn\" (UniqueName: \"kubernetes.io/projected/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-kube-api-access-ckwnn\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:37:31.065063 master-0 kubenswrapper[4745]: I1204 11:37:31.065019 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t46k7\" (UniqueName: \"kubernetes.io/projected/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-kube-api-access-t46k7\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:31.065131 master-0 kubenswrapper[4745]: I1204 11:37:31.065104 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tlr76\" (UniqueName: \"kubernetes.io/projected/7c017c69-b24e-4a7a-b888-133bed34c174-kube-api-access-tlr76\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:37:31.065131 master-0 kubenswrapper[4745]: I1204 11:37:31.065117 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-service-ca-bundle\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:31.065196 master-0 kubenswrapper[4745]: I1204 11:37:31.065150 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:31.065196 master-0 kubenswrapper[4745]: I1204 11:37:31.065178 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27576028-d64a-47cd-b76b-d524e41efe37-config\") pod \"openshift-kube-scheduler-operator-5f85974995-g4rwv\" (UID: \"27576028-d64a-47cd-b76b-d524e41efe37\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:37:31.065196 master-0 kubenswrapper[4745]: E1204 11:37:31.065186 4745 secret.go:189] Couldn't get secret openshift-marketplace/marketplace-operator-metrics: secret "marketplace-operator-metrics" not found Dec 04 11:37:31.065284 master-0 kubenswrapper[4745]: E1204 11:37:31.065215 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics podName:fd4c4c6f-380a-4cda-9a21-352b55ec2d98 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:31.565205397 +0000 UTC m=+137.267193792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "marketplace-operator-metrics" (UniqueName: "kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics") pod "marketplace-operator-f797b99b6-hjjrk" (UID: "fd4c4c6f-380a-4cda-9a21-352b55ec2d98") : secret "marketplace-operator-metrics" not found Dec 04 11:37:31.065284 master-0 kubenswrapper[4745]: I1204 11:37:31.065217 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccf81538-4d5a-4c26-8e54-fe39331a625d-config\") pod \"kube-apiserver-operator-765d9ff747-gr68k\" (UID: \"ccf81538-4d5a-4c26-8e54-fe39331a625d\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:37:31.065284 master-0 kubenswrapper[4745]: I1204 11:37:31.065231 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-serving-cert\") pod \"service-ca-operator-77758bc754-8smqn\" (UID: \"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8\") " pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:37:31.065284 master-0 kubenswrapper[4745]: I1204 11:37:31.065257 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8cffn\" (UniqueName: \"kubernetes.io/projected/08550069-c1a1-475e-84a2-e56905f1ed38-kube-api-access-8cffn\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:37:31.065284 master-0 kubenswrapper[4745]: I1204 11:37:31.065280 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b011b1f1-3235-4e20-825b-ce711c052407-bound-sa-token\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:31.065627 master-0 kubenswrapper[4745]: I1204 11:37:31.065590 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b011b1f1-3235-4e20-825b-ce711c052407-trusted-ca\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:31.066620 master-0 kubenswrapper[4745]: I1204 11:37:31.066586 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-client\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:31.066682 master-0 kubenswrapper[4745]: I1204 11:37:31.066633 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/ccf81538-4d5a-4c26-8e54-fe39331a625d-kube-api-access\") pod \"kube-apiserver-operator-765d9ff747-gr68k\" (UID: \"ccf81538-4d5a-4c26-8e54-fe39331a625d\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:37:31.066682 master-0 kubenswrapper[4745]: I1204 11:37:31.066671 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2g7bh\" (UniqueName: \"kubernetes.io/projected/00601c1a-efd4-4366-bdc9-d768afa252b0-kube-api-access-2g7bh\") pod \"openshift-config-operator-68758cbcdb-zh8g5\" (UID: \"00601c1a-efd4-4366-bdc9-d768afa252b0\") " pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:37:31.066746 master-0 kubenswrapper[4745]: I1204 11:37:31.066238 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27576028-d64a-47cd-b76b-d524e41efe37-config\") pod \"openshift-kube-scheduler-operator-5f85974995-g4rwv\" (UID: \"27576028-d64a-47cd-b76b-d524e41efe37\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:37:31.066746 master-0 kubenswrapper[4745]: I1204 11:37:31.066705 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bac00ac5-0371-48fd-b1cc-60438f08ae94-serving-cert\") pod \"kube-controller-manager-operator-848f645654-7hmhg\" (UID: \"bac00ac5-0371-48fd-b1cc-60438f08ae94\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:37:31.066857 master-0 kubenswrapper[4745]: I1204 11:37:31.066751 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-bound-sa-token\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:31.066857 master-0 kubenswrapper[4745]: I1204 11:37:31.066853 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:31.066988 master-0 kubenswrapper[4745]: I1204 11:37:31.066957 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-trusted-ca\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:31.067039 master-0 kubenswrapper[4745]: I1204 11:37:31.067017 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/27576028-d64a-47cd-b76b-d524e41efe37-kube-api-access\") pod \"openshift-kube-scheduler-operator-5f85974995-g4rwv\" (UID: \"27576028-d64a-47cd-b76b-d524e41efe37\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:37:31.067105 master-0 kubenswrapper[4745]: I1204 11:37:31.067052 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-profile-collector-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:31.067231 master-0 kubenswrapper[4745]: I1204 11:37:31.067113 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00601c1a-efd4-4366-bdc9-d768afa252b0-serving-cert\") pod \"openshift-config-operator-68758cbcdb-zh8g5\" (UID: \"00601c1a-efd4-4366-bdc9-d768afa252b0\") " pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:37:31.067231 master-0 kubenswrapper[4745]: I1204 11:37:31.067173 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jq49f\" (UniqueName: \"kubernetes.io/projected/b011b1f1-3235-4e20-825b-ce711c052407-kube-api-access-jq49f\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:31.067231 master-0 kubenswrapper[4745]: I1204 11:37:31.067183 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-trusted-ca-bundle\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:31.067621 master-0 kubenswrapper[4745]: I1204 11:37:31.067581 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-service-ca\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:31.067852 master-0 kubenswrapper[4745]: I1204 11:37:31.067795 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f15dcdb-c968-429c-9d1d-63c2becad337-trusted-ca\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:31.067975 master-0 kubenswrapper[4745]: E1204 11:37:31.067940 4745 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/performance-addon-operator-webhook-cert: secret "performance-addon-operator-webhook-cert" not found Dec 04 11:37:31.068043 master-0 kubenswrapper[4745]: E1204 11:37:31.068009 4745 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/catalog-operator-serving-cert: secret "catalog-operator-serving-cert" not found Dec 04 11:37:31.068113 master-0 kubenswrapper[4745]: E1204 11:37:31.068088 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert podName:6f15dcdb-c968-429c-9d1d-63c2becad337 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:31.568066999 +0000 UTC m=+137.270055624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert") pod "cluster-node-tuning-operator-85cff47f46-4gv5j" (UID: "6f15dcdb-c968-429c-9d1d-63c2becad337") : secret "performance-addon-operator-webhook-cert" not found Dec 04 11:37:31.068154 master-0 kubenswrapper[4745]: E1204 11:37:31.068121 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert podName:434ed9b9-715b-455b-867c-775b256df40f nodeName:}" failed. No retries permitted until 2025-12-04 11:37:31.568109151 +0000 UTC m=+137.270097776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert") pod "catalog-operator-fbc6455c4-5m8ll" (UID: "434ed9b9-715b-455b-867c-775b256df40f") : secret "catalog-operator-serving-cert" not found Dec 04 11:37:31.068154 master-0 kubenswrapper[4745]: I1204 11:37:31.067993 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zr454\" (UniqueName: \"kubernetes.io/projected/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-kube-api-access-zr454\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:31.068228 master-0 kubenswrapper[4745]: I1204 11:37:31.068199 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:37:31.068501 master-0 kubenswrapper[4745]: I1204 11:37:31.068466 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-config\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:31.068501 master-0 kubenswrapper[4745]: E1204 11:37:31.068487 4745 secret.go:189] Couldn't get secret openshift-dns-operator/metrics-tls: secret "metrics-tls" not found Dec 04 11:37:31.068574 master-0 kubenswrapper[4745]: E1204 11:37:31.068529 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls podName:7c017c69-b24e-4a7a-b888-133bed34c174 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:31.568519084 +0000 UTC m=+137.270507479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls") pod "dns-operator-7c56cf9b74-xz27r" (UID: "7c017c69-b24e-4a7a-b888-133bed34c174") : secret "metrics-tls" not found Dec 04 11:37:31.068674 master-0 kubenswrapper[4745]: E1204 11:37:31.068650 4745 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: secret "multus-admission-controller-secret" not found Dec 04 11:37:31.068716 master-0 kubenswrapper[4745]: E1204 11:37:31.068689 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs podName:08550069-c1a1-475e-84a2-e56905f1ed38 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:31.568679569 +0000 UTC m=+137.270668184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs") pod "multus-admission-controller-7dfc5b745f-258xq" (UID: "08550069-c1a1-475e-84a2-e56905f1ed38") : secret "multus-admission-controller-secret" not found Dec 04 11:37:31.068904 master-0 kubenswrapper[4745]: I1204 11:37:31.068823 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/00601c1a-efd4-4366-bdc9-d768afa252b0-available-featuregates\") pod \"openshift-config-operator-68758cbcdb-zh8g5\" (UID: \"00601c1a-efd4-4366-bdc9-d768afa252b0\") " pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:37:31.068904 master-0 kubenswrapper[4745]: I1204 11:37:31.068875 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-service-ca\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:31.069099 master-0 kubenswrapper[4745]: I1204 11:37:31.069039 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-trusted-ca\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:31.069305 master-0 kubenswrapper[4745]: I1204 11:37:31.069276 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bac00ac5-0371-48fd-b1cc-60438f08ae94-config\") pod \"kube-controller-manager-operator-848f645654-7hmhg\" (UID: \"bac00ac5-0371-48fd-b1cc-60438f08ae94\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:37:31.069868 master-0 kubenswrapper[4745]: I1204 11:37:31.069827 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-serving-cert\") pod \"service-ca-operator-77758bc754-8smqn\" (UID: \"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8\") " pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:37:31.070022 master-0 kubenswrapper[4745]: I1204 11:37:31.069993 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3322cc5a-f1f7-4522-b423-19fb7f38cd43-config\") pod \"openshift-controller-manager-operator-6c8676f99d-7z948\" (UID: \"3322cc5a-f1f7-4522-b423-19fb7f38cd43\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:37:31.070086 master-0 kubenswrapper[4745]: I1204 11:37:31.070057 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fd9f8671-8066-4990-b45d-8b619aa5d9ec-serving-cert\") pod \"kube-storage-version-migrator-operator-b9c5dfc78-dcxkw\" (UID: \"fd9f8671-8066-4990-b45d-8b619aa5d9ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:37:31.070135 master-0 kubenswrapper[4745]: I1204 11:37:31.070108 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ccf81538-4d5a-4c26-8e54-fe39331a625d-serving-cert\") pod \"kube-apiserver-operator-765d9ff747-gr68k\" (UID: \"ccf81538-4d5a-4c26-8e54-fe39331a625d\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:37:31.070576 master-0 kubenswrapper[4745]: I1204 11:37:31.070546 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42b3be0f-1d82-4a64-abb4-0118a6960efd-serving-cert\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:31.071116 master-0 kubenswrapper[4745]: I1204 11:37:31.071078 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-profile-collector-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:31.071432 master-0 kubenswrapper[4745]: I1204 11:37:31.071391 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bac00ac5-0371-48fd-b1cc-60438f08ae94-serving-cert\") pod \"kube-controller-manager-operator-848f645654-7hmhg\" (UID: \"bac00ac5-0371-48fd-b1cc-60438f08ae94\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:37:31.071690 master-0 kubenswrapper[4745]: I1204 11:37:31.071657 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-client\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:31.073263 master-0 kubenswrapper[4745]: I1204 11:37:31.072736 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-profile-collector-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:31.073263 master-0 kubenswrapper[4745]: I1204 11:37:31.073232 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3322cc5a-f1f7-4522-b423-19fb7f38cd43-serving-cert\") pod \"openshift-controller-manager-operator-6c8676f99d-7z948\" (UID: \"3322cc5a-f1f7-4522-b423-19fb7f38cd43\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:37:31.073427 master-0 kubenswrapper[4745]: I1204 11:37:31.073341 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6e9271a-44ea-4612-ab60-4a9d489ed062-serving-cert\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:31.074592 master-0 kubenswrapper[4745]: I1204 11:37:31.074519 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00601c1a-efd4-4366-bdc9-d768afa252b0-serving-cert\") pod \"openshift-config-operator-68758cbcdb-zh8g5\" (UID: \"00601c1a-efd4-4366-bdc9-d768afa252b0\") " pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:37:31.576356 master-0 kubenswrapper[4745]: I1204 11:37:31.576286 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:37:31.576356 master-0 kubenswrapper[4745]: I1204 11:37:31.576353 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:31.577319 master-0 kubenswrapper[4745]: I1204 11:37:31.576479 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:31.577319 master-0 kubenswrapper[4745]: I1204 11:37:31.576531 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:37:31.577319 master-0 kubenswrapper[4745]: I1204 11:37:31.576586 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:31.577319 master-0 kubenswrapper[4745]: I1204 11:37:31.576622 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:31.577319 master-0 kubenswrapper[4745]: I1204 11:37:31.576646 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:31.577319 master-0 kubenswrapper[4745]: I1204 11:37:31.576670 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:31.577319 master-0 kubenswrapper[4745]: I1204 11:37:31.576705 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:37:31.577319 master-0 kubenswrapper[4745]: E1204 11:37:31.576907 4745 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: secret "multus-admission-controller-secret" not found Dec 04 11:37:31.577319 master-0 kubenswrapper[4745]: E1204 11:37:31.576907 4745 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/olm-operator-serving-cert: secret "olm-operator-serving-cert" not found Dec 04 11:37:31.577319 master-0 kubenswrapper[4745]: E1204 11:37:31.577001 4745 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Dec 04 11:37:31.577319 master-0 kubenswrapper[4745]: E1204 11:37:31.577103 4745 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/catalog-operator-serving-cert: secret "catalog-operator-serving-cert" not found Dec 04 11:37:31.577319 master-0 kubenswrapper[4745]: E1204 11:37:31.576907 4745 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/performance-addon-operator-webhook-cert: secret "performance-addon-operator-webhook-cert" not found Dec 04 11:37:31.577319 master-0 kubenswrapper[4745]: E1204 11:37:31.577125 4745 secret.go:189] Couldn't get secret openshift-dns-operator/metrics-tls: secret "metrics-tls" not found Dec 04 11:37:31.577319 master-0 kubenswrapper[4745]: E1204 11:37:31.576966 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs podName:08550069-c1a1-475e-84a2-e56905f1ed38 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:32.5769515 +0000 UTC m=+138.278939885 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs") pod "multus-admission-controller-7dfc5b745f-258xq" (UID: "08550069-c1a1-475e-84a2-e56905f1ed38") : secret "multus-admission-controller-secret" not found Dec 04 11:37:31.577319 master-0 kubenswrapper[4745]: E1204 11:37:31.576961 4745 secret.go:189] Couldn't get secret openshift-ingress-operator/metrics-tls: secret "metrics-tls" not found Dec 04 11:37:31.577319 master-0 kubenswrapper[4745]: E1204 11:37:31.577201 4745 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/package-server-manager-serving-cert: secret "package-server-manager-serving-cert" not found Dec 04 11:37:31.577319 master-0 kubenswrapper[4745]: E1204 11:37:31.577166 4745 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-operator-tls: secret "image-registry-operator-tls" not found Dec 04 11:37:31.577319 master-0 kubenswrapper[4745]: E1204 11:37:31.577245 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls podName:b011b1f1-3235-4e20-825b-ce711c052407 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:32.577206928 +0000 UTC m=+138.279195543 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls") pod "ingress-operator-8649c48786-cx2b2" (UID: "b011b1f1-3235-4e20-825b-ce711c052407") : secret "metrics-tls" not found Dec 04 11:37:31.577957 master-0 kubenswrapper[4745]: E1204 11:37:31.577278 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls podName:1ade9186-b262-4b5e-9c6f-ba89f0130fb6 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:32.577263259 +0000 UTC m=+138.279251865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "image-registry-operator-tls" (UniqueName: "kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls") pod "cluster-image-registry-operator-6fb9f88b7-tgvfl" (UID: "1ade9186-b262-4b5e-9c6f-ba89f0130fb6") : secret "image-registry-operator-tls" not found Dec 04 11:37:31.577957 master-0 kubenswrapper[4745]: E1204 11:37:31.577400 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert podName:7bf67a51-9759-4e2a-a2ae-ef7416cad43f nodeName:}" failed. No retries permitted until 2025-12-04 11:37:32.577385933 +0000 UTC m=+138.279374538 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert") pod "olm-operator-7cd7dbb44c-vzj4q" (UID: "7bf67a51-9759-4e2a-a2ae-ef7416cad43f") : secret "olm-operator-serving-cert" not found Dec 04 11:37:31.577957 master-0 kubenswrapper[4745]: E1204 11:37:31.577427 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert podName:6f15dcdb-c968-429c-9d1d-63c2becad337 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:32.577414954 +0000 UTC m=+138.279403609 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert") pod "cluster-node-tuning-operator-85cff47f46-4gv5j" (UID: "6f15dcdb-c968-429c-9d1d-63c2becad337") : secret "performance-addon-operator-webhook-cert" not found Dec 04 11:37:31.577957 master-0 kubenswrapper[4745]: E1204 11:37:31.577448 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls podName:7c017c69-b24e-4a7a-b888-133bed34c174 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:32.577438065 +0000 UTC m=+138.279426710 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls") pod "dns-operator-7c56cf9b74-xz27r" (UID: "7c017c69-b24e-4a7a-b888-133bed34c174") : secret "metrics-tls" not found Dec 04 11:37:31.577957 master-0 kubenswrapper[4745]: I1204 11:37:31.577398 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:31.577957 master-0 kubenswrapper[4745]: E1204 11:37:31.577463 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls podName:2ab26ae5-0607-4dfd-840e-531d204b5030 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:32.577457696 +0000 UTC m=+138.279446091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-7ff994598c-p82nn" (UID: "2ab26ae5-0607-4dfd-840e-531d204b5030") : secret "cluster-monitoring-operator-tls" not found Dec 04 11:37:31.577957 master-0 kubenswrapper[4745]: E1204 11:37:31.577511 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert podName:72faf6d6-e8ca-43d1-b93e-67c11f8d3b46 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:32.577495897 +0000 UTC m=+138.279484522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "package-server-manager-serving-cert" (UniqueName: "kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert") pod "package-server-manager-67477646d4-7hndf" (UID: "72faf6d6-e8ca-43d1-b93e-67c11f8d3b46") : secret "package-server-manager-serving-cert" not found Dec 04 11:37:31.577957 master-0 kubenswrapper[4745]: E1204 11:37:31.577527 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert podName:434ed9b9-715b-455b-867c-775b256df40f nodeName:}" failed. No retries permitted until 2025-12-04 11:37:32.577520558 +0000 UTC m=+138.279508953 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert") pod "catalog-operator-fbc6455c4-5m8ll" (UID: "434ed9b9-715b-455b-867c-775b256df40f") : secret "catalog-operator-serving-cert" not found Dec 04 11:37:31.577957 master-0 kubenswrapper[4745]: I1204 11:37:31.577545 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:31.577957 master-0 kubenswrapper[4745]: E1204 11:37:31.577473 4745 secret.go:189] Couldn't get secret openshift-marketplace/marketplace-operator-metrics: secret "marketplace-operator-metrics" not found Dec 04 11:37:31.577957 master-0 kubenswrapper[4745]: E1204 11:37:31.577624 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics podName:fd4c4c6f-380a-4cda-9a21-352b55ec2d98 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:32.577606471 +0000 UTC m=+138.279594886 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "marketplace-operator-metrics" (UniqueName: "kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics") pod "marketplace-operator-f797b99b6-hjjrk" (UID: "fd4c4c6f-380a-4cda-9a21-352b55ec2d98") : secret "marketplace-operator-metrics" not found Dec 04 11:37:31.578265 master-0 kubenswrapper[4745]: E1204 11:37:31.577707 4745 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/node-tuning-operator-tls: secret "node-tuning-operator-tls" not found Dec 04 11:37:31.578265 master-0 kubenswrapper[4745]: E1204 11:37:31.577747 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls podName:6f15dcdb-c968-429c-9d1d-63c2becad337 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:32.577739595 +0000 UTC m=+138.279727990 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-tuning-operator-tls" (UniqueName: "kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls") pod "cluster-node-tuning-operator-85cff47f46-4gv5j" (UID: "6f15dcdb-c968-429c-9d1d-63c2becad337") : secret "node-tuning-operator-tls" not found Dec 04 11:37:31.689939 master-0 kubenswrapper[4745]: I1204 11:37:31.689830 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf"] Dec 04 11:37:31.689939 master-0 kubenswrapper[4745]: I1204 11:37:31.689951 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/csi-snapshot-controller-operator-6bc8656fdc-2q7f5"] Dec 04 11:37:31.700015 master-0 kubenswrapper[4745]: I1204 11:37:31.697013 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-dns-operator/dns-operator-7c56cf9b74-xz27r"] Dec 04 11:37:31.714097 master-0 kubenswrapper[4745]: I1204 11:37:31.713873 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948"] Dec 04 11:37:31.714097 master-0 kubenswrapper[4745]: I1204 11:37:31.713946 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j"] Dec 04 11:37:31.715000 master-0 kubenswrapper[4745]: I1204 11:37:31.714704 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw"] Dec 04 11:37:31.727895 master-0 kubenswrapper[4745]: I1204 11:37:31.726897 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn"] Dec 04 11:37:31.727895 master-0 kubenswrapper[4745]: I1204 11:37:31.726943 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5"] Dec 04 11:37:31.728859 master-0 kubenswrapper[4745]: I1204 11:37:31.728773 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf"] Dec 04 11:37:31.732602 master-0 kubenswrapper[4745]: I1204 11:37:31.730967 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-multus/multus-admission-controller-7dfc5b745f-258xq"] Dec 04 11:37:31.732602 master-0 kubenswrapper[4745]: I1204 11:37:31.730993 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg"] Dec 04 11:37:31.732602 master-0 kubenswrapper[4745]: I1204 11:37:31.731004 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/marketplace-operator-f797b99b6-hjjrk"] Dec 04 11:37:31.732602 master-0 kubenswrapper[4745]: I1204 11:37:31.731686 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q"] Dec 04 11:37:31.745162 master-0 kubenswrapper[4745]: I1204 11:37:31.740027 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvzrc\" (UniqueName: \"kubernetes.io/projected/2ab26ae5-0607-4dfd-840e-531d204b5030-kube-api-access-mvzrc\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:31.757007 master-0 kubenswrapper[4745]: I1204 11:37:31.745625 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b011b1f1-3235-4e20-825b-ce711c052407-bound-sa-token\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:31.757007 master-0 kubenswrapper[4745]: I1204 11:37:31.747248 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlr76\" (UniqueName: \"kubernetes.io/projected/7c017c69-b24e-4a7a-b888-133bed34c174-kube-api-access-tlr76\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:37:31.757007 master-0 kubenswrapper[4745]: I1204 11:37:31.747669 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggzfm\" (UniqueName: \"kubernetes.io/projected/434ed9b9-715b-455b-867c-775b256df40f-kube-api-access-ggzfm\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:31.757007 master-0 kubenswrapper[4745]: I1204 11:37:31.748606 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-llscb\" (UniqueName: \"kubernetes.io/projected/fd9f8671-8066-4990-b45d-8b619aa5d9ec-kube-api-access-llscb\") pod \"kube-storage-version-migrator-operator-b9c5dfc78-dcxkw\" (UID: \"fd9f8671-8066-4990-b45d-8b619aa5d9ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:37:31.757007 master-0 kubenswrapper[4745]: I1204 11:37:31.756909 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cffn\" (UniqueName: \"kubernetes.io/projected/08550069-c1a1-475e-84a2-e56905f1ed38-kube-api-access-8cffn\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:37:31.950574 master-0 kubenswrapper[4745]: I1204 11:37:31.950412 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:37:32.123630 master-0 kubenswrapper[4745]: I1204 11:37:32.123538 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj4dt\" (UniqueName: \"kubernetes.io/projected/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-kube-api-access-rj4dt\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:32.560341 master-0 kubenswrapper[4745]: I1204 11:37:32.560297 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2"] Dec 04 11:37:32.562065 master-0 kubenswrapper[4745]: I1204 11:37:32.560788 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-master-0"] Dec 04 11:37:32.563069 master-0 kubenswrapper[4745]: I1204 11:37:32.563039 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn"] Dec 04 11:37:32.563940 master-0 kubenswrapper[4745]: I1204 11:37:32.563897 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k"] Dec 04 11:37:32.564951 master-0 kubenswrapper[4745]: I1204 11:37:32.564908 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-operator/ingress-operator-8649c48786-cx2b2"] Dec 04 11:37:32.566119 master-0 kubenswrapper[4745]: I1204 11:37:32.566092 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr"] Dec 04 11:37:32.566793 master-0 kubenswrapper[4745]: I1204 11:37:32.566762 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv"] Dec 04 11:37:32.567542 master-0 kubenswrapper[4745]: I1204 11:37:32.567515 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl"] Dec 04 11:37:32.573972 master-0 kubenswrapper[4745]: I1204 11:37:32.573932 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll"] Dec 04 11:37:32.574240 master-0 kubenswrapper[4745]: I1204 11:37:32.574204 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw"] Dec 04 11:37:32.575498 master-0 kubenswrapper[4745]: I1204 11:37:32.575477 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-bkmlp"] Dec 04 11:37:32.575728 master-0 kubenswrapper[4745]: I1204 11:37:32.575696 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7xwd\" (UniqueName: \"kubernetes.io/projected/42b3be0f-1d82-4a64-abb4-0118a6960efd-kube-api-access-c7xwd\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:32.575895 master-0 kubenswrapper[4745]: I1204 11:37:32.575496 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq49f\" (UniqueName: \"kubernetes.io/projected/b011b1f1-3235-4e20-825b-ce711c052407-kube-api-access-jq49f\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:32.578617 master-0 kubenswrapper[4745]: I1204 11:37:32.576367 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:37:32.578617 master-0 kubenswrapper[4745]: I1204 11:37:32.578532 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckwnn\" (UniqueName: \"kubernetes.io/projected/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-kube-api-access-ckwnn\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:37:32.579444 master-0 kubenswrapper[4745]: I1204 11:37:32.579265 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/bac00ac5-0371-48fd-b1cc-60438f08ae94-kube-api-access\") pod \"kube-controller-manager-operator-848f645654-7hmhg\" (UID: \"bac00ac5-0371-48fd-b1cc-60438f08ae94\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:37:32.582011 master-0 kubenswrapper[4745]: I1204 11:37:32.581971 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"iptables-alerter-script" Dec 04 11:37:32.582435 master-0 kubenswrapper[4745]: I1204 11:37:32.582380 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k449s\" (UniqueName: \"kubernetes.io/projected/3322cc5a-f1f7-4522-b423-19fb7f38cd43-kube-api-access-k449s\") pod \"openshift-controller-manager-operator-6c8676f99d-7z948\" (UID: \"3322cc5a-f1f7-4522-b423-19fb7f38cd43\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:37:32.583548 master-0 kubenswrapper[4745]: I1204 11:37:32.583131 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6bhm\" (UniqueName: \"kubernetes.io/projected/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-kube-api-access-n6bhm\") pod \"service-ca-operator-77758bc754-8smqn\" (UID: \"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8\") " pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:37:32.583548 master-0 kubenswrapper[4745]: I1204 11:37:32.583489 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/27576028-d64a-47cd-b76b-d524e41efe37-kube-api-access\") pod \"openshift-kube-scheduler-operator-5f85974995-g4rwv\" (UID: \"27576028-d64a-47cd-b76b-d524e41efe37\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:37:32.583548 master-0 kubenswrapper[4745]: I1204 11:37:32.583522 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/ccf81538-4d5a-4c26-8e54-fe39331a625d-kube-api-access\") pod \"kube-apiserver-operator-765d9ff747-gr68k\" (UID: \"ccf81538-4d5a-4c26-8e54-fe39331a625d\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:37:32.583695 master-0 kubenswrapper[4745]: I1204 11:37:32.583579 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g7bh\" (UniqueName: \"kubernetes.io/projected/00601c1a-efd4-4366-bdc9-d768afa252b0-kube-api-access-2g7bh\") pod \"openshift-config-operator-68758cbcdb-zh8g5\" (UID: \"00601c1a-efd4-4366-bdc9-d768afa252b0\") " pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:37:32.583844 master-0 kubenswrapper[4745]: I1204 11:37:32.583795 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cxbd\" (UniqueName: \"kubernetes.io/projected/0158c2f3-20e5-43f4-875d-c5ad8f6112df-kube-api-access-8cxbd\") pod \"cluster-olm-operator-56fcb6cc5f-4xwp2\" (UID: \"0158c2f3-20e5-43f4-875d-c5ad8f6112df\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:37:32.587079 master-0 kubenswrapper[4745]: I1204 11:37:32.586924 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr454\" (UniqueName: \"kubernetes.io/projected/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-kube-api-access-zr454\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:32.587466 master-0 kubenswrapper[4745]: I1204 11:37:32.587399 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-bound-sa-token\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:32.587526 master-0 kubenswrapper[4745]: I1204 11:37:32.587398 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7bhn\" (UniqueName: \"kubernetes.io/projected/031d300e-24b4-481c-8b82-fe8cdb3fcef7-kube-api-access-k7bhn\") pod \"csi-snapshot-controller-operator-6bc8656fdc-2q7f5\" (UID: \"031d300e-24b4-481c-8b82-fe8cdb3fcef7\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-6bc8656fdc-2q7f5" Dec 04 11:37:32.587682 master-0 kubenswrapper[4745]: I1204 11:37:32.587635 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkjzz\" (UniqueName: \"kubernetes.io/projected/6f15dcdb-c968-429c-9d1d-63c2becad337-kube-api-access-kkjzz\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:32.587783 master-0 kubenswrapper[4745]: I1204 11:37:32.587747 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t46k7\" (UniqueName: \"kubernetes.io/projected/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-kube-api-access-t46k7\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:32.589455 master-0 kubenswrapper[4745]: I1204 11:37:32.589405 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdsq5\" (UniqueName: \"kubernetes.io/projected/c6e9271a-44ea-4612-ab60-4a9d489ed062-kube-api-access-cdsq5\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:32.591708 master-0 kubenswrapper[4745]: I1204 11:37:32.589931 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:32.591708 master-0 kubenswrapper[4745]: I1204 11:37:32.590266 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:32.591708 master-0 kubenswrapper[4745]: I1204 11:37:32.590341 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:32.591708 master-0 kubenswrapper[4745]: I1204 11:37:32.590393 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:37:32.591708 master-0 kubenswrapper[4745]: E1204 11:37:32.590425 4745 secret.go:189] Couldn't get secret openshift-ingress-operator/metrics-tls: secret "metrics-tls" not found Dec 04 11:37:32.591708 master-0 kubenswrapper[4745]: E1204 11:37:32.590481 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls podName:b011b1f1-3235-4e20-825b-ce711c052407 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:34.590464473 +0000 UTC m=+140.292452868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls") pod "ingress-operator-8649c48786-cx2b2" (UID: "b011b1f1-3235-4e20-825b-ce711c052407") : secret "metrics-tls" not found Dec 04 11:37:32.591708 master-0 kubenswrapper[4745]: E1204 11:37:32.590545 4745 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/package-server-manager-serving-cert: secret "package-server-manager-serving-cert" not found Dec 04 11:37:32.591708 master-0 kubenswrapper[4745]: E1204 11:37:32.590560 4745 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Dec 04 11:37:32.591708 master-0 kubenswrapper[4745]: E1204 11:37:32.590607 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert podName:72faf6d6-e8ca-43d1-b93e-67c11f8d3b46 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:34.590590398 +0000 UTC m=+140.292578783 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "package-server-manager-serving-cert" (UniqueName: "kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert") pod "package-server-manager-67477646d4-7hndf" (UID: "72faf6d6-e8ca-43d1-b93e-67c11f8d3b46") : secret "package-server-manager-serving-cert" not found Dec 04 11:37:32.591708 master-0 kubenswrapper[4745]: I1204 11:37:32.590628 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:32.591708 master-0 kubenswrapper[4745]: E1204 11:37:32.590653 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls podName:2ab26ae5-0607-4dfd-840e-531d204b5030 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:34.590626018 +0000 UTC m=+140.292614593 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-7ff994598c-p82nn" (UID: "2ab26ae5-0607-4dfd-840e-531d204b5030") : secret "cluster-monitoring-operator-tls" not found Dec 04 11:37:32.591708 master-0 kubenswrapper[4745]: E1204 11:37:32.590679 4745 secret.go:189] Couldn't get secret openshift-marketplace/marketplace-operator-metrics: secret "marketplace-operator-metrics" not found Dec 04 11:37:32.591708 master-0 kubenswrapper[4745]: E1204 11:37:32.590704 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics podName:fd4c4c6f-380a-4cda-9a21-352b55ec2d98 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:34.59069717 +0000 UTC m=+140.292685565 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "marketplace-operator-metrics" (UniqueName: "kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics") pod "marketplace-operator-f797b99b6-hjjrk" (UID: "fd4c4c6f-380a-4cda-9a21-352b55ec2d98") : secret "marketplace-operator-metrics" not found Dec 04 11:37:32.591708 master-0 kubenswrapper[4745]: I1204 11:37:32.590699 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:32.591708 master-0 kubenswrapper[4745]: E1204 11:37:32.590757 4745 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/olm-operator-serving-cert: secret "olm-operator-serving-cert" not found Dec 04 11:37:32.592390 master-0 kubenswrapper[4745]: E1204 11:37:32.590793 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert podName:7bf67a51-9759-4e2a-a2ae-ef7416cad43f nodeName:}" failed. No retries permitted until 2025-12-04 11:37:34.590786173 +0000 UTC m=+140.292774568 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert") pod "olm-operator-7cd7dbb44c-vzj4q" (UID: "7bf67a51-9759-4e2a-a2ae-ef7416cad43f") : secret "olm-operator-serving-cert" not found Dec 04 11:37:32.592390 master-0 kubenswrapper[4745]: I1204 11:37:32.590840 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:37:32.592390 master-0 kubenswrapper[4745]: E1204 11:37:32.590871 4745 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/node-tuning-operator-tls: secret "node-tuning-operator-tls" not found Dec 04 11:37:32.592390 master-0 kubenswrapper[4745]: I1204 11:37:32.590890 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:32.592390 master-0 kubenswrapper[4745]: E1204 11:37:32.590940 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls podName:6f15dcdb-c968-429c-9d1d-63c2becad337 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:34.590922107 +0000 UTC m=+140.292910502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "node-tuning-operator-tls" (UniqueName: "kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls") pod "cluster-node-tuning-operator-85cff47f46-4gv5j" (UID: "6f15dcdb-c968-429c-9d1d-63c2becad337") : secret "node-tuning-operator-tls" not found Dec 04 11:37:32.592390 master-0 kubenswrapper[4745]: E1204 11:37:32.590973 4745 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: secret "multus-admission-controller-secret" not found Dec 04 11:37:32.592390 master-0 kubenswrapper[4745]: E1204 11:37:32.591001 4745 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/performance-addon-operator-webhook-cert: secret "performance-addon-operator-webhook-cert" not found Dec 04 11:37:32.592390 master-0 kubenswrapper[4745]: E1204 11:37:32.591012 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs podName:08550069-c1a1-475e-84a2-e56905f1ed38 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:34.59099993 +0000 UTC m=+140.292988535 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs") pod "multus-admission-controller-7dfc5b745f-258xq" (UID: "08550069-c1a1-475e-84a2-e56905f1ed38") : secret "multus-admission-controller-secret" not found Dec 04 11:37:32.592390 master-0 kubenswrapper[4745]: E1204 11:37:32.591018 4745 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/catalog-operator-serving-cert: secret "catalog-operator-serving-cert" not found Dec 04 11:37:32.592390 master-0 kubenswrapper[4745]: I1204 11:37:32.590974 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:32.592390 master-0 kubenswrapper[4745]: E1204 11:37:32.591043 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert podName:6f15dcdb-c968-429c-9d1d-63c2becad337 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:34.591029831 +0000 UTC m=+140.293018406 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert") pod "cluster-node-tuning-operator-85cff47f46-4gv5j" (UID: "6f15dcdb-c968-429c-9d1d-63c2becad337") : secret "performance-addon-operator-webhook-cert" not found Dec 04 11:37:32.592390 master-0 kubenswrapper[4745]: E1204 11:37:32.591065 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert podName:434ed9b9-715b-455b-867c-775b256df40f nodeName:}" failed. No retries permitted until 2025-12-04 11:37:34.591056042 +0000 UTC m=+140.293044657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert") pod "catalog-operator-fbc6455c4-5m8ll" (UID: "434ed9b9-715b-455b-867c-775b256df40f") : secret "catalog-operator-serving-cert" not found Dec 04 11:37:32.592390 master-0 kubenswrapper[4745]: I1204 11:37:32.591099 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:37:32.592390 master-0 kubenswrapper[4745]: I1204 11:37:32.591141 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:32.592390 master-0 kubenswrapper[4745]: E1204 11:37:32.591253 4745 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-operator-tls: secret "image-registry-operator-tls" not found Dec 04 11:37:32.592847 master-0 kubenswrapper[4745]: E1204 11:37:32.591280 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls podName:1ade9186-b262-4b5e-9c6f-ba89f0130fb6 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:34.591272159 +0000 UTC m=+140.293260554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "image-registry-operator-tls" (UniqueName: "kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls") pod "cluster-image-registry-operator-6fb9f88b7-tgvfl" (UID: "1ade9186-b262-4b5e-9c6f-ba89f0130fb6") : secret "image-registry-operator-tls" not found Dec 04 11:37:32.592847 master-0 kubenswrapper[4745]: E1204 11:37:32.591326 4745 secret.go:189] Couldn't get secret openshift-dns-operator/metrics-tls: secret "metrics-tls" not found Dec 04 11:37:32.592847 master-0 kubenswrapper[4745]: E1204 11:37:32.591352 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls podName:7c017c69-b24e-4a7a-b888-133bed34c174 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:34.591344791 +0000 UTC m=+140.293333416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls") pod "dns-operator-7c56cf9b74-xz27r" (UID: "7c017c69-b24e-4a7a-b888-133bed34c174") : secret "metrics-tls" not found Dec 04 11:37:32.592847 master-0 kubenswrapper[4745]: I1204 11:37:32.592354 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhmlm\" (UniqueName: \"kubernetes.io/projected/a5b826c3-8638-4cf5-b974-b24e4282ce00-kube-api-access-rhmlm\") pod \"openshift-apiserver-operator-7bf7f6b755-sh6qf\" (UID: \"a5b826c3-8638-4cf5-b974-b24e4282ce00\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:37:32.684947 master-0 kubenswrapper[4745]: I1204 11:37:32.684819 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:37:32.693758 master-0 kubenswrapper[4745]: I1204 11:37:32.692863 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/330553d2-40ea-4496-8346-2e5bf680669b-iptables-alerter-script\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:37:32.693758 master-0 kubenswrapper[4745]: I1204 11:37:32.692979 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/330553d2-40ea-4496-8346-2e5bf680669b-host-slash\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:37:32.693758 master-0 kubenswrapper[4745]: I1204 11:37:32.693102 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59pbp\" (UniqueName: \"kubernetes.io/projected/330553d2-40ea-4496-8346-2e5bf680669b-kube-api-access-59pbp\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:37:32.714117 master-0 kubenswrapper[4745]: I1204 11:37:32.714039 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:37:32.728665 master-0 kubenswrapper[4745]: I1204 11:37:32.728324 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:32.737187 master-0 kubenswrapper[4745]: I1204 11:37:32.737128 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:37:32.745060 master-0 kubenswrapper[4745]: I1204 11:37:32.745004 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:37:32.761563 master-0 kubenswrapper[4745]: I1204 11:37:32.761092 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:37:32.769207 master-0 kubenswrapper[4745]: I1204 11:37:32.769166 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:32.785487 master-0 kubenswrapper[4745]: I1204 11:37:32.785441 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:37:32.794462 master-0 kubenswrapper[4745]: I1204 11:37:32.794376 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-59pbp\" (UniqueName: \"kubernetes.io/projected/330553d2-40ea-4496-8346-2e5bf680669b-kube-api-access-59pbp\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:37:32.794568 master-0 kubenswrapper[4745]: I1204 11:37:32.794543 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/330553d2-40ea-4496-8346-2e5bf680669b-iptables-alerter-script\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:37:32.794617 master-0 kubenswrapper[4745]: I1204 11:37:32.794606 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/330553d2-40ea-4496-8346-2e5bf680669b-host-slash\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:37:32.794764 master-0 kubenswrapper[4745]: I1204 11:37:32.794739 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/330553d2-40ea-4496-8346-2e5bf680669b-host-slash\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:37:32.798619 master-0 kubenswrapper[4745]: I1204 11:37:32.796726 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/330553d2-40ea-4496-8346-2e5bf680669b-iptables-alerter-script\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:37:32.845162 master-0 kubenswrapper[4745]: I1204 11:37:32.839636 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:37:32.845162 master-0 kubenswrapper[4745]: I1204 11:37:32.843449 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:37:32.853961 master-0 kubenswrapper[4745]: I1204 11:37:32.852485 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-6bc8656fdc-2q7f5" Dec 04 11:37:33.073927 master-0 kubenswrapper[4745]: I1204 11:37:33.072705 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-59pbp\" (UniqueName: \"kubernetes.io/projected/330553d2-40ea-4496-8346-2e5bf680669b-kube-api-access-59pbp\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:37:33.210744 master-0 kubenswrapper[4745]: I1204 11:37:33.210621 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:37:33.740420 master-0 kubenswrapper[4745]: I1204 11:37:33.740220 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k"] Dec 04 11:37:33.744307 master-0 kubenswrapper[4745]: I1204 11:37:33.742686 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2"] Dec 04 11:37:33.746722 master-0 kubenswrapper[4745]: I1204 11:37:33.744536 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv"] Dec 04 11:37:33.746722 master-0 kubenswrapper[4745]: I1204 11:37:33.746071 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw"] Dec 04 11:37:33.748247 master-0 kubenswrapper[4745]: I1204 11:37:33.748212 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg"] Dec 04 11:37:33.749541 master-0 kubenswrapper[4745]: I1204 11:37:33.748953 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr"] Dec 04 11:37:33.750030 master-0 kubenswrapper[4745]: I1204 11:37:33.749623 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn"] Dec 04 11:37:33.750238 master-0 kubenswrapper[4745]: W1204 11:37:33.750105 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod031d300e_24b4_481c_8b82_fe8cdb3fcef7.slice/crio-612a0c5312df7f19a5e3a086b42a22b55f539c232badbe0a03979b12eb756461 WatchSource:0}: Error finding container 612a0c5312df7f19a5e3a086b42a22b55f539c232badbe0a03979b12eb756461: Status 404 returned error can't find the container with id 612a0c5312df7f19a5e3a086b42a22b55f539c232badbe0a03979b12eb756461 Dec 04 11:37:33.750662 master-0 kubenswrapper[4745]: I1204 11:37:33.750388 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948"] Dec 04 11:37:33.751102 master-0 kubenswrapper[4745]: I1204 11:37:33.751055 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf"] Dec 04 11:37:33.751102 master-0 kubenswrapper[4745]: W1204 11:37:33.751067 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf81538_4d5a_4c26_8e54_fe39331a625d.slice/crio-52fc4812931b1d912474af968926c8a3a29e2b1cbdfed78532122ce1dc286a99 WatchSource:0}: Error finding container 52fc4812931b1d912474af968926c8a3a29e2b1cbdfed78532122ce1dc286a99: Status 404 returned error can't find the container with id 52fc4812931b1d912474af968926c8a3a29e2b1cbdfed78532122ce1dc286a99 Dec 04 11:37:33.751989 master-0 kubenswrapper[4745]: I1204 11:37:33.751939 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5"] Dec 04 11:37:33.752348 master-0 kubenswrapper[4745]: W1204 11:37:33.752188 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0158c2f3_20e5_43f4_875d_c5ad8f6112df.slice/crio-e64b7e965ab85bcd41866acdf04d1346eef2d43597395fb0ad995548a3c03068 WatchSource:0}: Error finding container e64b7e965ab85bcd41866acdf04d1346eef2d43597395fb0ad995548a3c03068: Status 404 returned error can't find the container with id e64b7e965ab85bcd41866acdf04d1346eef2d43597395fb0ad995548a3c03068 Dec 04 11:37:33.753425 master-0 kubenswrapper[4745]: I1204 11:37:33.752659 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/csi-snapshot-controller-operator-6bc8656fdc-2q7f5"] Dec 04 11:37:33.753425 master-0 kubenswrapper[4745]: I1204 11:37:33.753279 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw"] Dec 04 11:37:33.755370 master-0 kubenswrapper[4745]: W1204 11:37:33.755323 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd9f8671_8066_4990_b45d_8b619aa5d9ec.slice/crio-eadb6c5599ab1a4ae90f8ecda2c7a886a86c701b1c6361b22d8aa8fc4c814262 WatchSource:0}: Error finding container eadb6c5599ab1a4ae90f8ecda2c7a886a86c701b1c6361b22d8aa8fc4c814262: Status 404 returned error can't find the container with id eadb6c5599ab1a4ae90f8ecda2c7a886a86c701b1c6361b22d8aa8fc4c814262 Dec 04 11:37:33.757646 master-0 kubenswrapper[4745]: W1204 11:37:33.757612 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbac00ac5_0371_48fd_b1cc_60438f08ae94.slice/crio-0d019de7666ab420398ef1b6b5ac581f64802cb56fe4c2b360c11b041de71dc5 WatchSource:0}: Error finding container 0d019de7666ab420398ef1b6b5ac581f64802cb56fe4c2b360c11b041de71dc5: Status 404 returned error can't find the container with id 0d019de7666ab420398ef1b6b5ac581f64802cb56fe4c2b360c11b041de71dc5 Dec 04 11:37:33.760498 master-0 kubenswrapper[4745]: W1204 11:37:33.760431 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27576028_d64a_47cd_b76b_d524e41efe37.slice/crio-fa255b4fd328cf99db08eb2b43e9c35a73e8f688d9352d1ab6ed516f93712d61 WatchSource:0}: Error finding container fa255b4fd328cf99db08eb2b43e9c35a73e8f688d9352d1ab6ed516f93712d61: Status 404 returned error can't find the container with id fa255b4fd328cf99db08eb2b43e9c35a73e8f688d9352d1ab6ed516f93712d61 Dec 04 11:37:33.761224 master-0 kubenswrapper[4745]: W1204 11:37:33.761175 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6e9271a_44ea_4612_ab60_4a9d489ed062.slice/crio-6cab7196e003292e61274a565af49a44adbe51e465702618783576ef89e2744f WatchSource:0}: Error finding container 6cab7196e003292e61274a565af49a44adbe51e465702618783576ef89e2744f: Status 404 returned error can't find the container with id 6cab7196e003292e61274a565af49a44adbe51e465702618783576ef89e2744f Dec 04 11:37:33.761938 master-0 kubenswrapper[4745]: W1204 11:37:33.761908 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00601c1a_efd4_4366_bdc9_d768afa252b0.slice/crio-d9d667bd2c388cdba21d0d98e8c8985f6bb62287cc7f32d5b257b5a3ca9351a1 WatchSource:0}: Error finding container d9d667bd2c388cdba21d0d98e8c8985f6bb62287cc7f32d5b257b5a3ca9351a1: Status 404 returned error can't find the container with id d9d667bd2c388cdba21d0d98e8c8985f6bb62287cc7f32d5b257b5a3ca9351a1 Dec 04 11:37:33.762731 master-0 kubenswrapper[4745]: W1204 11:37:33.762706 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b3be0f_1d82_4a64_abb4_0118a6960efd.slice/crio-cbad8f519fca5622e25075665c609020a4c168f05797a0e7395559b78b81984d WatchSource:0}: Error finding container cbad8f519fca5622e25075665c609020a4c168f05797a0e7395559b78b81984d: Status 404 returned error can't find the container with id cbad8f519fca5622e25075665c609020a4c168f05797a0e7395559b78b81984d Dec 04 11:37:33.765114 master-0 kubenswrapper[4745]: W1204 11:37:33.765039 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5e33b0_4e2e_464c_ba5b_cbd2048004f8.slice/crio-da23ebdcd7c632c968f1dcc14625f7875764a703fd10b23106235b76064c9498 WatchSource:0}: Error finding container da23ebdcd7c632c968f1dcc14625f7875764a703fd10b23106235b76064c9498: Status 404 returned error can't find the container with id da23ebdcd7c632c968f1dcc14625f7875764a703fd10b23106235b76064c9498 Dec 04 11:37:33.767506 master-0 kubenswrapper[4745]: W1204 11:37:33.767438 4745 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5b826c3_8638_4cf5_b974_b24e4282ce00.slice/crio-4c6405b67db7763561b4f0f867c268ed82b2dcb8dc4a31ac8bd955b23c489a04 WatchSource:0}: Error finding container 4c6405b67db7763561b4f0f867c268ed82b2dcb8dc4a31ac8bd955b23c489a04: Status 404 returned error can't find the container with id 4c6405b67db7763561b4f0f867c268ed82b2dcb8dc4a31ac8bd955b23c489a04 Dec 04 11:37:33.772404 master-0 kubenswrapper[4745]: E1204 11:37:33.772336 4745 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:openshift-apiserver-operator,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8375671da86aa527ee7e291d86971b0baa823ffc7663b5a983084456e76c0f59,Command:[cluster-openshift-apiserver-operator operator],Args:[--config=/var/run/configmaps/config/config.yaml],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:metrics,HostPort:0,ContainerPort:8443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{EnvVar{Name:IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:df606f3b71d4376d1a2108c09f0d3dab455fc30bcb67c60e91590c105e9025bf,ValueFrom:nil,},EnvVar{Name:OPERATOR_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8375671da86aa527ee7e291d86971b0baa823ffc7663b5a983084456e76c0f59,ValueFrom:nil,},EnvVar{Name:OPERATOR_IMAGE_VERSION,Value:4.18.29,ValueFrom:nil,},EnvVar{Name:OPERAND_IMAGE_VERSION,Value:4.18.29,ValueFrom:nil,},EnvVar{Name:KUBE_APISERVER_OPERATOR_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0f43c31aa3359159d4557dad3cfaf812d8ce44db9cb9ae970e06d3479070b660,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{52428800 0} {} 50Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:false,MountPath:/var/run/configmaps/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:serving-cert,ReadOnly:false,MountPath:/var/run/secrets/serving-cert,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-rhmlm,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod openshift-apiserver-operator-7bf7f6b755-sh6qf_openshift-apiserver-operator(a5b826c3-8638-4cf5-b974-b24e4282ce00): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Dec 04 11:37:33.773603 master-0 kubenswrapper[4745]: E1204 11:37:33.773550 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"openshift-apiserver-operator\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" podUID="a5b826c3-8638-4cf5-b974-b24e4282ce00" Dec 04 11:37:34.148372 master-0 kubenswrapper[4745]: I1204 11:37:34.148061 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" event={"ID":"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8","Type":"ContainerStarted","Data":"da23ebdcd7c632c968f1dcc14625f7875764a703fd10b23106235b76064c9498"} Dec 04 11:37:34.149452 master-0 kubenswrapper[4745]: I1204 11:37:34.149369 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" event={"ID":"fd9f8671-8066-4990-b45d-8b619aa5d9ec","Type":"ContainerStarted","Data":"eadb6c5599ab1a4ae90f8ecda2c7a886a86c701b1c6361b22d8aa8fc4c814262"} Dec 04 11:37:34.150439 master-0 kubenswrapper[4745]: I1204 11:37:34.150399 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" event={"ID":"00601c1a-efd4-4366-bdc9-d768afa252b0","Type":"ContainerStarted","Data":"d9d667bd2c388cdba21d0d98e8c8985f6bb62287cc7f32d5b257b5a3ca9351a1"} Dec 04 11:37:34.151758 master-0 kubenswrapper[4745]: I1204 11:37:34.151650 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" event={"ID":"a5b826c3-8638-4cf5-b974-b24e4282ce00","Type":"ContainerStarted","Data":"4c6405b67db7763561b4f0f867c268ed82b2dcb8dc4a31ac8bd955b23c489a04"} Dec 04 11:37:34.153161 master-0 kubenswrapper[4745]: I1204 11:37:34.153078 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" event={"ID":"3322cc5a-f1f7-4522-b423-19fb7f38cd43","Type":"ContainerStarted","Data":"34d78076625efac7bdb2340b596443baa5d08eac7ab61fe519fdb353374c6f2a"} Dec 04 11:37:34.153576 master-0 kubenswrapper[4745]: E1204 11:37:34.153530 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"openshift-apiserver-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8375671da86aa527ee7e291d86971b0baa823ffc7663b5a983084456e76c0f59\\\"\"" pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" podUID="a5b826c3-8638-4cf5-b974-b24e4282ce00" Dec 04 11:37:34.154365 master-0 kubenswrapper[4745]: I1204 11:37:34.154327 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" event={"ID":"bac00ac5-0371-48fd-b1cc-60438f08ae94","Type":"ContainerStarted","Data":"0d019de7666ab420398ef1b6b5ac581f64802cb56fe4c2b360c11b041de71dc5"} Dec 04 11:37:34.155638 master-0 kubenswrapper[4745]: I1204 11:37:34.155598 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" event={"ID":"ccf81538-4d5a-4c26-8e54-fe39331a625d","Type":"ContainerStarted","Data":"52fc4812931b1d912474af968926c8a3a29e2b1cbdfed78532122ce1dc286a99"} Dec 04 11:37:34.156515 master-0 kubenswrapper[4745]: I1204 11:37:34.156479 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" event={"ID":"c6e9271a-44ea-4612-ab60-4a9d489ed062","Type":"ContainerStarted","Data":"6cab7196e003292e61274a565af49a44adbe51e465702618783576ef89e2744f"} Dec 04 11:37:34.157699 master-0 kubenswrapper[4745]: I1204 11:37:34.157625 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-6bc8656fdc-2q7f5" event={"ID":"031d300e-24b4-481c-8b82-fe8cdb3fcef7","Type":"ContainerStarted","Data":"612a0c5312df7f19a5e3a086b42a22b55f539c232badbe0a03979b12eb756461"} Dec 04 11:37:34.158601 master-0 kubenswrapper[4745]: I1204 11:37:34.158564 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" event={"ID":"0158c2f3-20e5-43f4-875d-c5ad8f6112df","Type":"ContainerStarted","Data":"e64b7e965ab85bcd41866acdf04d1346eef2d43597395fb0ad995548a3c03068"} Dec 04 11:37:34.159650 master-0 kubenswrapper[4745]: I1204 11:37:34.159527 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bkmlp" event={"ID":"330553d2-40ea-4496-8346-2e5bf680669b","Type":"ContainerStarted","Data":"ca886b4e0bb939f02a59e692a7e818915eb829261d10e2563a1a2a60bb3e4c87"} Dec 04 11:37:34.160982 master-0 kubenswrapper[4745]: I1204 11:37:34.160930 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" event={"ID":"27576028-d64a-47cd-b76b-d524e41efe37","Type":"ContainerStarted","Data":"fa255b4fd328cf99db08eb2b43e9c35a73e8f688d9352d1ab6ed516f93712d61"} Dec 04 11:37:34.162014 master-0 kubenswrapper[4745]: I1204 11:37:34.161954 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" event={"ID":"42b3be0f-1d82-4a64-abb4-0118a6960efd","Type":"ContainerStarted","Data":"cbad8f519fca5622e25075665c609020a4c168f05797a0e7395559b78b81984d"} Dec 04 11:37:34.616673 master-0 kubenswrapper[4745]: I1204 11:37:34.616597 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:37:34.616673 master-0 kubenswrapper[4745]: I1204 11:37:34.616681 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:34.617009 master-0 kubenswrapper[4745]: I1204 11:37:34.616704 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:34.617009 master-0 kubenswrapper[4745]: I1204 11:37:34.616730 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:37:34.617009 master-0 kubenswrapper[4745]: I1204 11:37:34.616748 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:34.617009 master-0 kubenswrapper[4745]: I1204 11:37:34.616775 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:34.617009 master-0 kubenswrapper[4745]: I1204 11:37:34.616823 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:37:34.617190 master-0 kubenswrapper[4745]: E1204 11:37:34.617048 4745 secret.go:189] Couldn't get secret openshift-marketplace/marketplace-operator-metrics: secret "marketplace-operator-metrics" not found Dec 04 11:37:34.617265 master-0 kubenswrapper[4745]: E1204 11:37:34.617205 4745 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-operator-tls: secret "image-registry-operator-tls" not found Dec 04 11:37:34.617309 master-0 kubenswrapper[4745]: I1204 11:37:34.617070 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:34.617309 master-0 kubenswrapper[4745]: E1204 11:37:34.617210 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics podName:fd4c4c6f-380a-4cda-9a21-352b55ec2d98 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:38.617176099 +0000 UTC m=+144.319164654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "marketplace-operator-metrics" (UniqueName: "kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics") pod "marketplace-operator-f797b99b6-hjjrk" (UID: "fd4c4c6f-380a-4cda-9a21-352b55ec2d98") : secret "marketplace-operator-metrics" not found Dec 04 11:37:34.617389 master-0 kubenswrapper[4745]: E1204 11:37:34.617288 4745 secret.go:189] Couldn't get secret openshift-dns-operator/metrics-tls: secret "metrics-tls" not found Dec 04 11:37:34.617389 master-0 kubenswrapper[4745]: E1204 11:37:34.617331 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls podName:1ade9186-b262-4b5e-9c6f-ba89f0130fb6 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:38.617307113 +0000 UTC m=+144.319295508 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "image-registry-operator-tls" (UniqueName: "kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls") pod "cluster-image-registry-operator-6fb9f88b7-tgvfl" (UID: "1ade9186-b262-4b5e-9c6f-ba89f0130fb6") : secret "image-registry-operator-tls" not found Dec 04 11:37:34.617389 master-0 kubenswrapper[4745]: I1204 11:37:34.617353 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:34.617389 master-0 kubenswrapper[4745]: E1204 11:37:34.617362 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls podName:7c017c69-b24e-4a7a-b888-133bed34c174 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:38.617352525 +0000 UTC m=+144.319341150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls") pod "dns-operator-7c56cf9b74-xz27r" (UID: "7c017c69-b24e-4a7a-b888-133bed34c174") : secret "metrics-tls" not found Dec 04 11:37:34.617512 master-0 kubenswrapper[4745]: E1204 11:37:34.617394 4745 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/performance-addon-operator-webhook-cert: secret "performance-addon-operator-webhook-cert" not found Dec 04 11:37:34.617512 master-0 kubenswrapper[4745]: E1204 11:37:34.617408 4745 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/olm-operator-serving-cert: secret "olm-operator-serving-cert" not found Dec 04 11:37:34.617512 master-0 kubenswrapper[4745]: I1204 11:37:34.617411 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:34.617512 master-0 kubenswrapper[4745]: E1204 11:37:34.617446 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert podName:7bf67a51-9759-4e2a-a2ae-ef7416cad43f nodeName:}" failed. No retries permitted until 2025-12-04 11:37:38.617437968 +0000 UTC m=+144.319426363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert") pod "olm-operator-7cd7dbb44c-vzj4q" (UID: "7bf67a51-9759-4e2a-a2ae-ef7416cad43f") : secret "olm-operator-serving-cert" not found Dec 04 11:37:34.617512 master-0 kubenswrapper[4745]: E1204 11:37:34.617459 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert podName:6f15dcdb-c968-429c-9d1d-63c2becad337 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:38.617453048 +0000 UTC m=+144.319441443 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert") pod "cluster-node-tuning-operator-85cff47f46-4gv5j" (UID: "6f15dcdb-c968-429c-9d1d-63c2becad337") : secret "performance-addon-operator-webhook-cert" not found Dec 04 11:37:34.617512 master-0 kubenswrapper[4745]: I1204 11:37:34.617477 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:34.617707 master-0 kubenswrapper[4745]: E1204 11:37:34.617562 4745 secret.go:189] Couldn't get secret openshift-ingress-operator/metrics-tls: secret "metrics-tls" not found Dec 04 11:37:34.617707 master-0 kubenswrapper[4745]: E1204 11:37:34.617600 4745 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/catalog-operator-serving-cert: secret "catalog-operator-serving-cert" not found Dec 04 11:37:34.617707 master-0 kubenswrapper[4745]: E1204 11:37:34.617565 4745 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Dec 04 11:37:34.617707 master-0 kubenswrapper[4745]: E1204 11:37:34.617650 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls podName:b011b1f1-3235-4e20-825b-ce711c052407 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:38.617624293 +0000 UTC m=+144.319612868 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls") pod "ingress-operator-8649c48786-cx2b2" (UID: "b011b1f1-3235-4e20-825b-ce711c052407") : secret "metrics-tls" not found Dec 04 11:37:34.617707 master-0 kubenswrapper[4745]: E1204 11:37:34.617674 4745 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/node-tuning-operator-tls: secret "node-tuning-operator-tls" not found Dec 04 11:37:34.617707 master-0 kubenswrapper[4745]: E1204 11:37:34.617674 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert podName:434ed9b9-715b-455b-867c-775b256df40f nodeName:}" failed. No retries permitted until 2025-12-04 11:37:38.617664614 +0000 UTC m=+144.319653239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert") pod "catalog-operator-fbc6455c4-5m8ll" (UID: "434ed9b9-715b-455b-867c-775b256df40f") : secret "catalog-operator-serving-cert" not found Dec 04 11:37:34.617949 master-0 kubenswrapper[4745]: E1204 11:37:34.617732 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls podName:2ab26ae5-0607-4dfd-840e-531d204b5030 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:38.617720096 +0000 UTC m=+144.319708701 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-7ff994598c-p82nn" (UID: "2ab26ae5-0607-4dfd-840e-531d204b5030") : secret "cluster-monitoring-operator-tls" not found Dec 04 11:37:34.617949 master-0 kubenswrapper[4745]: E1204 11:37:34.617737 4745 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/package-server-manager-serving-cert: secret "package-server-manager-serving-cert" not found Dec 04 11:37:34.617949 master-0 kubenswrapper[4745]: E1204 11:37:34.617751 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls podName:6f15dcdb-c968-429c-9d1d-63c2becad337 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:38.617742826 +0000 UTC m=+144.319731441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "node-tuning-operator-tls" (UniqueName: "kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls") pod "cluster-node-tuning-operator-85cff47f46-4gv5j" (UID: "6f15dcdb-c968-429c-9d1d-63c2becad337") : secret "node-tuning-operator-tls" not found Dec 04 11:37:34.617949 master-0 kubenswrapper[4745]: E1204 11:37:34.617775 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert podName:72faf6d6-e8ca-43d1-b93e-67c11f8d3b46 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:38.617762007 +0000 UTC m=+144.319750622 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "package-server-manager-serving-cert" (UniqueName: "kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert") pod "package-server-manager-67477646d4-7hndf" (UID: "72faf6d6-e8ca-43d1-b93e-67c11f8d3b46") : secret "package-server-manager-serving-cert" not found Dec 04 11:37:34.617949 master-0 kubenswrapper[4745]: E1204 11:37:34.617841 4745 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: secret "multus-admission-controller-secret" not found Dec 04 11:37:34.617949 master-0 kubenswrapper[4745]: E1204 11:37:34.617881 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs podName:08550069-c1a1-475e-84a2-e56905f1ed38 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:38.617873411 +0000 UTC m=+144.319861806 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs") pod "multus-admission-controller-7dfc5b745f-258xq" (UID: "08550069-c1a1-475e-84a2-e56905f1ed38") : secret "multus-admission-controller-secret" not found Dec 04 11:37:35.175691 master-0 kubenswrapper[4745]: I1204 11:37:35.175554 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" event={"ID":"ccf81538-4d5a-4c26-8e54-fe39331a625d","Type":"ContainerStarted","Data":"36ec3b979824ab62e6f7509543dc4f347e7c4493e3f1c85b36fa97144a94acc1"} Dec 04 11:37:35.176806 master-0 kubenswrapper[4745]: E1204 11:37:35.176711 4745 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"openshift-apiserver-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8375671da86aa527ee7e291d86971b0baa823ffc7663b5a983084456e76c0f59\\\"\"" pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" podUID="a5b826c3-8638-4cf5-b974-b24e4282ce00" Dec 04 11:37:35.313700 master-0 kubenswrapper[4745]: I1204 11:37:35.313613 4745 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" podStartSLOduration=4.31359265 podStartE2EDuration="4.31359265s" podCreationTimestamp="2025-12-04 11:37:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:37:35.298912718 +0000 UTC m=+141.000901113" watchObservedRunningTime="2025-12-04 11:37:35.31359265 +0000 UTC m=+141.015581045" Dec 04 11:37:35.439516 master-0 kubenswrapper[4745]: I1204 11:37:35.439307 4745 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" podStartSLOduration=106.439276845 podStartE2EDuration="1m46.439276845s" podCreationTimestamp="2025-12-04 11:35:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:37:35.438341965 +0000 UTC m=+141.140330370" watchObservedRunningTime="2025-12-04 11:37:35.439276845 +0000 UTC m=+141.141265240" Dec 04 11:37:37.658098 master-0 kubenswrapper[4745]: I1204 11:37:37.657973 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:37.658757 master-0 kubenswrapper[4745]: E1204 11:37:37.658179 4745 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Dec 04 11:37:37.658757 master-0 kubenswrapper[4745]: E1204 11:37:37.658305 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs podName:d8fca733-45c8-45b8-8653-ac204e7c6098 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:41.658276445 +0000 UTC m=+207.360265020 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs") pod "network-metrics-daemon-gp57t" (UID: "d8fca733-45c8-45b8-8653-ac204e7c6098") : secret "metrics-daemon-secret" not found Dec 04 11:37:38.670991 master-0 kubenswrapper[4745]: I1204 11:37:38.670874 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:38.670991 master-0 kubenswrapper[4745]: I1204 11:37:38.670970 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:38.670991 master-0 kubenswrapper[4745]: I1204 11:37:38.670997 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:38.671742 master-0 kubenswrapper[4745]: E1204 11:37:38.671196 4745 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/olm-operator-serving-cert: secret "olm-operator-serving-cert" not found Dec 04 11:37:38.671742 master-0 kubenswrapper[4745]: I1204 11:37:38.671232 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:37:38.671742 master-0 kubenswrapper[4745]: E1204 11:37:38.671287 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert podName:7bf67a51-9759-4e2a-a2ae-ef7416cad43f nodeName:}" failed. No retries permitted until 2025-12-04 11:37:46.671267272 +0000 UTC m=+152.373255857 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert") pod "olm-operator-7cd7dbb44c-vzj4q" (UID: "7bf67a51-9759-4e2a-a2ae-ef7416cad43f") : secret "olm-operator-serving-cert" not found Dec 04 11:37:38.671742 master-0 kubenswrapper[4745]: E1204 11:37:38.671293 4745 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Dec 04 11:37:38.671742 master-0 kubenswrapper[4745]: E1204 11:37:38.671342 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls podName:2ab26ae5-0607-4dfd-840e-531d204b5030 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:46.671328443 +0000 UTC m=+152.373316838 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-7ff994598c-p82nn" (UID: "2ab26ae5-0607-4dfd-840e-531d204b5030") : secret "cluster-monitoring-operator-tls" not found Dec 04 11:37:38.671742 master-0 kubenswrapper[4745]: I1204 11:37:38.671364 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:38.671742 master-0 kubenswrapper[4745]: I1204 11:37:38.671393 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:38.671742 master-0 kubenswrapper[4745]: E1204 11:37:38.671412 4745 secret.go:189] Couldn't get secret openshift-ingress-operator/metrics-tls: secret "metrics-tls" not found Dec 04 11:37:38.671742 master-0 kubenswrapper[4745]: E1204 11:37:38.671449 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls podName:b011b1f1-3235-4e20-825b-ce711c052407 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:46.671437957 +0000 UTC m=+152.373426522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls") pod "ingress-operator-8649c48786-cx2b2" (UID: "b011b1f1-3235-4e20-825b-ce711c052407") : secret "metrics-tls" not found Dec 04 11:37:38.671742 master-0 kubenswrapper[4745]: I1204 11:37:38.671471 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:37:38.671742 master-0 kubenswrapper[4745]: E1204 11:37:38.671497 4745 secret.go:189] Couldn't get secret openshift-marketplace/marketplace-operator-metrics: secret "marketplace-operator-metrics" not found Dec 04 11:37:38.671742 master-0 kubenswrapper[4745]: E1204 11:37:38.671505 4745 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/package-server-manager-serving-cert: secret "package-server-manager-serving-cert" not found Dec 04 11:37:38.671742 master-0 kubenswrapper[4745]: E1204 11:37:38.671525 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics podName:fd4c4c6f-380a-4cda-9a21-352b55ec2d98 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:46.67151627 +0000 UTC m=+152.373504675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "marketplace-operator-metrics" (UniqueName: "kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics") pod "marketplace-operator-f797b99b6-hjjrk" (UID: "fd4c4c6f-380a-4cda-9a21-352b55ec2d98") : secret "marketplace-operator-metrics" not found Dec 04 11:37:38.671742 master-0 kubenswrapper[4745]: E1204 11:37:38.671637 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert podName:72faf6d6-e8ca-43d1-b93e-67c11f8d3b46 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:46.671617583 +0000 UTC m=+152.373605978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "package-server-manager-serving-cert" (UniqueName: "kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert") pod "package-server-manager-67477646d4-7hndf" (UID: "72faf6d6-e8ca-43d1-b93e-67c11f8d3b46") : secret "package-server-manager-serving-cert" not found Dec 04 11:37:38.671742 master-0 kubenswrapper[4745]: E1204 11:37:38.671685 4745 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/node-tuning-operator-tls: secret "node-tuning-operator-tls" not found Dec 04 11:37:38.672341 master-0 kubenswrapper[4745]: I1204 11:37:38.671696 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:38.672341 master-0 kubenswrapper[4745]: E1204 11:37:38.671826 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls podName:6f15dcdb-c968-429c-9d1d-63c2becad337 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:46.671783628 +0000 UTC m=+152.373772033 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "node-tuning-operator-tls" (UniqueName: "kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls") pod "cluster-node-tuning-operator-85cff47f46-4gv5j" (UID: "6f15dcdb-c968-429c-9d1d-63c2becad337") : secret "node-tuning-operator-tls" not found Dec 04 11:37:38.672341 master-0 kubenswrapper[4745]: E1204 11:37:38.671860 4745 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/performance-addon-operator-webhook-cert: secret "performance-addon-operator-webhook-cert" not found Dec 04 11:37:38.672341 master-0 kubenswrapper[4745]: I1204 11:37:38.671871 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:38.672341 master-0 kubenswrapper[4745]: E1204 11:37:38.671895 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert podName:6f15dcdb-c968-429c-9d1d-63c2becad337 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:46.671886942 +0000 UTC m=+152.373875337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert") pod "cluster-node-tuning-operator-85cff47f46-4gv5j" (UID: "6f15dcdb-c968-429c-9d1d-63c2becad337") : secret "performance-addon-operator-webhook-cert" not found Dec 04 11:37:38.672341 master-0 kubenswrapper[4745]: E1204 11:37:38.671933 4745 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: secret "multus-admission-controller-secret" not found Dec 04 11:37:38.672341 master-0 kubenswrapper[4745]: E1204 11:37:38.671955 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs podName:08550069-c1a1-475e-84a2-e56905f1ed38 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:46.671947124 +0000 UTC m=+152.373935509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs") pod "multus-admission-controller-7dfc5b745f-258xq" (UID: "08550069-c1a1-475e-84a2-e56905f1ed38") : secret "multus-admission-controller-secret" not found Dec 04 11:37:38.672341 master-0 kubenswrapper[4745]: I1204 11:37:38.672045 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:37:38.672341 master-0 kubenswrapper[4745]: I1204 11:37:38.672088 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:38.672341 master-0 kubenswrapper[4745]: E1204 11:37:38.672099 4745 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/catalog-operator-serving-cert: secret "catalog-operator-serving-cert" not found Dec 04 11:37:38.672341 master-0 kubenswrapper[4745]: E1204 11:37:38.672227 4745 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-operator-tls: secret "image-registry-operator-tls" not found Dec 04 11:37:38.672341 master-0 kubenswrapper[4745]: E1204 11:37:38.672244 4745 secret.go:189] Couldn't get secret openshift-dns-operator/metrics-tls: secret "metrics-tls" not found Dec 04 11:37:38.672341 master-0 kubenswrapper[4745]: E1204 11:37:38.672251 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert podName:434ed9b9-715b-455b-867c-775b256df40f nodeName:}" failed. No retries permitted until 2025-12-04 11:37:46.672215822 +0000 UTC m=+152.374204217 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert") pod "catalog-operator-fbc6455c4-5m8ll" (UID: "434ed9b9-715b-455b-867c-775b256df40f") : secret "catalog-operator-serving-cert" not found Dec 04 11:37:38.672737 master-0 kubenswrapper[4745]: E1204 11:37:38.672369 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls podName:1ade9186-b262-4b5e-9c6f-ba89f0130fb6 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:46.672335546 +0000 UTC m=+152.374323941 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "image-registry-operator-tls" (UniqueName: "kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls") pod "cluster-image-registry-operator-6fb9f88b7-tgvfl" (UID: "1ade9186-b262-4b5e-9c6f-ba89f0130fb6") : secret "image-registry-operator-tls" not found Dec 04 11:37:38.672737 master-0 kubenswrapper[4745]: E1204 11:37:38.672387 4745 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls podName:7c017c69-b24e-4a7a-b888-133bed34c174 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:46.672380098 +0000 UTC m=+152.374368493 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls") pod "dns-operator-7c56cf9b74-xz27r" (UID: "7c017c69-b24e-4a7a-b888-133bed34c174") : secret "metrics-tls" not found Dec 04 11:37:43.207402 master-0 kubenswrapper[4745]: I1204 11:37:43.206464 4745 generic.go:334] "Generic (PLEG): container finished" podID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerID="8b2e6952b1e04c91242f448af7e8c754dbdec6df62ea2d8c6f318ad45c211983" exitCode=0 Dec 04 11:37:43.209113 master-0 kubenswrapper[4745]: I1204 11:37:43.206539 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" event={"ID":"00601c1a-efd4-4366-bdc9-d768afa252b0","Type":"ContainerDied","Data":"8b2e6952b1e04c91242f448af7e8c754dbdec6df62ea2d8c6f318ad45c211983"} Dec 04 11:37:43.210845 master-0 kubenswrapper[4745]: I1204 11:37:43.209765 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" event={"ID":"27576028-d64a-47cd-b76b-d524e41efe37","Type":"ContainerStarted","Data":"125cdcb9380437c2c74e709578e049126370c6c2e8787828f7e5e31c2a5f5cbe"} Dec 04 11:37:43.213003 master-0 kubenswrapper[4745]: I1204 11:37:43.212942 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" event={"ID":"42b3be0f-1d82-4a64-abb4-0118a6960efd","Type":"ContainerStarted","Data":"8543749f8386d25fbc9d05c27b7ab7559de13cecd2f9d2e22a588c804bace527"} Dec 04 11:37:43.217282 master-0 kubenswrapper[4745]: I1204 11:37:43.215733 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" event={"ID":"bac00ac5-0371-48fd-b1cc-60438f08ae94","Type":"ContainerStarted","Data":"c2365e3e1212552c67b403c1062c118ea5e3306eac11c30d2c954d48de545647"} Dec 04 11:37:43.220002 master-0 kubenswrapper[4745]: I1204 11:37:43.219954 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" event={"ID":"fd9f8671-8066-4990-b45d-8b619aa5d9ec","Type":"ContainerStarted","Data":"e0e04ce110c25a2c4a312ed2fdb876c28e02526d17e1277179eb5a2f7c3254e0"} Dec 04 11:37:43.227836 master-0 kubenswrapper[4745]: I1204 11:37:43.224458 4745 generic.go:334] "Generic (PLEG): container finished" podID="0158c2f3-20e5-43f4-875d-c5ad8f6112df" containerID="5f323ae636217996144f9c95442c8e52f9bd99e4069e42ddad8761df1ef87b48" exitCode=0 Dec 04 11:37:43.227836 master-0 kubenswrapper[4745]: I1204 11:37:43.224777 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" event={"ID":"0158c2f3-20e5-43f4-875d-c5ad8f6112df","Type":"ContainerDied","Data":"5f323ae636217996144f9c95442c8e52f9bd99e4069e42ddad8761df1ef87b48"} Dec 04 11:37:43.230141 master-0 kubenswrapper[4745]: I1204 11:37:43.229658 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" event={"ID":"3322cc5a-f1f7-4522-b423-19fb7f38cd43","Type":"ContainerStarted","Data":"c8d34e789c5970b0307d273982d5779a2dcd6c7a7b38f7401ca6eca1e3af06ea"} Dec 04 11:37:43.231861 master-0 kubenswrapper[4745]: I1204 11:37:43.231697 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" event={"ID":"c6e9271a-44ea-4612-ab60-4a9d489ed062","Type":"ContainerStarted","Data":"dc75d44b8be7e058788b5cd96125d7bea4962e131339dd256a97c23ba994b1b7"} Dec 04 11:37:43.234124 master-0 kubenswrapper[4745]: I1204 11:37:43.234043 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" event={"ID":"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8","Type":"ContainerStarted","Data":"b6e0393f35b37b796e29e063a198964a882daa0edec21adc6f195e441be69db7"} Dec 04 11:37:43.240573 master-0 kubenswrapper[4745]: I1204 11:37:43.240463 4745 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-6bc8656fdc-2q7f5" event={"ID":"031d300e-24b4-481c-8b82-fe8cdb3fcef7","Type":"ContainerStarted","Data":"90cc3b6000c187ca85e3ebde189fcb0fb0c22a655e72a22fb82a8f151adb8963"} Dec 04 11:37:43.263525 master-0 kubenswrapper[4745]: I1204 11:37:43.260160 4745 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" podStartSLOduration=105.506740124 podStartE2EDuration="1m54.260109316s" podCreationTimestamp="2025-12-04 11:35:49 +0000 UTC" firstStartedPulling="2025-12-04 11:37:33.76010834 +0000 UTC m=+139.462096735" lastFinishedPulling="2025-12-04 11:37:42.513477532 +0000 UTC m=+148.215465927" observedRunningTime="2025-12-04 11:37:43.260006802 +0000 UTC m=+148.961995187" watchObservedRunningTime="2025-12-04 11:37:43.260109316 +0000 UTC m=+148.962097711" Dec 04 11:37:43.284838 master-0 kubenswrapper[4745]: I1204 11:37:43.281573 4745 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" podStartSLOduration=105.532603655 podStartE2EDuration="1m54.281538694s" podCreationTimestamp="2025-12-04 11:35:49 +0000 UTC" firstStartedPulling="2025-12-04 11:37:33.763469188 +0000 UTC m=+139.465457583" lastFinishedPulling="2025-12-04 11:37:42.512404237 +0000 UTC m=+148.214392622" observedRunningTime="2025-12-04 11:37:43.281246785 +0000 UTC m=+148.983235310" watchObservedRunningTime="2025-12-04 11:37:43.281538694 +0000 UTC m=+148.983527089" Dec 04 11:37:43.312653 master-0 kubenswrapper[4745]: I1204 11:37:43.310739 4745 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" podStartSLOduration=106.563445464 podStartE2EDuration="1m55.310717801s" podCreationTimestamp="2025-12-04 11:35:48 +0000 UTC" firstStartedPulling="2025-12-04 11:37:33.767499137 +0000 UTC m=+139.469487532" lastFinishedPulling="2025-12-04 11:37:42.514771474 +0000 UTC m=+148.216759869" observedRunningTime="2025-12-04 11:37:43.309850434 +0000 UTC m=+149.011838819" watchObservedRunningTime="2025-12-04 11:37:43.310717801 +0000 UTC m=+149.012706196" Dec 04 11:37:43.354370 master-0 kubenswrapper[4745]: I1204 11:37:43.354285 4745 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" podStartSLOduration=104.598826381 podStartE2EDuration="1m53.354255209s" podCreationTimestamp="2025-12-04 11:35:50 +0000 UTC" firstStartedPulling="2025-12-04 11:37:33.757485106 +0000 UTC m=+139.459473501" lastFinishedPulling="2025-12-04 11:37:42.512913934 +0000 UTC m=+148.214902329" observedRunningTime="2025-12-04 11:37:43.33248146 +0000 UTC m=+149.034469865" watchObservedRunningTime="2025-12-04 11:37:43.354255209 +0000 UTC m=+149.056243604" Dec 04 11:37:43.380734 master-0 kubenswrapper[4745]: I1204 11:37:43.378254 4745 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" podStartSLOduration=105.627076996 podStartE2EDuration="1m54.378232859s" podCreationTimestamp="2025-12-04 11:35:49 +0000 UTC" firstStartedPulling="2025-12-04 11:37:33.763943292 +0000 UTC m=+139.465931687" lastFinishedPulling="2025-12-04 11:37:42.515099155 +0000 UTC m=+148.217087550" observedRunningTime="2025-12-04 11:37:43.375914955 +0000 UTC m=+149.077903350" watchObservedRunningTime="2025-12-04 11:37:43.378232859 +0000 UTC m=+149.080221254" Dec 04 11:37:43.420327 master-0 kubenswrapper[4745]: I1204 11:37:43.420218 4745 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" podStartSLOduration=105.674673706 podStartE2EDuration="1m54.420186906s" podCreationTimestamp="2025-12-04 11:35:49 +0000 UTC" firstStartedPulling="2025-12-04 11:37:33.765747281 +0000 UTC m=+139.467735686" lastFinishedPulling="2025-12-04 11:37:42.511260491 +0000 UTC m=+148.213248886" observedRunningTime="2025-12-04 11:37:43.395929667 +0000 UTC m=+149.097918072" watchObservedRunningTime="2025-12-04 11:37:43.420186906 +0000 UTC m=+149.122175301" Dec 04 11:37:43.909240 master-0 kubenswrapper[4745]: I1204 11:37:43.909150 4745 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" podStartSLOduration=106.151589809 podStartE2EDuration="1m54.909121506s" podCreationTimestamp="2025-12-04 11:35:49 +0000 UTC" firstStartedPulling="2025-12-04 11:37:33.756517364 +0000 UTC m=+139.458505759" lastFinishedPulling="2025-12-04 11:37:42.514049061 +0000 UTC m=+148.216037456" observedRunningTime="2025-12-04 11:37:43.422125589 +0000 UTC m=+149.124113984" watchObservedRunningTime="2025-12-04 11:37:43.909121506 +0000 UTC m=+149.611109901" Dec 04 11:37:43.910188 master-0 kubenswrapper[4745]: I1204 11:37:43.910144 4745 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-6bc8656fdc-2q7f5" podStartSLOduration=107.149711819 podStartE2EDuration="1m55.910134868s" podCreationTimestamp="2025-12-04 11:35:48 +0000 UTC" firstStartedPulling="2025-12-04 11:37:33.752235187 +0000 UTC m=+139.454223582" lastFinishedPulling="2025-12-04 11:37:42.512658236 +0000 UTC m=+148.214646631" observedRunningTime="2025-12-04 11:37:43.908306209 +0000 UTC m=+149.610294604" watchObservedRunningTime="2025-12-04 11:37:43.910134868 +0000 UTC m=+149.612123263" Dec 04 11:37:44.879707 master-0 kubenswrapper[4745]: I1204 11:37:44.878342 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr"] Dec 04 11:37:44.886254 master-0 kubenswrapper[4745]: I1204 11:37:44.886204 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" Dec 04 11:37:44.893114 master-0 kubenswrapper[4745]: I1204 11:37:44.891333 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr"] Dec 04 11:37:44.961316 master-0 kubenswrapper[4745]: I1204 11:37:44.960923 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5r7w\" (UniqueName: \"kubernetes.io/projected/38fc8086-a00c-4a2a-8a0e-c57e9d9d0103-kube-api-access-l5r7w\") pod \"csi-snapshot-controller-6b958b6f94-w74zr\" (UID: \"38fc8086-a00c-4a2a-8a0e-c57e9d9d0103\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" Dec 04 11:37:44.974921 master-0 kubenswrapper[4745]: I1204 11:37:44.974877 4745 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-74b7b57c65-d6v67"] Dec 04 11:37:44.975862 master-0 kubenswrapper[4745]: I1204 11:37:44.975844 4745 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-74b7b57c65-d6v67" Dec 04 11:37:44.982282 master-0 kubenswrapper[4745]: I1204 11:37:44.982239 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator"/"openshift-service-ca.crt" Dec 04 11:37:44.982512 master-0 kubenswrapper[4745]: I1204 11:37:44.982464 4745 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator"/"kube-root-ca.crt" Dec 04 11:37:45.066836 master-0 kubenswrapper[4745]: I1204 11:37:45.066297 4745 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxnbc\" (UniqueName: \"kubernetes.io/projected/16057f9c-b1f8-4915-acc3-2d4532af4963-kube-api-access-lxnbc\") pod \"migrator-74b7b57c65-d6v67\" (UID: \"16057f9c-b1f8-4915-acc3-2d4532af4963\") " pod="openshift-kube-storage-version-migrator/migrator-74b7b57c65-d6v67" Dec 04 11:37:45.066836 master-0 kubenswrapper[4745]: I1204 11:37:45.066381 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l5r7w\" (UniqueName: \"kubernetes.io/projected/38fc8086-a00c-4a2a-8a0e-c57e9d9d0103-kube-api-access-l5r7w\") pod \"csi-snapshot-controller-6b958b6f94-w74zr\" (UID: \"38fc8086-a00c-4a2a-8a0e-c57e9d9d0103\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" Dec 04 11:37:45.100019 master-0 kubenswrapper[4745]: I1204 11:37:45.099975 4745 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-74b7b57c65-d6v67"] Dec 04 11:37:45.163475 master-0 kubenswrapper[4745]: I1204 11:37:45.162981 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5r7w\" (UniqueName: \"kubernetes.io/projected/38fc8086-a00c-4a2a-8a0e-c57e9d9d0103-kube-api-access-l5r7w\") pod \"csi-snapshot-controller-6b958b6f94-w74zr\" (UID: \"38fc8086-a00c-4a2a-8a0e-c57e9d9d0103\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" Dec 04 11:37:45.167393 master-0 kubenswrapper[4745]: I1204 11:37:45.167322 4745 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lxnbc\" (UniqueName: \"kubernetes.io/projected/16057f9c-b1f8-4915-acc3-2d4532af4963-kube-api-access-lxnbc\") pod \"migrator-74b7b57c65-d6v67\" (UID: \"16057f9c-b1f8-4915-acc3-2d4532af4963\") " pod="openshift-kube-storage-version-migrator/migrator-74b7b57c65-d6v67" Dec 04 11:37:45.199644 master-0 kubenswrapper[4745]: I1204 11:37:45.199578 4745 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxnbc\" (UniqueName: \"kubernetes.io/projected/16057f9c-b1f8-4915-acc3-2d4532af4963-kube-api-access-lxnbc\") pod \"migrator-74b7b57c65-d6v67\" (UID: \"16057f9c-b1f8-4915-acc3-2d4532af4963\") " pod="openshift-kube-storage-version-migrator/migrator-74b7b57c65-d6v67" Dec 04 11:37:45.524432 master-0 kubenswrapper[4745]: I1204 11:37:45.524111 4745 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Dec 04 11:37:45.524144 master-0 systemd[1]: Stopping Kubernetes Kubelet... Dec 04 11:37:45.539911 master-0 systemd[1]: kubelet.service: Deactivated successfully. Dec 04 11:37:45.540212 master-0 systemd[1]: Stopped Kubernetes Kubelet. Dec 04 11:37:45.544669 master-0 systemd[1]: kubelet.service: Consumed 10.679s CPU time. Dec 04 11:37:45.560995 master-0 systemd[1]: Starting Kubernetes Kubelet... Dec 04 11:37:45.651157 master-0 kubenswrapper[8993]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 11:37:45.651157 master-0 kubenswrapper[8993]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Dec 04 11:37:45.651157 master-0 kubenswrapper[8993]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 11:37:45.651157 master-0 kubenswrapper[8993]: Flag --register-with-taints has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 11:37:45.651157 master-0 kubenswrapper[8993]: Flag --pod-infra-container-image has been deprecated, will be removed in a future release. Image garbage collector will get sandbox image information from CRI. Dec 04 11:37:45.651157 master-0 kubenswrapper[8993]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 11:37:45.652984 master-0 kubenswrapper[8993]: I1204 11:37:45.651245 8993 server.go:211] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Dec 04 11:37:45.655908 master-0 kubenswrapper[8993]: W1204 11:37:45.655359 8993 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 11:37:45.655908 master-0 kubenswrapper[8993]: W1204 11:37:45.655864 8993 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 11:37:45.655908 master-0 kubenswrapper[8993]: W1204 11:37:45.655872 8993 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 11:37:45.655908 master-0 kubenswrapper[8993]: W1204 11:37:45.655886 8993 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 11:37:45.655908 master-0 kubenswrapper[8993]: W1204 11:37:45.655892 8993 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 11:37:45.655908 master-0 kubenswrapper[8993]: W1204 11:37:45.655899 8993 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 11:37:45.655908 master-0 kubenswrapper[8993]: W1204 11:37:45.655905 8993 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 11:37:45.655908 master-0 kubenswrapper[8993]: W1204 11:37:45.655910 8993 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 11:37:45.655908 master-0 kubenswrapper[8993]: W1204 11:37:45.655915 8993 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 11:37:45.655908 master-0 kubenswrapper[8993]: W1204 11:37:45.655922 8993 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 11:37:45.655908 master-0 kubenswrapper[8993]: W1204 11:37:45.655927 8993 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 11:37:45.655908 master-0 kubenswrapper[8993]: W1204 11:37:45.655932 8993 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 11:37:45.655908 master-0 kubenswrapper[8993]: W1204 11:37:45.655937 8993 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 11:37:45.655908 master-0 kubenswrapper[8993]: W1204 11:37:45.655943 8993 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 11:37:45.655908 master-0 kubenswrapper[8993]: W1204 11:37:45.655949 8993 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 11:37:45.655908 master-0 kubenswrapper[8993]: W1204 11:37:45.655955 8993 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 11:37:45.656851 master-0 kubenswrapper[8993]: W1204 11:37:45.655965 8993 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 11:37:45.656851 master-0 kubenswrapper[8993]: W1204 11:37:45.655972 8993 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 11:37:45.656851 master-0 kubenswrapper[8993]: W1204 11:37:45.655978 8993 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 11:37:45.656851 master-0 kubenswrapper[8993]: W1204 11:37:45.655983 8993 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 11:37:45.656851 master-0 kubenswrapper[8993]: W1204 11:37:45.655987 8993 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 11:37:45.656851 master-0 kubenswrapper[8993]: W1204 11:37:45.655993 8993 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 11:37:45.656851 master-0 kubenswrapper[8993]: W1204 11:37:45.655999 8993 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 11:37:45.656851 master-0 kubenswrapper[8993]: W1204 11:37:45.656005 8993 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 11:37:45.656851 master-0 kubenswrapper[8993]: W1204 11:37:45.656010 8993 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 11:37:45.656851 master-0 kubenswrapper[8993]: W1204 11:37:45.656015 8993 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 11:37:45.656851 master-0 kubenswrapper[8993]: W1204 11:37:45.656021 8993 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 11:37:45.656851 master-0 kubenswrapper[8993]: W1204 11:37:45.656026 8993 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 11:37:45.656851 master-0 kubenswrapper[8993]: W1204 11:37:45.656031 8993 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 11:37:45.656851 master-0 kubenswrapper[8993]: W1204 11:37:45.656044 8993 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 11:37:45.656851 master-0 kubenswrapper[8993]: W1204 11:37:45.656056 8993 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 11:37:45.656851 master-0 kubenswrapper[8993]: W1204 11:37:45.656064 8993 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 11:37:45.656851 master-0 kubenswrapper[8993]: W1204 11:37:45.656071 8993 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 11:37:45.656851 master-0 kubenswrapper[8993]: W1204 11:37:45.656078 8993 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 11:37:45.656851 master-0 kubenswrapper[8993]: W1204 11:37:45.656084 8993 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 11:37:45.657475 master-0 kubenswrapper[8993]: W1204 11:37:45.656089 8993 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 11:37:45.657475 master-0 kubenswrapper[8993]: W1204 11:37:45.656143 8993 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 11:37:45.657475 master-0 kubenswrapper[8993]: W1204 11:37:45.656148 8993 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 11:37:45.657475 master-0 kubenswrapper[8993]: W1204 11:37:45.656155 8993 feature_gate.go:330] unrecognized feature gate: Example Dec 04 11:37:45.657475 master-0 kubenswrapper[8993]: W1204 11:37:45.656160 8993 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 11:37:45.657475 master-0 kubenswrapper[8993]: W1204 11:37:45.656165 8993 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 11:37:45.657475 master-0 kubenswrapper[8993]: W1204 11:37:45.656174 8993 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 11:37:45.657475 master-0 kubenswrapper[8993]: W1204 11:37:45.656181 8993 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 11:37:45.657475 master-0 kubenswrapper[8993]: W1204 11:37:45.656187 8993 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 11:37:45.657475 master-0 kubenswrapper[8993]: W1204 11:37:45.656192 8993 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 11:37:45.657475 master-0 kubenswrapper[8993]: W1204 11:37:45.656197 8993 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 11:37:45.657475 master-0 kubenswrapper[8993]: W1204 11:37:45.656203 8993 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 11:37:45.657475 master-0 kubenswrapper[8993]: W1204 11:37:45.656208 8993 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 11:37:45.657475 master-0 kubenswrapper[8993]: W1204 11:37:45.656213 8993 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 11:37:45.657475 master-0 kubenswrapper[8993]: W1204 11:37:45.656219 8993 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 11:37:45.657475 master-0 kubenswrapper[8993]: W1204 11:37:45.656225 8993 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 11:37:45.657475 master-0 kubenswrapper[8993]: W1204 11:37:45.656229 8993 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 11:37:45.657475 master-0 kubenswrapper[8993]: W1204 11:37:45.656234 8993 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 11:37:45.657475 master-0 kubenswrapper[8993]: W1204 11:37:45.656243 8993 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 11:37:45.657475 master-0 kubenswrapper[8993]: W1204 11:37:45.656248 8993 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 11:37:45.659219 master-0 kubenswrapper[8993]: W1204 11:37:45.656253 8993 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 11:37:45.659219 master-0 kubenswrapper[8993]: W1204 11:37:45.656258 8993 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 11:37:45.659219 master-0 kubenswrapper[8993]: W1204 11:37:45.656266 8993 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 11:37:45.659219 master-0 kubenswrapper[8993]: W1204 11:37:45.656270 8993 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 11:37:45.659219 master-0 kubenswrapper[8993]: W1204 11:37:45.656275 8993 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 11:37:45.659219 master-0 kubenswrapper[8993]: W1204 11:37:45.656281 8993 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 11:37:45.659219 master-0 kubenswrapper[8993]: W1204 11:37:45.656398 8993 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 11:37:45.659219 master-0 kubenswrapper[8993]: W1204 11:37:45.656523 8993 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 11:37:45.659219 master-0 kubenswrapper[8993]: W1204 11:37:45.656532 8993 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 11:37:45.659219 master-0 kubenswrapper[8993]: W1204 11:37:45.656548 8993 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 11:37:45.659219 master-0 kubenswrapper[8993]: W1204 11:37:45.656559 8993 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 11:37:45.659219 master-0 kubenswrapper[8993]: W1204 11:37:45.656568 8993 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 11:37:45.659219 master-0 kubenswrapper[8993]: W1204 11:37:45.656575 8993 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 11:37:45.659219 master-0 kubenswrapper[8993]: W1204 11:37:45.656580 8993 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 11:37:45.659219 master-0 kubenswrapper[8993]: W1204 11:37:45.656588 8993 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 11:37:45.659219 master-0 kubenswrapper[8993]: W1204 11:37:45.656595 8993 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 11:37:45.659219 master-0 kubenswrapper[8993]: W1204 11:37:45.656601 8993 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 11:37:45.659219 master-0 kubenswrapper[8993]: I1204 11:37:45.658092 8993 flags.go:64] FLAG: --address="0.0.0.0" Dec 04 11:37:45.659219 master-0 kubenswrapper[8993]: I1204 11:37:45.658148 8993 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Dec 04 11:37:45.659219 master-0 kubenswrapper[8993]: I1204 11:37:45.658164 8993 flags.go:64] FLAG: --anonymous-auth="true" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658176 8993 flags.go:64] FLAG: --application-metrics-count-limit="100" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658187 8993 flags.go:64] FLAG: --authentication-token-webhook="false" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658194 8993 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658205 8993 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658214 8993 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658221 8993 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658227 8993 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658234 8993 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658241 8993 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658248 8993 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658254 8993 flags.go:64] FLAG: --cgroup-root="" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658260 8993 flags.go:64] FLAG: --cgroups-per-qos="true" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658266 8993 flags.go:64] FLAG: --client-ca-file="" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658272 8993 flags.go:64] FLAG: --cloud-config="" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658278 8993 flags.go:64] FLAG: --cloud-provider="" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658283 8993 flags.go:64] FLAG: --cluster-dns="[]" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658294 8993 flags.go:64] FLAG: --cluster-domain="" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658300 8993 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658307 8993 flags.go:64] FLAG: --config-dir="" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658313 8993 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658320 8993 flags.go:64] FLAG: --container-log-max-files="5" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658329 8993 flags.go:64] FLAG: --container-log-max-size="10Mi" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658335 8993 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Dec 04 11:37:45.660336 master-0 kubenswrapper[8993]: I1204 11:37:45.658341 8993 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658347 8993 flags.go:64] FLAG: --containerd-namespace="k8s.io" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658353 8993 flags.go:64] FLAG: --contention-profiling="false" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658359 8993 flags.go:64] FLAG: --cpu-cfs-quota="true" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658366 8993 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658372 8993 flags.go:64] FLAG: --cpu-manager-policy="none" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658378 8993 flags.go:64] FLAG: --cpu-manager-policy-options="" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658391 8993 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658397 8993 flags.go:64] FLAG: --enable-controller-attach-detach="true" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658403 8993 flags.go:64] FLAG: --enable-debugging-handlers="true" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658409 8993 flags.go:64] FLAG: --enable-load-reader="false" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658415 8993 flags.go:64] FLAG: --enable-server="true" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658420 8993 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658447 8993 flags.go:64] FLAG: --event-burst="100" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658452 8993 flags.go:64] FLAG: --event-qps="50" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658458 8993 flags.go:64] FLAG: --event-storage-age-limit="default=0" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658464 8993 flags.go:64] FLAG: --event-storage-event-limit="default=0" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658470 8993 flags.go:64] FLAG: --eviction-hard="" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658479 8993 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658486 8993 flags.go:64] FLAG: --eviction-minimum-reclaim="" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658492 8993 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658497 8993 flags.go:64] FLAG: --eviction-soft="" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658504 8993 flags.go:64] FLAG: --eviction-soft-grace-period="" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658510 8993 flags.go:64] FLAG: --exit-on-lock-contention="false" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658516 8993 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Dec 04 11:37:45.661532 master-0 kubenswrapper[8993]: I1204 11:37:45.658522 8993 flags.go:64] FLAG: --experimental-mounter-path="" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658527 8993 flags.go:64] FLAG: --fail-cgroupv1="false" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658533 8993 flags.go:64] FLAG: --fail-swap-on="true" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658538 8993 flags.go:64] FLAG: --feature-gates="" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658546 8993 flags.go:64] FLAG: --file-check-frequency="20s" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658551 8993 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658557 8993 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658563 8993 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658569 8993 flags.go:64] FLAG: --healthz-port="10248" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658575 8993 flags.go:64] FLAG: --help="false" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658581 8993 flags.go:64] FLAG: --hostname-override="" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658587 8993 flags.go:64] FLAG: --housekeeping-interval="10s" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658593 8993 flags.go:64] FLAG: --http-check-frequency="20s" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658599 8993 flags.go:64] FLAG: --image-credential-provider-bin-dir="" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658605 8993 flags.go:64] FLAG: --image-credential-provider-config="" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658629 8993 flags.go:64] FLAG: --image-gc-high-threshold="85" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658635 8993 flags.go:64] FLAG: --image-gc-low-threshold="80" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658641 8993 flags.go:64] FLAG: --image-service-endpoint="" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658647 8993 flags.go:64] FLAG: --kernel-memcg-notification="false" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658653 8993 flags.go:64] FLAG: --kube-api-burst="100" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658659 8993 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658665 8993 flags.go:64] FLAG: --kube-api-qps="50" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658671 8993 flags.go:64] FLAG: --kube-reserved="" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658677 8993 flags.go:64] FLAG: --kube-reserved-cgroup="" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658683 8993 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658689 8993 flags.go:64] FLAG: --kubelet-cgroups="" Dec 04 11:37:45.662293 master-0 kubenswrapper[8993]: I1204 11:37:45.658695 8993 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658702 8993 flags.go:64] FLAG: --lock-file="" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658707 8993 flags.go:64] FLAG: --log-cadvisor-usage="false" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658713 8993 flags.go:64] FLAG: --log-flush-frequency="5s" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658718 8993 flags.go:64] FLAG: --log-json-info-buffer-size="0" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658730 8993 flags.go:64] FLAG: --log-json-split-stream="false" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658735 8993 flags.go:64] FLAG: --log-text-info-buffer-size="0" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658741 8993 flags.go:64] FLAG: --log-text-split-stream="false" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658747 8993 flags.go:64] FLAG: --logging-format="text" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658752 8993 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658758 8993 flags.go:64] FLAG: --make-iptables-util-chains="true" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658763 8993 flags.go:64] FLAG: --manifest-url="" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658769 8993 flags.go:64] FLAG: --manifest-url-header="" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658778 8993 flags.go:64] FLAG: --max-housekeeping-interval="15s" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658784 8993 flags.go:64] FLAG: --max-open-files="1000000" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658792 8993 flags.go:64] FLAG: --max-pods="110" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658798 8993 flags.go:64] FLAG: --maximum-dead-containers="-1" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658824 8993 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658831 8993 flags.go:64] FLAG: --memory-manager-policy="None" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658837 8993 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658843 8993 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658850 8993 flags.go:64] FLAG: --node-ip="192.168.32.10" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658857 8993 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/control-plane=,node-role.kubernetes.io/master=,node.openshift.io/os_id=rhcos" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658883 8993 flags.go:64] FLAG: --node-status-max-images="50" Dec 04 11:37:45.663079 master-0 kubenswrapper[8993]: I1204 11:37:45.658888 8993 flags.go:64] FLAG: --node-status-update-frequency="10s" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.658922 8993 flags.go:64] FLAG: --oom-score-adj="-999" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.658929 8993 flags.go:64] FLAG: --pod-cidr="" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.658934 8993 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a70b2a95140d1e90978f36cc9889013ae34bd232662c5424002274385669ed9" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.658946 8993 flags.go:64] FLAG: --pod-manifest-path="" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.658952 8993 flags.go:64] FLAG: --pod-max-pids="-1" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.658958 8993 flags.go:64] FLAG: --pods-per-core="0" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.658965 8993 flags.go:64] FLAG: --port="10250" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.658971 8993 flags.go:64] FLAG: --protect-kernel-defaults="false" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.658979 8993 flags.go:64] FLAG: --provider-id="" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.658985 8993 flags.go:64] FLAG: --qos-reserved="" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.658991 8993 flags.go:64] FLAG: --read-only-port="10255" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.658997 8993 flags.go:64] FLAG: --register-node="true" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.659002 8993 flags.go:64] FLAG: --register-schedulable="true" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.659009 8993 flags.go:64] FLAG: --register-with-taints="node-role.kubernetes.io/master=:NoSchedule" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.659022 8993 flags.go:64] FLAG: --registry-burst="10" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.659028 8993 flags.go:64] FLAG: --registry-qps="5" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.659037 8993 flags.go:64] FLAG: --reserved-cpus="" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.659042 8993 flags.go:64] FLAG: --reserved-memory="" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.659052 8993 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.659057 8993 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.659064 8993 flags.go:64] FLAG: --rotate-certificates="false" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.659069 8993 flags.go:64] FLAG: --rotate-server-certificates="false" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.659074 8993 flags.go:64] FLAG: --runonce="false" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.659080 8993 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Dec 04 11:37:45.663862 master-0 kubenswrapper[8993]: I1204 11:37:45.659086 8993 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659093 8993 flags.go:64] FLAG: --seccomp-default="false" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659099 8993 flags.go:64] FLAG: --serialize-image-pulls="true" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659104 8993 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659111 8993 flags.go:64] FLAG: --storage-driver-db="cadvisor" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659117 8993 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659123 8993 flags.go:64] FLAG: --storage-driver-password="root" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659129 8993 flags.go:64] FLAG: --storage-driver-secure="false" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659138 8993 flags.go:64] FLAG: --storage-driver-table="stats" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659144 8993 flags.go:64] FLAG: --storage-driver-user="root" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659149 8993 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659155 8993 flags.go:64] FLAG: --sync-frequency="1m0s" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659162 8993 flags.go:64] FLAG: --system-cgroups="" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659167 8993 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659185 8993 flags.go:64] FLAG: --system-reserved-cgroup="" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659191 8993 flags.go:64] FLAG: --tls-cert-file="" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659197 8993 flags.go:64] FLAG: --tls-cipher-suites="[]" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659205 8993 flags.go:64] FLAG: --tls-min-version="" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659210 8993 flags.go:64] FLAG: --tls-private-key-file="" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659216 8993 flags.go:64] FLAG: --topology-manager-policy="none" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659221 8993 flags.go:64] FLAG: --topology-manager-policy-options="" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659227 8993 flags.go:64] FLAG: --topology-manager-scope="container" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659234 8993 flags.go:64] FLAG: --v="2" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659243 8993 flags.go:64] FLAG: --version="false" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659252 8993 flags.go:64] FLAG: --vmodule="" Dec 04 11:37:45.664594 master-0 kubenswrapper[8993]: I1204 11:37:45.659261 8993 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Dec 04 11:37:45.665355 master-0 kubenswrapper[8993]: I1204 11:37:45.659267 8993 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Dec 04 11:37:45.665355 master-0 kubenswrapper[8993]: W1204 11:37:45.659480 8993 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 11:37:45.665355 master-0 kubenswrapper[8993]: W1204 11:37:45.659489 8993 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 11:37:45.665355 master-0 kubenswrapper[8993]: W1204 11:37:45.659495 8993 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 11:37:45.665355 master-0 kubenswrapper[8993]: W1204 11:37:45.659500 8993 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 11:37:45.665355 master-0 kubenswrapper[8993]: W1204 11:37:45.659504 8993 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 11:37:45.665355 master-0 kubenswrapper[8993]: W1204 11:37:45.659509 8993 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 11:37:45.665355 master-0 kubenswrapper[8993]: W1204 11:37:45.659514 8993 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 11:37:45.665355 master-0 kubenswrapper[8993]: W1204 11:37:45.659518 8993 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 11:37:45.665355 master-0 kubenswrapper[8993]: W1204 11:37:45.659523 8993 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 11:37:45.665355 master-0 kubenswrapper[8993]: W1204 11:37:45.659527 8993 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 11:37:45.665355 master-0 kubenswrapper[8993]: W1204 11:37:45.659532 8993 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 11:37:45.665355 master-0 kubenswrapper[8993]: W1204 11:37:45.659536 8993 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 11:37:45.665355 master-0 kubenswrapper[8993]: W1204 11:37:45.659542 8993 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 11:37:45.665355 master-0 kubenswrapper[8993]: W1204 11:37:45.659552 8993 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 11:37:45.665355 master-0 kubenswrapper[8993]: W1204 11:37:45.659560 8993 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 11:37:45.665355 master-0 kubenswrapper[8993]: W1204 11:37:45.659565 8993 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 11:37:45.665355 master-0 kubenswrapper[8993]: W1204 11:37:45.659570 8993 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 11:37:45.665355 master-0 kubenswrapper[8993]: W1204 11:37:45.659576 8993 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 11:37:45.665881 master-0 kubenswrapper[8993]: W1204 11:37:45.659584 8993 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 11:37:45.665881 master-0 kubenswrapper[8993]: W1204 11:37:45.659591 8993 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 11:37:45.665881 master-0 kubenswrapper[8993]: W1204 11:37:45.659600 8993 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 11:37:45.665881 master-0 kubenswrapper[8993]: W1204 11:37:45.659605 8993 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 11:37:45.665881 master-0 kubenswrapper[8993]: W1204 11:37:45.659611 8993 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 11:37:45.665881 master-0 kubenswrapper[8993]: W1204 11:37:45.659616 8993 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 11:37:45.665881 master-0 kubenswrapper[8993]: W1204 11:37:45.659623 8993 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 11:37:45.665881 master-0 kubenswrapper[8993]: W1204 11:37:45.659628 8993 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 11:37:45.665881 master-0 kubenswrapper[8993]: W1204 11:37:45.659633 8993 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 11:37:45.665881 master-0 kubenswrapper[8993]: W1204 11:37:45.659637 8993 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 11:37:45.665881 master-0 kubenswrapper[8993]: W1204 11:37:45.659642 8993 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 11:37:45.665881 master-0 kubenswrapper[8993]: W1204 11:37:45.659647 8993 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 11:37:45.665881 master-0 kubenswrapper[8993]: W1204 11:37:45.659652 8993 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 11:37:45.665881 master-0 kubenswrapper[8993]: W1204 11:37:45.659657 8993 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 11:37:45.665881 master-0 kubenswrapper[8993]: W1204 11:37:45.659662 8993 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 11:37:45.665881 master-0 kubenswrapper[8993]: W1204 11:37:45.659667 8993 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 11:37:45.665881 master-0 kubenswrapper[8993]: W1204 11:37:45.659672 8993 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 11:37:45.665881 master-0 kubenswrapper[8993]: W1204 11:37:45.659677 8993 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 11:37:45.665881 master-0 kubenswrapper[8993]: W1204 11:37:45.659681 8993 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 11:37:45.665881 master-0 kubenswrapper[8993]: W1204 11:37:45.659689 8993 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 11:37:45.666362 master-0 kubenswrapper[8993]: W1204 11:37:45.659694 8993 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 11:37:45.666362 master-0 kubenswrapper[8993]: W1204 11:37:45.659699 8993 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 11:37:45.666362 master-0 kubenswrapper[8993]: W1204 11:37:45.659704 8993 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 11:37:45.666362 master-0 kubenswrapper[8993]: W1204 11:37:45.659709 8993 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 11:37:45.666362 master-0 kubenswrapper[8993]: W1204 11:37:45.659713 8993 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 11:37:45.666362 master-0 kubenswrapper[8993]: W1204 11:37:45.659719 8993 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 11:37:45.666362 master-0 kubenswrapper[8993]: W1204 11:37:45.659723 8993 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 11:37:45.666362 master-0 kubenswrapper[8993]: W1204 11:37:45.659731 8993 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 11:37:45.666362 master-0 kubenswrapper[8993]: W1204 11:37:45.659738 8993 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 11:37:45.666362 master-0 kubenswrapper[8993]: W1204 11:37:45.659744 8993 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 11:37:45.666362 master-0 kubenswrapper[8993]: W1204 11:37:45.659749 8993 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 11:37:45.666362 master-0 kubenswrapper[8993]: W1204 11:37:45.659753 8993 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 11:37:45.666362 master-0 kubenswrapper[8993]: W1204 11:37:45.659757 8993 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 11:37:45.666362 master-0 kubenswrapper[8993]: W1204 11:37:45.659762 8993 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 11:37:45.666362 master-0 kubenswrapper[8993]: W1204 11:37:45.659766 8993 feature_gate.go:330] unrecognized feature gate: Example Dec 04 11:37:45.666362 master-0 kubenswrapper[8993]: W1204 11:37:45.659771 8993 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 11:37:45.666362 master-0 kubenswrapper[8993]: W1204 11:37:45.659776 8993 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 11:37:45.666362 master-0 kubenswrapper[8993]: W1204 11:37:45.659780 8993 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 11:37:45.666362 master-0 kubenswrapper[8993]: W1204 11:37:45.659785 8993 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 11:37:45.666362 master-0 kubenswrapper[8993]: W1204 11:37:45.659790 8993 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 11:37:45.666971 master-0 kubenswrapper[8993]: W1204 11:37:45.659795 8993 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 11:37:45.666971 master-0 kubenswrapper[8993]: W1204 11:37:45.659802 8993 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 11:37:45.666971 master-0 kubenswrapper[8993]: W1204 11:37:45.659829 8993 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 11:37:45.666971 master-0 kubenswrapper[8993]: W1204 11:37:45.659836 8993 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 11:37:45.666971 master-0 kubenswrapper[8993]: W1204 11:37:45.659840 8993 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 11:37:45.666971 master-0 kubenswrapper[8993]: W1204 11:37:45.659845 8993 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 11:37:45.666971 master-0 kubenswrapper[8993]: W1204 11:37:45.659851 8993 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 11:37:45.666971 master-0 kubenswrapper[8993]: W1204 11:37:45.659856 8993 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 11:37:45.666971 master-0 kubenswrapper[8993]: W1204 11:37:45.659860 8993 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 11:37:45.666971 master-0 kubenswrapper[8993]: W1204 11:37:45.659865 8993 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 11:37:45.666971 master-0 kubenswrapper[8993]: W1204 11:37:45.659869 8993 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 11:37:45.666971 master-0 kubenswrapper[8993]: W1204 11:37:45.659874 8993 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 11:37:45.666971 master-0 kubenswrapper[8993]: W1204 11:37:45.659878 8993 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 11:37:45.666971 master-0 kubenswrapper[8993]: W1204 11:37:45.659883 8993 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 11:37:45.667302 master-0 kubenswrapper[8993]: I1204 11:37:45.659901 8993 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false StreamingCollectionEncodingToJSON:false StreamingCollectionEncodingToProtobuf:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Dec 04 11:37:45.667302 master-0 kubenswrapper[8993]: I1204 11:37:45.666193 8993 server.go:491] "Kubelet version" kubeletVersion="v1.31.13" Dec 04 11:37:45.667302 master-0 kubenswrapper[8993]: I1204 11:37:45.666247 8993 server.go:493] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Dec 04 11:37:45.667302 master-0 kubenswrapper[8993]: W1204 11:37:45.666337 8993 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 11:37:45.667302 master-0 kubenswrapper[8993]: W1204 11:37:45.666345 8993 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 11:37:45.667302 master-0 kubenswrapper[8993]: W1204 11:37:45.666350 8993 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 11:37:45.667302 master-0 kubenswrapper[8993]: W1204 11:37:45.666354 8993 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 11:37:45.667302 master-0 kubenswrapper[8993]: W1204 11:37:45.666358 8993 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 11:37:45.667302 master-0 kubenswrapper[8993]: W1204 11:37:45.666363 8993 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 11:37:45.667302 master-0 kubenswrapper[8993]: W1204 11:37:45.666369 8993 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 11:37:45.667302 master-0 kubenswrapper[8993]: W1204 11:37:45.666375 8993 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 11:37:45.667302 master-0 kubenswrapper[8993]: W1204 11:37:45.666383 8993 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 11:37:45.667302 master-0 kubenswrapper[8993]: W1204 11:37:45.666388 8993 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 11:37:45.667302 master-0 kubenswrapper[8993]: W1204 11:37:45.666393 8993 feature_gate.go:330] unrecognized feature gate: Example Dec 04 11:37:45.667680 master-0 kubenswrapper[8993]: W1204 11:37:45.666397 8993 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 11:37:45.667680 master-0 kubenswrapper[8993]: W1204 11:37:45.666402 8993 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 11:37:45.667680 master-0 kubenswrapper[8993]: W1204 11:37:45.666407 8993 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 11:37:45.667680 master-0 kubenswrapper[8993]: W1204 11:37:45.666411 8993 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 11:37:45.667680 master-0 kubenswrapper[8993]: W1204 11:37:45.666416 8993 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 11:37:45.667680 master-0 kubenswrapper[8993]: W1204 11:37:45.666420 8993 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 11:37:45.667680 master-0 kubenswrapper[8993]: W1204 11:37:45.666424 8993 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 11:37:45.667680 master-0 kubenswrapper[8993]: W1204 11:37:45.666428 8993 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 11:37:45.667680 master-0 kubenswrapper[8993]: W1204 11:37:45.666432 8993 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 11:37:45.667680 master-0 kubenswrapper[8993]: W1204 11:37:45.666436 8993 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 11:37:45.667680 master-0 kubenswrapper[8993]: W1204 11:37:45.666440 8993 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 11:37:45.667680 master-0 kubenswrapper[8993]: W1204 11:37:45.666444 8993 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 11:37:45.667680 master-0 kubenswrapper[8993]: W1204 11:37:45.666448 8993 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 11:37:45.667680 master-0 kubenswrapper[8993]: W1204 11:37:45.666452 8993 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 11:37:45.667680 master-0 kubenswrapper[8993]: W1204 11:37:45.666456 8993 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 11:37:45.667680 master-0 kubenswrapper[8993]: W1204 11:37:45.666460 8993 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 11:37:45.667680 master-0 kubenswrapper[8993]: W1204 11:37:45.666464 8993 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 11:37:45.667680 master-0 kubenswrapper[8993]: W1204 11:37:45.666468 8993 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 11:37:45.667680 master-0 kubenswrapper[8993]: W1204 11:37:45.666472 8993 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 11:37:45.667680 master-0 kubenswrapper[8993]: W1204 11:37:45.666476 8993 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 11:37:45.668197 master-0 kubenswrapper[8993]: W1204 11:37:45.666480 8993 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 11:37:45.668197 master-0 kubenswrapper[8993]: W1204 11:37:45.666484 8993 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 11:37:45.668197 master-0 kubenswrapper[8993]: W1204 11:37:45.666488 8993 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 11:37:45.668197 master-0 kubenswrapper[8993]: W1204 11:37:45.666494 8993 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 11:37:45.668197 master-0 kubenswrapper[8993]: W1204 11:37:45.666500 8993 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 11:37:45.668197 master-0 kubenswrapper[8993]: W1204 11:37:45.666504 8993 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 11:37:45.668197 master-0 kubenswrapper[8993]: W1204 11:37:45.666509 8993 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 11:37:45.668197 master-0 kubenswrapper[8993]: W1204 11:37:45.666514 8993 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 11:37:45.668197 master-0 kubenswrapper[8993]: W1204 11:37:45.666518 8993 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 11:37:45.668197 master-0 kubenswrapper[8993]: W1204 11:37:45.666522 8993 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 11:37:45.668197 master-0 kubenswrapper[8993]: W1204 11:37:45.666526 8993 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 11:37:45.668197 master-0 kubenswrapper[8993]: W1204 11:37:45.666530 8993 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 11:37:45.668197 master-0 kubenswrapper[8993]: W1204 11:37:45.666534 8993 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 11:37:45.668197 master-0 kubenswrapper[8993]: W1204 11:37:45.666538 8993 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 11:37:45.668197 master-0 kubenswrapper[8993]: W1204 11:37:45.666543 8993 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 11:37:45.668197 master-0 kubenswrapper[8993]: W1204 11:37:45.666547 8993 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 11:37:45.668197 master-0 kubenswrapper[8993]: W1204 11:37:45.666552 8993 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 11:37:45.668197 master-0 kubenswrapper[8993]: W1204 11:37:45.666557 8993 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 11:37:45.668197 master-0 kubenswrapper[8993]: W1204 11:37:45.666561 8993 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 11:37:45.668700 master-0 kubenswrapper[8993]: W1204 11:37:45.666566 8993 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 11:37:45.668700 master-0 kubenswrapper[8993]: W1204 11:37:45.666570 8993 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 11:37:45.668700 master-0 kubenswrapper[8993]: W1204 11:37:45.666575 8993 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 11:37:45.668700 master-0 kubenswrapper[8993]: W1204 11:37:45.666579 8993 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 11:37:45.668700 master-0 kubenswrapper[8993]: W1204 11:37:45.666583 8993 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 11:37:45.668700 master-0 kubenswrapper[8993]: W1204 11:37:45.666586 8993 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 11:37:45.668700 master-0 kubenswrapper[8993]: W1204 11:37:45.666590 8993 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 11:37:45.668700 master-0 kubenswrapper[8993]: W1204 11:37:45.666595 8993 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 11:37:45.668700 master-0 kubenswrapper[8993]: W1204 11:37:45.666598 8993 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 11:37:45.668700 master-0 kubenswrapper[8993]: W1204 11:37:45.666603 8993 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 11:37:45.668700 master-0 kubenswrapper[8993]: W1204 11:37:45.666606 8993 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 11:37:45.668700 master-0 kubenswrapper[8993]: W1204 11:37:45.666610 8993 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 11:37:45.668700 master-0 kubenswrapper[8993]: W1204 11:37:45.666614 8993 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 11:37:45.668700 master-0 kubenswrapper[8993]: W1204 11:37:45.666618 8993 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 11:37:45.668700 master-0 kubenswrapper[8993]: W1204 11:37:45.666623 8993 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 11:37:45.668700 master-0 kubenswrapper[8993]: W1204 11:37:45.666627 8993 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 11:37:45.668700 master-0 kubenswrapper[8993]: W1204 11:37:45.666630 8993 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 11:37:45.668700 master-0 kubenswrapper[8993]: W1204 11:37:45.666634 8993 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 11:37:45.668700 master-0 kubenswrapper[8993]: W1204 11:37:45.666638 8993 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 11:37:45.668700 master-0 kubenswrapper[8993]: W1204 11:37:45.666641 8993 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 11:37:45.669499 master-0 kubenswrapper[8993]: W1204 11:37:45.666647 8993 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 11:37:45.669499 master-0 kubenswrapper[8993]: W1204 11:37:45.666650 8993 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 11:37:45.669499 master-0 kubenswrapper[8993]: I1204 11:37:45.666658 8993 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false StreamingCollectionEncodingToJSON:false StreamingCollectionEncodingToProtobuf:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Dec 04 11:37:45.669499 master-0 kubenswrapper[8993]: W1204 11:37:45.666798 8993 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 11:37:45.669499 master-0 kubenswrapper[8993]: W1204 11:37:45.666819 8993 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 11:37:45.669499 master-0 kubenswrapper[8993]: W1204 11:37:45.666823 8993 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 11:37:45.669499 master-0 kubenswrapper[8993]: W1204 11:37:45.666827 8993 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 11:37:45.669499 master-0 kubenswrapper[8993]: W1204 11:37:45.666831 8993 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 11:37:45.669499 master-0 kubenswrapper[8993]: W1204 11:37:45.666835 8993 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 11:37:45.669499 master-0 kubenswrapper[8993]: W1204 11:37:45.666840 8993 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 11:37:45.669499 master-0 kubenswrapper[8993]: W1204 11:37:45.666844 8993 feature_gate.go:330] unrecognized feature gate: Example Dec 04 11:37:45.669499 master-0 kubenswrapper[8993]: W1204 11:37:45.666849 8993 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 11:37:45.669499 master-0 kubenswrapper[8993]: W1204 11:37:45.666855 8993 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 11:37:45.669499 master-0 kubenswrapper[8993]: W1204 11:37:45.666859 8993 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 11:37:45.669499 master-0 kubenswrapper[8993]: W1204 11:37:45.666863 8993 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 11:37:45.669989 master-0 kubenswrapper[8993]: W1204 11:37:45.666867 8993 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 11:37:45.669989 master-0 kubenswrapper[8993]: W1204 11:37:45.666871 8993 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 11:37:45.669989 master-0 kubenswrapper[8993]: W1204 11:37:45.666874 8993 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 11:37:45.669989 master-0 kubenswrapper[8993]: W1204 11:37:45.666878 8993 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 11:37:45.669989 master-0 kubenswrapper[8993]: W1204 11:37:45.666882 8993 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 11:37:45.669989 master-0 kubenswrapper[8993]: W1204 11:37:45.666886 8993 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 11:37:45.669989 master-0 kubenswrapper[8993]: W1204 11:37:45.666889 8993 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 11:37:45.669989 master-0 kubenswrapper[8993]: W1204 11:37:45.666896 8993 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 11:37:45.669989 master-0 kubenswrapper[8993]: W1204 11:37:45.666900 8993 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 11:37:45.669989 master-0 kubenswrapper[8993]: W1204 11:37:45.666905 8993 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 11:37:45.669989 master-0 kubenswrapper[8993]: W1204 11:37:45.666909 8993 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 11:37:45.669989 master-0 kubenswrapper[8993]: W1204 11:37:45.666913 8993 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 11:37:45.669989 master-0 kubenswrapper[8993]: W1204 11:37:45.666917 8993 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 11:37:45.669989 master-0 kubenswrapper[8993]: W1204 11:37:45.666921 8993 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 11:37:45.669989 master-0 kubenswrapper[8993]: W1204 11:37:45.666925 8993 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 11:37:45.669989 master-0 kubenswrapper[8993]: W1204 11:37:45.666930 8993 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 11:37:45.669989 master-0 kubenswrapper[8993]: W1204 11:37:45.666935 8993 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 11:37:45.669989 master-0 kubenswrapper[8993]: W1204 11:37:45.666941 8993 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 11:37:45.669989 master-0 kubenswrapper[8993]: W1204 11:37:45.666947 8993 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 11:37:45.669989 master-0 kubenswrapper[8993]: W1204 11:37:45.666953 8993 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 11:37:45.670649 master-0 kubenswrapper[8993]: W1204 11:37:45.666959 8993 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 11:37:45.670649 master-0 kubenswrapper[8993]: W1204 11:37:45.666964 8993 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 11:37:45.670649 master-0 kubenswrapper[8993]: W1204 11:37:45.666969 8993 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 11:37:45.670649 master-0 kubenswrapper[8993]: W1204 11:37:45.666974 8993 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 11:37:45.670649 master-0 kubenswrapper[8993]: W1204 11:37:45.666978 8993 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 11:37:45.670649 master-0 kubenswrapper[8993]: W1204 11:37:45.666983 8993 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 11:37:45.670649 master-0 kubenswrapper[8993]: W1204 11:37:45.666990 8993 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 11:37:45.670649 master-0 kubenswrapper[8993]: W1204 11:37:45.666995 8993 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 11:37:45.670649 master-0 kubenswrapper[8993]: W1204 11:37:45.666999 8993 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 11:37:45.670649 master-0 kubenswrapper[8993]: W1204 11:37:45.667003 8993 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 11:37:45.670649 master-0 kubenswrapper[8993]: W1204 11:37:45.667007 8993 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 11:37:45.670649 master-0 kubenswrapper[8993]: W1204 11:37:45.667011 8993 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 11:37:45.670649 master-0 kubenswrapper[8993]: W1204 11:37:45.667015 8993 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 11:37:45.670649 master-0 kubenswrapper[8993]: W1204 11:37:45.667019 8993 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 11:37:45.670649 master-0 kubenswrapper[8993]: W1204 11:37:45.667024 8993 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 11:37:45.670649 master-0 kubenswrapper[8993]: W1204 11:37:45.667029 8993 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 11:37:45.670649 master-0 kubenswrapper[8993]: W1204 11:37:45.667034 8993 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 11:37:45.670649 master-0 kubenswrapper[8993]: W1204 11:37:45.667038 8993 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 11:37:45.670649 master-0 kubenswrapper[8993]: W1204 11:37:45.667042 8993 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 11:37:45.671777 master-0 kubenswrapper[8993]: W1204 11:37:45.667047 8993 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 11:37:45.671777 master-0 kubenswrapper[8993]: W1204 11:37:45.667051 8993 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 11:37:45.671777 master-0 kubenswrapper[8993]: W1204 11:37:45.667055 8993 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 11:37:45.671777 master-0 kubenswrapper[8993]: W1204 11:37:45.667060 8993 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 11:37:45.671777 master-0 kubenswrapper[8993]: W1204 11:37:45.667064 8993 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 11:37:45.671777 master-0 kubenswrapper[8993]: W1204 11:37:45.667068 8993 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 11:37:45.671777 master-0 kubenswrapper[8993]: W1204 11:37:45.667073 8993 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 11:37:45.671777 master-0 kubenswrapper[8993]: W1204 11:37:45.667077 8993 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 11:37:45.671777 master-0 kubenswrapper[8993]: W1204 11:37:45.667081 8993 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 11:37:45.671777 master-0 kubenswrapper[8993]: W1204 11:37:45.667085 8993 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 11:37:45.671777 master-0 kubenswrapper[8993]: W1204 11:37:45.667089 8993 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 11:37:45.671777 master-0 kubenswrapper[8993]: W1204 11:37:45.667093 8993 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 11:37:45.671777 master-0 kubenswrapper[8993]: W1204 11:37:45.667097 8993 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 11:37:45.671777 master-0 kubenswrapper[8993]: W1204 11:37:45.667101 8993 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 11:37:45.671777 master-0 kubenswrapper[8993]: W1204 11:37:45.667104 8993 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 11:37:45.671777 master-0 kubenswrapper[8993]: W1204 11:37:45.667108 8993 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 11:37:45.671777 master-0 kubenswrapper[8993]: W1204 11:37:45.667112 8993 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 11:37:45.671777 master-0 kubenswrapper[8993]: W1204 11:37:45.667116 8993 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 11:37:45.671777 master-0 kubenswrapper[8993]: W1204 11:37:45.667122 8993 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 11:37:45.672352 master-0 kubenswrapper[8993]: W1204 11:37:45.667125 8993 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 11:37:45.672352 master-0 kubenswrapper[8993]: W1204 11:37:45.667129 8993 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 11:37:45.672352 master-0 kubenswrapper[8993]: I1204 11:37:45.667136 8993 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false StreamingCollectionEncodingToJSON:false StreamingCollectionEncodingToProtobuf:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Dec 04 11:37:45.672352 master-0 kubenswrapper[8993]: I1204 11:37:45.667374 8993 server.go:940] "Client rotation is on, will bootstrap in background" Dec 04 11:37:45.672352 master-0 kubenswrapper[8993]: I1204 11:37:45.669135 8993 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Dec 04 11:37:45.672352 master-0 kubenswrapper[8993]: I1204 11:37:45.669220 8993 certificate_store.go:130] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-client-current.pem". Dec 04 11:37:45.672352 master-0 kubenswrapper[8993]: I1204 11:37:45.669416 8993 server.go:997] "Starting client certificate rotation" Dec 04 11:37:45.672352 master-0 kubenswrapper[8993]: I1204 11:37:45.669425 8993 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Certificate rotation is enabled Dec 04 11:37:45.672352 master-0 kubenswrapper[8993]: I1204 11:37:45.669603 8993 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Certificate expiration is 2025-12-05 11:26:53 +0000 UTC, rotation deadline is 2025-12-05 06:46:40.412958548 +0000 UTC Dec 04 11:37:45.672352 master-0 kubenswrapper[8993]: I1204 11:37:45.669648 8993 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Waiting 19h8m54.743312934s for next certificate rotation Dec 04 11:37:45.672352 master-0 kubenswrapper[8993]: I1204 11:37:45.670004 8993 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Dec 04 11:37:45.672352 master-0 kubenswrapper[8993]: I1204 11:37:45.671372 8993 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Dec 04 11:37:45.680031 master-0 kubenswrapper[8993]: I1204 11:37:45.678138 8993 log.go:25] "Validated CRI v1 runtime API" Dec 04 11:37:45.681406 master-0 kubenswrapper[8993]: I1204 11:37:45.681058 8993 log.go:25] "Validated CRI v1 image API" Dec 04 11:37:45.683251 master-0 kubenswrapper[8993]: I1204 11:37:45.682134 8993 server.go:1437] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Dec 04 11:37:45.690633 master-0 kubenswrapper[8993]: I1204 11:37:45.688920 8993 fs.go:135] Filesystem UUIDs: map[1a7dfbc4-59c8-49fb-a376-2f3ae5e5e818:/dev/vda3 7B77-95E7:/dev/vda2 910678ff-f77e-4a7d-8d53-86f2ac47a823:/dev/vda4] Dec 04 11:37:45.692329 master-0 kubenswrapper[8993]: I1204 11:37:45.688997 8993 fs.go:136] Filesystem partitions: map[/dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /dev/vda3:{mountpoint:/boot major:252 minor:3 fsType:ext4 blockSize:0} /dev/vda4:{mountpoint:/var major:252 minor:4 fsType:xfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0d019de7666ab420398ef1b6b5ac581f64802cb56fe4c2b360c11b041de71dc5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0d019de7666ab420398ef1b6b5ac581f64802cb56fe4c2b360c11b041de71dc5/userdata/shm major:0 minor:344 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1118687f000f059298fcb4f89292520334eab60bb7e784774b74bdb9bc2421bc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1118687f000f059298fcb4f89292520334eab60bb7e784774b74bdb9bc2421bc/userdata/shm major:0 minor:50 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/25835b8cd52c0d1fb7ed133702ef424c403a978f32d5722b14d0bf7744915891/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/25835b8cd52c0d1fb7ed133702ef424c403a978f32d5722b14d0bf7744915891/userdata/shm major:0 minor:132 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/34d78076625efac7bdb2340b596443baa5d08eac7ab61fe519fdb353374c6f2a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/34d78076625efac7bdb2340b596443baa5d08eac7ab61fe519fdb353374c6f2a/userdata/shm major:0 minor:331 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4c6405b67db7763561b4f0f867c268ed82b2dcb8dc4a31ac8bd955b23c489a04/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4c6405b67db7763561b4f0f867c268ed82b2dcb8dc4a31ac8bd955b23c489a04/userdata/shm major:0 minor:342 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/52fc4812931b1d912474af968926c8a3a29e2b1cbdfed78532122ce1dc286a99/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/52fc4812931b1d912474af968926c8a3a29e2b1cbdfed78532122ce1dc286a99/userdata/shm major:0 minor:334 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/59191695c89f8cecbba881756b5ffc5e4c892fd02facf20cc198ade1bf4ec267/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/59191695c89f8cecbba881756b5ffc5e4c892fd02facf20cc198ade1bf4ec267/userdata/shm major:0 minor:46 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6080c82a1de6439e859491a681111c8d2ae9907c581f1c30e651428ab5f16038/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6080c82a1de6439e859491a681111c8d2ae9907c581f1c30e651428ab5f16038/userdata/shm major:0 minor:58 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/612a0c5312df7f19a5e3a086b42a22b55f539c232badbe0a03979b12eb756461/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/612a0c5312df7f19a5e3a086b42a22b55f539c232badbe0a03979b12eb756461/userdata/shm major:0 minor:343 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6cab7196e003292e61274a565af49a44adbe51e465702618783576ef89e2744f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6cab7196e003292e61274a565af49a44adbe51e465702618783576ef89e2744f/userdata/shm major:0 minor:330 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/853c784d56688f268e88966f202d566476596a385a8e279f2c38cf8e7278c8d9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/853c784d56688f268e88966f202d566476596a385a8e279f2c38cf8e7278c8d9/userdata/shm major:0 minor:161 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/870c232b93a5ee37a81fedb1347de97a51e51c964baa741a79bf8da03ca09932/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/870c232b93a5ee37a81fedb1347de97a51e51c964baa741a79bf8da03ca09932/userdata/shm major:0 minor:54 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/adbbc7afd8e54e79f29b174cb989cf3e7455023359f413af406ae4a4afbf2ab4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/adbbc7afd8e54e79f29b174cb989cf3e7455023359f413af406ae4a4afbf2ab4/userdata/shm major:0 minor:147 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/adbccd36bc5c65e5e88e6060aa8c07788d2d0acd9edee809c8e2d70678390332/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/adbccd36bc5c65e5e88e6060aa8c07788d2d0acd9edee809c8e2d70678390332/userdata/shm major:0 minor:41 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b05c03ee7421430935dd045065b562c6c4243474d783822f7feef789f201d335/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b05c03ee7421430935dd045065b562c6c4243474d783822f7feef789f201d335/userdata/shm major:0 minor:160 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b19546f46eaddad7163bb8c25c987ab9b0d1e6ccae50bd40bb5bd44e80ea64cb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b19546f46eaddad7163bb8c25c987ab9b0d1e6ccae50bd40bb5bd44e80ea64cb/userdata/shm major:0 minor:188 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ca886b4e0bb939f02a59e692a7e818915eb829261d10e2563a1a2a60bb3e4c87/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ca886b4e0bb939f02a59e692a7e818915eb829261d10e2563a1a2a60bb3e4c87/userdata/shm major:0 minor:349 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cbad8f519fca5622e25075665c609020a4c168f05797a0e7395559b78b81984d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cbad8f519fca5622e25075665c609020a4c168f05797a0e7395559b78b81984d/userdata/shm major:0 minor:338 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cd9dab7f7f5afa841cd8a4ded039df1dd1c65380acd9d3f01a8545a60b7ba60d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cd9dab7f7f5afa841cd8a4ded039df1dd1c65380acd9d3f01a8545a60b7ba60d/userdata/shm major:0 minor:128 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d9d667bd2c388cdba21d0d98e8c8985f6bb62287cc7f32d5b257b5a3ca9351a1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d9d667bd2c388cdba21d0d98e8c8985f6bb62287cc7f32d5b257b5a3ca9351a1/userdata/shm major:0 minor:336 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/da23ebdcd7c632c968f1dcc14625f7875764a703fd10b23106235b76064c9498/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/da23ebdcd7c632c968f1dcc14625f7875764a703fd10b23106235b76064c9498/userdata/shm major:0 minor:328 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e64b7e965ab85bcd41866acdf04d1346eef2d43597395fb0ad995548a3c03068/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e64b7e965ab85bcd41866acdf04d1346eef2d43597395fb0ad995548a3c03068/userdata/shm major:0 minor:326 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/eadb6c5599ab1a4ae90f8ecda2c7a886a86c701b1c6361b22d8aa8fc4c814262/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/eadb6c5599ab1a4ae90f8ecda2c7a886a86c701b1c6361b22d8aa8fc4c814262/userdata/shm major:0 minor:306 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fa255b4fd328cf99db08eb2b43e9c35a73e8f688d9352d1ab6ed516f93712d61/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fa255b4fd328cf99db08eb2b43e9c35a73e8f688d9352d1ab6ed516f93712d61/userdata/shm major:0 minor:340 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:30 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/00601c1a-efd4-4366-bdc9-d768afa252b0/volumes/kubernetes.io~projected/kube-api-access-2g7bh:{mountpoint:/var/lib/kubelet/pods/00601c1a-efd4-4366-bdc9-d768afa252b0/volumes/kubernetes.io~projected/kube-api-access-2g7bh major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/00601c1a-efd4-4366-bdc9-d768afa252b0/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/00601c1a-efd4-4366-bdc9-d768afa252b0/volumes/kubernetes.io~secret/serving-cert major:0 minor:299 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0158c2f3-20e5-43f4-875d-c5ad8f6112df/volumes/kubernetes.io~projected/kube-api-access-8cxbd:{mountpoint:/var/lib/kubelet/pods/0158c2f3-20e5-43f4-875d-c5ad8f6112df/volumes/kubernetes.io~projected/kube-api-access-8cxbd major:0 minor:317 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0158c2f3-20e5-43f4-875d-c5ad8f6112df/volumes/kubernetes.io~secret/cluster-olm-operator-serving-cert:{mountpoint:/var/lib/kubelet/pods/0158c2f3-20e5-43f4-875d-c5ad8f6112df/volumes/kubernetes.io~secret/cluster-olm-operator-serving-cert major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/031d300e-24b4-481c-8b82-fe8cdb3fcef7/volumes/kubernetes.io~projected/kube-api-access-k7bhn:{mountpoint:/var/lib/kubelet/pods/031d300e-24b4-481c-8b82-fe8cdb3fcef7/volumes/kubernetes.io~projected/kube-api-access-k7bhn major:0 minor:320 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/08550069-c1a1-475e-84a2-e56905f1ed38/volumes/kubernetes.io~projected/kube-api-access-8cffn:{mountpoint:/var/lib/kubelet/pods/08550069-c1a1-475e-84a2-e56905f1ed38/volumes/kubernetes.io~projected/kube-api-access-8cffn major:0 minor:301 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/157eab0c-0d8d-486b-a349-c2e466e18e0c/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/157eab0c-0d8d-486b-a349-c2e466e18e0c/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:24 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/157eab0c-0d8d-486b-a349-c2e466e18e0c/volumes/kubernetes.io~projected/kube-api-access-p2mhg:{mountpoint:/var/lib/kubelet/pods/157eab0c-0d8d-486b-a349-c2e466e18e0c/volumes/kubernetes.io~projected/kube-api-access-p2mhg major:0 minor:158 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/157eab0c-0d8d-486b-a349-c2e466e18e0c/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/157eab0c-0d8d-486b-a349-c2e466e18e0c/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:157 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/16057f9c-b1f8-4915-acc3-2d4532af4963/volumes/kubernetes.io~projected/kube-api-access-lxnbc:{mountpoint:/var/lib/kubelet/pods/16057f9c-b1f8-4915-acc3-2d4532af4963/volumes/kubernetes.io~projected/kube-api-access-lxnbc major:0 minor:468 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ade9186-b262-4b5e-9c6f-ba89f0130fb6/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/1ade9186-b262-4b5e-9c6f-ba89f0130fb6/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:321 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ade9186-b262-4b5e-9c6f-ba89f0130fb6/volumes/kubernetes.io~projected/kube-api-access-t46k7:{mountpoint:/var/lib/kubelet/pods/1ade9186-b262-4b5e-9c6f-ba89f0130fb6/volumes/kubernetes.io~projected/kube-api-access-t46k7 major:0 minor:323 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/27576028-d64a-47cd-b76b-d524e41efe37/volumes/kubernetes.io~projected/kube-api-access:{mountpoint:/var/lib/kubelet/pods/27576028-d64a-47cd-b76b-d524e41efe37/volumes/kubernetes.io~projected/kube-api-access major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/27576028-d64a-47cd-b76b-d524e41efe37/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/27576028-d64a-47cd-b76b-d524e41efe37/volumes/kubernetes.io~secret/serving-cert major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/287fba2d-f56d-4ec0-b796-7849a68fb411/volumes/kubernetes.io~projected/kube-api-access-gmdvf:{mountpoint:/var/lib/kubelet/pods/287fba2d-f56d-4ec0-b796-7849a68fb411/volumes/kubernetes.io~projected/kube-api-access-gmdvf major:0 minor:159 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/287fba2d-f56d-4ec0-b796-7849a68fb411/volumes/kubernetes.io~secret/ovn-control-plane-metrics-cert:{mountpoint:/var/lib/kubelet/pods/287fba2d-f56d-4ec0-b796-7849a68fb411/volumes/kubernetes.io~secret/ovn-control-plane-metrics-cert major:0 minor:156 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ab26ae5-0607-4dfd-840e-531d204b5030/volumes/kubernetes.io~projected/kube-api-access-mvzrc:{mountpoint:/var/lib/kubelet/pods/2ab26ae5-0607-4dfd-840e-531d204b5030/volumes/kubernetes.io~projected/kube-api-access-mvzrc major:0 minor:303 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/330553d2-40ea-4496-8346-2e5bf680669b/volumes/kubernetes.io~projected/kube-api-access-59pbp:{mountpoint:/var/lib/kubelet/pods/330553d2-40ea-4496-8346-2e5bf680669b/volumes/kubernetes.io~projected/kube-api-access-59pbp major:0 minor:348 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3322cc5a-f1f7-4522-b423-19fb7f38cd43/volumes/kubernetes.io~projected/kube-api-access-k449s:{mountpoint:/var/lib/kubelet/pods/3322cc5a-f1f7-4522-b423-19fb7f38cd43/volumes/kubernetes.io~projected/kube-api-access-k449s major:0 minor:315 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3322cc5a-f1f7-4522-b423-19fb7f38cd43/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/3322cc5a-f1f7-4522-b423-19fb7f38cd43/volumes/kubernetes.io~secret/serving-cert major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/volumes/kubernetes.io~projected/kube-api-access-l5r7w:{mountpoint:/var/lib/kubelet/pods/38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/volumes/kubernetes.io~projected/kube-api-access-l5r7w major:0 minor:467 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/42b3be0f-1d82-4a64-abb4-0118a6960efd/volumes/kubernetes.io~projected/kube-api-access-c7xwd:{mountpoint:/var/lib/kubelet/pods/42b3be0f-1d82-4a64-abb4-0118a6960efd/volumes/kubernetes.io~projected/kube-api-access-c7xwd major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/42b3be0f-1d82-4a64-abb4-0118a6960efd/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/42b3be0f-1d82-4a64-abb4-0118a6960efd/volumes/kubernetes.io~secret/serving-cert major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/434ed9b9-715b-455b-867c-775b256df40f/volumes/kubernetes.io~projected/kube-api-access-ggzfm:{mountpoint:/var/lib/kubelet/pods/434ed9b9-715b-455b-867c-775b256df40f/volumes/kubernetes.io~projected/kube-api-access-ggzfm major:0 minor:304 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/434ed9b9-715b-455b-867c-775b256df40f/volumes/kubernetes.io~secret/profile-collector-cert:{mountpoint:/var/lib/kubelet/pods/434ed9b9-715b-455b-867c-775b256df40f/volumes/kubernetes.io~secret/profile-collector-cert major:0 minor:297 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/69640270-09e6-4217-b1c8-3d3465c0c3ae/volumes/kubernetes.io~projected/kube-api-access:{mountpoint:/var/lib/kubelet/pods/69640270-09e6-4217-b1c8-3d3465c0c3ae/volumes/kubernetes.io~projected/kube-api-access major:0 minor:126 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6f15dcdb-c968-429c-9d1d-63c2becad337/volumes/kubernetes.io~projected/kube-api-access-kkjzz:{mountpoint:/var/lib/kubelet/pods/6f15dcdb-c968-429c-9d1d-63c2becad337/volumes/kubernetes.io~projected/kube-api-access-kkjzz major:0 minor:322 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7203ec93-6572-4032-825c-140029a86058/volumes/kubernetes.io~projected/kube-api-access-gkcj4:{mountpoint:/var/lib/kubelet/pods/7203ec93-6572-4032-825c-140029a86058/volumes/kubernetes.io~projected/kube-api-access-gkcj4 major:0 minor:185 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7203ec93-6572-4032-825c-140029a86058/volumes/kubernetes.io~secret/webhook-cert:{mountpoint:/var/lib/kubelet/pods/7203ec93-6572-4032-825c-140029a86058/volumes/kubernetes.io~secret/webhook-cert major:0 minor:194 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46/volumes/kubernetes.io~projected/kube-api-access-ckwnn:{mountpoint:/var/lib/kubelet/pods/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46/volumes/kubernetes.io~projected/kube-api-access-ckwnn major:0 minor:313 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7bf67a51-9759-4e2a-a2ae-ef7416cad43f/volumes/kubernetes.io~projected/kube-api-access-zr454:{mountpoint:/var/lib/kubelet/pods/7bf67a51-9759-4e2a-a2ae-ef7416cad43f/volumes/kubernetes.io~projected/kube-api-access-zr454 major:0 minor:319 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7bf67a51-9759-4e2a-a2ae-ef7416cad43f/volumes/kubernetes.io~secret/profile-collector-cert:{mountpoint:/var/lib/kubelet/pods/7bf67a51-9759-4e2a-a2ae-ef7416cad43f/volumes/kubernetes.io~secret/profile-collector-cert major:0 minor:294 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7c017c69-b24e-4a7a-b888-133bed34c174/volumes/kubernetes.io~projected/kube-api-access-tlr76:{mountpoint:/var/lib/kubelet/pods/7c017c69-b24e-4a7a-b888-133bed34c174/volumes/kubernetes.io~projected/kube-api-access-tlr76 major:0 minor:302 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8/volumes/kubernetes.io~projected/kube-api-access-n6bhm:{mountpoint:/var/lib/kubelet/pods/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8/volumes/kubernetes.io~projected/kube-api-access-n6bhm major:0 minor:312 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8/volumes/kubernetes.io~secret/serving-cert major:0 minor:289 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a5b826c3-8638-4cf5-b974-b24e4282ce00/volumes/kubernetes.io~projected/kube-api-access-rhmlm:{mountpoint:/var/lib/kubelet/pods/a5b826c3-8638-4cf5-b974-b24e4282ce00/volumes/kubernetes.io~projected/kube-api-access-rhmlm major:0 minor:325 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a5b826c3-8638-4cf5-b974-b24e4282ce00/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/a5b826c3-8638-4cf5-b974-b24e4282ce00/volumes/kubernetes.io~secret/serving-cert major:0 minor:286 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b011b1f1-3235-4e20-825b-ce711c052407/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/b011b1f1-3235-4e20-825b-ce711c052407/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:300 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b011b1f1-3235-4e20-825b-ce711c052407/volumes/kubernetes.io~projected/kube-api-access-jq49f:{mountpoint:/var/lib/kubelet/pods/b011b1f1-3235-4e20-825b-ce711c052407/volumes/kubernetes.io~projected/kube-api-access-jq49f major:0 minor:309 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bac00ac5-0371-48fd-b1cc-60438f08ae94/volumes/kubernetes.io~projected/kube-api-access:{mountpoint:/var/lib/kubelet/pods/bac00ac5-0371-48fd-b1cc-60438f08ae94/volumes/kubernetes.io~projected/kube-api-access major:0 minor:311 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bac00ac5-0371-48fd-b1cc-60438f08ae94/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/bac00ac5-0371-48fd-b1cc-60438f08ae94/volumes/kubernetes.io~secret/serving-cert major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bdfcb644-24ef-4a33-93ae-a855e872d29a/volumes/kubernetes.io~projected/kube-api-access-f4w2j:{mountpoint:/var/lib/kubelet/pods/bdfcb644-24ef-4a33-93ae-a855e872d29a/volumes/kubernetes.io~projected/kube-api-access-f4w2j major:0 minor:146 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c6e9271a-44ea-4612-ab60-4a9d489ed062/volumes/kubernetes.io~projected/kube-api-access-cdsq5:{mountpoint:/var/lib/kubelet/pods/c6e9271a-44ea-4612-ab60-4a9d489ed062/volumes/kubernetes.io~projected/kube-api-access-cdsq5 major:0 minor:324 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c6e9271a-44ea-4612-ab60-4a9d489ed062/volumes/kubernetes.io~secret/etcd-client:{mountpoint:/var/lib/kubelet/pods/c6e9271a-44ea-4612-ab60-4a9d489ed062/volumes/kubernetes.io~secret/etcd-client major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c6e9271a-44ea-4612-ab60-4a9d489ed062/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/c6e9271a-44ea-4612-ab60-4a9d489ed062/volumes/kubernetes.io~secret/serving-cert major:0 minor:298 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c790c174-dc60-4f34-8818-3b367fbe3a5f/volumes/kubernetes.io~projected/kube-api-access-6lxhl:{mountpoint:/var/lib/kubelet/pods/c790c174-dc60-4f34-8818-3b367fbe3a5f/volumes/kubernetes.io~projected/kube-api-access-6lxhl major:0 minor:125 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ccf81538-4d5a-4c26-8e54-fe39331a625d/volumes/kubernetes.io~projected/kube-api-access:{mountpoint:/var/lib/kubelet/pods/ccf81538-4d5a-4c26-8e54-fe39331a625d/volumes/kubernetes.io~projected/kube-api-access major:0 minor:318 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ccf81538-4d5a-4c26-8e54-fe39331a625d/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/ccf81538-4d5a-4c26-8e54-fe39331a625d/volumes/kubernetes.io~secret/serving-cert major:0 minor:292 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d8fca733-45c8-45b8-8653-ac204e7c6098/volumes/kubernetes.io~projected/kube-api-access-2ncf9:{mountpoint:/var/lib/kubelet/pods/d8fca733-45c8-45b8-8653-ac204e7c6098/volumes/kubernetes.io~projected/kube-api-access-2ncf9 major:0 minor:150 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fd4c4c6f-380a-4cda-9a21-352b55ec2d98/volumes/kubernetes.io~projected/kube-api-access-rj4dt:{mountpoint:/var/lib/kubelet/pods/fd4c4c6f-380a-4cda-9a21-352b55ec2d98/volumes/kubernetes.io~projected/kube-api-access-rj4dt major:0 minor:308 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fd9f8671-8066-4990-b45d-8b619aa5d9ec/volumes/kubernetes.io~projected/kube-api-access-llscb:{mountpoint:/var/lib/kubelet/pods/fd9f8671-8066-4990-b45d-8b619aa5d9ec/volumes/kubernetes.io~projected/kube-api-access-llscb major:0 minor:305 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fd9f8671-8066-4990-b45d-8b619aa5d9ec/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/fd9f8671-8066-4990-b45d-8b619aa5d9ec/volumes/kubernetes.io~secret/serving-cert major:0 minor:291 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ffaf95be-586c-40fa-b15f-1beaffe7ff1c/volumes/kubernetes.io~projected/kube-api-access-t6bkg:{mountpoint:/var/lib/kubelet/pods/ffaf95be-586c-40fa-b15f-1beaffe7ff1c/volumes/kubernetes.io~projected/kube-api-access-t6bkg major:0 minor:127 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ffaf95be-586c-40fa-b15f-1beaffe7ff1c/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/ffaf95be-586c-40fa-b15f-1beaffe7ff1c/volumes/kubernetes.io~secret/metrics-tls major:0 minor:124 fsType:tmpfs blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/ef996df717a2f3360efada3545742be42ac70aa7591c3ffdd7cbc364657ca1d7/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/30c2e2f012970b434ee5c60c504c9ca86c293c524041f148510db9153d930e94/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-120:{mountpoint:/var/lib/containers/storage/overlay/c602ad66546d3d8165509b41d1b9a16d28eaec5af26feb1b71ad2daff6258282/merged major:0 minor:120 fsType:overlay blockSize:0} overlay_0-130:{mountpoint:/var/lib/containers/storage/overlay/87b6749669c1952dd271f9eb514332e2d1545dbafbfaa711f2be94eeaa29a1e2/merged major:0 minor:130 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/2d0dc08a43bb32025b0061ee29076466f9daa20e069d14c0b5fd7502b10657c4/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-136:{mountpoint:/var/lib/containers/storage/overlay/a4a27d838eac31d379b150d549b76799327ceeb338f60e9bd96a71e4f52aa197/merged major:0 minor:136 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/68a0f26a80cf1a155a104e07900bad11008c3b260b660d9f9269655714ba3bc7/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-149:{mountpoint:/var/lib/containers/storage/overlay/8d7c5ea1af347f955f42d83bc23d1c93daa74faf40831b43f3cd00bccadf1dd5/merged major:0 minor:149 fsType:overlay blockSize:0} overlay_0-151:{mountpoint:/var/lib/containers/storage/overlay/210848e47ac8ae40893e110bf8e6a41138cedcae7d812554c737d6b57622cbec/merged major:0 minor:151 fsType:overlay blockSize:0} overlay_0-154:{mountpoint:/var/lib/containers/storage/overlay/a8355b6c4ff90fd82cb236214fd8afb1a6857eb26488a17362a494dbcd9d474b/merged major:0 minor:154 fsType:overlay blockSize:0} overlay_0-163:{mountpoint:/var/lib/containers/storage/overlay/d18584c7896077384ca17519f407ff36ca131167dea88d142e19f672e7cc7e2a/merged major:0 minor:163 fsType:overlay blockSize:0} overlay_0-166:{mountpoint:/var/lib/containers/storage/overlay/cb35f0e0fd339b9d745ff19c886654a14cec5ef606ac434da077b60dff6ce383/merged major:0 minor:166 fsType:overlay blockSize:0} overlay_0-168:{mountpoint:/var/lib/containers/storage/overlay/af571619b30f7a85a5d48725f3cab6fc666e21fd4e601d25af17ccd979fdfc44/merged major:0 minor:168 fsType:overlay blockSize:0} overlay_0-170:{mountpoint:/var/lib/containers/storage/overlay/713e6e51904a92457fa7811693aeabcd9bcbb2b1c9c397abfc8bfaed62505447/merged major:0 minor:170 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/bb655df9a945a6cebde4ed6c17944f55fae789812c9ae552367004aab98b5330/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-183:{mountpoint:/var/lib/containers/storage/overlay/376f8ccf39959b706a8b18b5ffc909220fe318cc3cf20cebae2a33079d4cfabf/merged major:0 minor:183 fsType:overlay blockSize:0} overlay_0-186:{mountpoint:/var/lib/containers/storage/overlay/75612eb2ae55a16fbac12aaf2fc12a3dece9873fabe84b17fdd548bc5af0f413/merged major:0 minor:186 fsType:overlay blockSize:0} overlay_0-190:{mountpoint:/var/lib/containers/storage/overlay/68b0f8d7cd88babfc4f5211a8b1a479d02ee43ff682909ab842c3bd495917060/merged major:0 minor:190 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/f07d7f464e24c1b4a66a60953d3dcd8593214b86bf0b5a2f5f432929afb85a41/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-195:{mountpoint:/var/lib/containers/storage/overlay/f2367c097d0ee58a5d776824418a8e9b78374844b2ce516e48913fb88fe150e1/merged major:0 minor:195 fsType:overlay blockSize:0} overlay_0-197:{mountpoint:/var/lib/containers/storage/overlay/a78ebbe16e36278b072e58be3938515a12adfbf9d237b72f69f316cf24c3ce71/merged major:0 minor:197 fsType:overlay blockSize:0} overlay_0-199:{mountpoint:/var/lib/containers/storage/overlay/4b9fa727362b942b2a13e0dd160c8881bba2c5f006288a156bfae80c5d295343/merged major:0 minor:199 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/b8dac45067621aca2a645930faf2b62f0b40a04c35813423a848defcbf9ccd7f/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-221:{mountpoint:/var/lib/containers/storage/overlay/e0ca48f4841c44751320b6d2c9eed59eddb8f7378f83d5b3e1d59b647d41d1a8/merged major:0 minor:221 fsType:overlay blockSize:0} overlay_0-223:{mountpoint:/var/lib/containers/storage/overlay/6b0b8b5c7e3e6120e57b44cc905c6d79b95480e7385c76317c6fde97cf1d9c52/merged major:0 minor:223 fsType:overlay blockSize:0} overlay_0-228:{mountpoint:/var/lib/containers/storage/overlay/6497b09f2c1e50abd4afc1061a62c7d1625c59fb5e5b6fe61caf23bda8a62767/merged major:0 minor:228 fsType:overlay blockSize:0} overlay_0-236:{mountpoint:/var/lib/containers/storage/overlay/f5a4f16c5d3401e320fc0762986356129dd35b749584185a873373c3a9a0179b/merged major:0 minor:236 fsType:overlay blockSize:0} overlay_0-244:{mountpoint:/var/lib/containers/storage/overlay/6b53f21630ac0e4187f70f8eda4eca4fce5e0883c77be80442c96b8f8e9ecb2a/merged major:0 minor:244 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/733a61054c9dcae266ecfd333724b99773cd62de3b3d9a3b74276ed89b1e9b87/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/4162baef2a6af0b5520b5777d89115ceefa9c3e7b8aa643b68c09a415818297d/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/430a13f3b358cf15eaf22b1eb8ce308e64c548779462a981cb27ec23373c692e/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-273:{mountpoint:/var/lib/containers/storage/overlay/281aea3861e8dc7c5eb56aad94971baa6a987484c81fb30b4a89a6e499ef8ec8/merged major:0 minor:273 fsType:overlay blockSize:0} overlay_0-281:{mountpoint:/var/lib/containers/storage/overlay/5e564d4fb56bbffe62e4f758cb9f135bf08c410d8da96518c0c001b06ab49ddb/merged major:0 minor:281 fsType:overlay blockSize:0} overlay_0-351:{mountpoint:/var/lib/containers/storage/overlay/a3c0419a6693553babda8f7a1f05307818a14d1f8ba78ebdf2cbf50a9687f0e6/merged major:0 minor:351 fsType:overlay blockSize:0} overlay_0-353:{mountpoint:/var/lib/containers/storage/overlay/578da8593720dcb87588e10c5f96d79559e77f27341ee3747d7fb6ae309c0d62/merged major:0 minor:353 fsType:overlay blockSize:0} overlay_0-355:{mountpoint:/var/lib/containers/storage/overlay/c18aaf89e4f262aa5d1436836967bc60720ee3661187d12477f1fba54e71f9ac/merged major:0 minor:355 fsType:overlay blockSize:0} overlay_0-357:{mountpoint:/var/lib/containers/storage/overlay/32db868f5abf4e053fa3a2cd0844056b24a6ab037d74af229c8fd45609e4136d/merged major:0 minor:357 fsType:overlay blockSize:0} overlay_0-359:{mountpoint:/var/lib/containers/storage/overlay/3419d54820709407c6d5ac339b6331b27b0a0676ebd157684f4ef9bd3831c293/merged major:0 minor:359 fsType:overlay blockSize:0} overlay_0-361:{mountpoint:/var/lib/containers/storage/overlay/32dfd864702b981e7d8c8542c1ff24b01c843d5078dfb0744c3328134d33f154/merged major:0 minor:361 fsType:overlay blockSize:0} overlay_0-363:{mountpoint:/var/lib/containers/storage/overlay/08b7d03388d6e8c0d9f6567ee4cad61acbccd92e72bfb2071d585f2216413c33/merged major:0 minor:363 fsType:overlay blockSize:0} overlay_0-365:{mountpoint:/var/lib/containers/storage/overlay/918edd02a61866a930ee42839a5d128d5ea34a6c263f505cce01b95c162697f9/merged major:0 minor:365 fsType:overlay blockSize:0} overlay_0-367:{mountpoint:/var/lib/containers/storage/overlay/038caab34a67d3e3af7c623df04ad3b6feba3e3ca8b51055bd02c5270390a8ca/merged major:0 minor:367 fsType:overlay blockSize:0} overlay_0-369:{mountpoint:/var/lib/containers/storage/overlay/0e4499f02678be1dd7ff7a85a011395f5019bdd2d63f206da05e555ccac78c51/merged major:0 minor:369 fsType:overlay blockSize:0} overlay_0-371:{mountpoint:/var/lib/containers/storage/overlay/ee574fa103eb8d84949a4f4f5744d8197da4b9408af900c7d6eb1dec3fb57d09/merged major:0 minor:371 fsType:overlay blockSize:0} overlay_0-373:{mountpoint:/var/lib/containers/storage/overlay/8d43da7be802e713fd7048776309e1fff2cb94b1554f9a5275c12400eb06eaaf/merged major:0 minor:373 fsType:overlay blockSize:0} overlay_0-375:{mountpoint:/var/lib/containers/storage/overlay/fbe66fc443d5da17aa6a2bd36e0bdf4d5406ec8e08abe195a12cfaa7d19acf27/merged major:0 minor:375 fsType:overlay blockSize:0} overlay_0-377:{mountpoint:/var/lib/containers/storage/overlay/ef5b2d84889a60a57904224e9dfaf08f1ba4b9de88b9f480fce20832977e26ac/merged major:0 minor:377 fsType:overlay blockSize:0} overlay_0-386:{mountpoint:/var/lib/containers/storage/overlay/dc7ca0b40872627c8b192286834815acdb11b2d1aea592ef45e534ee20617c28/merged major:0 minor:386 fsType:overlay blockSize:0} overlay_0-388:{mountpoint:/var/lib/containers/storage/overlay/76f6c04862bf66a7a185c758d4606beaec873df7512ab4809b41882e6e7437ca/merged major:0 minor:388 fsType:overlay blockSize:0} overlay_0-390:{mountpoint:/var/lib/containers/storage/overlay/3ae2fd0ada26b6907a9a88c06a07fb34d6996b7cc62cffe331760a80b441f070/merged major:0 minor:390 fsType:overlay blockSize:0} overlay_0-392:{mountpoint:/var/lib/containers/storage/overlay/323634513ad8930f384b8cb30ffac36baa57a8c229d31b9b9eab5742ec8a9b8c/merged major:0 minor:392 fsType:overlay blockSize:0} overlay_0-394:{mountpoint:/var/lib/containers/storage/overlay/723da660ad98ab36e9f7d336823d4f1374fb824af032a8db8664dc9866da591c/merged major:0 minor:394 fsType:overlay blockSize:0} overlay_0-396:{mountpoint:/var/lib/containers/storage/overlay/613a3a6906f8b76d85d45c1ab23c48142a8d44e1590ba686e795a46588067fc0/merged major:0 minor:396 fsType:overlay blockSize:0} overlay_0-398:{mountpoint:/var/lib/containers/storage/overlay/7ec2c726f7c5146853c20737d137b4f3a179698d33b82a3618258de4fae63df7/merged major:0 minor:398 fsType:overlay blockSize:0} overlay_0-400:{mountpoint:/var/lib/containers/storage/overlay/9e03e31c22debca5233493fad397723e10adb039e70de5b7fa1cc16e4f1c66e2/merged major:0 minor:400 fsType:overlay blockSize:0} overlay_0-402:{mountpoint:/var/lib/containers/storage/overlay/e2e9083459e67446274ec7e520e7f7fe9129474103e923feb445eef4809e958b/merged major:0 minor:402 fsType:overlay blockSize:0} overlay_0-404:{mountpoint:/var/lib/containers/storage/overlay/afe9b1758e93e2dd590205fdd6f8b6402516bf1567085e3f5669da55b9db0ef2/merged major:0 minor:404 fsType:overlay blockSize:0} overlay_0-406:{mountpoint:/var/lib/containers/storage/overlay/566b217523ee5fa24e55a1e48211294b86605e7e9461ed5871b4a6e5852d638b/merged major:0 minor:406 fsType:overlay blockSize:0} overlay_0-43:{mountpoint:/var/lib/containers/storage/overlay/a272af30b862cfca9a161b4eb00b80feca9f0acd8d141941f8213a56c90ba8fc/merged major:0 minor:43 fsType:overlay blockSize:0} overlay_0-44:{mountpoint:/var/lib/containers/storage/overlay/144e56220eace4d7bb80326bfe269866bf5976eb0c4c59102f09c0f531a1a9ba/merged major:0 minor:44 fsType:overlay blockSize:0} overlay_0-48:{mountpoint:/var/lib/containers/storage/overlay/36d391bd085551aa6c3f317c8f71b5f5c89b5ed4010e20ea13d29fcf1135bf1a/merged major:0 minor:48 fsType:overlay blockSize:0} overlay_0-52:{mountpoint:/var/lib/containers/storage/overlay/4b3a9f66cfe6f59eb07c0576463fb02cfdda0c6f12a5bd4eac8e28ee9f563c89/merged major:0 minor:52 fsType:overlay blockSize:0} overlay_0-56:{mountpoint:/var/lib/containers/storage/overlay/c28907486d9e6f59fa06733c0290be8fa1460181e4146300a27d2cac51971cf4/merged major:0 minor:56 fsType:overlay blockSize:0} overlay_0-60:{mountpoint:/var/lib/containers/storage/overlay/8d28257b8ef5e0e9037011dc8a109dd76e7703d26947d7187847e9ee08ed8bcf/merged major:0 minor:60 fsType:overlay blockSize:0} overlay_0-62:{mountpoint:/var/lib/containers/storage/overlay/74b4de9fa3281f0d51cf3730835f3892a5e68ce54e5a92ac53ce5414acf45865/merged major:0 minor:62 fsType:overlay blockSize:0} overlay_0-64:{mountpoint:/var/lib/containers/storage/overlay/fcdfdbe1cbcb97f0fed32f1b8e9ee00c6f6dfa059db7aa8cfcdc767906cedf9a/merged major:0 minor:64 fsType:overlay blockSize:0} overlay_0-69:{mountpoint:/var/lib/containers/storage/overlay/203f40a07a072a0e4effe6a222c473b3159e183d63c897764a1c0e054aa38609/merged major:0 minor:69 fsType:overlay blockSize:0} overlay_0-71:{mountpoint:/var/lib/containers/storage/overlay/351f264b3b0e06f95609088a9d50ae0d54d652af42d000db6a55433a71549278/merged major:0 minor:71 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/9e4e46d5e9e3667ca98fcb81a21f685f9712de6b3fcb74f6b6d8b53009d7a789/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/725d7e31fcd310bc7567388d22301e79c31905eb2cf073c2f2f7e97f9aa1c8d0/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/bec35320af8fe84cb0767e2f7b69d80885009d02949e06f13078a71c12b83a65/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/6b246d1d0bef008aa42fd71a9f24038bc93c850a4e6c2929ce43e2f77ada4751/merged major:0 minor:96 fsType:overlay blockSize:0}] Dec 04 11:37:45.720227 master-0 kubenswrapper[8993]: I1204 11:37:45.719577 8993 manager.go:217] Machine: {Timestamp:2025-12-04 11:37:45.718278855 +0000 UTC m=+0.109220318 CPUVendorID:AuthenticAMD NumCores:16 NumPhysicalCores:1 NumSockets:16 CpuFrequency:2800000 MemoryCapacity:50514153472 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:27b5ee8bfd7d412e99796c008843ed23 SystemUUID:27b5ee8b-fd7d-412e-9979-6c008843ed23 BootID:8fe75f05-5c88-4c1f-b39c-b984078f0689 Filesystems:[{Device:/var/lib/kubelet/pods/42b3be0f-1d82-4a64-abb4-0118a6960efd/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:293 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/031d300e-24b4-481c-8b82-fe8cdb3fcef7/volumes/kubernetes.io~projected/kube-api-access-k7bhn DeviceMajor:0 DeviceMinor:320 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/1ade9186-b262-4b5e-9c6f-ba89f0130fb6/volumes/kubernetes.io~projected/kube-api-access-t46k7 DeviceMajor:0 DeviceMinor:323 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/34d78076625efac7bdb2340b596443baa5d08eac7ab61fe519fdb353374c6f2a/userdata/shm DeviceMajor:0 DeviceMinor:331 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-390 DeviceMajor:0 DeviceMinor:390 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-197 DeviceMajor:0 DeviceMinor:197 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fa255b4fd328cf99db08eb2b43e9c35a73e8f688d9352d1ab6ed516f93712d61/userdata/shm DeviceMajor:0 DeviceMinor:340 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/287fba2d-f56d-4ec0-b796-7849a68fb411/volumes/kubernetes.io~projected/kube-api-access-gmdvf DeviceMajor:0 DeviceMinor:159 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b05c03ee7421430935dd045065b562c6c4243474d783822f7feef789f201d335/userdata/shm DeviceMajor:0 DeviceMinor:160 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-186 DeviceMajor:0 DeviceMinor:186 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-199 DeviceMajor:0 DeviceMinor:199 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/c6e9271a-44ea-4612-ab60-4a9d489ed062/volumes/kubernetes.io~secret/etcd-client DeviceMajor:0 DeviceMinor:296 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/434ed9b9-715b-455b-867c-775b256df40f/volumes/kubernetes.io~projected/kube-api-access-ggzfm DeviceMajor:0 DeviceMinor:304 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/7bf67a51-9759-4e2a-a2ae-ef7416cad43f/volumes/kubernetes.io~projected/kube-api-access-zr454 DeviceMajor:0 DeviceMinor:319 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/dev/vda4 DeviceMajor:252 DeviceMinor:4 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/c790c174-dc60-4f34-8818-3b367fbe3a5f/volumes/kubernetes.io~projected/kube-api-access-6lxhl DeviceMajor:0 DeviceMinor:125 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-357 DeviceMajor:0 DeviceMinor:357 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/a5b826c3-8638-4cf5-b974-b24e4282ce00/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:286 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/0158c2f3-20e5-43f4-875d-c5ad8f6112df/volumes/kubernetes.io~secret/cluster-olm-operator-serving-cert DeviceMajor:0 DeviceMinor:287 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:30 Capacity:25257078784 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/7bf67a51-9759-4e2a-a2ae-ef7416cad43f/volumes/kubernetes.io~secret/profile-collector-cert DeviceMajor:0 DeviceMinor:294 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/fd9f8671-8066-4990-b45d-8b619aa5d9ec/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:291 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/fd4c4c6f-380a-4cda-9a21-352b55ec2d98/volumes/kubernetes.io~projected/kube-api-access-rj4dt DeviceMajor:0 DeviceMinor:308 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ca886b4e0bb939f02a59e692a7e818915eb829261d10e2563a1a2a60bb3e4c87/userdata/shm DeviceMajor:0 DeviceMinor:349 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/16057f9c-b1f8-4915-acc3-2d4532af4963/volumes/kubernetes.io~projected/kube-api-access-lxnbc DeviceMajor:0 DeviceMinor:468 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-221 DeviceMajor:0 DeviceMinor:221 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e64b7e965ab85bcd41866acdf04d1346eef2d43597395fb0ad995548a3c03068/userdata/shm DeviceMajor:0 DeviceMinor:326 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:25257074688 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-136 DeviceMajor:0 DeviceMinor:136 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/52fc4812931b1d912474af968926c8a3a29e2b1cbdfed78532122ce1dc286a99/userdata/shm DeviceMajor:0 DeviceMinor:334 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-353 DeviceMajor:0 DeviceMinor:353 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/volumes/kubernetes.io~projected/kube-api-access-l5r7w DeviceMajor:0 DeviceMinor:467 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1118687f000f059298fcb4f89292520334eab60bb7e784774b74bdb9bc2421bc/userdata/shm DeviceMajor:0 DeviceMinor:50 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-69 DeviceMajor:0 DeviceMinor:69 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/00601c1a-efd4-4366-bdc9-d768afa252b0/volumes/kubernetes.io~projected/kube-api-access-2g7bh DeviceMajor:0 DeviceMinor:316 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-355 DeviceMajor:0 DeviceMinor:355 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/adbbc7afd8e54e79f29b174cb989cf3e7455023359f413af406ae4a4afbf2ab4/userdata/shm DeviceMajor:0 DeviceMinor:147 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/157eab0c-0d8d-486b-a349-c2e466e18e0c/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:24 Capacity:10102833152 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/eadb6c5599ab1a4ae90f8ecda2c7a886a86c701b1c6361b22d8aa8fc4c814262/userdata/shm DeviceMajor:0 DeviceMinor:306 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/6f15dcdb-c968-429c-9d1d-63c2becad337/volumes/kubernetes.io~projected/kube-api-access-kkjzz DeviceMajor:0 DeviceMinor:322 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/612a0c5312df7f19a5e3a086b42a22b55f539c232badbe0a03979b12eb756461/userdata/shm DeviceMajor:0 DeviceMinor:343 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:10102833152 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-130 DeviceMajor:0 DeviceMinor:130 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/157eab0c-0d8d-486b-a349-c2e466e18e0c/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:157 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-228 DeviceMajor:0 DeviceMinor:228 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6cab7196e003292e61274a565af49a44adbe51e465702618783576ef89e2744f/userdata/shm DeviceMajor:0 DeviceMinor:330 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-377 DeviceMajor:0 DeviceMinor:377 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-44 DeviceMajor:0 DeviceMinor:44 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-52 DeviceMajor:0 DeviceMinor:52 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/a5b826c3-8638-4cf5-b974-b24e4282ce00/volumes/kubernetes.io~projected/kube-api-access-rhmlm DeviceMajor:0 DeviceMinor:325 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-388 DeviceMajor:0 DeviceMinor:388 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/27576028-d64a-47cd-b76b-d524e41efe37/volumes/kubernetes.io~projected/kube-api-access DeviceMajor:0 DeviceMinor:314 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-43 DeviceMajor:0 DeviceMinor:43 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cd9dab7f7f5afa841cd8a4ded039df1dd1c65380acd9d3f01a8545a60b7ba60d/userdata/shm DeviceMajor:0 DeviceMinor:128 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-166 DeviceMajor:0 DeviceMinor:166 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/434ed9b9-715b-455b-867c-775b256df40f/volumes/kubernetes.io~secret/profile-collector-cert DeviceMajor:0 DeviceMinor:297 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/2ab26ae5-0607-4dfd-840e-531d204b5030/volumes/kubernetes.io~projected/kube-api-access-mvzrc DeviceMajor:0 DeviceMinor:303 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46/volumes/kubernetes.io~projected/kube-api-access-ckwnn DeviceMajor:0 DeviceMinor:313 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/adbccd36bc5c65e5e88e6060aa8c07788d2d0acd9edee809c8e2d70678390332/userdata/shm DeviceMajor:0 DeviceMinor:41 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-62 DeviceMajor:0 DeviceMinor:62 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-367 DeviceMajor:0 DeviceMinor:367 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-406 DeviceMajor:0 DeviceMinor:406 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d9d667bd2c388cdba21d0d98e8c8985f6bb62287cc7f32d5b257b5a3ca9351a1/userdata/shm DeviceMajor:0 DeviceMinor:336 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-404 DeviceMajor:0 DeviceMinor:404 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-281 DeviceMajor:0 DeviceMinor:281 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/27576028-d64a-47cd-b76b-d524e41efe37/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:288 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/ffaf95be-586c-40fa-b15f-1beaffe7ff1c/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:124 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-400 DeviceMajor:0 DeviceMinor:400 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-120 DeviceMajor:0 DeviceMinor:120 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/69640270-09e6-4217-b1c8-3d3465c0c3ae/volumes/kubernetes.io~projected/kube-api-access DeviceMajor:0 DeviceMinor:126 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-168 DeviceMajor:0 DeviceMinor:168 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/7203ec93-6572-4032-825c-140029a86058/volumes/kubernetes.io~projected/kube-api-access-gkcj4 DeviceMajor:0 DeviceMinor:185 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-190 DeviceMajor:0 DeviceMinor:190 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/870c232b93a5ee37a81fedb1347de97a51e51c964baa741a79bf8da03ca09932/userdata/shm DeviceMajor:0 DeviceMinor:54 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-64 DeviceMajor:0 DeviceMinor:64 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4c6405b67db7763561b4f0f867c268ed82b2dcb8dc4a31ac8bd955b23c489a04/userdata/shm DeviceMajor:0 DeviceMinor:342 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-386 DeviceMajor:0 DeviceMinor:386 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cbad8f519fca5622e25075665c609020a4c168f05797a0e7395559b78b81984d/userdata/shm DeviceMajor:0 DeviceMinor:338 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-351 DeviceMajor:0 DeviceMinor:351 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-154 DeviceMajor:0 DeviceMinor:154 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/3322cc5a-f1f7-4522-b423-19fb7f38cd43/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:290 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/ccf81538-4d5a-4c26-8e54-fe39331a625d/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:292 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-163 DeviceMajor:0 DeviceMinor:163 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:289 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-244 DeviceMajor:0 DeviceMinor:244 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/b011b1f1-3235-4e20-825b-ce711c052407/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:300 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/3322cc5a-f1f7-4522-b423-19fb7f38cd43/volumes/kubernetes.io~projected/kube-api-access-k449s DeviceMajor:0 DeviceMinor:315 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/dev/vda3 DeviceMajor:252 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/ffaf95be-586c-40fa-b15f-1beaffe7ff1c/volumes/kubernetes.io~projected/kube-api-access-t6bkg DeviceMajor:0 DeviceMinor:127 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/fd9f8671-8066-4990-b45d-8b619aa5d9ec/volumes/kubernetes.io~projected/kube-api-access-llscb DeviceMajor:0 DeviceMinor:305 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-56 DeviceMajor:0 DeviceMinor:56 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/08550069-c1a1-475e-84a2-e56905f1ed38/volumes/kubernetes.io~projected/kube-api-access-8cffn DeviceMajor:0 DeviceMinor:301 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8/volumes/kubernetes.io~projected/kube-api-access-n6bhm DeviceMajor:0 DeviceMinor:312 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-359 DeviceMajor:0 DeviceMinor:359 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-371 DeviceMajor:0 DeviceMinor:371 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-195 DeviceMajor:0 DeviceMinor:195 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/42b3be0f-1d82-4a64-abb4-0118a6960efd/volumes/kubernetes.io~projected/kube-api-access-c7xwd DeviceMajor:0 DeviceMinor:310 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/da23ebdcd7c632c968f1dcc14625f7875764a703fd10b23106235b76064c9498/userdata/shm DeviceMajor:0 DeviceMinor:328 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-398 DeviceMajor:0 DeviceMinor:398 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-402 DeviceMajor:0 DeviceMinor:402 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-149 DeviceMajor:0 DeviceMinor:149 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/ccf81538-4d5a-4c26-8e54-fe39331a625d/volumes/kubernetes.io~projected/kube-api-access DeviceMajor:0 DeviceMinor:318 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-183 DeviceMajor:0 DeviceMinor:183 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/bac00ac5-0371-48fd-b1cc-60438f08ae94/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:295 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/bac00ac5-0371-48fd-b1cc-60438f08ae94/volumes/kubernetes.io~projected/kube-api-access DeviceMajor:0 DeviceMinor:311 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/330553d2-40ea-4496-8346-2e5bf680669b/volumes/kubernetes.io~projected/kube-api-access-59pbp DeviceMajor:0 DeviceMinor:348 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/59191695c89f8cecbba881756b5ffc5e4c892fd02facf20cc198ade1bf4ec267/userdata/shm DeviceMajor:0 DeviceMinor:46 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-48 DeviceMajor:0 DeviceMinor:48 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-363 DeviceMajor:0 DeviceMinor:363 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-392 DeviceMajor:0 DeviceMinor:392 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/bdfcb644-24ef-4a33-93ae-a855e872d29a/volumes/kubernetes.io~projected/kube-api-access-f4w2j DeviceMajor:0 DeviceMinor:146 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-394 DeviceMajor:0 DeviceMinor:394 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/25835b8cd52c0d1fb7ed133702ef424c403a978f32d5722b14d0bf7744915891/userdata/shm DeviceMajor:0 DeviceMinor:132 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/00601c1a-efd4-4366-bdc9-d768afa252b0/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:299 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/1ade9186-b262-4b5e-9c6f-ba89f0130fb6/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:321 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-361 DeviceMajor:0 DeviceMinor:361 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-373 DeviceMajor:0 DeviceMinor:373 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-375 DeviceMajor:0 DeviceMinor:375 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-170 DeviceMajor:0 DeviceMinor:170 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-273 DeviceMajor:0 DeviceMinor:273 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/7203ec93-6572-4032-825c-140029a86058/volumes/kubernetes.io~secret/webhook-cert DeviceMajor:0 DeviceMinor:194 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/b011b1f1-3235-4e20-825b-ce711c052407/volumes/kubernetes.io~projected/kube-api-access-jq49f DeviceMajor:0 DeviceMinor:309 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/c6e9271a-44ea-4612-ab60-4a9d489ed062/volumes/kubernetes.io~projected/kube-api-access-cdsq5 DeviceMajor:0 DeviceMinor:324 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0d019de7666ab420398ef1b6b5ac581f64802cb56fe4c2b360c11b041de71dc5/userdata/shm DeviceMajor:0 DeviceMinor:344 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-151 DeviceMajor:0 DeviceMinor:151 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/d8fca733-45c8-45b8-8653-ac204e7c6098/volumes/kubernetes.io~projected/kube-api-access-2ncf9 DeviceMajor:0 DeviceMinor:150 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/287fba2d-f56d-4ec0-b796-7849a68fb411/volumes/kubernetes.io~secret/ovn-control-plane-metrics-cert DeviceMajor:0 DeviceMinor:156 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-223 DeviceMajor:0 DeviceMinor:223 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-369 DeviceMajor:0 DeviceMinor:369 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-60 DeviceMajor:0 DeviceMinor:60 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-71 DeviceMajor:0 DeviceMinor:71 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/0158c2f3-20e5-43f4-875d-c5ad8f6112df/volumes/kubernetes.io~projected/kube-api-access-8cxbd DeviceMajor:0 DeviceMinor:317 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-236 DeviceMajor:0 DeviceMinor:236 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/c6e9271a-44ea-4612-ab60-4a9d489ed062/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:298 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b19546f46eaddad7163bb8c25c987ab9b0d1e6ccae50bd40bb5bd44e80ea64cb/userdata/shm DeviceMajor:0 DeviceMinor:188 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/157eab0c-0d8d-486b-a349-c2e466e18e0c/volumes/kubernetes.io~projected/kube-api-access-p2mhg DeviceMajor:0 DeviceMinor:158 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/853c784d56688f268e88966f202d566476596a385a8e279f2c38cf8e7278c8d9/userdata/shm DeviceMajor:0 DeviceMinor:161 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/7c017c69-b24e-4a7a-b888-133bed34c174/volumes/kubernetes.io~projected/kube-api-access-tlr76 DeviceMajor:0 DeviceMinor:302 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-365 DeviceMajor:0 DeviceMinor:365 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-396 DeviceMajor:0 DeviceMinor:396 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6080c82a1de6439e859491a681111c8d2ae9907c581f1c30e651428ab5f16038/userdata/shm DeviceMajor:0 DeviceMinor:58 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true}] DiskMap:map[252:0:{Name:vda Major:252 Minor:0 Size:214748364800 Scheduler:none} 252:16:{Name:vdb Major:252 Minor:16 Size:21474836480 Scheduler:none} 252:32:{Name:vdc Major:252 Minor:32 Size:21474836480 Scheduler:none} 252:48:{Name:vdd Major:252 Minor:48 Size:21474836480 Scheduler:none} 252:64:{Name:vde Major:252 Minor:64 Size:21474836480 Scheduler:none}] NetworkDevices:[{Name:0d019de7666ab42 MacAddress:d6:7e:6a:ac:ae:19 Speed:10000 Mtu:8900} {Name:34d78076625efac MacAddress:ca:4e:d8:50:10:97 Speed:10000 Mtu:8900} {Name:4c6405b67db7763 MacAddress:d2:61:54:c3:4b:da Speed:10000 Mtu:8900} {Name:52fc4812931b1d9 MacAddress:e6:87:23:bb:42:64 Speed:10000 Mtu:8900} {Name:612a0c5312df7f1 MacAddress:16:a5:9c:1f:89:b4 Speed:10000 Mtu:8900} {Name:6cab7196e003292 MacAddress:8e:4a:9f:53:4e:42 Speed:10000 Mtu:8900} {Name:br-ex MacAddress:fa:16:9e:81:f6:10 Speed:0 Mtu:9000} {Name:br-int MacAddress:52:4c:8d:e7:50:61 Speed:0 Mtu:8900} {Name:cbad8f519fca562 MacAddress:66:18:be:bb:53:4a Speed:10000 Mtu:8900} {Name:d9d667bd2c388cd MacAddress:ca:9a:63:c1:17:78 Speed:10000 Mtu:8900} {Name:da23ebdcd7c632c MacAddress:3e:40:b1:34:3d:d1 Speed:10000 Mtu:8900} {Name:e64b7e965ab85bc MacAddress:42:68:d6:3c:57:af Speed:10000 Mtu:8900} {Name:eadb6c5599ab1a4 MacAddress:86:f3:a8:7d:a4:d1 Speed:10000 Mtu:8900} {Name:eth0 MacAddress:fa:16:9e:81:f6:10 Speed:-1 Mtu:9000} {Name:eth1 MacAddress:fa:16:3e:d8:74:65 Speed:-1 Mtu:9000} {Name:eth2 MacAddress:fa:16:3e:d4:99:db Speed:-1 Mtu:9000} {Name:fa255b4fd328cf9 MacAddress:1e:d9:18:42:e2:e9 Speed:10000 Mtu:8900} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:80:00:02 Speed:0 Mtu:8900} {Name:ovs-system MacAddress:ce:07:4b:8f:0c:d7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:50514153472 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:0 Size:16777216 Type:Unified Level:3}] SocketID:0 BookID: DrawerID:} {Id:0 Threads:[1] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:1 Size:16777216 Type:Unified Level:3}] SocketID:1 BookID: DrawerID:} {Id:0 Threads:[10] Caches:[{Id:10 Size:32768 Type:Data Level:1} {Id:10 Size:32768 Type:Instruction Level:1} {Id:10 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:10 Size:16777216 Type:Unified Level:3}] SocketID:10 BookID: DrawerID:} {Id:0 Threads:[11] Caches:[{Id:11 Size:32768 Type:Data Level:1} {Id:11 Size:32768 Type:Instruction Level:1} {Id:11 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:11 Size:16777216 Type:Unified Level:3}] SocketID:11 BookID: DrawerID:} {Id:0 Threads:[12] Caches:[{Id:12 Size:32768 Type:Data Level:1} {Id:12 Size:32768 Type:Instruction Level:1} {Id:12 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:12 Size:16777216 Type:Unified Level:3}] SocketID:12 BookID: DrawerID:} {Id:0 Threads:[13] Caches:[{Id:13 Size:32768 Type:Data Level:1} {Id:13 Size:32768 Type:Instruction Level:1} {Id:13 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:13 Size:16777216 Type:Unified Level:3}] SocketID:13 BookID: DrawerID:} {Id:0 Threads:[14] Caches:[{Id:14 Size:32768 Type:Data Level:1} {Id:14 Size:32768 Type:Instruction Level:1} {Id:14 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:14 Size:16777216 Type:Unified Level:3}] SocketID:14 BookID: DrawerID:} {Id:0 Threads:[15] Caches:[{Id:15 Size:32768 Type:Data Level:1} {Id:15 Size:32768 Type:Instruction Level:1} {Id:15 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:15 Size:16777216 Type:Unified Level:3}] SocketID:15 BookID: DrawerID:} {Id:0 Threads:[2] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:2 Size:16777216 Type:Unified Level:3}] SocketID:2 BookID: DrawerID:} {Id:0 Threads:[3] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:3 Size:16777216 Type:Unified Level:3}] SocketID:3 BookID: DrawerID:} {Id:0 Threads:[4] Caches:[{Id:4 Size:32768 Type:Data Level:1} {Id:4 Size:32768 Type:Instruction Level:1} {Id:4 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:4 Size:16777216 Type:Unified Level:3}] SocketID:4 BookID: DrawerID:} {Id:0 Threads:[5] Caches:[{Id:5 Size:32768 Type:Data Level:1} {Id:5 Size:32768 Type:Instruction Level:1} {Id:5 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:5 Size:16777216 Type:Unified Level:3}] SocketID:5 BookID: DrawerID:} {Id:0 Threads:[6] Caches:[{Id:6 Size:32768 Type:Data Level:1} {Id:6 Size:32768 Type:Instruction Level:1} {Id:6 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:6 Size:16777216 Type:Unified Level:3}] SocketID:6 BookID: DrawerID:} {Id:0 Threads:[7] Caches:[{Id:7 Size:32768 Type:Data Level:1} {Id:7 Size:32768 Type:Instruction Level:1} {Id:7 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:7 Size:16777216 Type:Unified Level:3}] SocketID:7 BookID: DrawerID:} {Id:0 Threads:[8] Caches:[{Id:8 Size:32768 Type:Data Level:1} {Id:8 Size:32768 Type:Instruction Level:1} {Id:8 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:8 Size:16777216 Type:Unified Level:3}] SocketID:8 BookID: DrawerID:} {Id:0 Threads:[9] Caches:[{Id:9 Size:32768 Type:Data Level:1} {Id:9 Size:32768 Type:Instruction Level:1} {Id:9 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:9 Size:16777216 Type:Unified Level:3}] SocketID:9 BookID: DrawerID:}] Caches:[] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Dec 04 11:37:45.720227 master-0 kubenswrapper[8993]: I1204 11:37:45.720206 8993 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Dec 04 11:37:45.720743 master-0 kubenswrapper[8993]: I1204 11:37:45.720437 8993 manager.go:233] Version: {KernelVersion:5.14.0-427.100.1.el9_4.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 418.94.202511170715-0 DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Dec 04 11:37:45.721154 master-0 kubenswrapper[8993]: I1204 11:37:45.721102 8993 swap_util.go:113] "Swap is on" /proc/swaps contents="Filename\t\t\t\tType\t\tSize\t\tUsed\t\tPriority" Dec 04 11:37:45.721411 master-0 kubenswrapper[8993]: I1204 11:37:45.721351 8993 container_manager_linux.go:267] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Dec 04 11:37:45.721717 master-0 kubenswrapper[8993]: I1204 11:37:45.721406 8993 container_manager_linux.go:272] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"master-0","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"ExperimentalMemoryManagerPolicy":"None","ExperimentalMemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Dec 04 11:37:45.721717 master-0 kubenswrapper[8993]: I1204 11:37:45.721674 8993 topology_manager.go:138] "Creating topology manager with none policy" Dec 04 11:37:45.721717 master-0 kubenswrapper[8993]: I1204 11:37:45.721685 8993 container_manager_linux.go:303] "Creating device plugin manager" Dec 04 11:37:45.721717 master-0 kubenswrapper[8993]: I1204 11:37:45.721755 8993 manager.go:142] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Dec 04 11:37:45.722607 master-0 kubenswrapper[8993]: I1204 11:37:45.721871 8993 server.go:66] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Dec 04 11:37:45.722607 master-0 kubenswrapper[8993]: I1204 11:37:45.722129 8993 state_mem.go:36] "Initialized new in-memory state store" Dec 04 11:37:45.722719 master-0 kubenswrapper[8993]: I1204 11:37:45.722695 8993 server.go:1245] "Using root directory" path="/var/lib/kubelet" Dec 04 11:37:45.722828 master-0 kubenswrapper[8993]: I1204 11:37:45.722782 8993 kubelet.go:418] "Attempting to sync node with API server" Dec 04 11:37:45.722986 master-0 kubenswrapper[8993]: I1204 11:37:45.722961 8993 kubelet.go:313] "Adding static pod path" path="/etc/kubernetes/manifests" Dec 04 11:37:45.723046 master-0 kubenswrapper[8993]: I1204 11:37:45.723008 8993 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Dec 04 11:37:45.723092 master-0 kubenswrapper[8993]: I1204 11:37:45.723069 8993 kubelet.go:324] "Adding apiserver pod source" Dec 04 11:37:45.723134 master-0 kubenswrapper[8993]: I1204 11:37:45.723099 8993 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Dec 04 11:37:45.724719 master-0 kubenswrapper[8993]: I1204 11:37:45.724672 8993 kuberuntime_manager.go:262] "Container runtime initialized" containerRuntime="cri-o" version="1.31.13-2.rhaos4.18.git15789b8.el9" apiVersion="v1" Dec 04 11:37:45.725013 master-0 kubenswrapper[8993]: I1204 11:37:45.724991 8993 certificate_store.go:130] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-server-current.pem". Dec 04 11:37:45.725601 master-0 kubenswrapper[8993]: I1204 11:37:45.725337 8993 kubelet.go:854] "Not starting ClusterTrustBundle informer because we are in static kubelet mode" Dec 04 11:37:45.725601 master-0 kubenswrapper[8993]: I1204 11:37:45.725500 8993 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Dec 04 11:37:45.725601 master-0 kubenswrapper[8993]: I1204 11:37:45.725521 8993 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Dec 04 11:37:45.725601 master-0 kubenswrapper[8993]: I1204 11:37:45.725530 8993 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Dec 04 11:37:45.725601 master-0 kubenswrapper[8993]: I1204 11:37:45.725539 8993 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Dec 04 11:37:45.725601 master-0 kubenswrapper[8993]: I1204 11:37:45.725548 8993 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Dec 04 11:37:45.725601 master-0 kubenswrapper[8993]: I1204 11:37:45.725556 8993 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/secret" Dec 04 11:37:45.725601 master-0 kubenswrapper[8993]: I1204 11:37:45.725564 8993 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Dec 04 11:37:45.725601 master-0 kubenswrapper[8993]: I1204 11:37:45.725572 8993 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Dec 04 11:37:45.725601 master-0 kubenswrapper[8993]: I1204 11:37:45.725584 8993 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/fc" Dec 04 11:37:45.725601 master-0 kubenswrapper[8993]: I1204 11:37:45.725594 8993 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Dec 04 11:37:45.725601 master-0 kubenswrapper[8993]: I1204 11:37:45.725608 8993 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/projected" Dec 04 11:37:45.725601 master-0 kubenswrapper[8993]: I1204 11:37:45.725624 8993 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Dec 04 11:37:45.725601 master-0 kubenswrapper[8993]: I1204 11:37:45.725656 8993 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/csi" Dec 04 11:37:45.726558 master-0 kubenswrapper[8993]: I1204 11:37:45.726149 8993 server.go:1280] "Started kubelet" Dec 04 11:37:45.727106 master-0 kubenswrapper[8993]: I1204 11:37:45.726666 8993 server.go:163] "Starting to listen" address="0.0.0.0" port=10250 Dec 04 11:37:45.727106 master-0 kubenswrapper[8993]: I1204 11:37:45.726669 8993 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Dec 04 11:37:45.727106 master-0 kubenswrapper[8993]: I1204 11:37:45.726774 8993 server_v1.go:47] "podresources" method="list" useActivePods=true Dec 04 11:37:45.728920 master-0 kubenswrapper[8993]: I1204 11:37:45.728841 8993 server.go:236] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Dec 04 11:37:45.729737 master-0 systemd[1]: Started Kubernetes Kubelet. Dec 04 11:37:45.736500 master-0 kubenswrapper[8993]: I1204 11:37:45.735592 8993 server.go:449] "Adding debug handlers to kubelet server" Dec 04 11:37:45.738566 master-0 kubenswrapper[8993]: I1204 11:37:45.738517 8993 certificate_manager.go:356] kubernetes.io/kubelet-serving: Certificate rotation is enabled Dec 04 11:37:45.738646 master-0 kubenswrapper[8993]: I1204 11:37:45.738581 8993 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Dec 04 11:37:45.739626 master-0 kubenswrapper[8993]: I1204 11:37:45.738895 8993 reflector.go:368] Caches populated for *v1.Node from k8s.io/client-go/informers/factory.go:160 Dec 04 11:37:45.739626 master-0 kubenswrapper[8993]: I1204 11:37:45.739565 8993 certificate_manager.go:356] kubernetes.io/kubelet-serving: Certificate expiration is 2025-12-05 11:26:53 +0000 UTC, rotation deadline is 2025-12-05 04:28:51.893561378 +0000 UTC Dec 04 11:37:45.739626 master-0 kubenswrapper[8993]: I1204 11:37:45.739613 8993 certificate_manager.go:356] kubernetes.io/kubelet-serving: Waiting 16h51m6.153950807s for next certificate rotation Dec 04 11:37:45.739626 master-0 kubenswrapper[8993]: I1204 11:37:45.739650 8993 volume_manager.go:287] "The desired_state_of_world populator starts" Dec 04 11:37:45.739626 master-0 kubenswrapper[8993]: I1204 11:37:45.739660 8993 volume_manager.go:289] "Starting Kubelet Volume Manager" Dec 04 11:37:45.740235 master-0 kubenswrapper[8993]: I1204 11:37:45.739708 8993 desired_state_of_world_populator.go:147] "Desired state populator starts to run" Dec 04 11:37:45.741617 master-0 kubenswrapper[8993]: I1204 11:37:45.741524 8993 reflector.go:368] Caches populated for *v1.CSIDriver from k8s.io/client-go/informers/factory.go:160 Dec 04 11:37:45.741888 master-0 kubenswrapper[8993]: I1204 11:37:45.741639 8993 reflector.go:368] Caches populated for *v1.Service from k8s.io/client-go/informers/factory.go:160 Dec 04 11:37:45.744250 master-0 kubenswrapper[8993]: I1204 11:37:45.744181 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0158c2f3-20e5-43f4-875d-c5ad8f6112df" volumeName="kubernetes.io/projected/0158c2f3-20e5-43f4-875d-c5ad8f6112df-kube-api-access-8cxbd" seLinuxMountContext="" Dec 04 11:37:45.744250 master-0 kubenswrapper[8993]: I1204 11:37:45.744232 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5b826c3-8638-4cf5-b974-b24e4282ce00" volumeName="kubernetes.io/secret/a5b826c3-8638-4cf5-b974-b24e4282ce00-serving-cert" seLinuxMountContext="" Dec 04 11:37:45.744250 master-0 kubenswrapper[8993]: I1204 11:37:45.744245 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c790c174-dc60-4f34-8818-3b367fbe3a5f" volumeName="kubernetes.io/configmap/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-daemon-config" seLinuxMountContext="" Dec 04 11:37:45.744250 master-0 kubenswrapper[8993]: I1204 11:37:45.744255 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="08550069-c1a1-475e-84a2-e56905f1ed38" volumeName="kubernetes.io/projected/08550069-c1a1-475e-84a2-e56905f1ed38-kube-api-access-8cffn" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744267 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" volumeName="kubernetes.io/projected/38fc8086-a00c-4a2a-8a0e-c57e9d9d0103-kube-api-access-l5r7w" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744281 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7203ec93-6572-4032-825c-140029a86058" volumeName="kubernetes.io/secret/7203ec93-6572-4032-825c-140029a86058-webhook-cert" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744293 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="72faf6d6-e8ca-43d1-b93e-67c11f8d3b46" volumeName="kubernetes.io/projected/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-kube-api-access-ckwnn" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744304 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c790c174-dc60-4f34-8818-3b367fbe3a5f" volumeName="kubernetes.io/projected/c790c174-dc60-4f34-8818-3b367fbe3a5f-kube-api-access-6lxhl" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744319 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ffaf95be-586c-40fa-b15f-1beaffe7ff1c" volumeName="kubernetes.io/secret/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-metrics-tls" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744331 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8e5e33b0-4e2e-464c-ba5b-cbd2048004f8" volumeName="kubernetes.io/configmap/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-config" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744342 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bac00ac5-0371-48fd-b1cc-60438f08ae94" volumeName="kubernetes.io/secret/bac00ac5-0371-48fd-b1cc-60438f08ae94-serving-cert" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744351 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6e9271a-44ea-4612-ab60-4a9d489ed062" volumeName="kubernetes.io/projected/c6e9271a-44ea-4612-ab60-4a9d489ed062-kube-api-access-cdsq5" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744362 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd4c4c6f-380a-4cda-9a21-352b55ec2d98" volumeName="kubernetes.io/configmap/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-trusted-ca" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744378 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="16057f9c-b1f8-4915-acc3-2d4532af4963" volumeName="kubernetes.io/projected/16057f9c-b1f8-4915-acc3-2d4532af4963-kube-api-access-lxnbc" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744390 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8e5e33b0-4e2e-464c-ba5b-cbd2048004f8" volumeName="kubernetes.io/projected/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-kube-api-access-n6bhm" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744401 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6e9271a-44ea-4612-ab60-4a9d489ed062" volumeName="kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-service-ca" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744410 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ccf81538-4d5a-4c26-8e54-fe39331a625d" volumeName="kubernetes.io/projected/ccf81538-4d5a-4c26-8e54-fe39331a625d-kube-api-access" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744419 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ccf81538-4d5a-4c26-8e54-fe39331a625d" volumeName="kubernetes.io/secret/ccf81538-4d5a-4c26-8e54-fe39331a625d-serving-cert" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744429 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd9f8671-8066-4990-b45d-8b619aa5d9ec" volumeName="kubernetes.io/secret/fd9f8671-8066-4990-b45d-8b619aa5d9ec-serving-cert" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744440 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ade9186-b262-4b5e-9c6f-ba89f0130fb6" volumeName="kubernetes.io/projected/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-kube-api-access-t46k7" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744448 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="27576028-d64a-47cd-b76b-d524e41efe37" volumeName="kubernetes.io/configmap/27576028-d64a-47cd-b76b-d524e41efe37-config" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744457 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b011b1f1-3235-4e20-825b-ce711c052407" volumeName="kubernetes.io/projected/b011b1f1-3235-4e20-825b-ce711c052407-bound-sa-token" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744467 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6e9271a-44ea-4612-ab60-4a9d489ed062" volumeName="kubernetes.io/secret/c6e9271a-44ea-4612-ab60-4a9d489ed062-serving-cert" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744475 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6e9271a-44ea-4612-ab60-4a9d489ed062" volumeName="kubernetes.io/secret/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-client" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744484 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="157eab0c-0d8d-486b-a349-c2e466e18e0c" volumeName="kubernetes.io/projected/157eab0c-0d8d-486b-a349-c2e466e18e0c-kube-api-access-p2mhg" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744495 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6f15dcdb-c968-429c-9d1d-63c2becad337" volumeName="kubernetes.io/configmap/6f15dcdb-c968-429c-9d1d-63c2becad337-trusted-ca" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744506 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7bf67a51-9759-4e2a-a2ae-ef7416cad43f" volumeName="kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-profile-collector-cert" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744518 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b011b1f1-3235-4e20-825b-ce711c052407" volumeName="kubernetes.io/configmap/b011b1f1-3235-4e20-825b-ce711c052407-trusted-ca" seLinuxMountContext="" Dec 04 11:37:45.744476 master-0 kubenswrapper[8993]: I1204 11:37:45.744527 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bac00ac5-0371-48fd-b1cc-60438f08ae94" volumeName="kubernetes.io/configmap/bac00ac5-0371-48fd-b1cc-60438f08ae94-config" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744536 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bdfcb644-24ef-4a33-93ae-a855e872d29a" volumeName="kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-cni-binary-copy" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744546 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6e9271a-44ea-4612-ab60-4a9d489ed062" volumeName="kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-ca" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744555 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ffaf95be-586c-40fa-b15f-1beaffe7ff1c" volumeName="kubernetes.io/projected/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-kube-api-access-t6bkg" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744565 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="00601c1a-efd4-4366-bdc9-d768afa252b0" volumeName="kubernetes.io/projected/00601c1a-efd4-4366-bdc9-d768afa252b0-kube-api-access-2g7bh" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744576 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="031d300e-24b4-481c-8b82-fe8cdb3fcef7" volumeName="kubernetes.io/projected/031d300e-24b4-481c-8b82-fe8cdb3fcef7-kube-api-access-k7bhn" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744586 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="27576028-d64a-47cd-b76b-d524e41efe37" volumeName="kubernetes.io/projected/27576028-d64a-47cd-b76b-d524e41efe37-kube-api-access" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744596 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="287fba2d-f56d-4ec0-b796-7849a68fb411" volumeName="kubernetes.io/configmap/287fba2d-f56d-4ec0-b796-7849a68fb411-ovnkube-config" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744607 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="287fba2d-f56d-4ec0-b796-7849a68fb411" volumeName="kubernetes.io/secret/287fba2d-f56d-4ec0-b796-7849a68fb411-ovn-control-plane-metrics-cert" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744616 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3322cc5a-f1f7-4522-b423-19fb7f38cd43" volumeName="kubernetes.io/secret/3322cc5a-f1f7-4522-b423-19fb7f38cd43-serving-cert" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744624 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="42b3be0f-1d82-4a64-abb4-0118a6960efd" volumeName="kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-trusted-ca-bundle" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744634 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="69640270-09e6-4217-b1c8-3d3465c0c3ae" volumeName="kubernetes.io/configmap/69640270-09e6-4217-b1c8-3d3465c0c3ae-service-ca" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744643 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7203ec93-6572-4032-825c-140029a86058" volumeName="kubernetes.io/projected/7203ec93-6572-4032-825c-140029a86058-kube-api-access-gkcj4" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744654 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d8fca733-45c8-45b8-8653-ac204e7c6098" volumeName="kubernetes.io/projected/d8fca733-45c8-45b8-8653-ac204e7c6098-kube-api-access-2ncf9" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744663 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0158c2f3-20e5-43f4-875d-c5ad8f6112df" volumeName="kubernetes.io/secret/0158c2f3-20e5-43f4-875d-c5ad8f6112df-cluster-olm-operator-serving-cert" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744674 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="157eab0c-0d8d-486b-a349-c2e466e18e0c" volumeName="kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovnkube-script-lib" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744685 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="157eab0c-0d8d-486b-a349-c2e466e18e0c" volumeName="kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-env-overrides" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744696 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ade9186-b262-4b5e-9c6f-ba89f0130fb6" volumeName="kubernetes.io/projected/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-bound-sa-token" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744735 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="42b3be0f-1d82-4a64-abb4-0118a6960efd" volumeName="kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-service-ca-bundle" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744746 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="42b3be0f-1d82-4a64-abb4-0118a6960efd" volumeName="kubernetes.io/projected/42b3be0f-1d82-4a64-abb4-0118a6960efd-kube-api-access-c7xwd" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744757 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6f15dcdb-c968-429c-9d1d-63c2becad337" volumeName="kubernetes.io/projected/6f15dcdb-c968-429c-9d1d-63c2becad337-kube-api-access-kkjzz" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744769 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6e9271a-44ea-4612-ab60-4a9d489ed062" volumeName="kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-config" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744784 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd9f8671-8066-4990-b45d-8b619aa5d9ec" volumeName="kubernetes.io/configmap/fd9f8671-8066-4990-b45d-8b619aa5d9ec-config" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744798 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3322cc5a-f1f7-4522-b423-19fb7f38cd43" volumeName="kubernetes.io/configmap/3322cc5a-f1f7-4522-b423-19fb7f38cd43-config" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744833 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7c017c69-b24e-4a7a-b888-133bed34c174" volumeName="kubernetes.io/projected/7c017c69-b24e-4a7a-b888-133bed34c174-kube-api-access-tlr76" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744847 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c790c174-dc60-4f34-8818-3b367fbe3a5f" volumeName="kubernetes.io/configmap/c790c174-dc60-4f34-8818-3b367fbe3a5f-cni-binary-copy" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744860 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bdfcb644-24ef-4a33-93ae-a855e872d29a" volumeName="kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-cni-sysctl-allowlist" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744872 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd9f8671-8066-4990-b45d-8b619aa5d9ec" volumeName="kubernetes.io/projected/fd9f8671-8066-4990-b45d-8b619aa5d9ec-kube-api-access-llscb" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744903 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ab26ae5-0607-4dfd-840e-531d204b5030" volumeName="kubernetes.io/configmap/2ab26ae5-0607-4dfd-840e-531d204b5030-telemetry-config" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744915 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ccf81538-4d5a-4c26-8e54-fe39331a625d" volumeName="kubernetes.io/configmap/ccf81538-4d5a-4c26-8e54-fe39331a625d-config" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744926 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7203ec93-6572-4032-825c-140029a86058" volumeName="kubernetes.io/configmap/7203ec93-6572-4032-825c-140029a86058-ovnkube-identity-cm" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744935 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b011b1f1-3235-4e20-825b-ce711c052407" volumeName="kubernetes.io/projected/b011b1f1-3235-4e20-825b-ce711c052407-kube-api-access-jq49f" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744944 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="157eab0c-0d8d-486b-a349-c2e466e18e0c" volumeName="kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovnkube-config" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744954 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5b826c3-8638-4cf5-b974-b24e4282ce00" volumeName="kubernetes.io/configmap/a5b826c3-8638-4cf5-b974-b24e4282ce00-config" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744962 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bac00ac5-0371-48fd-b1cc-60438f08ae94" volumeName="kubernetes.io/projected/bac00ac5-0371-48fd-b1cc-60438f08ae94-kube-api-access" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744972 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="00601c1a-efd4-4366-bdc9-d768afa252b0" volumeName="kubernetes.io/empty-dir/00601c1a-efd4-4366-bdc9-d768afa252b0-available-featuregates" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744982 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0158c2f3-20e5-43f4-875d-c5ad8f6112df" volumeName="kubernetes.io/empty-dir/0158c2f3-20e5-43f4-875d-c5ad8f6112df-operand-assets" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.744994 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="287fba2d-f56d-4ec0-b796-7849a68fb411" volumeName="kubernetes.io/configmap/287fba2d-f56d-4ec0-b796-7849a68fb411-env-overrides" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745008 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3322cc5a-f1f7-4522-b423-19fb7f38cd43" volumeName="kubernetes.io/projected/3322cc5a-f1f7-4522-b423-19fb7f38cd43-kube-api-access-k449s" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745021 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="42b3be0f-1d82-4a64-abb4-0118a6960efd" volumeName="kubernetes.io/secret/42b3be0f-1d82-4a64-abb4-0118a6960efd-serving-cert" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745032 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="69640270-09e6-4217-b1c8-3d3465c0c3ae" volumeName="kubernetes.io/projected/69640270-09e6-4217-b1c8-3d3465c0c3ae-kube-api-access" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745042 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bdfcb644-24ef-4a33-93ae-a855e872d29a" volumeName="kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-whereabouts-configmap" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745052 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="00601c1a-efd4-4366-bdc9-d768afa252b0" volumeName="kubernetes.io/secret/00601c1a-efd4-4366-bdc9-d768afa252b0-serving-cert" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745064 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="157eab0c-0d8d-486b-a349-c2e466e18e0c" volumeName="kubernetes.io/secret/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovn-node-metrics-cert" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745076 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ade9186-b262-4b5e-9c6f-ba89f0130fb6" volumeName="kubernetes.io/configmap/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-trusted-ca" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745087 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="27576028-d64a-47cd-b76b-d524e41efe37" volumeName="kubernetes.io/secret/27576028-d64a-47cd-b76b-d524e41efe37-serving-cert" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745096 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="287fba2d-f56d-4ec0-b796-7849a68fb411" volumeName="kubernetes.io/projected/287fba2d-f56d-4ec0-b796-7849a68fb411-kube-api-access-gmdvf" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745104 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="330553d2-40ea-4496-8346-2e5bf680669b" volumeName="kubernetes.io/configmap/330553d2-40ea-4496-8346-2e5bf680669b-iptables-alerter-script" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745113 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="42b3be0f-1d82-4a64-abb4-0118a6960efd" volumeName="kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-config" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745122 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="434ed9b9-715b-455b-867c-775b256df40f" volumeName="kubernetes.io/projected/434ed9b9-715b-455b-867c-775b256df40f-kube-api-access-ggzfm" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745131 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="434ed9b9-715b-455b-867c-775b256df40f" volumeName="kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-profile-collector-cert" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745140 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8e5e33b0-4e2e-464c-ba5b-cbd2048004f8" volumeName="kubernetes.io/secret/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-serving-cert" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745148 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bdfcb644-24ef-4a33-93ae-a855e872d29a" volumeName="kubernetes.io/projected/bdfcb644-24ef-4a33-93ae-a855e872d29a-kube-api-access-f4w2j" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745157 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ab26ae5-0607-4dfd-840e-531d204b5030" volumeName="kubernetes.io/projected/2ab26ae5-0607-4dfd-840e-531d204b5030-kube-api-access-mvzrc" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745167 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="330553d2-40ea-4496-8346-2e5bf680669b" volumeName="kubernetes.io/projected/330553d2-40ea-4496-8346-2e5bf680669b-kube-api-access-59pbp" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745176 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7203ec93-6572-4032-825c-140029a86058" volumeName="kubernetes.io/configmap/7203ec93-6572-4032-825c-140029a86058-env-overrides" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745184 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7bf67a51-9759-4e2a-a2ae-ef7416cad43f" volumeName="kubernetes.io/projected/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-kube-api-access-zr454" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745193 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5b826c3-8638-4cf5-b974-b24e4282ce00" volumeName="kubernetes.io/projected/a5b826c3-8638-4cf5-b974-b24e4282ce00-kube-api-access-rhmlm" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745201 8993 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd4c4c6f-380a-4cda-9a21-352b55ec2d98" volumeName="kubernetes.io/projected/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-kube-api-access-rj4dt" seLinuxMountContext="" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745209 8993 reconstruct.go:97] "Volume reconstruction finished" Dec 04 11:37:45.745389 master-0 kubenswrapper[8993]: I1204 11:37:45.745217 8993 reconciler.go:26] "Reconciler: start to sync state" Dec 04 11:37:45.749582 master-0 kubenswrapper[8993]: I1204 11:37:45.749542 8993 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Dec 04 11:37:45.749927 master-0 kubenswrapper[8993]: I1204 11:37:45.749880 8993 factory.go:55] Registering systemd factory Dec 04 11:37:45.749927 master-0 kubenswrapper[8993]: I1204 11:37:45.749924 8993 factory.go:221] Registration of the systemd container factory successfully Dec 04 11:37:45.750374 master-0 kubenswrapper[8993]: I1204 11:37:45.750331 8993 factory.go:153] Registering CRI-O factory Dec 04 11:37:45.750374 master-0 kubenswrapper[8993]: I1204 11:37:45.750368 8993 factory.go:221] Registration of the crio container factory successfully Dec 04 11:37:45.751127 master-0 kubenswrapper[8993]: I1204 11:37:45.750537 8993 factory.go:219] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Dec 04 11:37:45.751127 master-0 kubenswrapper[8993]: I1204 11:37:45.750971 8993 factory.go:103] Registering Raw factory Dec 04 11:37:45.751127 master-0 kubenswrapper[8993]: I1204 11:37:45.750994 8993 manager.go:1196] Started watching for new ooms in manager Dec 04 11:37:45.752131 master-0 kubenswrapper[8993]: I1204 11:37:45.751973 8993 manager.go:319] Starting recovery of all containers Dec 04 11:37:45.774953 master-0 kubenswrapper[8993]: E1204 11:37:45.774768 8993 kubelet.go:1495] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Dec 04 11:37:45.790685 master-0 kubenswrapper[8993]: I1204 11:37:45.790602 8993 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv4" Dec 04 11:37:45.792751 master-0 kubenswrapper[8993]: I1204 11:37:45.792722 8993 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv6" Dec 04 11:37:45.792843 master-0 kubenswrapper[8993]: I1204 11:37:45.792780 8993 status_manager.go:217] "Starting to sync pod status with apiserver" Dec 04 11:37:45.792843 master-0 kubenswrapper[8993]: I1204 11:37:45.792833 8993 kubelet.go:2335] "Starting kubelet main sync loop" Dec 04 11:37:45.792929 master-0 kubenswrapper[8993]: E1204 11:37:45.792897 8993 kubelet.go:2359] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Dec 04 11:37:45.795425 master-0 kubenswrapper[8993]: I1204 11:37:45.795390 8993 reflector.go:368] Caches populated for *v1.RuntimeClass from k8s.io/client-go/informers/factory.go:160 Dec 04 11:37:45.817564 master-0 kubenswrapper[8993]: I1204 11:37:45.817491 8993 generic.go:334] "Generic (PLEG): container finished" podID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerID="8b2e6952b1e04c91242f448af7e8c754dbdec6df62ea2d8c6f318ad45c211983" exitCode=0 Dec 04 11:37:45.839887 master-0 kubenswrapper[8993]: I1204 11:37:45.839795 8993 generic.go:334] "Generic (PLEG): container finished" podID="bdfcb644-24ef-4a33-93ae-a855e872d29a" containerID="1d5a311d3baeca56657213d2436c5cd5a6f19236b17d29ba3c96c8778083bdb3" exitCode=0 Dec 04 11:37:45.839887 master-0 kubenswrapper[8993]: I1204 11:37:45.839866 8993 generic.go:334] "Generic (PLEG): container finished" podID="bdfcb644-24ef-4a33-93ae-a855e872d29a" containerID="7d222cce1ac64b8e7a610b554b283ef4b4d0fcbf566ec67f8a7637ab6af91dcb" exitCode=0 Dec 04 11:37:45.839887 master-0 kubenswrapper[8993]: I1204 11:37:45.839876 8993 generic.go:334] "Generic (PLEG): container finished" podID="bdfcb644-24ef-4a33-93ae-a855e872d29a" containerID="c09e207d8873c7c6bd85b10d3d0b68a6f4de01726a36fb157635378662fe6ac7" exitCode=0 Dec 04 11:37:45.839887 master-0 kubenswrapper[8993]: I1204 11:37:45.839887 8993 generic.go:334] "Generic (PLEG): container finished" podID="bdfcb644-24ef-4a33-93ae-a855e872d29a" containerID="180c9014500168f2c0f5e0532e1a0a716b6e343af71b25614526bc3a4db81fe9" exitCode=0 Dec 04 11:37:45.839887 master-0 kubenswrapper[8993]: I1204 11:37:45.839896 8993 generic.go:334] "Generic (PLEG): container finished" podID="bdfcb644-24ef-4a33-93ae-a855e872d29a" containerID="eadce23f3de74bb3fa383956febe6a31a7bf48f1c04ed7c5a031f480449f38e8" exitCode=0 Dec 04 11:37:45.839887 master-0 kubenswrapper[8993]: I1204 11:37:45.839904 8993 generic.go:334] "Generic (PLEG): container finished" podID="bdfcb644-24ef-4a33-93ae-a855e872d29a" containerID="4f5e35a41648fd33f62ab41661b91852c5163f0f30c4978159e0c3c22f526438" exitCode=0 Dec 04 11:37:45.844661 master-0 kubenswrapper[8993]: I1204 11:37:45.843924 8993 generic.go:334] "Generic (PLEG): container finished" podID="d75143d9bc4a2dc15781dc51ccff632a" containerID="9c7529c8ca2d0c98a54eee2915f7d9cb961fdd0ba295047dca3baa0a51ae6a4b" exitCode=0 Dec 04 11:37:45.850797 master-0 kubenswrapper[8993]: I1204 11:37:45.850593 8993 generic.go:334] "Generic (PLEG): container finished" podID="0158c2f3-20e5-43f4-875d-c5ad8f6112df" containerID="5f323ae636217996144f9c95442c8e52f9bd99e4069e42ddad8761df1ef87b48" exitCode=0 Dec 04 11:37:45.858570 master-0 kubenswrapper[8993]: I1204 11:37:45.858512 8993 generic.go:334] "Generic (PLEG): container finished" podID="3e64e99a-b3b9-4db7-aec4-8e61d1370e7e" containerID="db84ab590d59181aff119f26f2f6597b685567de9008996795746da92ab70ad5" exitCode=0 Dec 04 11:37:45.874873 master-0 kubenswrapper[8993]: I1204 11:37:45.874790 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_3169f44496ed8a28c6d6a15511ab0eec/kube-rbac-proxy-crio/2.log" Dec 04 11:37:45.875356 master-0 kubenswrapper[8993]: I1204 11:37:45.875310 8993 generic.go:334] "Generic (PLEG): container finished" podID="3169f44496ed8a28c6d6a15511ab0eec" containerID="3ed798c104f2e301f0961443f8ab6df6e17ec4caae5f1436b2b93d415a28f796" exitCode=1 Dec 04 11:37:45.875356 master-0 kubenswrapper[8993]: I1204 11:37:45.875346 8993 generic.go:334] "Generic (PLEG): container finished" podID="3169f44496ed8a28c6d6a15511ab0eec" containerID="fe978e3c9349858cb4986d59a0d297668af47052f5667b090a002d76ebcd619e" exitCode=0 Dec 04 11:37:45.877540 master-0 kubenswrapper[8993]: I1204 11:37:45.877484 8993 generic.go:334] "Generic (PLEG): container finished" podID="cca0c8b5-4833-4e29-8a5b-d5fd891635e6" containerID="0d3125af9f225e916c36216370812055c372bf043dda0792009085c501b96333" exitCode=0 Dec 04 11:37:45.887262 master-0 kubenswrapper[8993]: I1204 11:37:45.886921 8993 generic.go:334] "Generic (PLEG): container finished" podID="8b47694fcc32464ab24d09c23d6efb57" containerID="b371ad607ffd3e5ee045c3b072b5398e7b47188ceda9be737847471999ef8986" exitCode=1 Dec 04 11:37:45.892454 master-0 kubenswrapper[8993]: I1204 11:37:45.892390 8993 generic.go:334] "Generic (PLEG): container finished" podID="157eab0c-0d8d-486b-a349-c2e466e18e0c" containerID="aa46a13fdd928fc26792c9ef2cde5780818c25c59ca4872fc97dad5a0d213287" exitCode=0 Dec 04 11:37:45.893245 master-0 kubenswrapper[8993]: E1204 11:37:45.892991 8993 kubelet.go:2359] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Dec 04 11:37:45.932984 master-0 kubenswrapper[8993]: I1204 11:37:45.932937 8993 manager.go:324] Recovery completed Dec 04 11:37:45.977430 master-0 kubenswrapper[8993]: I1204 11:37:45.977353 8993 cpu_manager.go:225] "Starting CPU manager" policy="none" Dec 04 11:37:45.977430 master-0 kubenswrapper[8993]: I1204 11:37:45.977379 8993 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" Dec 04 11:37:45.977430 master-0 kubenswrapper[8993]: I1204 11:37:45.977402 8993 state_mem.go:36] "Initialized new in-memory state store" Dec 04 11:37:45.977970 master-0 kubenswrapper[8993]: I1204 11:37:45.977604 8993 state_mem.go:88] "Updated default CPUSet" cpuSet="" Dec 04 11:37:45.977970 master-0 kubenswrapper[8993]: I1204 11:37:45.977617 8993 state_mem.go:96] "Updated CPUSet assignments" assignments={} Dec 04 11:37:45.977970 master-0 kubenswrapper[8993]: I1204 11:37:45.977640 8993 state_checkpoint.go:136] "State checkpoint: restored state from checkpoint" Dec 04 11:37:45.977970 master-0 kubenswrapper[8993]: I1204 11:37:45.977648 8993 state_checkpoint.go:137] "State checkpoint: defaultCPUSet" defaultCpuSet="" Dec 04 11:37:45.977970 master-0 kubenswrapper[8993]: I1204 11:37:45.977654 8993 policy_none.go:49] "None policy: Start" Dec 04 11:37:45.980686 master-0 kubenswrapper[8993]: I1204 11:37:45.980659 8993 memory_manager.go:170] "Starting memorymanager" policy="None" Dec 04 11:37:45.980686 master-0 kubenswrapper[8993]: I1204 11:37:45.980688 8993 state_mem.go:35] "Initializing new in-memory state store" Dec 04 11:37:45.980907 master-0 kubenswrapper[8993]: I1204 11:37:45.980885 8993 state_mem.go:75] "Updated machine memory state" Dec 04 11:37:45.980907 master-0 kubenswrapper[8993]: I1204 11:37:45.980900 8993 state_checkpoint.go:82] "State checkpoint: restored state from checkpoint" Dec 04 11:37:45.994410 master-0 kubenswrapper[8993]: I1204 11:37:45.994338 8993 manager.go:334] "Starting Device Plugin manager" Dec 04 11:37:45.994669 master-0 kubenswrapper[8993]: I1204 11:37:45.994433 8993 manager.go:513] "Failed to read data from checkpoint" checkpoint="kubelet_internal_checkpoint" err="checkpoint is not found" Dec 04 11:37:45.994669 master-0 kubenswrapper[8993]: I1204 11:37:45.994454 8993 server.go:79] "Starting device plugin registration server" Dec 04 11:37:45.995159 master-0 kubenswrapper[8993]: I1204 11:37:45.995131 8993 eviction_manager.go:189] "Eviction manager: starting control loop" Dec 04 11:37:45.995226 master-0 kubenswrapper[8993]: I1204 11:37:45.995152 8993 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Dec 04 11:37:45.995494 master-0 kubenswrapper[8993]: I1204 11:37:45.995464 8993 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Dec 04 11:37:45.995591 master-0 kubenswrapper[8993]: I1204 11:37:45.995568 8993 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Dec 04 11:37:45.995591 master-0 kubenswrapper[8993]: I1204 11:37:45.995583 8993 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.094017 8993 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-etcd/etcd-master-0-master-0","openshift-kube-apiserver/bootstrap-kube-apiserver-master-0","kube-system/bootstrap-kube-controller-manager-master-0","kube-system/bootstrap-kube-scheduler-master-0","openshift-machine-config-operator/kube-rbac-proxy-crio-master-0"] Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.095353 8993 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.095369 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-scheduler-master-0" event={"ID":"5e09e2af7200e6f9be469dbfd9bb1127","Type":"ContainerStarted","Data":"28bd405676e81717d938eefd29fce0475230f84557116212e1a3920f34143d20"} Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.095460 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-scheduler-master-0" event={"ID":"5e09e2af7200e6f9be469dbfd9bb1127","Type":"ContainerStarted","Data":"6080c82a1de6439e859491a681111c8d2ae9907c581f1c30e651428ab5f16038"} Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.095570 8993 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9fbdb7f82e6e6abb4f5215b275fdf2bc40ea4d65f7fb361a517df32aae2da0f0" Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.095585 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" event={"ID":"d75143d9bc4a2dc15781dc51ccff632a","Type":"ContainerStarted","Data":"cb6defb2f3057900b70ffad997ff544ea8c575bd9817b1a99621b2f9c63061e6"} Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.095598 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" event={"ID":"d75143d9bc4a2dc15781dc51ccff632a","Type":"ContainerStarted","Data":"14ac45f5991606821dff758d708720469710a75e4bb098390a3a5689b8ae0ee8"} Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.095608 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" event={"ID":"d75143d9bc4a2dc15781dc51ccff632a","Type":"ContainerDied","Data":"9c7529c8ca2d0c98a54eee2915f7d9cb961fdd0ba295047dca3baa0a51ae6a4b"} Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.095624 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" event={"ID":"d75143d9bc4a2dc15781dc51ccff632a","Type":"ContainerStarted","Data":"59191695c89f8cecbba881756b5ffc5e4c892fd02facf20cc198ade1bf4ec267"} Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.095648 8993 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e53241da78dfcc827440e729a29c6a711ab284ebcb1ae27338b43e1937314aa2" Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.095657 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0-master-0" event={"ID":"cc0396a9a2689b3e8c132c12640cbe83","Type":"ContainerStarted","Data":"4ed3912e9d934219e324f1b3be9ecb2f87f15e4be5f71ebe6a2e74f6f7ff9948"} Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.095670 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0-master-0" event={"ID":"cc0396a9a2689b3e8c132c12640cbe83","Type":"ContainerStarted","Data":"2486b68bc3517ab1664fcb1823dbcafa72bb90a8386d8e6780a8a95866e68263"} Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.095683 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0-master-0" event={"ID":"cc0396a9a2689b3e8c132c12640cbe83","Type":"ContainerStarted","Data":"1118687f000f059298fcb4f89292520334eab60bb7e784774b74bdb9bc2421bc"} Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.095700 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"3169f44496ed8a28c6d6a15511ab0eec","Type":"ContainerStarted","Data":"cdc388259d8085154ae8e01bcad3dcfe7d469aa6e6aee3f021b6d2209453f2f4"} Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.095716 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"3169f44496ed8a28c6d6a15511ab0eec","Type":"ContainerDied","Data":"3ed798c104f2e301f0961443f8ab6df6e17ec4caae5f1436b2b93d415a28f796"} Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.095731 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"3169f44496ed8a28c6d6a15511ab0eec","Type":"ContainerDied","Data":"fe978e3c9349858cb4986d59a0d297668af47052f5667b090a002d76ebcd619e"} Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.095745 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"3169f44496ed8a28c6d6a15511ab0eec","Type":"ContainerStarted","Data":"870c232b93a5ee37a81fedb1347de97a51e51c964baa741a79bf8da03ca09932"} Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.095765 8993 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26ccf7a34e6643ad55af1366a3b1dbada6c9287b33079aa7a4ffa9382040181c" Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.095780 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"8b47694fcc32464ab24d09c23d6efb57","Type":"ContainerStarted","Data":"9f168b6e831554c513b271c722d3ec7e4db28ab5d11f8b57803ff03a30c8af06"} Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.095793 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"8b47694fcc32464ab24d09c23d6efb57","Type":"ContainerStarted","Data":"a573a12b7e61507c596e1178d09644f02ee9de55d89553ed9fce32978b18dcf3"} Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.095827 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"8b47694fcc32464ab24d09c23d6efb57","Type":"ContainerDied","Data":"b371ad607ffd3e5ee045c3b072b5398e7b47188ceda9be737847471999ef8986"} Dec 04 11:37:46.095966 master-0 kubenswrapper[8993]: I1204 11:37:46.095843 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"8b47694fcc32464ab24d09c23d6efb57","Type":"ContainerStarted","Data":"adbccd36bc5c65e5e88e6060aa8c07788d2d0acd9edee809c8e2d70678390332"} Dec 04 11:37:46.098847 master-0 kubenswrapper[8993]: I1204 11:37:46.098777 8993 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:37:46.098847 master-0 kubenswrapper[8993]: I1204 11:37:46.098837 8993 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:37:46.098847 master-0 kubenswrapper[8993]: I1204 11:37:46.098847 8993 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:37:46.099044 master-0 kubenswrapper[8993]: I1204 11:37:46.098908 8993 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 11:37:46.107919 master-0 kubenswrapper[8993]: E1204 11:37:46.107857 8993 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"kube-rbac-proxy-crio-master-0\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 11:37:46.111476 master-0 kubenswrapper[8993]: I1204 11:37:46.111418 8993 kubelet_node_status.go:115] "Node was previously registered" node="master-0" Dec 04 11:37:46.111610 master-0 kubenswrapper[8993]: I1204 11:37:46.111549 8993 kubelet_node_status.go:79] "Successfully registered node" node="master-0" Dec 04 11:37:46.118313 master-0 kubenswrapper[8993]: E1204 11:37:46.118253 8993 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"bootstrap-kube-apiserver-master-0\" already exists" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:46.126288 master-0 kubenswrapper[8993]: W1204 11:37:46.126118 8993 warnings.go:70] would violate PodSecurity "restricted:latest": host namespaces (hostNetwork=true), hostPort (container "etcd" uses hostPorts 2379, 2380), privileged (containers "etcdctl", "etcd" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (containers "etcdctl", "etcd" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (containers "etcdctl", "etcd" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volumes "certs", "data-dir" use restricted volume type "hostPath"), runAsNonRoot != true (pod or containers "etcdctl", "etcd" must set securityContext.runAsNonRoot=true), seccompProfile (pod or containers "etcdctl", "etcd" must set securityContext.seccompProfile.type to "RuntimeDefault" or "Localhost") Dec 04 11:37:46.126576 master-0 kubenswrapper[8993]: E1204 11:37:46.126436 8993 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"etcd-master-0-master-0\" already exists" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:37:46.126824 master-0 kubenswrapper[8993]: E1204 11:37:46.126746 8993 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"bootstrap-kube-controller-manager-master-0\" already exists" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:46.127030 master-0 kubenswrapper[8993]: E1204 11:37:46.126960 8993 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"bootstrap-kube-scheduler-master-0\" already exists" pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 11:37:46.150324 master-0 kubenswrapper[8993]: I1204 11:37:46.150092 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-secrets\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:46.150324 master-0 kubenswrapper[8993]: I1204 11:37:46.150170 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3169f44496ed8a28c6d6a15511ab0eec-etc-kube\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"3169f44496ed8a28c6d6a15511ab0eec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 11:37:46.150324 master-0 kubenswrapper[8993]: I1204 11:37:46.150198 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/host-path/cc0396a9a2689b3e8c132c12640cbe83-certs\") pod \"etcd-master-0-master-0\" (UID: \"cc0396a9a2689b3e8c132c12640cbe83\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:37:46.150324 master-0 kubenswrapper[8993]: I1204 11:37:46.150219 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/cc0396a9a2689b3e8c132c12640cbe83-data-dir\") pod \"etcd-master-0-master-0\" (UID: \"cc0396a9a2689b3e8c132c12640cbe83\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:37:46.150324 master-0 kubenswrapper[8993]: I1204 11:37:46.150251 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-secrets\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:46.150324 master-0 kubenswrapper[8993]: I1204 11:37:46.150282 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-ssl-certs-host\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:46.150677 master-0 kubenswrapper[8993]: I1204 11:37:46.150373 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-etc-kubernetes-cloud\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:46.150677 master-0 kubenswrapper[8993]: I1204 11:37:46.150441 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-config\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:46.150677 master-0 kubenswrapper[8993]: I1204 11:37:46.150462 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-logs\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:46.150677 master-0 kubenswrapper[8993]: I1204 11:37:46.150482 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-logs\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:46.150677 master-0 kubenswrapper[8993]: I1204 11:37:46.150501 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-ssl-certs-host\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:46.150677 master-0 kubenswrapper[8993]: I1204 11:37:46.150520 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/5e09e2af7200e6f9be469dbfd9bb1127-secrets\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"5e09e2af7200e6f9be469dbfd9bb1127\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 11:37:46.150677 master-0 kubenswrapper[8993]: I1204 11:37:46.150537 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/5e09e2af7200e6f9be469dbfd9bb1127-logs\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"5e09e2af7200e6f9be469dbfd9bb1127\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 11:37:46.150677 master-0 kubenswrapper[8993]: I1204 11:37:46.150554 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3169f44496ed8a28c6d6a15511ab0eec-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"3169f44496ed8a28c6d6a15511ab0eec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 11:37:46.150677 master-0 kubenswrapper[8993]: I1204 11:37:46.150570 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-etc-kubernetes-cloud\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:46.150677 master-0 kubenswrapper[8993]: I1204 11:37:46.150588 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-config\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:46.150677 master-0 kubenswrapper[8993]: I1204 11:37:46.150604 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-audit-dir\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:46.251298 master-0 kubenswrapper[8993]: I1204 11:37:46.251179 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-secrets\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:46.251514 master-0 kubenswrapper[8993]: I1204 11:37:46.251403 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-secrets\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:46.251514 master-0 kubenswrapper[8993]: I1204 11:37:46.251452 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-etc-kubernetes-cloud\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:46.251514 master-0 kubenswrapper[8993]: I1204 11:37:46.251504 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-config\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:46.251908 master-0 kubenswrapper[8993]: I1204 11:37:46.251532 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-logs\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:46.251908 master-0 kubenswrapper[8993]: I1204 11:37:46.251825 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-etc-kubernetes-cloud\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:46.251993 master-0 kubenswrapper[8993]: I1204 11:37:46.251973 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-config\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:46.252122 master-0 kubenswrapper[8993]: I1204 11:37:46.252003 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3169f44496ed8a28c6d6a15511ab0eec-etc-kube\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"3169f44496ed8a28c6d6a15511ab0eec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 11:37:46.252122 master-0 kubenswrapper[8993]: I1204 11:37:46.252085 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-logs\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:46.252122 master-0 kubenswrapper[8993]: I1204 11:37:46.252116 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/host-path/cc0396a9a2689b3e8c132c12640cbe83-certs\") pod \"etcd-master-0-master-0\" (UID: \"cc0396a9a2689b3e8c132c12640cbe83\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:37:46.252251 master-0 kubenswrapper[8993]: I1204 11:37:46.252026 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3169f44496ed8a28c6d6a15511ab0eec-etc-kube\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"3169f44496ed8a28c6d6a15511ab0eec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 11:37:46.252251 master-0 kubenswrapper[8993]: I1204 11:37:46.252153 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"certs\" (UniqueName: \"kubernetes.io/host-path/cc0396a9a2689b3e8c132c12640cbe83-certs\") pod \"etcd-master-0-master-0\" (UID: \"cc0396a9a2689b3e8c132c12640cbe83\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:37:46.252251 master-0 kubenswrapper[8993]: I1204 11:37:46.252194 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/cc0396a9a2689b3e8c132c12640cbe83-data-dir\") pod \"etcd-master-0-master-0\" (UID: \"cc0396a9a2689b3e8c132c12640cbe83\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:37:46.252251 master-0 kubenswrapper[8993]: I1204 11:37:46.252219 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-secrets\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:46.252251 master-0 kubenswrapper[8993]: I1204 11:37:46.252239 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-ssl-certs-host\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:46.252469 master-0 kubenswrapper[8993]: I1204 11:37:46.252286 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-secrets\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:46.252469 master-0 kubenswrapper[8993]: I1204 11:37:46.252288 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/cc0396a9a2689b3e8c132c12640cbe83-data-dir\") pod \"etcd-master-0-master-0\" (UID: \"cc0396a9a2689b3e8c132c12640cbe83\") " pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:37:46.252469 master-0 kubenswrapper[8993]: I1204 11:37:46.252307 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3169f44496ed8a28c6d6a15511ab0eec-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"3169f44496ed8a28c6d6a15511ab0eec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 11:37:46.252469 master-0 kubenswrapper[8993]: I1204 11:37:46.252326 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-ssl-certs-host\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:46.252469 master-0 kubenswrapper[8993]: I1204 11:37:46.252342 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-logs\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:46.252469 master-0 kubenswrapper[8993]: I1204 11:37:46.252355 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3169f44496ed8a28c6d6a15511ab0eec-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"3169f44496ed8a28c6d6a15511ab0eec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 11:37:46.252469 master-0 kubenswrapper[8993]: I1204 11:37:46.252363 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-ssl-certs-host\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:46.252469 master-0 kubenswrapper[8993]: I1204 11:37:46.252385 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/5e09e2af7200e6f9be469dbfd9bb1127-secrets\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"5e09e2af7200e6f9be469dbfd9bb1127\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 11:37:46.252469 master-0 kubenswrapper[8993]: I1204 11:37:46.252439 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/5e09e2af7200e6f9be469dbfd9bb1127-secrets\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"5e09e2af7200e6f9be469dbfd9bb1127\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 11:37:46.252469 master-0 kubenswrapper[8993]: I1204 11:37:46.252445 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-logs\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:46.252796 master-0 kubenswrapper[8993]: I1204 11:37:46.252456 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-ssl-certs-host\") pod \"bootstrap-kube-controller-manager-master-0\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:46.252796 master-0 kubenswrapper[8993]: I1204 11:37:46.252541 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/5e09e2af7200e6f9be469dbfd9bb1127-logs\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"5e09e2af7200e6f9be469dbfd9bb1127\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 11:37:46.252796 master-0 kubenswrapper[8993]: I1204 11:37:46.252577 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-etc-kubernetes-cloud\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:46.252796 master-0 kubenswrapper[8993]: I1204 11:37:46.252618 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/5e09e2af7200e6f9be469dbfd9bb1127-logs\") pod \"bootstrap-kube-scheduler-master-0\" (UID: \"5e09e2af7200e6f9be469dbfd9bb1127\") " pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 11:37:46.252796 master-0 kubenswrapper[8993]: I1204 11:37:46.252620 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-etc-kubernetes-cloud\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:46.252796 master-0 kubenswrapper[8993]: I1204 11:37:46.252635 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-config\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:46.252796 master-0 kubenswrapper[8993]: I1204 11:37:46.252660 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-config\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:46.252796 master-0 kubenswrapper[8993]: I1204 11:37:46.252665 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-audit-dir\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:46.252796 master-0 kubenswrapper[8993]: I1204 11:37:46.252714 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/d75143d9bc4a2dc15781dc51ccff632a-audit-dir\") pod \"bootstrap-kube-apiserver-master-0\" (UID: \"d75143d9bc4a2dc15781dc51ccff632a\") " pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:46.508823 master-0 kubenswrapper[8993]: I1204 11:37:46.508729 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:46.723768 master-0 kubenswrapper[8993]: I1204 11:37:46.723626 8993 apiserver.go:52] "Watching apiserver" Dec 04 11:37:46.735386 master-0 kubenswrapper[8993]: I1204 11:37:46.735291 8993 reflector.go:368] Caches populated for *v1.Pod from pkg/kubelet/config/apiserver.go:66 Dec 04 11:37:46.736686 master-0 kubenswrapper[8993]: I1204 11:37:46.736608 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948","openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw","openshift-network-node-identity/network-node-identity-f8hvq","openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn","assisted-installer/assisted-installer-controller-lj5rn","openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2","openshift-controller-manager/controller-manager-59948648c9-krt4p","openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j","openshift-etcd/etcd-master-0-master-0","openshift-multus/multus-admission-controller-7dfc5b745f-258xq","openshift-network-operator/iptables-alerter-bkmlp","openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz","kube-system/bootstrap-kube-controller-manager-master-0","openshift-cluster-storage-operator/csi-snapshot-controller-operator-6bc8656fdc-2q7f5","openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr","openshift-network-operator/network-operator-79767b7ff9-5bgzx","openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq","kube-system/bootstrap-kube-scheduler-master-0","openshift-machine-config-operator/kube-rbac-proxy-crio-master-0","openshift-multus/multus-additional-cni-plugins-6pk59","openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q","openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf","openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5","openshift-ingress-operator/ingress-operator-8649c48786-cx2b2","openshift-marketplace/marketplace-operator-f797b99b6-hjjrk","openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn","openshift-multus/multus-twxbl","openshift-multus/network-metrics-daemon-gp57t","openshift-kube-storage-version-migrator/migrator-74b7b57c65-d6v67","openshift-network-diagnostics/network-check-target-w2lss","openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf","openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr","openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd","openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl","openshift-kube-apiserver/bootstrap-kube-apiserver-master-0","openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg","openshift-ovn-kubernetes/ovnkube-node-z4qvm","openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw","openshift-dns-operator/dns-operator-7c56cf9b74-xz27r","openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv","openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll"] Dec 04 11:37:46.737013 master-0 kubenswrapper[8993]: I1204 11:37:46.736921 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="assisted-installer/assisted-installer-controller-lj5rn" Dec 04 11:37:46.737344 master-0 kubenswrapper[8993]: I1204 11:37:46.737043 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:46.737344 master-0 kubenswrapper[8993]: I1204 11:37:46.737183 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:37:46.738222 master-0 kubenswrapper[8993]: I1204 11:37:46.738176 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:37:46.738312 master-0 kubenswrapper[8993]: I1204 11:37:46.738239 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:46.739373 master-0 kubenswrapper[8993]: I1204 11:37:46.739318 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:46.743947 master-0 kubenswrapper[8993]: I1204 11:37:46.743873 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:37:46.744525 master-0 kubenswrapper[8993]: I1204 11:37:46.744473 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"openshift-service-ca.crt" Dec 04 11:37:46.744887 master-0 kubenswrapper[8993]: I1204 11:37:46.744835 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"kube-root-ca.crt" Dec 04 11:37:46.745432 master-0 kubenswrapper[8993]: I1204 11:37:46.745160 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca-operator"/"serving-cert" Dec 04 11:37:46.746161 master-0 kubenswrapper[8993]: I1204 11:37:46.746089 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"openshift-service-ca.crt" Dec 04 11:37:46.748557 master-0 kubenswrapper[8993]: I1204 11:37:46.748499 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:46.748657 master-0 kubenswrapper[8993]: I1204 11:37:46.748581 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:46.748657 master-0 kubenswrapper[8993]: I1204 11:37:46.748622 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:46.748773 master-0 kubenswrapper[8993]: I1204 11:37:46.748631 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:46.748864 master-0 kubenswrapper[8993]: I1204 11:37:46.748847 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:37:46.748928 master-0 kubenswrapper[8993]: I1204 11:37:46.748906 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:46.748928 master-0 kubenswrapper[8993]: I1204 11:37:46.748919 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:46.749158 master-0 kubenswrapper[8993]: I1204 11:37:46.749107 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-scheduler-operator"/"kube-scheduler-operator-serving-cert" Dec 04 11:37:46.749279 master-0 kubenswrapper[8993]: I1204 11:37:46.749230 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns-operator"/"metrics-tls" Dec 04 11:37:46.749279 master-0 kubenswrapper[8993]: I1204 11:37:46.749268 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"cluster-monitoring-operator-tls" Dec 04 11:37:46.749479 master-0 kubenswrapper[8993]: I1204 11:37:46.749366 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-olm-operator"/"cluster-olm-operator-serving-cert" Dec 04 11:37:46.752942 master-0 kubenswrapper[8993]: I1204 11:37:46.750631 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"performance-addon-operator-webhook-cert" Dec 04 11:37:46.754341 master-0 kubenswrapper[8993]: I1204 11:37:46.754286 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-olm-operator"/"openshift-service-ca.crt" Dec 04 11:37:46.754541 master-0 kubenswrapper[8993]: I1204 11:37:46.754497 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"openshift-service-ca.crt" Dec 04 11:37:46.754767 master-0 kubenswrapper[8993]: I1204 11:37:46.754729 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"openshift-service-ca.crt" Dec 04 11:37:46.756206 master-0 kubenswrapper[8993]: I1204 11:37:46.756156 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42b3be0f-1d82-4a64-abb4-0118a6960efd-serving-cert\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:46.756206 master-0 kubenswrapper[8993]: I1204 11:37:46.756194 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6e9271a-44ea-4612-ab60-4a9d489ed062-serving-cert\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:46.756360 master-0 kubenswrapper[8993]: I1204 11:37:46.756214 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5b826c3-8638-4cf5-b974-b24e4282ce00-serving-cert\") pod \"openshift-apiserver-operator-7bf7f6b755-sh6qf\" (UID: \"a5b826c3-8638-4cf5-b974-b24e4282ce00\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:37:46.756360 master-0 kubenswrapper[8993]: I1204 11:37:46.756258 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rhmlm\" (UniqueName: \"kubernetes.io/projected/a5b826c3-8638-4cf5-b974-b24e4282ce00-kube-api-access-rhmlm\") pod \"openshift-apiserver-operator-7bf7f6b755-sh6qf\" (UID: \"a5b826c3-8638-4cf5-b974-b24e4282ce00\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:37:46.756360 master-0 kubenswrapper[8993]: I1204 11:37:46.756282 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/bac00ac5-0371-48fd-b1cc-60438f08ae94-kube-api-access\") pod \"kube-controller-manager-operator-848f645654-7hmhg\" (UID: \"bac00ac5-0371-48fd-b1cc-60438f08ae94\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:37:46.756360 master-0 kubenswrapper[8993]: I1204 11:37:46.756302 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3322cc5a-f1f7-4522-b423-19fb7f38cd43-config\") pod \"openshift-controller-manager-operator-6c8676f99d-7z948\" (UID: \"3322cc5a-f1f7-4522-b423-19fb7f38cd43\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:37:46.756360 master-0 kubenswrapper[8993]: I1204 11:37:46.756324 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tlr76\" (UniqueName: \"kubernetes.io/projected/7c017c69-b24e-4a7a-b888-133bed34c174-kube-api-access-tlr76\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:37:46.756360 master-0 kubenswrapper[8993]: I1204 11:37:46.756343 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27576028-d64a-47cd-b76b-d524e41efe37-serving-cert\") pod \"openshift-kube-scheduler-operator-5f85974995-g4rwv\" (UID: \"27576028-d64a-47cd-b76b-d524e41efe37\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:37:46.756360 master-0 kubenswrapper[8993]: I1204 11:37:46.756370 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-trusted-ca-bundle\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:46.756734 master-0 kubenswrapper[8993]: I1204 11:37:46.756390 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c7xwd\" (UniqueName: \"kubernetes.io/projected/42b3be0f-1d82-4a64-abb4-0118a6960efd-kube-api-access-c7xwd\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:46.756734 master-0 kubenswrapper[8993]: I1204 11:37:46.756410 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-metrics-tls\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:37:46.756734 master-0 kubenswrapper[8993]: I1204 11:37:46.756430 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-olm-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/0158c2f3-20e5-43f4-875d-c5ad8f6112df-cluster-olm-operator-serving-cert\") pod \"cluster-olm-operator-56fcb6cc5f-4xwp2\" (UID: \"0158c2f3-20e5-43f4-875d-c5ad8f6112df\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:37:46.756734 master-0 kubenswrapper[8993]: I1204 11:37:46.756450 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ccf81538-4d5a-4c26-8e54-fe39331a625d-serving-cert\") pod \"kube-apiserver-operator-765d9ff747-gr68k\" (UID: \"ccf81538-4d5a-4c26-8e54-fe39331a625d\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:37:46.756734 master-0 kubenswrapper[8993]: I1204 11:37:46.756468 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-config\") pod \"service-ca-operator-77758bc754-8smqn\" (UID: \"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8\") " pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:37:46.756734 master-0 kubenswrapper[8993]: I1204 11:37:46.756487 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cdsq5\" (UniqueName: \"kubernetes.io/projected/c6e9271a-44ea-4612-ab60-4a9d489ed062-kube-api-access-cdsq5\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:46.756734 master-0 kubenswrapper[8993]: I1204 11:37:46.756507 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/ccf81538-4d5a-4c26-8e54-fe39331a625d-kube-api-access\") pod \"kube-apiserver-operator-765d9ff747-gr68k\" (UID: \"ccf81538-4d5a-4c26-8e54-fe39331a625d\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:37:46.756734 master-0 kubenswrapper[8993]: I1204 11:37:46.756533 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/69640270-09e6-4217-b1c8-3d3465c0c3ae-etc-cvo-updatepayloads\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:37:46.756734 master-0 kubenswrapper[8993]: I1204 11:37:46.756567 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-client\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:46.756734 master-0 kubenswrapper[8993]: I1204 11:37:46.756590 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operand-assets\" (UniqueName: \"kubernetes.io/empty-dir/0158c2f3-20e5-43f4-875d-c5ad8f6112df-operand-assets\") pod \"cluster-olm-operator-56fcb6cc5f-4xwp2\" (UID: \"0158c2f3-20e5-43f4-875d-c5ad8f6112df\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:37:46.756734 master-0 kubenswrapper[8993]: I1204 11:37:46.756612 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-bound-sa-token\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:46.756734 master-0 kubenswrapper[8993]: I1204 11:37:46.756627 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"kube-root-ca.crt" Dec 04 11:37:46.756734 master-0 kubenswrapper[8993]: I1204 11:37:46.756714 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-serving-cert" Dec 04 11:37:46.756734 master-0 kubenswrapper[8993]: I1204 11:37:46.756632 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-service-ca\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:46.757511 master-0 kubenswrapper[8993]: I1204 11:37:46.756853 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:37:46.757511 master-0 kubenswrapper[8993]: I1204 11:37:46.756886 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-trusted-ca\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:46.757511 master-0 kubenswrapper[8993]: I1204 11:37:46.756901 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:46.757511 master-0 kubenswrapper[8993]: I1204 11:37:46.756911 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-config\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:46.757511 master-0 kubenswrapper[8993]: I1204 11:37:46.756920 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-74b7b57c65-d6v67" Dec 04 11:37:46.757511 master-0 kubenswrapper[8993]: I1204 11:37:46.756939 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k7bhn\" (UniqueName: \"kubernetes.io/projected/031d300e-24b4-481c-8b82-fe8cdb3fcef7-kube-api-access-k7bhn\") pod \"csi-snapshot-controller-operator-6bc8656fdc-2q7f5\" (UID: \"031d300e-24b4-481c-8b82-fe8cdb3fcef7\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-6bc8656fdc-2q7f5" Dec 04 11:37:46.757511 master-0 kubenswrapper[8993]: I1204 11:37:46.756988 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2ab26ae5-0607-4dfd-840e-531d204b5030-telemetry-config\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:46.757511 master-0 kubenswrapper[8993]: I1204 11:37:46.757035 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-config-operator"/"config-operator-serving-cert" Dec 04 11:37:46.757511 master-0 kubenswrapper[8993]: I1204 11:37:46.757054 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" Dec 04 11:37:46.757511 master-0 kubenswrapper[8993]: I1204 11:37:46.757136 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-serving-cert" Dec 04 11:37:46.757511 master-0 kubenswrapper[8993]: I1204 11:37:46.757151 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mvzrc\" (UniqueName: \"kubernetes.io/projected/2ab26ae5-0607-4dfd-840e-531d204b5030-kube-api-access-mvzrc\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:46.757511 master-0 kubenswrapper[8993]: I1204 11:37:46.757193 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n6bhm\" (UniqueName: \"kubernetes.io/projected/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-kube-api-access-n6bhm\") pod \"service-ca-operator-77758bc754-8smqn\" (UID: \"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8\") " pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:37:46.757511 master-0 kubenswrapper[8993]: I1204 11:37:46.757222 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/27576028-d64a-47cd-b76b-d524e41efe37-kube-api-access\") pod \"openshift-kube-scheduler-operator-5f85974995-g4rwv\" (UID: \"27576028-d64a-47cd-b76b-d524e41efe37\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:37:46.757511 master-0 kubenswrapper[8993]: I1204 11:37:46.757256 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2g7bh\" (UniqueName: \"kubernetes.io/projected/00601c1a-efd4-4366-bdc9-d768afa252b0-kube-api-access-2g7bh\") pod \"openshift-config-operator-68758cbcdb-zh8g5\" (UID: \"00601c1a-efd4-4366-bdc9-d768afa252b0\") " pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:37:46.757511 master-0 kubenswrapper[8993]: I1204 11:37:46.757306 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-olm-operator"/"kube-root-ca.crt" Dec 04 11:37:46.757511 master-0 kubenswrapper[8993]: I1204 11:37:46.757418 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"kube-root-ca.crt" Dec 04 11:37:46.757511 master-0 kubenswrapper[8993]: I1204 11:37:46.757468 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz" Dec 04 11:37:46.757511 master-0 kubenswrapper[8993]: I1204 11:37:46.757292 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.757588 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"kube-root-ca.crt" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.757634 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"kube-root-ca.crt" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.757706 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-serving-cert\") pod \"service-ca-operator-77758bc754-8smqn\" (UID: \"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8\") " pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.757751 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/69640270-09e6-4217-b1c8-3d3465c0c3ae-etc-ssl-certs\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.757778 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27576028-d64a-47cd-b76b-d524e41efe37-serving-cert\") pod \"openshift-kube-scheduler-operator-5f85974995-g4rwv\" (UID: \"27576028-d64a-47cd-b76b-d524e41efe37\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.757786 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-config" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.757860 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operand-assets\" (UniqueName: \"kubernetes.io/empty-dir/0158c2f3-20e5-43f4-875d-c5ad8f6112df-operand-assets\") pod \"cluster-olm-operator-56fcb6cc5f-4xwp2\" (UID: \"0158c2f3-20e5-43f4-875d-c5ad8f6112df\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.757791 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/69640270-09e6-4217-b1c8-3d3465c0c3ae-kube-api-access\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.758007 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.758020 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5b826c3-8638-4cf5-b974-b24e4282ce00-serving-cert\") pod \"openshift-apiserver-operator-7bf7f6b755-sh6qf\" (UID: \"a5b826c3-8638-4cf5-b974-b24e4282ce00\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.758049 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccf81538-4d5a-4c26-8e54-fe39331a625d-config\") pod \"kube-apiserver-operator-765d9ff747-gr68k\" (UID: \"ccf81538-4d5a-4c26-8e54-fe39331a625d\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.758090 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cluster-olm-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/0158c2f3-20e5-43f4-875d-c5ad8f6112df-cluster-olm-operator-serving-cert\") pod \"cluster-olm-operator-56fcb6cc5f-4xwp2\" (UID: \"0158c2f3-20e5-43f4-875d-c5ad8f6112df\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.758223 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.758272 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ccf81538-4d5a-4c26-8e54-fe39331a625d-serving-cert\") pod \"kube-apiserver-operator-765d9ff747-gr68k\" (UID: \"ccf81538-4d5a-4c26-8e54-fe39331a625d\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.758278 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-serving-cert\") pod \"service-ca-operator-77758bc754-8smqn\" (UID: \"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8\") " pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.758293 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-service-ca-bundle\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.758336 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"image-registry-operator-tls" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.758360 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5b826c3-8638-4cf5-b974-b24e4282ce00-config\") pod \"openshift-apiserver-operator-7bf7f6b755-sh6qf\" (UID: \"a5b826c3-8638-4cf5-b974-b24e4282ce00\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.758404 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"kube-root-ca.crt" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.758482 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-config" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.758528 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"openshift-service-ca.crt" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.758550 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"openshift-service-ca.crt" Dec 04 11:37:46.758529 master-0 kubenswrapper[8993]: I1204 11:37:46.758572 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-serving-cert" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.758605 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"service-ca-operator-config" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.758664 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-host-etc-kube\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.758700 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"openshift-service-ca.crt" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.758712 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bac00ac5-0371-48fd-b1cc-60438f08ae94-serving-cert\") pod \"kube-controller-manager-operator-848f645654-7hmhg\" (UID: \"bac00ac5-0371-48fd-b1cc-60438f08ae94\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.758733 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-version"/"cluster-version-operator-serving-cert" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.758738 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bac00ac5-0371-48fd-b1cc-60438f08ae94-config\") pod \"kube-controller-manager-operator-848f645654-7hmhg\" (UID: \"bac00ac5-0371-48fd-b1cc-60438f08ae94\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.758745 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"openshift-kube-scheduler-operator-config" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.758700 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"openshift-service-ca.crt" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.758793 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication-operator"/"serving-cert" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.758900 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-service-ca.crt" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.758919 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-config" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.758951 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"kube-root-ca.crt" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.758883 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-serving-cert" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.759082 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-root-ca.crt" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.759110 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-root-ca.crt" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.758747 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"node-tuning-operator-tls" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.759197 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-storage-operator"/"openshift-service-ca.crt" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.759216 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-service-ca.crt" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.759391 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kube-root-ca.crt" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.759494 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3322cc5a-f1f7-4522-b423-19fb7f38cd43-serving-cert\") pod \"openshift-controller-manager-operator-6c8676f99d-7z948\" (UID: \"3322cc5a-f1f7-4522-b423-19fb7f38cd43\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.759528 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f15dcdb-c968-429c-9d1d-63c2becad337-trusted-ca\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.759550 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kkjzz\" (UniqueName: \"kubernetes.io/projected/6f15dcdb-c968-429c-9d1d-63c2becad337-kube-api-access-kkjzz\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.759827 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t6bkg\" (UniqueName: \"kubernetes.io/projected/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-kube-api-access-t6bkg\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.759871 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/00601c1a-efd4-4366-bdc9-d768afa252b0-available-featuregates\") pod \"openshift-config-operator-68758cbcdb-zh8g5\" (UID: \"00601c1a-efd4-4366-bdc9-d768afa252b0\") " pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.759918 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bac00ac5-0371-48fd-b1cc-60438f08ae94-serving-cert\") pod \"kube-controller-manager-operator-848f645654-7hmhg\" (UID: \"bac00ac5-0371-48fd-b1cc-60438f08ae94\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.759945 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69640270-09e6-4217-b1c8-3d3465c0c3ae-service-ca\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.759987 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8cxbd\" (UniqueName: \"kubernetes.io/projected/0158c2f3-20e5-43f4-875d-c5ad8f6112df-kube-api-access-8cxbd\") pod \"cluster-olm-operator-56fcb6cc5f-4xwp2\" (UID: \"0158c2f3-20e5-43f4-875d-c5ad8f6112df\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.760016 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/00601c1a-efd4-4366-bdc9-d768afa252b0-available-featuregates\") pod \"openshift-config-operator-68758cbcdb-zh8g5\" (UID: \"00601c1a-efd4-4366-bdc9-d768afa252b0\") " pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:37:46.759994 master-0 kubenswrapper[8993]: I1204 11:37:46.760036 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00601c1a-efd4-4366-bdc9-d768afa252b0-serving-cert\") pod \"openshift-config-operator-68758cbcdb-zh8g5\" (UID: \"00601c1a-efd4-4366-bdc9-d768afa252b0\") " pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:37:46.761931 master-0 kubenswrapper[8993]: I1204 11:37:46.760072 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-storage-operator"/"kube-root-ca.crt" Dec 04 11:37:46.761931 master-0 kubenswrapper[8993]: I1204 11:37:46.760163 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"kube-root-ca.crt" Dec 04 11:37:46.761931 master-0 kubenswrapper[8993]: I1204 11:37:46.760192 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5b826c3-8638-4cf5-b974-b24e4282ce00-config\") pod \"openshift-apiserver-operator-7bf7f6b755-sh6qf\" (UID: \"a5b826c3-8638-4cf5-b974-b24e4282ce00\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:37:46.761931 master-0 kubenswrapper[8993]: I1204 11:37:46.760073 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-config\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:46.761931 master-0 kubenswrapper[8993]: I1204 11:37:46.760310 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-ca\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:46.761931 master-0 kubenswrapper[8993]: I1204 11:37:46.760347 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69640270-09e6-4217-b1c8-3d3465c0c3ae-service-ca\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:37:46.761931 master-0 kubenswrapper[8993]: I1204 11:37:46.760400 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3322cc5a-f1f7-4522-b423-19fb7f38cd43-serving-cert\") pod \"openshift-controller-manager-operator-6c8676f99d-7z948\" (UID: \"3322cc5a-f1f7-4522-b423-19fb7f38cd43\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:37:46.761931 master-0 kubenswrapper[8993]: I1204 11:37:46.760425 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k449s\" (UniqueName: \"kubernetes.io/projected/3322cc5a-f1f7-4522-b423-19fb7f38cd43-kube-api-access-k449s\") pod \"openshift-controller-manager-operator-6c8676f99d-7z948\" (UID: \"3322cc5a-f1f7-4522-b423-19fb7f38cd43\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:37:46.761931 master-0 kubenswrapper[8993]: I1204 11:37:46.760476 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27576028-d64a-47cd-b76b-d524e41efe37-config\") pod \"openshift-kube-scheduler-operator-5f85974995-g4rwv\" (UID: \"27576028-d64a-47cd-b76b-d524e41efe37\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:37:46.761931 master-0 kubenswrapper[8993]: I1204 11:37:46.760441 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00601c1a-efd4-4366-bdc9-d768afa252b0-serving-cert\") pod \"openshift-config-operator-68758cbcdb-zh8g5\" (UID: \"00601c1a-efd4-4366-bdc9-d768afa252b0\") " pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:37:46.761931 master-0 kubenswrapper[8993]: I1204 11:37:46.760501 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t46k7\" (UniqueName: \"kubernetes.io/projected/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-kube-api-access-t46k7\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:46.761931 master-0 kubenswrapper[8993]: I1204 11:37:46.760543 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:37:46.761931 master-0 kubenswrapper[8993]: I1204 11:37:46.760582 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:46.761931 master-0 kubenswrapper[8993]: I1204 11:37:46.761097 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"telemetry-config" Dec 04 11:37:46.762949 master-0 kubenswrapper[8993]: I1204 11:37:46.762887 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"service-ca-bundle" Dec 04 11:37:46.763155 master-0 kubenswrapper[8993]: I1204 11:37:46.763092 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-service-ca-bundle" Dec 04 11:37:46.763633 master-0 kubenswrapper[8993]: I1204 11:37:46.763581 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27576028-d64a-47cd-b76b-d524e41efe37-config\") pod \"openshift-kube-scheduler-operator-5f85974995-g4rwv\" (UID: \"27576028-d64a-47cd-b76b-d524e41efe37\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:37:46.763797 master-0 kubenswrapper[8993]: I1204 11:37:46.763760 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-config" Dec 04 11:37:46.764212 master-0 kubenswrapper[8993]: I1204 11:37:46.764163 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"package-server-manager-serving-cert" Dec 04 11:37:46.764660 master-0 kubenswrapper[8993]: I1204 11:37:46.764613 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-operator-serving-cert" Dec 04 11:37:46.764660 master-0 kubenswrapper[8993]: I1204 11:37:46.764639 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"openshift-service-ca.crt" Dec 04 11:37:46.765240 master-0 kubenswrapper[8993]: I1204 11:37:46.765194 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"default-cni-sysctl-allowlist" Dec 04 11:37:46.765240 master-0 kubenswrapper[8993]: I1204 11:37:46.765223 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"env-overrides" Dec 04 11:37:46.765649 master-0 kubenswrapper[8993]: I1204 11:37:46.765600 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"kube-root-ca.crt" Dec 04 11:37:46.767681 master-0 kubenswrapper[8993]: I1204 11:37:46.767625 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"whereabouts-config" Dec 04 11:37:46.767787 master-0 kubenswrapper[8993]: I1204 11:37:46.767686 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42b3be0f-1d82-4a64-abb4-0118a6960efd-serving-cert\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:46.767787 master-0 kubenswrapper[8993]: I1204 11:37:46.767376 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2ab26ae5-0607-4dfd-840e-531d204b5030-telemetry-config\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:46.767949 master-0 kubenswrapper[8993]: I1204 11:37:46.767135 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-service-ca\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:46.767949 master-0 kubenswrapper[8993]: I1204 11:37:46.767820 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"kube-root-ca.crt" Dec 04 11:37:46.767949 master-0 kubenswrapper[8993]: I1204 11:37:46.767822 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-operator-config" Dec 04 11:37:46.767949 master-0 kubenswrapper[8993]: I1204 11:37:46.767262 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-operator"/"metrics-tls" Dec 04 11:37:46.767949 master-0 kubenswrapper[8993]: I1204 11:37:46.767353 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"kube-root-ca.crt" Dec 04 11:37:46.767949 master-0 kubenswrapper[8993]: I1204 11:37:46.767509 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"cni-copy-resources" Dec 04 11:37:46.767949 master-0 kubenswrapper[8993]: I1204 11:37:46.767572 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"kube-root-ca.crt" Dec 04 11:37:46.768487 master-0 kubenswrapper[8993]: I1204 11:37:46.767218 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"pprof-cert" Dec 04 11:37:46.768487 master-0 kubenswrapper[8993]: I1204 11:37:46.768249 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-config\") pod \"service-ca-operator-77758bc754-8smqn\" (UID: \"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8\") " pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:37:46.768487 master-0 kubenswrapper[8993]: I1204 11:37:46.768374 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3322cc5a-f1f7-4522-b423-19fb7f38cd43-config\") pod \"openshift-controller-manager-operator-6c8676f99d-7z948\" (UID: \"3322cc5a-f1f7-4522-b423-19fb7f38cd43\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:37:46.768487 master-0 kubenswrapper[8993]: I1204 11:37:46.768419 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccf81538-4d5a-4c26-8e54-fe39331a625d-config\") pod \"kube-apiserver-operator-765d9ff747-gr68k\" (UID: \"ccf81538-4d5a-4c26-8e54-fe39331a625d\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:37:46.768723 master-0 kubenswrapper[8993]: I1204 11:37:46.768606 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6e9271a-44ea-4612-ab60-4a9d489ed062-serving-cert\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:46.768975 master-0 kubenswrapper[8993]: I1204 11:37:46.768934 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"kube-root-ca.crt" Dec 04 11:37:46.769575 master-0 kubenswrapper[8993]: I1204 11:37:46.769532 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"authentication-operator-config" Dec 04 11:37:46.769846 master-0 kubenswrapper[8993]: I1204 11:37:46.769787 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"openshift-service-ca.crt" Dec 04 11:37:46.770077 master-0 kubenswrapper[8993]: I1204 11:37:46.770034 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-service-ca-bundle\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:46.770218 master-0 kubenswrapper[8993]: I1204 11:37:46.770173 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bac00ac5-0371-48fd-b1cc-60438f08ae94-config\") pod \"kube-controller-manager-operator-848f645654-7hmhg\" (UID: \"bac00ac5-0371-48fd-b1cc-60438f08ae94\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:37:46.770535 master-0 kubenswrapper[8993]: I1204 11:37:46.770469 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-config\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:46.770991 master-0 kubenswrapper[8993]: I1204 11:37:46.770951 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"kube-root-ca.crt" Dec 04 11:37:46.771094 master-0 kubenswrapper[8993]: I1204 11:37:46.771020 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"kube-root-ca.crt" Dec 04 11:37:46.772402 master-0 kubenswrapper[8993]: I1204 11:37:46.771329 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-client" Dec 04 11:37:46.772402 master-0 kubenswrapper[8993]: I1204 11:37:46.771445 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-ca-bundle" Dec 04 11:37:46.772402 master-0 kubenswrapper[8993]: I1204 11:37:46.771508 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"openshift-service-ca.crt" Dec 04 11:37:46.772402 master-0 kubenswrapper[8993]: I1204 11:37:46.771542 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"openshift-service-ca.crt" Dec 04 11:37:46.772402 master-0 kubenswrapper[8993]: I1204 11:37:46.771561 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"metrics-daemon-secret" Dec 04 11:37:46.772402 master-0 kubenswrapper[8993]: I1204 11:37:46.771611 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"openshift-service-ca.crt" Dec 04 11:37:46.772402 master-0 kubenswrapper[8993]: I1204 11:37:46.771686 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-storage-version-migrator-operator"/"serving-cert" Dec 04 11:37:46.772402 master-0 kubenswrapper[8993]: I1204 11:37:46.771782 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"openshift-service-ca.crt" Dec 04 11:37:46.772402 master-0 kubenswrapper[8993]: I1204 11:37:46.771849 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"marketplace-operator-metrics" Dec 04 11:37:46.772402 master-0 kubenswrapper[8993]: I1204 11:37:46.771785 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"multus-daemon-config" Dec 04 11:37:46.772402 master-0 kubenswrapper[8993]: I1204 11:37:46.771967 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"kube-root-ca.crt" Dec 04 11:37:46.772402 master-0 kubenswrapper[8993]: I1204 11:37:46.772010 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"openshift-service-ca.crt" Dec 04 11:37:46.772402 master-0 kubenswrapper[8993]: I1204 11:37:46.771813 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"multus-admission-controller-secret" Dec 04 11:37:46.772402 master-0 kubenswrapper[8993]: I1204 11:37:46.772079 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-node-identity"/"network-node-identity-cert" Dec 04 11:37:46.772402 master-0 kubenswrapper[8993]: I1204 11:37:46.772133 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"kube-root-ca.crt" Dec 04 11:37:46.772402 master-0 kubenswrapper[8993]: I1204 11:37:46.772205 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"ovnkube-identity-cm" Dec 04 11:37:46.772402 master-0 kubenswrapper[8993]: I1204 11:37:46.772241 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"openshift-service-ca.crt" Dec 04 11:37:46.772402 master-0 kubenswrapper[8993]: I1204 11:37:46.772292 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"olm-operator-serving-cert" Dec 04 11:37:46.772402 master-0 kubenswrapper[8993]: I1204 11:37:46.772361 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"kube-root-ca.crt" Dec 04 11:37:46.773376 master-0 kubenswrapper[8993]: I1204 11:37:46.772644 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"openshift-service-ca.crt" Dec 04 11:37:46.773376 master-0 kubenswrapper[8993]: I1204 11:37:46.772648 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"env-overrides" Dec 04 11:37:46.773376 master-0 kubenswrapper[8993]: I1204 11:37:46.773005 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"catalog-operator-serving-cert" Dec 04 11:37:46.773376 master-0 kubenswrapper[8993]: I1204 11:37:46.773152 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-config" Dec 04 11:37:46.773376 master-0 kubenswrapper[8993]: I1204 11:37:46.773292 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"config" Dec 04 11:37:46.773613 master-0 kubenswrapper[8993]: I1204 11:37:46.773471 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-control-plane-metrics-cert" Dec 04 11:37:46.783588 master-0 kubenswrapper[8993]: I1204 11:37:46.783473 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"trusted-ca" Dec 04 11:37:46.783936 master-0 kubenswrapper[8993]: I1204 11:37:46.783889 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-config\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:46.785593 master-0 kubenswrapper[8993]: I1204 11:37:46.784990 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"trusted-ca" Dec 04 11:37:46.785883 master-0 kubenswrapper[8993]: I1204 11:37:46.785698 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-ca\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:46.788285 master-0 kubenswrapper[8993]: I1204 11:37:46.786193 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"kube-root-ca.crt" Dec 04 11:37:46.788285 master-0 kubenswrapper[8993]: I1204 11:37:46.786222 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-trusted-ca\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:46.788285 master-0 kubenswrapper[8993]: I1204 11:37:46.786260 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-client\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:46.790937 master-0 kubenswrapper[8993]: I1204 11:37:46.790310 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-operator"/"metrics-tls" Dec 04 11:37:46.790937 master-0 kubenswrapper[8993]: I1204 11:37:46.790846 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f15dcdb-c968-429c-9d1d-63c2becad337-trusted-ca\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:46.791151 master-0 kubenswrapper[8993]: I1204 11:37:46.791105 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"trusted-ca-bundle" Dec 04 11:37:46.793062 master-0 kubenswrapper[8993]: I1204 11:37:46.793027 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"trusted-ca" Dec 04 11:37:46.793685 master-0 kubenswrapper[8993]: I1204 11:37:46.793645 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"marketplace-trusted-ca" Dec 04 11:37:46.799004 master-0 kubenswrapper[8993]: I1204 11:37:46.798945 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-metrics-tls\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:37:46.799004 master-0 kubenswrapper[8993]: I1204 11:37:46.798985 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-trusted-ca-bundle\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:46.805345 master-0 kubenswrapper[8993]: I1204 11:37:46.805273 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"openshift-service-ca.crt" Dec 04 11:37:46.827399 master-0 kubenswrapper[8993]: I1204 11:37:46.827301 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"iptables-alerter-script" Dec 04 11:37:46.841872 master-0 kubenswrapper[8993]: I1204 11:37:46.841765 8993 desired_state_of_world_populator.go:155] "Finished populating initial desired state of world" Dec 04 11:37:46.846117 master-0 kubenswrapper[8993]: I1204 11:37:46.846054 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"kube-root-ca.crt" Dec 04 11:37:46.861999 master-0 kubenswrapper[8993]: I1204 11:37:46.861895 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-cni-multus\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.861999 master-0 kubenswrapper[8993]: I1204 11:37:46.861959 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-node-log\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.861999 master-0 kubenswrapper[8993]: I1204 11:37:46.862003 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-llscb\" (UniqueName: \"kubernetes.io/projected/fd9f8671-8066-4990-b45d-8b619aa5d9ec-kube-api-access-llscb\") pod \"kube-storage-version-migrator-operator-b9c5dfc78-dcxkw\" (UID: \"fd9f8671-8066-4990-b45d-8b619aa5d9ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:37:46.862299 master-0 kubenswrapper[8993]: I1204 11:37:46.862034 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-59pbp\" (UniqueName: \"kubernetes.io/projected/330553d2-40ea-4496-8346-2e5bf680669b-kube-api-access-59pbp\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:37:46.862299 master-0 kubenswrapper[8993]: I1204 11:37:46.862136 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2ncf9\" (UniqueName: \"kubernetes.io/projected/d8fca733-45c8-45b8-8653-ac204e7c6098-kube-api-access-2ncf9\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:46.862299 master-0 kubenswrapper[8993]: I1204 11:37:46.862205 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.862426 master-0 kubenswrapper[8993]: I1204 11:37:46.862373 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-cni-bin\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.862426 master-0 kubenswrapper[8993]: I1204 11:37:46.862411 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:46.862538 master-0 kubenswrapper[8993]: I1204 11:37:46.862440 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-netns\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.862538 master-0 kubenswrapper[8993]: I1204 11:37:46.862473 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-systemd-units\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.862538 master-0 kubenswrapper[8993]: I1204 11:37:46.862501 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8cffn\" (UniqueName: \"kubernetes.io/projected/08550069-c1a1-475e-84a2-e56905f1ed38-kube-api-access-8cffn\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:37:46.862624 master-0 kubenswrapper[8993]: I1204 11:37:46.862552 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vgkr\" (UniqueName: \"kubernetes.io/projected/51337a75-bfa1-4cac-ab92-8b0b6e529c02-kube-api-access-6vgkr\") pod \"controller-manager-59948648c9-krt4p\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:46.862624 master-0 kubenswrapper[8993]: I1204 11:37:46.862598 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-hostroot\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.862624 master-0 kubenswrapper[8993]: I1204 11:37:46.862622 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-cni-netd\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.862709 master-0 kubenswrapper[8993]: I1204 11:37:46.862651 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.862709 master-0 kubenswrapper[8993]: I1204 11:37:46.862683 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-socket-dir-parent\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.862782 master-0 kubenswrapper[8993]: I1204 11:37:46.862719 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-conf-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.862782 master-0 kubenswrapper[8993]: I1204 11:37:46.862747 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-daemon-config\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.862782 master-0 kubenswrapper[8993]: I1204 11:37:46.862771 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f4w2j\" (UniqueName: \"kubernetes.io/projected/bdfcb644-24ef-4a33-93ae-a855e872d29a-kube-api-access-f4w2j\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:37:46.862936 master-0 kubenswrapper[8993]: I1204 11:37:46.862793 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51337a75-bfa1-4cac-ab92-8b0b6e529c02-serving-cert\") pod \"controller-manager-59948648c9-krt4p\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:46.862936 master-0 kubenswrapper[8993]: I1204 11:37:46.862841 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ggzfm\" (UniqueName: \"kubernetes.io/projected/434ed9b9-715b-455b-867c-775b256df40f-kube-api-access-ggzfm\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:46.862936 master-0 kubenswrapper[8993]: I1204 11:37:46.862868 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:37:46.862936 master-0 kubenswrapper[8993]: I1204 11:37:46.862901 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-k8s-cni-cncf-io\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.862936 master-0 kubenswrapper[8993]: I1204 11:37:46.862925 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/330553d2-40ea-4496-8346-2e5bf680669b-host-slash\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:37:46.863489 master-0 kubenswrapper[8993]: I1204 11:37:46.863081 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6lxhl\" (UniqueName: \"kubernetes.io/projected/c790c174-dc60-4f34-8818-3b367fbe3a5f-kube-api-access-6lxhl\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.863489 master-0 kubenswrapper[8993]: I1204 11:37:46.863240 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:37:46.863489 master-0 kubenswrapper[8993]: I1204 11:37:46.863296 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-kubelet\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.863489 master-0 kubenswrapper[8993]: I1204 11:37:46.863331 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-var-lib-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.863489 master-0 kubenswrapper[8993]: I1204 11:37:46.863398 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gmdvf\" (UniqueName: \"kubernetes.io/projected/287fba2d-f56d-4ec0-b796-7849a68fb411-kube-api-access-gmdvf\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:37:46.863732 master-0 kubenswrapper[8993]: I1204 11:37:46.863529 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/69640270-09e6-4217-b1c8-3d3465c0c3ae-etc-ssl-certs\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:37:46.863732 master-0 kubenswrapper[8993]: E1204 11:37:46.863532 8993 secret.go:189] Couldn't get secret openshift-dns-operator/metrics-tls: secret "metrics-tls" not found Dec 04 11:37:46.863732 master-0 kubenswrapper[8993]: I1204 11:37:46.863578 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:46.863732 master-0 kubenswrapper[8993]: E1204 11:37:46.863624 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls podName:7c017c69-b24e-4a7a-b888-133bed34c174 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:47.363602971 +0000 UTC m=+1.754544404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls") pod "dns-operator-7c56cf9b74-xz27r" (UID: "7c017c69-b24e-4a7a-b888-133bed34c174") : secret "metrics-tls" not found Dec 04 11:37:46.863732 master-0 kubenswrapper[8993]: I1204 11:37:46.863655 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/69640270-09e6-4217-b1c8-3d3465c0c3ae-etc-ssl-certs\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:37:46.863732 master-0 kubenswrapper[8993]: E1204 11:37:46.863679 8993 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/node-tuning-operator-tls: secret "node-tuning-operator-tls" not found Dec 04 11:37:46.863920 master-0 kubenswrapper[8993]: I1204 11:37:46.863755 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gkcj4\" (UniqueName: \"kubernetes.io/projected/7203ec93-6572-4032-825c-140029a86058-kube-api-access-gkcj4\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:37:46.863920 master-0 kubenswrapper[8993]: E1204 11:37:46.863784 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls podName:6f15dcdb-c968-429c-9d1d-63c2becad337 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:47.363762416 +0000 UTC m=+1.754703839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-tuning-operator-tls" (UniqueName: "kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls") pod "cluster-node-tuning-operator-85cff47f46-4gv5j" (UID: "6f15dcdb-c968-429c-9d1d-63c2becad337") : secret "node-tuning-operator-tls" not found Dec 04 11:37:46.863920 master-0 kubenswrapper[8993]: I1204 11:37:46.863835 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:46.863920 master-0 kubenswrapper[8993]: I1204 11:37:46.863867 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:37:46.864071 master-0 kubenswrapper[8993]: E1204 11:37:46.863933 8993 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Dec 04 11:37:46.864071 master-0 kubenswrapper[8993]: E1204 11:37:46.863974 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls podName:2ab26ae5-0607-4dfd-840e-531d204b5030 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:47.363963813 +0000 UTC m=+1.754905246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-7ff994598c-p82nn" (UID: "2ab26ae5-0607-4dfd-840e-531d204b5030") : secret "cluster-monitoring-operator-tls" not found Dec 04 11:37:46.864071 master-0 kubenswrapper[8993]: I1204 11:37:46.864011 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/287fba2d-f56d-4ec0-b796-7849a68fb411-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:37:46.864071 master-0 kubenswrapper[8993]: I1204 11:37:46.864060 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-ovn\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.864579 master-0 kubenswrapper[8993]: I1204 11:37:46.864090 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p2mhg\" (UniqueName: \"kubernetes.io/projected/157eab0c-0d8d-486b-a349-c2e466e18e0c-kube-api-access-p2mhg\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.864579 master-0 kubenswrapper[8993]: I1204 11:37:46.864120 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rj4dt\" (UniqueName: \"kubernetes.io/projected/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-kube-api-access-rj4dt\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:46.864579 master-0 kubenswrapper[8993]: I1204 11:37:46.864148 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b011b1f1-3235-4e20-825b-ce711c052407-bound-sa-token\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:46.864579 master-0 kubenswrapper[8993]: I1204 11:37:46.864191 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:46.864579 master-0 kubenswrapper[8993]: I1204 11:37:46.864227 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-daemon-config\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.864579 master-0 kubenswrapper[8993]: I1204 11:37:46.864237 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-etc-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.864579 master-0 kubenswrapper[8993]: I1204 11:37:46.864274 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b011b1f1-3235-4e20-825b-ce711c052407-trusted-ca\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:46.864579 master-0 kubenswrapper[8993]: I1204 11:37:46.864318 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/287fba2d-f56d-4ec0-b796-7849a68fb411-ovnkube-config\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:37:46.864579 master-0 kubenswrapper[8993]: I1204 11:37:46.864343 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-system-cni-dir\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:37:46.864579 master-0 kubenswrapper[8993]: I1204 11:37:46.864354 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/287fba2d-f56d-4ec0-b796-7849a68fb411-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:37:46.864579 master-0 kubenswrapper[8993]: I1204 11:37:46.864358 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:37:46.864579 master-0 kubenswrapper[8993]: I1204 11:37:46.864428 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-cnibin\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.864579 master-0 kubenswrapper[8993]: I1204 11:37:46.864487 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c790c174-dc60-4f34-8818-3b367fbe3a5f-cni-binary-copy\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.864579 master-0 kubenswrapper[8993]: I1204 11:37:46.864562 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-env-overrides\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.864973 master-0 kubenswrapper[8993]: I1204 11:37:46.864675 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jq49f\" (UniqueName: \"kubernetes.io/projected/b011b1f1-3235-4e20-825b-ce711c052407-kube-api-access-jq49f\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:46.864973 master-0 kubenswrapper[8993]: I1204 11:37:46.864859 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fd9f8671-8066-4990-b45d-8b619aa5d9ec-serving-cert\") pod \"kube-storage-version-migrator-operator-b9c5dfc78-dcxkw\" (UID: \"fd9f8671-8066-4990-b45d-8b619aa5d9ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:37:46.864973 master-0 kubenswrapper[8993]: I1204 11:37:46.864950 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-systemd\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.865054 master-0 kubenswrapper[8993]: I1204 11:37:46.864980 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-cnibin\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:37:46.865054 master-0 kubenswrapper[8993]: I1204 11:37:46.864873 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-env-overrides\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.865054 master-0 kubenswrapper[8993]: I1204 11:37:46.865002 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:37:46.865054 master-0 kubenswrapper[8993]: I1204 11:37:46.865022 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-run-netns\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.865227 master-0 kubenswrapper[8993]: I1204 11:37:46.865187 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-kubelet\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.865264 master-0 kubenswrapper[8993]: I1204 11:37:46.865243 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-etc-kubernetes\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.865308 master-0 kubenswrapper[8993]: I1204 11:37:46.865291 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-slash\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.865379 master-0 kubenswrapper[8993]: I1204 11:37:46.865351 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p2dv\" (UniqueName: \"kubernetes.io/projected/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-kube-api-access-4p2dv\") pod \"route-controller-manager-864c894b4d-xbpkz\" (UID: \"2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4\") " pod="openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz" Dec 04 11:37:46.865410 master-0 kubenswrapper[8993]: I1204 11:37:46.865381 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:46.865410 master-0 kubenswrapper[8993]: I1204 11:37:46.865357 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fd9f8671-8066-4990-b45d-8b619aa5d9ec-serving-cert\") pod \"kube-storage-version-migrator-operator-b9c5dfc78-dcxkw\" (UID: \"fd9f8671-8066-4990-b45d-8b619aa5d9ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:37:46.865464 master-0 kubenswrapper[8993]: I1204 11:37:46.865412 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zr454\" (UniqueName: \"kubernetes.io/projected/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-kube-api-access-zr454\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:46.865492 master-0 kubenswrapper[8993]: I1204 11:37:46.865443 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-serving-cert\") pod \"route-controller-manager-864c894b4d-xbpkz\" (UID: \"2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4\") " pod="openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz" Dec 04 11:37:46.865492 master-0 kubenswrapper[8993]: I1204 11:37:46.865483 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-log-socket\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.865545 master-0 kubenswrapper[8993]: I1204 11:37:46.865504 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-client-ca\") pod \"controller-manager-59948648c9-krt4p\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:46.865640 master-0 kubenswrapper[8993]: I1204 11:37:46.865558 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7203ec93-6572-4032-825c-140029a86058-webhook-cert\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:37:46.865640 master-0 kubenswrapper[8993]: I1204 11:37:46.865588 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7203ec93-6572-4032-825c-140029a86058-env-overrides\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:37:46.865640 master-0 kubenswrapper[8993]: I1204 11:37:46.865633 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/69640270-09e6-4217-b1c8-3d3465c0c3ae-etc-cvo-updatepayloads\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:37:46.865722 master-0 kubenswrapper[8993]: I1204 11:37:46.865680 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/69640270-09e6-4217-b1c8-3d3465c0c3ae-etc-cvo-updatepayloads\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:37:46.865784 master-0 kubenswrapper[8993]: I1204 11:37:46.865756 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-cni-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.865851 master-0 kubenswrapper[8993]: I1204 11:37:46.865799 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:46.865887 master-0 kubenswrapper[8993]: I1204 11:37:46.865858 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7203ec93-6572-4032-825c-140029a86058-env-overrides\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:37:46.865887 master-0 kubenswrapper[8993]: I1204 11:37:46.865878 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-os-release\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:37:46.865942 master-0 kubenswrapper[8993]: I1204 11:37:46.865909 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-cni-binary-copy\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:37:46.865942 master-0 kubenswrapper[8993]: I1204 11:37:46.865935 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-profile-collector-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:46.865998 master-0 kubenswrapper[8993]: I1204 11:37:46.865965 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:46.866026 master-0 kubenswrapper[8993]: I1204 11:37:46.865999 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/287fba2d-f56d-4ec0-b796-7849a68fb411-env-overrides\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:37:46.866063 master-0 kubenswrapper[8993]: I1204 11:37:46.865999 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c790c174-dc60-4f34-8818-3b367fbe3a5f-cni-binary-copy\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866087 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-cni-bin\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866117 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-cni-binary-copy\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866122 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866163 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ckwnn\" (UniqueName: \"kubernetes.io/projected/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-kube-api-access-ckwnn\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866208 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-trusted-ca\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866231 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/287fba2d-f56d-4ec0-b796-7849a68fb411-ovnkube-config\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866241 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/287fba2d-f56d-4ec0-b796-7849a68fb411-env-overrides\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866342 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"whereabouts-configmap\" (UniqueName: \"kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-whereabouts-configmap\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866402 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7203ec93-6572-4032-825c-140029a86058-webhook-cert\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866410 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-client-ca\") pod \"route-controller-manager-864c894b4d-xbpkz\" (UID: \"2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4\") " pod="openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866467 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovnkube-script-lib\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866494 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/330553d2-40ea-4496-8346-2e5bf680669b-iptables-alerter-script\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866504 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"whereabouts-configmap\" (UniqueName: \"kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-whereabouts-configmap\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866414 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-profile-collector-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866616 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovnkube-config\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866642 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/7203ec93-6572-4032-825c-140029a86058-ovnkube-identity-cm\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866664 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866722 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-run-ovn-kubernetes\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866759 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b011b1f1-3235-4e20-825b-ce711c052407-trusted-ca\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866769 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-config\") pod \"route-controller-manager-864c894b4d-xbpkz\" (UID: \"2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4\") " pod="openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866878 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fd9f8671-8066-4990-b45d-8b619aa5d9ec-config\") pod \"kube-storage-version-migrator-operator-b9c5dfc78-dcxkw\" (UID: \"fd9f8671-8066-4990-b45d-8b619aa5d9ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866890 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/7203ec93-6572-4032-825c-140029a86058-ovnkube-identity-cm\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866896 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/330553d2-40ea-4496-8346-2e5bf680669b-iptables-alerter-script\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866912 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-proxy-ca-bundles\") pod \"controller-manager-59948648c9-krt4p\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866929 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-trusted-ca\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: E1204 11:37:46.866969 8993 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-operator-tls: secret "image-registry-operator-tls" not found Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.866963 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-system-cni-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.867000 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovnkube-config\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: E1204 11:37:46.867019 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls podName:1ade9186-b262-4b5e-9c6f-ba89f0130fb6 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:47.36700582 +0000 UTC m=+1.757947243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "image-registry-operator-tls" (UniqueName: "kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls") pod "cluster-image-registry-operator-6fb9f88b7-tgvfl" (UID: "1ade9186-b262-4b5e-9c6f-ba89f0130fb6") : secret "image-registry-operator-tls" not found Dec 04 11:37:46.867065 master-0 kubenswrapper[8993]: I1204 11:37:46.867056 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-host-etc-kube\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:37:46.868139 master-0 kubenswrapper[8993]: I1204 11:37:46.867104 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovn-node-metrics-cert\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.868139 master-0 kubenswrapper[8993]: I1204 11:37:46.867123 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fd9f8671-8066-4990-b45d-8b619aa5d9ec-config\") pod \"kube-storage-version-migrator-operator-b9c5dfc78-dcxkw\" (UID: \"fd9f8671-8066-4990-b45d-8b619aa5d9ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:37:46.868139 master-0 kubenswrapper[8993]: I1204 11:37:46.867133 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-os-release\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.868139 master-0 kubenswrapper[8993]: I1204 11:37:46.867159 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-config\") pod \"controller-manager-59948648c9-krt4p\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:46.868139 master-0 kubenswrapper[8993]: I1204 11:37:46.867180 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-host-etc-kube\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:37:46.868139 master-0 kubenswrapper[8993]: I1204 11:37:46.867183 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-profile-collector-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:46.868139 master-0 kubenswrapper[8993]: I1204 11:37:46.867212 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-multus-certs\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.868139 master-0 kubenswrapper[8993]: I1204 11:37:46.867232 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lxnbc\" (UniqueName: \"kubernetes.io/projected/16057f9c-b1f8-4915-acc3-2d4532af4963-kube-api-access-lxnbc\") pod \"migrator-74b7b57c65-d6v67\" (UID: \"16057f9c-b1f8-4915-acc3-2d4532af4963\") " pod="openshift-kube-storage-version-migrator/migrator-74b7b57c65-d6v67" Dec 04 11:37:46.868139 master-0 kubenswrapper[8993]: I1204 11:37:46.867264 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:46.868139 master-0 kubenswrapper[8993]: I1204 11:37:46.867283 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l5r7w\" (UniqueName: \"kubernetes.io/projected/38fc8086-a00c-4a2a-8a0e-c57e9d9d0103-kube-api-access-l5r7w\") pod \"csi-snapshot-controller-6b958b6f94-w74zr\" (UID: \"38fc8086-a00c-4a2a-8a0e-c57e9d9d0103\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" Dec 04 11:37:46.868139 master-0 kubenswrapper[8993]: I1204 11:37:46.867304 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbt5w\" (UniqueName: \"kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w\") pod \"network-check-target-w2lss\" (UID: \"a3558de2-46f8-48b5-a961-95decb7805cf\") " pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:46.868139 master-0 kubenswrapper[8993]: E1204 11:37:46.867359 8993 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/performance-addon-operator-webhook-cert: secret "performance-addon-operator-webhook-cert" not found Dec 04 11:37:46.868139 master-0 kubenswrapper[8993]: I1204 11:37:46.867374 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-profile-collector-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:46.868139 master-0 kubenswrapper[8993]: E1204 11:37:46.867405 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert podName:6f15dcdb-c968-429c-9d1d-63c2becad337 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:47.367386623 +0000 UTC m=+1.758328056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert") pod "cluster-node-tuning-operator-85cff47f46-4gv5j" (UID: "6f15dcdb-c968-429c-9d1d-63c2becad337") : secret "performance-addon-operator-webhook-cert" not found Dec 04 11:37:46.868139 master-0 kubenswrapper[8993]: I1204 11:37:46.867425 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:37:46.868139 master-0 kubenswrapper[8993]: E1204 11:37:46.867521 8993 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 11:37:46.868139 master-0 kubenswrapper[8993]: E1204 11:37:46.867553 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert podName:69640270-09e6-4217-b1c8-3d3465c0c3ae nodeName:}" failed. No retries permitted until 2025-12-04 11:37:47.367545558 +0000 UTC m=+1.758486991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert") pod "cluster-version-operator-77dfcc565f-nqpsd" (UID: "69640270-09e6-4217-b1c8-3d3465c0c3ae") : secret "cluster-version-operator-serving-cert" not found Dec 04 11:37:46.879369 master-0 kubenswrapper[8993]: I1204 11:37:46.879306 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhmlm\" (UniqueName: \"kubernetes.io/projected/a5b826c3-8638-4cf5-b974-b24e4282ce00-kube-api-access-rhmlm\") pod \"openshift-apiserver-operator-7bf7f6b755-sh6qf\" (UID: \"a5b826c3-8638-4cf5-b974-b24e4282ce00\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:37:46.902863 master-0 kubenswrapper[8993]: I1204 11:37:46.902756 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/bac00ac5-0371-48fd-b1cc-60438f08ae94-kube-api-access\") pod \"kube-controller-manager-operator-848f645654-7hmhg\" (UID: \"bac00ac5-0371-48fd-b1cc-60438f08ae94\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:37:46.919842 master-0 kubenswrapper[8993]: I1204 11:37:46.919700 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7bhn\" (UniqueName: \"kubernetes.io/projected/031d300e-24b4-481c-8b82-fe8cdb3fcef7-kube-api-access-k7bhn\") pod \"csi-snapshot-controller-operator-6bc8656fdc-2q7f5\" (UID: \"031d300e-24b4-481c-8b82-fe8cdb3fcef7\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-6bc8656fdc-2q7f5" Dec 04 11:37:46.940942 master-0 kubenswrapper[8993]: I1204 11:37:46.940881 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlr76\" (UniqueName: \"kubernetes.io/projected/7c017c69-b24e-4a7a-b888-133bed34c174-kube-api-access-tlr76\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:37:46.946204 master-0 kubenswrapper[8993]: I1204 11:37:46.946159 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-service-ca.crt" Dec 04 11:37:46.966434 master-0 kubenswrapper[8993]: I1204 11:37:46.966338 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"config" Dec 04 11:37:46.968770 master-0 kubenswrapper[8993]: I1204 11:37:46.968724 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-cni-bin\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.968918 master-0 kubenswrapper[8993]: I1204 11:37:46.968856 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-cni-bin\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.968918 master-0 kubenswrapper[8993]: I1204 11:37:46.968878 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:37:46.969249 master-0 kubenswrapper[8993]: I1204 11:37:46.968944 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-client-ca\") pod \"route-controller-manager-864c894b4d-xbpkz\" (UID: \"2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4\") " pod="openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz" Dec 04 11:37:46.969249 master-0 kubenswrapper[8993]: E1204 11:37:46.968977 8993 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/package-server-manager-serving-cert: secret "package-server-manager-serving-cert" not found Dec 04 11:37:46.969249 master-0 kubenswrapper[8993]: I1204 11:37:46.969028 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-run-ovn-kubernetes\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.969249 master-0 kubenswrapper[8993]: E1204 11:37:46.969043 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert podName:72faf6d6-e8ca-43d1-b93e-67c11f8d3b46 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:47.469023896 +0000 UTC m=+1.859965329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "package-server-manager-serving-cert" (UniqueName: "kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert") pod "package-server-manager-67477646d4-7hndf" (UID: "72faf6d6-e8ca-43d1-b93e-67c11f8d3b46") : secret "package-server-manager-serving-cert" not found Dec 04 11:37:46.969249 master-0 kubenswrapper[8993]: I1204 11:37:46.969059 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-config\") pod \"route-controller-manager-864c894b4d-xbpkz\" (UID: \"2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4\") " pod="openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz" Dec 04 11:37:46.969249 master-0 kubenswrapper[8993]: I1204 11:37:46.969145 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-run-ovn-kubernetes\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.969249 master-0 kubenswrapper[8993]: I1204 11:37:46.969183 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-system-cni-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.969249 master-0 kubenswrapper[8993]: I1204 11:37:46.969224 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-proxy-ca-bundles\") pod \"controller-manager-59948648c9-krt4p\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.969273 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-os-release\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.969282 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-system-cni-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.969313 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-config\") pod \"controller-manager-59948648c9-krt4p\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.969357 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-multus-certs\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.969359 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-os-release\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.969427 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tbt5w\" (UniqueName: \"kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w\") pod \"network-check-target-w2lss\" (UID: \"a3558de2-46f8-48b5-a961-95decb7805cf\") " pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: E1204 11:37:46.969444 8993 configmap.go:193] Couldn't get configMap openshift-controller-manager/config: configmap "config" not found Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.969473 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-multus-certs\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.969508 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-cni-multus\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.969538 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-cni-multus\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.969556 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-node-log\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.969598 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-node-log\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: E1204 11:37:46.969675 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-config podName:51337a75-bfa1-4cac-ab92-8b0b6e529c02 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:47.469587554 +0000 UTC m=+1.860528987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-config") pod "controller-manager-59948648c9-krt4p" (UID: "51337a75-bfa1-4cac-ab92-8b0b6e529c02") : configmap "config" not found Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.969926 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-netns\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.969977 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.970046 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-cni-bin\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.970078 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.970136 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-systemd-units\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.970256 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-netns\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.970358 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6vgkr\" (UniqueName: \"kubernetes.io/projected/51337a75-bfa1-4cac-ab92-8b0b6e529c02-kube-api-access-6vgkr\") pod \"controller-manager-59948648c9-krt4p\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.970395 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-socket-dir-parent\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.970476 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-systemd-units\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.970545 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.970577 master-0 kubenswrapper[8993]: I1204 11:37:46.970586 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-cni-bin\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: E1204 11:37:46.970902 8993 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/olm-operator-serving-cert: secret "olm-operator-serving-cert" not found Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: E1204 11:37:46.970945 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert podName:7bf67a51-9759-4e2a-a2ae-ef7416cad43f nodeName:}" failed. No retries permitted until 2025-12-04 11:37:47.470933677 +0000 UTC m=+1.861875110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert") pod "olm-operator-7cd7dbb44c-vzj4q" (UID: "7bf67a51-9759-4e2a-a2ae-ef7416cad43f") : secret "olm-operator-serving-cert" not found Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.970972 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-hostroot\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.970998 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-cni-netd\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.971021 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.971024 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-socket-dir-parent\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.971106 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.971106 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-cni-netd\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.971263 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-k8s-cni-cncf-io\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.971291 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-conf-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.971311 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-hostroot\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.971341 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-k8s-cni-cncf-io\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.971380 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51337a75-bfa1-4cac-ab92-8b0b6e529c02-serving-cert\") pod \"controller-manager-59948648c9-krt4p\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.971446 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-conf-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.971498 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/330553d2-40ea-4496-8346-2e5bf680669b-host-slash\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.971526 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-kubelet\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.971554 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-kubelet\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.971565 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/330553d2-40ea-4496-8346-2e5bf680669b-host-slash\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.971776 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-var-lib-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.971824 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.971881 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-var-lib-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.971915 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-ovn\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.971939 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-ovn\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: E1204 11:37:46.972050 8993 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: secret "multus-admission-controller-secret" not found Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.972057 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.972100 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-etc-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: E1204 11:37:46.972141 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs podName:08550069-c1a1-475e-84a2-e56905f1ed38 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:47.472129595 +0000 UTC m=+1.863071028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs") pod "multus-admission-controller-7dfc5b745f-258xq" (UID: "08550069-c1a1-475e-84a2-e56905f1ed38") : secret "multus-admission-controller-secret" not found Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.972160 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-etc-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.972169 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-system-cni-dir\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.972221 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-cnibin\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: E1204 11:37:46.972234 8993 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/catalog-operator-serving-cert: secret "catalog-operator-serving-cert" not found Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.972260 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-systemd\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: E1204 11:37:46.972287 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert podName:434ed9b9-715b-455b-867c-775b256df40f nodeName:}" failed. No retries permitted until 2025-12-04 11:37:47.47226539 +0000 UTC m=+1.863207023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert") pod "catalog-operator-fbc6455c4-5m8ll" (UID: "434ed9b9-715b-455b-867c-775b256df40f") : secret "catalog-operator-serving-cert" not found Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.972241 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-systemd\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.972324 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-system-cni-dir\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.972339 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-cnibin\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.972372 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.972400 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-cnibin\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.972404 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-run-netns\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.972397 master-0 kubenswrapper[8993]: I1204 11:37:46.972444 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-etc-kubernetes\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: I1204 11:37:46.972484 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: I1204 11:37:46.972501 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-kubelet\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: I1204 11:37:46.972513 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-etc-kubernetes\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: I1204 11:37:46.972541 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-run-netns\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: I1204 11:37:46.972446 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-cnibin\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: I1204 11:37:46.972611 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-slash\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: I1204 11:37:46.972545 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-slash\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: I1204 11:37:46.972646 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-kubelet\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: I1204 11:37:46.972667 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4p2dv\" (UniqueName: \"kubernetes.io/projected/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-kube-api-access-4p2dv\") pod \"route-controller-manager-864c894b4d-xbpkz\" (UID: \"2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4\") " pod="openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz" Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: I1204 11:37:46.972692 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: I1204 11:37:46.972719 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-serving-cert\") pod \"route-controller-manager-864c894b4d-xbpkz\" (UID: \"2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4\") " pod="openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz" Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: I1204 11:37:46.972739 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-cni-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: I1204 11:37:46.972756 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-log-socket\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: I1204 11:37:46.972774 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-client-ca\") pod \"controller-manager-59948648c9-krt4p\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: I1204 11:37:46.972795 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: I1204 11:37:46.972831 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: I1204 11:37:46.972856 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-os-release\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: I1204 11:37:46.972966 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-os-release\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: I1204 11:37:46.973100 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-log-socket\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: E1204 11:37:46.973183 8993 secret.go:189] Couldn't get secret openshift-marketplace/marketplace-operator-metrics: secret "marketplace-operator-metrics" not found Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: E1204 11:37:46.973189 8993 secret.go:189] Couldn't get secret openshift-ingress-operator/metrics-tls: secret "metrics-tls" not found Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: I1204 11:37:46.973264 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-cni-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: E1204 11:37:46.973279 8993 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: E1204 11:37:46.973230 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics podName:fd4c4c6f-380a-4cda-9a21-352b55ec2d98 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:47.47321462 +0000 UTC m=+1.864156053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "marketplace-operator-metrics" (UniqueName: "kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics") pod "marketplace-operator-f797b99b6-hjjrk" (UID: "fd4c4c6f-380a-4cda-9a21-352b55ec2d98") : secret "marketplace-operator-metrics" not found Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: E1204 11:37:46.973375 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls podName:b011b1f1-3235-4e20-825b-ce711c052407 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:47.473340625 +0000 UTC m=+1.864282218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls") pod "ingress-operator-8649c48786-cx2b2" (UID: "b011b1f1-3235-4e20-825b-ce711c052407") : secret "metrics-tls" not found Dec 04 11:37:46.974144 master-0 kubenswrapper[8993]: E1204 11:37:46.973397 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs podName:d8fca733-45c8-45b8-8653-ac204e7c6098 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:47.473387966 +0000 UTC m=+1.864329399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs") pod "network-metrics-daemon-gp57t" (UID: "d8fca733-45c8-45b8-8653-ac204e7c6098") : secret "metrics-daemon-secret" not found Dec 04 11:37:46.985850 master-0 kubenswrapper[8993]: I1204 11:37:46.985614 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"client-ca" Dec 04 11:37:46.994097 master-0 kubenswrapper[8993]: E1204 11:37:46.993931 8993 configmap.go:193] Couldn't get configMap openshift-controller-manager/client-ca: configmap "client-ca" not found Dec 04 11:37:46.994097 master-0 kubenswrapper[8993]: E1204 11:37:46.994041 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-client-ca podName:51337a75-bfa1-4cac-ab92-8b0b6e529c02 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:47.494015459 +0000 UTC m=+1.884956892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-client-ca") pod "controller-manager-59948648c9-krt4p" (UID: "51337a75-bfa1-4cac-ab92-8b0b6e529c02") : configmap "client-ca" not found Dec 04 11:37:47.013415 master-0 kubenswrapper[8993]: I1204 11:37:47.013241 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-global-ca" Dec 04 11:37:47.021909 master-0 kubenswrapper[8993]: I1204 11:37:47.021836 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-proxy-ca-bundles\") pod \"controller-manager-59948648c9-krt4p\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:47.027337 master-0 kubenswrapper[8993]: I1204 11:37:47.027303 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"serving-cert" Dec 04 11:37:47.032018 master-0 kubenswrapper[8993]: E1204 11:37:47.031975 8993 secret.go:189] Couldn't get secret openshift-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 11:37:47.032161 master-0 kubenswrapper[8993]: E1204 11:37:47.032058 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51337a75-bfa1-4cac-ab92-8b0b6e529c02-serving-cert podName:51337a75-bfa1-4cac-ab92-8b0b6e529c02 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:47.532030319 +0000 UTC m=+1.922971762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/51337a75-bfa1-4cac-ab92-8b0b6e529c02-serving-cert") pod "controller-manager-59948648c9-krt4p" (UID: "51337a75-bfa1-4cac-ab92-8b0b6e529c02") : secret "serving-cert" not found Dec 04 11:37:47.040119 master-0 kubenswrapper[8993]: I1204 11:37:47.040083 8993 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Dec 04 11:37:47.047919 master-0 kubenswrapper[8993]: I1204 11:37:47.047760 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator"/"kube-root-ca.crt" Dec 04 11:37:47.068151 master-0 kubenswrapper[8993]: I1204 11:37:47.066733 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"kube-root-ca.crt" Dec 04 11:37:47.086299 master-0 kubenswrapper[8993]: I1204 11:37:47.086237 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator"/"openshift-service-ca.crt" Dec 04 11:37:47.107428 master-0 kubenswrapper[8993]: I1204 11:37:47.107068 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Dec 04 11:37:47.115828 master-0 kubenswrapper[8993]: E1204 11:37:47.114495 8993 secret.go:189] Couldn't get secret openshift-route-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 11:37:47.115828 master-0 kubenswrapper[8993]: I1204 11:37:47.114586 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-77c99c46b8-6cntk"] Dec 04 11:37:47.115828 master-0 kubenswrapper[8993]: E1204 11:37:47.114609 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-serving-cert podName:2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:47.61458274 +0000 UTC m=+2.005524163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-serving-cert") pod "route-controller-manager-864c894b4d-xbpkz" (UID: "2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4") : secret "serving-cert" not found Dec 04 11:37:47.115828 master-0 kubenswrapper[8993]: E1204 11:37:47.114779 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3e64e99a-b3b9-4db7-aec4-8e61d1370e7e" containerName="assisted-installer-controller" Dec 04 11:37:47.115828 master-0 kubenswrapper[8993]: I1204 11:37:47.114798 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e64e99a-b3b9-4db7-aec4-8e61d1370e7e" containerName="assisted-installer-controller" Dec 04 11:37:47.115828 master-0 kubenswrapper[8993]: E1204 11:37:47.114832 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cca0c8b5-4833-4e29-8a5b-d5fd891635e6" containerName="prober" Dec 04 11:37:47.115828 master-0 kubenswrapper[8993]: I1204 11:37:47.114840 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="cca0c8b5-4833-4e29-8a5b-d5fd891635e6" containerName="prober" Dec 04 11:37:47.115828 master-0 kubenswrapper[8993]: I1204 11:37:47.114987 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="3e64e99a-b3b9-4db7-aec4-8e61d1370e7e" containerName="assisted-installer-controller" Dec 04 11:37:47.115828 master-0 kubenswrapper[8993]: I1204 11:37:47.115006 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="cca0c8b5-4833-4e29-8a5b-d5fd891635e6" containerName="prober" Dec 04 11:37:47.115828 master-0 kubenswrapper[8993]: I1204 11:37:47.115444 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" Dec 04 11:37:47.139898 master-0 kubenswrapper[8993]: I1204 11:37:47.133819 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"openshift-service-ca.crt" Dec 04 11:37:47.139898 master-0 kubenswrapper[8993]: I1204 11:37:47.136591 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-77c99c46b8-6cntk"] Dec 04 11:37:47.151410 master-0 kubenswrapper[8993]: I1204 11:37:47.150499 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"config" Dec 04 11:37:47.159982 master-0 kubenswrapper[8993]: E1204 11:37:47.159535 8993 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/config: configmap "config" not found Dec 04 11:37:47.159982 master-0 kubenswrapper[8993]: E1204 11:37:47.159684 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-config podName:2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:47.659653176 +0000 UTC m=+2.050594610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-config") pod "route-controller-manager-864c894b4d-xbpkz" (UID: "2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4") : configmap "config" not found Dec 04 11:37:47.167272 master-0 kubenswrapper[8993]: I1204 11:37:47.166051 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"client-ca" Dec 04 11:37:47.173841 master-0 kubenswrapper[8993]: E1204 11:37:47.172925 8993 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/client-ca: configmap "client-ca" not found Dec 04 11:37:47.173841 master-0 kubenswrapper[8993]: E1204 11:37:47.173065 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-client-ca podName:2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:47.673034267 +0000 UTC m=+2.063975700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-client-ca") pod "route-controller-manager-864c894b4d-xbpkz" (UID: "2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4") : configmap "client-ca" not found Dec 04 11:37:47.177956 master-0 kubenswrapper[8993]: I1204 11:37:47.175310 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1243d581-fa11-4db1-a01a-0cf64eb3ef74-signing-cabundle\") pod \"service-ca-77c99c46b8-6cntk\" (UID: \"1243d581-fa11-4db1-a01a-0cf64eb3ef74\") " pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" Dec 04 11:37:47.177956 master-0 kubenswrapper[8993]: I1204 11:37:47.176377 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1243d581-fa11-4db1-a01a-0cf64eb3ef74-signing-key\") pod \"service-ca-77c99c46b8-6cntk\" (UID: \"1243d581-fa11-4db1-a01a-0cf64eb3ef74\") " pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" Dec 04 11:37:47.177956 master-0 kubenswrapper[8993]: I1204 11:37:47.176497 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q8d8\" (UniqueName: \"kubernetes.io/projected/1243d581-fa11-4db1-a01a-0cf64eb3ef74-kube-api-access-9q8d8\") pod \"service-ca-77c99c46b8-6cntk\" (UID: \"1243d581-fa11-4db1-a01a-0cf64eb3ef74\") " pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" Dec 04 11:37:47.190171 master-0 kubenswrapper[8993]: I1204 11:37:47.188108 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"kube-root-ca.crt" Dec 04 11:37:47.217258 master-0 kubenswrapper[8993]: I1204 11:37:47.217183 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7xwd\" (UniqueName: \"kubernetes.io/projected/42b3be0f-1d82-4a64-abb4-0118a6960efd-kube-api-access-c7xwd\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:37:47.238043 master-0 kubenswrapper[8993]: I1204 11:37:47.237971 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/69640270-09e6-4217-b1c8-3d3465c0c3ae-kube-api-access\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:37:47.259494 master-0 kubenswrapper[8993]: I1204 11:37:47.259421 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvzrc\" (UniqueName: \"kubernetes.io/projected/2ab26ae5-0607-4dfd-840e-531d204b5030-kube-api-access-mvzrc\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:47.278539 master-0 kubenswrapper[8993]: I1204 11:37:47.278308 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1243d581-fa11-4db1-a01a-0cf64eb3ef74-signing-cabundle\") pod \"service-ca-77c99c46b8-6cntk\" (UID: \"1243d581-fa11-4db1-a01a-0cf64eb3ef74\") " pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" Dec 04 11:37:47.278998 master-0 kubenswrapper[8993]: I1204 11:37:47.278946 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1243d581-fa11-4db1-a01a-0cf64eb3ef74-signing-key\") pod \"service-ca-77c99c46b8-6cntk\" (UID: \"1243d581-fa11-4db1-a01a-0cf64eb3ef74\") " pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" Dec 04 11:37:47.279223 master-0 kubenswrapper[8993]: I1204 11:37:47.279174 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdsq5\" (UniqueName: \"kubernetes.io/projected/c6e9271a-44ea-4612-ab60-4a9d489ed062-kube-api-access-cdsq5\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:37:47.279223 master-0 kubenswrapper[8993]: I1204 11:37:47.279224 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9q8d8\" (UniqueName: \"kubernetes.io/projected/1243d581-fa11-4db1-a01a-0cf64eb3ef74-kube-api-access-9q8d8\") pod \"service-ca-77c99c46b8-6cntk\" (UID: \"1243d581-fa11-4db1-a01a-0cf64eb3ef74\") " pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" Dec 04 11:37:47.298684 master-0 kubenswrapper[8993]: I1204 11:37:47.298617 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-bound-sa-token\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:47.318771 master-0 kubenswrapper[8993]: I1204 11:37:47.318698 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g7bh\" (UniqueName: \"kubernetes.io/projected/00601c1a-efd4-4366-bdc9-d768afa252b0-kube-api-access-2g7bh\") pod \"openshift-config-operator-68758cbcdb-zh8g5\" (UID: \"00601c1a-efd4-4366-bdc9-d768afa252b0\") " pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:37:47.339561 master-0 kubenswrapper[8993]: I1204 11:37:47.339500 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6bhm\" (UniqueName: \"kubernetes.io/projected/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-kube-api-access-n6bhm\") pod \"service-ca-operator-77758bc754-8smqn\" (UID: \"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8\") " pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:37:47.359928 master-0 kubenswrapper[8993]: I1204 11:37:47.359857 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/ccf81538-4d5a-4c26-8e54-fe39331a625d-kube-api-access\") pod \"kube-apiserver-operator-765d9ff747-gr68k\" (UID: \"ccf81538-4d5a-4c26-8e54-fe39331a625d\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:37:47.380215 master-0 kubenswrapper[8993]: I1204 11:37:47.380160 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:47.380474 master-0 kubenswrapper[8993]: I1204 11:37:47.380240 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:37:47.380474 master-0 kubenswrapper[8993]: I1204 11:37:47.380344 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/27576028-d64a-47cd-b76b-d524e41efe37-kube-api-access\") pod \"openshift-kube-scheduler-operator-5f85974995-g4rwv\" (UID: \"27576028-d64a-47cd-b76b-d524e41efe37\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:37:47.380474 master-0 kubenswrapper[8993]: E1204 11:37:47.380416 8993 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-operator-tls: secret "image-registry-operator-tls" not found Dec 04 11:37:47.380600 master-0 kubenswrapper[8993]: I1204 11:37:47.380473 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:47.380600 master-0 kubenswrapper[8993]: E1204 11:37:47.380534 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls podName:1ade9186-b262-4b5e-9c6f-ba89f0130fb6 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:48.380502369 +0000 UTC m=+2.771443872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "image-registry-operator-tls" (UniqueName: "kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls") pod "cluster-image-registry-operator-6fb9f88b7-tgvfl" (UID: "1ade9186-b262-4b5e-9c6f-ba89f0130fb6") : secret "image-registry-operator-tls" not found Dec 04 11:37:47.380600 master-0 kubenswrapper[8993]: E1204 11:37:47.380566 8993 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 11:37:47.380725 master-0 kubenswrapper[8993]: E1204 11:37:47.380624 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert podName:69640270-09e6-4217-b1c8-3d3465c0c3ae nodeName:}" failed. No retries permitted until 2025-12-04 11:37:48.380606622 +0000 UTC m=+2.771548055 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert") pod "cluster-version-operator-77dfcc565f-nqpsd" (UID: "69640270-09e6-4217-b1c8-3d3465c0c3ae") : secret "cluster-version-operator-serving-cert" not found Dec 04 11:37:47.380725 master-0 kubenswrapper[8993]: E1204 11:37:47.380628 8993 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/performance-addon-operator-webhook-cert: secret "performance-addon-operator-webhook-cert" not found Dec 04 11:37:47.380725 master-0 kubenswrapper[8993]: E1204 11:37:47.380679 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert podName:6f15dcdb-c968-429c-9d1d-63c2becad337 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:48.380662214 +0000 UTC m=+2.771603647 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert") pod "cluster-node-tuning-operator-85cff47f46-4gv5j" (UID: "6f15dcdb-c968-429c-9d1d-63c2becad337") : secret "performance-addon-operator-webhook-cert" not found Dec 04 11:37:47.380895 master-0 kubenswrapper[8993]: I1204 11:37:47.380860 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:37:47.381000 master-0 kubenswrapper[8993]: E1204 11:37:47.380974 8993 secret.go:189] Couldn't get secret openshift-dns-operator/metrics-tls: secret "metrics-tls" not found Dec 04 11:37:47.381000 master-0 kubenswrapper[8993]: I1204 11:37:47.380986 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:47.381091 master-0 kubenswrapper[8993]: E1204 11:37:47.381005 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls podName:7c017c69-b24e-4a7a-b888-133bed34c174 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:48.380998134 +0000 UTC m=+2.771939567 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls") pod "dns-operator-7c56cf9b74-xz27r" (UID: "7c017c69-b24e-4a7a-b888-133bed34c174") : secret "metrics-tls" not found Dec 04 11:37:47.381091 master-0 kubenswrapper[8993]: I1204 11:37:47.381066 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:47.381164 master-0 kubenswrapper[8993]: E1204 11:37:47.381105 8993 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/node-tuning-operator-tls: secret "node-tuning-operator-tls" not found Dec 04 11:37:47.381199 master-0 kubenswrapper[8993]: E1204 11:37:47.381181 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls podName:6f15dcdb-c968-429c-9d1d-63c2becad337 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:48.381133018 +0000 UTC m=+2.772074451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-tuning-operator-tls" (UniqueName: "kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls") pod "cluster-node-tuning-operator-85cff47f46-4gv5j" (UID: "6f15dcdb-c968-429c-9d1d-63c2becad337") : secret "node-tuning-operator-tls" not found Dec 04 11:37:47.381199 master-0 kubenswrapper[8993]: E1204 11:37:47.381187 8993 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Dec 04 11:37:47.381277 master-0 kubenswrapper[8993]: E1204 11:37:47.381224 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls podName:2ab26ae5-0607-4dfd-840e-531d204b5030 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:48.381213261 +0000 UTC m=+2.772154764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-7ff994598c-p82nn" (UID: "2ab26ae5-0607-4dfd-840e-531d204b5030") : secret "cluster-monitoring-operator-tls" not found Dec 04 11:37:47.386625 master-0 kubenswrapper[8993]: I1204 11:37:47.386574 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-node-metrics-cert" Dec 04 11:37:47.387863 master-0 kubenswrapper[8993]: I1204 11:37:47.387828 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovn-node-metrics-cert\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:47.406575 master-0 kubenswrapper[8993]: I1204 11:37:47.406238 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-script-lib" Dec 04 11:37:47.407763 master-0 kubenswrapper[8993]: I1204 11:37:47.407715 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovnkube-script-lib\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:47.442824 master-0 kubenswrapper[8993]: I1204 11:37:47.442574 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkjzz\" (UniqueName: \"kubernetes.io/projected/6f15dcdb-c968-429c-9d1d-63c2becad337-kube-api-access-kkjzz\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:47.458022 master-0 kubenswrapper[8993]: I1204 11:37:47.457970 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6bkg\" (UniqueName: \"kubernetes.io/projected/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-kube-api-access-t6bkg\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:37:47.482779 master-0 kubenswrapper[8993]: I1204 11:37:47.482719 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cxbd\" (UniqueName: \"kubernetes.io/projected/0158c2f3-20e5-43f4-875d-c5ad8f6112df-kube-api-access-8cxbd\") pod \"cluster-olm-operator-56fcb6cc5f-4xwp2\" (UID: \"0158c2f3-20e5-43f4-875d-c5ad8f6112df\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:37:47.483030 master-0 kubenswrapper[8993]: I1204 11:37:47.482796 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:37:47.483030 master-0 kubenswrapper[8993]: E1204 11:37:47.482958 8993 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: secret "multus-admission-controller-secret" not found Dec 04 11:37:47.483030 master-0 kubenswrapper[8993]: E1204 11:37:47.483013 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs podName:08550069-c1a1-475e-84a2-e56905f1ed38 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:48.482999369 +0000 UTC m=+2.873940802 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs") pod "multus-admission-controller-7dfc5b745f-258xq" (UID: "08550069-c1a1-475e-84a2-e56905f1ed38") : secret "multus-admission-controller-secret" not found Dec 04 11:37:47.483175 master-0 kubenswrapper[8993]: I1204 11:37:47.483069 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:47.483175 master-0 kubenswrapper[8993]: I1204 11:37:47.483130 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:47.483254 master-0 kubenswrapper[8993]: I1204 11:37:47.483179 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:47.483441 master-0 kubenswrapper[8993]: E1204 11:37:47.483395 8993 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/catalog-operator-serving-cert: secret "catalog-operator-serving-cert" not found Dec 04 11:37:47.483500 master-0 kubenswrapper[8993]: E1204 11:37:47.483454 8993 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Dec 04 11:37:47.483543 master-0 kubenswrapper[8993]: E1204 11:37:47.483492 8993 secret.go:189] Couldn't get secret openshift-marketplace/marketplace-operator-metrics: secret "marketplace-operator-metrics" not found Dec 04 11:37:47.483543 master-0 kubenswrapper[8993]: I1204 11:37:47.483420 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:47.483543 master-0 kubenswrapper[8993]: E1204 11:37:47.483522 8993 secret.go:189] Couldn't get secret openshift-ingress-operator/metrics-tls: secret "metrics-tls" not found Dec 04 11:37:47.483543 master-0 kubenswrapper[8993]: E1204 11:37:47.483498 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert podName:434ed9b9-715b-455b-867c-775b256df40f nodeName:}" failed. No retries permitted until 2025-12-04 11:37:48.483474885 +0000 UTC m=+2.874416318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert") pod "catalog-operator-fbc6455c4-5m8ll" (UID: "434ed9b9-715b-455b-867c-775b256df40f") : secret "catalog-operator-serving-cert" not found Dec 04 11:37:47.483696 master-0 kubenswrapper[8993]: E1204 11:37:47.483554 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls podName:b011b1f1-3235-4e20-825b-ce711c052407 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:48.483544387 +0000 UTC m=+2.874485820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls") pod "ingress-operator-8649c48786-cx2b2" (UID: "b011b1f1-3235-4e20-825b-ce711c052407") : secret "metrics-tls" not found Dec 04 11:37:47.483696 master-0 kubenswrapper[8993]: E1204 11:37:47.483569 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs podName:d8fca733-45c8-45b8-8653-ac204e7c6098 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:48.483563928 +0000 UTC m=+2.874505361 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs") pod "network-metrics-daemon-gp57t" (UID: "d8fca733-45c8-45b8-8653-ac204e7c6098") : secret "metrics-daemon-secret" not found Dec 04 11:37:47.483696 master-0 kubenswrapper[8993]: E1204 11:37:47.483585 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics podName:fd4c4c6f-380a-4cda-9a21-352b55ec2d98 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:48.483577898 +0000 UTC m=+2.874519331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "marketplace-operator-metrics" (UniqueName: "kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics") pod "marketplace-operator-f797b99b6-hjjrk" (UID: "fd4c4c6f-380a-4cda-9a21-352b55ec2d98") : secret "marketplace-operator-metrics" not found Dec 04 11:37:47.483696 master-0 kubenswrapper[8993]: I1204 11:37:47.483601 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:37:47.483696 master-0 kubenswrapper[8993]: E1204 11:37:47.483650 8993 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/package-server-manager-serving-cert: secret "package-server-manager-serving-cert" not found Dec 04 11:37:47.483696 master-0 kubenswrapper[8993]: I1204 11:37:47.483666 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-config\") pod \"controller-manager-59948648c9-krt4p\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:47.483696 master-0 kubenswrapper[8993]: E1204 11:37:47.483680 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert podName:72faf6d6-e8ca-43d1-b93e-67c11f8d3b46 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:48.483669021 +0000 UTC m=+2.874610454 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "package-server-manager-serving-cert" (UniqueName: "kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert") pod "package-server-manager-67477646d4-7hndf" (UID: "72faf6d6-e8ca-43d1-b93e-67c11f8d3b46") : secret "package-server-manager-serving-cert" not found Dec 04 11:37:47.483696 master-0 kubenswrapper[8993]: E1204 11:37:47.483707 8993 configmap.go:193] Couldn't get configMap openshift-controller-manager/config: configmap "config" not found Dec 04 11:37:47.484027 master-0 kubenswrapper[8993]: E1204 11:37:47.483728 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-config podName:51337a75-bfa1-4cac-ab92-8b0b6e529c02 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:48.483723233 +0000 UTC m=+2.874664666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-config") pod "controller-manager-59948648c9-krt4p" (UID: "51337a75-bfa1-4cac-ab92-8b0b6e529c02") : configmap "config" not found Dec 04 11:37:47.484027 master-0 kubenswrapper[8993]: I1204 11:37:47.483776 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:47.484027 master-0 kubenswrapper[8993]: E1204 11:37:47.483879 8993 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/olm-operator-serving-cert: secret "olm-operator-serving-cert" not found Dec 04 11:37:47.484027 master-0 kubenswrapper[8993]: E1204 11:37:47.483926 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert podName:7bf67a51-9759-4e2a-a2ae-ef7416cad43f nodeName:}" failed. No retries permitted until 2025-12-04 11:37:48.483915199 +0000 UTC m=+2.874856802 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert") pod "olm-operator-7cd7dbb44c-vzj4q" (UID: "7bf67a51-9759-4e2a-a2ae-ef7416cad43f") : secret "olm-operator-serving-cert" not found Dec 04 11:37:47.498063 master-0 kubenswrapper[8993]: I1204 11:37:47.497983 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k449s\" (UniqueName: \"kubernetes.io/projected/3322cc5a-f1f7-4522-b423-19fb7f38cd43-kube-api-access-k449s\") pod \"openshift-controller-manager-operator-6c8676f99d-7z948\" (UID: \"3322cc5a-f1f7-4522-b423-19fb7f38cd43\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:37:47.518929 master-0 kubenswrapper[8993]: I1204 11:37:47.518832 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t46k7\" (UniqueName: \"kubernetes.io/projected/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-kube-api-access-t46k7\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:47.558281 master-0 kubenswrapper[8993]: I1204 11:37:47.558217 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-llscb\" (UniqueName: \"kubernetes.io/projected/fd9f8671-8066-4990-b45d-8b619aa5d9ec-kube-api-access-llscb\") pod \"kube-storage-version-migrator-operator-b9c5dfc78-dcxkw\" (UID: \"fd9f8671-8066-4990-b45d-8b619aa5d9ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:37:47.580554 master-0 kubenswrapper[8993]: I1204 11:37:47.580480 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-59pbp\" (UniqueName: \"kubernetes.io/projected/330553d2-40ea-4496-8346-2e5bf680669b-kube-api-access-59pbp\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:37:47.586119 master-0 kubenswrapper[8993]: I1204 11:37:47.586031 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-client-ca\") pod \"controller-manager-59948648c9-krt4p\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:47.587185 master-0 kubenswrapper[8993]: E1204 11:37:47.586575 8993 configmap.go:193] Couldn't get configMap openshift-controller-manager/client-ca: configmap "client-ca" not found Dec 04 11:37:47.587185 master-0 kubenswrapper[8993]: E1204 11:37:47.586845 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-client-ca podName:51337a75-bfa1-4cac-ab92-8b0b6e529c02 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:48.586776722 +0000 UTC m=+2.977718255 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-client-ca") pod "controller-manager-59948648c9-krt4p" (UID: "51337a75-bfa1-4cac-ab92-8b0b6e529c02") : configmap "client-ca" not found Dec 04 11:37:47.587185 master-0 kubenswrapper[8993]: E1204 11:37:47.586953 8993 secret.go:189] Couldn't get secret openshift-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 11:37:47.587185 master-0 kubenswrapper[8993]: E1204 11:37:47.587029 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51337a75-bfa1-4cac-ab92-8b0b6e529c02-serving-cert podName:51337a75-bfa1-4cac-ab92-8b0b6e529c02 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:48.587012779 +0000 UTC m=+2.977954212 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/51337a75-bfa1-4cac-ab92-8b0b6e529c02-serving-cert") pod "controller-manager-59948648c9-krt4p" (UID: "51337a75-bfa1-4cac-ab92-8b0b6e529c02") : secret "serving-cert" not found Dec 04 11:37:47.587185 master-0 kubenswrapper[8993]: I1204 11:37:47.586757 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51337a75-bfa1-4cac-ab92-8b0b6e529c02-serving-cert\") pod \"controller-manager-59948648c9-krt4p\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:47.597719 master-0 kubenswrapper[8993]: I1204 11:37:47.597647 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ncf9\" (UniqueName: \"kubernetes.io/projected/d8fca733-45c8-45b8-8653-ac204e7c6098-kube-api-access-2ncf9\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:47.620171 master-0 kubenswrapper[8993]: I1204 11:37:47.620120 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4w2j\" (UniqueName: \"kubernetes.io/projected/bdfcb644-24ef-4a33-93ae-a855e872d29a-kube-api-access-f4w2j\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:37:47.640830 master-0 kubenswrapper[8993]: I1204 11:37:47.638729 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmdvf\" (UniqueName: \"kubernetes.io/projected/287fba2d-f56d-4ec0-b796-7849a68fb411-kube-api-access-gmdvf\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:37:47.662372 master-0 kubenswrapper[8993]: I1204 11:37:47.662339 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lxhl\" (UniqueName: \"kubernetes.io/projected/c790c174-dc60-4f34-8818-3b367fbe3a5f-kube-api-access-6lxhl\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:37:47.680793 master-0 kubenswrapper[8993]: I1204 11:37:47.680756 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggzfm\" (UniqueName: \"kubernetes.io/projected/434ed9b9-715b-455b-867c-775b256df40f-kube-api-access-ggzfm\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:47.689194 master-0 kubenswrapper[8993]: I1204 11:37:47.689143 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-client-ca\") pod \"route-controller-manager-864c894b4d-xbpkz\" (UID: \"2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4\") " pod="openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz" Dec 04 11:37:47.689360 master-0 kubenswrapper[8993]: E1204 11:37:47.689312 8993 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/client-ca: configmap "client-ca" not found Dec 04 11:37:47.689476 master-0 kubenswrapper[8993]: E1204 11:37:47.689441 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-client-ca podName:2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:48.689405237 +0000 UTC m=+3.080346810 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-client-ca") pod "route-controller-manager-864c894b4d-xbpkz" (UID: "2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4") : configmap "client-ca" not found Dec 04 11:37:47.689579 master-0 kubenswrapper[8993]: E1204 11:37:47.689562 8993 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/config: configmap "config" not found Dec 04 11:37:47.689690 master-0 kubenswrapper[8993]: E1204 11:37:47.689680 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-config podName:2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:48.689659375 +0000 UTC m=+3.080600808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-config") pod "route-controller-manager-864c894b4d-xbpkz" (UID: "2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4") : configmap "config" not found Dec 04 11:37:47.689752 master-0 kubenswrapper[8993]: I1204 11:37:47.689325 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-config\") pod \"route-controller-manager-864c894b4d-xbpkz\" (UID: \"2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4\") " pod="openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz" Dec 04 11:37:47.690067 master-0 kubenswrapper[8993]: I1204 11:37:47.690051 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-serving-cert\") pod \"route-controller-manager-864c894b4d-xbpkz\" (UID: \"2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4\") " pod="openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz" Dec 04 11:37:47.690212 master-0 kubenswrapper[8993]: E1204 11:37:47.690200 8993 secret.go:189] Couldn't get secret openshift-route-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 11:37:47.690322 master-0 kubenswrapper[8993]: E1204 11:37:47.690275 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-serving-cert podName:2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:48.690266205 +0000 UTC m=+3.081207638 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-serving-cert") pod "route-controller-manager-864c894b4d-xbpkz" (UID: "2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4") : secret "serving-cert" not found Dec 04 11:37:47.698769 master-0 kubenswrapper[8993]: I1204 11:37:47.698733 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkcj4\" (UniqueName: \"kubernetes.io/projected/7203ec93-6572-4032-825c-140029a86058-kube-api-access-gkcj4\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:37:47.721340 master-0 kubenswrapper[8993]: I1204 11:37:47.721278 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cffn\" (UniqueName: \"kubernetes.io/projected/08550069-c1a1-475e-84a2-e56905f1ed38-kube-api-access-8cffn\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:37:47.741911 master-0 kubenswrapper[8993]: I1204 11:37:47.741797 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj4dt\" (UniqueName: \"kubernetes.io/projected/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-kube-api-access-rj4dt\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:47.761827 master-0 kubenswrapper[8993]: I1204 11:37:47.761722 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2mhg\" (UniqueName: \"kubernetes.io/projected/157eab0c-0d8d-486b-a349-c2e466e18e0c-kube-api-access-p2mhg\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:47.779902 master-0 kubenswrapper[8993]: I1204 11:37:47.777874 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b011b1f1-3235-4e20-825b-ce711c052407-bound-sa-token\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:47.800078 master-0 kubenswrapper[8993]: I1204 11:37:47.800021 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq49f\" (UniqueName: \"kubernetes.io/projected/b011b1f1-3235-4e20-825b-ce711c052407-kube-api-access-jq49f\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:47.817096 master-0 kubenswrapper[8993]: I1204 11:37:47.816948 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr454\" (UniqueName: \"kubernetes.io/projected/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-kube-api-access-zr454\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:47.839673 master-0 kubenswrapper[8993]: I1204 11:37:47.839535 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckwnn\" (UniqueName: \"kubernetes.io/projected/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-kube-api-access-ckwnn\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:37:47.863874 master-0 kubenswrapper[8993]: I1204 11:37:47.863773 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5r7w\" (UniqueName: \"kubernetes.io/projected/38fc8086-a00c-4a2a-8a0e-c57e9d9d0103-kube-api-access-l5r7w\") pod \"csi-snapshot-controller-6b958b6f94-w74zr\" (UID: \"38fc8086-a00c-4a2a-8a0e-c57e9d9d0103\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" Dec 04 11:37:47.878158 master-0 kubenswrapper[8993]: I1204 11:37:47.878093 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxnbc\" (UniqueName: \"kubernetes.io/projected/16057f9c-b1f8-4915-acc3-2d4532af4963-kube-api-access-lxnbc\") pod \"migrator-74b7b57c65-d6v67\" (UID: \"16057f9c-b1f8-4915-acc3-2d4532af4963\") " pod="openshift-kube-storage-version-migrator/migrator-74b7b57c65-d6v67" Dec 04 11:37:47.897229 master-0 kubenswrapper[8993]: E1204 11:37:47.896709 8993 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"bootstrap-kube-controller-manager-master-0\" already exists" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:47.905677 master-0 kubenswrapper[8993]: I1204 11:37:47.905601 8993 request.go:700] Waited for 1.007092927s due to client-side throttling, not priority and fairness, request: POST:https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods Dec 04 11:37:47.916582 master-0 kubenswrapper[8993]: E1204 11:37:47.916500 8993 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"bootstrap-kube-apiserver-master-0\" already exists" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:47.935243 master-0 kubenswrapper[8993]: W1204 11:37:47.935163 8993 warnings.go:70] would violate PodSecurity "restricted:latest": host namespaces (hostNetwork=true), hostPort (container "etcd" uses hostPorts 2379, 2380), privileged (containers "etcdctl", "etcd" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (containers "etcdctl", "etcd" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (containers "etcdctl", "etcd" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volumes "certs", "data-dir" use restricted volume type "hostPath"), runAsNonRoot != true (pod or containers "etcdctl", "etcd" must set securityContext.runAsNonRoot=true), seccompProfile (pod or containers "etcdctl", "etcd" must set securityContext.seccompProfile.type to "RuntimeDefault" or "Localhost") Dec 04 11:37:47.935608 master-0 kubenswrapper[8993]: E1204 11:37:47.935282 8993 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"etcd-master-0-master-0\" already exists" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:37:47.957856 master-0 kubenswrapper[8993]: I1204 11:37:47.957777 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" Dec 04 11:37:47.962376 master-0 kubenswrapper[8993]: I1204 11:37:47.962319 8993 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Dec 04 11:37:47.973182 master-0 kubenswrapper[8993]: I1204 11:37:47.973135 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbt5w\" (UniqueName: \"kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w\") pod \"network-check-target-w2lss\" (UID: \"a3558de2-46f8-48b5-a961-95decb7805cf\") " pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:47.982307 master-0 kubenswrapper[8993]: I1204 11:37:47.982194 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vgkr\" (UniqueName: \"kubernetes.io/projected/51337a75-bfa1-4cac-ab92-8b0b6e529c02-kube-api-access-6vgkr\") pod \"controller-manager-59948648c9-krt4p\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:48.003568 master-0 kubenswrapper[8993]: I1204 11:37:48.003016 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-74b7b57c65-d6v67" Dec 04 11:37:48.006165 master-0 kubenswrapper[8993]: I1204 11:37:48.006123 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca"/"signing-key" Dec 04 11:37:48.008159 master-0 kubenswrapper[8993]: I1204 11:37:48.008104 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p2dv\" (UniqueName: \"kubernetes.io/projected/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-kube-api-access-4p2dv\") pod \"route-controller-manager-864c894b4d-xbpkz\" (UID: \"2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4\") " pod="openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz" Dec 04 11:37:48.022180 master-0 kubenswrapper[8993]: I1204 11:37:48.022114 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1243d581-fa11-4db1-a01a-0cf64eb3ef74-signing-key\") pod \"service-ca-77c99c46b8-6cntk\" (UID: \"1243d581-fa11-4db1-a01a-0cf64eb3ef74\") " pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" Dec 04 11:37:48.026273 master-0 kubenswrapper[8993]: I1204 11:37:48.026234 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"openshift-service-ca.crt" Dec 04 11:37:48.048998 master-0 kubenswrapper[8993]: I1204 11:37:48.048314 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"signing-cabundle" Dec 04 11:37:48.050525 master-0 kubenswrapper[8993]: I1204 11:37:48.050476 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1243d581-fa11-4db1-a01a-0cf64eb3ef74-signing-cabundle\") pod \"service-ca-77c99c46b8-6cntk\" (UID: \"1243d581-fa11-4db1-a01a-0cf64eb3ef74\") " pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" Dec 04 11:37:48.052928 master-0 kubenswrapper[8993]: I1204 11:37:48.052877 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-59948648c9-krt4p"] Dec 04 11:37:48.054851 master-0 kubenswrapper[8993]: E1204 11:37:48.054784 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[client-ca config serving-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" podUID="51337a75-bfa1-4cac-ab92-8b0b6e529c02" Dec 04 11:37:48.088404 master-0 kubenswrapper[8993]: I1204 11:37:48.080900 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"kube-root-ca.crt" Dec 04 11:37:48.089854 master-0 kubenswrapper[8993]: I1204 11:37:48.088593 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz"] Dec 04 11:37:48.089854 master-0 kubenswrapper[8993]: E1204 11:37:48.088997 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[client-ca config serving-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz" podUID="2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4" Dec 04 11:37:48.118894 master-0 kubenswrapper[8993]: I1204 11:37:48.118419 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q8d8\" (UniqueName: \"kubernetes.io/projected/1243d581-fa11-4db1-a01a-0cf64eb3ef74-kube-api-access-9q8d8\") pod \"service-ca-77c99c46b8-6cntk\" (UID: \"1243d581-fa11-4db1-a01a-0cf64eb3ef74\") " pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" Dec 04 11:37:48.208332 master-0 kubenswrapper[8993]: I1204 11:37:48.208159 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr"] Dec 04 11:37:48.238622 master-0 kubenswrapper[8993]: I1204 11:37:48.238559 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-74b7b57c65-d6v67"] Dec 04 11:37:48.252176 master-0 kubenswrapper[8993]: W1204 11:37:48.252104 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16057f9c_b1f8_4915_acc3_2d4532af4963.slice/crio-5c0e8a1ff66497ba460c926920322631645b0bfd118367bdd87314c14c19d316 WatchSource:0}: Error finding container 5c0e8a1ff66497ba460c926920322631645b0bfd118367bdd87314c14c19d316: Status 404 returned error can't find the container with id 5c0e8a1ff66497ba460c926920322631645b0bfd118367bdd87314c14c19d316 Dec 04 11:37:48.256552 master-0 kubenswrapper[8993]: I1204 11:37:48.256150 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:48.400013 master-0 kubenswrapper[8993]: I1204 11:37:48.399955 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:48.400013 master-0 kubenswrapper[8993]: I1204 11:37:48.400018 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:37:48.400361 master-0 kubenswrapper[8993]: E1204 11:37:48.400289 8993 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-operator-tls: secret "image-registry-operator-tls" not found Dec 04 11:37:48.400653 master-0 kubenswrapper[8993]: E1204 11:37:48.400410 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls podName:1ade9186-b262-4b5e-9c6f-ba89f0130fb6 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:50.400378705 +0000 UTC m=+4.791320318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "image-registry-operator-tls" (UniqueName: "kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls") pod "cluster-image-registry-operator-6fb9f88b7-tgvfl" (UID: "1ade9186-b262-4b5e-9c6f-ba89f0130fb6") : secret "image-registry-operator-tls" not found Dec 04 11:37:48.400653 master-0 kubenswrapper[8993]: I1204 11:37:48.400518 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:48.400653 master-0 kubenswrapper[8993]: E1204 11:37:48.400624 8993 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 11:37:48.400775 master-0 kubenswrapper[8993]: E1204 11:37:48.400699 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert podName:69640270-09e6-4217-b1c8-3d3465c0c3ae nodeName:}" failed. No retries permitted until 2025-12-04 11:37:50.400676935 +0000 UTC m=+4.791618548 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert") pod "cluster-version-operator-77dfcc565f-nqpsd" (UID: "69640270-09e6-4217-b1c8-3d3465c0c3ae") : secret "cluster-version-operator-serving-cert" not found Dec 04 11:37:48.400856 master-0 kubenswrapper[8993]: E1204 11:37:48.400820 8993 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/performance-addon-operator-webhook-cert: secret "performance-addon-operator-webhook-cert" not found Dec 04 11:37:48.401618 master-0 kubenswrapper[8993]: E1204 11:37:48.400896 8993 secret.go:189] Couldn't get secret openshift-dns-operator/metrics-tls: secret "metrics-tls" not found Dec 04 11:37:48.401618 master-0 kubenswrapper[8993]: I1204 11:37:48.400837 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:37:48.401618 master-0 kubenswrapper[8993]: E1204 11:37:48.400949 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert podName:6f15dcdb-c968-429c-9d1d-63c2becad337 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:50.400909283 +0000 UTC m=+4.791850896 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert") pod "cluster-node-tuning-operator-85cff47f46-4gv5j" (UID: "6f15dcdb-c968-429c-9d1d-63c2becad337") : secret "performance-addon-operator-webhook-cert" not found Dec 04 11:37:48.401618 master-0 kubenswrapper[8993]: E1204 11:37:48.400983 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls podName:7c017c69-b24e-4a7a-b888-133bed34c174 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:50.400967044 +0000 UTC m=+4.791908837 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls") pod "dns-operator-7c56cf9b74-xz27r" (UID: "7c017c69-b24e-4a7a-b888-133bed34c174") : secret "metrics-tls" not found Dec 04 11:37:48.401618 master-0 kubenswrapper[8993]: I1204 11:37:48.401076 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:48.401618 master-0 kubenswrapper[8993]: I1204 11:37:48.401120 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:48.401618 master-0 kubenswrapper[8993]: E1204 11:37:48.401365 8993 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Dec 04 11:37:48.401618 master-0 kubenswrapper[8993]: E1204 11:37:48.401395 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls podName:2ab26ae5-0607-4dfd-840e-531d204b5030 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:50.401386158 +0000 UTC m=+4.792327601 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-7ff994598c-p82nn" (UID: "2ab26ae5-0607-4dfd-840e-531d204b5030") : secret "cluster-monitoring-operator-tls" not found Dec 04 11:37:48.401618 master-0 kubenswrapper[8993]: E1204 11:37:48.401450 8993 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/node-tuning-operator-tls: secret "node-tuning-operator-tls" not found Dec 04 11:37:48.401618 master-0 kubenswrapper[8993]: E1204 11:37:48.401473 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls podName:6f15dcdb-c968-429c-9d1d-63c2becad337 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:50.401465211 +0000 UTC m=+4.792406864 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "node-tuning-operator-tls" (UniqueName: "kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls") pod "cluster-node-tuning-operator-85cff47f46-4gv5j" (UID: "6f15dcdb-c968-429c-9d1d-63c2becad337") : secret "node-tuning-operator-tls" not found Dec 04 11:37:48.409038 master-0 kubenswrapper[8993]: I1204 11:37:48.408956 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" Dec 04 11:37:48.471144 master-0 kubenswrapper[8993]: I1204 11:37:48.471064 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w2lss"] Dec 04 11:37:48.485287 master-0 kubenswrapper[8993]: W1204 11:37:48.485042 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3558de2_46f8_48b5_a961_95decb7805cf.slice/crio-86e405dadeb983de0c61fd791085ee3cc704ca6463b209f2814b958275b8c70d WatchSource:0}: Error finding container 86e405dadeb983de0c61fd791085ee3cc704ca6463b209f2814b958275b8c70d: Status 404 returned error can't find the container with id 86e405dadeb983de0c61fd791085ee3cc704ca6463b209f2814b958275b8c70d Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: I1204 11:37:48.502703 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-config\") pod \"controller-manager-59948648c9-krt4p\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: I1204 11:37:48.503621 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: I1204 11:37:48.503753 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: I1204 11:37:48.503845 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: I1204 11:37:48.503904 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: I1204 11:37:48.503981 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: I1204 11:37:48.504010 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: I1204 11:37:48.504050 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: E1204 11:37:48.507154 8993 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: E1204 11:37:48.507267 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs podName:d8fca733-45c8-45b8-8653-ac204e7c6098 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:50.507235307 +0000 UTC m=+4.898176740 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs") pod "network-metrics-daemon-gp57t" (UID: "d8fca733-45c8-45b8-8653-ac204e7c6098") : secret "metrics-daemon-secret" not found Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: E1204 11:37:48.507639 8993 secret.go:189] Couldn't get secret openshift-ingress-operator/metrics-tls: secret "metrics-tls" not found Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: E1204 11:37:48.507668 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls podName:b011b1f1-3235-4e20-825b-ce711c052407 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:50.50766049 +0000 UTC m=+4.898601923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls") pod "ingress-operator-8649c48786-cx2b2" (UID: "b011b1f1-3235-4e20-825b-ce711c052407") : secret "metrics-tls" not found Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: E1204 11:37:48.508564 8993 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/catalog-operator-serving-cert: secret "catalog-operator-serving-cert" not found Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: I1204 11:37:48.508610 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-config\") pod \"controller-manager-59948648c9-krt4p\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: E1204 11:37:48.508693 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert podName:434ed9b9-715b-455b-867c-775b256df40f nodeName:}" failed. No retries permitted until 2025-12-04 11:37:50.508670963 +0000 UTC m=+4.899612456 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert") pod "catalog-operator-fbc6455c4-5m8ll" (UID: "434ed9b9-715b-455b-867c-775b256df40f") : secret "catalog-operator-serving-cert" not found Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: E1204 11:37:48.508708 8993 secret.go:189] Couldn't get secret openshift-marketplace/marketplace-operator-metrics: secret "marketplace-operator-metrics" not found Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: E1204 11:37:48.508738 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics podName:fd4c4c6f-380a-4cda-9a21-352b55ec2d98 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:50.508729965 +0000 UTC m=+4.899671398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "marketplace-operator-metrics" (UniqueName: "kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics") pod "marketplace-operator-f797b99b6-hjjrk" (UID: "fd4c4c6f-380a-4cda-9a21-352b55ec2d98") : secret "marketplace-operator-metrics" not found Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: E1204 11:37:48.508785 8993 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/package-server-manager-serving-cert: secret "package-server-manager-serving-cert" not found Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: E1204 11:37:48.508826 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert podName:72faf6d6-e8ca-43d1-b93e-67c11f8d3b46 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:50.508799877 +0000 UTC m=+4.899741320 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "package-server-manager-serving-cert" (UniqueName: "kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert") pod "package-server-manager-67477646d4-7hndf" (UID: "72faf6d6-e8ca-43d1-b93e-67c11f8d3b46") : secret "package-server-manager-serving-cert" not found Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: E1204 11:37:48.508867 8993 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: secret "multus-admission-controller-secret" not found Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: E1204 11:37:48.508885 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs podName:08550069-c1a1-475e-84a2-e56905f1ed38 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:50.50887987 +0000 UTC m=+4.899821303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs") pod "multus-admission-controller-7dfc5b745f-258xq" (UID: "08550069-c1a1-475e-84a2-e56905f1ed38") : secret "multus-admission-controller-secret" not found Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: E1204 11:37:48.508922 8993 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/olm-operator-serving-cert: secret "olm-operator-serving-cert" not found Dec 04 11:37:48.509166 master-0 kubenswrapper[8993]: E1204 11:37:48.508941 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert podName:7bf67a51-9759-4e2a-a2ae-ef7416cad43f nodeName:}" failed. No retries permitted until 2025-12-04 11:37:50.508935712 +0000 UTC m=+4.899877145 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert") pod "olm-operator-7cd7dbb44c-vzj4q" (UID: "7bf67a51-9759-4e2a-a2ae-ef7416cad43f") : secret "olm-operator-serving-cert" not found Dec 04 11:37:48.604850 master-0 kubenswrapper[8993]: I1204 11:37:48.604781 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51337a75-bfa1-4cac-ab92-8b0b6e529c02-serving-cert\") pod \"controller-manager-59948648c9-krt4p\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:48.605048 master-0 kubenswrapper[8993]: I1204 11:37:48.604971 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-client-ca\") pod \"controller-manager-59948648c9-krt4p\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:48.605048 master-0 kubenswrapper[8993]: E1204 11:37:48.604992 8993 secret.go:189] Couldn't get secret openshift-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 11:37:48.605110 master-0 kubenswrapper[8993]: E1204 11:37:48.605088 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51337a75-bfa1-4cac-ab92-8b0b6e529c02-serving-cert podName:51337a75-bfa1-4cac-ab92-8b0b6e529c02 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:50.605065888 +0000 UTC m=+4.996007381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/51337a75-bfa1-4cac-ab92-8b0b6e529c02-serving-cert") pod "controller-manager-59948648c9-krt4p" (UID: "51337a75-bfa1-4cac-ab92-8b0b6e529c02") : secret "serving-cert" not found Dec 04 11:37:48.611557 master-0 kubenswrapper[8993]: E1204 11:37:48.605623 8993 configmap.go:193] Couldn't get configMap openshift-controller-manager/client-ca: configmap "client-ca" not found Dec 04 11:37:48.611557 master-0 kubenswrapper[8993]: E1204 11:37:48.605692 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-client-ca podName:51337a75-bfa1-4cac-ab92-8b0b6e529c02 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:50.605679118 +0000 UTC m=+4.996620561 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-client-ca") pod "controller-manager-59948648c9-krt4p" (UID: "51337a75-bfa1-4cac-ab92-8b0b6e529c02") : configmap "client-ca" not found Dec 04 11:37:48.683249 master-0 kubenswrapper[8993]: I1204 11:37:48.681499 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-77c99c46b8-6cntk"] Dec 04 11:37:48.706850 master-0 kubenswrapper[8993]: I1204 11:37:48.706403 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-serving-cert\") pod \"route-controller-manager-864c894b4d-xbpkz\" (UID: \"2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4\") " pod="openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz" Dec 04 11:37:48.706850 master-0 kubenswrapper[8993]: I1204 11:37:48.706515 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-client-ca\") pod \"route-controller-manager-864c894b4d-xbpkz\" (UID: \"2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4\") " pod="openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz" Dec 04 11:37:48.706850 master-0 kubenswrapper[8993]: I1204 11:37:48.706554 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-config\") pod \"route-controller-manager-864c894b4d-xbpkz\" (UID: \"2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4\") " pod="openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz" Dec 04 11:37:48.708054 master-0 kubenswrapper[8993]: E1204 11:37:48.707251 8993 secret.go:189] Couldn't get secret openshift-route-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 11:37:48.708054 master-0 kubenswrapper[8993]: E1204 11:37:48.707346 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-serving-cert podName:2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:50.707323482 +0000 UTC m=+5.098264915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-serving-cert") pod "route-controller-manager-864c894b4d-xbpkz" (UID: "2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4") : secret "serving-cert" not found Dec 04 11:37:48.708054 master-0 kubenswrapper[8993]: I1204 11:37:48.707497 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-config\") pod \"route-controller-manager-864c894b4d-xbpkz\" (UID: \"2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4\") " pod="openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz" Dec 04 11:37:48.708054 master-0 kubenswrapper[8993]: E1204 11:37:48.707568 8993 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/client-ca: configmap "client-ca" not found Dec 04 11:37:48.708054 master-0 kubenswrapper[8993]: E1204 11:37:48.707616 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-client-ca podName:2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:50.707598901 +0000 UTC m=+5.098540334 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-client-ca") pod "route-controller-manager-864c894b4d-xbpkz" (UID: "2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4") : configmap "client-ca" not found Dec 04 11:37:48.797938 master-0 kubenswrapper[8993]: W1204 11:37:48.797878 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1243d581_fa11_4db1_a01a_0cf64eb3ef74.slice/crio-786de756c2bbfc0e0c7e3711833e432deb88e55c1e571e200028809dee015dd2 WatchSource:0}: Error finding container 786de756c2bbfc0e0c7e3711833e432deb88e55c1e571e200028809dee015dd2: Status 404 returned error can't find the container with id 786de756c2bbfc0e0c7e3711833e432deb88e55c1e571e200028809dee015dd2 Dec 04 11:37:48.934277 master-0 kubenswrapper[8993]: I1204 11:37:48.934014 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" event={"ID":"38fc8086-a00c-4a2a-8a0e-c57e9d9d0103","Type":"ContainerStarted","Data":"bae7cb91a4042c94b674a12af151b5562dfcde35982f682375aba774df863de4"} Dec 04 11:37:48.941829 master-0 kubenswrapper[8993]: I1204 11:37:48.939071 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-74b7b57c65-d6v67" event={"ID":"16057f9c-b1f8-4915-acc3-2d4532af4963","Type":"ContainerStarted","Data":"5c0e8a1ff66497ba460c926920322631645b0bfd118367bdd87314c14c19d316"} Dec 04 11:37:48.951894 master-0 kubenswrapper[8993]: I1204 11:37:48.950233 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w2lss" event={"ID":"a3558de2-46f8-48b5-a961-95decb7805cf","Type":"ContainerStarted","Data":"edab431d5b587866095fc10361efd69a73f2970f9cff27628b745827d75deba9"} Dec 04 11:37:48.951894 master-0 kubenswrapper[8993]: I1204 11:37:48.950299 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w2lss" event={"ID":"a3558de2-46f8-48b5-a961-95decb7805cf","Type":"ContainerStarted","Data":"86e405dadeb983de0c61fd791085ee3cc704ca6463b209f2814b958275b8c70d"} Dec 04 11:37:48.955827 master-0 kubenswrapper[8993]: I1204 11:37:48.955458 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz" Dec 04 11:37:48.955945 master-0 kubenswrapper[8993]: I1204 11:37:48.955923 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" event={"ID":"1243d581-fa11-4db1-a01a-0cf64eb3ef74","Type":"ContainerStarted","Data":"786de756c2bbfc0e0c7e3711833e432deb88e55c1e571e200028809dee015dd2"} Dec 04 11:37:48.959932 master-0 kubenswrapper[8993]: I1204 11:37:48.957147 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:48.989377 master-0 kubenswrapper[8993]: I1204 11:37:48.989312 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz" Dec 04 11:37:49.001301 master-0 kubenswrapper[8993]: I1204 11:37:49.001165 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:49.110872 master-0 kubenswrapper[8993]: I1204 11:37:49.110787 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vgkr\" (UniqueName: \"kubernetes.io/projected/51337a75-bfa1-4cac-ab92-8b0b6e529c02-kube-api-access-6vgkr\") pod \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " Dec 04 11:37:49.110872 master-0 kubenswrapper[8993]: I1204 11:37:49.110870 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-config\") pod \"2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4\" (UID: \"2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4\") " Dec 04 11:37:49.111121 master-0 kubenswrapper[8993]: I1204 11:37:49.110902 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-config\") pod \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " Dec 04 11:37:49.111121 master-0 kubenswrapper[8993]: I1204 11:37:49.110946 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-proxy-ca-bundles\") pod \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\" (UID: \"51337a75-bfa1-4cac-ab92-8b0b6e529c02\") " Dec 04 11:37:49.111121 master-0 kubenswrapper[8993]: I1204 11:37:49.110981 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4p2dv\" (UniqueName: \"kubernetes.io/projected/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-kube-api-access-4p2dv\") pod \"2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4\" (UID: \"2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4\") " Dec 04 11:37:49.111846 master-0 kubenswrapper[8993]: I1204 11:37:49.111741 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "51337a75-bfa1-4cac-ab92-8b0b6e529c02" (UID: "51337a75-bfa1-4cac-ab92-8b0b6e529c02"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:37:49.111846 master-0 kubenswrapper[8993]: I1204 11:37:49.111762 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-config" (OuterVolumeSpecName: "config") pod "2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4" (UID: "2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:37:49.112122 master-0 kubenswrapper[8993]: I1204 11:37:49.112002 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-config" (OuterVolumeSpecName: "config") pod "51337a75-bfa1-4cac-ab92-8b0b6e529c02" (UID: "51337a75-bfa1-4cac-ab92-8b0b6e529c02"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:37:49.115188 master-0 kubenswrapper[8993]: I1204 11:37:49.115134 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-kube-api-access-4p2dv" (OuterVolumeSpecName: "kube-api-access-4p2dv") pod "2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4" (UID: "2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4"). InnerVolumeSpecName "kube-api-access-4p2dv". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:37:49.115277 master-0 kubenswrapper[8993]: I1204 11:37:49.115133 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51337a75-bfa1-4cac-ab92-8b0b6e529c02-kube-api-access-6vgkr" (OuterVolumeSpecName: "kube-api-access-6vgkr") pod "51337a75-bfa1-4cac-ab92-8b0b6e529c02" (UID: "51337a75-bfa1-4cac-ab92-8b0b6e529c02"). InnerVolumeSpecName "kube-api-access-6vgkr". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:37:49.213242 master-0 kubenswrapper[8993]: I1204 11:37:49.213123 8993 reconciler_common.go:293] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-proxy-ca-bundles\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:49.213242 master-0 kubenswrapper[8993]: I1204 11:37:49.213217 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4p2dv\" (UniqueName: \"kubernetes.io/projected/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-kube-api-access-4p2dv\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:49.213242 master-0 kubenswrapper[8993]: I1204 11:37:49.213243 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6vgkr\" (UniqueName: \"kubernetes.io/projected/51337a75-bfa1-4cac-ab92-8b0b6e529c02-kube-api-access-6vgkr\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:49.213502 master-0 kubenswrapper[8993]: I1204 11:37:49.213256 8993 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-config\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:49.213502 master-0 kubenswrapper[8993]: I1204 11:37:49.213270 8993 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-config\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:49.958845 master-0 kubenswrapper[8993]: I1204 11:37:49.958779 8993 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 11:37:49.959854 master-0 kubenswrapper[8993]: I1204 11:37:49.959502 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz" Dec 04 11:37:49.960770 master-0 kubenswrapper[8993]: I1204 11:37:49.960742 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-59948648c9-krt4p" Dec 04 11:37:49.981113 master-0 kubenswrapper[8993]: I1204 11:37:49.981052 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:49.999586 master-0 kubenswrapper[8993]: I1204 11:37:49.999543 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-59948648c9-krt4p"] Dec 04 11:37:50.000778 master-0 kubenswrapper[8993]: I1204 11:37:50.000761 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-5c6c4578c-plvql"] Dec 04 11:37:50.002368 master-0 kubenswrapper[8993]: I1204 11:37:50.002333 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:50.005023 master-0 kubenswrapper[8993]: I1204 11:37:50.004986 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"serving-cert" Dec 04 11:37:50.008311 master-0 kubenswrapper[8993]: I1204 11:37:50.008247 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:50.010675 master-0 kubenswrapper[8993]: I1204 11:37:50.010632 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"kube-root-ca.crt" Dec 04 11:37:50.010896 master-0 kubenswrapper[8993]: I1204 11:37:50.010851 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"client-ca" Dec 04 11:37:50.012117 master-0 kubenswrapper[8993]: I1204 11:37:50.011442 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"config" Dec 04 11:37:50.012117 master-0 kubenswrapper[8993]: I1204 11:37:50.011858 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-service-ca.crt" Dec 04 11:37:50.014767 master-0 kubenswrapper[8993]: I1204 11:37:50.014533 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-global-ca" Dec 04 11:37:50.015327 master-0 kubenswrapper[8993]: I1204 11:37:50.015294 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:50.015410 master-0 kubenswrapper[8993]: I1204 11:37:50.015337 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-controller-manager/controller-manager-59948648c9-krt4p"] Dec 04 11:37:50.017034 master-0 kubenswrapper[8993]: I1204 11:37:50.017009 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-5c6c4578c-plvql"] Dec 04 11:37:50.042056 master-0 kubenswrapper[8993]: I1204 11:37:50.041962 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz"] Dec 04 11:37:50.042657 master-0 kubenswrapper[8993]: I1204 11:37:50.042608 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-864c894b4d-xbpkz"] Dec 04 11:37:50.126507 master-0 kubenswrapper[8993]: I1204 11:37:50.126419 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/775079db-8c67-4d06-87fb-53ee469e8945-serving-cert\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:50.126703 master-0 kubenswrapper[8993]: I1204 11:37:50.126531 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-config\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:50.126867 master-0 kubenswrapper[8993]: I1204 11:37:50.126817 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2hbr\" (UniqueName: \"kubernetes.io/projected/775079db-8c67-4d06-87fb-53ee469e8945-kube-api-access-l2hbr\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:50.127033 master-0 kubenswrapper[8993]: I1204 11:37:50.126986 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-client-ca\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:50.127171 master-0 kubenswrapper[8993]: I1204 11:37:50.127149 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-proxy-ca-bundles\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:50.127872 master-0 kubenswrapper[8993]: I1204 11:37:50.127848 8993 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:50.127872 master-0 kubenswrapper[8993]: I1204 11:37:50.127868 8993 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/51337a75-bfa1-4cac-ab92-8b0b6e529c02-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:50.127971 master-0 kubenswrapper[8993]: I1204 11:37:50.127880 8993 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51337a75-bfa1-4cac-ab92-8b0b6e529c02-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:50.127971 master-0 kubenswrapper[8993]: I1204 11:37:50.127908 8993 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 11:37:50.141956 master-0 kubenswrapper[8993]: I1204 11:37:50.141206 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:50.228748 master-0 kubenswrapper[8993]: I1204 11:37:50.228650 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-client-ca\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:50.228993 master-0 kubenswrapper[8993]: E1204 11:37:50.228870 8993 configmap.go:193] Couldn't get configMap openshift-controller-manager/client-ca: configmap "client-ca" not found Dec 04 11:37:50.229029 master-0 kubenswrapper[8993]: E1204 11:37:50.229001 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-client-ca podName:775079db-8c67-4d06-87fb-53ee469e8945 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:50.72897296 +0000 UTC m=+5.119914393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-client-ca") pod "controller-manager-5c6c4578c-plvql" (UID: "775079db-8c67-4d06-87fb-53ee469e8945") : configmap "client-ca" not found Dec 04 11:37:50.229128 master-0 kubenswrapper[8993]: I1204 11:37:50.229085 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-proxy-ca-bundles\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:50.229613 master-0 kubenswrapper[8993]: I1204 11:37:50.229574 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/775079db-8c67-4d06-87fb-53ee469e8945-serving-cert\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:50.229663 master-0 kubenswrapper[8993]: I1204 11:37:50.229639 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-config\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:50.229738 master-0 kubenswrapper[8993]: I1204 11:37:50.229710 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l2hbr\" (UniqueName: \"kubernetes.io/projected/775079db-8c67-4d06-87fb-53ee469e8945-kube-api-access-l2hbr\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:50.230138 master-0 kubenswrapper[8993]: E1204 11:37:50.230103 8993 secret.go:189] Couldn't get secret openshift-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 11:37:50.230184 master-0 kubenswrapper[8993]: E1204 11:37:50.230168 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/775079db-8c67-4d06-87fb-53ee469e8945-serving-cert podName:775079db-8c67-4d06-87fb-53ee469e8945 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:50.730147618 +0000 UTC m=+5.121089051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/775079db-8c67-4d06-87fb-53ee469e8945-serving-cert") pod "controller-manager-5c6c4578c-plvql" (UID: "775079db-8c67-4d06-87fb-53ee469e8945") : secret "serving-cert" not found Dec 04 11:37:50.230664 master-0 kubenswrapper[8993]: I1204 11:37:50.230606 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-proxy-ca-bundles\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:50.231283 master-0 kubenswrapper[8993]: I1204 11:37:50.231252 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-config\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:50.252263 master-0 kubenswrapper[8993]: I1204 11:37:50.252183 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2hbr\" (UniqueName: \"kubernetes.io/projected/775079db-8c67-4d06-87fb-53ee469e8945-kube-api-access-l2hbr\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:50.432776 master-0 kubenswrapper[8993]: I1204 11:37:50.432556 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:50.432776 master-0 kubenswrapper[8993]: I1204 11:37:50.432674 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:37:50.432776 master-0 kubenswrapper[8993]: I1204 11:37:50.432701 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:50.432776 master-0 kubenswrapper[8993]: I1204 11:37:50.432745 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:37:50.432776 master-0 kubenswrapper[8993]: I1204 11:37:50.432775 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:50.433240 master-0 kubenswrapper[8993]: E1204 11:37:50.432786 8993 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-operator-tls: secret "image-registry-operator-tls" not found Dec 04 11:37:50.433240 master-0 kubenswrapper[8993]: E1204 11:37:50.432932 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls podName:1ade9186-b262-4b5e-9c6f-ba89f0130fb6 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:54.432899698 +0000 UTC m=+8.823841321 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "image-registry-operator-tls" (UniqueName: "kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls") pod "cluster-image-registry-operator-6fb9f88b7-tgvfl" (UID: "1ade9186-b262-4b5e-9c6f-ba89f0130fb6") : secret "image-registry-operator-tls" not found Dec 04 11:37:50.433240 master-0 kubenswrapper[8993]: E1204 11:37:50.432949 8993 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Dec 04 11:37:50.433240 master-0 kubenswrapper[8993]: E1204 11:37:50.433023 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls podName:2ab26ae5-0607-4dfd-840e-531d204b5030 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:54.432999991 +0000 UTC m=+8.823941614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-7ff994598c-p82nn" (UID: "2ab26ae5-0607-4dfd-840e-531d204b5030") : secret "cluster-monitoring-operator-tls" not found Dec 04 11:37:50.433240 master-0 kubenswrapper[8993]: E1204 11:37:50.433073 8993 secret.go:189] Couldn't get secret openshift-cluster-version/cluster-version-operator-serving-cert: secret "cluster-version-operator-serving-cert" not found Dec 04 11:37:50.433240 master-0 kubenswrapper[8993]: E1204 11:37:50.433096 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert podName:69640270-09e6-4217-b1c8-3d3465c0c3ae nodeName:}" failed. No retries permitted until 2025-12-04 11:37:54.433086784 +0000 UTC m=+8.824028437 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert") pod "cluster-version-operator-77dfcc565f-nqpsd" (UID: "69640270-09e6-4217-b1c8-3d3465c0c3ae") : secret "cluster-version-operator-serving-cert" not found Dec 04 11:37:50.433240 master-0 kubenswrapper[8993]: E1204 11:37:50.433137 8993 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/performance-addon-operator-webhook-cert: secret "performance-addon-operator-webhook-cert" not found Dec 04 11:37:50.433240 master-0 kubenswrapper[8993]: E1204 11:37:50.433162 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert podName:6f15dcdb-c968-429c-9d1d-63c2becad337 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:54.433149626 +0000 UTC m=+8.824091299 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert") pod "cluster-node-tuning-operator-85cff47f46-4gv5j" (UID: "6f15dcdb-c968-429c-9d1d-63c2becad337") : secret "performance-addon-operator-webhook-cert" not found Dec 04 11:37:50.433240 master-0 kubenswrapper[8993]: E1204 11:37:50.433204 8993 secret.go:189] Couldn't get secret openshift-dns-operator/metrics-tls: secret "metrics-tls" not found Dec 04 11:37:50.433240 master-0 kubenswrapper[8993]: E1204 11:37:50.433223 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls podName:7c017c69-b24e-4a7a-b888-133bed34c174 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:54.433216768 +0000 UTC m=+8.824158211 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls") pod "dns-operator-7c56cf9b74-xz27r" (UID: "7c017c69-b24e-4a7a-b888-133bed34c174") : secret "metrics-tls" not found Dec 04 11:37:50.433626 master-0 kubenswrapper[8993]: E1204 11:37:50.433259 8993 secret.go:189] Couldn't get secret openshift-cluster-node-tuning-operator/node-tuning-operator-tls: secret "node-tuning-operator-tls" not found Dec 04 11:37:50.433626 master-0 kubenswrapper[8993]: E1204 11:37:50.433281 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls podName:6f15dcdb-c968-429c-9d1d-63c2becad337 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:54.43327458 +0000 UTC m=+8.824216023 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "node-tuning-operator-tls" (UniqueName: "kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls") pod "cluster-node-tuning-operator-85cff47f46-4gv5j" (UID: "6f15dcdb-c968-429c-9d1d-63c2becad337") : secret "node-tuning-operator-tls" not found Dec 04 11:37:50.433626 master-0 kubenswrapper[8993]: I1204 11:37:50.432798 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:50.534723 master-0 kubenswrapper[8993]: I1204 11:37:50.534669 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:50.534979 master-0 kubenswrapper[8993]: I1204 11:37:50.534761 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:50.534979 master-0 kubenswrapper[8993]: I1204 11:37:50.534792 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:37:50.534979 master-0 kubenswrapper[8993]: E1204 11:37:50.534843 8993 secret.go:189] Couldn't get secret openshift-marketplace/marketplace-operator-metrics: secret "marketplace-operator-metrics" not found Dec 04 11:37:50.534979 master-0 kubenswrapper[8993]: E1204 11:37:50.534955 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics podName:fd4c4c6f-380a-4cda-9a21-352b55ec2d98 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:54.534933605 +0000 UTC m=+8.925875038 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "marketplace-operator-metrics" (UniqueName: "kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics") pod "marketplace-operator-f797b99b6-hjjrk" (UID: "fd4c4c6f-380a-4cda-9a21-352b55ec2d98") : secret "marketplace-operator-metrics" not found Dec 04 11:37:50.534979 master-0 kubenswrapper[8993]: E1204 11:37:50.534958 8993 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Dec 04 11:37:50.535160 master-0 kubenswrapper[8993]: E1204 11:37:50.534988 8993 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/package-server-manager-serving-cert: secret "package-server-manager-serving-cert" not found Dec 04 11:37:50.535160 master-0 kubenswrapper[8993]: E1204 11:37:50.534991 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs podName:d8fca733-45c8-45b8-8653-ac204e7c6098 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:54.534981526 +0000 UTC m=+8.925922959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs") pod "network-metrics-daemon-gp57t" (UID: "d8fca733-45c8-45b8-8653-ac204e7c6098") : secret "metrics-daemon-secret" not found Dec 04 11:37:50.535160 master-0 kubenswrapper[8993]: I1204 11:37:50.535068 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:50.535257 master-0 kubenswrapper[8993]: I1204 11:37:50.535154 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:37:50.535257 master-0 kubenswrapper[8993]: E1204 11:37:50.535174 8993 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/olm-operator-serving-cert: secret "olm-operator-serving-cert" not found Dec 04 11:37:50.535257 master-0 kubenswrapper[8993]: E1204 11:37:50.535200 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert podName:72faf6d6-e8ca-43d1-b93e-67c11f8d3b46 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:54.535183313 +0000 UTC m=+8.926124746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "package-server-manager-serving-cert" (UniqueName: "kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert") pod "package-server-manager-67477646d4-7hndf" (UID: "72faf6d6-e8ca-43d1-b93e-67c11f8d3b46") : secret "package-server-manager-serving-cert" not found Dec 04 11:37:50.535371 master-0 kubenswrapper[8993]: E1204 11:37:50.535247 8993 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: secret "multus-admission-controller-secret" not found Dec 04 11:37:50.535371 master-0 kubenswrapper[8993]: I1204 11:37:50.535263 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:50.535371 master-0 kubenswrapper[8993]: E1204 11:37:50.535314 8993 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/catalog-operator-serving-cert: secret "catalog-operator-serving-cert" not found Dec 04 11:37:50.535467 master-0 kubenswrapper[8993]: E1204 11:37:50.535383 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert podName:7bf67a51-9759-4e2a-a2ae-ef7416cad43f nodeName:}" failed. No retries permitted until 2025-12-04 11:37:54.535288766 +0000 UTC m=+8.926230199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert") pod "olm-operator-7cd7dbb44c-vzj4q" (UID: "7bf67a51-9759-4e2a-a2ae-ef7416cad43f") : secret "olm-operator-serving-cert" not found Dec 04 11:37:50.535506 master-0 kubenswrapper[8993]: E1204 11:37:50.535478 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs podName:08550069-c1a1-475e-84a2-e56905f1ed38 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:54.535442491 +0000 UTC m=+8.926383924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs") pod "multus-admission-controller-7dfc5b745f-258xq" (UID: "08550069-c1a1-475e-84a2-e56905f1ed38") : secret "multus-admission-controller-secret" not found Dec 04 11:37:50.535506 master-0 kubenswrapper[8993]: E1204 11:37:50.535497 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert podName:434ed9b9-715b-455b-867c-775b256df40f nodeName:}" failed. No retries permitted until 2025-12-04 11:37:54.535489923 +0000 UTC m=+8.926431356 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert") pod "catalog-operator-fbc6455c4-5m8ll" (UID: "434ed9b9-715b-455b-867c-775b256df40f") : secret "catalog-operator-serving-cert" not found Dec 04 11:37:50.535621 master-0 kubenswrapper[8993]: I1204 11:37:50.535572 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:50.535682 master-0 kubenswrapper[8993]: E1204 11:37:50.535664 8993 secret.go:189] Couldn't get secret openshift-ingress-operator/metrics-tls: secret "metrics-tls" not found Dec 04 11:37:50.535723 master-0 kubenswrapper[8993]: E1204 11:37:50.535712 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls podName:b011b1f1-3235-4e20-825b-ce711c052407 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:54.53570057 +0000 UTC m=+8.926642183 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls") pod "ingress-operator-8649c48786-cx2b2" (UID: "b011b1f1-3235-4e20-825b-ce711c052407") : secret "metrics-tls" not found Dec 04 11:37:50.738568 master-0 kubenswrapper[8993]: I1204 11:37:50.738378 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/775079db-8c67-4d06-87fb-53ee469e8945-serving-cert\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:50.738568 master-0 kubenswrapper[8993]: I1204 11:37:50.738508 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-client-ca\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:50.738900 master-0 kubenswrapper[8993]: E1204 11:37:50.738649 8993 configmap.go:193] Couldn't get configMap openshift-controller-manager/client-ca: configmap "client-ca" not found Dec 04 11:37:50.738900 master-0 kubenswrapper[8993]: E1204 11:37:50.738715 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-client-ca podName:775079db-8c67-4d06-87fb-53ee469e8945 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:51.738694277 +0000 UTC m=+6.129635710 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-client-ca") pod "controller-manager-5c6c4578c-plvql" (UID: "775079db-8c67-4d06-87fb-53ee469e8945") : configmap "client-ca" not found Dec 04 11:37:50.739016 master-0 kubenswrapper[8993]: E1204 11:37:50.738960 8993 secret.go:189] Couldn't get secret openshift-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 11:37:50.739158 master-0 kubenswrapper[8993]: E1204 11:37:50.739119 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/775079db-8c67-4d06-87fb-53ee469e8945-serving-cert podName:775079db-8c67-4d06-87fb-53ee469e8945 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:51.739058909 +0000 UTC m=+6.130000412 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/775079db-8c67-4d06-87fb-53ee469e8945-serving-cert") pod "controller-manager-5c6c4578c-plvql" (UID: "775079db-8c67-4d06-87fb-53ee469e8945") : secret "serving-cert" not found Dec 04 11:37:50.946368 master-0 kubenswrapper[8993]: I1204 11:37:50.946297 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:37:50.965335 master-0 kubenswrapper[8993]: I1204 11:37:50.965285 8993 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 11:37:50.965335 master-0 kubenswrapper[8993]: I1204 11:37:50.965329 8993 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 11:37:51.516281 master-0 kubenswrapper[8993]: I1204 11:37:51.516133 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:51.522835 master-0 kubenswrapper[8993]: I1204 11:37:51.522773 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" Dec 04 11:37:51.752045 master-0 kubenswrapper[8993]: I1204 11:37:51.751955 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/775079db-8c67-4d06-87fb-53ee469e8945-serving-cert\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:51.752411 master-0 kubenswrapper[8993]: E1204 11:37:51.752210 8993 secret.go:189] Couldn't get secret openshift-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 11:37:51.752411 master-0 kubenswrapper[8993]: E1204 11:37:51.752288 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/775079db-8c67-4d06-87fb-53ee469e8945-serving-cert podName:775079db-8c67-4d06-87fb-53ee469e8945 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:53.752265582 +0000 UTC m=+8.143207015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/775079db-8c67-4d06-87fb-53ee469e8945-serving-cert") pod "controller-manager-5c6c4578c-plvql" (UID: "775079db-8c67-4d06-87fb-53ee469e8945") : secret "serving-cert" not found Dec 04 11:37:51.752411 master-0 kubenswrapper[8993]: I1204 11:37:51.752352 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-client-ca\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:51.752613 master-0 kubenswrapper[8993]: E1204 11:37:51.752486 8993 configmap.go:193] Couldn't get configMap openshift-controller-manager/client-ca: configmap "client-ca" not found Dec 04 11:37:51.752613 master-0 kubenswrapper[8993]: E1204 11:37:51.752601 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-client-ca podName:775079db-8c67-4d06-87fb-53ee469e8945 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:53.752579292 +0000 UTC m=+8.143520725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-client-ca") pod "controller-manager-5c6c4578c-plvql" (UID: "775079db-8c67-4d06-87fb-53ee469e8945") : configmap "client-ca" not found Dec 04 11:37:51.800160 master-0 kubenswrapper[8993]: I1204 11:37:51.799927 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4" path="/var/lib/kubelet/pods/2fdd5ffb-6e41-4310-987e-f8df1b2ed0d4/volumes" Dec 04 11:37:51.800474 master-0 kubenswrapper[8993]: I1204 11:37:51.800390 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51337a75-bfa1-4cac-ab92-8b0b6e529c02" path="/var/lib/kubelet/pods/51337a75-bfa1-4cac-ab92-8b0b6e529c02/volumes" Dec 04 11:37:51.976115 master-0 kubenswrapper[8993]: I1204 11:37:51.976058 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bkmlp" event={"ID":"330553d2-40ea-4496-8346-2e5bf680669b","Type":"ContainerStarted","Data":"cae8d8cde749126fcbce8ff45106b92b6ebb6a2835b782d066d9a3ed581fa67c"} Dec 04 11:37:52.603214 master-0 kubenswrapper[8993]: I1204 11:37:52.602745 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:52.642308 master-0 kubenswrapper[8993]: I1204 11:37:52.642237 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6"] Dec 04 11:37:52.643056 master-0 kubenswrapper[8993]: I1204 11:37:52.643019 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:37:52.648437 master-0 kubenswrapper[8993]: I1204 11:37:52.648407 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"kube-root-ca.crt" Dec 04 11:37:52.648553 master-0 kubenswrapper[8993]: I1204 11:37:52.648502 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"client-ca" Dec 04 11:37:52.648677 master-0 kubenswrapper[8993]: I1204 11:37:52.648647 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"config" Dec 04 11:37:52.649612 master-0 kubenswrapper[8993]: I1204 11:37:52.649561 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"openshift-service-ca.crt" Dec 04 11:37:52.650452 master-0 kubenswrapper[8993]: I1204 11:37:52.650423 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Dec 04 11:37:52.653599 master-0 kubenswrapper[8993]: I1204 11:37:52.653508 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6"] Dec 04 11:37:52.766784 master-0 kubenswrapper[8993]: I1204 11:37:52.766713 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d934e427-6a74-48cf-987b-adda550c31b6-serving-cert\") pod \"route-controller-manager-5f845c897b-hhhv6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:37:52.767021 master-0 kubenswrapper[8993]: I1204 11:37:52.766854 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-config\") pod \"route-controller-manager-5f845c897b-hhhv6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:37:52.767021 master-0 kubenswrapper[8993]: I1204 11:37:52.766930 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2xvx\" (UniqueName: \"kubernetes.io/projected/d934e427-6a74-48cf-987b-adda550c31b6-kube-api-access-w2xvx\") pod \"route-controller-manager-5f845c897b-hhhv6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:37:52.767021 master-0 kubenswrapper[8993]: I1204 11:37:52.766954 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-client-ca\") pod \"route-controller-manager-5f845c897b-hhhv6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:37:52.868695 master-0 kubenswrapper[8993]: I1204 11:37:52.868508 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-config\") pod \"route-controller-manager-5f845c897b-hhhv6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:37:52.869007 master-0 kubenswrapper[8993]: I1204 11:37:52.868869 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w2xvx\" (UniqueName: \"kubernetes.io/projected/d934e427-6a74-48cf-987b-adda550c31b6-kube-api-access-w2xvx\") pod \"route-controller-manager-5f845c897b-hhhv6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:37:52.869007 master-0 kubenswrapper[8993]: I1204 11:37:52.868934 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-client-ca\") pod \"route-controller-manager-5f845c897b-hhhv6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:37:52.869501 master-0 kubenswrapper[8993]: E1204 11:37:52.869294 8993 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/client-ca: configmap "client-ca" not found Dec 04 11:37:52.869501 master-0 kubenswrapper[8993]: I1204 11:37:52.869335 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d934e427-6a74-48cf-987b-adda550c31b6-serving-cert\") pod \"route-controller-manager-5f845c897b-hhhv6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:37:52.869501 master-0 kubenswrapper[8993]: E1204 11:37:52.869382 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-client-ca podName:d934e427-6a74-48cf-987b-adda550c31b6 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:53.369363611 +0000 UTC m=+7.760305204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-client-ca") pod "route-controller-manager-5f845c897b-hhhv6" (UID: "d934e427-6a74-48cf-987b-adda550c31b6") : configmap "client-ca" not found Dec 04 11:37:52.869662 master-0 kubenswrapper[8993]: E1204 11:37:52.869591 8993 secret.go:189] Couldn't get secret openshift-route-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 11:37:52.869762 master-0 kubenswrapper[8993]: E1204 11:37:52.869742 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d934e427-6a74-48cf-987b-adda550c31b6-serving-cert podName:d934e427-6a74-48cf-987b-adda550c31b6 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:53.369716342 +0000 UTC m=+7.760657775 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/d934e427-6a74-48cf-987b-adda550c31b6-serving-cert") pod "route-controller-manager-5f845c897b-hhhv6" (UID: "d934e427-6a74-48cf-987b-adda550c31b6") : secret "serving-cert" not found Dec 04 11:37:52.870144 master-0 kubenswrapper[8993]: I1204 11:37:52.870105 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-config\") pod \"route-controller-manager-5f845c897b-hhhv6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:37:52.884834 master-0 kubenswrapper[8993]: I1204 11:37:52.884746 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:52.890419 master-0 kubenswrapper[8993]: I1204 11:37:52.890367 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:52.982217 master-0 kubenswrapper[8993]: I1204 11:37:52.982102 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-74b7b57c65-d6v67" event={"ID":"16057f9c-b1f8-4915-acc3-2d4532af4963","Type":"ContainerStarted","Data":"df2983400bf9e64cd4aa80222d1103237c6635ed8065dd95e72dedb49203b03f"} Dec 04 11:37:52.982217 master-0 kubenswrapper[8993]: I1204 11:37:52.982185 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-74b7b57c65-d6v67" event={"ID":"16057f9c-b1f8-4915-acc3-2d4532af4963","Type":"ContainerStarted","Data":"6aac1d02d082254f480b3398376d838c4c36e21403148dd18cf8225e41bce4b7"} Dec 04 11:37:52.984556 master-0 kubenswrapper[8993]: I1204 11:37:52.984504 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" event={"ID":"a5b826c3-8638-4cf5-b974-b24e4282ce00","Type":"ContainerStarted","Data":"ccce88b1ca2f9a134e692a16b1bcd6669f59f655145c0cf6017bc4ec59640741"} Dec 04 11:37:52.986876 master-0 kubenswrapper[8993]: I1204 11:37:52.986799 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" event={"ID":"00601c1a-efd4-4366-bdc9-d768afa252b0","Type":"ContainerStarted","Data":"f8eb928e51ec9bf13f9354409288ca080a3ee9211f423ab53973ca61d201ddbb"} Dec 04 11:37:52.987164 master-0 kubenswrapper[8993]: I1204 11:37:52.987121 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:37:52.989014 master-0 kubenswrapper[8993]: I1204 11:37:52.988981 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" event={"ID":"1243d581-fa11-4db1-a01a-0cf64eb3ef74","Type":"ContainerStarted","Data":"42bf9b312d3d677a209c2f4ed476e28aa24937e7036328cd0eb57e2a02bb1e2a"} Dec 04 11:37:52.991014 master-0 kubenswrapper[8993]: I1204 11:37:52.990976 8993 generic.go:334] "Generic (PLEG): container finished" podID="0158c2f3-20e5-43f4-875d-c5ad8f6112df" containerID="e06ff9d9a723c08c69bb4e160a236454da183658ecde2bd72b8d90a106d9f21e" exitCode=0 Dec 04 11:37:52.991112 master-0 kubenswrapper[8993]: I1204 11:37:52.991019 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" event={"ID":"0158c2f3-20e5-43f4-875d-c5ad8f6112df","Type":"ContainerDied","Data":"e06ff9d9a723c08c69bb4e160a236454da183658ecde2bd72b8d90a106d9f21e"} Dec 04 11:37:52.992774 master-0 kubenswrapper[8993]: I1204 11:37:52.992728 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" event={"ID":"38fc8086-a00c-4a2a-8a0e-c57e9d9d0103","Type":"ContainerStarted","Data":"8024196dc7d7114b2537f80438f2f5ad83a892cee7caa5f4d34fca2b46d86f82"} Dec 04 11:37:52.997342 master-0 kubenswrapper[8993]: I1204 11:37:52.997310 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:53.214709 master-0 kubenswrapper[8993]: I1204 11:37:53.214500 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2xvx\" (UniqueName: \"kubernetes.io/projected/d934e427-6a74-48cf-987b-adda550c31b6-kube-api-access-w2xvx\") pod \"route-controller-manager-5f845c897b-hhhv6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:37:53.377010 master-0 kubenswrapper[8993]: I1204 11:37:53.376941 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-client-ca\") pod \"route-controller-manager-5f845c897b-hhhv6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:37:53.377248 master-0 kubenswrapper[8993]: E1204 11:37:53.377145 8993 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/client-ca: configmap "client-ca" not found Dec 04 11:37:53.377295 master-0 kubenswrapper[8993]: E1204 11:37:53.377255 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-client-ca podName:d934e427-6a74-48cf-987b-adda550c31b6 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:54.377231679 +0000 UTC m=+8.768173142 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-client-ca") pod "route-controller-manager-5f845c897b-hhhv6" (UID: "d934e427-6a74-48cf-987b-adda550c31b6") : configmap "client-ca" not found Dec 04 11:37:53.377346 master-0 kubenswrapper[8993]: I1204 11:37:53.377285 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d934e427-6a74-48cf-987b-adda550c31b6-serving-cert\") pod \"route-controller-manager-5f845c897b-hhhv6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:37:53.377564 master-0 kubenswrapper[8993]: E1204 11:37:53.377467 8993 secret.go:189] Couldn't get secret openshift-route-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 11:37:53.377564 master-0 kubenswrapper[8993]: E1204 11:37:53.377548 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d934e427-6a74-48cf-987b-adda550c31b6-serving-cert podName:d934e427-6a74-48cf-987b-adda550c31b6 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:54.377537588 +0000 UTC m=+8.768479021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/d934e427-6a74-48cf-987b-adda550c31b6-serving-cert") pod "route-controller-manager-5f845c897b-hhhv6" (UID: "d934e427-6a74-48cf-987b-adda550c31b6") : secret "serving-cert" not found Dec 04 11:37:53.783885 master-0 kubenswrapper[8993]: I1204 11:37:53.783822 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-client-ca\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:53.784189 master-0 kubenswrapper[8993]: E1204 11:37:53.784012 8993 configmap.go:193] Couldn't get configMap openshift-controller-manager/client-ca: configmap "client-ca" not found Dec 04 11:37:53.784189 master-0 kubenswrapper[8993]: E1204 11:37:53.784102 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-client-ca podName:775079db-8c67-4d06-87fb-53ee469e8945 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:57.784074892 +0000 UTC m=+12.175016325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-client-ca") pod "controller-manager-5c6c4578c-plvql" (UID: "775079db-8c67-4d06-87fb-53ee469e8945") : configmap "client-ca" not found Dec 04 11:37:53.784409 master-0 kubenswrapper[8993]: I1204 11:37:53.784388 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/775079db-8c67-4d06-87fb-53ee469e8945-serving-cert\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:53.784580 master-0 kubenswrapper[8993]: E1204 11:37:53.784557 8993 secret.go:189] Couldn't get secret openshift-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 11:37:53.784628 master-0 kubenswrapper[8993]: E1204 11:37:53.784603 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/775079db-8c67-4d06-87fb-53ee469e8945-serving-cert podName:775079db-8c67-4d06-87fb-53ee469e8945 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:57.784593488 +0000 UTC m=+12.175534921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/775079db-8c67-4d06-87fb-53ee469e8945-serving-cert") pod "controller-manager-5c6c4578c-plvql" (UID: "775079db-8c67-4d06-87fb-53ee469e8945") : secret "serving-cert" not found Dec 04 11:37:54.393363 master-0 kubenswrapper[8993]: I1204 11:37:54.393315 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-client-ca\") pod \"route-controller-manager-5f845c897b-hhhv6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:37:54.394398 master-0 kubenswrapper[8993]: E1204 11:37:54.393475 8993 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/client-ca: configmap "client-ca" not found Dec 04 11:37:54.394474 master-0 kubenswrapper[8993]: E1204 11:37:54.394454 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-client-ca podName:d934e427-6a74-48cf-987b-adda550c31b6 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:56.39443211 +0000 UTC m=+10.785373543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-client-ca") pod "route-controller-manager-5f845c897b-hhhv6" (UID: "d934e427-6a74-48cf-987b-adda550c31b6") : configmap "client-ca" not found Dec 04 11:37:54.394551 master-0 kubenswrapper[8993]: I1204 11:37:54.394385 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d934e427-6a74-48cf-987b-adda550c31b6-serving-cert\") pod \"route-controller-manager-5f845c897b-hhhv6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:37:54.394773 master-0 kubenswrapper[8993]: E1204 11:37:54.394756 8993 secret.go:189] Couldn't get secret openshift-route-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 11:37:54.394907 master-0 kubenswrapper[8993]: E1204 11:37:54.394892 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d934e427-6a74-48cf-987b-adda550c31b6-serving-cert podName:d934e427-6a74-48cf-987b-adda550c31b6 nodeName:}" failed. No retries permitted until 2025-12-04 11:37:56.394879404 +0000 UTC m=+10.785820837 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/d934e427-6a74-48cf-987b-adda550c31b6-serving-cert") pod "route-controller-manager-5f845c897b-hhhv6" (UID: "d934e427-6a74-48cf-987b-adda550c31b6") : secret "serving-cert" not found Dec 04 11:37:54.495637 master-0 kubenswrapper[8993]: I1204 11:37:54.495561 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:54.495637 master-0 kubenswrapper[8993]: I1204 11:37:54.495626 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:37:54.496034 master-0 kubenswrapper[8993]: I1204 11:37:54.495877 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:37:54.496034 master-0 kubenswrapper[8993]: I1204 11:37:54.495915 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:37:54.496034 master-0 kubenswrapper[8993]: I1204 11:37:54.495938 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:54.496034 master-0 kubenswrapper[8993]: I1204 11:37:54.496003 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:37:54.496510 master-0 kubenswrapper[8993]: E1204 11:37:54.496179 8993 secret.go:189] Couldn't get secret openshift-dns-operator/metrics-tls: secret "metrics-tls" not found Dec 04 11:37:54.496510 master-0 kubenswrapper[8993]: E1204 11:37:54.496242 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls podName:7c017c69-b24e-4a7a-b888-133bed34c174 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:02.496222438 +0000 UTC m=+16.887163871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls") pod "dns-operator-7c56cf9b74-xz27r" (UID: "7c017c69-b24e-4a7a-b888-133bed34c174") : secret "metrics-tls" not found Dec 04 11:37:54.498314 master-0 kubenswrapper[8993]: E1204 11:37:54.496634 8993 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Dec 04 11:37:54.498314 master-0 kubenswrapper[8993]: E1204 11:37:54.496667 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls podName:2ab26ae5-0607-4dfd-840e-531d204b5030 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:02.496660653 +0000 UTC m=+16.887602086 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-7ff994598c-p82nn" (UID: "2ab26ae5-0607-4dfd-840e-531d204b5030") : secret "cluster-monitoring-operator-tls" not found Dec 04 11:37:54.498314 master-0 kubenswrapper[8993]: E1204 11:37:54.496781 8993 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-operator-tls: secret "image-registry-operator-tls" not found Dec 04 11:37:54.498314 master-0 kubenswrapper[8993]: E1204 11:37:54.496929 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls podName:1ade9186-b262-4b5e-9c6f-ba89f0130fb6 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:02.49690236 +0000 UTC m=+16.887843974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "image-registry-operator-tls" (UniqueName: "kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls") pod "cluster-image-registry-operator-6fb9f88b7-tgvfl" (UID: "1ade9186-b262-4b5e-9c6f-ba89f0130fb6") : secret "image-registry-operator-tls" not found Dec 04 11:37:54.500741 master-0 kubenswrapper[8993]: I1204 11:37:54.500688 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert\") pod \"cluster-version-operator-77dfcc565f-nqpsd\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:37:54.501525 master-0 kubenswrapper[8993]: I1204 11:37:54.501482 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:54.501591 master-0 kubenswrapper[8993]: I1204 11:37:54.501495 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:54.538679 master-0 kubenswrapper[8993]: I1204 11:37:54.538601 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:37:54.541018 master-0 kubenswrapper[8993]: I1204 11:37:54.539796 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:37:54.568106 master-0 kubenswrapper[8993]: W1204 11:37:54.568024 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69640270_09e6_4217_b1c8_3d3465c0c3ae.slice/crio-8a30f468c810c7517b6d7ce7be8593935cc7f7e8c940f4af8bd6dfdbb4ab9d60 WatchSource:0}: Error finding container 8a30f468c810c7517b6d7ce7be8593935cc7f7e8c940f4af8bd6dfdbb4ab9d60: Status 404 returned error can't find the container with id 8a30f468c810c7517b6d7ce7be8593935cc7f7e8c940f4af8bd6dfdbb4ab9d60 Dec 04 11:37:54.597548 master-0 kubenswrapper[8993]: I1204 11:37:54.597491 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:37:54.597936 master-0 kubenswrapper[8993]: E1204 11:37:54.597706 8993 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/olm-operator-serving-cert: secret "olm-operator-serving-cert" not found Dec 04 11:37:54.597936 master-0 kubenswrapper[8993]: I1204 11:37:54.597782 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:37:54.597936 master-0 kubenswrapper[8993]: E1204 11:37:54.597831 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert podName:7bf67a51-9759-4e2a-a2ae-ef7416cad43f nodeName:}" failed. No retries permitted until 2025-12-04 11:38:02.59778901 +0000 UTC m=+16.988730443 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert") pod "olm-operator-7cd7dbb44c-vzj4q" (UID: "7bf67a51-9759-4e2a-a2ae-ef7416cad43f") : secret "olm-operator-serving-cert" not found Dec 04 11:37:54.597936 master-0 kubenswrapper[8993]: I1204 11:37:54.597907 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:37:54.597936 master-0 kubenswrapper[8993]: E1204 11:37:54.597926 8993 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: secret "multus-admission-controller-secret" not found Dec 04 11:37:54.597936 master-0 kubenswrapper[8993]: E1204 11:37:54.597960 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs podName:08550069-c1a1-475e-84a2-e56905f1ed38 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:02.597952095 +0000 UTC m=+16.988893528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs") pod "multus-admission-controller-7dfc5b745f-258xq" (UID: "08550069-c1a1-475e-84a2-e56905f1ed38") : secret "multus-admission-controller-secret" not found Dec 04 11:37:54.597936 master-0 kubenswrapper[8993]: I1204 11:37:54.598009 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:37:54.601774 master-0 kubenswrapper[8993]: I1204 11:37:54.598050 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:37:54.601774 master-0 kubenswrapper[8993]: I1204 11:37:54.598096 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:37:54.601774 master-0 kubenswrapper[8993]: E1204 11:37:54.598042 8993 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/catalog-operator-serving-cert: secret "catalog-operator-serving-cert" not found Dec 04 11:37:54.601774 master-0 kubenswrapper[8993]: I1204 11:37:54.598157 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:37:54.601774 master-0 kubenswrapper[8993]: E1204 11:37:54.598186 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert podName:434ed9b9-715b-455b-867c-775b256df40f nodeName:}" failed. No retries permitted until 2025-12-04 11:38:02.598175911 +0000 UTC m=+16.989117344 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert") pod "catalog-operator-fbc6455c4-5m8ll" (UID: "434ed9b9-715b-455b-867c-775b256df40f") : secret "catalog-operator-serving-cert" not found Dec 04 11:37:54.601774 master-0 kubenswrapper[8993]: E1204 11:37:54.598298 8993 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Dec 04 11:37:54.601774 master-0 kubenswrapper[8993]: E1204 11:37:54.598327 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs podName:d8fca733-45c8-45b8-8653-ac204e7c6098 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:02.598318856 +0000 UTC m=+16.989260289 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs") pod "network-metrics-daemon-gp57t" (UID: "d8fca733-45c8-45b8-8653-ac204e7c6098") : secret "metrics-daemon-secret" not found Dec 04 11:37:54.601774 master-0 kubenswrapper[8993]: E1204 11:37:54.598394 8993 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/package-server-manager-serving-cert: secret "package-server-manager-serving-cert" not found Dec 04 11:37:54.601774 master-0 kubenswrapper[8993]: E1204 11:37:54.598434 8993 secret.go:189] Couldn't get secret openshift-marketplace/marketplace-operator-metrics: secret "marketplace-operator-metrics" not found Dec 04 11:37:54.601774 master-0 kubenswrapper[8993]: E1204 11:37:54.598532 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert podName:72faf6d6-e8ca-43d1-b93e-67c11f8d3b46 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:02.598463371 +0000 UTC m=+16.989404864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "package-server-manager-serving-cert" (UniqueName: "kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert") pod "package-server-manager-67477646d4-7hndf" (UID: "72faf6d6-e8ca-43d1-b93e-67c11f8d3b46") : secret "package-server-manager-serving-cert" not found Dec 04 11:37:54.601774 master-0 kubenswrapper[8993]: E1204 11:37:54.598555 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics podName:fd4c4c6f-380a-4cda-9a21-352b55ec2d98 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:02.598546493 +0000 UTC m=+16.989488026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "marketplace-operator-metrics" (UniqueName: "kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics") pod "marketplace-operator-f797b99b6-hjjrk" (UID: "fd4c4c6f-380a-4cda-9a21-352b55ec2d98") : secret "marketplace-operator-metrics" not found Dec 04 11:37:54.601774 master-0 kubenswrapper[8993]: E1204 11:37:54.598583 8993 secret.go:189] Couldn't get secret openshift-ingress-operator/metrics-tls: secret "metrics-tls" not found Dec 04 11:37:54.601774 master-0 kubenswrapper[8993]: E1204 11:37:54.598610 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls podName:b011b1f1-3235-4e20-825b-ce711c052407 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:02.598600635 +0000 UTC m=+16.989542158 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls") pod "ingress-operator-8649c48786-cx2b2" (UID: "b011b1f1-3235-4e20-825b-ce711c052407") : secret "metrics-tls" not found Dec 04 11:37:54.768295 master-0 kubenswrapper[8993]: I1204 11:37:54.767973 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" podStartSLOduration=7.767949973 podStartE2EDuration="7.767949973s" podCreationTimestamp="2025-12-04 11:37:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:37:53.358395153 +0000 UTC m=+7.749336586" watchObservedRunningTime="2025-12-04 11:37:54.767949973 +0000 UTC m=+9.158891406" Dec 04 11:37:54.772257 master-0 kubenswrapper[8993]: I1204 11:37:54.772205 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j"] Dec 04 11:37:55.001680 master-0 kubenswrapper[8993]: I1204 11:37:55.000724 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" event={"ID":"69640270-09e6-4217-b1c8-3d3465c0c3ae","Type":"ContainerStarted","Data":"8a30f468c810c7517b6d7ce7be8593935cc7f7e8c940f4af8bd6dfdbb4ab9d60"} Dec 04 11:37:55.813687 master-0 kubenswrapper[8993]: I1204 11:37:55.813618 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:55.820502 master-0 kubenswrapper[8993]: I1204 11:37:55.820427 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:56.009859 master-0 kubenswrapper[8993]: I1204 11:37:56.009682 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" event={"ID":"0158c2f3-20e5-43f4-875d-c5ad8f6112df","Type":"ContainerStarted","Data":"a126ca57c03b18fb6fa405d36e189ab201f4700a3aff868c2ddd170df50ee89e"} Dec 04 11:37:56.013201 master-0 kubenswrapper[8993]: I1204 11:37:56.012705 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" event={"ID":"6f15dcdb-c968-429c-9d1d-63c2becad337","Type":"ContainerStarted","Data":"43dcc9c0ef931e3436340e17ac24b9225ef01b32e75d1a2065a16822407e5048"} Dec 04 11:37:56.018288 master-0 kubenswrapper[8993]: I1204 11:37:56.018215 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:37:56.360939 master-0 kubenswrapper[8993]: I1204 11:37:56.360528 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:37:56.425971 master-0 kubenswrapper[8993]: I1204 11:37:56.425212 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d934e427-6a74-48cf-987b-adda550c31b6-serving-cert\") pod \"route-controller-manager-5f845c897b-hhhv6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:37:56.425971 master-0 kubenswrapper[8993]: E1204 11:37:56.425497 8993 secret.go:189] Couldn't get secret openshift-route-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 11:37:56.425971 master-0 kubenswrapper[8993]: E1204 11:37:56.425603 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d934e427-6a74-48cf-987b-adda550c31b6-serving-cert podName:d934e427-6a74-48cf-987b-adda550c31b6 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:00.425581279 +0000 UTC m=+14.816522712 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/d934e427-6a74-48cf-987b-adda550c31b6-serving-cert") pod "route-controller-manager-5f845c897b-hhhv6" (UID: "d934e427-6a74-48cf-987b-adda550c31b6") : secret "serving-cert" not found Dec 04 11:37:56.425971 master-0 kubenswrapper[8993]: I1204 11:37:56.425593 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-client-ca\") pod \"route-controller-manager-5f845c897b-hhhv6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:37:56.425971 master-0 kubenswrapper[8993]: E1204 11:37:56.425793 8993 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/client-ca: configmap "client-ca" not found Dec 04 11:37:56.425971 master-0 kubenswrapper[8993]: E1204 11:37:56.425915 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-client-ca podName:d934e427-6a74-48cf-987b-adda550c31b6 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:00.425891019 +0000 UTC m=+14.816832612 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-client-ca") pod "route-controller-manager-5f845c897b-hhhv6" (UID: "d934e427-6a74-48cf-987b-adda550c31b6") : configmap "client-ca" not found Dec 04 11:37:57.017952 master-0 kubenswrapper[8993]: I1204 11:37:57.017900 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-olm-operator_cluster-olm-operator-56fcb6cc5f-4xwp2_0158c2f3-20e5-43f4-875d-c5ad8f6112df/cluster-olm-operator/0.log" Dec 04 11:37:57.018928 master-0 kubenswrapper[8993]: I1204 11:37:57.018836 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" event={"ID":"0158c2f3-20e5-43f4-875d-c5ad8f6112df","Type":"ContainerDied","Data":"a126ca57c03b18fb6fa405d36e189ab201f4700a3aff868c2ddd170df50ee89e"} Dec 04 11:37:57.019287 master-0 kubenswrapper[8993]: I1204 11:37:57.019257 8993 scope.go:117] "RemoveContainer" containerID="a126ca57c03b18fb6fa405d36e189ab201f4700a3aff868c2ddd170df50ee89e" Dec 04 11:37:57.019601 master-0 kubenswrapper[8993]: I1204 11:37:57.019551 8993 generic.go:334] "Generic (PLEG): container finished" podID="0158c2f3-20e5-43f4-875d-c5ad8f6112df" containerID="a126ca57c03b18fb6fa405d36e189ab201f4700a3aff868c2ddd170df50ee89e" exitCode=255 Dec 04 11:37:57.726386 master-0 kubenswrapper[8993]: I1204 11:37:57.726317 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:57.726595 master-0 kubenswrapper[8993]: I1204 11:37:57.726552 8993 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 11:37:57.726595 master-0 kubenswrapper[8993]: I1204 11:37:57.726562 8993 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 11:37:57.753212 master-0 kubenswrapper[8993]: I1204 11:37:57.753174 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:37:57.845015 master-0 kubenswrapper[8993]: I1204 11:37:57.844926 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-client-ca\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:57.845283 master-0 kubenswrapper[8993]: E1204 11:37:57.845195 8993 configmap.go:193] Couldn't get configMap openshift-controller-manager/client-ca: configmap "client-ca" not found Dec 04 11:37:57.845550 master-0 kubenswrapper[8993]: E1204 11:37:57.845316 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-client-ca podName:775079db-8c67-4d06-87fb-53ee469e8945 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:05.845289594 +0000 UTC m=+20.236231027 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-client-ca") pod "controller-manager-5c6c4578c-plvql" (UID: "775079db-8c67-4d06-87fb-53ee469e8945") : configmap "client-ca" not found Dec 04 11:37:57.845550 master-0 kubenswrapper[8993]: I1204 11:37:57.845452 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/775079db-8c67-4d06-87fb-53ee469e8945-serving-cert\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:57.855434 master-0 kubenswrapper[8993]: I1204 11:37:57.854755 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/775079db-8c67-4d06-87fb-53ee469e8945-serving-cert\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:37:58.028230 master-0 kubenswrapper[8993]: I1204 11:37:58.028041 8993 generic.go:334] "Generic (PLEG): container finished" podID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerID="f8eb928e51ec9bf13f9354409288ca080a3ee9211f423ab53973ca61d201ddbb" exitCode=0 Dec 04 11:37:58.028230 master-0 kubenswrapper[8993]: I1204 11:37:58.028135 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" event={"ID":"00601c1a-efd4-4366-bdc9-d768afa252b0","Type":"ContainerDied","Data":"f8eb928e51ec9bf13f9354409288ca080a3ee9211f423ab53973ca61d201ddbb"} Dec 04 11:37:58.028765 master-0 kubenswrapper[8993]: I1204 11:37:58.028607 8993 scope.go:117] "RemoveContainer" containerID="f8eb928e51ec9bf13f9354409288ca080a3ee9211f423ab53973ca61d201ddbb" Dec 04 11:37:58.036313 master-0 kubenswrapper[8993]: I1204 11:37:58.036277 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-olm-operator_cluster-olm-operator-56fcb6cc5f-4xwp2_0158c2f3-20e5-43f4-875d-c5ad8f6112df/cluster-olm-operator/0.log" Dec 04 11:37:58.043281 master-0 kubenswrapper[8993]: I1204 11:37:58.043235 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" event={"ID":"0158c2f3-20e5-43f4-875d-c5ad8f6112df","Type":"ContainerStarted","Data":"db80abb8e4c0e90fdd2ce38c6760862b2f66436f0df8b6e38dd7af704d246cce"} Dec 04 11:37:58.047674 master-0 kubenswrapper[8993]: I1204 11:37:58.047621 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" event={"ID":"69640270-09e6-4217-b1c8-3d3465c0c3ae","Type":"ContainerStarted","Data":"72267672c37ea5ea5121bfc6098f5ca0a616e150a2f0b617b4e3f39d2cb68626"} Dec 04 11:37:58.047775 master-0 kubenswrapper[8993]: I1204 11:37:58.047714 8993 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 11:37:59.056049 master-0 kubenswrapper[8993]: I1204 11:37:59.055917 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" event={"ID":"00601c1a-efd4-4366-bdc9-d768afa252b0","Type":"ContainerStarted","Data":"456f267c13077df8fde873615eb32f2c8011d7876410ffb6709899a5fdee25ce"} Dec 04 11:37:59.061270 master-0 kubenswrapper[8993]: I1204 11:37:59.056607 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:38:00.493834 master-0 kubenswrapper[8993]: I1204 11:38:00.492018 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-client-ca\") pod \"route-controller-manager-5f845c897b-hhhv6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:38:00.493834 master-0 kubenswrapper[8993]: E1204 11:38:00.492227 8993 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/client-ca: configmap "client-ca" not found Dec 04 11:38:00.493834 master-0 kubenswrapper[8993]: E1204 11:38:00.492474 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-client-ca podName:d934e427-6a74-48cf-987b-adda550c31b6 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:08.492421211 +0000 UTC m=+22.883362804 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-client-ca") pod "route-controller-manager-5f845c897b-hhhv6" (UID: "d934e427-6a74-48cf-987b-adda550c31b6") : configmap "client-ca" not found Dec 04 11:38:00.493834 master-0 kubenswrapper[8993]: I1204 11:38:00.492627 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d934e427-6a74-48cf-987b-adda550c31b6-serving-cert\") pod \"route-controller-manager-5f845c897b-hhhv6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:38:00.493834 master-0 kubenswrapper[8993]: E1204 11:38:00.492832 8993 secret.go:189] Couldn't get secret openshift-route-controller-manager/serving-cert: secret "serving-cert" not found Dec 04 11:38:00.493834 master-0 kubenswrapper[8993]: E1204 11:38:00.492897 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d934e427-6a74-48cf-987b-adda550c31b6-serving-cert podName:d934e427-6a74-48cf-987b-adda550c31b6 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:08.492887206 +0000 UTC m=+22.883828839 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/d934e427-6a74-48cf-987b-adda550c31b6-serving-cert") pod "route-controller-manager-5f845c897b-hhhv6" (UID: "d934e427-6a74-48cf-987b-adda550c31b6") : secret "serving-cert" not found Dec 04 11:38:01.593846 master-0 kubenswrapper[8993]: I1204 11:38:01.592205 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-dp5s8"] Dec 04 11:38:01.593846 master-0 kubenswrapper[8993]: I1204 11:38:01.593493 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.708286 master-0 kubenswrapper[8993]: I1204 11:38:01.708216 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-sysconfig\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.708286 master-0 kubenswrapper[8993]: I1204 11:38:01.708262 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-sysctl-d\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.708286 master-0 kubenswrapper[8993]: I1204 11:38:01.708282 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-run\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.708669 master-0 kubenswrapper[8993]: I1204 11:38:01.708342 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-kubernetes\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.708669 master-0 kubenswrapper[8993]: I1204 11:38:01.708410 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-sysctl-conf\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.708669 master-0 kubenswrapper[8993]: I1204 11:38:01.708431 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c91e6234-52c5-41c0-a1ff-6a92932b83cd-tmp\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.708669 master-0 kubenswrapper[8993]: I1204 11:38:01.708461 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-systemd\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.708669 master-0 kubenswrapper[8993]: I1204 11:38:01.708491 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-var-lib-kubelet\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.708669 master-0 kubenswrapper[8993]: I1204 11:38:01.708534 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-lib-modules\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.708669 master-0 kubenswrapper[8993]: I1204 11:38:01.708549 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-modprobe-d\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.708669 master-0 kubenswrapper[8993]: I1204 11:38:01.708565 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-host\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.708669 master-0 kubenswrapper[8993]: I1204 11:38:01.708582 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-tuned\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.708669 master-0 kubenswrapper[8993]: I1204 11:38:01.708598 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-sys\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.708669 master-0 kubenswrapper[8993]: I1204 11:38:01.708633 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc244\" (UniqueName: \"kubernetes.io/projected/c91e6234-52c5-41c0-a1ff-6a92932b83cd-kube-api-access-rc244\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.810420 master-0 kubenswrapper[8993]: I1204 11:38:01.810328 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rc244\" (UniqueName: \"kubernetes.io/projected/c91e6234-52c5-41c0-a1ff-6a92932b83cd-kube-api-access-rc244\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.810765 master-0 kubenswrapper[8993]: I1204 11:38:01.810703 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-sysconfig\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.810856 master-0 kubenswrapper[8993]: I1204 11:38:01.810780 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-sysctl-d\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.810993 master-0 kubenswrapper[8993]: I1204 11:38:01.810926 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-sysconfig\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.811049 master-0 kubenswrapper[8993]: I1204 11:38:01.810998 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-run\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.811084 master-0 kubenswrapper[8993]: I1204 11:38:01.811064 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-kubernetes\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.811137 master-0 kubenswrapper[8993]: I1204 11:38:01.811113 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-sysctl-conf\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.811177 master-0 kubenswrapper[8993]: I1204 11:38:01.811144 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c91e6234-52c5-41c0-a1ff-6a92932b83cd-tmp\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.811232 master-0 kubenswrapper[8993]: I1204 11:38:01.811207 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-systemd\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.811635 master-0 kubenswrapper[8993]: I1204 11:38:01.811607 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-sysctl-conf\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.811684 master-0 kubenswrapper[8993]: I1204 11:38:01.811659 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-systemd\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.811777 master-0 kubenswrapper[8993]: I1204 11:38:01.811736 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-run\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.811954 master-0 kubenswrapper[8993]: I1204 11:38:01.811774 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-kubernetes\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.812097 master-0 kubenswrapper[8993]: I1204 11:38:01.812077 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-sysctl-d\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.812240 master-0 kubenswrapper[8993]: I1204 11:38:01.812224 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-var-lib-kubelet\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.812333 master-0 kubenswrapper[8993]: I1204 11:38:01.812321 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-lib-modules\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.812513 master-0 kubenswrapper[8993]: I1204 11:38:01.812464 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-var-lib-kubelet\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.812599 master-0 kubenswrapper[8993]: I1204 11:38:01.812512 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-modprobe-d\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.812599 master-0 kubenswrapper[8993]: I1204 11:38:01.812564 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-host\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.812679 master-0 kubenswrapper[8993]: I1204 11:38:01.812604 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-tuned\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.812679 master-0 kubenswrapper[8993]: I1204 11:38:01.812645 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-sys\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.812921 master-0 kubenswrapper[8993]: I1204 11:38:01.812861 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-sys\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.812921 master-0 kubenswrapper[8993]: I1204 11:38:01.812843 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-modprobe-d\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.812921 master-0 kubenswrapper[8993]: I1204 11:38:01.812872 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-lib-modules\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.813209 master-0 kubenswrapper[8993]: I1204 11:38:01.813185 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-host\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.817476 master-0 kubenswrapper[8993]: I1204 11:38:01.817437 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-tuned\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.817560 master-0 kubenswrapper[8993]: I1204 11:38:01.817482 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c91e6234-52c5-41c0-a1ff-6a92932b83cd-tmp\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.827417 master-0 kubenswrapper[8993]: I1204 11:38:01.827374 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc244\" (UniqueName: \"kubernetes.io/projected/c91e6234-52c5-41c0-a1ff-6a92932b83cd-kube-api-access-rc244\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:01.914250 master-0 kubenswrapper[8993]: I1204 11:38:01.914113 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:38:02.071674 master-0 kubenswrapper[8993]: I1204 11:38:02.071635 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" event={"ID":"c91e6234-52c5-41c0-a1ff-6a92932b83cd","Type":"ContainerStarted","Data":"54b0fde896c3b634b8d8c973707b46fec6d1d513bb3b0b8d06d7d9097ccc4530"} Dec 04 11:38:02.073906 master-0 kubenswrapper[8993]: I1204 11:38:02.073886 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" event={"ID":"6f15dcdb-c968-429c-9d1d-63c2becad337","Type":"ContainerStarted","Data":"d6c550a785a1145fdc343107de5010ef2c2358de520cd277331cd0afa9b20bdf"} Dec 04 11:38:02.361138 master-0 kubenswrapper[8993]: I1204 11:38:02.360751 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:38:02.521176 master-0 kubenswrapper[8993]: I1204 11:38:02.521132 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:38:02.521472 master-0 kubenswrapper[8993]: I1204 11:38:02.521452 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:38:02.521687 master-0 kubenswrapper[8993]: I1204 11:38:02.521668 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:38:02.521786 master-0 kubenswrapper[8993]: E1204 11:38:02.521753 8993 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Dec 04 11:38:02.521867 master-0 kubenswrapper[8993]: E1204 11:38:02.521846 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls podName:2ab26ae5-0607-4dfd-840e-531d204b5030 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:18.521799672 +0000 UTC m=+32.912741105 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-7ff994598c-p82nn" (UID: "2ab26ae5-0607-4dfd-840e-531d204b5030") : secret "cluster-monitoring-operator-tls" not found Dec 04 11:38:02.527636 master-0 kubenswrapper[8993]: I1204 11:38:02.527604 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:38:02.529127 master-0 kubenswrapper[8993]: I1204 11:38:02.529074 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:38:02.623014 master-0 kubenswrapper[8993]: I1204 11:38:02.622886 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:38:02.623673 master-0 kubenswrapper[8993]: I1204 11:38:02.623655 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:38:02.623861 master-0 kubenswrapper[8993]: E1204 11:38:02.623103 8993 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/catalog-operator-serving-cert: secret "catalog-operator-serving-cert" not found Dec 04 11:38:02.623993 master-0 kubenswrapper[8993]: I1204 11:38:02.623969 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:38:02.624074 master-0 kubenswrapper[8993]: E1204 11:38:02.623967 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert podName:434ed9b9-715b-455b-867c-775b256df40f nodeName:}" failed. No retries permitted until 2025-12-04 11:38:18.623927112 +0000 UTC m=+33.014868605 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert") pod "catalog-operator-fbc6455c4-5m8ll" (UID: "434ed9b9-715b-455b-867c-775b256df40f") : secret "catalog-operator-serving-cert" not found Dec 04 11:38:02.624172 master-0 kubenswrapper[8993]: I1204 11:38:02.624158 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:38:02.624270 master-0 kubenswrapper[8993]: I1204 11:38:02.624253 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:38:02.624412 master-0 kubenswrapper[8993]: I1204 11:38:02.624390 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:38:02.624561 master-0 kubenswrapper[8993]: E1204 11:38:02.624175 8993 secret.go:189] Couldn't get secret openshift-marketplace/marketplace-operator-metrics: secret "marketplace-operator-metrics" not found Dec 04 11:38:02.624619 master-0 kubenswrapper[8993]: I1204 11:38:02.624526 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:38:02.624710 master-0 kubenswrapper[8993]: E1204 11:38:02.624288 8993 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Dec 04 11:38:02.624775 master-0 kubenswrapper[8993]: E1204 11:38:02.624742 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics podName:fd4c4c6f-380a-4cda-9a21-352b55ec2d98 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:18.624698336 +0000 UTC m=+33.015639959 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "marketplace-operator-metrics" (UniqueName: "kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics") pod "marketplace-operator-f797b99b6-hjjrk" (UID: "fd4c4c6f-380a-4cda-9a21-352b55ec2d98") : secret "marketplace-operator-metrics" not found Dec 04 11:38:02.624854 master-0 kubenswrapper[8993]: E1204 11:38:02.624421 8993 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/package-server-manager-serving-cert: secret "package-server-manager-serving-cert" not found Dec 04 11:38:02.624854 master-0 kubenswrapper[8993]: E1204 11:38:02.624509 8993 secret.go:189] Couldn't get secret openshift-operator-lifecycle-manager/olm-operator-serving-cert: secret "olm-operator-serving-cert" not found Dec 04 11:38:02.624939 master-0 kubenswrapper[8993]: E1204 11:38:02.624879 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs podName:d8fca733-45c8-45b8-8653-ac204e7c6098 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:18.624762988 +0000 UTC m=+33.015704651 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs") pod "network-metrics-daemon-gp57t" (UID: "d8fca733-45c8-45b8-8653-ac204e7c6098") : secret "metrics-daemon-secret" not found Dec 04 11:38:02.624939 master-0 kubenswrapper[8993]: E1204 11:38:02.624898 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert podName:72faf6d6-e8ca-43d1-b93e-67c11f8d3b46 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:18.624890282 +0000 UTC m=+33.015831935 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "package-server-manager-serving-cert" (UniqueName: "kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert") pod "package-server-manager-67477646d4-7hndf" (UID: "72faf6d6-e8ca-43d1-b93e-67c11f8d3b46") : secret "package-server-manager-serving-cert" not found Dec 04 11:38:02.625042 master-0 kubenswrapper[8993]: E1204 11:38:02.625023 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert podName:7bf67a51-9759-4e2a-a2ae-ef7416cad43f nodeName:}" failed. No retries permitted until 2025-12-04 11:38:18.624994236 +0000 UTC m=+33.015935669 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "srv-cert" (UniqueName: "kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert") pod "olm-operator-7cd7dbb44c-vzj4q" (UID: "7bf67a51-9759-4e2a-a2ae-ef7416cad43f") : secret "olm-operator-serving-cert" not found Dec 04 11:38:02.625200 master-0 kubenswrapper[8993]: E1204 11:38:02.625178 8993 secret.go:189] Couldn't get secret openshift-multus/multus-admission-controller-secret: secret "multus-admission-controller-secret" not found Dec 04 11:38:02.625349 master-0 kubenswrapper[8993]: E1204 11:38:02.625333 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs podName:08550069-c1a1-475e-84a2-e56905f1ed38 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:18.625309006 +0000 UTC m=+33.016250439 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs") pod "multus-admission-controller-7dfc5b745f-258xq" (UID: "08550069-c1a1-475e-84a2-e56905f1ed38") : secret "multus-admission-controller-secret" not found Dec 04 11:38:02.628855 master-0 kubenswrapper[8993]: I1204 11:38:02.628741 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:38:02.638537 master-0 kubenswrapper[8993]: I1204 11:38:02.638447 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:38:02.641262 master-0 kubenswrapper[8993]: I1204 11:38:02.641243 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:38:02.656218 master-0 kubenswrapper[8993]: I1204 11:38:02.656156 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:38:02.877971 master-0 kubenswrapper[8993]: I1204 11:38:02.877608 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl"] Dec 04 11:38:02.927937 master-0 kubenswrapper[8993]: W1204 11:38:02.926953 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ade9186_b262_4b5e_9c6f_ba89f0130fb6.slice/crio-c13740ec53fb9299b45efbd89f500b5ff1c2e8c4723ff4ec44bf1b5ff490925a WatchSource:0}: Error finding container c13740ec53fb9299b45efbd89f500b5ff1c2e8c4723ff4ec44bf1b5ff490925a: Status 404 returned error can't find the container with id c13740ec53fb9299b45efbd89f500b5ff1c2e8c4723ff4ec44bf1b5ff490925a Dec 04 11:38:02.948770 master-0 kubenswrapper[8993]: I1204 11:38:02.948691 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-dns-operator/dns-operator-7c56cf9b74-xz27r"] Dec 04 11:38:02.956170 master-0 kubenswrapper[8993]: I1204 11:38:02.956101 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-operator/ingress-operator-8649c48786-cx2b2"] Dec 04 11:38:02.964790 master-0 kubenswrapper[8993]: W1204 11:38:02.964731 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb011b1f1_3235_4e20_825b_ce711c052407.slice/crio-773244d15d95d1008b0937319bf6aba15eff590b74992c80e3033356005709af WatchSource:0}: Error finding container 773244d15d95d1008b0937319bf6aba15eff590b74992c80e3033356005709af: Status 404 returned error can't find the container with id 773244d15d95d1008b0937319bf6aba15eff590b74992c80e3033356005709af Dec 04 11:38:03.083385 master-0 kubenswrapper[8993]: I1204 11:38:03.083319 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" event={"ID":"1ade9186-b262-4b5e-9c6f-ba89f0130fb6","Type":"ContainerStarted","Data":"c13740ec53fb9299b45efbd89f500b5ff1c2e8c4723ff4ec44bf1b5ff490925a"} Dec 04 11:38:03.085704 master-0 kubenswrapper[8993]: I1204 11:38:03.085626 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" event={"ID":"c91e6234-52c5-41c0-a1ff-6a92932b83cd","Type":"ContainerStarted","Data":"f873572c29c6d6d272a3e612cffe7e384efbce76c4a6c668e927c6ff03b1c3e0"} Dec 04 11:38:03.087221 master-0 kubenswrapper[8993]: I1204 11:38:03.087169 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" event={"ID":"7c017c69-b24e-4a7a-b888-133bed34c174","Type":"ContainerStarted","Data":"73c1f951bd9264b3f0b9e21c0ff82a20649a61998f0c539575a5fc18eabd1838"} Dec 04 11:38:03.089693 master-0 kubenswrapper[8993]: I1204 11:38:03.089645 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" event={"ID":"b011b1f1-3235-4e20-825b-ce711c052407","Type":"ContainerStarted","Data":"773244d15d95d1008b0937319bf6aba15eff590b74992c80e3033356005709af"} Dec 04 11:38:03.101912 master-0 kubenswrapper[8993]: I1204 11:38:03.101829 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" podStartSLOduration=2.101785125 podStartE2EDuration="2.101785125s" podCreationTimestamp="2025-12-04 11:38:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:38:03.101137674 +0000 UTC m=+17.492079107" watchObservedRunningTime="2025-12-04 11:38:03.101785125 +0000 UTC m=+17.492726568" Dec 04 11:38:03.546928 master-0 kubenswrapper[8993]: I1204 11:38:03.546842 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler/installer-1-master-0"] Dec 04 11:38:03.547571 master-0 kubenswrapper[8993]: I1204 11:38:03.547546 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 11:38:03.555550 master-0 kubenswrapper[8993]: I1204 11:38:03.553724 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler"/"kube-root-ca.crt" Dec 04 11:38:03.565049 master-0 kubenswrapper[8993]: I1204 11:38:03.558618 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/installer-1-master-0"] Dec 04 11:38:03.642094 master-0 kubenswrapper[8993]: I1204 11:38:03.642032 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7746ae23-c2f8-431c-9e52-dc3d0f9404d3-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"7746ae23-c2f8-431c-9e52-dc3d0f9404d3\") " pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 11:38:03.643131 master-0 kubenswrapper[8993]: I1204 11:38:03.642512 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/7746ae23-c2f8-431c-9e52-dc3d0f9404d3-var-lock\") pod \"installer-1-master-0\" (UID: \"7746ae23-c2f8-431c-9e52-dc3d0f9404d3\") " pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 11:38:03.643131 master-0 kubenswrapper[8993]: I1204 11:38:03.642646 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/7746ae23-c2f8-431c-9e52-dc3d0f9404d3-kube-api-access\") pod \"installer-1-master-0\" (UID: \"7746ae23-c2f8-431c-9e52-dc3d0f9404d3\") " pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 11:38:03.660163 master-0 kubenswrapper[8993]: I1204 11:38:03.660087 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-apiserver/apiserver-97f98c4dd-r2hjk"] Dec 04 11:38:03.661367 master-0 kubenswrapper[8993]: I1204 11:38:03.661333 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.664147 master-0 kubenswrapper[8993]: I1204 11:38:03.664089 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"openshift-service-ca.crt" Dec 04 11:38:03.664409 master-0 kubenswrapper[8993]: I1204 11:38:03.664193 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"encryption-config-0" Dec 04 11:38:03.664409 master-0 kubenswrapper[8993]: I1204 11:38:03.664089 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"etcd-serving-ca" Dec 04 11:38:03.664409 master-0 kubenswrapper[8993]: I1204 11:38:03.664192 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"audit-0" Dec 04 11:38:03.664536 master-0 kubenswrapper[8993]: I1204 11:38:03.664420 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"image-import-ca" Dec 04 11:38:03.664536 master-0 kubenswrapper[8993]: I1204 11:38:03.664489 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"config" Dec 04 11:38:03.664763 master-0 kubenswrapper[8993]: I1204 11:38:03.664698 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"serving-cert" Dec 04 11:38:03.664763 master-0 kubenswrapper[8993]: I1204 11:38:03.664753 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"kube-root-ca.crt" Dec 04 11:38:03.671075 master-0 kubenswrapper[8993]: I1204 11:38:03.671023 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"etcd-client" Dec 04 11:38:03.671259 master-0 kubenswrapper[8993]: I1204 11:38:03.671204 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"trusted-ca-bundle" Dec 04 11:38:03.671739 master-0 kubenswrapper[8993]: I1204 11:38:03.671702 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver/apiserver-97f98c4dd-r2hjk"] Dec 04 11:38:03.743916 master-0 kubenswrapper[8993]: I1204 11:38:03.743783 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bjrs\" (UniqueName: \"kubernetes.io/projected/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-kube-api-access-5bjrs\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.743916 master-0 kubenswrapper[8993]: I1204 11:38:03.743883 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/7746ae23-c2f8-431c-9e52-dc3d0f9404d3-var-lock\") pod \"installer-1-master-0\" (UID: \"7746ae23-c2f8-431c-9e52-dc3d0f9404d3\") " pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 11:38:03.744161 master-0 kubenswrapper[8993]: I1204 11:38:03.743986 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/7746ae23-c2f8-431c-9e52-dc3d0f9404d3-var-lock\") pod \"installer-1-master-0\" (UID: \"7746ae23-c2f8-431c-9e52-dc3d0f9404d3\") " pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 11:38:03.744161 master-0 kubenswrapper[8993]: I1204 11:38:03.744138 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-node-pullsecrets\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.744299 master-0 kubenswrapper[8993]: I1204 11:38:03.744277 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-image-import-ca\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.744329 master-0 kubenswrapper[8993]: I1204 11:38:03.744310 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/7746ae23-c2f8-431c-9e52-dc3d0f9404d3-kube-api-access\") pod \"installer-1-master-0\" (UID: \"7746ae23-c2f8-431c-9e52-dc3d0f9404d3\") " pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 11:38:03.744394 master-0 kubenswrapper[8993]: I1204 11:38:03.744334 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-etcd-client\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.744394 master-0 kubenswrapper[8993]: I1204 11:38:03.744387 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.753149 master-0 kubenswrapper[8993]: I1204 11:38:03.744458 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit-dir\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.753149 master-0 kubenswrapper[8993]: I1204 11:38:03.745908 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-encryption-config\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.753149 master-0 kubenswrapper[8993]: I1204 11:38:03.746003 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7746ae23-c2f8-431c-9e52-dc3d0f9404d3-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"7746ae23-c2f8-431c-9e52-dc3d0f9404d3\") " pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 11:38:03.753149 master-0 kubenswrapper[8993]: I1204 11:38:03.746032 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-etcd-serving-ca\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.753149 master-0 kubenswrapper[8993]: I1204 11:38:03.746062 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-serving-cert\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.753149 master-0 kubenswrapper[8993]: I1204 11:38:03.746107 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7746ae23-c2f8-431c-9e52-dc3d0f9404d3-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"7746ae23-c2f8-431c-9e52-dc3d0f9404d3\") " pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 11:38:03.753149 master-0 kubenswrapper[8993]: I1204 11:38:03.746234 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-config\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.753149 master-0 kubenswrapper[8993]: I1204 11:38:03.746286 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-trusted-ca-bundle\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.779142 master-0 kubenswrapper[8993]: I1204 11:38:03.772451 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/7746ae23-c2f8-431c-9e52-dc3d0f9404d3-kube-api-access\") pod \"installer-1-master-0\" (UID: \"7746ae23-c2f8-431c-9e52-dc3d0f9404d3\") " pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 11:38:03.847473 master-0 kubenswrapper[8993]: I1204 11:38:03.847354 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-encryption-config\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.847473 master-0 kubenswrapper[8993]: I1204 11:38:03.847456 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-etcd-serving-ca\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.847847 master-0 kubenswrapper[8993]: I1204 11:38:03.847602 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-serving-cert\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.847847 master-0 kubenswrapper[8993]: I1204 11:38:03.847640 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-config\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.847847 master-0 kubenswrapper[8993]: I1204 11:38:03.847663 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-trusted-ca-bundle\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.847847 master-0 kubenswrapper[8993]: I1204 11:38:03.847708 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5bjrs\" (UniqueName: \"kubernetes.io/projected/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-kube-api-access-5bjrs\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.847847 master-0 kubenswrapper[8993]: I1204 11:38:03.847740 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-node-pullsecrets\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.847847 master-0 kubenswrapper[8993]: I1204 11:38:03.847787 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-image-import-ca\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.847847 master-0 kubenswrapper[8993]: I1204 11:38:03.847818 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-etcd-client\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.847847 master-0 kubenswrapper[8993]: I1204 11:38:03.847835 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.847847 master-0 kubenswrapper[8993]: I1204 11:38:03.847850 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit-dir\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.848219 master-0 kubenswrapper[8993]: I1204 11:38:03.847941 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit-dir\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.848616 master-0 kubenswrapper[8993]: E1204 11:38:03.848559 8993 secret.go:189] Couldn't get secret openshift-apiserver/serving-cert: secret "serving-cert" not found Dec 04 11:38:03.848673 master-0 kubenswrapper[8993]: E1204 11:38:03.848637 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-serving-cert podName:fe4742fa-f04b-43cd-a67d-ba9f09ceb024 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:04.348618535 +0000 UTC m=+18.739560008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-serving-cert") pod "apiserver-97f98c4dd-r2hjk" (UID: "fe4742fa-f04b-43cd-a67d-ba9f09ceb024") : secret "serving-cert" not found Dec 04 11:38:03.848828 master-0 kubenswrapper[8993]: I1204 11:38:03.848771 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-etcd-serving-ca\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.848877 master-0 kubenswrapper[8993]: I1204 11:38:03.848855 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-node-pullsecrets\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.849350 master-0 kubenswrapper[8993]: I1204 11:38:03.849326 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-config\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.849670 master-0 kubenswrapper[8993]: I1204 11:38:03.849636 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-image-import-ca\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.850088 master-0 kubenswrapper[8993]: I1204 11:38:03.850055 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-trusted-ca-bundle\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.850088 master-0 kubenswrapper[8993]: E1204 11:38:03.850079 8993 configmap.go:193] Couldn't get configMap openshift-apiserver/audit-0: configmap "audit-0" not found Dec 04 11:38:03.850272 master-0 kubenswrapper[8993]: E1204 11:38:03.850136 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit podName:fe4742fa-f04b-43cd-a67d-ba9f09ceb024 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:04.350125404 +0000 UTC m=+18.741066917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "audit" (UniqueName: "kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit") pod "apiserver-97f98c4dd-r2hjk" (UID: "fe4742fa-f04b-43cd-a67d-ba9f09ceb024") : configmap "audit-0" not found Dec 04 11:38:03.850867 master-0 kubenswrapper[8993]: I1204 11:38:03.850736 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-encryption-config\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.853151 master-0 kubenswrapper[8993]: I1204 11:38:03.853104 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-etcd-client\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.875007 master-0 kubenswrapper[8993]: I1204 11:38:03.871368 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bjrs\" (UniqueName: \"kubernetes.io/projected/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-kube-api-access-5bjrs\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:03.894079 master-0 kubenswrapper[8993]: I1204 11:38:03.890818 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 11:38:04.305435 master-0 kubenswrapper[8993]: I1204 11:38:04.305294 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/installer-1-master-0"] Dec 04 11:38:04.312100 master-0 kubenswrapper[8993]: W1204 11:38:04.312031 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7746ae23_c2f8_431c_9e52_dc3d0f9404d3.slice/crio-bc7ebd29438234ac605bc7aa0cb9e2c9cf8ce4ca7e6c3b5534b80edf20cd0afa WatchSource:0}: Error finding container bc7ebd29438234ac605bc7aa0cb9e2c9cf8ce4ca7e6c3b5534b80edf20cd0afa: Status 404 returned error can't find the container with id bc7ebd29438234ac605bc7aa0cb9e2c9cf8ce4ca7e6c3b5534b80edf20cd0afa Dec 04 11:38:04.356761 master-0 kubenswrapper[8993]: I1204 11:38:04.356670 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-serving-cert\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:04.357564 master-0 kubenswrapper[8993]: I1204 11:38:04.356946 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:04.357564 master-0 kubenswrapper[8993]: E1204 11:38:04.357072 8993 configmap.go:193] Couldn't get configMap openshift-apiserver/audit-0: configmap "audit-0" not found Dec 04 11:38:04.357564 master-0 kubenswrapper[8993]: E1204 11:38:04.357153 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit podName:fe4742fa-f04b-43cd-a67d-ba9f09ceb024 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:05.357113963 +0000 UTC m=+19.748055386 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "audit" (UniqueName: "kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit") pod "apiserver-97f98c4dd-r2hjk" (UID: "fe4742fa-f04b-43cd-a67d-ba9f09ceb024") : configmap "audit-0" not found Dec 04 11:38:04.357830 master-0 kubenswrapper[8993]: E1204 11:38:04.357721 8993 secret.go:189] Couldn't get secret openshift-apiserver/serving-cert: secret "serving-cert" not found Dec 04 11:38:04.357942 master-0 kubenswrapper[8993]: E1204 11:38:04.357911 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-serving-cert podName:fe4742fa-f04b-43cd-a67d-ba9f09ceb024 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:05.357877907 +0000 UTC m=+19.748819520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-serving-cert") pod "apiserver-97f98c4dd-r2hjk" (UID: "fe4742fa-f04b-43cd-a67d-ba9f09ceb024") : secret "serving-cert" not found Dec 04 11:38:04.767072 master-0 kubenswrapper[8993]: I1204 11:38:04.766916 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:38:04.767072 master-0 kubenswrapper[8993]: I1204 11:38:04.767088 8993 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 11:38:04.785873 master-0 kubenswrapper[8993]: I1204 11:38:04.785821 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:38:05.112915 master-0 kubenswrapper[8993]: I1204 11:38:05.112834 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-1-master-0" event={"ID":"7746ae23-c2f8-431c-9e52-dc3d0f9404d3","Type":"ContainerStarted","Data":"bc7ebd29438234ac605bc7aa0cb9e2c9cf8ce4ca7e6c3b5534b80edf20cd0afa"} Dec 04 11:38:05.236760 master-0 kubenswrapper[8993]: I1204 11:38:05.236671 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-5c6c4578c-plvql"] Dec 04 11:38:05.237180 master-0 kubenswrapper[8993]: E1204 11:38:05.237142 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[client-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" podUID="775079db-8c67-4d06-87fb-53ee469e8945" Dec 04 11:38:05.251167 master-0 kubenswrapper[8993]: I1204 11:38:05.251095 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6"] Dec 04 11:38:05.251580 master-0 kubenswrapper[8993]: E1204 11:38:05.251536 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[client-ca serving-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" podUID="d934e427-6a74-48cf-987b-adda550c31b6" Dec 04 11:38:05.372561 master-0 kubenswrapper[8993]: I1204 11:38:05.372414 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:05.372561 master-0 kubenswrapper[8993]: E1204 11:38:05.372540 8993 configmap.go:193] Couldn't get configMap openshift-apiserver/audit-0: configmap "audit-0" not found Dec 04 11:38:05.372774 master-0 kubenswrapper[8993]: I1204 11:38:05.372591 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-serving-cert\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:05.372774 master-0 kubenswrapper[8993]: E1204 11:38:05.372610 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit podName:fe4742fa-f04b-43cd-a67d-ba9f09ceb024 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:07.372593299 +0000 UTC m=+21.763534732 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "audit" (UniqueName: "kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit") pod "apiserver-97f98c4dd-r2hjk" (UID: "fe4742fa-f04b-43cd-a67d-ba9f09ceb024") : configmap "audit-0" not found Dec 04 11:38:05.372887 master-0 kubenswrapper[8993]: E1204 11:38:05.372819 8993 secret.go:189] Couldn't get secret openshift-apiserver/serving-cert: secret "serving-cert" not found Dec 04 11:38:05.372945 master-0 kubenswrapper[8993]: E1204 11:38:05.372917 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-serving-cert podName:fe4742fa-f04b-43cd-a67d-ba9f09ceb024 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:07.372892659 +0000 UTC m=+21.763834152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-serving-cert") pod "apiserver-97f98c4dd-r2hjk" (UID: "fe4742fa-f04b-43cd-a67d-ba9f09ceb024") : secret "serving-cert" not found Dec 04 11:38:05.660063 master-0 kubenswrapper[8993]: I1204 11:38:05.659855 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd/installer-1-master-0"] Dec 04 11:38:05.663457 master-0 kubenswrapper[8993]: I1204 11:38:05.660642 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-1-master-0" Dec 04 11:38:05.663457 master-0 kubenswrapper[8993]: I1204 11:38:05.663138 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd"/"kube-root-ca.crt" Dec 04 11:38:05.672294 master-0 kubenswrapper[8993]: I1204 11:38:05.672250 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd/installer-1-master-0"] Dec 04 11:38:05.780073 master-0 kubenswrapper[8993]: I1204 11:38:05.779994 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3-kube-api-access\") pod \"installer-1-master-0\" (UID: \"f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3\") " pod="openshift-etcd/installer-1-master-0" Dec 04 11:38:05.780073 master-0 kubenswrapper[8993]: I1204 11:38:05.780065 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3\") " pod="openshift-etcd/installer-1-master-0" Dec 04 11:38:05.780720 master-0 kubenswrapper[8993]: I1204 11:38:05.780158 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3-var-lock\") pod \"installer-1-master-0\" (UID: \"f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3\") " pod="openshift-etcd/installer-1-master-0" Dec 04 11:38:05.883738 master-0 kubenswrapper[8993]: I1204 11:38:05.883646 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3-kube-api-access\") pod \"installer-1-master-0\" (UID: \"f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3\") " pod="openshift-etcd/installer-1-master-0" Dec 04 11:38:05.883738 master-0 kubenswrapper[8993]: I1204 11:38:05.883710 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3\") " pod="openshift-etcd/installer-1-master-0" Dec 04 11:38:05.884148 master-0 kubenswrapper[8993]: I1204 11:38:05.883964 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-client-ca\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:38:05.884148 master-0 kubenswrapper[8993]: I1204 11:38:05.884008 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3\") " pod="openshift-etcd/installer-1-master-0" Dec 04 11:38:05.884148 master-0 kubenswrapper[8993]: I1204 11:38:05.884069 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3-var-lock\") pod \"installer-1-master-0\" (UID: \"f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3\") " pod="openshift-etcd/installer-1-master-0" Dec 04 11:38:05.884272 master-0 kubenswrapper[8993]: I1204 11:38:05.884214 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3-var-lock\") pod \"installer-1-master-0\" (UID: \"f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3\") " pod="openshift-etcd/installer-1-master-0" Dec 04 11:38:05.885213 master-0 kubenswrapper[8993]: I1204 11:38:05.885156 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-client-ca\") pod \"controller-manager-5c6c4578c-plvql\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:38:05.912013 master-0 kubenswrapper[8993]: I1204 11:38:05.911834 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3-kube-api-access\") pod \"installer-1-master-0\" (UID: \"f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3\") " pod="openshift-etcd/installer-1-master-0" Dec 04 11:38:05.994848 master-0 kubenswrapper[8993]: I1204 11:38:05.993211 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-1-master-0" Dec 04 11:38:06.117290 master-0 kubenswrapper[8993]: I1204 11:38:06.117231 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:38:06.117609 master-0 kubenswrapper[8993]: I1204 11:38:06.117244 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:38:06.126872 master-0 kubenswrapper[8993]: I1204 11:38:06.126827 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:38:06.134524 master-0 kubenswrapper[8993]: I1204 11:38:06.134471 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:38:06.290105 master-0 kubenswrapper[8993]: I1204 11:38:06.289954 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/775079db-8c67-4d06-87fb-53ee469e8945-serving-cert\") pod \"775079db-8c67-4d06-87fb-53ee469e8945\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " Dec 04 11:38:06.290105 master-0 kubenswrapper[8993]: I1204 11:38:06.290045 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2hbr\" (UniqueName: \"kubernetes.io/projected/775079db-8c67-4d06-87fb-53ee469e8945-kube-api-access-l2hbr\") pod \"775079db-8c67-4d06-87fb-53ee469e8945\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " Dec 04 11:38:06.290105 master-0 kubenswrapper[8993]: I1204 11:38:06.290084 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-client-ca\") pod \"775079db-8c67-4d06-87fb-53ee469e8945\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " Dec 04 11:38:06.290412 master-0 kubenswrapper[8993]: I1204 11:38:06.290123 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-config\") pod \"775079db-8c67-4d06-87fb-53ee469e8945\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " Dec 04 11:38:06.290412 master-0 kubenswrapper[8993]: I1204 11:38:06.290356 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-config\") pod \"d934e427-6a74-48cf-987b-adda550c31b6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " Dec 04 11:38:06.290491 master-0 kubenswrapper[8993]: I1204 11:38:06.290472 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2xvx\" (UniqueName: \"kubernetes.io/projected/d934e427-6a74-48cf-987b-adda550c31b6-kube-api-access-w2xvx\") pod \"d934e427-6a74-48cf-987b-adda550c31b6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " Dec 04 11:38:06.290595 master-0 kubenswrapper[8993]: I1204 11:38:06.290545 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-proxy-ca-bundles\") pod \"775079db-8c67-4d06-87fb-53ee469e8945\" (UID: \"775079db-8c67-4d06-87fb-53ee469e8945\") " Dec 04 11:38:06.291654 master-0 kubenswrapper[8993]: I1204 11:38:06.290905 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-config" (OuterVolumeSpecName: "config") pod "775079db-8c67-4d06-87fb-53ee469e8945" (UID: "775079db-8c67-4d06-87fb-53ee469e8945"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:38:06.291654 master-0 kubenswrapper[8993]: I1204 11:38:06.291068 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-client-ca" (OuterVolumeSpecName: "client-ca") pod "775079db-8c67-4d06-87fb-53ee469e8945" (UID: "775079db-8c67-4d06-87fb-53ee469e8945"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:38:06.291654 master-0 kubenswrapper[8993]: I1204 11:38:06.291206 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-config" (OuterVolumeSpecName: "config") pod "d934e427-6a74-48cf-987b-adda550c31b6" (UID: "d934e427-6a74-48cf-987b-adda550c31b6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:38:06.291654 master-0 kubenswrapper[8993]: I1204 11:38:06.291352 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "775079db-8c67-4d06-87fb-53ee469e8945" (UID: "775079db-8c67-4d06-87fb-53ee469e8945"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:38:06.294685 master-0 kubenswrapper[8993]: I1204 11:38:06.294596 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/775079db-8c67-4d06-87fb-53ee469e8945-kube-api-access-l2hbr" (OuterVolumeSpecName: "kube-api-access-l2hbr") pod "775079db-8c67-4d06-87fb-53ee469e8945" (UID: "775079db-8c67-4d06-87fb-53ee469e8945"). InnerVolumeSpecName "kube-api-access-l2hbr". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:38:06.294776 master-0 kubenswrapper[8993]: I1204 11:38:06.294720 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d934e427-6a74-48cf-987b-adda550c31b6-kube-api-access-w2xvx" (OuterVolumeSpecName: "kube-api-access-w2xvx") pod "d934e427-6a74-48cf-987b-adda550c31b6" (UID: "d934e427-6a74-48cf-987b-adda550c31b6"). InnerVolumeSpecName "kube-api-access-w2xvx". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:38:06.294856 master-0 kubenswrapper[8993]: I1204 11:38:06.294763 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/775079db-8c67-4d06-87fb-53ee469e8945-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "775079db-8c67-4d06-87fb-53ee469e8945" (UID: "775079db-8c67-4d06-87fb-53ee469e8945"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 11:38:06.393138 master-0 kubenswrapper[8993]: I1204 11:38:06.393049 8993 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-config\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:06.393138 master-0 kubenswrapper[8993]: I1204 11:38:06.393123 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w2xvx\" (UniqueName: \"kubernetes.io/projected/d934e427-6a74-48cf-987b-adda550c31b6-kube-api-access-w2xvx\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:06.393138 master-0 kubenswrapper[8993]: I1204 11:38:06.393137 8993 reconciler_common.go:293] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-proxy-ca-bundles\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:06.393138 master-0 kubenswrapper[8993]: I1204 11:38:06.393149 8993 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/775079db-8c67-4d06-87fb-53ee469e8945-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:06.393138 master-0 kubenswrapper[8993]: I1204 11:38:06.393162 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-l2hbr\" (UniqueName: \"kubernetes.io/projected/775079db-8c67-4d06-87fb-53ee469e8945-kube-api-access-l2hbr\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:06.393138 master-0 kubenswrapper[8993]: I1204 11:38:06.393175 8993 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:06.393138 master-0 kubenswrapper[8993]: I1204 11:38:06.393188 8993 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/775079db-8c67-4d06-87fb-53ee469e8945-config\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:07.121128 master-0 kubenswrapper[8993]: I1204 11:38:07.120958 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:38:07.122045 master-0 kubenswrapper[8993]: I1204 11:38:07.121335 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-5c6c4578c-plvql" Dec 04 11:38:07.408402 master-0 kubenswrapper[8993]: I1204 11:38:07.408227 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-serving-cert\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:07.408798 master-0 kubenswrapper[8993]: E1204 11:38:07.408686 8993 secret.go:189] Couldn't get secret openshift-apiserver/serving-cert: secret "serving-cert" not found Dec 04 11:38:07.408798 master-0 kubenswrapper[8993]: I1204 11:38:07.408764 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:07.408898 master-0 kubenswrapper[8993]: E1204 11:38:07.408839 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-serving-cert podName:fe4742fa-f04b-43cd-a67d-ba9f09ceb024 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:11.40879548 +0000 UTC m=+25.799737133 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-serving-cert") pod "apiserver-97f98c4dd-r2hjk" (UID: "fe4742fa-f04b-43cd-a67d-ba9f09ceb024") : secret "serving-cert" not found Dec 04 11:38:07.408990 master-0 kubenswrapper[8993]: E1204 11:38:07.408943 8993 configmap.go:193] Couldn't get configMap openshift-apiserver/audit-0: configmap "audit-0" not found Dec 04 11:38:07.409067 master-0 kubenswrapper[8993]: E1204 11:38:07.409039 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit podName:fe4742fa-f04b-43cd-a67d-ba9f09ceb024 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:11.409014736 +0000 UTC m=+25.799956369 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "audit" (UniqueName: "kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit") pod "apiserver-97f98c4dd-r2hjk" (UID: "fe4742fa-f04b-43cd-a67d-ba9f09ceb024") : configmap "audit-0" not found Dec 04 11:38:08.522848 master-0 kubenswrapper[8993]: I1204 11:38:08.522667 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-client-ca\") pod \"route-controller-manager-5f845c897b-hhhv6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:38:08.522848 master-0 kubenswrapper[8993]: E1204 11:38:08.522828 8993 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/client-ca: object "openshift-route-controller-manager"/"client-ca" not registered Dec 04 11:38:08.522848 master-0 kubenswrapper[8993]: I1204 11:38:08.522846 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d934e427-6a74-48cf-987b-adda550c31b6-serving-cert\") pod \"route-controller-manager-5f845c897b-hhhv6\" (UID: \"d934e427-6a74-48cf-987b-adda550c31b6\") " pod="openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6" Dec 04 11:38:08.522848 master-0 kubenswrapper[8993]: E1204 11:38:08.522896 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-client-ca podName:d934e427-6a74-48cf-987b-adda550c31b6 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:24.522878261 +0000 UTC m=+38.913819684 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-client-ca") pod "route-controller-manager-5f845c897b-hhhv6" (UID: "d934e427-6a74-48cf-987b-adda550c31b6") : object "openshift-route-controller-manager"/"client-ca" not registered Dec 04 11:38:08.523710 master-0 kubenswrapper[8993]: E1204 11:38:08.522940 8993 secret.go:189] Couldn't get secret openshift-route-controller-manager/serving-cert: object "openshift-route-controller-manager"/"serving-cert" not registered Dec 04 11:38:08.523710 master-0 kubenswrapper[8993]: E1204 11:38:08.522967 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d934e427-6a74-48cf-987b-adda550c31b6-serving-cert podName:d934e427-6a74-48cf-987b-adda550c31b6 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:24.522959434 +0000 UTC m=+38.913900867 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/d934e427-6a74-48cf-987b-adda550c31b6-serving-cert") pod "route-controller-manager-5f845c897b-hhhv6" (UID: "d934e427-6a74-48cf-987b-adda550c31b6") : object "openshift-route-controller-manager"/"serving-cert" not registered Dec 04 11:38:11.139648 master-0 kubenswrapper[8993]: I1204 11:38:11.139597 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-1-master-0" event={"ID":"7746ae23-c2f8-431c-9e52-dc3d0f9404d3","Type":"ContainerStarted","Data":"47094805f1edeaf17e1a7adb5657ee79a627ba8088dc54090e01c274544dfb2b"} Dec 04 11:38:11.462075 master-0 kubenswrapper[8993]: I1204 11:38:11.461929 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:11.462285 master-0 kubenswrapper[8993]: E1204 11:38:11.462082 8993 configmap.go:193] Couldn't get configMap openshift-apiserver/audit-0: configmap "audit-0" not found Dec 04 11:38:11.462285 master-0 kubenswrapper[8993]: I1204 11:38:11.462136 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-serving-cert\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:11.462285 master-0 kubenswrapper[8993]: E1204 11:38:11.462196 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit podName:fe4742fa-f04b-43cd-a67d-ba9f09ceb024 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:19.462176522 +0000 UTC m=+33.853117955 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "audit" (UniqueName: "kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit") pod "apiserver-97f98c4dd-r2hjk" (UID: "fe4742fa-f04b-43cd-a67d-ba9f09ceb024") : configmap "audit-0" not found Dec 04 11:38:11.465248 master-0 kubenswrapper[8993]: I1204 11:38:11.465192 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-serving-cert\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:12.506692 master-0 kubenswrapper[8993]: I1204 11:38:12.506625 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h"] Dec 04 11:38:12.507471 master-0 kubenswrapper[8993]: I1204 11:38:12.507261 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" Dec 04 11:38:12.511448 master-0 kubenswrapper[8993]: I1204 11:38:12.511366 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"config" Dec 04 11:38:12.511647 master-0 kubenswrapper[8993]: I1204 11:38:12.511542 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"client-ca" Dec 04 11:38:12.513118 master-0 kubenswrapper[8993]: I1204 11:38:12.513039 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"openshift-service-ca.crt" Dec 04 11:38:12.513566 master-0 kubenswrapper[8993]: I1204 11:38:12.513539 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Dec 04 11:38:12.514087 master-0 kubenswrapper[8993]: I1204 11:38:12.514058 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"kube-root-ca.crt" Dec 04 11:38:12.676896 master-0 kubenswrapper[8993]: I1204 11:38:12.676787 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/4639ea5a-0121-4855-8b9a-3af7487fdec4-client-ca\") pod \"route-controller-manager-f4c4cbbd-5bv8h\" (UID: \"4639ea5a-0121-4855-8b9a-3af7487fdec4\") " pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" Dec 04 11:38:12.677216 master-0 kubenswrapper[8993]: I1204 11:38:12.677072 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4639ea5a-0121-4855-8b9a-3af7487fdec4-config\") pod \"route-controller-manager-f4c4cbbd-5bv8h\" (UID: \"4639ea5a-0121-4855-8b9a-3af7487fdec4\") " pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" Dec 04 11:38:12.677260 master-0 kubenswrapper[8993]: I1204 11:38:12.677209 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4639ea5a-0121-4855-8b9a-3af7487fdec4-serving-cert\") pod \"route-controller-manager-f4c4cbbd-5bv8h\" (UID: \"4639ea5a-0121-4855-8b9a-3af7487fdec4\") " pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" Dec 04 11:38:12.677320 master-0 kubenswrapper[8993]: I1204 11:38:12.677284 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc8sk\" (UniqueName: \"kubernetes.io/projected/4639ea5a-0121-4855-8b9a-3af7487fdec4-kube-api-access-mc8sk\") pod \"route-controller-manager-f4c4cbbd-5bv8h\" (UID: \"4639ea5a-0121-4855-8b9a-3af7487fdec4\") " pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" Dec 04 11:38:12.779519 master-0 kubenswrapper[8993]: I1204 11:38:12.779242 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4639ea5a-0121-4855-8b9a-3af7487fdec4-serving-cert\") pod \"route-controller-manager-f4c4cbbd-5bv8h\" (UID: \"4639ea5a-0121-4855-8b9a-3af7487fdec4\") " pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" Dec 04 11:38:12.779519 master-0 kubenswrapper[8993]: I1204 11:38:12.779412 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mc8sk\" (UniqueName: \"kubernetes.io/projected/4639ea5a-0121-4855-8b9a-3af7487fdec4-kube-api-access-mc8sk\") pod \"route-controller-manager-f4c4cbbd-5bv8h\" (UID: \"4639ea5a-0121-4855-8b9a-3af7487fdec4\") " pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" Dec 04 11:38:12.779992 master-0 kubenswrapper[8993]: I1204 11:38:12.779891 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/4639ea5a-0121-4855-8b9a-3af7487fdec4-client-ca\") pod \"route-controller-manager-f4c4cbbd-5bv8h\" (UID: \"4639ea5a-0121-4855-8b9a-3af7487fdec4\") " pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" Dec 04 11:38:12.780105 master-0 kubenswrapper[8993]: I1204 11:38:12.780076 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4639ea5a-0121-4855-8b9a-3af7487fdec4-config\") pod \"route-controller-manager-f4c4cbbd-5bv8h\" (UID: \"4639ea5a-0121-4855-8b9a-3af7487fdec4\") " pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" Dec 04 11:38:12.781184 master-0 kubenswrapper[8993]: I1204 11:38:12.781150 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/4639ea5a-0121-4855-8b9a-3af7487fdec4-client-ca\") pod \"route-controller-manager-f4c4cbbd-5bv8h\" (UID: \"4639ea5a-0121-4855-8b9a-3af7487fdec4\") " pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" Dec 04 11:38:12.781518 master-0 kubenswrapper[8993]: I1204 11:38:12.781445 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4639ea5a-0121-4855-8b9a-3af7487fdec4-config\") pod \"route-controller-manager-f4c4cbbd-5bv8h\" (UID: \"4639ea5a-0121-4855-8b9a-3af7487fdec4\") " pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" Dec 04 11:38:12.783264 master-0 kubenswrapper[8993]: I1204 11:38:12.783199 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4639ea5a-0121-4855-8b9a-3af7487fdec4-serving-cert\") pod \"route-controller-manager-f4c4cbbd-5bv8h\" (UID: \"4639ea5a-0121-4855-8b9a-3af7487fdec4\") " pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" Dec 04 11:38:14.571976 master-0 kubenswrapper[8993]: I1204 11:38:14.571916 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h"] Dec 04 11:38:17.343279 master-0 kubenswrapper[8993]: I1204 11:38:17.333902 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6"] Dec 04 11:38:18.170719 master-0 kubenswrapper[8993]: I1204 11:38:18.170627 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-5f845c897b-hhhv6"] Dec 04 11:38:18.363719 master-0 kubenswrapper[8993]: I1204 11:38:18.363644 8993 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/d934e427-6a74-48cf-987b-adda550c31b6-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:18.363719 master-0 kubenswrapper[8993]: I1204 11:38:18.363691 8993 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d934e427-6a74-48cf-987b-adda550c31b6-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:18.566236 master-0 kubenswrapper[8993]: I1204 11:38:18.566154 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:38:18.571838 master-0 kubenswrapper[8993]: I1204 11:38:18.570525 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc8sk\" (UniqueName: \"kubernetes.io/projected/4639ea5a-0121-4855-8b9a-3af7487fdec4-kube-api-access-mc8sk\") pod \"route-controller-manager-f4c4cbbd-5bv8h\" (UID: \"4639ea5a-0121-4855-8b9a-3af7487fdec4\") " pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" Dec 04 11:38:18.581796 master-0 kubenswrapper[8993]: I1204 11:38:18.581732 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:38:18.676935 master-0 kubenswrapper[8993]: I1204 11:38:18.672474 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-666dcff694-54zwc"] Dec 04 11:38:18.676935 master-0 kubenswrapper[8993]: I1204 11:38:18.673036 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g"] Dec 04 11:38:18.676935 master-0 kubenswrapper[8993]: I1204 11:38:18.673394 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:38:18.676935 master-0 kubenswrapper[8993]: I1204 11:38:18.673447 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:38:18.676935 master-0 kubenswrapper[8993]: I1204 11:38:18.673484 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:38:18.676935 master-0 kubenswrapper[8993]: I1204 11:38:18.673506 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.687629 master-0 kubenswrapper[8993]: I1204 11:38:18.683274 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:38:18.691039 master-0 kubenswrapper[8993]: I1204 11:38:18.690056 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" Dec 04 11:38:18.691039 master-0 kubenswrapper[8993]: I1204 11:38:18.673506 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:38:18.691039 master-0 kubenswrapper[8993]: I1204 11:38:18.690640 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:38:18.691039 master-0 kubenswrapper[8993]: I1204 11:38:18.690772 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:38:18.691879 master-0 kubenswrapper[8993]: I1204 11:38:18.691827 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:38:18.693725 master-0 kubenswrapper[8993]: I1204 11:38:18.693696 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv"] Dec 04 11:38:18.694394 master-0 kubenswrapper[8993]: I1204 11:38:18.694366 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:18.695139 master-0 kubenswrapper[8993]: I1204 11:38:18.695076 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:38:18.704525 master-0 kubenswrapper[8993]: I1204 11:38:18.703716 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"kube-root-ca.crt" Dec 04 11:38:18.708779 master-0 kubenswrapper[8993]: I1204 11:38:18.708724 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:38:18.711427 master-0 kubenswrapper[8993]: I1204 11:38:18.709534 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-global-ca" Dec 04 11:38:18.714602 master-0 kubenswrapper[8993]: I1204 11:38:18.714549 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"openshift-service-ca.crt" Dec 04 11:38:18.715397 master-0 kubenswrapper[8993]: I1204 11:38:18.715374 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-service-ca.crt" Dec 04 11:38:18.715581 master-0 kubenswrapper[8993]: I1204 11:38:18.715551 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-catalogd"/"catalogserver-cert" Dec 04 11:38:18.715739 master-0 kubenswrapper[8993]: I1204 11:38:18.715717 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"encryption-config-1" Dec 04 11:38:18.715909 master-0 kubenswrapper[8993]: I1204 11:38:18.715892 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"config" Dec 04 11:38:18.716066 master-0 kubenswrapper[8993]: I1204 11:38:18.716042 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"trusted-ca-bundle" Dec 04 11:38:18.716247 master-0 kubenswrapper[8993]: I1204 11:38:18.716224 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"openshift-service-ca.crt" Dec 04 11:38:18.716449 master-0 kubenswrapper[8993]: I1204 11:38:18.716420 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"etcd-serving-ca" Dec 04 11:38:18.723606 master-0 kubenswrapper[8993]: I1204 11:38:18.723529 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:38:18.747215 master-0 kubenswrapper[8993]: I1204 11:38:18.737582 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:38:18.747215 master-0 kubenswrapper[8993]: I1204 11:38:18.741091 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"kube-root-ca.crt" Dec 04 11:38:18.747215 master-0 kubenswrapper[8993]: I1204 11:38:18.741323 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"client-ca" Dec 04 11:38:18.747215 master-0 kubenswrapper[8993]: I1204 11:38:18.741363 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"serving-cert" Dec 04 11:38:18.747215 master-0 kubenswrapper[8993]: I1204 11:38:18.741426 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"etcd-client" Dec 04 11:38:18.747215 master-0 kubenswrapper[8993]: I1204 11:38:18.741531 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"serving-cert" Dec 04 11:38:18.747215 master-0 kubenswrapper[8993]: I1204 11:38:18.741628 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"audit-1" Dec 04 11:38:18.747215 master-0 kubenswrapper[8993]: I1204 11:38:18.741629 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"kube-root-ca.crt" Dec 04 11:38:18.747215 master-0 kubenswrapper[8993]: I1204 11:38:18.741835 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"catalogd-trusted-ca-bundle" Dec 04 11:38:18.747215 master-0 kubenswrapper[8993]: I1204 11:38:18.745747 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-666dcff694-54zwc"] Dec 04 11:38:18.747215 master-0 kubenswrapper[8993]: I1204 11:38:18.745862 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-scheduler/installer-1-master-0"] Dec 04 11:38:18.747215 master-0 kubenswrapper[8993]: I1204 11:38:18.745881 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g"] Dec 04 11:38:18.747215 master-0 kubenswrapper[8993]: I1204 11:38:18.746152 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-scheduler/installer-1-master-0" podUID="7746ae23-c2f8-431c-9e52-dc3d0f9404d3" containerName="installer" containerID="cri-o://47094805f1edeaf17e1a7adb5657ee79a627ba8088dc54090e01c274544dfb2b" gracePeriod=30 Dec 04 11:38:18.748078 master-0 kubenswrapper[8993]: I1204 11:38:18.748026 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv"] Dec 04 11:38:18.749074 master-0 kubenswrapper[8993]: I1204 11:38:18.749025 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-5c6c4578c-plvql"] Dec 04 11:38:18.774251 master-0 kubenswrapper[8993]: I1204 11:38:18.774179 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-apiserver/apiserver-97f98c4dd-r2hjk"] Dec 04 11:38:18.774251 master-0 kubenswrapper[8993]: I1204 11:38:18.774256 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd"] Dec 04 11:38:18.774533 master-0 kubenswrapper[8993]: I1204 11:38:18.774484 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" podUID="69640270-09e6-4217-b1c8-3d3465c0c3ae" containerName="cluster-version-operator" containerID="cri-o://72267672c37ea5ea5121bfc6098f5ca0a616e150a2f0b617b4e3f39d2cb68626" gracePeriod=130 Dec 04 11:38:18.775111 master-0 kubenswrapper[8993]: E1204 11:38:18.775066 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[audit], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" podUID="fe4742fa-f04b-43cd-a67d-ba9f09ceb024" Dec 04 11:38:18.784838 master-0 kubenswrapper[8993]: I1204 11:38:18.781823 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-controller-manager/controller-manager-5c6c4578c-plvql"] Dec 04 11:38:18.802833 master-0 kubenswrapper[8993]: I1204 11:38:18.794439 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-etcd-serving-ca\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.802833 master-0 kubenswrapper[8993]: I1204 11:38:18.794503 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-client-ca\") pod \"controller-manager-666dcff694-54zwc\" (UID: \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\") " pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" Dec 04 11:38:18.802833 master-0 kubenswrapper[8993]: I1204 11:38:18.794534 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-proxy-ca-bundles\") pod \"controller-manager-666dcff694-54zwc\" (UID: \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\") " pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" Dec 04 11:38:18.802833 master-0 kubenswrapper[8993]: I1204 11:38:18.794568 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szqm4\" (UniqueName: \"kubernetes.io/projected/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-kube-api-access-szqm4\") pod \"controller-manager-666dcff694-54zwc\" (UID: \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\") " pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" Dec 04 11:38:18.802833 master-0 kubenswrapper[8993]: I1204 11:38:18.794602 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-encryption-config\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.802833 master-0 kubenswrapper[8993]: I1204 11:38:18.794631 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/ee9a47b1-cdd9-43bc-8115-8851f29106e6-etc-containers\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:18.802833 master-0 kubenswrapper[8993]: I1204 11:38:18.794652 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-serving-cert\") pod \"controller-manager-666dcff694-54zwc\" (UID: \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\") " pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" Dec 04 11:38:18.802833 master-0 kubenswrapper[8993]: I1204 11:38:18.794672 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-serving-cert\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.802833 master-0 kubenswrapper[8993]: I1204 11:38:18.794700 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg7hr\" (UniqueName: \"kubernetes.io/projected/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-kube-api-access-lg7hr\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.802833 master-0 kubenswrapper[8993]: I1204 11:38:18.794742 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/ee9a47b1-cdd9-43bc-8115-8851f29106e6-cache\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:18.802833 master-0 kubenswrapper[8993]: I1204 11:38:18.794779 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-trusted-ca-bundle\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.802833 master-0 kubenswrapper[8993]: I1204 11:38:18.794821 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/ee9a47b1-cdd9-43bc-8115-8851f29106e6-ca-certs\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:18.802833 master-0 kubenswrapper[8993]: I1204 11:38:18.794842 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-audit-policies\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.802833 master-0 kubenswrapper[8993]: I1204 11:38:18.794874 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-etcd-client\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.802833 master-0 kubenswrapper[8993]: I1204 11:38:18.794900 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnfmb\" (UniqueName: \"kubernetes.io/projected/ee9a47b1-cdd9-43bc-8115-8851f29106e6-kube-api-access-rnfmb\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:18.802833 master-0 kubenswrapper[8993]: I1204 11:38:18.794925 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-audit-dir\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.802833 master-0 kubenswrapper[8993]: I1204 11:38:18.794942 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalogserver-certs\" (UniqueName: \"kubernetes.io/secret/ee9a47b1-cdd9-43bc-8115-8851f29106e6-catalogserver-certs\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:18.802833 master-0 kubenswrapper[8993]: I1204 11:38:18.794959 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/ee9a47b1-cdd9-43bc-8115-8851f29106e6-etc-docker\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:18.802833 master-0 kubenswrapper[8993]: I1204 11:38:18.794977 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-config\") pod \"controller-manager-666dcff694-54zwc\" (UID: \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\") " pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" Dec 04 11:38:18.842843 master-0 kubenswrapper[8993]: I1204 11:38:18.838283 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" Dec 04 11:38:18.842843 master-0 kubenswrapper[8993]: I1204 11:38:18.838964 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:38:18.861996 master-0 kubenswrapper[8993]: I1204 11:38:18.857197 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:38:18.861996 master-0 kubenswrapper[8993]: I1204 11:38:18.857240 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:38:18.861996 master-0 kubenswrapper[8993]: I1204 11:38:18.857912 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:38:18.861996 master-0 kubenswrapper[8993]: I1204 11:38:18.861929 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:38:18.864077 master-0 kubenswrapper[8993]: I1204 11:38:18.864030 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:38:18.864657 master-0 kubenswrapper[8993]: I1204 11:38:18.864636 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:38:18.878961 master-0 kubenswrapper[8993]: I1204 11:38:18.868304 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t"] Dec 04 11:38:18.878961 master-0 kubenswrapper[8993]: I1204 11:38:18.869437 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:38:18.881034 master-0 kubenswrapper[8993]: I1204 11:38:18.880661 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"kube-root-ca.crt" Dec 04 11:38:18.881034 master-0 kubenswrapper[8993]: I1204 11:38:18.880738 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"openshift-service-ca.crt" Dec 04 11:38:18.885545 master-0 kubenswrapper[8993]: I1204 11:38:18.885277 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"operator-controller-trusted-ca-bundle" Dec 04 11:38:18.896405 master-0 kubenswrapper[8993]: I1204 11:38:18.896321 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/ee9a47b1-cdd9-43bc-8115-8851f29106e6-etc-containers\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:18.896547 master-0 kubenswrapper[8993]: I1204 11:38:18.896414 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-serving-cert\") pod \"controller-manager-666dcff694-54zwc\" (UID: \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\") " pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" Dec 04 11:38:18.898424 master-0 kubenswrapper[8993]: I1204 11:38:18.898380 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/ee9a47b1-cdd9-43bc-8115-8851f29106e6-etc-containers\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:18.898424 master-0 kubenswrapper[8993]: I1204 11:38:18.898385 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-serving-cert\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.898551 master-0 kubenswrapper[8993]: I1204 11:38:18.898523 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lg7hr\" (UniqueName: \"kubernetes.io/projected/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-kube-api-access-lg7hr\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.898593 master-0 kubenswrapper[8993]: I1204 11:38:18.898585 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/ee9a47b1-cdd9-43bc-8115-8851f29106e6-cache\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:18.898651 master-0 kubenswrapper[8993]: I1204 11:38:18.898631 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-trusted-ca-bundle\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.898693 master-0 kubenswrapper[8993]: I1204 11:38:18.898684 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/ee9a47b1-cdd9-43bc-8115-8851f29106e6-ca-certs\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:18.898739 master-0 kubenswrapper[8993]: I1204 11:38:18.898718 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-audit-policies\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.898831 master-0 kubenswrapper[8993]: I1204 11:38:18.898780 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-etcd-client\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.899004 master-0 kubenswrapper[8993]: I1204 11:38:18.898834 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rnfmb\" (UniqueName: \"kubernetes.io/projected/ee9a47b1-cdd9-43bc-8115-8851f29106e6-kube-api-access-rnfmb\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:18.899004 master-0 kubenswrapper[8993]: I1204 11:38:18.898896 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-audit-dir\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.899004 master-0 kubenswrapper[8993]: I1204 11:38:18.898921 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalogserver-certs\" (UniqueName: \"kubernetes.io/secret/ee9a47b1-cdd9-43bc-8115-8851f29106e6-catalogserver-certs\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:18.899004 master-0 kubenswrapper[8993]: I1204 11:38:18.898944 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/ee9a47b1-cdd9-43bc-8115-8851f29106e6-etc-docker\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:18.899004 master-0 kubenswrapper[8993]: I1204 11:38:18.898979 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-config\") pod \"controller-manager-666dcff694-54zwc\" (UID: \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\") " pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" Dec 04 11:38:18.899648 master-0 kubenswrapper[8993]: I1204 11:38:18.899601 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-etcd-serving-ca\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.899868 master-0 kubenswrapper[8993]: I1204 11:38:18.899821 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-audit-policies\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.900126 master-0 kubenswrapper[8993]: I1204 11:38:18.899995 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-client-ca\") pod \"controller-manager-666dcff694-54zwc\" (UID: \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\") " pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" Dec 04 11:38:18.900858 master-0 kubenswrapper[8993]: I1204 11:38:18.900757 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-etcd-serving-ca\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.900933 master-0 kubenswrapper[8993]: I1204 11:38:18.900888 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-proxy-ca-bundles\") pod \"controller-manager-666dcff694-54zwc\" (UID: \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\") " pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" Dec 04 11:38:18.900933 master-0 kubenswrapper[8993]: I1204 11:38:18.900919 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-szqm4\" (UniqueName: \"kubernetes.io/projected/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-kube-api-access-szqm4\") pod \"controller-manager-666dcff694-54zwc\" (UID: \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\") " pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" Dec 04 11:38:18.901012 master-0 kubenswrapper[8993]: I1204 11:38:18.900945 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-encryption-config\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.903623 master-0 kubenswrapper[8993]: I1204 11:38:18.903563 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-audit-dir\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.905273 master-0 kubenswrapper[8993]: I1204 11:38:18.905250 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/ee9a47b1-cdd9-43bc-8115-8851f29106e6-etc-docker\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:18.905981 master-0 kubenswrapper[8993]: I1204 11:38:18.905936 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-serving-cert\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.906210 master-0 kubenswrapper[8993]: I1204 11:38:18.906162 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-encryption-config\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.906249 master-0 kubenswrapper[8993]: I1204 11:38:18.906200 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-trusted-ca-bundle\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.907027 master-0 kubenswrapper[8993]: I1204 11:38:18.906992 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/ee9a47b1-cdd9-43bc-8115-8851f29106e6-cache\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:18.907424 master-0 kubenswrapper[8993]: I1204 11:38:18.907375 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-config\") pod \"controller-manager-666dcff694-54zwc\" (UID: \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\") " pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" Dec 04 11:38:18.914799 master-0 kubenswrapper[8993]: I1204 11:38:18.914705 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-proxy-ca-bundles\") pod \"controller-manager-666dcff694-54zwc\" (UID: \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\") " pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" Dec 04 11:38:18.916549 master-0 kubenswrapper[8993]: I1204 11:38:18.916471 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalogserver-certs\" (UniqueName: \"kubernetes.io/secret/ee9a47b1-cdd9-43bc-8115-8851f29106e6-catalogserver-certs\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:18.917072 master-0 kubenswrapper[8993]: I1204 11:38:18.917031 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-client-ca\") pod \"controller-manager-666dcff694-54zwc\" (UID: \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\") " pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" Dec 04 11:38:18.922918 master-0 kubenswrapper[8993]: I1204 11:38:18.921629 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-serving-cert\") pod \"controller-manager-666dcff694-54zwc\" (UID: \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\") " pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" Dec 04 11:38:18.929049 master-0 kubenswrapper[8993]: I1204 11:38:18.928796 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/ee9a47b1-cdd9-43bc-8115-8851f29106e6-ca-certs\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:18.930344 master-0 kubenswrapper[8993]: I1204 11:38:18.930301 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-etcd-client\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:18.990230 master-0 kubenswrapper[8993]: I1204 11:38:18.988543 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-szqm4\" (UniqueName: \"kubernetes.io/projected/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-kube-api-access-szqm4\") pod \"controller-manager-666dcff694-54zwc\" (UID: \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\") " pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" Dec 04 11:38:18.996443 master-0 kubenswrapper[8993]: I1204 11:38:18.996389 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnfmb\" (UniqueName: \"kubernetes.io/projected/ee9a47b1-cdd9-43bc-8115-8851f29106e6-kube-api-access-rnfmb\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:18.998222 master-0 kubenswrapper[8993]: I1204 11:38:18.998173 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg7hr\" (UniqueName: \"kubernetes.io/projected/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-kube-api-access-lg7hr\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:19.000145 master-0 kubenswrapper[8993]: I1204 11:38:19.000114 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:19.035740 master-0 kubenswrapper[8993]: I1204 11:38:19.029248 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/1897bad8-3875-4bd6-b877-b1abe1fe76c7-cache\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:38:19.035740 master-0 kubenswrapper[8993]: I1204 11:38:19.029384 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkqp2\" (UniqueName: \"kubernetes.io/projected/1897bad8-3875-4bd6-b877-b1abe1fe76c7-kube-api-access-dkqp2\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:38:19.035740 master-0 kubenswrapper[8993]: I1204 11:38:19.029474 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/1897bad8-3875-4bd6-b877-b1abe1fe76c7-ca-certs\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:38:19.035740 master-0 kubenswrapper[8993]: I1204 11:38:19.029528 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/1897bad8-3875-4bd6-b877-b1abe1fe76c7-etc-containers\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:38:19.035740 master-0 kubenswrapper[8993]: I1204 11:38:19.029600 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/1897bad8-3875-4bd6-b877-b1abe1fe76c7-etc-docker\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:38:19.074670 master-0 kubenswrapper[8993]: I1204 11:38:19.060929 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t"] Dec 04 11:38:19.126226 master-0 kubenswrapper[8993]: I1204 11:38:19.126047 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:19.135671 master-0 kubenswrapper[8993]: I1204 11:38:19.131113 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/1897bad8-3875-4bd6-b877-b1abe1fe76c7-ca-certs\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:38:19.135671 master-0 kubenswrapper[8993]: I1204 11:38:19.131413 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/1897bad8-3875-4bd6-b877-b1abe1fe76c7-etc-containers\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:38:19.135671 master-0 kubenswrapper[8993]: I1204 11:38:19.131447 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/1897bad8-3875-4bd6-b877-b1abe1fe76c7-etc-docker\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:38:19.135671 master-0 kubenswrapper[8993]: I1204 11:38:19.131508 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/1897bad8-3875-4bd6-b877-b1abe1fe76c7-cache\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:38:19.135671 master-0 kubenswrapper[8993]: I1204 11:38:19.131536 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dkqp2\" (UniqueName: \"kubernetes.io/projected/1897bad8-3875-4bd6-b877-b1abe1fe76c7-kube-api-access-dkqp2\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:38:19.135671 master-0 kubenswrapper[8993]: I1204 11:38:19.132661 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/1897bad8-3875-4bd6-b877-b1abe1fe76c7-etc-docker\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:38:19.135671 master-0 kubenswrapper[8993]: I1204 11:38:19.132772 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/1897bad8-3875-4bd6-b877-b1abe1fe76c7-etc-containers\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:38:19.146954 master-0 kubenswrapper[8993]: I1204 11:38:19.145477 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/1897bad8-3875-4bd6-b877-b1abe1fe76c7-cache\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:38:19.174583 master-0 kubenswrapper[8993]: I1204 11:38:19.151125 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/1897bad8-3875-4bd6-b877-b1abe1fe76c7-ca-certs\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:38:19.187290 master-0 kubenswrapper[8993]: I1204 11:38:19.187022 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkqp2\" (UniqueName: \"kubernetes.io/projected/1897bad8-3875-4bd6-b877-b1abe1fe76c7-kube-api-access-dkqp2\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:38:19.199773 master-0 kubenswrapper[8993]: I1204 11:38:19.199626 8993 generic.go:334] "Generic (PLEG): container finished" podID="69640270-09e6-4217-b1c8-3d3465c0c3ae" containerID="72267672c37ea5ea5121bfc6098f5ca0a616e150a2f0b617b4e3f39d2cb68626" exitCode=0 Dec 04 11:38:19.199921 master-0 kubenswrapper[8993]: I1204 11:38:19.199783 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" event={"ID":"69640270-09e6-4217-b1c8-3d3465c0c3ae","Type":"ContainerDied","Data":"72267672c37ea5ea5121bfc6098f5ca0a616e150a2f0b617b4e3f39d2cb68626"} Dec 04 11:38:19.209643 master-0 kubenswrapper[8993]: I1204 11:38:19.209582 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:19.214427 master-0 kubenswrapper[8993]: I1204 11:38:19.212729 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" event={"ID":"1ade9186-b262-4b5e-9c6f-ba89f0130fb6","Type":"ContainerStarted","Data":"b4a708629c00edd600857e5208cac33c83ecd3ee4160351814e5fc4f907308cf"} Dec 04 11:38:19.214427 master-0 kubenswrapper[8993]: I1204 11:38:19.213135 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" Dec 04 11:38:19.273679 master-0 kubenswrapper[8993]: I1204 11:38:19.273565 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler/installer-1-master-0" podStartSLOduration=16.273535849 podStartE2EDuration="16.273535849s" podCreationTimestamp="2025-12-04 11:38:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:38:19.244554249 +0000 UTC m=+33.635495682" watchObservedRunningTime="2025-12-04 11:38:19.273535849 +0000 UTC m=+33.664477282" Dec 04 11:38:19.281584 master-0 kubenswrapper[8993]: I1204 11:38:19.281343 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd/installer-1-master-0"] Dec 04 11:38:19.335141 master-0 kubenswrapper[8993]: W1204 11:38:19.335080 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf24bc354_1fe3_4dd1_b0a0_3dc86a14aff3.slice/crio-85449a546194f1b7d82572b88b05b009dbf13dc608b9793959a5abd709bf99f0 WatchSource:0}: Error finding container 85449a546194f1b7d82572b88b05b009dbf13dc608b9793959a5abd709bf99f0: Status 404 returned error can't find the container with id 85449a546194f1b7d82572b88b05b009dbf13dc608b9793959a5abd709bf99f0 Dec 04 11:38:19.359179 master-0 kubenswrapper[8993]: I1204 11:38:19.356587 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:19.359179 master-0 kubenswrapper[8993]: I1204 11:38:19.357267 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:38:19.450372 master-0 kubenswrapper[8993]: I1204 11:38:19.446600 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:38:19.451147 master-0 kubenswrapper[8993]: I1204 11:38:19.450601 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-etcd-serving-ca\") pod \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " Dec 04 11:38:19.451147 master-0 kubenswrapper[8993]: I1204 11:38:19.450635 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bjrs\" (UniqueName: \"kubernetes.io/projected/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-kube-api-access-5bjrs\") pod \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " Dec 04 11:38:19.451147 master-0 kubenswrapper[8993]: I1204 11:38:19.450654 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-trusted-ca-bundle\") pod \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " Dec 04 11:38:19.451147 master-0 kubenswrapper[8993]: I1204 11:38:19.450687 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-config\") pod \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " Dec 04 11:38:19.451147 master-0 kubenswrapper[8993]: I1204 11:38:19.450708 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-serving-cert\") pod \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " Dec 04 11:38:19.451147 master-0 kubenswrapper[8993]: I1204 11:38:19.450744 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-node-pullsecrets\") pod \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " Dec 04 11:38:19.451147 master-0 kubenswrapper[8993]: I1204 11:38:19.450814 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-etcd-client\") pod \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " Dec 04 11:38:19.451147 master-0 kubenswrapper[8993]: I1204 11:38:19.450859 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-encryption-config\") pod \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " Dec 04 11:38:19.451147 master-0 kubenswrapper[8993]: I1204 11:38:19.450876 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/69640270-09e6-4217-b1c8-3d3465c0c3ae-etc-ssl-certs\") pod \"69640270-09e6-4217-b1c8-3d3465c0c3ae\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " Dec 04 11:38:19.451147 master-0 kubenswrapper[8993]: I1204 11:38:19.450897 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/69640270-09e6-4217-b1c8-3d3465c0c3ae-kube-api-access\") pod \"69640270-09e6-4217-b1c8-3d3465c0c3ae\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " Dec 04 11:38:19.451147 master-0 kubenswrapper[8993]: I1204 11:38:19.450920 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert\") pod \"69640270-09e6-4217-b1c8-3d3465c0c3ae\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " Dec 04 11:38:19.451147 master-0 kubenswrapper[8993]: I1204 11:38:19.450945 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/69640270-09e6-4217-b1c8-3d3465c0c3ae-etc-cvo-updatepayloads\") pod \"69640270-09e6-4217-b1c8-3d3465c0c3ae\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " Dec 04 11:38:19.451147 master-0 kubenswrapper[8993]: I1204 11:38:19.450973 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-image-import-ca\") pod \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " Dec 04 11:38:19.451147 master-0 kubenswrapper[8993]: I1204 11:38:19.451015 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit-dir\") pod \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " Dec 04 11:38:19.451147 master-0 kubenswrapper[8993]: I1204 11:38:19.451038 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69640270-09e6-4217-b1c8-3d3465c0c3ae-service-ca\") pod \"69640270-09e6-4217-b1c8-3d3465c0c3ae\" (UID: \"69640270-09e6-4217-b1c8-3d3465c0c3ae\") " Dec 04 11:38:19.452934 master-0 kubenswrapper[8993]: I1204 11:38:19.452799 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69640270-09e6-4217-b1c8-3d3465c0c3ae-service-ca" (OuterVolumeSpecName: "service-ca") pod "69640270-09e6-4217-b1c8-3d3465c0c3ae" (UID: "69640270-09e6-4217-b1c8-3d3465c0c3ae"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:38:19.453012 master-0 kubenswrapper[8993]: I1204 11:38:19.452933 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/69640270-09e6-4217-b1c8-3d3465c0c3ae-etc-cvo-updatepayloads" (OuterVolumeSpecName: "etc-cvo-updatepayloads") pod "69640270-09e6-4217-b1c8-3d3465c0c3ae" (UID: "69640270-09e6-4217-b1c8-3d3465c0c3ae"). InnerVolumeSpecName "etc-cvo-updatepayloads". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:38:19.454447 master-0 kubenswrapper[8993]: I1204 11:38:19.453698 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-image-import-ca" (OuterVolumeSpecName: "image-import-ca") pod "fe4742fa-f04b-43cd-a67d-ba9f09ceb024" (UID: "fe4742fa-f04b-43cd-a67d-ba9f09ceb024"). InnerVolumeSpecName "image-import-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:38:19.454447 master-0 kubenswrapper[8993]: I1204 11:38:19.453733 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit-dir" (OuterVolumeSpecName: "audit-dir") pod "fe4742fa-f04b-43cd-a67d-ba9f09ceb024" (UID: "fe4742fa-f04b-43cd-a67d-ba9f09ceb024"). InnerVolumeSpecName "audit-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:38:19.456983 master-0 kubenswrapper[8993]: I1204 11:38:19.456360 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fe4742fa-f04b-43cd-a67d-ba9f09ceb024" (UID: "fe4742fa-f04b-43cd-a67d-ba9f09ceb024"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:38:19.457307 master-0 kubenswrapper[8993]: I1204 11:38:19.457259 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-etcd-serving-ca" (OuterVolumeSpecName: "etcd-serving-ca") pod "fe4742fa-f04b-43cd-a67d-ba9f09ceb024" (UID: "fe4742fa-f04b-43cd-a67d-ba9f09ceb024"). InnerVolumeSpecName "etcd-serving-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:38:19.457567 master-0 kubenswrapper[8993]: I1204 11:38:19.457519 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "69640270-09e6-4217-b1c8-3d3465c0c3ae" (UID: "69640270-09e6-4217-b1c8-3d3465c0c3ae"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 11:38:19.458055 master-0 kubenswrapper[8993]: I1204 11:38:19.457972 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-node-pullsecrets" (OuterVolumeSpecName: "node-pullsecrets") pod "fe4742fa-f04b-43cd-a67d-ba9f09ceb024" (UID: "fe4742fa-f04b-43cd-a67d-ba9f09ceb024"). InnerVolumeSpecName "node-pullsecrets". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:38:19.458131 master-0 kubenswrapper[8993]: I1204 11:38:19.458082 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/69640270-09e6-4217-b1c8-3d3465c0c3ae-etc-ssl-certs" (OuterVolumeSpecName: "etc-ssl-certs") pod "69640270-09e6-4217-b1c8-3d3465c0c3ae" (UID: "69640270-09e6-4217-b1c8-3d3465c0c3ae"). InnerVolumeSpecName "etc-ssl-certs". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:38:19.461074 master-0 kubenswrapper[8993]: I1204 11:38:19.460964 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-encryption-config" (OuterVolumeSpecName: "encryption-config") pod "fe4742fa-f04b-43cd-a67d-ba9f09ceb024" (UID: "fe4742fa-f04b-43cd-a67d-ba9f09ceb024"). InnerVolumeSpecName "encryption-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 11:38:19.466754 master-0 kubenswrapper[8993]: I1204 11:38:19.466646 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-config" (OuterVolumeSpecName: "config") pod "fe4742fa-f04b-43cd-a67d-ba9f09ceb024" (UID: "fe4742fa-f04b-43cd-a67d-ba9f09ceb024"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:38:19.482060 master-0 kubenswrapper[8993]: I1204 11:38:19.469371 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69640270-09e6-4217-b1c8-3d3465c0c3ae-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "69640270-09e6-4217-b1c8-3d3465c0c3ae" (UID: "69640270-09e6-4217-b1c8-3d3465c0c3ae"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:38:19.482060 master-0 kubenswrapper[8993]: I1204 11:38:19.471653 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-kube-api-access-5bjrs" (OuterVolumeSpecName: "kube-api-access-5bjrs") pod "fe4742fa-f04b-43cd-a67d-ba9f09ceb024" (UID: "fe4742fa-f04b-43cd-a67d-ba9f09ceb024"). InnerVolumeSpecName "kube-api-access-5bjrs". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:38:19.482060 master-0 kubenswrapper[8993]: I1204 11:38:19.471788 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-etcd-client" (OuterVolumeSpecName: "etcd-client") pod "fe4742fa-f04b-43cd-a67d-ba9f09ceb024" (UID: "fe4742fa-f04b-43cd-a67d-ba9f09ceb024"). InnerVolumeSpecName "etcd-client". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 11:38:19.482060 master-0 kubenswrapper[8993]: I1204 11:38:19.472220 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "fe4742fa-f04b-43cd-a67d-ba9f09ceb024" (UID: "fe4742fa-f04b-43cd-a67d-ba9f09ceb024"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 11:38:19.553944 master-0 kubenswrapper[8993]: I1204 11:38:19.552792 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit\") pod \"apiserver-97f98c4dd-r2hjk\" (UID: \"fe4742fa-f04b-43cd-a67d-ba9f09ceb024\") " pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:19.553944 master-0 kubenswrapper[8993]: I1204 11:38:19.552974 8993 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:19.553944 master-0 kubenswrapper[8993]: I1204 11:38:19.552988 8993 reconciler_common.go:293] "Volume detached for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-node-pullsecrets\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:19.553944 master-0 kubenswrapper[8993]: I1204 11:38:19.552998 8993 reconciler_common.go:293] "Volume detached for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-etcd-client\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:19.553944 master-0 kubenswrapper[8993]: I1204 11:38:19.553012 8993 reconciler_common.go:293] "Volume detached for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-encryption-config\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:19.553944 master-0 kubenswrapper[8993]: I1204 11:38:19.553021 8993 reconciler_common.go:293] "Volume detached for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/69640270-09e6-4217-b1c8-3d3465c0c3ae-etc-ssl-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:19.553944 master-0 kubenswrapper[8993]: I1204 11:38:19.553030 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/69640270-09e6-4217-b1c8-3d3465c0c3ae-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:19.553944 master-0 kubenswrapper[8993]: I1204 11:38:19.553039 8993 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69640270-09e6-4217-b1c8-3d3465c0c3ae-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:19.553944 master-0 kubenswrapper[8993]: I1204 11:38:19.553055 8993 reconciler_common.go:293] "Volume detached for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/69640270-09e6-4217-b1c8-3d3465c0c3ae-etc-cvo-updatepayloads\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:19.553944 master-0 kubenswrapper[8993]: I1204 11:38:19.553076 8993 reconciler_common.go:293] "Volume detached for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-image-import-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:19.553944 master-0 kubenswrapper[8993]: I1204 11:38:19.553084 8993 reconciler_common.go:293] "Volume detached for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:19.553944 master-0 kubenswrapper[8993]: I1204 11:38:19.553093 8993 reconciler_common.go:293] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69640270-09e6-4217-b1c8-3d3465c0c3ae-service-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:19.553944 master-0 kubenswrapper[8993]: I1204 11:38:19.553103 8993 reconciler_common.go:293] "Volume detached for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-etcd-serving-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:19.553944 master-0 kubenswrapper[8993]: I1204 11:38:19.553114 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5bjrs\" (UniqueName: \"kubernetes.io/projected/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-kube-api-access-5bjrs\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:19.553944 master-0 kubenswrapper[8993]: I1204 11:38:19.553135 8993 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:19.553944 master-0 kubenswrapper[8993]: I1204 11:38:19.553147 8993 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-config\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:19.553944 master-0 kubenswrapper[8993]: E1204 11:38:19.553256 8993 configmap.go:193] Couldn't get configMap openshift-apiserver/audit-0: configmap "audit-0" not found Dec 04 11:38:19.553944 master-0 kubenswrapper[8993]: E1204 11:38:19.553330 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit podName:fe4742fa-f04b-43cd-a67d-ba9f09ceb024 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:35.553303943 +0000 UTC m=+49.944245376 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "audit" (UniqueName: "kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit") pod "apiserver-97f98c4dd-r2hjk" (UID: "fe4742fa-f04b-43cd-a67d-ba9f09ceb024") : configmap "audit-0" not found Dec 04 11:38:19.680467 master-0 kubenswrapper[8993]: I1204 11:38:19.680366 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn"] Dec 04 11:38:19.680840 master-0 kubenswrapper[8993]: I1204 11:38:19.680828 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q"] Dec 04 11:38:19.808104 master-0 kubenswrapper[8993]: I1204 11:38:19.800871 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="775079db-8c67-4d06-87fb-53ee469e8945" path="/var/lib/kubelet/pods/775079db-8c67-4d06-87fb-53ee469e8945/volumes" Dec 04 11:38:19.808104 master-0 kubenswrapper[8993]: I1204 11:38:19.801214 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d934e427-6a74-48cf-987b-adda550c31b6" path="/var/lib/kubelet/pods/d934e427-6a74-48cf-987b-adda550c31b6/volumes" Dec 04 11:38:19.864250 master-0 kubenswrapper[8993]: W1204 11:38:19.864179 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08550069_c1a1_475e_84a2_e56905f1ed38.slice/crio-7458153a023b91d017eed71d76df09c0bc8fa59fa08b1c40a9a1e8366760b372 WatchSource:0}: Error finding container 7458153a023b91d017eed71d76df09c0bc8fa59fa08b1c40a9a1e8366760b372: Status 404 returned error can't find the container with id 7458153a023b91d017eed71d76df09c0bc8fa59fa08b1c40a9a1e8366760b372 Dec 04 11:38:19.864921 master-0 kubenswrapper[8993]: I1204 11:38:19.864882 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-multus/multus-admission-controller-7dfc5b745f-258xq"] Dec 04 11:38:19.865362 master-0 kubenswrapper[8993]: W1204 11:38:19.865317 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4639ea5a_0121_4855_8b9a_3af7487fdec4.slice/crio-93b1aeed7fbf7aa2163f672dace96f59ee5784ac761cd6abcc71854bbbee95c3 WatchSource:0}: Error finding container 93b1aeed7fbf7aa2163f672dace96f59ee5784ac761cd6abcc71854bbbee95c3: Status 404 returned error can't find the container with id 93b1aeed7fbf7aa2163f672dace96f59ee5784ac761cd6abcc71854bbbee95c3 Dec 04 11:38:19.866778 master-0 kubenswrapper[8993]: I1204 11:38:19.866716 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h"] Dec 04 11:38:20.007872 master-0 kubenswrapper[8993]: I1204 11:38:20.007511 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gp57t"] Dec 04 11:38:20.020838 master-0 kubenswrapper[8993]: I1204 11:38:20.011819 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf"] Dec 04 11:38:20.020838 master-0 kubenswrapper[8993]: I1204 11:38:20.011893 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g"] Dec 04 11:38:20.020838 master-0 kubenswrapper[8993]: I1204 11:38:20.011912 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll"] Dec 04 11:38:20.020838 master-0 kubenswrapper[8993]: I1204 11:38:20.013372 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/marketplace-operator-f797b99b6-hjjrk"] Dec 04 11:38:20.034348 master-0 kubenswrapper[8993]: W1204 11:38:20.032963 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd0c3bfe_7dc3_4996_aa80_1ad438dca0b9.slice/crio-633c1d5f3a3bae71b1e74d7bb8c0b438d99900f59c81ad94f6fad5a2189395ea WatchSource:0}: Error finding container 633c1d5f3a3bae71b1e74d7bb8c0b438d99900f59c81ad94f6fad5a2189395ea: Status 404 returned error can't find the container with id 633c1d5f3a3bae71b1e74d7bb8c0b438d99900f59c81ad94f6fad5a2189395ea Dec 04 11:38:20.035191 master-0 kubenswrapper[8993]: W1204 11:38:20.035125 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8fca733_45c8_45b8_8653_ac204e7c6098.slice/crio-d1fbec2f91180eb6330203120902a7c2d9e5600f6e157a2c0cffd49f47e5d173 WatchSource:0}: Error finding container d1fbec2f91180eb6330203120902a7c2d9e5600f6e157a2c0cffd49f47e5d173: Status 404 returned error can't find the container with id d1fbec2f91180eb6330203120902a7c2d9e5600f6e157a2c0cffd49f47e5d173 Dec 04 11:38:20.225349 master-0 kubenswrapper[8993]: I1204 11:38:20.225196 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-666dcff694-54zwc"] Dec 04 11:38:20.226449 master-0 kubenswrapper[8993]: I1204 11:38:20.226425 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t"] Dec 04 11:38:20.227516 master-0 kubenswrapper[8993]: I1204 11:38:20.227464 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv"] Dec 04 11:38:20.253750 master-0 kubenswrapper[8993]: I1204 11:38:20.253691 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" event={"ID":"4639ea5a-0121-4855-8b9a-3af7487fdec4","Type":"ContainerStarted","Data":"93b1aeed7fbf7aa2163f672dace96f59ee5784ac761cd6abcc71854bbbee95c3"} Dec 04 11:38:20.256593 master-0 kubenswrapper[8993]: I1204 11:38:20.256277 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" event={"ID":"7c017c69-b24e-4a7a-b888-133bed34c174","Type":"ContainerStarted","Data":"daa9534f34c458fdc0da15b1b3ebedc6b05698aa07f60b29fe05d4f6fdb4d999"} Dec 04 11:38:20.256593 master-0 kubenswrapper[8993]: I1204 11:38:20.256316 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" event={"ID":"7c017c69-b24e-4a7a-b888-133bed34c174","Type":"ContainerStarted","Data":"e26a41e221127ea183a0c8443cd5fb4b7b8e754ae6da365530ffa8e0051ef459"} Dec 04 11:38:20.259953 master-0 kubenswrapper[8993]: I1204 11:38:20.258303 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" event={"ID":"fd4c4c6f-380a-4cda-9a21-352b55ec2d98","Type":"ContainerStarted","Data":"d87bd21afe82e9e2b6c4d808bf699abec2e43c9e57cadeb786171c447db8bbfe"} Dec 04 11:38:20.262375 master-0 kubenswrapper[8993]: I1204 11:38:20.261369 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" event={"ID":"b011b1f1-3235-4e20-825b-ce711c052407","Type":"ContainerStarted","Data":"51cef92d704724c90de3ae256673cce5ec9954aeee7c8eb66419deadfabecfec"} Dec 04 11:38:20.262375 master-0 kubenswrapper[8993]: I1204 11:38:20.261410 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" event={"ID":"b011b1f1-3235-4e20-825b-ce711c052407","Type":"ContainerStarted","Data":"8c8f5ab95655b4b56cfeec6bbc9fe176ccf7048325a2476ad9f982e855b05fb0"} Dec 04 11:38:20.272485 master-0 kubenswrapper[8993]: I1204 11:38:20.272141 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" event={"ID":"7bf67a51-9759-4e2a-a2ae-ef7416cad43f","Type":"ContainerStarted","Data":"9209d07e9d452425b2d2ddf357828c438f519980e0dbf9221a16c945f07adb72"} Dec 04 11:38:20.274298 master-0 kubenswrapper[8993]: I1204 11:38:20.274258 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" event={"ID":"434ed9b9-715b-455b-867c-775b256df40f","Type":"ContainerStarted","Data":"dc99390b4f6b05b78c6da98b65609309d92ed4065939c3774e5b8b38d407bec6"} Dec 04 11:38:20.277253 master-0 kubenswrapper[8993]: I1204 11:38:20.277188 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" event={"ID":"69640270-09e6-4217-b1c8-3d3465c0c3ae","Type":"ContainerDied","Data":"8a30f468c810c7517b6d7ce7be8593935cc7f7e8c940f4af8bd6dfdbb4ab9d60"} Dec 04 11:38:20.277253 master-0 kubenswrapper[8993]: I1204 11:38:20.277235 8993 scope.go:117] "RemoveContainer" containerID="72267672c37ea5ea5121bfc6098f5ca0a616e150a2f0b617b4e3f39d2cb68626" Dec 04 11:38:20.277519 master-0 kubenswrapper[8993]: I1204 11:38:20.277355 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd" Dec 04 11:38:20.281919 master-0 kubenswrapper[8993]: I1204 11:38:20.281173 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" event={"ID":"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46","Type":"ContainerStarted","Data":"f7a477bc11228fdd4daa26111c6364c8fa4e63910f723a8777b94d79118850dc"} Dec 04 11:38:20.281919 master-0 kubenswrapper[8993]: I1204 11:38:20.281205 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" event={"ID":"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46","Type":"ContainerStarted","Data":"c76231902c039c32af3a18ebabd11c0b9524870e040b7e0b95b175ee636d58b0"} Dec 04 11:38:20.286701 master-0 kubenswrapper[8993]: I1204 11:38:20.286653 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" event={"ID":"2ab26ae5-0607-4dfd-840e-531d204b5030","Type":"ContainerStarted","Data":"9f0c60cb6b9dab33f815706515da2ff65774b603ef38e904976aabef8f51a1be"} Dec 04 11:38:20.288695 master-0 kubenswrapper[8993]: I1204 11:38:20.288661 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" event={"ID":"08550069-c1a1-475e-84a2-e56905f1ed38","Type":"ContainerStarted","Data":"7458153a023b91d017eed71d76df09c0bc8fa59fa08b1c40a9a1e8366760b372"} Dec 04 11:38:20.291554 master-0 kubenswrapper[8993]: I1204 11:38:20.291523 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gp57t" event={"ID":"d8fca733-45c8-45b8-8653-ac204e7c6098","Type":"ContainerStarted","Data":"d1fbec2f91180eb6330203120902a7c2d9e5600f6e157a2c0cffd49f47e5d173"} Dec 04 11:38:20.296224 master-0 kubenswrapper[8993]: I1204 11:38:20.295832 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-1-master-0" event={"ID":"f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3","Type":"ContainerStarted","Data":"20848d27653bd7e506c71f074203dfd9a4dbef438e1f6edd38d28115690cb4d7"} Dec 04 11:38:20.296224 master-0 kubenswrapper[8993]: I1204 11:38:20.295863 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-1-master-0" event={"ID":"f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3","Type":"ContainerStarted","Data":"85449a546194f1b7d82572b88b05b009dbf13dc608b9793959a5abd709bf99f0"} Dec 04 11:38:20.299464 master-0 kubenswrapper[8993]: I1204 11:38:20.298943 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-97f98c4dd-r2hjk" Dec 04 11:38:20.300795 master-0 kubenswrapper[8993]: I1204 11:38:20.299887 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" event={"ID":"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9","Type":"ContainerStarted","Data":"633c1d5f3a3bae71b1e74d7bb8c0b438d99900f59c81ad94f6fad5a2189395ea"} Dec 04 11:38:20.494132 master-0 kubenswrapper[8993]: I1204 11:38:20.494037 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd/installer-1-master-0" podStartSLOduration=15.494003188 podStartE2EDuration="15.494003188s" podCreationTimestamp="2025-12-04 11:38:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:38:20.493109289 +0000 UTC m=+34.884050732" watchObservedRunningTime="2025-12-04 11:38:20.494003188 +0000 UTC m=+34.884944621" Dec 04 11:38:20.529573 master-0 kubenswrapper[8993]: I1204 11:38:20.529502 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd"] Dec 04 11:38:20.560834 master-0 kubenswrapper[8993]: I1204 11:38:20.556827 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-cluster-version/cluster-version-operator-77dfcc565f-nqpsd"] Dec 04 11:38:20.647828 master-0 kubenswrapper[8993]: I1204 11:38:20.646211 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-apiserver/apiserver-97f98c4dd-r2hjk"] Dec 04 11:38:20.647828 master-0 kubenswrapper[8993]: I1204 11:38:20.646292 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-apiserver/apiserver-97f98c4dd-r2hjk"] Dec 04 11:38:20.690995 master-0 kubenswrapper[8993]: I1204 11:38:20.690946 8993 reconciler_common.go:293] "Volume detached for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/fe4742fa-f04b-43cd-a67d-ba9f09ceb024-audit\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:20.804212 master-0 kubenswrapper[8993]: I1204 11:38:20.803667 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx"] Dec 04 11:38:20.804212 master-0 kubenswrapper[8993]: E1204 11:38:20.803973 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="69640270-09e6-4217-b1c8-3d3465c0c3ae" containerName="cluster-version-operator" Dec 04 11:38:20.804212 master-0 kubenswrapper[8993]: I1204 11:38:20.803990 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="69640270-09e6-4217-b1c8-3d3465c0c3ae" containerName="cluster-version-operator" Dec 04 11:38:20.804212 master-0 kubenswrapper[8993]: I1204 11:38:20.804083 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="69640270-09e6-4217-b1c8-3d3465c0c3ae" containerName="cluster-version-operator" Dec 04 11:38:20.804840 master-0 kubenswrapper[8993]: I1204 11:38:20.804522 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:38:20.813416 master-0 kubenswrapper[8993]: I1204 11:38:20.807091 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-apiserver/apiserver-6cbcc775d9-jrlx4"] Dec 04 11:38:20.813416 master-0 kubenswrapper[8993]: I1204 11:38:20.807775 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-version"/"cluster-version-operator-serving-cert" Dec 04 11:38:20.813416 master-0 kubenswrapper[8993]: I1204 11:38:20.808032 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:20.813416 master-0 kubenswrapper[8993]: I1204 11:38:20.811073 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"kube-root-ca.crt" Dec 04 11:38:20.814132 master-0 kubenswrapper[8993]: I1204 11:38:20.814080 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"encryption-config-1" Dec 04 11:38:20.819284 master-0 kubenswrapper[8993]: I1204 11:38:20.815161 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"image-import-ca" Dec 04 11:38:20.819284 master-0 kubenswrapper[8993]: I1204 11:38:20.815303 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"etcd-client" Dec 04 11:38:20.819284 master-0 kubenswrapper[8993]: I1204 11:38:20.815461 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"serving-cert" Dec 04 11:38:20.819284 master-0 kubenswrapper[8993]: I1204 11:38:20.816401 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"openshift-service-ca.crt" Dec 04 11:38:20.825018 master-0 kubenswrapper[8993]: I1204 11:38:20.824954 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"etcd-serving-ca" Dec 04 11:38:20.827361 master-0 kubenswrapper[8993]: I1204 11:38:20.825902 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"config" Dec 04 11:38:20.827361 master-0 kubenswrapper[8993]: I1204 11:38:20.826869 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"kube-root-ca.crt" Dec 04 11:38:20.827472 master-0 kubenswrapper[8993]: I1204 11:38:20.827379 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"audit-1" Dec 04 11:38:20.828130 master-0 kubenswrapper[8993]: I1204 11:38:20.828027 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xg7vh"] Dec 04 11:38:20.828418 master-0 kubenswrapper[8993]: I1204 11:38:20.828390 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"openshift-service-ca.crt" Dec 04 11:38:20.831865 master-0 kubenswrapper[8993]: I1204 11:38:20.831798 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver/apiserver-6cbcc775d9-jrlx4"] Dec 04 11:38:20.831968 master-0 kubenswrapper[8993]: I1204 11:38:20.831949 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xg7vh" Dec 04 11:38:20.833525 master-0 kubenswrapper[8993]: I1204 11:38:20.832740 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xg7vh"] Dec 04 11:38:20.835014 master-0 kubenswrapper[8993]: I1204 11:38:20.834980 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns"/"dns-default-metrics-tls" Dec 04 11:38:20.874409 master-0 kubenswrapper[8993]: I1204 11:38:20.874360 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"openshift-service-ca.crt" Dec 04 11:38:20.874671 master-0 kubenswrapper[8993]: I1204 11:38:20.874631 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"dns-default" Dec 04 11:38:20.874853 master-0 kubenswrapper[8993]: I1204 11:38:20.874533 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"trusted-ca-bundle" Dec 04 11:38:20.874957 master-0 kubenswrapper[8993]: I1204 11:38:20.874594 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"kube-root-ca.crt" Dec 04 11:38:20.900042 master-0 kubenswrapper[8993]: I1204 11:38:20.899992 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae-metrics-tls\") pod \"dns-default-xg7vh\" (UID: \"0c092f5d-bd33-4d91-9206-ce9c0b9e1aae\") " pod="openshift-dns/dns-default-xg7vh" Dec 04 11:38:20.900334 master-0 kubenswrapper[8993]: I1204 11:38:20.900307 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/7ec61be5-32f9-4aac-815f-41d173213107-node-pullsecrets\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:20.900447 master-0 kubenswrapper[8993]: I1204 11:38:20.900428 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-trusted-ca-bundle\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:20.900665 master-0 kubenswrapper[8993]: I1204 11:38:20.900641 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-audit\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:20.900881 master-0 kubenswrapper[8993]: I1204 11:38:20.900840 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2bpn\" (UniqueName: \"kubernetes.io/projected/7ec61be5-32f9-4aac-815f-41d173213107-kube-api-access-p2bpn\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:20.901057 master-0 kubenswrapper[8993]: I1204 11:38:20.901018 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae-config-volume\") pod \"dns-default-xg7vh\" (UID: \"0c092f5d-bd33-4d91-9206-ce9c0b9e1aae\") " pod="openshift-dns/dns-default-xg7vh" Dec 04 11:38:20.901172 master-0 kubenswrapper[8993]: I1204 11:38:20.901155 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a399a87b-8153-4045-a8d3-63fd88ae280f-kube-api-access\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:38:20.901487 master-0 kubenswrapper[8993]: I1204 11:38:20.901468 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a399a87b-8153-4045-a8d3-63fd88ae280f-serving-cert\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:38:20.901594 master-0 kubenswrapper[8993]: I1204 11:38:20.901577 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/7ec61be5-32f9-4aac-815f-41d173213107-etcd-client\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:20.901822 master-0 kubenswrapper[8993]: I1204 11:38:20.901787 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/7ec61be5-32f9-4aac-815f-41d173213107-audit-dir\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:20.901936 master-0 kubenswrapper[8993]: I1204 11:38:20.901919 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tltk9\" (UniqueName: \"kubernetes.io/projected/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae-kube-api-access-tltk9\") pod \"dns-default-xg7vh\" (UID: \"0c092f5d-bd33-4d91-9206-ce9c0b9e1aae\") " pod="openshift-dns/dns-default-xg7vh" Dec 04 11:38:20.902039 master-0 kubenswrapper[8993]: I1204 11:38:20.902019 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ec61be5-32f9-4aac-815f-41d173213107-serving-cert\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:20.902150 master-0 kubenswrapper[8993]: I1204 11:38:20.902129 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/a399a87b-8153-4045-a8d3-63fd88ae280f-etc-cvo-updatepayloads\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:38:20.902276 master-0 kubenswrapper[8993]: I1204 11:38:20.902256 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-image-import-ca\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:20.902439 master-0 kubenswrapper[8993]: I1204 11:38:20.902420 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-etcd-serving-ca\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:20.902558 master-0 kubenswrapper[8993]: I1204 11:38:20.902541 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/a399a87b-8153-4045-a8d3-63fd88ae280f-etc-ssl-certs\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:38:20.902684 master-0 kubenswrapper[8993]: I1204 11:38:20.902662 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a399a87b-8153-4045-a8d3-63fd88ae280f-service-ca\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:38:20.902822 master-0 kubenswrapper[8993]: I1204 11:38:20.902789 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/7ec61be5-32f9-4aac-815f-41d173213107-encryption-config\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:20.902981 master-0 kubenswrapper[8993]: I1204 11:38:20.902922 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-config\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:20.964927 master-0 kubenswrapper[8993]: I1204 11:38:20.959107 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.003919 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-config\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.003978 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae-metrics-tls\") pod \"dns-default-xg7vh\" (UID: \"0c092f5d-bd33-4d91-9206-ce9c0b9e1aae\") " pod="openshift-dns/dns-default-xg7vh" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.004834 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-config\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.004919 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/7ec61be5-32f9-4aac-815f-41d173213107-node-pullsecrets\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.004988 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-trusted-ca-bundle\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.005046 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-audit\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.005089 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae-config-volume\") pod \"dns-default-xg7vh\" (UID: \"0c092f5d-bd33-4d91-9206-ce9c0b9e1aae\") " pod="openshift-dns/dns-default-xg7vh" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.005116 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p2bpn\" (UniqueName: \"kubernetes.io/projected/7ec61be5-32f9-4aac-815f-41d173213107-kube-api-access-p2bpn\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.005168 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a399a87b-8153-4045-a8d3-63fd88ae280f-kube-api-access\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.005201 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a399a87b-8153-4045-a8d3-63fd88ae280f-serving-cert\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.005226 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/7ec61be5-32f9-4aac-815f-41d173213107-etcd-client\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.005259 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/7ec61be5-32f9-4aac-815f-41d173213107-audit-dir\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.005288 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tltk9\" (UniqueName: \"kubernetes.io/projected/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae-kube-api-access-tltk9\") pod \"dns-default-xg7vh\" (UID: \"0c092f5d-bd33-4d91-9206-ce9c0b9e1aae\") " pod="openshift-dns/dns-default-xg7vh" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.005322 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ec61be5-32f9-4aac-815f-41d173213107-serving-cert\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.005368 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/a399a87b-8153-4045-a8d3-63fd88ae280f-etc-cvo-updatepayloads\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.005400 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-image-import-ca\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.005431 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-etcd-serving-ca\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.005467 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/a399a87b-8153-4045-a8d3-63fd88ae280f-etc-ssl-certs\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.005505 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a399a87b-8153-4045-a8d3-63fd88ae280f-service-ca\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.005539 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/7ec61be5-32f9-4aac-815f-41d173213107-encryption-config\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.006754 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/a399a87b-8153-4045-a8d3-63fd88ae280f-etc-cvo-updatepayloads\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.006796 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae-config-volume\") pod \"dns-default-xg7vh\" (UID: \"0c092f5d-bd33-4d91-9206-ce9c0b9e1aae\") " pod="openshift-dns/dns-default-xg7vh" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.006830 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/7ec61be5-32f9-4aac-815f-41d173213107-audit-dir\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.007907 master-0 kubenswrapper[8993]: I1204 11:38:21.007341 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-trusted-ca-bundle\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.008945 master-0 kubenswrapper[8993]: I1204 11:38:21.008251 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-image-import-ca\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.008945 master-0 kubenswrapper[8993]: E1204 11:38:21.008282 8993 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Dec 04 11:38:21.008945 master-0 kubenswrapper[8993]: I1204 11:38:21.008335 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-etcd-serving-ca\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.008945 master-0 kubenswrapper[8993]: E1204 11:38:21.008361 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae-metrics-tls podName:0c092f5d-bd33-4d91-9206-ce9c0b9e1aae nodeName:}" failed. No retries permitted until 2025-12-04 11:38:21.508337102 +0000 UTC m=+35.899278625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae-metrics-tls") pod "dns-default-xg7vh" (UID: "0c092f5d-bd33-4d91-9206-ce9c0b9e1aae") : secret "dns-default-metrics-tls" not found Dec 04 11:38:21.008945 master-0 kubenswrapper[8993]: I1204 11:38:21.008751 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/7ec61be5-32f9-4aac-815f-41d173213107-node-pullsecrets\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.008945 master-0 kubenswrapper[8993]: I1204 11:38:21.008915 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/a399a87b-8153-4045-a8d3-63fd88ae280f-etc-ssl-certs\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:38:21.009290 master-0 kubenswrapper[8993]: I1204 11:38:21.009264 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-audit\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.009478 master-0 kubenswrapper[8993]: I1204 11:38:21.009442 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a399a87b-8153-4045-a8d3-63fd88ae280f-service-ca\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:38:21.018312 master-0 kubenswrapper[8993]: I1204 11:38:21.017762 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/7ec61be5-32f9-4aac-815f-41d173213107-etcd-client\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.018312 master-0 kubenswrapper[8993]: I1204 11:38:21.018040 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ec61be5-32f9-4aac-815f-41d173213107-serving-cert\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.036948 master-0 kubenswrapper[8993]: I1204 11:38:21.024116 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/7ec61be5-32f9-4aac-815f-41d173213107-encryption-config\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.036948 master-0 kubenswrapper[8993]: I1204 11:38:21.025497 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a399a87b-8153-4045-a8d3-63fd88ae280f-serving-cert\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:38:21.113114 master-0 kubenswrapper[8993]: I1204 11:38:21.112419 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tltk9\" (UniqueName: \"kubernetes.io/projected/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae-kube-api-access-tltk9\") pod \"dns-default-xg7vh\" (UID: \"0c092f5d-bd33-4d91-9206-ce9c0b9e1aae\") " pod="openshift-dns/dns-default-xg7vh" Dec 04 11:38:21.126992 master-0 kubenswrapper[8993]: I1204 11:38:21.125992 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2bpn\" (UniqueName: \"kubernetes.io/projected/7ec61be5-32f9-4aac-815f-41d173213107-kube-api-access-p2bpn\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.126992 master-0 kubenswrapper[8993]: I1204 11:38:21.126166 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a399a87b-8153-4045-a8d3-63fd88ae280f-kube-api-access\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:38:21.194765 master-0 kubenswrapper[8993]: I1204 11:38:21.194712 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:38:21.214763 master-0 kubenswrapper[8993]: I1204 11:38:21.214700 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:21.222263 master-0 kubenswrapper[8993]: W1204 11:38:21.222188 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda399a87b_8153_4045_a8d3_63fd88ae280f.slice/crio-3683b10cf07d6921c3832ff5c3c42262028823e5717156ccd7dd27d6a44a9b03 WatchSource:0}: Error finding container 3683b10cf07d6921c3832ff5c3c42262028823e5717156ccd7dd27d6a44a9b03: Status 404 returned error can't find the container with id 3683b10cf07d6921c3832ff5c3c42262028823e5717156ccd7dd27d6a44a9b03 Dec 04 11:38:21.325822 master-0 kubenswrapper[8993]: I1204 11:38:21.325740 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" event={"ID":"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488","Type":"ContainerStarted","Data":"9760331699aef8fe3de0bf48aba4d7195e92f3c02baf22a5cdc678ff360c51d4"} Dec 04 11:38:21.330176 master-0 kubenswrapper[8993]: I1204 11:38:21.330125 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" event={"ID":"1897bad8-3875-4bd6-b877-b1abe1fe76c7","Type":"ContainerStarted","Data":"9c2fc9403fab0d35870e3bc56e7a58963be646e5a41f7dc3511733d940fb3a34"} Dec 04 11:38:21.330176 master-0 kubenswrapper[8993]: I1204 11:38:21.330181 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" event={"ID":"1897bad8-3875-4bd6-b877-b1abe1fe76c7","Type":"ContainerStarted","Data":"9b1319524752363a937b5af4a730963d2a56573bdd16e93cbb4db707f16a3fba"} Dec 04 11:38:21.333852 master-0 kubenswrapper[8993]: I1204 11:38:21.333791 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" event={"ID":"ee9a47b1-cdd9-43bc-8115-8851f29106e6","Type":"ContainerStarted","Data":"72abc724ed2d61f11cccbb7ec6d373328f957dd321cb6fd0e7f3d01b800d6a97"} Dec 04 11:38:21.334009 master-0 kubenswrapper[8993]: I1204 11:38:21.333859 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" event={"ID":"ee9a47b1-cdd9-43bc-8115-8851f29106e6","Type":"ContainerStarted","Data":"12b3881df5a7c036eddc497f15dd545447cd37cf5073a1b59f0de5515580f635"} Dec 04 11:38:21.334009 master-0 kubenswrapper[8993]: I1204 11:38:21.333880 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" event={"ID":"ee9a47b1-cdd9-43bc-8115-8851f29106e6","Type":"ContainerStarted","Data":"7e5d9f59cc52a039bc3101dea9d52f4d7e3ff569f7c4b78565cd401fa0991a31"} Dec 04 11:38:21.334687 master-0 kubenswrapper[8993]: I1204 11:38:21.334634 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:21.336336 master-0 kubenswrapper[8993]: I1204 11:38:21.336284 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" event={"ID":"a399a87b-8153-4045-a8d3-63fd88ae280f","Type":"ContainerStarted","Data":"3683b10cf07d6921c3832ff5c3c42262028823e5717156ccd7dd27d6a44a9b03"} Dec 04 11:38:21.396003 master-0 kubenswrapper[8993]: I1204 11:38:21.395498 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler/installer-2-master-0"] Dec 04 11:38:21.396395 master-0 kubenswrapper[8993]: I1204 11:38:21.396260 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 11:38:21.416398 master-0 kubenswrapper[8993]: I1204 11:38:21.416308 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/installer-2-master-0"] Dec 04 11:38:21.454132 master-0 kubenswrapper[8993]: I1204 11:38:21.454046 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be8773d8-3480-4b40-aabf-132671c02553-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"be8773d8-3480-4b40-aabf-132671c02553\") " pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 11:38:21.454486 master-0 kubenswrapper[8993]: I1204 11:38:21.454134 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/be8773d8-3480-4b40-aabf-132671c02553-var-lock\") pod \"installer-2-master-0\" (UID: \"be8773d8-3480-4b40-aabf-132671c02553\") " pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 11:38:21.454486 master-0 kubenswrapper[8993]: I1204 11:38:21.454225 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/be8773d8-3480-4b40-aabf-132671c02553-kube-api-access\") pod \"installer-2-master-0\" (UID: \"be8773d8-3480-4b40-aabf-132671c02553\") " pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 11:38:21.458510 master-0 kubenswrapper[8993]: I1204 11:38:21.458394 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" podStartSLOduration=3.458369602 podStartE2EDuration="3.458369602s" podCreationTimestamp="2025-12-04 11:38:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:38:21.427112258 +0000 UTC m=+35.818053701" watchObservedRunningTime="2025-12-04 11:38:21.458369602 +0000 UTC m=+35.849311035" Dec 04 11:38:21.461823 master-0 kubenswrapper[8993]: I1204 11:38:21.461766 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-qq64m"] Dec 04 11:38:21.463399 master-0 kubenswrapper[8993]: I1204 11:38:21.462623 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qq64m" Dec 04 11:38:21.555625 master-0 kubenswrapper[8993]: I1204 11:38:21.555549 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be8773d8-3480-4b40-aabf-132671c02553-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"be8773d8-3480-4b40-aabf-132671c02553\") " pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 11:38:21.556344 master-0 kubenswrapper[8993]: I1204 11:38:21.555674 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/be8773d8-3480-4b40-aabf-132671c02553-var-lock\") pod \"installer-2-master-0\" (UID: \"be8773d8-3480-4b40-aabf-132671c02553\") " pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 11:38:21.556344 master-0 kubenswrapper[8993]: I1204 11:38:21.555716 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/be8773d8-3480-4b40-aabf-132671c02553-kube-api-access\") pod \"installer-2-master-0\" (UID: \"be8773d8-3480-4b40-aabf-132671c02553\") " pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 11:38:21.556344 master-0 kubenswrapper[8993]: I1204 11:38:21.555704 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be8773d8-3480-4b40-aabf-132671c02553-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"be8773d8-3480-4b40-aabf-132671c02553\") " pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 11:38:21.556344 master-0 kubenswrapper[8993]: I1204 11:38:21.555755 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7-hosts-file\") pod \"node-resolver-qq64m\" (UID: \"7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7\") " pod="openshift-dns/node-resolver-qq64m" Dec 04 11:38:21.556344 master-0 kubenswrapper[8993]: I1204 11:38:21.555962 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/be8773d8-3480-4b40-aabf-132671c02553-var-lock\") pod \"installer-2-master-0\" (UID: \"be8773d8-3480-4b40-aabf-132671c02553\") " pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 11:38:21.556344 master-0 kubenswrapper[8993]: I1204 11:38:21.556086 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae-metrics-tls\") pod \"dns-default-xg7vh\" (UID: \"0c092f5d-bd33-4d91-9206-ce9c0b9e1aae\") " pod="openshift-dns/dns-default-xg7vh" Dec 04 11:38:21.556344 master-0 kubenswrapper[8993]: I1204 11:38:21.556189 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmm9t\" (UniqueName: \"kubernetes.io/projected/7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7-kube-api-access-mmm9t\") pod \"node-resolver-qq64m\" (UID: \"7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7\") " pod="openshift-dns/node-resolver-qq64m" Dec 04 11:38:21.561281 master-0 kubenswrapper[8993]: I1204 11:38:21.561182 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae-metrics-tls\") pod \"dns-default-xg7vh\" (UID: \"0c092f5d-bd33-4d91-9206-ce9c0b9e1aae\") " pod="openshift-dns/dns-default-xg7vh" Dec 04 11:38:21.657440 master-0 kubenswrapper[8993]: I1204 11:38:21.657371 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mmm9t\" (UniqueName: \"kubernetes.io/projected/7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7-kube-api-access-mmm9t\") pod \"node-resolver-qq64m\" (UID: \"7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7\") " pod="openshift-dns/node-resolver-qq64m" Dec 04 11:38:21.657728 master-0 kubenswrapper[8993]: I1204 11:38:21.657479 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7-hosts-file\") pod \"node-resolver-qq64m\" (UID: \"7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7\") " pod="openshift-dns/node-resolver-qq64m" Dec 04 11:38:21.657728 master-0 kubenswrapper[8993]: I1204 11:38:21.657566 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7-hosts-file\") pod \"node-resolver-qq64m\" (UID: \"7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7\") " pod="openshift-dns/node-resolver-qq64m" Dec 04 11:38:21.669411 master-0 kubenswrapper[8993]: I1204 11:38:21.669357 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/be8773d8-3480-4b40-aabf-132671c02553-kube-api-access\") pod \"installer-2-master-0\" (UID: \"be8773d8-3480-4b40-aabf-132671c02553\") " pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 11:38:21.687841 master-0 kubenswrapper[8993]: I1204 11:38:21.681568 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmm9t\" (UniqueName: \"kubernetes.io/projected/7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7-kube-api-access-mmm9t\") pod \"node-resolver-qq64m\" (UID: \"7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7\") " pod="openshift-dns/node-resolver-qq64m" Dec 04 11:38:21.745841 master-0 kubenswrapper[8993]: I1204 11:38:21.744928 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 11:38:21.782768 master-0 kubenswrapper[8993]: I1204 11:38:21.782697 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver/apiserver-6cbcc775d9-jrlx4"] Dec 04 11:38:21.810379 master-0 kubenswrapper[8993]: I1204 11:38:21.804052 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69640270-09e6-4217-b1c8-3d3465c0c3ae" path="/var/lib/kubelet/pods/69640270-09e6-4217-b1c8-3d3465c0c3ae/volumes" Dec 04 11:38:21.810379 master-0 kubenswrapper[8993]: I1204 11:38:21.804607 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe4742fa-f04b-43cd-a67d-ba9f09ceb024" path="/var/lib/kubelet/pods/fe4742fa-f04b-43cd-a67d-ba9f09ceb024/volumes" Dec 04 11:38:21.810379 master-0 kubenswrapper[8993]: I1204 11:38:21.810352 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qq64m" Dec 04 11:38:21.834648 master-0 kubenswrapper[8993]: I1204 11:38:21.834573 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xg7vh" Dec 04 11:38:21.994737 master-0 kubenswrapper[8993]: I1204 11:38:21.994620 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/installer-2-master-0"] Dec 04 11:38:22.299241 master-0 kubenswrapper[8993]: I1204 11:38:22.299128 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xg7vh"] Dec 04 11:38:22.348131 master-0 kubenswrapper[8993]: I1204 11:38:22.348056 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qq64m" event={"ID":"7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7","Type":"ContainerStarted","Data":"474d4f9ffe7ccdfc7a57a90c2911a6db821fd6fb44f99e0d486e566260e1bcfb"} Dec 04 11:38:22.350395 master-0 kubenswrapper[8993]: I1204 11:38:22.350281 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" event={"ID":"7ec61be5-32f9-4aac-815f-41d173213107","Type":"ContainerStarted","Data":"ea46e001e83a6c3de3d0e1b94f621607bbf3b37c1d2ff600eca3937d30803913"} Dec 04 11:38:22.355321 master-0 kubenswrapper[8993]: I1204 11:38:22.355234 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" event={"ID":"1897bad8-3875-4bd6-b877-b1abe1fe76c7","Type":"ContainerStarted","Data":"2ff1bb7b9640a70f24f91de11e060c8d7d8ad652495e8fa6de3fe55f6ad72da8"} Dec 04 11:38:22.355669 master-0 kubenswrapper[8993]: I1204 11:38:22.355615 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:38:22.362692 master-0 kubenswrapper[8993]: I1204 11:38:22.362599 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" event={"ID":"a399a87b-8153-4045-a8d3-63fd88ae280f","Type":"ContainerStarted","Data":"067d901be9a85d08d5b38edc8f0dc976efa622744a3bc1f1c7a19a180b2e2f65"} Dec 04 11:38:22.397784 master-0 kubenswrapper[8993]: I1204 11:38:22.396253 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" podStartSLOduration=4.396222396 podStartE2EDuration="4.396222396s" podCreationTimestamp="2025-12-04 11:38:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:38:22.377869377 +0000 UTC m=+36.768810830" watchObservedRunningTime="2025-12-04 11:38:22.396222396 +0000 UTC m=+36.787163829" Dec 04 11:38:22.398065 master-0 kubenswrapper[8993]: I1204 11:38:22.397898 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" podStartSLOduration=2.397847738 podStartE2EDuration="2.397847738s" podCreationTimestamp="2025-12-04 11:38:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:38:22.397025472 +0000 UTC m=+36.787966915" watchObservedRunningTime="2025-12-04 11:38:22.397847738 +0000 UTC m=+36.788789171" Dec 04 11:38:22.570411 master-0 kubenswrapper[8993]: I1204 11:38:22.569696 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/installer-1-master-0"] Dec 04 11:38:22.571023 master-0 kubenswrapper[8993]: I1204 11:38:22.570446 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 11:38:22.584763 master-0 kubenswrapper[8993]: I1204 11:38:22.584287 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver"/"kube-root-ca.crt" Dec 04 11:38:22.585372 master-0 kubenswrapper[8993]: I1204 11:38:22.585295 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-1-master-0"] Dec 04 11:38:22.681402 master-0 kubenswrapper[8993]: I1204 11:38:22.681305 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/0a3dbe2b-a659-46c2-93e8-19bd30ee2260-var-lock\") pod \"installer-1-master-0\" (UID: \"0a3dbe2b-a659-46c2-93e8-19bd30ee2260\") " pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 11:38:22.681402 master-0 kubenswrapper[8993]: I1204 11:38:22.681395 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/0a3dbe2b-a659-46c2-93e8-19bd30ee2260-kube-api-access\") pod \"installer-1-master-0\" (UID: \"0a3dbe2b-a659-46c2-93e8-19bd30ee2260\") " pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 11:38:22.681826 master-0 kubenswrapper[8993]: I1204 11:38:22.681440 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0a3dbe2b-a659-46c2-93e8-19bd30ee2260-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"0a3dbe2b-a659-46c2-93e8-19bd30ee2260\") " pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 11:38:22.783103 master-0 kubenswrapper[8993]: I1204 11:38:22.782989 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0a3dbe2b-a659-46c2-93e8-19bd30ee2260-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"0a3dbe2b-a659-46c2-93e8-19bd30ee2260\") " pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 11:38:22.783206 master-0 kubenswrapper[8993]: I1204 11:38:22.783155 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0a3dbe2b-a659-46c2-93e8-19bd30ee2260-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"0a3dbe2b-a659-46c2-93e8-19bd30ee2260\") " pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 11:38:22.783296 master-0 kubenswrapper[8993]: I1204 11:38:22.783252 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/0a3dbe2b-a659-46c2-93e8-19bd30ee2260-var-lock\") pod \"installer-1-master-0\" (UID: \"0a3dbe2b-a659-46c2-93e8-19bd30ee2260\") " pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 11:38:22.783351 master-0 kubenswrapper[8993]: I1204 11:38:22.783307 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/0a3dbe2b-a659-46c2-93e8-19bd30ee2260-var-lock\") pod \"installer-1-master-0\" (UID: \"0a3dbe2b-a659-46c2-93e8-19bd30ee2260\") " pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 11:38:22.783823 master-0 kubenswrapper[8993]: I1204 11:38:22.783371 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/0a3dbe2b-a659-46c2-93e8-19bd30ee2260-kube-api-access\") pod \"installer-1-master-0\" (UID: \"0a3dbe2b-a659-46c2-93e8-19bd30ee2260\") " pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 11:38:22.801029 master-0 kubenswrapper[8993]: I1204 11:38:22.800923 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/0a3dbe2b-a659-46c2-93e8-19bd30ee2260-kube-api-access\") pod \"installer-1-master-0\" (UID: \"0a3dbe2b-a659-46c2-93e8-19bd30ee2260\") " pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 11:38:22.931675 master-0 kubenswrapper[8993]: I1204 11:38:22.930987 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 11:38:23.369914 master-0 kubenswrapper[8993]: I1204 11:38:23.369834 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xg7vh" event={"ID":"0c092f5d-bd33-4d91-9206-ce9c0b9e1aae","Type":"ContainerStarted","Data":"f79899a7403dcd84a3d96a78d16e1cbb4b992d570d19008637079be293ab8381"} Dec 04 11:38:23.425095 master-0 kubenswrapper[8993]: W1204 11:38:23.425020 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbe8773d8_3480_4b40_aabf_132671c02553.slice/crio-18226fa277d44fbf724851b7ce7889bf09cbaae7c7b6bab7b0bfffed765a202a WatchSource:0}: Error finding container 18226fa277d44fbf724851b7ce7889bf09cbaae7c7b6bab7b0bfffed765a202a: Status 404 returned error can't find the container with id 18226fa277d44fbf724851b7ce7889bf09cbaae7c7b6bab7b0bfffed765a202a Dec 04 11:38:24.392651 master-0 kubenswrapper[8993]: I1204 11:38:24.392563 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-2-master-0" event={"ID":"be8773d8-3480-4b40-aabf-132671c02553","Type":"ContainerStarted","Data":"18226fa277d44fbf724851b7ce7889bf09cbaae7c7b6bab7b0bfffed765a202a"} Dec 04 11:38:24.871877 master-0 kubenswrapper[8993]: I1204 11:38:24.871776 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-666dcff694-54zwc"] Dec 04 11:38:24.914162 master-0 kubenswrapper[8993]: I1204 11:38:24.914078 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h"] Dec 04 11:38:26.585378 master-0 kubenswrapper[8993]: I1204 11:38:26.585289 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-scheduler/installer-2-master-0"] Dec 04 11:38:27.170915 master-0 kubenswrapper[8993]: I1204 11:38:27.170727 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/installer-1-master-0"] Dec 04 11:38:27.171497 master-0 kubenswrapper[8993]: I1204 11:38:27.171457 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 11:38:27.174163 master-0 kubenswrapper[8993]: I1204 11:38:27.174117 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager"/"kube-root-ca.crt" Dec 04 11:38:27.183995 master-0 kubenswrapper[8993]: I1204 11:38:27.183922 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-1-master-0"] Dec 04 11:38:27.272254 master-0 kubenswrapper[8993]: I1204 11:38:27.272183 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/2dea9140-7c02-46cd-9b67-a2aee143c3a8-var-lock\") pod \"installer-1-master-0\" (UID: \"2dea9140-7c02-46cd-9b67-a2aee143c3a8\") " pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 11:38:27.272497 master-0 kubenswrapper[8993]: I1204 11:38:27.272312 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/2dea9140-7c02-46cd-9b67-a2aee143c3a8-kube-api-access\") pod \"installer-1-master-0\" (UID: \"2dea9140-7c02-46cd-9b67-a2aee143c3a8\") " pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 11:38:27.272497 master-0 kubenswrapper[8993]: I1204 11:38:27.272379 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2dea9140-7c02-46cd-9b67-a2aee143c3a8-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"2dea9140-7c02-46cd-9b67-a2aee143c3a8\") " pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 11:38:27.373327 master-0 kubenswrapper[8993]: I1204 11:38:27.373174 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/2dea9140-7c02-46cd-9b67-a2aee143c3a8-var-lock\") pod \"installer-1-master-0\" (UID: \"2dea9140-7c02-46cd-9b67-a2aee143c3a8\") " pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 11:38:27.373327 master-0 kubenswrapper[8993]: I1204 11:38:27.373271 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/2dea9140-7c02-46cd-9b67-a2aee143c3a8-kube-api-access\") pod \"installer-1-master-0\" (UID: \"2dea9140-7c02-46cd-9b67-a2aee143c3a8\") " pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 11:38:27.373327 master-0 kubenswrapper[8993]: I1204 11:38:27.373312 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2dea9140-7c02-46cd-9b67-a2aee143c3a8-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"2dea9140-7c02-46cd-9b67-a2aee143c3a8\") " pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 11:38:27.373991 master-0 kubenswrapper[8993]: I1204 11:38:27.373427 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2dea9140-7c02-46cd-9b67-a2aee143c3a8-kubelet-dir\") pod \"installer-1-master-0\" (UID: \"2dea9140-7c02-46cd-9b67-a2aee143c3a8\") " pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 11:38:27.373991 master-0 kubenswrapper[8993]: I1204 11:38:27.373487 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/2dea9140-7c02-46cd-9b67-a2aee143c3a8-var-lock\") pod \"installer-1-master-0\" (UID: \"2dea9140-7c02-46cd-9b67-a2aee143c3a8\") " pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 11:38:27.394589 master-0 kubenswrapper[8993]: I1204 11:38:27.394516 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/2dea9140-7c02-46cd-9b67-a2aee143c3a8-kube-api-access\") pod \"installer-1-master-0\" (UID: \"2dea9140-7c02-46cd-9b67-a2aee143c3a8\") " pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 11:38:27.511191 master-0 kubenswrapper[8993]: I1204 11:38:27.510352 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 11:38:28.797070 master-0 kubenswrapper[8993]: I1204 11:38:28.797001 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler/installer-3-master-0"] Dec 04 11:38:28.797709 master-0 kubenswrapper[8993]: I1204 11:38:28.797684 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 11:38:28.807114 master-0 kubenswrapper[8993]: I1204 11:38:28.807005 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/installer-3-master-0"] Dec 04 11:38:28.898560 master-0 kubenswrapper[8993]: I1204 11:38:28.898499 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/c26ef42b-772d-4708-9258-f19c4432cf98-kube-api-access\") pod \"installer-3-master-0\" (UID: \"c26ef42b-772d-4708-9258-f19c4432cf98\") " pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 11:38:28.898560 master-0 kubenswrapper[8993]: I1204 11:38:28.898560 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c26ef42b-772d-4708-9258-f19c4432cf98-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"c26ef42b-772d-4708-9258-f19c4432cf98\") " pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 11:38:28.898955 master-0 kubenswrapper[8993]: I1204 11:38:28.898697 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/c26ef42b-772d-4708-9258-f19c4432cf98-var-lock\") pod \"installer-3-master-0\" (UID: \"c26ef42b-772d-4708-9258-f19c4432cf98\") " pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 11:38:29.000419 master-0 kubenswrapper[8993]: I1204 11:38:29.000249 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/c26ef42b-772d-4708-9258-f19c4432cf98-var-lock\") pod \"installer-3-master-0\" (UID: \"c26ef42b-772d-4708-9258-f19c4432cf98\") " pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 11:38:29.000759 master-0 kubenswrapper[8993]: I1204 11:38:29.000452 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/c26ef42b-772d-4708-9258-f19c4432cf98-var-lock\") pod \"installer-3-master-0\" (UID: \"c26ef42b-772d-4708-9258-f19c4432cf98\") " pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 11:38:29.000759 master-0 kubenswrapper[8993]: I1204 11:38:29.000554 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/c26ef42b-772d-4708-9258-f19c4432cf98-kube-api-access\") pod \"installer-3-master-0\" (UID: \"c26ef42b-772d-4708-9258-f19c4432cf98\") " pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 11:38:29.000759 master-0 kubenswrapper[8993]: I1204 11:38:29.000592 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c26ef42b-772d-4708-9258-f19c4432cf98-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"c26ef42b-772d-4708-9258-f19c4432cf98\") " pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 11:38:29.000759 master-0 kubenswrapper[8993]: I1204 11:38:29.000742 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c26ef42b-772d-4708-9258-f19c4432cf98-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"c26ef42b-772d-4708-9258-f19c4432cf98\") " pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 11:38:29.006771 master-0 kubenswrapper[8993]: I1204 11:38:29.006708 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:38:29.020007 master-0 kubenswrapper[8993]: I1204 11:38:29.019960 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/c26ef42b-772d-4708-9258-f19c4432cf98-kube-api-access\") pod \"installer-3-master-0\" (UID: \"c26ef42b-772d-4708-9258-f19c4432cf98\") " pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 11:38:29.167953 master-0 kubenswrapper[8993]: I1204 11:38:29.167859 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 11:38:29.450535 master-0 kubenswrapper[8993]: I1204 11:38:29.450357 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:38:32.665991 master-0 kubenswrapper[8993]: I1204 11:38:32.661902 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-1-master-0"] Dec 04 11:38:32.677125 master-0 kubenswrapper[8993]: W1204 11:38:32.677049 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0a3dbe2b_a659_46c2_93e8_19bd30ee2260.slice/crio-931fd825327f937f17576e7f8284d2682a80b19af4b1c302c89fce2514617dec WatchSource:0}: Error finding container 931fd825327f937f17576e7f8284d2682a80b19af4b1c302c89fce2514617dec: Status 404 returned error can't find the container with id 931fd825327f937f17576e7f8284d2682a80b19af4b1c302c89fce2514617dec Dec 04 11:38:32.833863 master-0 kubenswrapper[8993]: I1204 11:38:32.833047 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/installer-3-master-0"] Dec 04 11:38:32.908834 master-0 kubenswrapper[8993]: W1204 11:38:32.908759 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc26ef42b_772d_4708_9258_f19c4432cf98.slice/crio-f2472f4682e1e8e3f8bb729cbae27e67f828a88c6a231750c3d0b15f03f0f09c WatchSource:0}: Error finding container f2472f4682e1e8e3f8bb729cbae27e67f828a88c6a231750c3d0b15f03f0f09c: Status 404 returned error can't find the container with id f2472f4682e1e8e3f8bb729cbae27e67f828a88c6a231750c3d0b15f03f0f09c Dec 04 11:38:33.155969 master-0 kubenswrapper[8993]: I1204 11:38:33.154252 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm"] Dec 04 11:38:33.161609 master-0 kubenswrapper[8993]: I1204 11:38:33.158535 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm" Dec 04 11:38:33.165825 master-0 kubenswrapper[8993]: I1204 11:38:33.165272 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"control-plane-machine-set-operator-tls" Dec 04 11:38:33.165825 master-0 kubenswrapper[8993]: I1204 11:38:33.165663 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-root-ca.crt" Dec 04 11:38:33.182852 master-0 kubenswrapper[8993]: I1204 11:38:33.179940 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"openshift-service-ca.crt" Dec 04 11:38:33.191912 master-0 kubenswrapper[8993]: I1204 11:38:33.189731 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-1-master-0"] Dec 04 11:38:33.192115 master-0 kubenswrapper[8993]: I1204 11:38:33.192016 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm"] Dec 04 11:38:33.216814 master-0 kubenswrapper[8993]: W1204 11:38:33.216677 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2dea9140_7c02_46cd_9b67_a2aee143c3a8.slice/crio-97e14d6795f3ba77eb346fd28cc32caafbe4ac4a888e237d49c89ec74001590a WatchSource:0}: Error finding container 97e14d6795f3ba77eb346fd28cc32caafbe4ac4a888e237d49c89ec74001590a: Status 404 returned error can't find the container with id 97e14d6795f3ba77eb346fd28cc32caafbe4ac4a888e237d49c89ec74001590a Dec 04 11:38:33.275214 master-0 kubenswrapper[8993]: I1204 11:38:33.269748 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfspg\" (UniqueName: \"kubernetes.io/projected/14bd3485-aa02-4984-b4a3-59f360b1b327-kube-api-access-nfspg\") pod \"control-plane-machine-set-operator-7df95c79b5-7w5lm\" (UID: \"14bd3485-aa02-4984-b4a3-59f360b1b327\") " pod="openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm" Dec 04 11:38:33.275214 master-0 kubenswrapper[8993]: I1204 11:38:33.269895 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/14bd3485-aa02-4984-b4a3-59f360b1b327-control-plane-machine-set-operator-tls\") pod \"control-plane-machine-set-operator-7df95c79b5-7w5lm\" (UID: \"14bd3485-aa02-4984-b4a3-59f360b1b327\") " pod="openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm" Dec 04 11:38:33.370824 master-0 kubenswrapper[8993]: I1204 11:38:33.370762 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/14bd3485-aa02-4984-b4a3-59f360b1b327-control-plane-machine-set-operator-tls\") pod \"control-plane-machine-set-operator-7df95c79b5-7w5lm\" (UID: \"14bd3485-aa02-4984-b4a3-59f360b1b327\") " pod="openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm" Dec 04 11:38:33.371047 master-0 kubenswrapper[8993]: I1204 11:38:33.370856 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nfspg\" (UniqueName: \"kubernetes.io/projected/14bd3485-aa02-4984-b4a3-59f360b1b327-kube-api-access-nfspg\") pod \"control-plane-machine-set-operator-7df95c79b5-7w5lm\" (UID: \"14bd3485-aa02-4984-b4a3-59f360b1b327\") " pod="openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm" Dec 04 11:38:33.380909 master-0 kubenswrapper[8993]: I1204 11:38:33.379756 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/14bd3485-aa02-4984-b4a3-59f360b1b327-control-plane-machine-set-operator-tls\") pod \"control-plane-machine-set-operator-7df95c79b5-7w5lm\" (UID: \"14bd3485-aa02-4984-b4a3-59f360b1b327\") " pod="openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm" Dec 04 11:38:33.454984 master-0 kubenswrapper[8993]: I1204 11:38:33.454928 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfspg\" (UniqueName: \"kubernetes.io/projected/14bd3485-aa02-4984-b4a3-59f360b1b327-kube-api-access-nfspg\") pod \"control-plane-machine-set-operator-7df95c79b5-7w5lm\" (UID: \"14bd3485-aa02-4984-b4a3-59f360b1b327\") " pod="openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm" Dec 04 11:38:33.488342 master-0 kubenswrapper[8993]: I1204 11:38:33.487972 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qq64m" event={"ID":"7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7","Type":"ContainerStarted","Data":"fe30a2395afc044b15784b56c2acd40bc0a5107c4306c61b7b1369bbba3b9665"} Dec 04 11:38:33.491032 master-0 kubenswrapper[8993]: I1204 11:38:33.490988 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" event={"ID":"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488","Type":"ContainerStarted","Data":"3adeb4fcdce3f930013f70fb01f91cd09aa3eee77796d249058496dc50773d65"} Dec 04 11:38:33.491197 master-0 kubenswrapper[8993]: I1204 11:38:33.491142 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" podUID="d9e7fd24-3079-469c-b0b7-2d3a7a7cf488" containerName="controller-manager" containerID="cri-o://3adeb4fcdce3f930013f70fb01f91cd09aa3eee77796d249058496dc50773d65" gracePeriod=30 Dec 04 11:38:33.491365 master-0 kubenswrapper[8993]: I1204 11:38:33.491218 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" Dec 04 11:38:33.493897 master-0 kubenswrapper[8993]: I1204 11:38:33.493856 8993 generic.go:334] "Generic (PLEG): container finished" podID="cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9" containerID="44d18c5f308aeaf2b863c2401d4f75bd82232506412ba0188b0eb8f15063089d" exitCode=0 Dec 04 11:38:33.494583 master-0 kubenswrapper[8993]: I1204 11:38:33.494541 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" event={"ID":"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9","Type":"ContainerDied","Data":"44d18c5f308aeaf2b863c2401d4f75bd82232506412ba0188b0eb8f15063089d"} Dec 04 11:38:33.501595 master-0 kubenswrapper[8993]: I1204 11:38:33.501548 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" Dec 04 11:38:33.508652 master-0 kubenswrapper[8993]: I1204 11:38:33.508600 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xg7vh" event={"ID":"0c092f5d-bd33-4d91-9206-ce9c0b9e1aae","Type":"ContainerStarted","Data":"0625e0e0f4c8bd31122a7d05c95061ec569f486f42cc0f6cd7a6bd83d1f1f2b7"} Dec 04 11:38:33.511449 master-0 kubenswrapper[8993]: I1204 11:38:33.510998 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gp57t" event={"ID":"d8fca733-45c8-45b8-8653-ac204e7c6098","Type":"ContainerStarted","Data":"8f8bdcdac6ef69694f78c8c1291b0fef42c58d2dbf49488855c8915dffb3b28a"} Dec 04 11:38:33.511449 master-0 kubenswrapper[8993]: I1204 11:38:33.511030 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gp57t" event={"ID":"d8fca733-45c8-45b8-8653-ac204e7c6098","Type":"ContainerStarted","Data":"e2de576795c777e806ad9920c9d716c4ae70b12ba3569c884574784c71c97e0a"} Dec 04 11:38:33.519986 master-0 kubenswrapper[8993]: I1204 11:38:33.519860 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" event={"ID":"4639ea5a-0121-4855-8b9a-3af7487fdec4","Type":"ContainerStarted","Data":"640b32bb7a423039a61f0610477c1f05fc585618f8b27b5d506a7b125a2e28b0"} Dec 04 11:38:33.519986 master-0 kubenswrapper[8993]: I1204 11:38:33.519898 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" podUID="4639ea5a-0121-4855-8b9a-3af7487fdec4" containerName="route-controller-manager" containerID="cri-o://640b32bb7a423039a61f0610477c1f05fc585618f8b27b5d506a7b125a2e28b0" gracePeriod=30 Dec 04 11:38:33.520491 master-0 kubenswrapper[8993]: I1204 11:38:33.520270 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" Dec 04 11:38:33.525749 master-0 kubenswrapper[8993]: I1204 11:38:33.525366 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" Dec 04 11:38:33.529364 master-0 kubenswrapper[8993]: I1204 11:38:33.529300 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-qq64m" podStartSLOduration=12.529282519 podStartE2EDuration="12.529282519s" podCreationTimestamp="2025-12-04 11:38:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:38:33.528616378 +0000 UTC m=+47.919557811" watchObservedRunningTime="2025-12-04 11:38:33.529282519 +0000 UTC m=+47.920223952" Dec 04 11:38:33.532630 master-0 kubenswrapper[8993]: I1204 11:38:33.532584 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" event={"ID":"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46","Type":"ContainerStarted","Data":"75e7ab729f90601f1a3824e70ddebf2fb143cea828b4fc655dacf16540161a43"} Dec 04 11:38:33.533405 master-0 kubenswrapper[8993]: I1204 11:38:33.533241 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:38:33.551011 master-0 kubenswrapper[8993]: I1204 11:38:33.550955 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-1-master-0" event={"ID":"2dea9140-7c02-46cd-9b67-a2aee143c3a8","Type":"ContainerStarted","Data":"97e14d6795f3ba77eb346fd28cc32caafbe4ac4a888e237d49c89ec74001590a"} Dec 04 11:38:33.563411 master-0 kubenswrapper[8993]: I1204 11:38:33.563130 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" event={"ID":"08550069-c1a1-475e-84a2-e56905f1ed38","Type":"ContainerStarted","Data":"150e8033295adf15ce019a92e7d442b68772928da716e398fe0f605d8a64f9e6"} Dec 04 11:38:33.563411 master-0 kubenswrapper[8993]: I1204 11:38:33.563180 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" event={"ID":"08550069-c1a1-475e-84a2-e56905f1ed38","Type":"ContainerStarted","Data":"8762d647c5e9e97a8049116602f9b1ae80da119559094578719d511b88598148"} Dec 04 11:38:33.575734 master-0 kubenswrapper[8993]: I1204 11:38:33.575271 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" podStartSLOduration=16.226887459 podStartE2EDuration="28.575247675s" podCreationTimestamp="2025-12-04 11:38:05 +0000 UTC" firstStartedPulling="2025-12-04 11:38:19.872992347 +0000 UTC m=+34.263933780" lastFinishedPulling="2025-12-04 11:38:32.221352563 +0000 UTC m=+46.612293996" observedRunningTime="2025-12-04 11:38:33.574133689 +0000 UTC m=+47.965075142" watchObservedRunningTime="2025-12-04 11:38:33.575247675 +0000 UTC m=+47.966189108" Dec 04 11:38:33.579029 master-0 kubenswrapper[8993]: I1204 11:38:33.578465 8993 generic.go:334] "Generic (PLEG): container finished" podID="7ec61be5-32f9-4aac-815f-41d173213107" containerID="2457f1970947a8a4cfd57936a0c4c7d3fd936e7b3d7af8b436e2c40036dd0011" exitCode=0 Dec 04 11:38:33.579029 master-0 kubenswrapper[8993]: I1204 11:38:33.578605 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" event={"ID":"7ec61be5-32f9-4aac-815f-41d173213107","Type":"ContainerDied","Data":"2457f1970947a8a4cfd57936a0c4c7d3fd936e7b3d7af8b436e2c40036dd0011"} Dec 04 11:38:33.592078 master-0 kubenswrapper[8993]: I1204 11:38:33.589113 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" event={"ID":"7bf67a51-9759-4e2a-a2ae-ef7416cad43f","Type":"ContainerStarted","Data":"a07b26cc0182875b44a8547a51ab37b9ecce9b325c869263f1bd9fdce8e70767"} Dec 04 11:38:33.592078 master-0 kubenswrapper[8993]: I1204 11:38:33.591169 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:38:33.600852 master-0 kubenswrapper[8993]: I1204 11:38:33.600792 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_installer-2-master-0_be8773d8-3480-4b40-aabf-132671c02553/installer/0.log" Dec 04 11:38:33.601050 master-0 kubenswrapper[8993]: I1204 11:38:33.600878 8993 generic.go:334] "Generic (PLEG): container finished" podID="be8773d8-3480-4b40-aabf-132671c02553" containerID="81ebb9073c8f04f8234c81cd00fa1c76082a4de3d67f0d299b1f7725353ad278" exitCode=1 Dec 04 11:38:33.601050 master-0 kubenswrapper[8993]: I1204 11:38:33.600998 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-2-master-0" event={"ID":"be8773d8-3480-4b40-aabf-132671c02553","Type":"ContainerDied","Data":"81ebb9073c8f04f8234c81cd00fa1c76082a4de3d67f0d299b1f7725353ad278"} Dec 04 11:38:33.611773 master-0 kubenswrapper[8993]: I1204 11:38:33.611708 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:38:33.616641 master-0 kubenswrapper[8993]: I1204 11:38:33.616549 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" event={"ID":"2ab26ae5-0607-4dfd-840e-531d204b5030","Type":"ContainerStarted","Data":"e46a607757568cd9a4789d8486763cd25cd32617c45ffebc35cc76dd338c3721"} Dec 04 11:38:33.654375 master-0 kubenswrapper[8993]: I1204 11:38:33.654322 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" event={"ID":"434ed9b9-715b-455b-867c-775b256df40f","Type":"ContainerStarted","Data":"d52940e40873ac2fe6a9577dcdb30a516bd0a393e9f0dad9fe227be657b740cf"} Dec 04 11:38:33.655498 master-0 kubenswrapper[8993]: I1204 11:38:33.655460 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:38:33.674280 master-0 kubenswrapper[8993]: I1204 11:38:33.674240 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:38:33.721323 master-0 kubenswrapper[8993]: I1204 11:38:33.721124 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" podStartSLOduration=18.532859263 podStartE2EDuration="28.721100838s" podCreationTimestamp="2025-12-04 11:38:05 +0000 UTC" firstStartedPulling="2025-12-04 11:38:20.237885194 +0000 UTC m=+34.628826637" lastFinishedPulling="2025-12-04 11:38:30.426126779 +0000 UTC m=+44.817068212" observedRunningTime="2025-12-04 11:38:33.61214964 +0000 UTC m=+48.003091093" watchObservedRunningTime="2025-12-04 11:38:33.721100838 +0000 UTC m=+48.112042281" Dec 04 11:38:33.722031 master-0 kubenswrapper[8993]: I1204 11:38:33.721973 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-1-master-0" event={"ID":"0a3dbe2b-a659-46c2-93e8-19bd30ee2260","Type":"ContainerStarted","Data":"1374a96ed1ca6171abfb891d570b17cfc8290599387bccafe504b9debca481e3"} Dec 04 11:38:33.722031 master-0 kubenswrapper[8993]: I1204 11:38:33.722028 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-1-master-0" event={"ID":"0a3dbe2b-a659-46c2-93e8-19bd30ee2260","Type":"ContainerStarted","Data":"931fd825327f937f17576e7f8284d2682a80b19af4b1c302c89fce2514617dec"} Dec 04 11:38:33.725601 master-0 kubenswrapper[8993]: I1204 11:38:33.725357 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" event={"ID":"fd4c4c6f-380a-4cda-9a21-352b55ec2d98","Type":"ContainerStarted","Data":"efdaa968c7f62ed279952ab0bc764a0bd7b1fa6435a03cf5affa209a48cd298e"} Dec 04 11:38:33.725601 master-0 kubenswrapper[8993]: I1204 11:38:33.725408 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:38:33.728332 master-0 kubenswrapper[8993]: I1204 11:38:33.728278 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-3-master-0" event={"ID":"c26ef42b-772d-4708-9258-f19c4432cf98","Type":"ContainerStarted","Data":"f2472f4682e1e8e3f8bb729cbae27e67f828a88c6a231750c3d0b15f03f0f09c"} Dec 04 11:38:33.751198 master-0 kubenswrapper[8993]: I1204 11:38:33.749460 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm" Dec 04 11:38:33.850964 master-0 kubenswrapper[8993]: I1204 11:38:33.842372 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:38:33.947704 master-0 kubenswrapper[8993]: I1204 11:38:33.947623 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/installer-1-master-0" podStartSLOduration=11.947599511 podStartE2EDuration="11.947599511s" podCreationTimestamp="2025-12-04 11:38:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:38:33.914748866 +0000 UTC m=+48.305690299" watchObservedRunningTime="2025-12-04 11:38:33.947599511 +0000 UTC m=+48.338540944" Dec 04 11:38:33.971689 master-0 kubenswrapper[8993]: I1204 11:38:33.971582 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler/installer-3-master-0" podStartSLOduration=5.97155889 podStartE2EDuration="5.97155889s" podCreationTimestamp="2025-12-04 11:38:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:38:33.948901452 +0000 UTC m=+48.339842885" watchObservedRunningTime="2025-12-04 11:38:33.97155889 +0000 UTC m=+48.362500333" Dec 04 11:38:34.123018 master-0 kubenswrapper[8993]: I1204 11:38:34.122079 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-7f22v"] Dec 04 11:38:34.127371 master-0 kubenswrapper[8993]: I1204 11:38:34.125917 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" Dec 04 11:38:34.127371 master-0 kubenswrapper[8993]: I1204 11:38:34.126342 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-7f22v" Dec 04 11:38:34.135547 master-0 kubenswrapper[8993]: I1204 11:38:34.135404 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-7f22v"] Dec 04 11:38:34.214369 master-0 kubenswrapper[8993]: I1204 11:38:34.214249 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szqm4\" (UniqueName: \"kubernetes.io/projected/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-kube-api-access-szqm4\") pod \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\" (UID: \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\") " Dec 04 11:38:34.214555 master-0 kubenswrapper[8993]: I1204 11:38:34.214376 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-config\") pod \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\" (UID: \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\") " Dec 04 11:38:34.214555 master-0 kubenswrapper[8993]: I1204 11:38:34.214448 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-proxy-ca-bundles\") pod \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\" (UID: \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\") " Dec 04 11:38:34.214555 master-0 kubenswrapper[8993]: I1204 11:38:34.214497 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-client-ca\") pod \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\" (UID: \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\") " Dec 04 11:38:34.214555 master-0 kubenswrapper[8993]: I1204 11:38:34.214526 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-serving-cert\") pod \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\" (UID: \"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488\") " Dec 04 11:38:34.214832 master-0 kubenswrapper[8993]: I1204 11:38:34.214707 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c-utilities\") pod \"redhat-operators-7f22v\" (UID: \"2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c\") " pod="openshift-marketplace/redhat-operators-7f22v" Dec 04 11:38:34.214832 master-0 kubenswrapper[8993]: I1204 11:38:34.214784 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c-catalog-content\") pod \"redhat-operators-7f22v\" (UID: \"2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c\") " pod="openshift-marketplace/redhat-operators-7f22v" Dec 04 11:38:34.214975 master-0 kubenswrapper[8993]: I1204 11:38:34.214908 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62vpr\" (UniqueName: \"kubernetes.io/projected/2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c-kube-api-access-62vpr\") pod \"redhat-operators-7f22v\" (UID: \"2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c\") " pod="openshift-marketplace/redhat-operators-7f22v" Dec 04 11:38:34.217018 master-0 kubenswrapper[8993]: I1204 11:38:34.216967 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-client-ca" (OuterVolumeSpecName: "client-ca") pod "d9e7fd24-3079-469c-b0b7-2d3a7a7cf488" (UID: "d9e7fd24-3079-469c-b0b7-2d3a7a7cf488"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:38:34.217648 master-0 kubenswrapper[8993]: I1204 11:38:34.217614 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-config" (OuterVolumeSpecName: "config") pod "d9e7fd24-3079-469c-b0b7-2d3a7a7cf488" (UID: "d9e7fd24-3079-469c-b0b7-2d3a7a7cf488"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:38:34.218223 master-0 kubenswrapper[8993]: I1204 11:38:34.218169 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "d9e7fd24-3079-469c-b0b7-2d3a7a7cf488" (UID: "d9e7fd24-3079-469c-b0b7-2d3a7a7cf488"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:38:34.266095 master-0 kubenswrapper[8993]: I1204 11:38:34.266018 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-kube-api-access-szqm4" (OuterVolumeSpecName: "kube-api-access-szqm4") pod "d9e7fd24-3079-469c-b0b7-2d3a7a7cf488" (UID: "d9e7fd24-3079-469c-b0b7-2d3a7a7cf488"). InnerVolumeSpecName "kube-api-access-szqm4". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:38:34.266684 master-0 kubenswrapper[8993]: I1204 11:38:34.266586 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "d9e7fd24-3079-469c-b0b7-2d3a7a7cf488" (UID: "d9e7fd24-3079-469c-b0b7-2d3a7a7cf488"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 11:38:34.312999 master-0 kubenswrapper[8993]: I1204 11:38:34.312638 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt"] Dec 04 11:38:34.312999 master-0 kubenswrapper[8993]: E1204 11:38:34.312898 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d9e7fd24-3079-469c-b0b7-2d3a7a7cf488" containerName="controller-manager" Dec 04 11:38:34.312999 master-0 kubenswrapper[8993]: I1204 11:38:34.312912 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9e7fd24-3079-469c-b0b7-2d3a7a7cf488" containerName="controller-manager" Dec 04 11:38:34.312999 master-0 kubenswrapper[8993]: I1204 11:38:34.312990 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="d9e7fd24-3079-469c-b0b7-2d3a7a7cf488" containerName="controller-manager" Dec 04 11:38:34.313537 master-0 kubenswrapper[8993]: I1204 11:38:34.313514 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" Dec 04 11:38:34.319690 master-0 kubenswrapper[8993]: I1204 11:38:34.316543 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c-utilities\") pod \"redhat-operators-7f22v\" (UID: \"2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c\") " pod="openshift-marketplace/redhat-operators-7f22v" Dec 04 11:38:34.319690 master-0 kubenswrapper[8993]: I1204 11:38:34.316672 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c-catalog-content\") pod \"redhat-operators-7f22v\" (UID: \"2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c\") " pod="openshift-marketplace/redhat-operators-7f22v" Dec 04 11:38:34.319690 master-0 kubenswrapper[8993]: I1204 11:38:34.317076 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-62vpr\" (UniqueName: \"kubernetes.io/projected/2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c-kube-api-access-62vpr\") pod \"redhat-operators-7f22v\" (UID: \"2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c\") " pod="openshift-marketplace/redhat-operators-7f22v" Dec 04 11:38:34.319690 master-0 kubenswrapper[8993]: I1204 11:38:34.317126 8993 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-config\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:34.319690 master-0 kubenswrapper[8993]: I1204 11:38:34.317138 8993 reconciler_common.go:293] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-proxy-ca-bundles\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:34.319690 master-0 kubenswrapper[8993]: I1204 11:38:34.317332 8993 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:34.319690 master-0 kubenswrapper[8993]: I1204 11:38:34.317341 8993 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:34.319690 master-0 kubenswrapper[8993]: I1204 11:38:34.317350 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-szqm4\" (UniqueName: \"kubernetes.io/projected/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488-kube-api-access-szqm4\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:34.319690 master-0 kubenswrapper[8993]: I1204 11:38:34.318137 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c-catalog-content\") pod \"redhat-operators-7f22v\" (UID: \"2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c\") " pod="openshift-marketplace/redhat-operators-7f22v" Dec 04 11:38:34.320647 master-0 kubenswrapper[8993]: I1204 11:38:34.320015 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c-utilities\") pod \"redhat-operators-7f22v\" (UID: \"2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c\") " pod="openshift-marketplace/redhat-operators-7f22v" Dec 04 11:38:34.327964 master-0 kubenswrapper[8993]: I1204 11:38:34.320772 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_installer-2-master-0_be8773d8-3480-4b40-aabf-132671c02553/installer/0.log" Dec 04 11:38:34.327964 master-0 kubenswrapper[8993]: I1204 11:38:34.320872 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 11:38:34.327964 master-0 kubenswrapper[8993]: I1204 11:38:34.325821 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt"] Dec 04 11:38:34.352179 master-0 kubenswrapper[8993]: I1204 11:38:34.351320 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-62vpr\" (UniqueName: \"kubernetes.io/projected/2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c-kube-api-access-62vpr\") pod \"redhat-operators-7f22v\" (UID: \"2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c\") " pod="openshift-marketplace/redhat-operators-7f22v" Dec 04 11:38:34.377010 master-0 kubenswrapper[8993]: I1204 11:38:34.376962 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" Dec 04 11:38:34.427373 master-0 kubenswrapper[8993]: I1204 11:38:34.427289 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/be8773d8-3480-4b40-aabf-132671c02553-kube-api-access\") pod \"be8773d8-3480-4b40-aabf-132671c02553\" (UID: \"be8773d8-3480-4b40-aabf-132671c02553\") " Dec 04 11:38:34.427721 master-0 kubenswrapper[8993]: I1204 11:38:34.427389 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mc8sk\" (UniqueName: \"kubernetes.io/projected/4639ea5a-0121-4855-8b9a-3af7487fdec4-kube-api-access-mc8sk\") pod \"4639ea5a-0121-4855-8b9a-3af7487fdec4\" (UID: \"4639ea5a-0121-4855-8b9a-3af7487fdec4\") " Dec 04 11:38:34.427721 master-0 kubenswrapper[8993]: I1204 11:38:34.427458 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4639ea5a-0121-4855-8b9a-3af7487fdec4-config\") pod \"4639ea5a-0121-4855-8b9a-3af7487fdec4\" (UID: \"4639ea5a-0121-4855-8b9a-3af7487fdec4\") " Dec 04 11:38:34.427721 master-0 kubenswrapper[8993]: I1204 11:38:34.427497 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/4639ea5a-0121-4855-8b9a-3af7487fdec4-client-ca\") pod \"4639ea5a-0121-4855-8b9a-3af7487fdec4\" (UID: \"4639ea5a-0121-4855-8b9a-3af7487fdec4\") " Dec 04 11:38:34.427721 master-0 kubenswrapper[8993]: I1204 11:38:34.427530 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/be8773d8-3480-4b40-aabf-132671c02553-var-lock\") pod \"be8773d8-3480-4b40-aabf-132671c02553\" (UID: \"be8773d8-3480-4b40-aabf-132671c02553\") " Dec 04 11:38:34.427721 master-0 kubenswrapper[8993]: I1204 11:38:34.427654 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4639ea5a-0121-4855-8b9a-3af7487fdec4-serving-cert\") pod \"4639ea5a-0121-4855-8b9a-3af7487fdec4\" (UID: \"4639ea5a-0121-4855-8b9a-3af7487fdec4\") " Dec 04 11:38:34.427918 master-0 kubenswrapper[8993]: I1204 11:38:34.427729 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be8773d8-3480-4b40-aabf-132671c02553-kubelet-dir\") pod \"be8773d8-3480-4b40-aabf-132671c02553\" (UID: \"be8773d8-3480-4b40-aabf-132671c02553\") " Dec 04 11:38:34.428257 master-0 kubenswrapper[8993]: I1204 11:38:34.428223 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-config\") pod \"controller-manager-7d958ff6f6-b8lzt\" (UID: \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\") " pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" Dec 04 11:38:34.428348 master-0 kubenswrapper[8993]: I1204 11:38:34.428322 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-client-ca\") pod \"controller-manager-7d958ff6f6-b8lzt\" (UID: \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\") " pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" Dec 04 11:38:34.428399 master-0 kubenswrapper[8993]: I1204 11:38:34.428374 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-serving-cert\") pod \"controller-manager-7d958ff6f6-b8lzt\" (UID: \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\") " pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" Dec 04 11:38:34.428445 master-0 kubenswrapper[8993]: I1204 11:38:34.428422 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f97cz\" (UniqueName: \"kubernetes.io/projected/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-kube-api-access-f97cz\") pod \"controller-manager-7d958ff6f6-b8lzt\" (UID: \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\") " pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" Dec 04 11:38:34.428482 master-0 kubenswrapper[8993]: I1204 11:38:34.428463 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-proxy-ca-bundles\") pod \"controller-manager-7d958ff6f6-b8lzt\" (UID: \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\") " pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" Dec 04 11:38:34.435938 master-0 kubenswrapper[8993]: I1204 11:38:34.433723 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/be8773d8-3480-4b40-aabf-132671c02553-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "be8773d8-3480-4b40-aabf-132671c02553" (UID: "be8773d8-3480-4b40-aabf-132671c02553"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:38:34.435938 master-0 kubenswrapper[8993]: I1204 11:38:34.434475 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be8773d8-3480-4b40-aabf-132671c02553-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "be8773d8-3480-4b40-aabf-132671c02553" (UID: "be8773d8-3480-4b40-aabf-132671c02553"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:38:34.435938 master-0 kubenswrapper[8993]: I1204 11:38:34.434621 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/be8773d8-3480-4b40-aabf-132671c02553-var-lock" (OuterVolumeSpecName: "var-lock") pod "be8773d8-3480-4b40-aabf-132671c02553" (UID: "be8773d8-3480-4b40-aabf-132671c02553"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:38:34.435938 master-0 kubenswrapper[8993]: I1204 11:38:34.434969 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4639ea5a-0121-4855-8b9a-3af7487fdec4-client-ca" (OuterVolumeSpecName: "client-ca") pod "4639ea5a-0121-4855-8b9a-3af7487fdec4" (UID: "4639ea5a-0121-4855-8b9a-3af7487fdec4"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:38:34.435938 master-0 kubenswrapper[8993]: I1204 11:38:34.435068 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4639ea5a-0121-4855-8b9a-3af7487fdec4-config" (OuterVolumeSpecName: "config") pod "4639ea5a-0121-4855-8b9a-3af7487fdec4" (UID: "4639ea5a-0121-4855-8b9a-3af7487fdec4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:38:34.441848 master-0 kubenswrapper[8993]: I1204 11:38:34.441746 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4639ea5a-0121-4855-8b9a-3af7487fdec4-kube-api-access-mc8sk" (OuterVolumeSpecName: "kube-api-access-mc8sk") pod "4639ea5a-0121-4855-8b9a-3af7487fdec4" (UID: "4639ea5a-0121-4855-8b9a-3af7487fdec4"). InnerVolumeSpecName "kube-api-access-mc8sk". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:38:34.453324 master-0 kubenswrapper[8993]: I1204 11:38:34.452393 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4639ea5a-0121-4855-8b9a-3af7487fdec4-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "4639ea5a-0121-4855-8b9a-3af7487fdec4" (UID: "4639ea5a-0121-4855-8b9a-3af7487fdec4"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 11:38:34.453613 master-0 kubenswrapper[8993]: I1204 11:38:34.453344 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-7f22v" Dec 04 11:38:34.530458 master-0 kubenswrapper[8993]: I1204 11:38:34.530383 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f97cz\" (UniqueName: \"kubernetes.io/projected/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-kube-api-access-f97cz\") pod \"controller-manager-7d958ff6f6-b8lzt\" (UID: \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\") " pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" Dec 04 11:38:34.530458 master-0 kubenswrapper[8993]: I1204 11:38:34.530455 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-proxy-ca-bundles\") pod \"controller-manager-7d958ff6f6-b8lzt\" (UID: \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\") " pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" Dec 04 11:38:34.532387 master-0 kubenswrapper[8993]: I1204 11:38:34.530510 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-config\") pod \"controller-manager-7d958ff6f6-b8lzt\" (UID: \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\") " pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" Dec 04 11:38:34.532387 master-0 kubenswrapper[8993]: I1204 11:38:34.530563 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-client-ca\") pod \"controller-manager-7d958ff6f6-b8lzt\" (UID: \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\") " pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" Dec 04 11:38:34.532387 master-0 kubenswrapper[8993]: I1204 11:38:34.531723 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-serving-cert\") pod \"controller-manager-7d958ff6f6-b8lzt\" (UID: \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\") " pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" Dec 04 11:38:34.532498 master-0 kubenswrapper[8993]: I1204 11:38:34.532392 8993 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be8773d8-3480-4b40-aabf-132671c02553-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:34.532498 master-0 kubenswrapper[8993]: I1204 11:38:34.532412 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/be8773d8-3480-4b40-aabf-132671c02553-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:34.532498 master-0 kubenswrapper[8993]: I1204 11:38:34.532428 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mc8sk\" (UniqueName: \"kubernetes.io/projected/4639ea5a-0121-4855-8b9a-3af7487fdec4-kube-api-access-mc8sk\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:34.532498 master-0 kubenswrapper[8993]: I1204 11:38:34.532443 8993 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4639ea5a-0121-4855-8b9a-3af7487fdec4-config\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:34.532498 master-0 kubenswrapper[8993]: I1204 11:38:34.532453 8993 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/4639ea5a-0121-4855-8b9a-3af7487fdec4-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:34.532498 master-0 kubenswrapper[8993]: I1204 11:38:34.532464 8993 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/be8773d8-3480-4b40-aabf-132671c02553-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:34.532498 master-0 kubenswrapper[8993]: I1204 11:38:34.532474 8993 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4639ea5a-0121-4855-8b9a-3af7487fdec4-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:34.533211 master-0 kubenswrapper[8993]: I1204 11:38:34.532729 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-proxy-ca-bundles\") pod \"controller-manager-7d958ff6f6-b8lzt\" (UID: \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\") " pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" Dec 04 11:38:34.537457 master-0 kubenswrapper[8993]: I1204 11:38:34.533705 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-client-ca\") pod \"controller-manager-7d958ff6f6-b8lzt\" (UID: \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\") " pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" Dec 04 11:38:34.537457 master-0 kubenswrapper[8993]: I1204 11:38:34.534574 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-config\") pod \"controller-manager-7d958ff6f6-b8lzt\" (UID: \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\") " pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" Dec 04 11:38:34.537457 master-0 kubenswrapper[8993]: I1204 11:38:34.535490 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm"] Dec 04 11:38:34.538195 master-0 kubenswrapper[8993]: I1204 11:38:34.537517 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-serving-cert\") pod \"controller-manager-7d958ff6f6-b8lzt\" (UID: \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\") " pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" Dec 04 11:38:34.553972 master-0 kubenswrapper[8993]: W1204 11:38:34.553898 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14bd3485_aa02_4984_b4a3_59f360b1b327.slice/crio-3015234670ad18f7c398b493ca22ed29544c1a67b53fd16b0177b13130626f13 WatchSource:0}: Error finding container 3015234670ad18f7c398b493ca22ed29544c1a67b53fd16b0177b13130626f13: Status 404 returned error can't find the container with id 3015234670ad18f7c398b493ca22ed29544c1a67b53fd16b0177b13130626f13 Dec 04 11:38:34.554427 master-0 kubenswrapper[8993]: I1204 11:38:34.554318 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f97cz\" (UniqueName: \"kubernetes.io/projected/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-kube-api-access-f97cz\") pod \"controller-manager-7d958ff6f6-b8lzt\" (UID: \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\") " pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" Dec 04 11:38:34.698332 master-0 kubenswrapper[8993]: I1204 11:38:34.698216 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-ghr5b"] Dec 04 11:38:34.698928 master-0 kubenswrapper[8993]: E1204 11:38:34.698512 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="be8773d8-3480-4b40-aabf-132671c02553" containerName="installer" Dec 04 11:38:34.698928 master-0 kubenswrapper[8993]: I1204 11:38:34.698529 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="be8773d8-3480-4b40-aabf-132671c02553" containerName="installer" Dec 04 11:38:34.698928 master-0 kubenswrapper[8993]: E1204 11:38:34.698539 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4639ea5a-0121-4855-8b9a-3af7487fdec4" containerName="route-controller-manager" Dec 04 11:38:34.698928 master-0 kubenswrapper[8993]: I1204 11:38:34.698549 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="4639ea5a-0121-4855-8b9a-3af7487fdec4" containerName="route-controller-manager" Dec 04 11:38:34.698928 master-0 kubenswrapper[8993]: I1204 11:38:34.698650 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="4639ea5a-0121-4855-8b9a-3af7487fdec4" containerName="route-controller-manager" Dec 04 11:38:34.698928 master-0 kubenswrapper[8993]: I1204 11:38:34.698671 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="be8773d8-3480-4b40-aabf-132671c02553" containerName="installer" Dec 04 11:38:34.710711 master-0 kubenswrapper[8993]: I1204 11:38:34.699725 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-ghr5b" Dec 04 11:38:34.710711 master-0 kubenswrapper[8993]: I1204 11:38:34.704936 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" Dec 04 11:38:34.732844 master-0 kubenswrapper[8993]: I1204 11:38:34.729139 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-ghr5b"] Dec 04 11:38:34.752841 master-0 kubenswrapper[8993]: I1204 11:38:34.736593 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc6z5\" (UniqueName: \"kubernetes.io/projected/a2aabd50-bfed-4ab5-ad19-f84ec50203ec-kube-api-access-hc6z5\") pod \"certified-operators-ghr5b\" (UID: \"a2aabd50-bfed-4ab5-ad19-f84ec50203ec\") " pod="openshift-marketplace/certified-operators-ghr5b" Dec 04 11:38:34.752841 master-0 kubenswrapper[8993]: I1204 11:38:34.736658 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a2aabd50-bfed-4ab5-ad19-f84ec50203ec-catalog-content\") pod \"certified-operators-ghr5b\" (UID: \"a2aabd50-bfed-4ab5-ad19-f84ec50203ec\") " pod="openshift-marketplace/certified-operators-ghr5b" Dec 04 11:38:34.752841 master-0 kubenswrapper[8993]: I1204 11:38:34.736690 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a2aabd50-bfed-4ab5-ad19-f84ec50203ec-utilities\") pod \"certified-operators-ghr5b\" (UID: \"a2aabd50-bfed-4ab5-ad19-f84ec50203ec\") " pod="openshift-marketplace/certified-operators-ghr5b" Dec 04 11:38:34.752841 master-0 kubenswrapper[8993]: I1204 11:38:34.742903 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xg7vh" event={"ID":"0c092f5d-bd33-4d91-9206-ce9c0b9e1aae","Type":"ContainerStarted","Data":"837602bd5dadafccf4ed90ab86380a1b344692994e946f4047947b5548e163ff"} Dec 04 11:38:34.752841 master-0 kubenswrapper[8993]: I1204 11:38:34.743116 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-dns/dns-default-xg7vh" Dec 04 11:38:34.756127 master-0 kubenswrapper[8993]: I1204 11:38:34.754740 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm" event={"ID":"14bd3485-aa02-4984-b4a3-59f360b1b327","Type":"ContainerStarted","Data":"3015234670ad18f7c398b493ca22ed29544c1a67b53fd16b0177b13130626f13"} Dec 04 11:38:34.761912 master-0 kubenswrapper[8993]: I1204 11:38:34.761604 8993 generic.go:334] "Generic (PLEG): container finished" podID="d9e7fd24-3079-469c-b0b7-2d3a7a7cf488" containerID="3adeb4fcdce3f930013f70fb01f91cd09aa3eee77796d249058496dc50773d65" exitCode=0 Dec 04 11:38:34.761912 master-0 kubenswrapper[8993]: I1204 11:38:34.761717 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" event={"ID":"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488","Type":"ContainerDied","Data":"3adeb4fcdce3f930013f70fb01f91cd09aa3eee77796d249058496dc50773d65"} Dec 04 11:38:34.761912 master-0 kubenswrapper[8993]: I1204 11:38:34.761782 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" event={"ID":"d9e7fd24-3079-469c-b0b7-2d3a7a7cf488","Type":"ContainerDied","Data":"9760331699aef8fe3de0bf48aba4d7195e92f3c02baf22a5cdc678ff360c51d4"} Dec 04 11:38:34.761912 master-0 kubenswrapper[8993]: I1204 11:38:34.761782 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-666dcff694-54zwc" Dec 04 11:38:34.761912 master-0 kubenswrapper[8993]: I1204 11:38:34.761798 8993 scope.go:117] "RemoveContainer" containerID="3adeb4fcdce3f930013f70fb01f91cd09aa3eee77796d249058496dc50773d65" Dec 04 11:38:34.770586 master-0 kubenswrapper[8993]: I1204 11:38:34.770524 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" event={"ID":"7ec61be5-32f9-4aac-815f-41d173213107","Type":"ContainerStarted","Data":"131ab88eb766b2bec357b0787e931d80b6794443e7b4c223f72442c2a3bf6ea5"} Dec 04 11:38:34.770586 master-0 kubenswrapper[8993]: I1204 11:38:34.770566 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" event={"ID":"7ec61be5-32f9-4aac-815f-41d173213107","Type":"ContainerStarted","Data":"19428b559fb7fb65d3273f1d2bf6bb3d775e7a46edc4a0efc0050ce5d4e0c696"} Dec 04 11:38:34.776371 master-0 kubenswrapper[8993]: I1204 11:38:34.776222 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-xg7vh" podStartSLOduration=5.201405129 podStartE2EDuration="14.776207227s" podCreationTimestamp="2025-12-04 11:38:20 +0000 UTC" firstStartedPulling="2025-12-04 11:38:22.780861017 +0000 UTC m=+37.171802450" lastFinishedPulling="2025-12-04 11:38:32.355663115 +0000 UTC m=+46.746604548" observedRunningTime="2025-12-04 11:38:34.773590873 +0000 UTC m=+49.164532306" watchObservedRunningTime="2025-12-04 11:38:34.776207227 +0000 UTC m=+49.167148660" Dec 04 11:38:34.780205 master-0 kubenswrapper[8993]: I1204 11:38:34.780173 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_installer-2-master-0_be8773d8-3480-4b40-aabf-132671c02553/installer/0.log" Dec 04 11:38:34.780325 master-0 kubenswrapper[8993]: I1204 11:38:34.780243 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-2-master-0" event={"ID":"be8773d8-3480-4b40-aabf-132671c02553","Type":"ContainerDied","Data":"18226fa277d44fbf724851b7ce7889bf09cbaae7c7b6bab7b0bfffed765a202a"} Dec 04 11:38:34.780427 master-0 kubenswrapper[8993]: I1204 11:38:34.780334 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-2-master-0" Dec 04 11:38:34.782232 master-0 kubenswrapper[8993]: I1204 11:38:34.782075 8993 scope.go:117] "RemoveContainer" containerID="3adeb4fcdce3f930013f70fb01f91cd09aa3eee77796d249058496dc50773d65" Dec 04 11:38:34.782631 master-0 kubenswrapper[8993]: E1204 11:38:34.782530 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3adeb4fcdce3f930013f70fb01f91cd09aa3eee77796d249058496dc50773d65\": container with ID starting with 3adeb4fcdce3f930013f70fb01f91cd09aa3eee77796d249058496dc50773d65 not found: ID does not exist" containerID="3adeb4fcdce3f930013f70fb01f91cd09aa3eee77796d249058496dc50773d65" Dec 04 11:38:34.782691 master-0 kubenswrapper[8993]: I1204 11:38:34.782565 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3adeb4fcdce3f930013f70fb01f91cd09aa3eee77796d249058496dc50773d65"} err="failed to get container status \"3adeb4fcdce3f930013f70fb01f91cd09aa3eee77796d249058496dc50773d65\": rpc error: code = NotFound desc = could not find container \"3adeb4fcdce3f930013f70fb01f91cd09aa3eee77796d249058496dc50773d65\": container with ID starting with 3adeb4fcdce3f930013f70fb01f91cd09aa3eee77796d249058496dc50773d65 not found: ID does not exist" Dec 04 11:38:34.782691 master-0 kubenswrapper[8993]: I1204 11:38:34.782688 8993 scope.go:117] "RemoveContainer" containerID="81ebb9073c8f04f8234c81cd00fa1c76082a4de3d67f0d299b1f7725353ad278" Dec 04 11:38:34.783992 master-0 kubenswrapper[8993]: I1204 11:38:34.783617 8993 generic.go:334] "Generic (PLEG): container finished" podID="4639ea5a-0121-4855-8b9a-3af7487fdec4" containerID="640b32bb7a423039a61f0610477c1f05fc585618f8b27b5d506a7b125a2e28b0" exitCode=0 Dec 04 11:38:34.783992 master-0 kubenswrapper[8993]: I1204 11:38:34.783675 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" event={"ID":"4639ea5a-0121-4855-8b9a-3af7487fdec4","Type":"ContainerDied","Data":"640b32bb7a423039a61f0610477c1f05fc585618f8b27b5d506a7b125a2e28b0"} Dec 04 11:38:34.783992 master-0 kubenswrapper[8993]: I1204 11:38:34.783705 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" event={"ID":"4639ea5a-0121-4855-8b9a-3af7487fdec4","Type":"ContainerDied","Data":"93b1aeed7fbf7aa2163f672dace96f59ee5784ac761cd6abcc71854bbbee95c3"} Dec 04 11:38:34.783992 master-0 kubenswrapper[8993]: I1204 11:38:34.783787 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h" Dec 04 11:38:34.794638 master-0 kubenswrapper[8993]: I1204 11:38:34.794195 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-1-master-0" event={"ID":"2dea9140-7c02-46cd-9b67-a2aee143c3a8","Type":"ContainerStarted","Data":"c88107d86ca094e0fb66d5f48c269fd63501da09c2e45e6167e8bdd22853011e"} Dec 04 11:38:34.814453 master-0 kubenswrapper[8993]: I1204 11:38:34.808338 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" event={"ID":"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9","Type":"ContainerStarted","Data":"510389c89ad3333a244d1038fd1e56c0815710256a1e5ead7cab9c90b03f4a41"} Dec 04 11:38:34.814453 master-0 kubenswrapper[8993]: I1204 11:38:34.810691 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" podStartSLOduration=6.241751454 podStartE2EDuration="16.810649513s" podCreationTimestamp="2025-12-04 11:38:18 +0000 UTC" firstStartedPulling="2025-12-04 11:38:21.809192977 +0000 UTC m=+36.200134410" lastFinishedPulling="2025-12-04 11:38:32.378091036 +0000 UTC m=+46.769032469" observedRunningTime="2025-12-04 11:38:34.807888095 +0000 UTC m=+49.198829528" watchObservedRunningTime="2025-12-04 11:38:34.810649513 +0000 UTC m=+49.201590946" Dec 04 11:38:34.815097 master-0 kubenswrapper[8993]: I1204 11:38:34.815026 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-3-master-0" event={"ID":"c26ef42b-772d-4708-9258-f19c4432cf98","Type":"ContainerStarted","Data":"87b326610b4da980ea18879714f675d6bb9e24b9cf46e43dd90e6c093d451fef"} Dec 04 11:38:34.846902 master-0 kubenswrapper[8993]: I1204 11:38:34.844499 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a2aabd50-bfed-4ab5-ad19-f84ec50203ec-utilities\") pod \"certified-operators-ghr5b\" (UID: \"a2aabd50-bfed-4ab5-ad19-f84ec50203ec\") " pod="openshift-marketplace/certified-operators-ghr5b" Dec 04 11:38:34.846902 master-0 kubenswrapper[8993]: I1204 11:38:34.844895 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hc6z5\" (UniqueName: \"kubernetes.io/projected/a2aabd50-bfed-4ab5-ad19-f84ec50203ec-kube-api-access-hc6z5\") pod \"certified-operators-ghr5b\" (UID: \"a2aabd50-bfed-4ab5-ad19-f84ec50203ec\") " pod="openshift-marketplace/certified-operators-ghr5b" Dec 04 11:38:34.846902 master-0 kubenswrapper[8993]: I1204 11:38:34.845015 8993 scope.go:117] "RemoveContainer" containerID="640b32bb7a423039a61f0610477c1f05fc585618f8b27b5d506a7b125a2e28b0" Dec 04 11:38:34.846902 master-0 kubenswrapper[8993]: I1204 11:38:34.845025 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a2aabd50-bfed-4ab5-ad19-f84ec50203ec-catalog-content\") pod \"certified-operators-ghr5b\" (UID: \"a2aabd50-bfed-4ab5-ad19-f84ec50203ec\") " pod="openshift-marketplace/certified-operators-ghr5b" Dec 04 11:38:34.846902 master-0 kubenswrapper[8993]: I1204 11:38:34.845486 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a2aabd50-bfed-4ab5-ad19-f84ec50203ec-catalog-content\") pod \"certified-operators-ghr5b\" (UID: \"a2aabd50-bfed-4ab5-ad19-f84ec50203ec\") " pod="openshift-marketplace/certified-operators-ghr5b" Dec 04 11:38:34.846902 master-0 kubenswrapper[8993]: I1204 11:38:34.845922 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/installer-1-master-0" podStartSLOduration=7.845539983 podStartE2EDuration="7.845539983s" podCreationTimestamp="2025-12-04 11:38:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:38:34.843656393 +0000 UTC m=+49.234597826" watchObservedRunningTime="2025-12-04 11:38:34.845539983 +0000 UTC m=+49.236481416" Dec 04 11:38:34.847328 master-0 kubenswrapper[8993]: I1204 11:38:34.847223 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a2aabd50-bfed-4ab5-ad19-f84ec50203ec-utilities\") pod \"certified-operators-ghr5b\" (UID: \"a2aabd50-bfed-4ab5-ad19-f84ec50203ec\") " pod="openshift-marketplace/certified-operators-ghr5b" Dec 04 11:38:34.874090 master-0 kubenswrapper[8993]: I1204 11:38:34.869984 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc6z5\" (UniqueName: \"kubernetes.io/projected/a2aabd50-bfed-4ab5-ad19-f84ec50203ec-kube-api-access-hc6z5\") pod \"certified-operators-ghr5b\" (UID: \"a2aabd50-bfed-4ab5-ad19-f84ec50203ec\") " pod="openshift-marketplace/certified-operators-ghr5b" Dec 04 11:38:34.874090 master-0 kubenswrapper[8993]: I1204 11:38:34.870694 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-666dcff694-54zwc"] Dec 04 11:38:34.881620 master-0 kubenswrapper[8993]: I1204 11:38:34.881396 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-controller-manager/controller-manager-666dcff694-54zwc"] Dec 04 11:38:34.892859 master-0 kubenswrapper[8993]: I1204 11:38:34.890261 8993 scope.go:117] "RemoveContainer" containerID="640b32bb7a423039a61f0610477c1f05fc585618f8b27b5d506a7b125a2e28b0" Dec 04 11:38:34.897581 master-0 kubenswrapper[8993]: E1204 11:38:34.895198 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"640b32bb7a423039a61f0610477c1f05fc585618f8b27b5d506a7b125a2e28b0\": container with ID starting with 640b32bb7a423039a61f0610477c1f05fc585618f8b27b5d506a7b125a2e28b0 not found: ID does not exist" containerID="640b32bb7a423039a61f0610477c1f05fc585618f8b27b5d506a7b125a2e28b0" Dec 04 11:38:34.897581 master-0 kubenswrapper[8993]: I1204 11:38:34.895278 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"640b32bb7a423039a61f0610477c1f05fc585618f8b27b5d506a7b125a2e28b0"} err="failed to get container status \"640b32bb7a423039a61f0610477c1f05fc585618f8b27b5d506a7b125a2e28b0\": rpc error: code = NotFound desc = could not find container \"640b32bb7a423039a61f0610477c1f05fc585618f8b27b5d506a7b125a2e28b0\": container with ID starting with 640b32bb7a423039a61f0610477c1f05fc585618f8b27b5d506a7b125a2e28b0 not found: ID does not exist" Dec 04 11:38:34.911602 master-0 kubenswrapper[8993]: I1204 11:38:34.910477 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" podStartSLOduration=4.706650363 podStartE2EDuration="16.910439247s" podCreationTimestamp="2025-12-04 11:38:18 +0000 UTC" firstStartedPulling="2025-12-04 11:38:20.049129202 +0000 UTC m=+34.440070645" lastFinishedPulling="2025-12-04 11:38:32.252918086 +0000 UTC m=+46.643859529" observedRunningTime="2025-12-04 11:38:34.904641441 +0000 UTC m=+49.295582894" watchObservedRunningTime="2025-12-04 11:38:34.910439247 +0000 UTC m=+49.301380680" Dec 04 11:38:34.919051 master-0 kubenswrapper[8993]: I1204 11:38:34.918999 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h"] Dec 04 11:38:34.923170 master-0 kubenswrapper[8993]: I1204 11:38:34.923073 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-f4c4cbbd-5bv8h"] Dec 04 11:38:34.938766 master-0 kubenswrapper[8993]: I1204 11:38:34.938669 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-7f22v"] Dec 04 11:38:34.941149 master-0 kubenswrapper[8993]: I1204 11:38:34.941053 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-scheduler/installer-2-master-0"] Dec 04 11:38:34.948415 master-0 kubenswrapper[8993]: I1204 11:38:34.947784 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-scheduler/installer-2-master-0"] Dec 04 11:38:35.052114 master-0 kubenswrapper[8993]: I1204 11:38:35.051869 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-ghr5b" Dec 04 11:38:35.237042 master-0 kubenswrapper[8993]: W1204 11:38:35.236946 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e35f5d_cc9b_409e_90bd_6c2ade6a8034.slice/crio-5f67891bdcf81a10e58fd650cd479871cf63cf1a46783610fea88da38d5f52fe WatchSource:0}: Error finding container 5f67891bdcf81a10e58fd650cd479871cf63cf1a46783610fea88da38d5f52fe: Status 404 returned error can't find the container with id 5f67891bdcf81a10e58fd650cd479871cf63cf1a46783610fea88da38d5f52fe Dec 04 11:38:35.239442 master-0 kubenswrapper[8993]: I1204 11:38:35.239375 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt"] Dec 04 11:38:35.653551 master-0 kubenswrapper[8993]: I1204 11:38:35.652831 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-ghr5b"] Dec 04 11:38:35.809730 master-0 kubenswrapper[8993]: I1204 11:38:35.809585 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4639ea5a-0121-4855-8b9a-3af7487fdec4" path="/var/lib/kubelet/pods/4639ea5a-0121-4855-8b9a-3af7487fdec4/volumes" Dec 04 11:38:35.810306 master-0 kubenswrapper[8993]: I1204 11:38:35.810270 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be8773d8-3480-4b40-aabf-132671c02553" path="/var/lib/kubelet/pods/be8773d8-3480-4b40-aabf-132671c02553/volumes" Dec 04 11:38:35.810995 master-0 kubenswrapper[8993]: I1204 11:38:35.810962 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9e7fd24-3079-469c-b0b7-2d3a7a7cf488" path="/var/lib/kubelet/pods/d9e7fd24-3079-469c-b0b7-2d3a7a7cf488/volumes" Dec 04 11:38:35.840759 master-0 kubenswrapper[8993]: I1204 11:38:35.839603 8993 generic.go:334] "Generic (PLEG): container finished" podID="2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c" containerID="736abedc363f924ab7e5e68cb6da6ea2f0b1b26806032413a9c3e2d40ef9bfc5" exitCode=0 Dec 04 11:38:35.840759 master-0 kubenswrapper[8993]: I1204 11:38:35.839699 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-7f22v" event={"ID":"2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c","Type":"ContainerDied","Data":"736abedc363f924ab7e5e68cb6da6ea2f0b1b26806032413a9c3e2d40ef9bfc5"} Dec 04 11:38:35.840759 master-0 kubenswrapper[8993]: I1204 11:38:35.839729 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-7f22v" event={"ID":"2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c","Type":"ContainerStarted","Data":"ee17c5a232895ee588633b4fc8647abb50bd0280101befcae43811f2596f07e7"} Dec 04 11:38:35.850959 master-0 kubenswrapper[8993]: I1204 11:38:35.850321 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-ghr5b" event={"ID":"a2aabd50-bfed-4ab5-ad19-f84ec50203ec","Type":"ContainerStarted","Data":"aa452c9783f0b829a2a3835614811770f6302ac6216bafb11edc376776d3168c"} Dec 04 11:38:35.856421 master-0 kubenswrapper[8993]: I1204 11:38:35.854903 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" event={"ID":"13e35f5d-cc9b-409e-90bd-6c2ade6a8034","Type":"ContainerStarted","Data":"408e30226780713b267871382e4ca053aef12ec750cfbd39cb2bae230c6f3eca"} Dec 04 11:38:35.856421 master-0 kubenswrapper[8993]: I1204 11:38:35.855026 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" event={"ID":"13e35f5d-cc9b-409e-90bd-6c2ade6a8034","Type":"ContainerStarted","Data":"5f67891bdcf81a10e58fd650cd479871cf63cf1a46783610fea88da38d5f52fe"} Dec 04 11:38:35.856421 master-0 kubenswrapper[8993]: I1204 11:38:35.856360 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" Dec 04 11:38:35.865077 master-0 kubenswrapper[8993]: I1204 11:38:35.865013 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" Dec 04 11:38:35.898081 master-0 kubenswrapper[8993]: I1204 11:38:35.896701 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-2p882"] Dec 04 11:38:35.899019 master-0 kubenswrapper[8993]: I1204 11:38:35.898986 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-2p882" Dec 04 11:38:35.919947 master-0 kubenswrapper[8993]: I1204 11:38:35.914722 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-2p882"] Dec 04 11:38:35.956873 master-0 kubenswrapper[8993]: I1204 11:38:35.952307 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" podStartSLOduration=11.95227378 podStartE2EDuration="11.95227378s" podCreationTimestamp="2025-12-04 11:38:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:38:35.951505605 +0000 UTC m=+50.342447058" watchObservedRunningTime="2025-12-04 11:38:35.95227378 +0000 UTC m=+50.343215213" Dec 04 11:38:35.963024 master-0 kubenswrapper[8993]: I1204 11:38:35.962958 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a0710bdf-3961-48d6-864a-efbd6d68e852-catalog-content\") pod \"community-operators-2p882\" (UID: \"a0710bdf-3961-48d6-864a-efbd6d68e852\") " pod="openshift-marketplace/community-operators-2p882" Dec 04 11:38:35.963207 master-0 kubenswrapper[8993]: I1204 11:38:35.963134 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkxnr\" (UniqueName: \"kubernetes.io/projected/a0710bdf-3961-48d6-864a-efbd6d68e852-kube-api-access-dkxnr\") pod \"community-operators-2p882\" (UID: \"a0710bdf-3961-48d6-864a-efbd6d68e852\") " pod="openshift-marketplace/community-operators-2p882" Dec 04 11:38:35.963207 master-0 kubenswrapper[8993]: I1204 11:38:35.963166 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a0710bdf-3961-48d6-864a-efbd6d68e852-utilities\") pod \"community-operators-2p882\" (UID: \"a0710bdf-3961-48d6-864a-efbd6d68e852\") " pod="openshift-marketplace/community-operators-2p882" Dec 04 11:38:36.065747 master-0 kubenswrapper[8993]: I1204 11:38:36.065569 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a0710bdf-3961-48d6-864a-efbd6d68e852-catalog-content\") pod \"community-operators-2p882\" (UID: \"a0710bdf-3961-48d6-864a-efbd6d68e852\") " pod="openshift-marketplace/community-operators-2p882" Dec 04 11:38:36.065747 master-0 kubenswrapper[8993]: I1204 11:38:36.065651 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dkxnr\" (UniqueName: \"kubernetes.io/projected/a0710bdf-3961-48d6-864a-efbd6d68e852-kube-api-access-dkxnr\") pod \"community-operators-2p882\" (UID: \"a0710bdf-3961-48d6-864a-efbd6d68e852\") " pod="openshift-marketplace/community-operators-2p882" Dec 04 11:38:36.070380 master-0 kubenswrapper[8993]: I1204 11:38:36.066720 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a0710bdf-3961-48d6-864a-efbd6d68e852-catalog-content\") pod \"community-operators-2p882\" (UID: \"a0710bdf-3961-48d6-864a-efbd6d68e852\") " pod="openshift-marketplace/community-operators-2p882" Dec 04 11:38:36.070380 master-0 kubenswrapper[8993]: I1204 11:38:36.066785 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a0710bdf-3961-48d6-864a-efbd6d68e852-utilities\") pod \"community-operators-2p882\" (UID: \"a0710bdf-3961-48d6-864a-efbd6d68e852\") " pod="openshift-marketplace/community-operators-2p882" Dec 04 11:38:36.070380 master-0 kubenswrapper[8993]: I1204 11:38:36.067176 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a0710bdf-3961-48d6-864a-efbd6d68e852-utilities\") pod \"community-operators-2p882\" (UID: \"a0710bdf-3961-48d6-864a-efbd6d68e852\") " pod="openshift-marketplace/community-operators-2p882" Dec 04 11:38:36.099548 master-0 kubenswrapper[8993]: I1204 11:38:36.099469 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkxnr\" (UniqueName: \"kubernetes.io/projected/a0710bdf-3961-48d6-864a-efbd6d68e852-kube-api-access-dkxnr\") pod \"community-operators-2p882\" (UID: \"a0710bdf-3961-48d6-864a-efbd6d68e852\") " pod="openshift-marketplace/community-operators-2p882" Dec 04 11:38:36.215837 master-0 kubenswrapper[8993]: I1204 11:38:36.215727 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:36.216147 master-0 kubenswrapper[8993]: I1204 11:38:36.215897 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:36.224492 master-0 kubenswrapper[8993]: I1204 11:38:36.224427 8993 patch_prober.go:28] interesting pod/apiserver-6cbcc775d9-jrlx4 container/openshift-apiserver namespace/openshift-apiserver: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Dec 04 11:38:36.224492 master-0 kubenswrapper[8993]: [+]log ok Dec 04 11:38:36.224492 master-0 kubenswrapper[8993]: [+]etcd ok Dec 04 11:38:36.224492 master-0 kubenswrapper[8993]: [+]poststarthook/start-apiserver-admission-initializer ok Dec 04 11:38:36.224492 master-0 kubenswrapper[8993]: [+]poststarthook/generic-apiserver-start-informers ok Dec 04 11:38:36.224492 master-0 kubenswrapper[8993]: [+]poststarthook/max-in-flight-filter ok Dec 04 11:38:36.224492 master-0 kubenswrapper[8993]: [+]poststarthook/storage-object-count-tracker-hook ok Dec 04 11:38:36.224492 master-0 kubenswrapper[8993]: [+]poststarthook/image.openshift.io-apiserver-caches ok Dec 04 11:38:36.224492 master-0 kubenswrapper[8993]: [-]poststarthook/authorization.openshift.io-bootstrapclusterroles failed: reason withheld Dec 04 11:38:36.224492 master-0 kubenswrapper[8993]: [-]poststarthook/authorization.openshift.io-ensurenodebootstrap-sa failed: reason withheld Dec 04 11:38:36.224492 master-0 kubenswrapper[8993]: [+]poststarthook/project.openshift.io-projectcache ok Dec 04 11:38:36.224492 master-0 kubenswrapper[8993]: [+]poststarthook/project.openshift.io-projectauthorizationcache ok Dec 04 11:38:36.224492 master-0 kubenswrapper[8993]: [+]poststarthook/openshift.io-startinformers ok Dec 04 11:38:36.224492 master-0 kubenswrapper[8993]: [+]poststarthook/openshift.io-restmapperupdater ok Dec 04 11:38:36.224492 master-0 kubenswrapper[8993]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Dec 04 11:38:36.224492 master-0 kubenswrapper[8993]: livez check failed Dec 04 11:38:36.225238 master-0 kubenswrapper[8993]: I1204 11:38:36.224508 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" podUID="7ec61be5-32f9-4aac-815f-41d173213107" containerName="openshift-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 11:38:36.245899 master-0 kubenswrapper[8993]: I1204 11:38:36.245231 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-2p882" Dec 04 11:38:36.683038 master-0 kubenswrapper[8993]: I1204 11:38:36.681340 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v"] Dec 04 11:38:36.683038 master-0 kubenswrapper[8993]: I1204 11:38:36.682127 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" Dec 04 11:38:36.686521 master-0 kubenswrapper[8993]: I1204 11:38:36.686136 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"kube-root-ca.crt" Dec 04 11:38:36.686521 master-0 kubenswrapper[8993]: I1204 11:38:36.686242 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Dec 04 11:38:36.686521 master-0 kubenswrapper[8993]: I1204 11:38:36.686468 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"client-ca" Dec 04 11:38:36.688445 master-0 kubenswrapper[8993]: I1204 11:38:36.688188 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"openshift-service-ca.crt" Dec 04 11:38:36.688445 master-0 kubenswrapper[8993]: I1204 11:38:36.688286 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"config" Dec 04 11:38:36.699796 master-0 kubenswrapper[8993]: I1204 11:38:36.699686 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v"] Dec 04 11:38:36.761828 master-0 kubenswrapper[8993]: I1204 11:38:36.758034 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-2p882"] Dec 04 11:38:36.793834 master-0 kubenswrapper[8993]: I1204 11:38:36.786692 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-client-ca\") pod \"route-controller-manager-846b467b5c-thc5v\" (UID: \"c56bd968-49b0-41c0-8a5a-dcd3e7db8343\") " pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" Dec 04 11:38:36.793834 master-0 kubenswrapper[8993]: I1204 11:38:36.786793 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-config\") pod \"route-controller-manager-846b467b5c-thc5v\" (UID: \"c56bd968-49b0-41c0-8a5a-dcd3e7db8343\") " pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" Dec 04 11:38:36.793834 master-0 kubenswrapper[8993]: I1204 11:38:36.786998 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-serving-cert\") pod \"route-controller-manager-846b467b5c-thc5v\" (UID: \"c56bd968-49b0-41c0-8a5a-dcd3e7db8343\") " pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" Dec 04 11:38:36.793834 master-0 kubenswrapper[8993]: I1204 11:38:36.787119 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbxnz\" (UniqueName: \"kubernetes.io/projected/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-kube-api-access-dbxnz\") pod \"route-controller-manager-846b467b5c-thc5v\" (UID: \"c56bd968-49b0-41c0-8a5a-dcd3e7db8343\") " pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" Dec 04 11:38:36.884269 master-0 kubenswrapper[8993]: I1204 11:38:36.883974 8993 generic.go:334] "Generic (PLEG): container finished" podID="a2aabd50-bfed-4ab5-ad19-f84ec50203ec" containerID="3d224218c60e1e7468baaba3d9d1b53375aeedd487691935fc138aa3c833f437" exitCode=0 Dec 04 11:38:36.884269 master-0 kubenswrapper[8993]: I1204 11:38:36.884074 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-ghr5b" event={"ID":"a2aabd50-bfed-4ab5-ad19-f84ec50203ec","Type":"ContainerDied","Data":"3d224218c60e1e7468baaba3d9d1b53375aeedd487691935fc138aa3c833f437"} Dec 04 11:38:36.901550 master-0 kubenswrapper[8993]: I1204 11:38:36.888144 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-serving-cert\") pod \"route-controller-manager-846b467b5c-thc5v\" (UID: \"c56bd968-49b0-41c0-8a5a-dcd3e7db8343\") " pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" Dec 04 11:38:36.901550 master-0 kubenswrapper[8993]: I1204 11:38:36.888194 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dbxnz\" (UniqueName: \"kubernetes.io/projected/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-kube-api-access-dbxnz\") pod \"route-controller-manager-846b467b5c-thc5v\" (UID: \"c56bd968-49b0-41c0-8a5a-dcd3e7db8343\") " pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" Dec 04 11:38:36.901550 master-0 kubenswrapper[8993]: I1204 11:38:36.888241 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-client-ca\") pod \"route-controller-manager-846b467b5c-thc5v\" (UID: \"c56bd968-49b0-41c0-8a5a-dcd3e7db8343\") " pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" Dec 04 11:38:36.901550 master-0 kubenswrapper[8993]: I1204 11:38:36.888627 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-config\") pod \"route-controller-manager-846b467b5c-thc5v\" (UID: \"c56bd968-49b0-41c0-8a5a-dcd3e7db8343\") " pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" Dec 04 11:38:36.901550 master-0 kubenswrapper[8993]: I1204 11:38:36.888627 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2p882" event={"ID":"a0710bdf-3961-48d6-864a-efbd6d68e852","Type":"ContainerStarted","Data":"fa9c7f76d1131adc2959e788aafcb6d95d23ded230dc81a5ae7f70e4e6a74fe0"} Dec 04 11:38:36.901550 master-0 kubenswrapper[8993]: I1204 11:38:36.890156 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-client-ca\") pod \"route-controller-manager-846b467b5c-thc5v\" (UID: \"c56bd968-49b0-41c0-8a5a-dcd3e7db8343\") " pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" Dec 04 11:38:36.901550 master-0 kubenswrapper[8993]: I1204 11:38:36.890709 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-config\") pod \"route-controller-manager-846b467b5c-thc5v\" (UID: \"c56bd968-49b0-41c0-8a5a-dcd3e7db8343\") " pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" Dec 04 11:38:36.901550 master-0 kubenswrapper[8993]: I1204 11:38:36.893308 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-serving-cert\") pod \"route-controller-manager-846b467b5c-thc5v\" (UID: \"c56bd968-49b0-41c0-8a5a-dcd3e7db8343\") " pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" Dec 04 11:38:36.920197 master-0 kubenswrapper[8993]: I1204 11:38:36.920134 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbxnz\" (UniqueName: \"kubernetes.io/projected/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-kube-api-access-dbxnz\") pod \"route-controller-manager-846b467b5c-thc5v\" (UID: \"c56bd968-49b0-41c0-8a5a-dcd3e7db8343\") " pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" Dec 04 11:38:37.018239 master-0 kubenswrapper[8993]: I1204 11:38:37.018155 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" Dec 04 11:38:37.102548 master-0 kubenswrapper[8993]: I1204 11:38:37.102499 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-krbbd"] Dec 04 11:38:37.103716 master-0 kubenswrapper[8993]: I1204 11:38:37.103692 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-krbbd" Dec 04 11:38:37.119731 master-0 kubenswrapper[8993]: I1204 11:38:37.119643 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-krbbd"] Dec 04 11:38:37.217214 master-0 kubenswrapper[8993]: I1204 11:38:37.216862 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/349b1e1d-db56-4960-b6ff-e2f5f07d4aaa-catalog-content\") pod \"redhat-marketplace-krbbd\" (UID: \"349b1e1d-db56-4960-b6ff-e2f5f07d4aaa\") " pod="openshift-marketplace/redhat-marketplace-krbbd" Dec 04 11:38:37.217214 master-0 kubenswrapper[8993]: I1204 11:38:37.216925 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/349b1e1d-db56-4960-b6ff-e2f5f07d4aaa-utilities\") pod \"redhat-marketplace-krbbd\" (UID: \"349b1e1d-db56-4960-b6ff-e2f5f07d4aaa\") " pod="openshift-marketplace/redhat-marketplace-krbbd" Dec 04 11:38:37.217214 master-0 kubenswrapper[8993]: I1204 11:38:37.217006 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz65b\" (UniqueName: \"kubernetes.io/projected/349b1e1d-db56-4960-b6ff-e2f5f07d4aaa-kube-api-access-qz65b\") pod \"redhat-marketplace-krbbd\" (UID: \"349b1e1d-db56-4960-b6ff-e2f5f07d4aaa\") " pod="openshift-marketplace/redhat-marketplace-krbbd" Dec 04 11:38:37.318022 master-0 kubenswrapper[8993]: I1204 11:38:37.317933 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/349b1e1d-db56-4960-b6ff-e2f5f07d4aaa-catalog-content\") pod \"redhat-marketplace-krbbd\" (UID: \"349b1e1d-db56-4960-b6ff-e2f5f07d4aaa\") " pod="openshift-marketplace/redhat-marketplace-krbbd" Dec 04 11:38:37.318022 master-0 kubenswrapper[8993]: I1204 11:38:37.318018 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/349b1e1d-db56-4960-b6ff-e2f5f07d4aaa-utilities\") pod \"redhat-marketplace-krbbd\" (UID: \"349b1e1d-db56-4960-b6ff-e2f5f07d4aaa\") " pod="openshift-marketplace/redhat-marketplace-krbbd" Dec 04 11:38:37.318360 master-0 kubenswrapper[8993]: I1204 11:38:37.318059 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qz65b\" (UniqueName: \"kubernetes.io/projected/349b1e1d-db56-4960-b6ff-e2f5f07d4aaa-kube-api-access-qz65b\") pod \"redhat-marketplace-krbbd\" (UID: \"349b1e1d-db56-4960-b6ff-e2f5f07d4aaa\") " pod="openshift-marketplace/redhat-marketplace-krbbd" Dec 04 11:38:37.320163 master-0 kubenswrapper[8993]: I1204 11:38:37.319291 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/349b1e1d-db56-4960-b6ff-e2f5f07d4aaa-utilities\") pod \"redhat-marketplace-krbbd\" (UID: \"349b1e1d-db56-4960-b6ff-e2f5f07d4aaa\") " pod="openshift-marketplace/redhat-marketplace-krbbd" Dec 04 11:38:37.326697 master-0 kubenswrapper[8993]: I1204 11:38:37.326524 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/349b1e1d-db56-4960-b6ff-e2f5f07d4aaa-catalog-content\") pod \"redhat-marketplace-krbbd\" (UID: \"349b1e1d-db56-4960-b6ff-e2f5f07d4aaa\") " pod="openshift-marketplace/redhat-marketplace-krbbd" Dec 04 11:38:37.340113 master-0 kubenswrapper[8993]: I1204 11:38:37.339999 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz65b\" (UniqueName: \"kubernetes.io/projected/349b1e1d-db56-4960-b6ff-e2f5f07d4aaa-kube-api-access-qz65b\") pod \"redhat-marketplace-krbbd\" (UID: \"349b1e1d-db56-4960-b6ff-e2f5f07d4aaa\") " pod="openshift-marketplace/redhat-marketplace-krbbd" Dec 04 11:38:37.348229 master-0 kubenswrapper[8993]: I1204 11:38:37.348165 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq"] Dec 04 11:38:37.350747 master-0 kubenswrapper[8993]: I1204 11:38:37.349142 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:38:37.355404 master-0 kubenswrapper[8993]: I1204 11:38:37.353777 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-machine-approver"/"machine-approver-tls" Dec 04 11:38:37.355404 master-0 kubenswrapper[8993]: I1204 11:38:37.354228 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"openshift-service-ca.crt" Dec 04 11:38:37.355404 master-0 kubenswrapper[8993]: I1204 11:38:37.354528 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"machine-approver-config" Dec 04 11:38:37.355404 master-0 kubenswrapper[8993]: I1204 11:38:37.354653 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-root-ca.crt" Dec 04 11:38:37.357752 master-0 kubenswrapper[8993]: I1204 11:38:37.357327 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-rbac-proxy" Dec 04 11:38:37.419850 master-0 kubenswrapper[8993]: I1204 11:38:37.419720 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c835660f-5a79-4679-b9be-8543ca6ef5a1-config\") pod \"machine-approver-f797d8546-qvgbq\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:38:37.419850 master-0 kubenswrapper[8993]: I1204 11:38:37.419867 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/c835660f-5a79-4679-b9be-8543ca6ef5a1-machine-approver-tls\") pod \"machine-approver-f797d8546-qvgbq\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:38:37.420192 master-0 kubenswrapper[8993]: I1204 11:38:37.419912 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxbts\" (UniqueName: \"kubernetes.io/projected/c835660f-5a79-4679-b9be-8543ca6ef5a1-kube-api-access-nxbts\") pod \"machine-approver-f797d8546-qvgbq\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:38:37.420192 master-0 kubenswrapper[8993]: I1204 11:38:37.419949 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/c835660f-5a79-4679-b9be-8543ca6ef5a1-auth-proxy-config\") pod \"machine-approver-f797d8546-qvgbq\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:38:37.445952 master-0 kubenswrapper[8993]: I1204 11:38:37.445888 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-krbbd" Dec 04 11:38:37.521262 master-0 kubenswrapper[8993]: I1204 11:38:37.521053 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/c835660f-5a79-4679-b9be-8543ca6ef5a1-auth-proxy-config\") pod \"machine-approver-f797d8546-qvgbq\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:38:37.521731 master-0 kubenswrapper[8993]: I1204 11:38:37.521694 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c835660f-5a79-4679-b9be-8543ca6ef5a1-config\") pod \"machine-approver-f797d8546-qvgbq\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:38:37.522168 master-0 kubenswrapper[8993]: I1204 11:38:37.521923 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/c835660f-5a79-4679-b9be-8543ca6ef5a1-machine-approver-tls\") pod \"machine-approver-f797d8546-qvgbq\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:38:37.522706 master-0 kubenswrapper[8993]: I1204 11:38:37.522601 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c835660f-5a79-4679-b9be-8543ca6ef5a1-config\") pod \"machine-approver-f797d8546-qvgbq\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:38:37.522706 master-0 kubenswrapper[8993]: I1204 11:38:37.521957 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nxbts\" (UniqueName: \"kubernetes.io/projected/c835660f-5a79-4679-b9be-8543ca6ef5a1-kube-api-access-nxbts\") pod \"machine-approver-f797d8546-qvgbq\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:38:37.527387 master-0 kubenswrapper[8993]: I1204 11:38:37.526201 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/c835660f-5a79-4679-b9be-8543ca6ef5a1-machine-approver-tls\") pod \"machine-approver-f797d8546-qvgbq\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:38:37.527387 master-0 kubenswrapper[8993]: I1204 11:38:37.526955 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/c835660f-5a79-4679-b9be-8543ca6ef5a1-auth-proxy-config\") pod \"machine-approver-f797d8546-qvgbq\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:38:37.549640 master-0 kubenswrapper[8993]: I1204 11:38:37.548847 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v"] Dec 04 11:38:37.555976 master-0 kubenswrapper[8993]: I1204 11:38:37.555884 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxbts\" (UniqueName: \"kubernetes.io/projected/c835660f-5a79-4679-b9be-8543ca6ef5a1-kube-api-access-nxbts\") pod \"machine-approver-f797d8546-qvgbq\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:38:37.700481 master-0 kubenswrapper[8993]: I1204 11:38:37.700390 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:38:37.907562 master-0 kubenswrapper[8993]: I1204 11:38:37.907475 8993 generic.go:334] "Generic (PLEG): container finished" podID="a0710bdf-3961-48d6-864a-efbd6d68e852" containerID="8b462edb24709c28f1c57773708761f546f09cea56bd49fe8e39f36f60a1efa2" exitCode=0 Dec 04 11:38:37.908434 master-0 kubenswrapper[8993]: I1204 11:38:37.908056 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2p882" event={"ID":"a0710bdf-3961-48d6-864a-efbd6d68e852","Type":"ContainerDied","Data":"8b462edb24709c28f1c57773708761f546f09cea56bd49fe8e39f36f60a1efa2"} Dec 04 11:38:38.916239 master-0 kubenswrapper[8993]: I1204 11:38:38.916183 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" event={"ID":"c835660f-5a79-4679-b9be-8543ca6ef5a1","Type":"ContainerStarted","Data":"40749160ea3271ba79ddd289ecc16ddea5467363a62ec473910d1a7a9d5f865a"} Dec 04 11:38:38.917406 master-0 kubenswrapper[8993]: I1204 11:38:38.917375 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" event={"ID":"c56bd968-49b0-41c0-8a5a-dcd3e7db8343","Type":"ContainerStarted","Data":"d68dc51f246bf40bdd087540e0e6983ac7790e5fd02e31f376a9379f96364276"} Dec 04 11:38:39.126911 master-0 kubenswrapper[8993]: I1204 11:38:39.126800 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:39.126911 master-0 kubenswrapper[8993]: I1204 11:38:39.126910 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:40.871838 master-0 kubenswrapper[8993]: I1204 11:38:40.867995 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:40.898106 master-0 kubenswrapper[8993]: I1204 11:38:40.894207 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:38:40.995908 master-0 kubenswrapper[8993]: I1204 11:38:40.992938 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-krbbd"] Dec 04 11:38:41.239053 master-0 kubenswrapper[8993]: I1204 11:38:41.237502 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:41.247796 master-0 kubenswrapper[8993]: I1204 11:38:41.247730 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:38:41.318153 master-0 kubenswrapper[8993]: I1204 11:38:41.317995 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn"] Dec 04 11:38:41.320773 master-0 kubenswrapper[8993]: I1204 11:38:41.319001 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" Dec 04 11:38:41.327597 master-0 kubenswrapper[8993]: I1204 11:38:41.326713 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"openshift-service-ca.crt" Dec 04 11:38:41.327597 master-0 kubenswrapper[8993]: I1204 11:38:41.327093 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-credential-operator"/"cloud-credential-operator-serving-cert" Dec 04 11:38:41.333457 master-0 kubenswrapper[8993]: I1204 11:38:41.332427 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"kube-root-ca.crt" Dec 04 11:38:41.356718 master-0 kubenswrapper[8993]: I1204 11:38:41.356653 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"cco-trusted-ca" Dec 04 11:38:41.378056 master-0 kubenswrapper[8993]: I1204 11:38:41.376398 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn"] Dec 04 11:38:41.407071 master-0 kubenswrapper[8993]: I1204 11:38:41.405896 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cco-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64d30b80-2336-49c2-a2c2-1e0694036a84-cco-trusted-ca\") pod \"cloud-credential-operator-698c598cfc-95jdn\" (UID: \"64d30b80-2336-49c2-a2c2-1e0694036a84\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" Dec 04 11:38:41.407071 master-0 kubenswrapper[8993]: I1204 11:38:41.406006 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cloud-credential-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/64d30b80-2336-49c2-a2c2-1e0694036a84-cloud-credential-operator-serving-cert\") pod \"cloud-credential-operator-698c598cfc-95jdn\" (UID: \"64d30b80-2336-49c2-a2c2-1e0694036a84\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" Dec 04 11:38:41.407071 master-0 kubenswrapper[8993]: I1204 11:38:41.406061 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgdmn\" (UniqueName: \"kubernetes.io/projected/64d30b80-2336-49c2-a2c2-1e0694036a84-kube-api-access-vgdmn\") pod \"cloud-credential-operator-698c598cfc-95jdn\" (UID: \"64d30b80-2336-49c2-a2c2-1e0694036a84\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" Dec 04 11:38:41.458544 master-0 kubenswrapper[8993]: I1204 11:38:41.458452 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-797cfd8b47-8wqgp"] Dec 04 11:38:41.460484 master-0 kubenswrapper[8993]: I1204 11:38:41.460401 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-797cfd8b47-8wqgp" Dec 04 11:38:41.465075 master-0 kubenswrapper[8993]: I1204 11:38:41.465042 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-samples-operator"/"openshift-service-ca.crt" Dec 04 11:38:41.465796 master-0 kubenswrapper[8993]: I1204 11:38:41.465723 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-samples-operator"/"samples-operator-tls" Dec 04 11:38:41.466087 master-0 kubenswrapper[8993]: I1204 11:38:41.465749 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-samples-operator"/"kube-root-ca.crt" Dec 04 11:38:41.501533 master-0 kubenswrapper[8993]: I1204 11:38:41.501474 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-797cfd8b47-8wqgp"] Dec 04 11:38:41.512789 master-0 kubenswrapper[8993]: I1204 11:38:41.507772 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vgdmn\" (UniqueName: \"kubernetes.io/projected/64d30b80-2336-49c2-a2c2-1e0694036a84-kube-api-access-vgdmn\") pod \"cloud-credential-operator-698c598cfc-95jdn\" (UID: \"64d30b80-2336-49c2-a2c2-1e0694036a84\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" Dec 04 11:38:41.512789 master-0 kubenswrapper[8993]: I1204 11:38:41.507895 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w6kv\" (UniqueName: \"kubernetes.io/projected/ccf1cb9e-8885-4224-92d5-d1b116bc0090-kube-api-access-8w6kv\") pod \"cluster-samples-operator-797cfd8b47-8wqgp\" (UID: \"ccf1cb9e-8885-4224-92d5-d1b116bc0090\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-797cfd8b47-8wqgp" Dec 04 11:38:41.512789 master-0 kubenswrapper[8993]: I1204 11:38:41.507936 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cco-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64d30b80-2336-49c2-a2c2-1e0694036a84-cco-trusted-ca\") pod \"cloud-credential-operator-698c598cfc-95jdn\" (UID: \"64d30b80-2336-49c2-a2c2-1e0694036a84\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" Dec 04 11:38:41.512789 master-0 kubenswrapper[8993]: I1204 11:38:41.509162 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccf1cb9e-8885-4224-92d5-d1b116bc0090-samples-operator-tls\") pod \"cluster-samples-operator-797cfd8b47-8wqgp\" (UID: \"ccf1cb9e-8885-4224-92d5-d1b116bc0090\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-797cfd8b47-8wqgp" Dec 04 11:38:41.512789 master-0 kubenswrapper[8993]: I1204 11:38:41.509208 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cloud-credential-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/64d30b80-2336-49c2-a2c2-1e0694036a84-cloud-credential-operator-serving-cert\") pod \"cloud-credential-operator-698c598cfc-95jdn\" (UID: \"64d30b80-2336-49c2-a2c2-1e0694036a84\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" Dec 04 11:38:41.512789 master-0 kubenswrapper[8993]: I1204 11:38:41.511419 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cco-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64d30b80-2336-49c2-a2c2-1e0694036a84-cco-trusted-ca\") pod \"cloud-credential-operator-698c598cfc-95jdn\" (UID: \"64d30b80-2336-49c2-a2c2-1e0694036a84\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" Dec 04 11:38:41.532322 master-0 kubenswrapper[8993]: I1204 11:38:41.515847 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cloud-credential-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/64d30b80-2336-49c2-a2c2-1e0694036a84-cloud-credential-operator-serving-cert\") pod \"cloud-credential-operator-698c598cfc-95jdn\" (UID: \"64d30b80-2336-49c2-a2c2-1e0694036a84\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" Dec 04 11:38:41.573579 master-0 kubenswrapper[8993]: I1204 11:38:41.573479 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgdmn\" (UniqueName: \"kubernetes.io/projected/64d30b80-2336-49c2-a2c2-1e0694036a84-kube-api-access-vgdmn\") pod \"cloud-credential-operator-698c598cfc-95jdn\" (UID: \"64d30b80-2336-49c2-a2c2-1e0694036a84\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" Dec 04 11:38:41.615840 master-0 kubenswrapper[8993]: I1204 11:38:41.611160 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccf1cb9e-8885-4224-92d5-d1b116bc0090-samples-operator-tls\") pod \"cluster-samples-operator-797cfd8b47-8wqgp\" (UID: \"ccf1cb9e-8885-4224-92d5-d1b116bc0090\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-797cfd8b47-8wqgp" Dec 04 11:38:41.615840 master-0 kubenswrapper[8993]: I1204 11:38:41.611260 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8w6kv\" (UniqueName: \"kubernetes.io/projected/ccf1cb9e-8885-4224-92d5-d1b116bc0090-kube-api-access-8w6kv\") pod \"cluster-samples-operator-797cfd8b47-8wqgp\" (UID: \"ccf1cb9e-8885-4224-92d5-d1b116bc0090\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-797cfd8b47-8wqgp" Dec 04 11:38:41.615840 master-0 kubenswrapper[8993]: E1204 11:38:41.611639 8993 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Dec 04 11:38:41.615840 master-0 kubenswrapper[8993]: E1204 11:38:41.611685 8993 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf1cb9e-8885-4224-92d5-d1b116bc0090-samples-operator-tls podName:ccf1cb9e-8885-4224-92d5-d1b116bc0090 nodeName:}" failed. No retries permitted until 2025-12-04 11:38:42.111669028 +0000 UTC m=+56.502610461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ccf1cb9e-8885-4224-92d5-d1b116bc0090-samples-operator-tls") pod "cluster-samples-operator-797cfd8b47-8wqgp" (UID: "ccf1cb9e-8885-4224-92d5-d1b116bc0090") : secret "samples-operator-tls" not found Dec 04 11:38:41.662365 master-0 kubenswrapper[8993]: I1204 11:38:41.659367 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" Dec 04 11:38:41.662997 master-0 kubenswrapper[8993]: I1204 11:38:41.662912 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w6kv\" (UniqueName: \"kubernetes.io/projected/ccf1cb9e-8885-4224-92d5-d1b116bc0090-kube-api-access-8w6kv\") pod \"cluster-samples-operator-797cfd8b47-8wqgp\" (UID: \"ccf1cb9e-8885-4224-92d5-d1b116bc0090\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-797cfd8b47-8wqgp" Dec 04 11:38:41.676356 master-0 kubenswrapper[8993]: I1204 11:38:41.676294 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" event={"ID":"c835660f-5a79-4679-b9be-8543ca6ef5a1","Type":"ContainerStarted","Data":"77e87b65d2d4db1f1231cca5b248512d4a871ef2353103a6010989d0ff1fc4d1"} Dec 04 11:38:41.692667 master-0 kubenswrapper[8993]: I1204 11:38:41.692616 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm" event={"ID":"14bd3485-aa02-4984-b4a3-59f360b1b327","Type":"ContainerStarted","Data":"aeee1a4ddc268ca9307b81e79359b2f59515c9c502aecb0723e30ace49120598"} Dec 04 11:38:41.701243 master-0 kubenswrapper[8993]: I1204 11:38:41.701177 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" event={"ID":"c56bd968-49b0-41c0-8a5a-dcd3e7db8343","Type":"ContainerStarted","Data":"47a473d94fff10df95224b25679ae8f920aec0430df8284cb166e6ed144bf766"} Dec 04 11:38:41.707187 master-0 kubenswrapper[8993]: I1204 11:38:41.707131 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" Dec 04 11:38:41.737527 master-0 kubenswrapper[8993]: I1204 11:38:41.730796 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" Dec 04 11:38:41.737527 master-0 kubenswrapper[8993]: I1204 11:38:41.732226 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm" podStartSLOduration=5.989537805 podStartE2EDuration="9.732192738s" podCreationTimestamp="2025-12-04 11:38:32 +0000 UTC" firstStartedPulling="2025-12-04 11:38:34.558245439 +0000 UTC m=+48.949186872" lastFinishedPulling="2025-12-04 11:38:38.300900372 +0000 UTC m=+52.691841805" observedRunningTime="2025-12-04 11:38:41.725266346 +0000 UTC m=+56.116207769" watchObservedRunningTime="2025-12-04 11:38:41.732192738 +0000 UTC m=+56.123134171" Dec 04 11:38:41.739631 master-0 kubenswrapper[8993]: I1204 11:38:41.739406 8993 generic.go:334] "Generic (PLEG): container finished" podID="349b1e1d-db56-4960-b6ff-e2f5f07d4aaa" containerID="c29a5ac71e4cb432d40dfd2f98df48e6c19a408bcb1d6775f4fb6aa8804f1a0d" exitCode=0 Dec 04 11:38:41.740268 master-0 kubenswrapper[8993]: I1204 11:38:41.740237 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-krbbd" event={"ID":"349b1e1d-db56-4960-b6ff-e2f5f07d4aaa","Type":"ContainerDied","Data":"c29a5ac71e4cb432d40dfd2f98df48e6c19a408bcb1d6775f4fb6aa8804f1a0d"} Dec 04 11:38:41.740325 master-0 kubenswrapper[8993]: I1204 11:38:41.740276 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-krbbd" event={"ID":"349b1e1d-db56-4960-b6ff-e2f5f07d4aaa","Type":"ContainerStarted","Data":"4b154ea5d1a65a00f9a58abb9bd66c22de4b2bf96d4f551828820cb8bf05f648"} Dec 04 11:38:41.766977 master-0 kubenswrapper[8993]: I1204 11:38:41.765190 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" podStartSLOduration=16.765167607 podStartE2EDuration="16.765167607s" podCreationTimestamp="2025-12-04 11:38:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:38:41.763612947 +0000 UTC m=+56.154554380" watchObservedRunningTime="2025-12-04 11:38:41.765167607 +0000 UTC m=+56.156109040" Dec 04 11:38:42.130929 master-0 kubenswrapper[8993]: I1204 11:38:42.128780 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccf1cb9e-8885-4224-92d5-d1b116bc0090-samples-operator-tls\") pod \"cluster-samples-operator-797cfd8b47-8wqgp\" (UID: \"ccf1cb9e-8885-4224-92d5-d1b116bc0090\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-797cfd8b47-8wqgp" Dec 04 11:38:42.136851 master-0 kubenswrapper[8993]: I1204 11:38:42.135241 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccf1cb9e-8885-4224-92d5-d1b116bc0090-samples-operator-tls\") pod \"cluster-samples-operator-797cfd8b47-8wqgp\" (UID: \"ccf1cb9e-8885-4224-92d5-d1b116bc0090\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-797cfd8b47-8wqgp" Dec 04 11:38:42.165851 master-0 kubenswrapper[8993]: I1204 11:38:42.165254 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5"] Dec 04 11:38:42.167002 master-0 kubenswrapper[8993]: I1204 11:38:42.166470 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:38:42.169845 master-0 kubenswrapper[8993]: I1204 11:38:42.169541 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-webhook-server-cert" Dec 04 11:38:42.170027 master-0 kubenswrapper[8993]: I1204 11:38:42.169941 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-operator-tls" Dec 04 11:38:42.181912 master-0 kubenswrapper[8993]: I1204 11:38:42.174732 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-operator-dockercfg-hkjv7" Dec 04 11:38:42.181912 master-0 kubenswrapper[8993]: I1204 11:38:42.174970 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"cluster-baremetal-operator-images" Dec 04 11:38:42.181912 master-0 kubenswrapper[8993]: I1204 11:38:42.175120 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"baremetal-kube-rbac-proxy" Dec 04 11:38:42.197933 master-0 kubenswrapper[8993]: I1204 11:38:42.196768 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5"] Dec 04 11:38:42.205937 master-0 kubenswrapper[8993]: I1204 11:38:42.205870 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-scheduler/installer-3-master-0"] Dec 04 11:38:42.206238 master-0 kubenswrapper[8993]: I1204 11:38:42.206147 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-scheduler/installer-3-master-0" podUID="c26ef42b-772d-4708-9258-f19c4432cf98" containerName="installer" containerID="cri-o://87b326610b4da980ea18879714f675d6bb9e24b9cf46e43dd90e6c093d451fef" gracePeriod=30 Dec 04 11:38:42.232089 master-0 kubenswrapper[8993]: I1204 11:38:42.232037 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e3160a9-11d1-4845-ba30-1a49ae7339a9-config\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:38:42.232220 master-0 kubenswrapper[8993]: I1204 11:38:42.232098 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e3160a9-11d1-4845-ba30-1a49ae7339a9-cert\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:38:42.232220 master-0 kubenswrapper[8993]: I1204 11:38:42.232142 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fksx7\" (UniqueName: \"kubernetes.io/projected/7e3160a9-11d1-4845-ba30-1a49ae7339a9-kube-api-access-fksx7\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:38:42.232220 master-0 kubenswrapper[8993]: I1204 11:38:42.232177 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-baremetal-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e3160a9-11d1-4845-ba30-1a49ae7339a9-cluster-baremetal-operator-tls\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:38:42.232220 master-0 kubenswrapper[8993]: I1204 11:38:42.232205 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/7e3160a9-11d1-4845-ba30-1a49ae7339a9-images\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:38:42.241344 master-0 kubenswrapper[8993]: I1204 11:38:42.241225 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn"] Dec 04 11:38:42.340793 master-0 kubenswrapper[8993]: I1204 11:38:42.339526 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/7e3160a9-11d1-4845-ba30-1a49ae7339a9-images\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:38:42.340793 master-0 kubenswrapper[8993]: I1204 11:38:42.339645 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e3160a9-11d1-4845-ba30-1a49ae7339a9-config\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:38:42.340793 master-0 kubenswrapper[8993]: I1204 11:38:42.339666 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e3160a9-11d1-4845-ba30-1a49ae7339a9-cert\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:38:42.340793 master-0 kubenswrapper[8993]: I1204 11:38:42.339718 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fksx7\" (UniqueName: \"kubernetes.io/projected/7e3160a9-11d1-4845-ba30-1a49ae7339a9-kube-api-access-fksx7\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:38:42.340793 master-0 kubenswrapper[8993]: I1204 11:38:42.339771 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-baremetal-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e3160a9-11d1-4845-ba30-1a49ae7339a9-cluster-baremetal-operator-tls\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:38:42.347601 master-0 kubenswrapper[8993]: I1204 11:38:42.347561 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e3160a9-11d1-4845-ba30-1a49ae7339a9-config\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:38:42.348374 master-0 kubenswrapper[8993]: I1204 11:38:42.348133 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/7e3160a9-11d1-4845-ba30-1a49ae7339a9-images\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:38:42.353859 master-0 kubenswrapper[8993]: I1204 11:38:42.353533 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cluster-baremetal-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e3160a9-11d1-4845-ba30-1a49ae7339a9-cluster-baremetal-operator-tls\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:38:42.357784 master-0 kubenswrapper[8993]: I1204 11:38:42.357722 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e3160a9-11d1-4845-ba30-1a49ae7339a9-cert\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:38:42.386169 master-0 kubenswrapper[8993]: I1204 11:38:42.386020 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fksx7\" (UniqueName: \"kubernetes.io/projected/7e3160a9-11d1-4845-ba30-1a49ae7339a9-kube-api-access-fksx7\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:38:42.400215 master-0 kubenswrapper[8993]: I1204 11:38:42.399747 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-797cfd8b47-8wqgp" Dec 04 11:38:42.508077 master-0 kubenswrapper[8993]: I1204 11:38:42.508017 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:38:42.791084 master-0 kubenswrapper[8993]: I1204 11:38:42.790981 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_installer-3-master-0_c26ef42b-772d-4708-9258-f19c4432cf98/installer/0.log" Dec 04 11:38:42.791770 master-0 kubenswrapper[8993]: I1204 11:38:42.791117 8993 generic.go:334] "Generic (PLEG): container finished" podID="c26ef42b-772d-4708-9258-f19c4432cf98" containerID="87b326610b4da980ea18879714f675d6bb9e24b9cf46e43dd90e6c093d451fef" exitCode=1 Dec 04 11:38:42.791770 master-0 kubenswrapper[8993]: I1204 11:38:42.791346 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-3-master-0" event={"ID":"c26ef42b-772d-4708-9258-f19c4432cf98","Type":"ContainerDied","Data":"87b326610b4da980ea18879714f675d6bb9e24b9cf46e43dd90e6c093d451fef"} Dec 04 11:38:42.806145 master-0 kubenswrapper[8993]: I1204 11:38:42.806027 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" event={"ID":"64d30b80-2336-49c2-a2c2-1e0694036a84","Type":"ContainerStarted","Data":"d1c9a8585f7a5265a978457ce0a270703b6517df0bbfb680f3b6722aa322ffbc"} Dec 04 11:38:42.806145 master-0 kubenswrapper[8993]: I1204 11:38:42.806135 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" event={"ID":"64d30b80-2336-49c2-a2c2-1e0694036a84","Type":"ContainerStarted","Data":"f98dcde4da5cf1328576b051bbce37ad312e157073b4d2dd8315e3085ebb6ec4"} Dec 04 11:38:42.840072 master-0 kubenswrapper[8993]: I1204 11:38:42.839986 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-7f22v"] Dec 04 11:38:42.901636 master-0 kubenswrapper[8993]: I1204 11:38:42.900908 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_installer-3-master-0_c26ef42b-772d-4708-9258-f19c4432cf98/installer/0.log" Dec 04 11:38:42.901636 master-0 kubenswrapper[8993]: I1204 11:38:42.901013 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 11:38:42.957113 master-0 kubenswrapper[8993]: I1204 11:38:42.956362 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/c26ef42b-772d-4708-9258-f19c4432cf98-var-lock\") pod \"c26ef42b-772d-4708-9258-f19c4432cf98\" (UID: \"c26ef42b-772d-4708-9258-f19c4432cf98\") " Dec 04 11:38:42.957113 master-0 kubenswrapper[8993]: I1204 11:38:42.956448 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c26ef42b-772d-4708-9258-f19c4432cf98-kubelet-dir\") pod \"c26ef42b-772d-4708-9258-f19c4432cf98\" (UID: \"c26ef42b-772d-4708-9258-f19c4432cf98\") " Dec 04 11:38:42.957113 master-0 kubenswrapper[8993]: I1204 11:38:42.956515 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/c26ef42b-772d-4708-9258-f19c4432cf98-kube-api-access\") pod \"c26ef42b-772d-4708-9258-f19c4432cf98\" (UID: \"c26ef42b-772d-4708-9258-f19c4432cf98\") " Dec 04 11:38:42.957573 master-0 kubenswrapper[8993]: I1204 11:38:42.957281 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c26ef42b-772d-4708-9258-f19c4432cf98-var-lock" (OuterVolumeSpecName: "var-lock") pod "c26ef42b-772d-4708-9258-f19c4432cf98" (UID: "c26ef42b-772d-4708-9258-f19c4432cf98"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:38:42.957573 master-0 kubenswrapper[8993]: I1204 11:38:42.957333 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c26ef42b-772d-4708-9258-f19c4432cf98-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "c26ef42b-772d-4708-9258-f19c4432cf98" (UID: "c26ef42b-772d-4708-9258-f19c4432cf98"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:38:42.979764 master-0 kubenswrapper[8993]: I1204 11:38:42.973754 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c26ef42b-772d-4708-9258-f19c4432cf98-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "c26ef42b-772d-4708-9258-f19c4432cf98" (UID: "c26ef42b-772d-4708-9258-f19c4432cf98"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:38:43.060296 master-0 kubenswrapper[8993]: I1204 11:38:43.059043 8993 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/c26ef42b-772d-4708-9258-f19c4432cf98-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:43.060296 master-0 kubenswrapper[8993]: I1204 11:38:43.059099 8993 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c26ef42b-772d-4708-9258-f19c4432cf98-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:43.060296 master-0 kubenswrapper[8993]: I1204 11:38:43.059123 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/c26ef42b-772d-4708-9258-f19c4432cf98-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:43.085621 master-0 kubenswrapper[8993]: I1204 11:38:43.084990 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-797cfd8b47-8wqgp"] Dec 04 11:38:43.206065 master-0 kubenswrapper[8993]: I1204 11:38:43.203770 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-controller-manager/installer-1-master-0"] Dec 04 11:38:43.206065 master-0 kubenswrapper[8993]: I1204 11:38:43.204169 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/installer-1-master-0" podUID="2dea9140-7c02-46cd-9b67-a2aee143c3a8" containerName="installer" containerID="cri-o://c88107d86ca094e0fb66d5f48c269fd63501da09c2e45e6167e8bdd22853011e" gracePeriod=30 Dec 04 11:38:43.259359 master-0 kubenswrapper[8993]: I1204 11:38:43.257699 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5"] Dec 04 11:38:43.269790 master-0 kubenswrapper[8993]: I1204 11:38:43.267995 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-wksdw"] Dec 04 11:38:43.269790 master-0 kubenswrapper[8993]: E1204 11:38:43.268312 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c26ef42b-772d-4708-9258-f19c4432cf98" containerName="installer" Dec 04 11:38:43.269790 master-0 kubenswrapper[8993]: I1204 11:38:43.268328 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="c26ef42b-772d-4708-9258-f19c4432cf98" containerName="installer" Dec 04 11:38:43.269790 master-0 kubenswrapper[8993]: I1204 11:38:43.268507 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="c26ef42b-772d-4708-9258-f19c4432cf98" containerName="installer" Dec 04 11:38:43.269790 master-0 kubenswrapper[8993]: I1204 11:38:43.269316 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:38:43.275671 master-0 kubenswrapper[8993]: I1204 11:38:43.275366 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"redhat-operators-dockercfg-8t954" Dec 04 11:38:43.298508 master-0 kubenswrapper[8993]: I1204 11:38:43.298364 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-wksdw"] Dec 04 11:38:43.309755 master-0 kubenswrapper[8993]: I1204 11:38:43.309531 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk"] Dec 04 11:38:43.312350 master-0 kubenswrapper[8993]: I1204 11:38:43.312303 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" Dec 04 11:38:43.337831 master-0 kubenswrapper[8993]: I1204 11:38:43.337567 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-autoscaler-operator-cert" Dec 04 11:38:43.338286 master-0 kubenswrapper[8993]: I1204 11:38:43.338107 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-autoscaler-operator-dockercfg-zs454" Dec 04 11:38:43.338458 master-0 kubenswrapper[8993]: I1204 11:38:43.338291 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-rbac-proxy-cluster-autoscaler-operator" Dec 04 11:38:43.362098 master-0 kubenswrapper[8993]: I1204 11:38:43.361952 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-55965856b6-skbmb"] Dec 04 11:38:43.372883 master-0 kubenswrapper[8993]: I1204 11:38:43.372762 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:38:43.382542 master-0 kubenswrapper[8993]: I1204 11:38:43.382478 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk"] Dec 04 11:38:43.383881 master-0 kubenswrapper[8993]: I1204 11:38:43.383844 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-insights"/"openshift-insights-serving-cert" Dec 04 11:38:43.384356 master-0 kubenswrapper[8993]: I1204 11:38:43.383852 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-insights"/"operator-dockercfg-qxdwr" Dec 04 11:38:43.384933 master-0 kubenswrapper[8993]: I1204 11:38:43.383950 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"service-ca-bundle" Dec 04 11:38:43.388186 master-0 kubenswrapper[8993]: I1204 11:38:43.384953 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"openshift-service-ca.crt" Dec 04 11:38:43.401856 master-0 kubenswrapper[8993]: I1204 11:38:43.391448 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsvvf\" (UniqueName: \"kubernetes.io/projected/018e9ad3-c071-45c6-bfa6-e53dda20c757-kube-api-access-bsvvf\") pod \"redhat-operators-wksdw\" (UID: \"018e9ad3-c071-45c6-bfa6-e53dda20c757\") " pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:38:43.401856 master-0 kubenswrapper[8993]: I1204 11:38:43.391548 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/018e9ad3-c071-45c6-bfa6-e53dda20c757-catalog-content\") pod \"redhat-operators-wksdw\" (UID: \"018e9ad3-c071-45c6-bfa6-e53dda20c757\") " pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:38:43.401856 master-0 kubenswrapper[8993]: I1204 11:38:43.391582 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/018e9ad3-c071-45c6-bfa6-e53dda20c757-utilities\") pod \"redhat-operators-wksdw\" (UID: \"018e9ad3-c071-45c6-bfa6-e53dda20c757\") " pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:38:43.401856 master-0 kubenswrapper[8993]: I1204 11:38:43.391616 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pqsl\" (UniqueName: \"kubernetes.io/projected/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-kube-api-access-2pqsl\") pod \"cluster-autoscaler-operator-5f49d774cd-894dk\" (UID: \"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639\") " pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" Dec 04 11:38:43.401856 master-0 kubenswrapper[8993]: I1204 11:38:43.391656 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-auth-proxy-config\") pod \"cluster-autoscaler-operator-5f49d774cd-894dk\" (UID: \"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639\") " pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" Dec 04 11:38:43.401856 master-0 kubenswrapper[8993]: I1204 11:38:43.391685 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-cert\") pod \"cluster-autoscaler-operator-5f49d774cd-894dk\" (UID: \"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639\") " pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" Dec 04 11:38:43.401856 master-0 kubenswrapper[8993]: I1204 11:38:43.399116 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-55965856b6-skbmb"] Dec 04 11:38:43.403341 master-0 kubenswrapper[8993]: I1204 11:38:43.403084 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"kube-root-ca.crt" Dec 04 11:38:43.429797 master-0 kubenswrapper[8993]: I1204 11:38:43.423606 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"trusted-ca-bundle" Dec 04 11:38:43.503336 master-0 kubenswrapper[8993]: I1204 11:38:43.503261 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-auth-proxy-config\") pod \"cluster-autoscaler-operator-5f49d774cd-894dk\" (UID: \"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639\") " pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" Dec 04 11:38:43.507912 master-0 kubenswrapper[8993]: I1204 11:38:43.502150 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-auth-proxy-config\") pod \"cluster-autoscaler-operator-5f49d774cd-894dk\" (UID: \"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639\") " pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" Dec 04 11:38:43.508171 master-0 kubenswrapper[8993]: I1204 11:38:43.508143 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b668f740-dbc3-48e0-9ebc-83bae3a43c83-snapshots\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:38:43.508469 master-0 kubenswrapper[8993]: I1204 11:38:43.508377 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b668f740-dbc3-48e0-9ebc-83bae3a43c83-service-ca-bundle\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:38:43.508531 master-0 kubenswrapper[8993]: I1204 11:38:43.508512 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-cert\") pod \"cluster-autoscaler-operator-5f49d774cd-894dk\" (UID: \"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639\") " pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" Dec 04 11:38:43.508598 master-0 kubenswrapper[8993]: I1204 11:38:43.508573 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b668f740-dbc3-48e0-9ebc-83bae3a43c83-trusted-ca-bundle\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:38:43.510075 master-0 kubenswrapper[8993]: I1204 11:38:43.509897 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b668f740-dbc3-48e0-9ebc-83bae3a43c83-serving-cert\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:38:43.510157 master-0 kubenswrapper[8993]: I1204 11:38:43.510109 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bsvvf\" (UniqueName: \"kubernetes.io/projected/018e9ad3-c071-45c6-bfa6-e53dda20c757-kube-api-access-bsvvf\") pod \"redhat-operators-wksdw\" (UID: \"018e9ad3-c071-45c6-bfa6-e53dda20c757\") " pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:38:43.510204 master-0 kubenswrapper[8993]: I1204 11:38:43.510190 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xttdn\" (UniqueName: \"kubernetes.io/projected/b668f740-dbc3-48e0-9ebc-83bae3a43c83-kube-api-access-xttdn\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:38:43.510287 master-0 kubenswrapper[8993]: I1204 11:38:43.510258 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/018e9ad3-c071-45c6-bfa6-e53dda20c757-catalog-content\") pod \"redhat-operators-wksdw\" (UID: \"018e9ad3-c071-45c6-bfa6-e53dda20c757\") " pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:38:43.510335 master-0 kubenswrapper[8993]: I1204 11:38:43.510295 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/018e9ad3-c071-45c6-bfa6-e53dda20c757-utilities\") pod \"redhat-operators-wksdw\" (UID: \"018e9ad3-c071-45c6-bfa6-e53dda20c757\") " pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:38:43.510427 master-0 kubenswrapper[8993]: I1204 11:38:43.510372 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2pqsl\" (UniqueName: \"kubernetes.io/projected/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-kube-api-access-2pqsl\") pod \"cluster-autoscaler-operator-5f49d774cd-894dk\" (UID: \"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639\") " pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" Dec 04 11:38:43.512306 master-0 kubenswrapper[8993]: I1204 11:38:43.511324 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/018e9ad3-c071-45c6-bfa6-e53dda20c757-utilities\") pod \"redhat-operators-wksdw\" (UID: \"018e9ad3-c071-45c6-bfa6-e53dda20c757\") " pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:38:43.512306 master-0 kubenswrapper[8993]: I1204 11:38:43.511495 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/018e9ad3-c071-45c6-bfa6-e53dda20c757-catalog-content\") pod \"redhat-operators-wksdw\" (UID: \"018e9ad3-c071-45c6-bfa6-e53dda20c757\") " pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:38:43.525975 master-0 kubenswrapper[8993]: I1204 11:38:43.525777 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-cert\") pod \"cluster-autoscaler-operator-5f49d774cd-894dk\" (UID: \"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639\") " pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" Dec 04 11:38:43.541381 master-0 kubenswrapper[8993]: I1204 11:38:43.538139 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pqsl\" (UniqueName: \"kubernetes.io/projected/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-kube-api-access-2pqsl\") pod \"cluster-autoscaler-operator-5f49d774cd-894dk\" (UID: \"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639\") " pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" Dec 04 11:38:43.559733 master-0 kubenswrapper[8993]: I1204 11:38:43.559676 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsvvf\" (UniqueName: \"kubernetes.io/projected/018e9ad3-c071-45c6-bfa6-e53dda20c757-kube-api-access-bsvvf\") pod \"redhat-operators-wksdw\" (UID: \"018e9ad3-c071-45c6-bfa6-e53dda20c757\") " pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:38:43.614368 master-0 kubenswrapper[8993]: I1204 11:38:43.612903 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b668f740-dbc3-48e0-9ebc-83bae3a43c83-snapshots\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:38:43.614368 master-0 kubenswrapper[8993]: I1204 11:38:43.612976 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b668f740-dbc3-48e0-9ebc-83bae3a43c83-service-ca-bundle\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:38:43.614368 master-0 kubenswrapper[8993]: I1204 11:38:43.613018 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b668f740-dbc3-48e0-9ebc-83bae3a43c83-trusted-ca-bundle\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:38:43.614368 master-0 kubenswrapper[8993]: I1204 11:38:43.613039 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b668f740-dbc3-48e0-9ebc-83bae3a43c83-serving-cert\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:38:43.614368 master-0 kubenswrapper[8993]: I1204 11:38:43.613103 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xttdn\" (UniqueName: \"kubernetes.io/projected/b668f740-dbc3-48e0-9ebc-83bae3a43c83-kube-api-access-xttdn\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:38:43.619125 master-0 kubenswrapper[8993]: I1204 11:38:43.618568 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b668f740-dbc3-48e0-9ebc-83bae3a43c83-snapshots\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:38:43.619433 master-0 kubenswrapper[8993]: I1204 11:38:43.619391 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b668f740-dbc3-48e0-9ebc-83bae3a43c83-service-ca-bundle\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:38:43.620390 master-0 kubenswrapper[8993]: I1204 11:38:43.620328 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b668f740-dbc3-48e0-9ebc-83bae3a43c83-trusted-ca-bundle\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:38:43.630305 master-0 kubenswrapper[8993]: I1204 11:38:43.630252 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b668f740-dbc3-48e0-9ebc-83bae3a43c83-serving-cert\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:38:43.633916 master-0 kubenswrapper[8993]: I1204 11:38:43.633872 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xttdn\" (UniqueName: \"kubernetes.io/projected/b668f740-dbc3-48e0-9ebc-83bae3a43c83-kube-api-access-xttdn\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:38:43.652761 master-0 kubenswrapper[8993]: I1204 11:38:43.652706 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:38:43.687114 master-0 kubenswrapper[8993]: I1204 11:38:43.686581 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" Dec 04 11:38:43.746393 master-0 kubenswrapper[8993]: I1204 11:38:43.745750 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:38:43.836121 master-0 kubenswrapper[8993]: I1204 11:38:43.832945 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" event={"ID":"7e3160a9-11d1-4845-ba30-1a49ae7339a9","Type":"ContainerStarted","Data":"c2c98fa5f1fd4720ca08ff4b851c5b1972a6185dbb2f13863dd011c50de56bb2"} Dec 04 11:38:43.846456 master-0 kubenswrapper[8993]: I1204 11:38:43.845989 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_installer-3-master-0_c26ef42b-772d-4708-9258-f19c4432cf98/installer/0.log" Dec 04 11:38:43.846456 master-0 kubenswrapper[8993]: I1204 11:38:43.846165 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-3-master-0" event={"ID":"c26ef42b-772d-4708-9258-f19c4432cf98","Type":"ContainerDied","Data":"f2472f4682e1e8e3f8bb729cbae27e67f828a88c6a231750c3d0b15f03f0f09c"} Dec 04 11:38:43.846456 master-0 kubenswrapper[8993]: I1204 11:38:43.846265 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-3-master-0" Dec 04 11:38:43.846456 master-0 kubenswrapper[8993]: I1204 11:38:43.846335 8993 scope.go:117] "RemoveContainer" containerID="87b326610b4da980ea18879714f675d6bb9e24b9cf46e43dd90e6c093d451fef" Dec 04 11:38:43.853994 master-0 kubenswrapper[8993]: I1204 11:38:43.853786 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-797cfd8b47-8wqgp" event={"ID":"ccf1cb9e-8885-4224-92d5-d1b116bc0090","Type":"ContainerStarted","Data":"5f6e465bf3a100d7d2886ee1f7e11272f1efa1a5de4bd0fed903545e3f9d07c9"} Dec 04 11:38:43.905000 master-0 kubenswrapper[8993]: I1204 11:38:43.886982 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-scheduler/installer-3-master-0"] Dec 04 11:38:43.905000 master-0 kubenswrapper[8993]: I1204 11:38:43.890529 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-scheduler/installer-3-master-0"] Dec 04 11:38:44.015328 master-0 kubenswrapper[8993]: I1204 11:38:44.012678 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn"] Dec 04 11:38:44.018689 master-0 kubenswrapper[8993]: I1204 11:38:44.018019 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:38:44.029965 master-0 kubenswrapper[8993]: I1204 11:38:44.026654 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"openshift-service-ca.crt" Dec 04 11:38:44.030846 master-0 kubenswrapper[8993]: I1204 11:38:44.030794 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"mco-proxy-tls" Dec 04 11:38:44.030934 master-0 kubenswrapper[8993]: I1204 11:38:44.030857 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"kube-root-ca.crt" Dec 04 11:38:44.031030 master-0 kubenswrapper[8993]: I1204 11:38:44.030945 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-operator-dockercfg-l9v2g" Dec 04 11:38:44.031030 master-0 kubenswrapper[8993]: I1204 11:38:44.030959 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"kube-rbac-proxy" Dec 04 11:38:44.031370 master-0 kubenswrapper[8993]: I1204 11:38:44.031326 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"machine-config-operator-images" Dec 04 11:38:44.049470 master-0 kubenswrapper[8993]: I1204 11:38:44.048401 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn"] Dec 04 11:38:44.119249 master-0 kubenswrapper[8993]: I1204 11:38:44.119086 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd"] Dec 04 11:38:44.125881 master-0 kubenswrapper[8993]: I1204 11:38:44.124878 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-images\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:38:44.125881 master-0 kubenswrapper[8993]: I1204 11:38:44.124988 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-auth-proxy-config\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:38:44.125881 master-0 kubenswrapper[8993]: I1204 11:38:44.125024 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhvdc\" (UniqueName: \"kubernetes.io/projected/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-kube-api-access-nhvdc\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:38:44.125881 master-0 kubenswrapper[8993]: I1204 11:38:44.125072 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-proxy-tls\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:38:44.127591 master-0 kubenswrapper[8993]: I1204 11:38:44.127515 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" Dec 04 11:38:44.128453 master-0 kubenswrapper[8993]: I1204 11:38:44.128392 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd"] Dec 04 11:38:44.131122 master-0 kubenswrapper[8993]: I1204 11:38:44.131070 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-storage-operator"/"cluster-storage-operator-serving-cert" Dec 04 11:38:44.228351 master-0 kubenswrapper[8993]: I1204 11:38:44.226601 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-auth-proxy-config\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:38:44.228351 master-0 kubenswrapper[8993]: I1204 11:38:44.226664 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nhvdc\" (UniqueName: \"kubernetes.io/projected/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-kube-api-access-nhvdc\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:38:44.228351 master-0 kubenswrapper[8993]: I1204 11:38:44.226692 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjkck\" (UniqueName: \"kubernetes.io/projected/f797ab14-0eb5-48b4-b914-f434f67c4c49-kube-api-access-zjkck\") pod \"cluster-storage-operator-dcf7fc84b-fncfd\" (UID: \"f797ab14-0eb5-48b4-b914-f434f67c4c49\") " pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" Dec 04 11:38:44.228351 master-0 kubenswrapper[8993]: I1204 11:38:44.226938 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-proxy-tls\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:38:44.228351 master-0 kubenswrapper[8993]: I1204 11:38:44.227152 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-storage-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/f797ab14-0eb5-48b4-b914-f434f67c4c49-cluster-storage-operator-serving-cert\") pod \"cluster-storage-operator-dcf7fc84b-fncfd\" (UID: \"f797ab14-0eb5-48b4-b914-f434f67c4c49\") " pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" Dec 04 11:38:44.228351 master-0 kubenswrapper[8993]: I1204 11:38:44.227235 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-images\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:38:44.230254 master-0 kubenswrapper[8993]: I1204 11:38:44.230176 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-auth-proxy-config\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:38:44.235622 master-0 kubenswrapper[8993]: I1204 11:38:44.235534 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-images\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:38:44.250004 master-0 kubenswrapper[8993]: I1204 11:38:44.249917 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-proxy-tls\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:38:44.254667 master-0 kubenswrapper[8993]: I1204 11:38:44.254600 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhvdc\" (UniqueName: \"kubernetes.io/projected/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-kube-api-access-nhvdc\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:38:44.292050 master-0 kubenswrapper[8993]: I1204 11:38:44.290626 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk"] Dec 04 11:38:44.310895 master-0 kubenswrapper[8993]: W1204 11:38:44.310767 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7fc7c16_5bca_49e5_aff0_7a8f80c6b639.slice/crio-80b7010f11c99ac14cabd3f2b1f486b53fdcc69d5c12f6e72980c019a365f3ae WatchSource:0}: Error finding container 80b7010f11c99ac14cabd3f2b1f486b53fdcc69d5c12f6e72980c019a365f3ae: Status 404 returned error can't find the container with id 80b7010f11c99ac14cabd3f2b1f486b53fdcc69d5c12f6e72980c019a365f3ae Dec 04 11:38:44.328498 master-0 kubenswrapper[8993]: I1204 11:38:44.328422 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zjkck\" (UniqueName: \"kubernetes.io/projected/f797ab14-0eb5-48b4-b914-f434f67c4c49-kube-api-access-zjkck\") pod \"cluster-storage-operator-dcf7fc84b-fncfd\" (UID: \"f797ab14-0eb5-48b4-b914-f434f67c4c49\") " pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" Dec 04 11:38:44.328498 master-0 kubenswrapper[8993]: I1204 11:38:44.328492 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-storage-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/f797ab14-0eb5-48b4-b914-f434f67c4c49-cluster-storage-operator-serving-cert\") pod \"cluster-storage-operator-dcf7fc84b-fncfd\" (UID: \"f797ab14-0eb5-48b4-b914-f434f67c4c49\") " pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" Dec 04 11:38:44.334172 master-0 kubenswrapper[8993]: I1204 11:38:44.334116 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cluster-storage-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/f797ab14-0eb5-48b4-b914-f434f67c4c49-cluster-storage-operator-serving-cert\") pod \"cluster-storage-operator-dcf7fc84b-fncfd\" (UID: \"f797ab14-0eb5-48b4-b914-f434f67c4c49\") " pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" Dec 04 11:38:44.343822 master-0 kubenswrapper[8993]: I1204 11:38:44.343754 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-wksdw"] Dec 04 11:38:44.355763 master-0 kubenswrapper[8993]: I1204 11:38:44.355717 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjkck\" (UniqueName: \"kubernetes.io/projected/f797ab14-0eb5-48b4-b914-f434f67c4c49-kube-api-access-zjkck\") pod \"cluster-storage-operator-dcf7fc84b-fncfd\" (UID: \"f797ab14-0eb5-48b4-b914-f434f67c4c49\") " pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" Dec 04 11:38:44.362684 master-0 kubenswrapper[8993]: I1204 11:38:44.360303 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:38:44.366703 master-0 kubenswrapper[8993]: W1204 11:38:44.366630 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod018e9ad3_c071_45c6_bfa6_e53dda20c757.slice/crio-5b961ab6b54b9feb8cf7fe5efab6be134bcc809fa3be066db38163dd3c1044fc WatchSource:0}: Error finding container 5b961ab6b54b9feb8cf7fe5efab6be134bcc809fa3be066db38163dd3c1044fc: Status 404 returned error can't find the container with id 5b961ab6b54b9feb8cf7fe5efab6be134bcc809fa3be066db38163dd3c1044fc Dec 04 11:38:44.505081 master-0 kubenswrapper[8993]: I1204 11:38:44.496388 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" Dec 04 11:38:44.594837 master-0 kubenswrapper[8993]: I1204 11:38:44.589897 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-55965856b6-skbmb"] Dec 04 11:38:44.617217 master-0 kubenswrapper[8993]: I1204 11:38:44.612640 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler/installer-4-master-0"] Dec 04 11:38:44.628899 master-0 kubenswrapper[8993]: I1204 11:38:44.628776 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:38:44.630752 master-0 kubenswrapper[8993]: I1204 11:38:44.629975 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-2p882"] Dec 04 11:38:44.635495 master-0 kubenswrapper[8993]: I1204 11:38:44.633083 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/installer-4-master-0"] Dec 04 11:38:44.640445 master-0 kubenswrapper[8993]: I1204 11:38:44.638106 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-scheduler"/"installer-sa-dockercfg-z45bl" Dec 04 11:38:44.741122 master-0 kubenswrapper[8993]: I1204 11:38:44.741028 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/780ea907-dec5-426e-9de2-158f59c09f71-kube-api-access\") pod \"installer-4-master-0\" (UID: \"780ea907-dec5-426e-9de2-158f59c09f71\") " pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:38:44.741122 master-0 kubenswrapper[8993]: I1204 11:38:44.741120 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/780ea907-dec5-426e-9de2-158f59c09f71-var-lock\") pod \"installer-4-master-0\" (UID: \"780ea907-dec5-426e-9de2-158f59c09f71\") " pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:38:44.742793 master-0 kubenswrapper[8993]: I1204 11:38:44.741212 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/780ea907-dec5-426e-9de2-158f59c09f71-kubelet-dir\") pod \"installer-4-master-0\" (UID: \"780ea907-dec5-426e-9de2-158f59c09f71\") " pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:38:44.800128 master-0 kubenswrapper[8993]: W1204 11:38:44.799761 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb668f740_dbc3_48e0_9ebc_83bae3a43c83.slice/crio-c2ef6f4b038048608a7de8078d0bbb7a0ab65dee8ba06d90a8c50f1331efa7b2 WatchSource:0}: Error finding container c2ef6f4b038048608a7de8078d0bbb7a0ab65dee8ba06d90a8c50f1331efa7b2: Status 404 returned error can't find the container with id c2ef6f4b038048608a7de8078d0bbb7a0ab65dee8ba06d90a8c50f1331efa7b2 Dec 04 11:38:44.847204 master-0 kubenswrapper[8993]: I1204 11:38:44.846939 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/780ea907-dec5-426e-9de2-158f59c09f71-kube-api-access\") pod \"installer-4-master-0\" (UID: \"780ea907-dec5-426e-9de2-158f59c09f71\") " pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:38:44.847204 master-0 kubenswrapper[8993]: I1204 11:38:44.847106 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/780ea907-dec5-426e-9de2-158f59c09f71-var-lock\") pod \"installer-4-master-0\" (UID: \"780ea907-dec5-426e-9de2-158f59c09f71\") " pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:38:44.847535 master-0 kubenswrapper[8993]: I1204 11:38:44.847178 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/780ea907-dec5-426e-9de2-158f59c09f71-kubelet-dir\") pod \"installer-4-master-0\" (UID: \"780ea907-dec5-426e-9de2-158f59c09f71\") " pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:38:44.847791 master-0 kubenswrapper[8993]: I1204 11:38:44.847687 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/780ea907-dec5-426e-9de2-158f59c09f71-kubelet-dir\") pod \"installer-4-master-0\" (UID: \"780ea907-dec5-426e-9de2-158f59c09f71\") " pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:38:44.848086 master-0 kubenswrapper[8993]: I1204 11:38:44.848035 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/780ea907-dec5-426e-9de2-158f59c09f71-var-lock\") pod \"installer-4-master-0\" (UID: \"780ea907-dec5-426e-9de2-158f59c09f71\") " pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:38:44.873201 master-0 kubenswrapper[8993]: I1204 11:38:44.873075 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-55965856b6-skbmb" event={"ID":"b668f740-dbc3-48e0-9ebc-83bae3a43c83","Type":"ContainerStarted","Data":"c2ef6f4b038048608a7de8078d0bbb7a0ab65dee8ba06d90a8c50f1331efa7b2"} Dec 04 11:38:44.876388 master-0 kubenswrapper[8993]: I1204 11:38:44.876251 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" event={"ID":"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639","Type":"ContainerStarted","Data":"8351b3c33e5381d9f8f52c5cbb85fe67b5c8d17b81f220227d907d879cdef1ea"} Dec 04 11:38:44.876388 master-0 kubenswrapper[8993]: I1204 11:38:44.876304 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" event={"ID":"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639","Type":"ContainerStarted","Data":"80b7010f11c99ac14cabd3f2b1f486b53fdcc69d5c12f6e72980c019a365f3ae"} Dec 04 11:38:44.878705 master-0 kubenswrapper[8993]: I1204 11:38:44.878632 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wksdw" event={"ID":"018e9ad3-c071-45c6-bfa6-e53dda20c757","Type":"ContainerStarted","Data":"5b961ab6b54b9feb8cf7fe5efab6be134bcc809fa3be066db38163dd3c1044fc"} Dec 04 11:38:44.899294 master-0 kubenswrapper[8993]: I1204 11:38:44.899168 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/780ea907-dec5-426e-9de2-158f59c09f71-kube-api-access\") pod \"installer-4-master-0\" (UID: \"780ea907-dec5-426e-9de2-158f59c09f71\") " pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:38:44.928513 master-0 kubenswrapper[8993]: I1204 11:38:44.928435 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq"] Dec 04 11:38:44.929395 master-0 kubenswrapper[8993]: I1204 11:38:44.929362 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:38:44.935469 master-0 kubenswrapper[8993]: I1204 11:38:44.935259 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"packageserver-service-cert" Dec 04 11:38:44.935469 master-0 kubenswrapper[8993]: I1204 11:38:44.935387 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"olm-operator-serviceaccount-dockercfg-8qwsb" Dec 04 11:38:44.953292 master-0 kubenswrapper[8993]: I1204 11:38:44.953210 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq"] Dec 04 11:38:44.981987 master-0 kubenswrapper[8993]: I1204 11:38:44.981419 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:38:45.018124 master-0 kubenswrapper[8993]: I1204 11:38:45.015663 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn"] Dec 04 11:38:45.039471 master-0 kubenswrapper[8993]: I1204 11:38:45.039391 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-rxhpq"] Dec 04 11:38:45.047992 master-0 kubenswrapper[8993]: I1204 11:38:45.043439 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:38:45.053057 master-0 kubenswrapper[8993]: I1204 11:38:45.050467 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"community-operators-dockercfg-kww9g" Dec 04 11:38:45.055939 master-0 kubenswrapper[8993]: I1204 11:38:45.055852 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/855d7874-16b1-47d0-82f6-d2b0c89b9a84-webhook-cert\") pod \"packageserver-675f5c767c-mtdrq\" (UID: \"855d7874-16b1-47d0-82f6-d2b0c89b9a84\") " pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:38:45.056261 master-0 kubenswrapper[8993]: I1204 11:38:45.056070 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/855d7874-16b1-47d0-82f6-d2b0c89b9a84-apiservice-cert\") pod \"packageserver-675f5c767c-mtdrq\" (UID: \"855d7874-16b1-47d0-82f6-d2b0c89b9a84\") " pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:38:45.062959 master-0 kubenswrapper[8993]: I1204 11:38:45.062677 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/855d7874-16b1-47d0-82f6-d2b0c89b9a84-tmpfs\") pod \"packageserver-675f5c767c-mtdrq\" (UID: \"855d7874-16b1-47d0-82f6-d2b0c89b9a84\") " pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:38:45.062959 master-0 kubenswrapper[8993]: I1204 11:38:45.062895 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2"] Dec 04 11:38:45.065368 master-0 kubenswrapper[8993]: I1204 11:38:45.063934 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vv7k\" (UniqueName: \"kubernetes.io/projected/855d7874-16b1-47d0-82f6-d2b0c89b9a84-kube-api-access-5vv7k\") pod \"packageserver-675f5c767c-mtdrq\" (UID: \"855d7874-16b1-47d0-82f6-d2b0c89b9a84\") " pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:38:45.065368 master-0 kubenswrapper[8993]: I1204 11:38:45.064820 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:38:45.078133 master-0 kubenswrapper[8993]: I1204 11:38:45.077993 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"cloud-controller-manager-images" Dec 04 11:38:45.087119 master-0 kubenswrapper[8993]: I1204 11:38:45.078296 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"kube-rbac-proxy" Dec 04 11:38:45.087119 master-0 kubenswrapper[8993]: I1204 11:38:45.078450 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"openshift-service-ca.crt" Dec 04 11:38:45.087119 master-0 kubenswrapper[8993]: I1204 11:38:45.078618 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"kube-root-ca.crt" Dec 04 11:38:45.087119 master-0 kubenswrapper[8993]: I1204 11:38:45.078861 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-controller-manager-operator"/"cloud-controller-manager-operator-tls" Dec 04 11:38:45.087119 master-0 kubenswrapper[8993]: I1204 11:38:45.078974 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-rxhpq"] Dec 04 11:38:45.087119 master-0 kubenswrapper[8993]: I1204 11:38:45.081016 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd"] Dec 04 11:38:45.172016 master-0 kubenswrapper[8993]: I1204 11:38:45.171937 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-auth-proxy-config\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:38:45.172016 master-0 kubenswrapper[8993]: I1204 11:38:45.172017 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/855d7874-16b1-47d0-82f6-d2b0c89b9a84-webhook-cert\") pod \"packageserver-675f5c767c-mtdrq\" (UID: \"855d7874-16b1-47d0-82f6-d2b0c89b9a84\") " pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:38:45.172361 master-0 kubenswrapper[8993]: I1204 11:38:45.172293 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-cloud-controller-manager-operator-tls\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:38:45.172472 master-0 kubenswrapper[8993]: I1204 11:38:45.172411 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/855d7874-16b1-47d0-82f6-d2b0c89b9a84-apiservice-cert\") pod \"packageserver-675f5c767c-mtdrq\" (UID: \"855d7874-16b1-47d0-82f6-d2b0c89b9a84\") " pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:38:45.172550 master-0 kubenswrapper[8993]: I1204 11:38:45.172502 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-catalog-content\") pod \"community-operators-rxhpq\" (UID: \"5ae25dd5-dfdb-42f6-97d0-14ad17743c95\") " pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:38:45.172727 master-0 kubenswrapper[8993]: I1204 11:38:45.172694 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/855d7874-16b1-47d0-82f6-d2b0c89b9a84-tmpfs\") pod \"packageserver-675f5c767c-mtdrq\" (UID: \"855d7874-16b1-47d0-82f6-d2b0c89b9a84\") " pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:38:45.172777 master-0 kubenswrapper[8993]: I1204 11:38:45.172736 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-utilities\") pod \"community-operators-rxhpq\" (UID: \"5ae25dd5-dfdb-42f6-97d0-14ad17743c95\") " pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:38:45.172880 master-0 kubenswrapper[8993]: I1204 11:38:45.172858 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5vv7k\" (UniqueName: \"kubernetes.io/projected/855d7874-16b1-47d0-82f6-d2b0c89b9a84-kube-api-access-5vv7k\") pod \"packageserver-675f5c767c-mtdrq\" (UID: \"855d7874-16b1-47d0-82f6-d2b0c89b9a84\") " pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:38:45.172975 master-0 kubenswrapper[8993]: I1204 11:38:45.172949 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fssw\" (UniqueName: \"kubernetes.io/projected/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-kube-api-access-6fssw\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:38:45.173087 master-0 kubenswrapper[8993]: I1204 11:38:45.173059 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-images\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:38:45.173140 master-0 kubenswrapper[8993]: I1204 11:38:45.173117 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l22ps\" (UniqueName: \"kubernetes.io/projected/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-kube-api-access-l22ps\") pod \"community-operators-rxhpq\" (UID: \"5ae25dd5-dfdb-42f6-97d0-14ad17743c95\") " pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:38:45.173240 master-0 kubenswrapper[8993]: I1204 11:38:45.173214 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-host-etc-kube\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:38:45.174075 master-0 kubenswrapper[8993]: I1204 11:38:45.174001 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/855d7874-16b1-47d0-82f6-d2b0c89b9a84-tmpfs\") pod \"packageserver-675f5c767c-mtdrq\" (UID: \"855d7874-16b1-47d0-82f6-d2b0c89b9a84\") " pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:38:45.181012 master-0 kubenswrapper[8993]: I1204 11:38:45.179733 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/855d7874-16b1-47d0-82f6-d2b0c89b9a84-apiservice-cert\") pod \"packageserver-675f5c767c-mtdrq\" (UID: \"855d7874-16b1-47d0-82f6-d2b0c89b9a84\") " pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:38:45.185711 master-0 kubenswrapper[8993]: I1204 11:38:45.185646 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/855d7874-16b1-47d0-82f6-d2b0c89b9a84-webhook-cert\") pod \"packageserver-675f5c767c-mtdrq\" (UID: \"855d7874-16b1-47d0-82f6-d2b0c89b9a84\") " pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:38:45.202837 master-0 kubenswrapper[8993]: I1204 11:38:45.202759 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vv7k\" (UniqueName: \"kubernetes.io/projected/855d7874-16b1-47d0-82f6-d2b0c89b9a84-kube-api-access-5vv7k\") pod \"packageserver-675f5c767c-mtdrq\" (UID: \"855d7874-16b1-47d0-82f6-d2b0c89b9a84\") " pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:38:45.276350 master-0 kubenswrapper[8993]: I1204 11:38:45.276168 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-utilities\") pod \"community-operators-rxhpq\" (UID: \"5ae25dd5-dfdb-42f6-97d0-14ad17743c95\") " pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:38:45.276350 master-0 kubenswrapper[8993]: I1204 11:38:45.276279 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6fssw\" (UniqueName: \"kubernetes.io/projected/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-kube-api-access-6fssw\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:38:45.276980 master-0 kubenswrapper[8993]: I1204 11:38:45.276319 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-images\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:38:45.276980 master-0 kubenswrapper[8993]: I1204 11:38:45.276461 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l22ps\" (UniqueName: \"kubernetes.io/projected/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-kube-api-access-l22ps\") pod \"community-operators-rxhpq\" (UID: \"5ae25dd5-dfdb-42f6-97d0-14ad17743c95\") " pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:38:45.276980 master-0 kubenswrapper[8993]: I1204 11:38:45.276506 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-host-etc-kube\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:38:45.276980 master-0 kubenswrapper[8993]: I1204 11:38:45.276557 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-auth-proxy-config\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:38:45.276980 master-0 kubenswrapper[8993]: I1204 11:38:45.276624 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-cloud-controller-manager-operator-tls\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:38:45.276980 master-0 kubenswrapper[8993]: I1204 11:38:45.276661 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-catalog-content\") pod \"community-operators-rxhpq\" (UID: \"5ae25dd5-dfdb-42f6-97d0-14ad17743c95\") " pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:38:45.277326 master-0 kubenswrapper[8993]: I1204 11:38:45.277286 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-catalog-content\") pod \"community-operators-rxhpq\" (UID: \"5ae25dd5-dfdb-42f6-97d0-14ad17743c95\") " pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:38:45.278062 master-0 kubenswrapper[8993]: I1204 11:38:45.278020 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-utilities\") pod \"community-operators-rxhpq\" (UID: \"5ae25dd5-dfdb-42f6-97d0-14ad17743c95\") " pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:38:45.278122 master-0 kubenswrapper[8993]: I1204 11:38:45.278099 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-host-etc-kube\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:38:45.279244 master-0 kubenswrapper[8993]: I1204 11:38:45.278828 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-images\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:38:45.279244 master-0 kubenswrapper[8993]: I1204 11:38:45.279140 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-auth-proxy-config\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:38:45.284197 master-0 kubenswrapper[8993]: I1204 11:38:45.282126 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-cloud-controller-manager-operator-tls\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:38:45.304017 master-0 kubenswrapper[8993]: I1204 11:38:45.303938 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l22ps\" (UniqueName: \"kubernetes.io/projected/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-kube-api-access-l22ps\") pod \"community-operators-rxhpq\" (UID: \"5ae25dd5-dfdb-42f6-97d0-14ad17743c95\") " pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:38:45.304563 master-0 kubenswrapper[8993]: I1204 11:38:45.304499 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fssw\" (UniqueName: \"kubernetes.io/projected/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-kube-api-access-6fssw\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:38:45.318182 master-0 kubenswrapper[8993]: I1204 11:38:45.318133 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:38:45.428762 master-0 kubenswrapper[8993]: I1204 11:38:45.427860 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:38:45.459290 master-0 kubenswrapper[8993]: I1204 11:38:45.458656 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:38:45.546062 master-0 kubenswrapper[8993]: I1204 11:38:45.544712 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt"] Dec 04 11:38:45.546062 master-0 kubenswrapper[8993]: I1204 11:38:45.545794 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" podUID="13e35f5d-cc9b-409e-90bd-6c2ade6a8034" containerName="controller-manager" containerID="cri-o://408e30226780713b267871382e4ca053aef12ec750cfbd39cb2bae230c6f3eca" gracePeriod=30 Dec 04 11:38:45.560164 master-0 kubenswrapper[8993]: I1204 11:38:45.559644 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v"] Dec 04 11:38:45.560164 master-0 kubenswrapper[8993]: I1204 11:38:45.560027 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" podUID="c56bd968-49b0-41c0-8a5a-dcd3e7db8343" containerName="route-controller-manager" containerID="cri-o://47a473d94fff10df95224b25679ae8f920aec0430df8284cb166e6ed144bf766" gracePeriod=30 Dec 04 11:38:45.630923 master-0 kubenswrapper[8993]: I1204 11:38:45.625292 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-ghr5b"] Dec 04 11:38:45.638254 master-0 kubenswrapper[8993]: I1204 11:38:45.637120 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-api/machine-api-operator-88d48b57d-9fjtd"] Dec 04 11:38:45.650837 master-0 kubenswrapper[8993]: I1204 11:38:45.646992 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:38:45.650837 master-0 kubenswrapper[8993]: I1204 11:38:45.650017 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"machine-api-operator-dockercfg-tpbt2" Dec 04 11:38:45.650837 master-0 kubenswrapper[8993]: I1204 11:38:45.650393 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-rbac-proxy" Dec 04 11:38:45.650837 master-0 kubenswrapper[8993]: I1204 11:38:45.650731 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"machine-api-operator-images" Dec 04 11:38:45.651182 master-0 kubenswrapper[8993]: I1204 11:38:45.650956 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"machine-api-operator-tls" Dec 04 11:38:45.661937 master-0 kubenswrapper[8993]: I1204 11:38:45.660736 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/machine-api-operator-88d48b57d-9fjtd"] Dec 04 11:38:45.817833 master-0 kubenswrapper[8993]: I1204 11:38:45.804432 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/c50317d3-f7cd-4133-845e-44add57ac378-images\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:38:45.817833 master-0 kubenswrapper[8993]: I1204 11:38:45.804527 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2jw8\" (UniqueName: \"kubernetes.io/projected/c50317d3-f7cd-4133-845e-44add57ac378-kube-api-access-s2jw8\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:38:45.817833 master-0 kubenswrapper[8993]: I1204 11:38:45.804561 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c50317d3-f7cd-4133-845e-44add57ac378-config\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:38:45.817833 master-0 kubenswrapper[8993]: I1204 11:38:45.804903 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/c50317d3-f7cd-4133-845e-44add57ac378-machine-api-operator-tls\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:38:45.907698 master-0 kubenswrapper[8993]: I1204 11:38:45.907613 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/c50317d3-f7cd-4133-845e-44add57ac378-images\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:38:45.907698 master-0 kubenswrapper[8993]: I1204 11:38:45.907698 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s2jw8\" (UniqueName: \"kubernetes.io/projected/c50317d3-f7cd-4133-845e-44add57ac378-kube-api-access-s2jw8\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:38:45.908137 master-0 kubenswrapper[8993]: I1204 11:38:45.907740 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c50317d3-f7cd-4133-845e-44add57ac378-config\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:38:45.908137 master-0 kubenswrapper[8993]: I1204 11:38:45.907766 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/c50317d3-f7cd-4133-845e-44add57ac378-machine-api-operator-tls\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:38:45.913439 master-0 kubenswrapper[8993]: I1204 11:38:45.913371 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"machine-api-operator-tls" Dec 04 11:38:45.913720 master-0 kubenswrapper[8993]: I1204 11:38:45.913615 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-rbac-proxy" Dec 04 11:38:45.913945 master-0 kubenswrapper[8993]: I1204 11:38:45.913858 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"machine-api-operator-images" Dec 04 11:38:45.919215 master-0 kubenswrapper[8993]: I1204 11:38:45.919157 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/c50317d3-f7cd-4133-845e-44add57ac378-images\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:38:45.920003 master-0 kubenswrapper[8993]: I1204 11:38:45.919953 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c50317d3-f7cd-4133-845e-44add57ac378-config\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:38:45.923514 master-0 kubenswrapper[8993]: I1204 11:38:45.923378 8993 generic.go:334] "Generic (PLEG): container finished" podID="018e9ad3-c071-45c6-bfa6-e53dda20c757" containerID="a596093d397577de9c313d7ade0099442be9e40a6f7cf814a9802e189eb3738e" exitCode=0 Dec 04 11:38:45.923932 master-0 kubenswrapper[8993]: I1204 11:38:45.923883 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/c50317d3-f7cd-4133-845e-44add57ac378-machine-api-operator-tls\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:38:45.933175 master-0 kubenswrapper[8993]: I1204 11:38:45.930589 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c26ef42b-772d-4708-9258-f19c4432cf98" path="/var/lib/kubelet/pods/c26ef42b-772d-4708-9258-f19c4432cf98/volumes" Dec 04 11:38:45.933175 master-0 kubenswrapper[8993]: I1204 11:38:45.931260 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wksdw" event={"ID":"018e9ad3-c071-45c6-bfa6-e53dda20c757","Type":"ContainerDied","Data":"a596093d397577de9c313d7ade0099442be9e40a6f7cf814a9802e189eb3738e"} Dec 04 11:38:45.933175 master-0 kubenswrapper[8993]: I1204 11:38:45.931334 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xg7vh" Dec 04 11:38:45.934931 master-0 kubenswrapper[8993]: I1204 11:38:45.934869 8993 generic.go:334] "Generic (PLEG): container finished" podID="13e35f5d-cc9b-409e-90bd-6c2ade6a8034" containerID="408e30226780713b267871382e4ca053aef12ec750cfbd39cb2bae230c6f3eca" exitCode=0 Dec 04 11:38:45.935024 master-0 kubenswrapper[8993]: I1204 11:38:45.934984 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" event={"ID":"13e35f5d-cc9b-409e-90bd-6c2ade6a8034","Type":"ContainerDied","Data":"408e30226780713b267871382e4ca053aef12ec750cfbd39cb2bae230c6f3eca"} Dec 04 11:38:45.940997 master-0 kubenswrapper[8993]: I1204 11:38:45.940933 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2jw8\" (UniqueName: \"kubernetes.io/projected/c50317d3-f7cd-4133-845e-44add57ac378-kube-api-access-s2jw8\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:38:45.942468 master-0 kubenswrapper[8993]: I1204 11:38:45.942380 8993 generic.go:334] "Generic (PLEG): container finished" podID="c56bd968-49b0-41c0-8a5a-dcd3e7db8343" containerID="47a473d94fff10df95224b25679ae8f920aec0430df8284cb166e6ed144bf766" exitCode=0 Dec 04 11:38:45.942468 master-0 kubenswrapper[8993]: I1204 11:38:45.942439 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" event={"ID":"c56bd968-49b0-41c0-8a5a-dcd3e7db8343","Type":"ContainerDied","Data":"47a473d94fff10df95224b25679ae8f920aec0430df8284cb166e6ed144bf766"} Dec 04 11:38:46.022592 master-0 kubenswrapper[8993]: I1204 11:38:46.022303 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-8qs8v"] Dec 04 11:38:46.024319 master-0 kubenswrapper[8993]: I1204 11:38:46.024171 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:38:46.027913 master-0 kubenswrapper[8993]: I1204 11:38:46.027204 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"certified-operators-dockercfg-x4zqf" Dec 04 11:38:46.039308 master-0 kubenswrapper[8993]: I1204 11:38:46.039186 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-8qs8v"] Dec 04 11:38:46.060034 master-0 kubenswrapper[8993]: I1204 11:38:46.059974 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"machine-api-operator-dockercfg-tpbt2" Dec 04 11:38:46.066762 master-0 kubenswrapper[8993]: I1204 11:38:46.065197 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:38:46.113076 master-0 kubenswrapper[8993]: I1204 11:38:46.112704 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c-catalog-content\") pod \"certified-operators-8qs8v\" (UID: \"b620f29d-dcde-4f98-9fb6-dd479dcdcf7c\") " pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:38:46.113076 master-0 kubenswrapper[8993]: I1204 11:38:46.112772 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c-utilities\") pod \"certified-operators-8qs8v\" (UID: \"b620f29d-dcde-4f98-9fb6-dd479dcdcf7c\") " pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:38:46.114980 master-0 kubenswrapper[8993]: I1204 11:38:46.113375 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6z8r\" (UniqueName: \"kubernetes.io/projected/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c-kube-api-access-v6z8r\") pod \"certified-operators-8qs8v\" (UID: \"b620f29d-dcde-4f98-9fb6-dd479dcdcf7c\") " pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:38:46.172170 master-0 kubenswrapper[8993]: I1204 11:38:46.172070 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/installer-2-master-0"] Dec 04 11:38:46.173385 master-0 kubenswrapper[8993]: I1204 11:38:46.173290 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:38:46.179065 master-0 kubenswrapper[8993]: I1204 11:38:46.179006 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager"/"installer-sa-dockercfg-vn92f" Dec 04 11:38:46.190835 master-0 kubenswrapper[8993]: I1204 11:38:46.190679 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-2-master-0"] Dec 04 11:38:46.220954 master-0 kubenswrapper[8993]: I1204 11:38:46.220371 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/38e7be62-e4f5-42ba-89f0-83aca874a092-kube-api-access\") pod \"installer-2-master-0\" (UID: \"38e7be62-e4f5-42ba-89f0-83aca874a092\") " pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:38:46.220954 master-0 kubenswrapper[8993]: I1204 11:38:46.220472 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v6z8r\" (UniqueName: \"kubernetes.io/projected/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c-kube-api-access-v6z8r\") pod \"certified-operators-8qs8v\" (UID: \"b620f29d-dcde-4f98-9fb6-dd479dcdcf7c\") " pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:38:46.223917 master-0 kubenswrapper[8993]: I1204 11:38:46.222498 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c-catalog-content\") pod \"certified-operators-8qs8v\" (UID: \"b620f29d-dcde-4f98-9fb6-dd479dcdcf7c\") " pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:38:46.223917 master-0 kubenswrapper[8993]: I1204 11:38:46.223007 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c-catalog-content\") pod \"certified-operators-8qs8v\" (UID: \"b620f29d-dcde-4f98-9fb6-dd479dcdcf7c\") " pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:38:46.223917 master-0 kubenswrapper[8993]: I1204 11:38:46.223117 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c-utilities\") pod \"certified-operators-8qs8v\" (UID: \"b620f29d-dcde-4f98-9fb6-dd479dcdcf7c\") " pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:38:46.225182 master-0 kubenswrapper[8993]: I1204 11:38:46.225138 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/38e7be62-e4f5-42ba-89f0-83aca874a092-var-lock\") pod \"installer-2-master-0\" (UID: \"38e7be62-e4f5-42ba-89f0-83aca874a092\") " pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:38:46.225182 master-0 kubenswrapper[8993]: I1204 11:38:46.225156 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c-utilities\") pod \"certified-operators-8qs8v\" (UID: \"b620f29d-dcde-4f98-9fb6-dd479dcdcf7c\") " pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:38:46.225314 master-0 kubenswrapper[8993]: I1204 11:38:46.225235 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/38e7be62-e4f5-42ba-89f0-83aca874a092-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"38e7be62-e4f5-42ba-89f0-83aca874a092\") " pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:38:46.264136 master-0 kubenswrapper[8993]: I1204 11:38:46.264038 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6z8r\" (UniqueName: \"kubernetes.io/projected/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c-kube-api-access-v6z8r\") pod \"certified-operators-8qs8v\" (UID: \"b620f29d-dcde-4f98-9fb6-dd479dcdcf7c\") " pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:38:46.327716 master-0 kubenswrapper[8993]: I1204 11:38:46.327634 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/38e7be62-e4f5-42ba-89f0-83aca874a092-var-lock\") pod \"installer-2-master-0\" (UID: \"38e7be62-e4f5-42ba-89f0-83aca874a092\") " pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:38:46.328386 master-0 kubenswrapper[8993]: I1204 11:38:46.327508 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/38e7be62-e4f5-42ba-89f0-83aca874a092-var-lock\") pod \"installer-2-master-0\" (UID: \"38e7be62-e4f5-42ba-89f0-83aca874a092\") " pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:38:46.328386 master-0 kubenswrapper[8993]: I1204 11:38:46.328049 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/38e7be62-e4f5-42ba-89f0-83aca874a092-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"38e7be62-e4f5-42ba-89f0-83aca874a092\") " pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:38:46.328386 master-0 kubenswrapper[8993]: I1204 11:38:46.328269 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/38e7be62-e4f5-42ba-89f0-83aca874a092-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"38e7be62-e4f5-42ba-89f0-83aca874a092\") " pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:38:46.329010 master-0 kubenswrapper[8993]: I1204 11:38:46.328967 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/38e7be62-e4f5-42ba-89f0-83aca874a092-kube-api-access\") pod \"installer-2-master-0\" (UID: \"38e7be62-e4f5-42ba-89f0-83aca874a092\") " pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:38:46.355269 master-0 kubenswrapper[8993]: I1204 11:38:46.354324 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:38:46.359837 master-0 kubenswrapper[8993]: I1204 11:38:46.357159 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/38e7be62-e4f5-42ba-89f0-83aca874a092-kube-api-access\") pod \"installer-2-master-0\" (UID: \"38e7be62-e4f5-42ba-89f0-83aca874a092\") " pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:38:46.505689 master-0 kubenswrapper[8993]: I1204 11:38:46.505170 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:38:46.964196 master-0 kubenswrapper[8993]: I1204 11:38:46.964093 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" event={"ID":"f797ab14-0eb5-48b4-b914-f434f67c4c49","Type":"ContainerStarted","Data":"f406e5ed7d285ce7a027888d7e8f01827254b6187dd34070ea866b782bc7fc5c"} Dec 04 11:38:46.969239 master-0 kubenswrapper[8993]: I1204 11:38:46.969167 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" event={"ID":"cdb50850-779d-4179-ba1d-65ffeb4bb2e9","Type":"ContainerStarted","Data":"4e4d27e585843021cf1d4ebb05e041bc6724b400e88a89f330496e3b5cadf825"} Dec 04 11:38:47.986820 master-0 kubenswrapper[8993]: I1204 11:38:47.986697 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_installer-1-master-0_7746ae23-c2f8-431c-9e52-dc3d0f9404d3/installer/0.log" Dec 04 11:38:47.987583 master-0 kubenswrapper[8993]: I1204 11:38:47.986909 8993 generic.go:334] "Generic (PLEG): container finished" podID="7746ae23-c2f8-431c-9e52-dc3d0f9404d3" containerID="47094805f1edeaf17e1a7adb5657ee79a627ba8088dc54090e01c274544dfb2b" exitCode=1 Dec 04 11:38:47.987583 master-0 kubenswrapper[8993]: I1204 11:38:47.986959 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-1-master-0" event={"ID":"7746ae23-c2f8-431c-9e52-dc3d0f9404d3","Type":"ContainerDied","Data":"47094805f1edeaf17e1a7adb5657ee79a627ba8088dc54090e01c274544dfb2b"} Dec 04 11:38:48.020103 master-0 kubenswrapper[8993]: I1204 11:38:48.020026 8993 patch_prober.go:28] interesting pod/route-controller-manager-846b467b5c-thc5v container/route-controller-manager namespace/openshift-route-controller-manager: Readiness probe status=failure output="Get \"https://10.128.0.53:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:38:48.020435 master-0 kubenswrapper[8993]: I1204 11:38:48.020113 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" podUID="c56bd968-49b0-41c0-8a5a-dcd3e7db8343" containerName="route-controller-manager" probeResult="failure" output="Get \"https://10.128.0.53:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:38:48.261198 master-0 kubenswrapper[8993]: I1204 11:38:48.260924 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" Dec 04 11:38:48.330391 master-0 kubenswrapper[8993]: I1204 11:38:48.329289 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-6686654b8d-rrndk"] Dec 04 11:38:48.330391 master-0 kubenswrapper[8993]: E1204 11:38:48.329931 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="13e35f5d-cc9b-409e-90bd-6c2ade6a8034" containerName="controller-manager" Dec 04 11:38:48.330391 master-0 kubenswrapper[8993]: I1204 11:38:48.329953 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="13e35f5d-cc9b-409e-90bd-6c2ade6a8034" containerName="controller-manager" Dec 04 11:38:48.330391 master-0 kubenswrapper[8993]: I1204 11:38:48.330161 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="13e35f5d-cc9b-409e-90bd-6c2ade6a8034" containerName="controller-manager" Dec 04 11:38:48.332959 master-0 kubenswrapper[8993]: I1204 11:38:48.331060 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:38:48.337936 master-0 kubenswrapper[8993]: I1204 11:38:48.337725 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-6686654b8d-rrndk"] Dec 04 11:38:48.376504 master-0 kubenswrapper[8993]: I1204 11:38:48.375275 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-proxy-ca-bundles\") pod \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\" (UID: \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\") " Dec 04 11:38:48.376504 master-0 kubenswrapper[8993]: I1204 11:38:48.375336 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-serving-cert\") pod \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\" (UID: \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\") " Dec 04 11:38:48.376504 master-0 kubenswrapper[8993]: I1204 11:38:48.375517 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-config\") pod \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\" (UID: \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\") " Dec 04 11:38:48.376504 master-0 kubenswrapper[8993]: I1204 11:38:48.375639 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-client-ca\") pod \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\" (UID: \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\") " Dec 04 11:38:48.376504 master-0 kubenswrapper[8993]: I1204 11:38:48.375777 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f97cz\" (UniqueName: \"kubernetes.io/projected/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-kube-api-access-f97cz\") pod \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\" (UID: \"13e35f5d-cc9b-409e-90bd-6c2ade6a8034\") " Dec 04 11:38:48.376504 master-0 kubenswrapper[8993]: I1204 11:38:48.376092 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-config\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:38:48.376504 master-0 kubenswrapper[8993]: I1204 11:38:48.376152 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-proxy-ca-bundles\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:38:48.376504 master-0 kubenswrapper[8993]: I1204 11:38:48.376190 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-client-ca\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:38:48.376504 master-0 kubenswrapper[8993]: I1204 11:38:48.376322 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2qnk\" (UniqueName: \"kubernetes.io/projected/24506aa4-ab78-49df-bb58-59093498f13d-kube-api-access-w2qnk\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:38:48.376504 master-0 kubenswrapper[8993]: I1204 11:38:48.376387 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24506aa4-ab78-49df-bb58-59093498f13d-serving-cert\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:38:48.377161 master-0 kubenswrapper[8993]: I1204 11:38:48.376528 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-client-ca" (OuterVolumeSpecName: "client-ca") pod "13e35f5d-cc9b-409e-90bd-6c2ade6a8034" (UID: "13e35f5d-cc9b-409e-90bd-6c2ade6a8034"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:38:48.377161 master-0 kubenswrapper[8993]: I1204 11:38:48.377068 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "13e35f5d-cc9b-409e-90bd-6c2ade6a8034" (UID: "13e35f5d-cc9b-409e-90bd-6c2ade6a8034"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:38:48.378422 master-0 kubenswrapper[8993]: I1204 11:38:48.377922 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-config" (OuterVolumeSpecName: "config") pod "13e35f5d-cc9b-409e-90bd-6c2ade6a8034" (UID: "13e35f5d-cc9b-409e-90bd-6c2ade6a8034"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:38:48.380502 master-0 kubenswrapper[8993]: I1204 11:38:48.380467 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "13e35f5d-cc9b-409e-90bd-6c2ade6a8034" (UID: "13e35f5d-cc9b-409e-90bd-6c2ade6a8034"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 11:38:48.389233 master-0 kubenswrapper[8993]: I1204 11:38:48.389148 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-kube-api-access-f97cz" (OuterVolumeSpecName: "kube-api-access-f97cz") pod "13e35f5d-cc9b-409e-90bd-6c2ade6a8034" (UID: "13e35f5d-cc9b-409e-90bd-6c2ade6a8034"). InnerVolumeSpecName "kube-api-access-f97cz". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:38:48.477835 master-0 kubenswrapper[8993]: I1204 11:38:48.477737 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24506aa4-ab78-49df-bb58-59093498f13d-serving-cert\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:38:48.478117 master-0 kubenswrapper[8993]: I1204 11:38:48.477872 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-config\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:38:48.478756 master-0 kubenswrapper[8993]: I1204 11:38:48.478617 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-proxy-ca-bundles\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:38:48.479216 master-0 kubenswrapper[8993]: I1204 11:38:48.478980 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-client-ca\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:38:48.479216 master-0 kubenswrapper[8993]: I1204 11:38:48.479075 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w2qnk\" (UniqueName: \"kubernetes.io/projected/24506aa4-ab78-49df-bb58-59093498f13d-kube-api-access-w2qnk\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:38:48.479482 master-0 kubenswrapper[8993]: I1204 11:38:48.479424 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-config\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:38:48.480347 master-0 kubenswrapper[8993]: I1204 11:38:48.480282 8993 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:48.480347 master-0 kubenswrapper[8993]: I1204 11:38:48.480348 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f97cz\" (UniqueName: \"kubernetes.io/projected/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-kube-api-access-f97cz\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:48.480460 master-0 kubenswrapper[8993]: I1204 11:38:48.480367 8993 reconciler_common.go:293] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-proxy-ca-bundles\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:48.480460 master-0 kubenswrapper[8993]: I1204 11:38:48.480383 8993 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:48.480460 master-0 kubenswrapper[8993]: I1204 11:38:48.480400 8993 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13e35f5d-cc9b-409e-90bd-6c2ade6a8034-config\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:48.480737 master-0 kubenswrapper[8993]: I1204 11:38:48.480696 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-client-ca\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:38:48.483218 master-0 kubenswrapper[8993]: I1204 11:38:48.483027 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-proxy-ca-bundles\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:38:48.483218 master-0 kubenswrapper[8993]: I1204 11:38:48.483173 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24506aa4-ab78-49df-bb58-59093498f13d-serving-cert\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:38:48.504515 master-0 kubenswrapper[8993]: I1204 11:38:48.504465 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2qnk\" (UniqueName: \"kubernetes.io/projected/24506aa4-ab78-49df-bb58-59093498f13d-kube-api-access-w2qnk\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:38:48.658944 master-0 kubenswrapper[8993]: I1204 11:38:48.658833 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:38:49.002780 master-0 kubenswrapper[8993]: I1204 11:38:49.002643 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" event={"ID":"13e35f5d-cc9b-409e-90bd-6c2ade6a8034","Type":"ContainerDied","Data":"5f67891bdcf81a10e58fd650cd479871cf63cf1a46783610fea88da38d5f52fe"} Dec 04 11:38:49.002780 master-0 kubenswrapper[8993]: I1204 11:38:49.002718 8993 scope.go:117] "RemoveContainer" containerID="408e30226780713b267871382e4ca053aef12ec750cfbd39cb2bae230c6f3eca" Dec 04 11:38:49.005124 master-0 kubenswrapper[8993]: I1204 11:38:49.002739 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt" Dec 04 11:38:49.076853 master-0 kubenswrapper[8993]: I1204 11:38:49.075873 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt"] Dec 04 11:38:49.080580 master-0 kubenswrapper[8993]: I1204 11:38:49.080517 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-controller-manager/controller-manager-7d958ff6f6-b8lzt"] Dec 04 11:38:49.409781 master-0 kubenswrapper[8993]: I1204 11:38:49.409744 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" Dec 04 11:38:49.500350 master-0 kubenswrapper[8993]: I1204 11:38:49.500279 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-config\") pod \"c56bd968-49b0-41c0-8a5a-dcd3e7db8343\" (UID: \"c56bd968-49b0-41c0-8a5a-dcd3e7db8343\") " Dec 04 11:38:49.500635 master-0 kubenswrapper[8993]: I1204 11:38:49.500467 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbxnz\" (UniqueName: \"kubernetes.io/projected/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-kube-api-access-dbxnz\") pod \"c56bd968-49b0-41c0-8a5a-dcd3e7db8343\" (UID: \"c56bd968-49b0-41c0-8a5a-dcd3e7db8343\") " Dec 04 11:38:49.500635 master-0 kubenswrapper[8993]: I1204 11:38:49.500506 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-client-ca\") pod \"c56bd968-49b0-41c0-8a5a-dcd3e7db8343\" (UID: \"c56bd968-49b0-41c0-8a5a-dcd3e7db8343\") " Dec 04 11:38:49.500635 master-0 kubenswrapper[8993]: I1204 11:38:49.500556 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-serving-cert\") pod \"c56bd968-49b0-41c0-8a5a-dcd3e7db8343\" (UID: \"c56bd968-49b0-41c0-8a5a-dcd3e7db8343\") " Dec 04 11:38:49.503887 master-0 kubenswrapper[8993]: I1204 11:38:49.503050 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-config" (OuterVolumeSpecName: "config") pod "c56bd968-49b0-41c0-8a5a-dcd3e7db8343" (UID: "c56bd968-49b0-41c0-8a5a-dcd3e7db8343"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:38:49.503887 master-0 kubenswrapper[8993]: I1204 11:38:49.503372 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-client-ca" (OuterVolumeSpecName: "client-ca") pod "c56bd968-49b0-41c0-8a5a-dcd3e7db8343" (UID: "c56bd968-49b0-41c0-8a5a-dcd3e7db8343"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 11:38:49.504266 master-0 kubenswrapper[8993]: I1204 11:38:49.504133 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "c56bd968-49b0-41c0-8a5a-dcd3e7db8343" (UID: "c56bd968-49b0-41c0-8a5a-dcd3e7db8343"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 11:38:49.504350 master-0 kubenswrapper[8993]: I1204 11:38:49.504291 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-kube-api-access-dbxnz" (OuterVolumeSpecName: "kube-api-access-dbxnz") pod "c56bd968-49b0-41c0-8a5a-dcd3e7db8343" (UID: "c56bd968-49b0-41c0-8a5a-dcd3e7db8343"). InnerVolumeSpecName "kube-api-access-dbxnz". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:38:49.602777 master-0 kubenswrapper[8993]: I1204 11:38:49.602132 8993 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-config\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:49.602777 master-0 kubenswrapper[8993]: I1204 11:38:49.602189 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dbxnz\" (UniqueName: \"kubernetes.io/projected/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-kube-api-access-dbxnz\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:49.602777 master-0 kubenswrapper[8993]: I1204 11:38:49.602205 8993 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:49.602777 master-0 kubenswrapper[8993]: I1204 11:38:49.602213 8993 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c56bd968-49b0-41c0-8a5a-dcd3e7db8343-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:49.811161 master-0 kubenswrapper[8993]: I1204 11:38:49.811096 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13e35f5d-cc9b-409e-90bd-6c2ade6a8034" path="/var/lib/kubelet/pods/13e35f5d-cc9b-409e-90bd-6c2ade6a8034/volumes" Dec 04 11:38:50.014848 master-0 kubenswrapper[8993]: I1204 11:38:50.014627 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" event={"ID":"c56bd968-49b0-41c0-8a5a-dcd3e7db8343","Type":"ContainerDied","Data":"d68dc51f246bf40bdd087540e0e6983ac7790e5fd02e31f376a9379f96364276"} Dec 04 11:38:50.014848 master-0 kubenswrapper[8993]: I1204 11:38:50.014729 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v" Dec 04 11:38:50.052211 master-0 kubenswrapper[8993]: I1204 11:38:50.052122 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v"] Dec 04 11:38:50.054882 master-0 kubenswrapper[8993]: I1204 11:38:50.054853 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-846b467b5c-thc5v"] Dec 04 11:38:50.692093 master-0 kubenswrapper[8993]: I1204 11:38:50.692022 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk"] Dec 04 11:38:50.692838 master-0 kubenswrapper[8993]: E1204 11:38:50.692792 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c56bd968-49b0-41c0-8a5a-dcd3e7db8343" containerName="route-controller-manager" Dec 04 11:38:50.692965 master-0 kubenswrapper[8993]: I1204 11:38:50.692952 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="c56bd968-49b0-41c0-8a5a-dcd3e7db8343" containerName="route-controller-manager" Dec 04 11:38:50.693211 master-0 kubenswrapper[8993]: I1204 11:38:50.693195 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="c56bd968-49b0-41c0-8a5a-dcd3e7db8343" containerName="route-controller-manager" Dec 04 11:38:50.694408 master-0 kubenswrapper[8993]: I1204 11:38:50.694390 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:38:50.698314 master-0 kubenswrapper[8993]: I1204 11:38:50.698285 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"route-controller-manager-sa-dockercfg-qzw27" Dec 04 11:38:50.698456 master-0 kubenswrapper[8993]: I1204 11:38:50.698308 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"kube-root-ca.crt" Dec 04 11:38:50.698456 master-0 kubenswrapper[8993]: I1204 11:38:50.698341 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"client-ca" Dec 04 11:38:50.699665 master-0 kubenswrapper[8993]: I1204 11:38:50.699536 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Dec 04 11:38:50.700279 master-0 kubenswrapper[8993]: I1204 11:38:50.700256 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"config" Dec 04 11:38:50.702371 master-0 kubenswrapper[8993]: I1204 11:38:50.702297 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"openshift-service-ca.crt" Dec 04 11:38:50.709612 master-0 kubenswrapper[8993]: I1204 11:38:50.709496 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk"] Dec 04 11:38:50.821282 master-0 kubenswrapper[8993]: I1204 11:38:50.821149 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d77m8\" (UniqueName: \"kubernetes.io/projected/e4d7939a-5961-4608-b910-73e71aa55bf6-kube-api-access-d77m8\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:38:50.821671 master-0 kubenswrapper[8993]: I1204 11:38:50.821590 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4d7939a-5961-4608-b910-73e71aa55bf6-serving-cert\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:38:50.821754 master-0 kubenswrapper[8993]: I1204 11:38:50.821721 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-config\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:38:50.821868 master-0 kubenswrapper[8993]: I1204 11:38:50.821840 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-client-ca\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:38:50.926426 master-0 kubenswrapper[8993]: I1204 11:38:50.925779 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4d7939a-5961-4608-b910-73e71aa55bf6-serving-cert\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:38:50.926426 master-0 kubenswrapper[8993]: I1204 11:38:50.925916 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-config\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:38:50.926426 master-0 kubenswrapper[8993]: I1204 11:38:50.925981 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-client-ca\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:38:50.926426 master-0 kubenswrapper[8993]: I1204 11:38:50.926058 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d77m8\" (UniqueName: \"kubernetes.io/projected/e4d7939a-5961-4608-b910-73e71aa55bf6-kube-api-access-d77m8\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:38:50.927461 master-0 kubenswrapper[8993]: I1204 11:38:50.927413 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-client-ca\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:38:50.927873 master-0 kubenswrapper[8993]: I1204 11:38:50.927779 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-config\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:38:50.933771 master-0 kubenswrapper[8993]: I1204 11:38:50.933710 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4d7939a-5961-4608-b910-73e71aa55bf6-serving-cert\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:38:50.947410 master-0 kubenswrapper[8993]: I1204 11:38:50.947236 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d77m8\" (UniqueName: \"kubernetes.io/projected/e4d7939a-5961-4608-b910-73e71aa55bf6-kube-api-access-d77m8\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:38:51.026497 master-0 kubenswrapper[8993]: I1204 11:38:51.026400 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:38:51.194367 master-0 kubenswrapper[8993]: I1204 11:38:51.194259 8993 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-etcd/etcd-master-0-master-0"] Dec 04 11:38:51.195303 master-0 kubenswrapper[8993]: I1204 11:38:51.195168 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-etcd/etcd-master-0-master-0" podUID="cc0396a9a2689b3e8c132c12640cbe83" containerName="etcdctl" containerID="cri-o://2486b68bc3517ab1664fcb1823dbcafa72bb90a8386d8e6780a8a95866e68263" gracePeriod=30 Dec 04 11:38:51.195482 master-0 kubenswrapper[8993]: I1204 11:38:51.195307 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-etcd/etcd-master-0-master-0" podUID="cc0396a9a2689b3e8c132c12640cbe83" containerName="etcd" containerID="cri-o://4ed3912e9d934219e324f1b3be9ecb2f87f15e4be5f71ebe6a2e74f6f7ff9948" gracePeriod=30 Dec 04 11:38:51.199166 master-0 kubenswrapper[8993]: I1204 11:38:51.199065 8993 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-etcd/etcd-master-0"] Dec 04 11:38:51.199483 master-0 kubenswrapper[8993]: E1204 11:38:51.199443 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cc0396a9a2689b3e8c132c12640cbe83" containerName="etcd" Dec 04 11:38:51.199483 master-0 kubenswrapper[8993]: I1204 11:38:51.199470 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc0396a9a2689b3e8c132c12640cbe83" containerName="etcd" Dec 04 11:38:51.199589 master-0 kubenswrapper[8993]: E1204 11:38:51.199487 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cc0396a9a2689b3e8c132c12640cbe83" containerName="etcdctl" Dec 04 11:38:51.199589 master-0 kubenswrapper[8993]: I1204 11:38:51.199499 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc0396a9a2689b3e8c132c12640cbe83" containerName="etcdctl" Dec 04 11:38:51.199872 master-0 kubenswrapper[8993]: I1204 11:38:51.199611 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="cc0396a9a2689b3e8c132c12640cbe83" containerName="etcdctl" Dec 04 11:38:51.199872 master-0 kubenswrapper[8993]: I1204 11:38:51.199631 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="cc0396a9a2689b3e8c132c12640cbe83" containerName="etcd" Dec 04 11:38:51.218734 master-0 kubenswrapper[8993]: I1204 11:38:51.218632 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0" Dec 04 11:38:51.334681 master-0 kubenswrapper[8993]: I1204 11:38:51.334600 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-usr-local-bin\") pod \"etcd-master-0\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:38:51.334681 master-0 kubenswrapper[8993]: I1204 11:38:51.334696 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-cert-dir\") pod \"etcd-master-0\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:38:51.335016 master-0 kubenswrapper[8993]: I1204 11:38:51.334719 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-static-pod-dir\") pod \"etcd-master-0\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:38:51.335016 master-0 kubenswrapper[8993]: I1204 11:38:51.334960 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-data-dir\") pod \"etcd-master-0\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:38:51.335304 master-0 kubenswrapper[8993]: I1204 11:38:51.335242 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-resource-dir\") pod \"etcd-master-0\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:38:51.335464 master-0 kubenswrapper[8993]: I1204 11:38:51.335417 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-log-dir\") pod \"etcd-master-0\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:38:51.437465 master-0 kubenswrapper[8993]: I1204 11:38:51.437389 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-resource-dir\") pod \"etcd-master-0\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:38:51.437465 master-0 kubenswrapper[8993]: I1204 11:38:51.437465 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-log-dir\") pod \"etcd-master-0\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:38:51.437750 master-0 kubenswrapper[8993]: I1204 11:38:51.437504 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-usr-local-bin\") pod \"etcd-master-0\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:38:51.437750 master-0 kubenswrapper[8993]: I1204 11:38:51.437540 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-cert-dir\") pod \"etcd-master-0\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:38:51.437750 master-0 kubenswrapper[8993]: I1204 11:38:51.437565 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-static-pod-dir\") pod \"etcd-master-0\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:38:51.437750 master-0 kubenswrapper[8993]: I1204 11:38:51.437589 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-data-dir\") pod \"etcd-master-0\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:38:51.437750 master-0 kubenswrapper[8993]: I1204 11:38:51.437703 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-data-dir\") pod \"etcd-master-0\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:38:51.438110 master-0 kubenswrapper[8993]: I1204 11:38:51.437760 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-resource-dir\") pod \"etcd-master-0\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:38:51.438110 master-0 kubenswrapper[8993]: I1204 11:38:51.437788 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-log-dir\") pod \"etcd-master-0\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:38:51.438110 master-0 kubenswrapper[8993]: I1204 11:38:51.437840 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-usr-local-bin\") pod \"etcd-master-0\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:38:51.438110 master-0 kubenswrapper[8993]: I1204 11:38:51.437867 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-cert-dir\") pod \"etcd-master-0\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:38:51.438110 master-0 kubenswrapper[8993]: I1204 11:38:51.437896 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-static-pod-dir\") pod \"etcd-master-0\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:38:51.803498 master-0 kubenswrapper[8993]: I1204 11:38:51.803424 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c56bd968-49b0-41c0-8a5a-dcd3e7db8343" path="/var/lib/kubelet/pods/c56bd968-49b0-41c0-8a5a-dcd3e7db8343/volumes" Dec 04 11:38:52.031261 master-0 kubenswrapper[8993]: I1204 11:38:52.031195 8993 generic.go:334] "Generic (PLEG): container finished" podID="f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3" containerID="20848d27653bd7e506c71f074203dfd9a4dbef438e1f6edd38d28115690cb4d7" exitCode=0 Dec 04 11:38:52.031261 master-0 kubenswrapper[8993]: I1204 11:38:52.031262 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-1-master-0" event={"ID":"f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3","Type":"ContainerDied","Data":"20848d27653bd7e506c71f074203dfd9a4dbef438e1f6edd38d28115690cb4d7"} Dec 04 11:38:54.030352 master-0 kubenswrapper[8993]: I1204 11:38:54.030293 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-1-master-0" Dec 04 11:38:54.036094 master-0 kubenswrapper[8993]: I1204 11:38:54.036059 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_installer-1-master-0_7746ae23-c2f8-431c-9e52-dc3d0f9404d3/installer/0.log" Dec 04 11:38:54.036318 master-0 kubenswrapper[8993]: I1204 11:38:54.036125 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 11:38:54.041204 master-0 kubenswrapper[8993]: I1204 11:38:54.041148 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_installer-1-master-0_7746ae23-c2f8-431c-9e52-dc3d0f9404d3/installer/0.log" Dec 04 11:38:54.041374 master-0 kubenswrapper[8993]: I1204 11:38:54.041323 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-1-master-0" Dec 04 11:38:54.042464 master-0 kubenswrapper[8993]: I1204 11:38:54.041407 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-1-master-0" event={"ID":"7746ae23-c2f8-431c-9e52-dc3d0f9404d3","Type":"ContainerDied","Data":"bc7ebd29438234ac605bc7aa0cb9e2c9cf8ce4ca7e6c3b5534b80edf20cd0afa"} Dec 04 11:38:54.043713 master-0 kubenswrapper[8993]: I1204 11:38:54.043644 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-1-master-0" event={"ID":"f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3","Type":"ContainerDied","Data":"85449a546194f1b7d82572b88b05b009dbf13dc608b9793959a5abd709bf99f0"} Dec 04 11:38:54.043713 master-0 kubenswrapper[8993]: I1204 11:38:54.043707 8993 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85449a546194f1b7d82572b88b05b009dbf13dc608b9793959a5abd709bf99f0" Dec 04 11:38:54.043848 master-0 kubenswrapper[8993]: I1204 11:38:54.043773 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-1-master-0" Dec 04 11:38:54.080645 master-0 kubenswrapper[8993]: I1204 11:38:54.080570 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3-kubelet-dir\") pod \"f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3\" (UID: \"f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3\") " Dec 04 11:38:54.080645 master-0 kubenswrapper[8993]: I1204 11:38:54.080622 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3-var-lock\") pod \"f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3\" (UID: \"f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3\") " Dec 04 11:38:54.080951 master-0 kubenswrapper[8993]: I1204 11:38:54.080697 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3-kube-api-access\") pod \"f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3\" (UID: \"f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3\") " Dec 04 11:38:54.080951 master-0 kubenswrapper[8993]: I1204 11:38:54.080760 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7746ae23-c2f8-431c-9e52-dc3d0f9404d3-kubelet-dir\") pod \"7746ae23-c2f8-431c-9e52-dc3d0f9404d3\" (UID: \"7746ae23-c2f8-431c-9e52-dc3d0f9404d3\") " Dec 04 11:38:54.080951 master-0 kubenswrapper[8993]: I1204 11:38:54.080790 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/7746ae23-c2f8-431c-9e52-dc3d0f9404d3-kube-api-access\") pod \"7746ae23-c2f8-431c-9e52-dc3d0f9404d3\" (UID: \"7746ae23-c2f8-431c-9e52-dc3d0f9404d3\") " Dec 04 11:38:54.080951 master-0 kubenswrapper[8993]: I1204 11:38:54.080837 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/7746ae23-c2f8-431c-9e52-dc3d0f9404d3-var-lock\") pod \"7746ae23-c2f8-431c-9e52-dc3d0f9404d3\" (UID: \"7746ae23-c2f8-431c-9e52-dc3d0f9404d3\") " Dec 04 11:38:54.081239 master-0 kubenswrapper[8993]: I1204 11:38:54.081166 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3-var-lock" (OuterVolumeSpecName: "var-lock") pod "f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3" (UID: "f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:38:54.081294 master-0 kubenswrapper[8993]: I1204 11:38:54.081235 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7746ae23-c2f8-431c-9e52-dc3d0f9404d3-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "7746ae23-c2f8-431c-9e52-dc3d0f9404d3" (UID: "7746ae23-c2f8-431c-9e52-dc3d0f9404d3"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:38:54.081294 master-0 kubenswrapper[8993]: I1204 11:38:54.081166 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3" (UID: "f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:38:54.081383 master-0 kubenswrapper[8993]: I1204 11:38:54.081368 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7746ae23-c2f8-431c-9e52-dc3d0f9404d3-var-lock" (OuterVolumeSpecName: "var-lock") pod "7746ae23-c2f8-431c-9e52-dc3d0f9404d3" (UID: "7746ae23-c2f8-431c-9e52-dc3d0f9404d3"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:38:54.081759 master-0 kubenswrapper[8993]: I1204 11:38:54.081720 8993 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:54.081759 master-0 kubenswrapper[8993]: I1204 11:38:54.081749 8993 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:54.081759 master-0 kubenswrapper[8993]: I1204 11:38:54.081759 8993 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7746ae23-c2f8-431c-9e52-dc3d0f9404d3-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:54.081910 master-0 kubenswrapper[8993]: I1204 11:38:54.081770 8993 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/7746ae23-c2f8-431c-9e52-dc3d0f9404d3-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:54.084499 master-0 kubenswrapper[8993]: I1204 11:38:54.084442 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3" (UID: "f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:38:54.086288 master-0 kubenswrapper[8993]: I1204 11:38:54.086205 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7746ae23-c2f8-431c-9e52-dc3d0f9404d3-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "7746ae23-c2f8-431c-9e52-dc3d0f9404d3" (UID: "7746ae23-c2f8-431c-9e52-dc3d0f9404d3"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:38:54.183765 master-0 kubenswrapper[8993]: I1204 11:38:54.183623 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 11:38:54.183765 master-0 kubenswrapper[8993]: I1204 11:38:54.183721 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/7746ae23-c2f8-431c-9e52-dc3d0f9404d3-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 11:39:04.346182 master-0 kubenswrapper[8993]: E1204 11:39:04.346103 8993 kubelet.go:1929] "Failed creating a mirror pod for" err="Internal error occurred: admission plugin \"LimitRanger\" failed to complete mutation in 13s" pod="openshift-etcd/etcd-master-0" Dec 04 11:39:04.346764 master-0 kubenswrapper[8993]: I1204 11:39:04.346738 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0" Dec 04 11:39:04.723578 master-0 kubenswrapper[8993]: E1204 11:39:04.723455 8993 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-podf24bc354_1fe3_4dd1_b0a0_3dc86a14aff3.slice/crio-85449a546194f1b7d82572b88b05b009dbf13dc608b9793959a5abd709bf99f0\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-pod7746ae23_c2f8_431c_9e52_dc3d0f9404d3.slice/crio-bc7ebd29438234ac605bc7aa0cb9e2c9cf8ce4ca7e6c3b5534b80edf20cd0afa\": RecentStats: unable to find data in memory cache]" Dec 04 11:39:06.111766 master-0 kubenswrapper[8993]: I1204 11:39:06.111624 8993 generic.go:334] "Generic (PLEG): container finished" podID="8b47694fcc32464ab24d09c23d6efb57" containerID="9f168b6e831554c513b271c722d3ec7e4db28ab5d11f8b57803ff03a30c8af06" exitCode=1 Dec 04 11:39:06.111766 master-0 kubenswrapper[8993]: I1204 11:39:06.111721 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"8b47694fcc32464ab24d09c23d6efb57","Type":"ContainerDied","Data":"9f168b6e831554c513b271c722d3ec7e4db28ab5d11f8b57803ff03a30c8af06"} Dec 04 11:39:06.112568 master-0 kubenswrapper[8993]: I1204 11:39:06.112527 8993 scope.go:117] "RemoveContainer" containerID="9f168b6e831554c513b271c722d3ec7e4db28ab5d11f8b57803ff03a30c8af06" Dec 04 11:39:06.114093 master-0 kubenswrapper[8993]: I1204 11:39:06.114046 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_installer-1-master-0_2dea9140-7c02-46cd-9b67-a2aee143c3a8/installer/0.log" Dec 04 11:39:06.114150 master-0 kubenswrapper[8993]: I1204 11:39:06.114121 8993 generic.go:334] "Generic (PLEG): container finished" podID="2dea9140-7c02-46cd-9b67-a2aee143c3a8" containerID="c88107d86ca094e0fb66d5f48c269fd63501da09c2e45e6167e8bdd22853011e" exitCode=1 Dec 04 11:39:06.114189 master-0 kubenswrapper[8993]: I1204 11:39:06.114171 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-1-master-0" event={"ID":"2dea9140-7c02-46cd-9b67-a2aee143c3a8","Type":"ContainerDied","Data":"c88107d86ca094e0fb66d5f48c269fd63501da09c2e45e6167e8bdd22853011e"} Dec 04 11:39:08.870157 master-0 kubenswrapper[8993]: I1204 11:39:08.870096 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:39:09.143728 master-0 kubenswrapper[8993]: I1204 11:39:09.143503 8993 generic.go:334] "Generic (PLEG): container finished" podID="5e09e2af7200e6f9be469dbfd9bb1127" containerID="28bd405676e81717d938eefd29fce0475230f84557116212e1a3920f34143d20" exitCode=1 Dec 04 11:39:09.143728 master-0 kubenswrapper[8993]: I1204 11:39:09.143572 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-scheduler-master-0" event={"ID":"5e09e2af7200e6f9be469dbfd9bb1127","Type":"ContainerDied","Data":"28bd405676e81717d938eefd29fce0475230f84557116212e1a3920f34143d20"} Dec 04 11:39:09.144211 master-0 kubenswrapper[8993]: I1204 11:39:09.144189 8993 scope.go:117] "RemoveContainer" containerID="28bd405676e81717d938eefd29fce0475230f84557116212e1a3920f34143d20" Dec 04 11:39:10.141700 master-0 kubenswrapper[8993]: I1204 11:39:10.141578 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:39:11.261782 master-0 kubenswrapper[8993]: E1204 11:39:11.261635 8993 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:39:12.885271 master-0 kubenswrapper[8993]: I1204 11:39:12.884942 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:39:14.491422 master-0 kubenswrapper[8993]: I1204 11:39:14.491115 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:39:14.824724 master-0 kubenswrapper[8993]: E1204 11:39:14.824640 8993 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-pod7746ae23_c2f8_431c_9e52_dc3d0f9404d3.slice/crio-bc7ebd29438234ac605bc7aa0cb9e2c9cf8ce4ca7e6c3b5534b80edf20cd0afa\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-podf24bc354_1fe3_4dd1_b0a0_3dc86a14aff3.slice/crio-85449a546194f1b7d82572b88b05b009dbf13dc608b9793959a5abd709bf99f0\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod330553d2_40ea_4496_8346_2e5bf680669b.slice/crio-e0f65feb280def85efd04008a4a4dfb6c2b0bd021e57a8e540b2a6878ffaf31a.scope\": RecentStats: unable to find data in memory cache]" Dec 04 11:39:16.186261 master-0 kubenswrapper[8993]: I1204 11:39:16.186088 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-6c8676f99d-7z948_3322cc5a-f1f7-4522-b423-19fb7f38cd43/openshift-controller-manager-operator/0.log" Dec 04 11:39:16.186261 master-0 kubenswrapper[8993]: I1204 11:39:16.186179 8993 generic.go:334] "Generic (PLEG): container finished" podID="3322cc5a-f1f7-4522-b423-19fb7f38cd43" containerID="c8d34e789c5970b0307d273982d5779a2dcd6c7a7b38f7401ca6eca1e3af06ea" exitCode=1 Dec 04 11:39:16.186261 master-0 kubenswrapper[8993]: I1204 11:39:16.186232 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" event={"ID":"3322cc5a-f1f7-4522-b423-19fb7f38cd43","Type":"ContainerDied","Data":"c8d34e789c5970b0307d273982d5779a2dcd6c7a7b38f7401ca6eca1e3af06ea"} Dec 04 11:39:16.187079 master-0 kubenswrapper[8993]: I1204 11:39:16.187033 8993 scope.go:117] "RemoveContainer" containerID="c8d34e789c5970b0307d273982d5779a2dcd6c7a7b38f7401ca6eca1e3af06ea" Dec 04 11:39:18.209922 master-0 kubenswrapper[8993]: I1204 11:39:18.209552 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-1-master-0_0a3dbe2b-a659-46c2-93e8-19bd30ee2260/installer/0.log" Dec 04 11:39:18.209922 master-0 kubenswrapper[8993]: I1204 11:39:18.209620 8993 generic.go:334] "Generic (PLEG): container finished" podID="0a3dbe2b-a659-46c2-93e8-19bd30ee2260" containerID="1374a96ed1ca6171abfb891d570b17cfc8290599387bccafe504b9debca481e3" exitCode=1 Dec 04 11:39:18.209922 master-0 kubenswrapper[8993]: I1204 11:39:18.209677 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-1-master-0" event={"ID":"0a3dbe2b-a659-46c2-93e8-19bd30ee2260","Type":"ContainerDied","Data":"1374a96ed1ca6171abfb891d570b17cfc8290599387bccafe504b9debca481e3"} Dec 04 11:39:18.390264 master-0 kubenswrapper[8993]: I1204 11:39:18.390186 8993 patch_prober.go:28] interesting pod/etcd-operator-5bf4d88c6f-2bpmr container/etcd-operator namespace/openshift-etcd-operator: Liveness probe status=failure output="Get \"https://10.128.0.21:8443/healthz\": dial tcp 10.128.0.21:8443: connect: connection refused" start-of-body= Dec 04 11:39:18.390550 master-0 kubenswrapper[8993]: I1204 11:39:18.390265 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" podUID="c6e9271a-44ea-4612-ab60-4a9d489ed062" containerName="etcd-operator" probeResult="failure" output="Get \"https://10.128.0.21:8443/healthz\": dial tcp 10.128.0.21:8443: connect: connection refused" Dec 04 11:39:19.216716 master-0 kubenswrapper[8993]: I1204 11:39:19.216650 8993 generic.go:334] "Generic (PLEG): container finished" podID="cc0396a9a2689b3e8c132c12640cbe83" containerID="4ed3912e9d934219e324f1b3be9ecb2f87f15e4be5f71ebe6a2e74f6f7ff9948" exitCode=0 Dec 04 11:39:19.284108 master-0 kubenswrapper[8993]: I1204 11:39:19.284037 8993 patch_prober.go:28] interesting pod/authentication-operator-6c968fdfdf-nrrfw container/authentication-operator namespace/openshift-authentication-operator: Liveness probe status=failure output="Get \"https://10.128.0.11:8443/healthz\": dial tcp 10.128.0.11:8443: connect: connection refused" start-of-body= Dec 04 11:39:19.284573 master-0 kubenswrapper[8993]: I1204 11:39:19.284116 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" podUID="42b3be0f-1d82-4a64-abb4-0118a6960efd" containerName="authentication-operator" probeResult="failure" output="Get \"https://10.128.0.11:8443/healthz\": dial tcp 10.128.0.11:8443: connect: connection refused" Dec 04 11:39:19.717706 master-0 kubenswrapper[8993]: I1204 11:39:19.717655 8993 scope.go:117] "RemoveContainer" containerID="47a473d94fff10df95224b25679ae8f920aec0430df8284cb166e6ed144bf766" Dec 04 11:39:21.081600 master-0 kubenswrapper[8993]: I1204 11:39:21.081556 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-1-master-0_0a3dbe2b-a659-46c2-93e8-19bd30ee2260/installer/0.log" Dec 04 11:39:21.082199 master-0 kubenswrapper[8993]: I1204 11:39:21.081645 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 11:39:21.167170 master-0 kubenswrapper[8993]: I1204 11:39:21.166965 8993 scope.go:117] "RemoveContainer" containerID="47094805f1edeaf17e1a7adb5657ee79a627ba8088dc54090e01c274544dfb2b" Dec 04 11:39:21.233831 master-0 kubenswrapper[8993]: I1204 11:39:21.233676 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"c24e01603234fe8003f8aae8171b0065","Type":"ContainerStarted","Data":"0c0691169c41a340c40aee76ff53fe8e36e950fa8887c06e8cf8518dde6a06ba"} Dec 04 11:39:21.235974 master-0 kubenswrapper[8993]: I1204 11:39:21.235936 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-1-master-0_0a3dbe2b-a659-46c2-93e8-19bd30ee2260/installer/0.log" Dec 04 11:39:21.236191 master-0 kubenswrapper[8993]: I1204 11:39:21.236070 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-1-master-0" event={"ID":"0a3dbe2b-a659-46c2-93e8-19bd30ee2260","Type":"ContainerDied","Data":"931fd825327f937f17576e7f8284d2682a80b19af4b1c302c89fce2514617dec"} Dec 04 11:39:21.236191 master-0 kubenswrapper[8993]: I1204 11:39:21.236124 8993 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="931fd825327f937f17576e7f8284d2682a80b19af4b1c302c89fce2514617dec" Dec 04 11:39:21.236191 master-0 kubenswrapper[8993]: I1204 11:39:21.236085 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 11:39:21.240537 master-0 kubenswrapper[8993]: I1204 11:39:21.240420 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" event={"ID":"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48","Type":"ContainerStarted","Data":"38aff0440f5b265ce52ca882bf70fe892cd569736c1a9aa92adc7ee8587a099b"} Dec 04 11:39:21.254300 master-0 kubenswrapper[8993]: I1204 11:39:21.253377 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/0a3dbe2b-a659-46c2-93e8-19bd30ee2260-kube-api-access\") pod \"0a3dbe2b-a659-46c2-93e8-19bd30ee2260\" (UID: \"0a3dbe2b-a659-46c2-93e8-19bd30ee2260\") " Dec 04 11:39:21.254300 master-0 kubenswrapper[8993]: I1204 11:39:21.253503 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0a3dbe2b-a659-46c2-93e8-19bd30ee2260-kubelet-dir\") pod \"0a3dbe2b-a659-46c2-93e8-19bd30ee2260\" (UID: \"0a3dbe2b-a659-46c2-93e8-19bd30ee2260\") " Dec 04 11:39:21.254300 master-0 kubenswrapper[8993]: I1204 11:39:21.253580 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/0a3dbe2b-a659-46c2-93e8-19bd30ee2260-var-lock\") pod \"0a3dbe2b-a659-46c2-93e8-19bd30ee2260\" (UID: \"0a3dbe2b-a659-46c2-93e8-19bd30ee2260\") " Dec 04 11:39:21.254300 master-0 kubenswrapper[8993]: I1204 11:39:21.253877 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/0a3dbe2b-a659-46c2-93e8-19bd30ee2260-var-lock" (OuterVolumeSpecName: "var-lock") pod "0a3dbe2b-a659-46c2-93e8-19bd30ee2260" (UID: "0a3dbe2b-a659-46c2-93e8-19bd30ee2260"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:39:21.254930 master-0 kubenswrapper[8993]: I1204 11:39:21.254793 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/0a3dbe2b-a659-46c2-93e8-19bd30ee2260-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "0a3dbe2b-a659-46c2-93e8-19bd30ee2260" (UID: "0a3dbe2b-a659-46c2-93e8-19bd30ee2260"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:39:21.263244 master-0 kubenswrapper[8993]: E1204 11:39:21.262394 8993 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:39:21.356553 master-0 kubenswrapper[8993]: I1204 11:39:21.356479 8993 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/0a3dbe2b-a659-46c2-93e8-19bd30ee2260-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 11:39:21.356553 master-0 kubenswrapper[8993]: I1204 11:39:21.356528 8993 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0a3dbe2b-a659-46c2-93e8-19bd30ee2260-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:39:21.412152 master-0 kubenswrapper[8993]: I1204 11:39:21.412058 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a3dbe2b-a659-46c2-93e8-19bd30ee2260-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "0a3dbe2b-a659-46c2-93e8-19bd30ee2260" (UID: "0a3dbe2b-a659-46c2-93e8-19bd30ee2260"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:39:21.448657 master-0 kubenswrapper[8993]: I1204 11:39:21.448343 8993 scope.go:117] "RemoveContainer" containerID="b371ad607ffd3e5ee045c3b072b5398e7b47188ceda9be737847471999ef8986" Dec 04 11:39:21.457698 master-0 kubenswrapper[8993]: I1204 11:39:21.457623 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/0a3dbe2b-a659-46c2-93e8-19bd30ee2260-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 11:39:21.607178 master-0 kubenswrapper[8993]: I1204 11:39:21.607124 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_installer-1-master-0_2dea9140-7c02-46cd-9b67-a2aee143c3a8/installer/0.log" Dec 04 11:39:21.607333 master-0 kubenswrapper[8993]: I1204 11:39:21.607229 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 11:39:21.644076 master-0 kubenswrapper[8993]: I1204 11:39:21.644032 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0-master-0_cc0396a9a2689b3e8c132c12640cbe83/etcdctl/0.log" Dec 04 11:39:21.644298 master-0 kubenswrapper[8993]: I1204 11:39:21.644245 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:39:21.761998 master-0 kubenswrapper[8993]: I1204 11:39:21.761933 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2dea9140-7c02-46cd-9b67-a2aee143c3a8-kubelet-dir\") pod \"2dea9140-7c02-46cd-9b67-a2aee143c3a8\" (UID: \"2dea9140-7c02-46cd-9b67-a2aee143c3a8\") " Dec 04 11:39:21.762091 master-0 kubenswrapper[8993]: I1204 11:39:21.762018 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/2dea9140-7c02-46cd-9b67-a2aee143c3a8-var-lock\") pod \"2dea9140-7c02-46cd-9b67-a2aee143c3a8\" (UID: \"2dea9140-7c02-46cd-9b67-a2aee143c3a8\") " Dec 04 11:39:21.762218 master-0 kubenswrapper[8993]: I1204 11:39:21.762074 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/host-path/cc0396a9a2689b3e8c132c12640cbe83-certs\") pod \"cc0396a9a2689b3e8c132c12640cbe83\" (UID: \"cc0396a9a2689b3e8c132c12640cbe83\") " Dec 04 11:39:21.762276 master-0 kubenswrapper[8993]: I1204 11:39:21.762244 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/cc0396a9a2689b3e8c132c12640cbe83-data-dir\") pod \"cc0396a9a2689b3e8c132c12640cbe83\" (UID: \"cc0396a9a2689b3e8c132c12640cbe83\") " Dec 04 11:39:21.762412 master-0 kubenswrapper[8993]: I1204 11:39:21.762374 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/2dea9140-7c02-46cd-9b67-a2aee143c3a8-kube-api-access\") pod \"2dea9140-7c02-46cd-9b67-a2aee143c3a8\" (UID: \"2dea9140-7c02-46cd-9b67-a2aee143c3a8\") " Dec 04 11:39:21.763022 master-0 kubenswrapper[8993]: I1204 11:39:21.762959 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/2dea9140-7c02-46cd-9b67-a2aee143c3a8-var-lock" (OuterVolumeSpecName: "var-lock") pod "2dea9140-7c02-46cd-9b67-a2aee143c3a8" (UID: "2dea9140-7c02-46cd-9b67-a2aee143c3a8"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:39:21.763089 master-0 kubenswrapper[8993]: I1204 11:39:21.763047 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/2dea9140-7c02-46cd-9b67-a2aee143c3a8-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "2dea9140-7c02-46cd-9b67-a2aee143c3a8" (UID: "2dea9140-7c02-46cd-9b67-a2aee143c3a8"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:39:21.763209 master-0 kubenswrapper[8993]: I1204 11:39:21.763155 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/cc0396a9a2689b3e8c132c12640cbe83-certs" (OuterVolumeSpecName: "certs") pod "cc0396a9a2689b3e8c132c12640cbe83" (UID: "cc0396a9a2689b3e8c132c12640cbe83"). InnerVolumeSpecName "certs". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:39:21.763267 master-0 kubenswrapper[8993]: I1204 11:39:21.763223 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/cc0396a9a2689b3e8c132c12640cbe83-data-dir" (OuterVolumeSpecName: "data-dir") pod "cc0396a9a2689b3e8c132c12640cbe83" (UID: "cc0396a9a2689b3e8c132c12640cbe83"). InnerVolumeSpecName "data-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:39:21.770271 master-0 kubenswrapper[8993]: I1204 11:39:21.767899 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dea9140-7c02-46cd-9b67-a2aee143c3a8-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "2dea9140-7c02-46cd-9b67-a2aee143c3a8" (UID: "2dea9140-7c02-46cd-9b67-a2aee143c3a8"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:39:21.832284 master-0 kubenswrapper[8993]: I1204 11:39:21.832224 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc0396a9a2689b3e8c132c12640cbe83" path="/var/lib/kubelet/pods/cc0396a9a2689b3e8c132c12640cbe83/volumes" Dec 04 11:39:21.832572 master-0 kubenswrapper[8993]: I1204 11:39:21.832531 8993 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0-master-0" podUID="" Dec 04 11:39:21.865550 master-0 kubenswrapper[8993]: I1204 11:39:21.865461 8993 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2dea9140-7c02-46cd-9b67-a2aee143c3a8-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:39:21.865550 master-0 kubenswrapper[8993]: I1204 11:39:21.865534 8993 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/2dea9140-7c02-46cd-9b67-a2aee143c3a8-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 11:39:21.865550 master-0 kubenswrapper[8993]: I1204 11:39:21.865546 8993 reconciler_common.go:293] "Volume detached for volume \"certs\" (UniqueName: \"kubernetes.io/host-path/cc0396a9a2689b3e8c132c12640cbe83-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 11:39:21.865550 master-0 kubenswrapper[8993]: I1204 11:39:21.865556 8993 reconciler_common.go:293] "Volume detached for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/cc0396a9a2689b3e8c132c12640cbe83-data-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:39:21.865550 master-0 kubenswrapper[8993]: I1204 11:39:21.865565 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/2dea9140-7c02-46cd-9b67-a2aee143c3a8-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 11:39:22.283166 master-0 kubenswrapper[8993]: I1204 11:39:22.283104 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_installer-1-master-0_2dea9140-7c02-46cd-9b67-a2aee143c3a8/installer/0.log" Dec 04 11:39:22.283655 master-0 kubenswrapper[8993]: I1204 11:39:22.283314 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-1-master-0" Dec 04 11:39:22.287814 master-0 kubenswrapper[8993]: I1204 11:39:22.287741 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-7f22v" podUID="2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c" containerName="extract-content" containerID="cri-o://bf01610f07d799dee957df874d54a814bddfc7f890d6afabc5cc027100265399" gracePeriod=2 Dec 04 11:39:22.292756 master-0 kubenswrapper[8993]: I1204 11:39:22.292729 8993 generic.go:334] "Generic (PLEG): container finished" podID="a2aabd50-bfed-4ab5-ad19-f84ec50203ec" containerID="d2725ac4d78fdf9566061ef8100f1f04d68cc38c172c702bd00a3a8215aa8d8e" exitCode=0 Dec 04 11:39:22.294588 master-0 kubenswrapper[8993]: I1204 11:39:22.294530 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0-master-0_cc0396a9a2689b3e8c132c12640cbe83/etcdctl/0.log" Dec 04 11:39:22.294588 master-0 kubenswrapper[8993]: I1204 11:39:22.294556 8993 generic.go:334] "Generic (PLEG): container finished" podID="cc0396a9a2689b3e8c132c12640cbe83" containerID="2486b68bc3517ab1664fcb1823dbcafa72bb90a8386d8e6780a8a95866e68263" exitCode=137 Dec 04 11:39:22.294713 master-0 kubenswrapper[8993]: I1204 11:39:22.294651 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:39:22.298167 master-0 kubenswrapper[8993]: I1204 11:39:22.298093 8993 generic.go:334] "Generic (PLEG): container finished" podID="c24e01603234fe8003f8aae8171b0065" containerID="ec5adef1bc610591b982f90e781d407a1f1f553e2257a5524d4e326fae0da502" exitCode=0 Dec 04 11:39:22.304800 master-0 kubenswrapper[8993]: I1204 11:39:22.304735 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-6c8676f99d-7z948_3322cc5a-f1f7-4522-b423-19fb7f38cd43/openshift-controller-manager-operator/0.log" Dec 04 11:39:22.306928 master-0 kubenswrapper[8993]: I1204 11:39:22.306878 8993 generic.go:334] "Generic (PLEG): container finished" podID="349b1e1d-db56-4960-b6ff-e2f5f07d4aaa" containerID="df46ed9cb416f80d99a93862b94cdddf077285002596e27aa33cd31815366ba5" exitCode=0 Dec 04 11:39:22.969306 master-0 kubenswrapper[8993]: I1204 11:39:22.969244 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-ghr5b" Dec 04 11:39:22.975164 master-0 kubenswrapper[8993]: I1204 11:39:22.975125 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-7f22v_2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c/extract-content/0.log" Dec 04 11:39:22.975665 master-0 kubenswrapper[8993]: I1204 11:39:22.975636 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-7f22v" Dec 04 11:39:23.086622 master-0 kubenswrapper[8993]: I1204 11:39:23.086520 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62vpr\" (UniqueName: \"kubernetes.io/projected/2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c-kube-api-access-62vpr\") pod \"2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c\" (UID: \"2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c\") " Dec 04 11:39:23.086622 master-0 kubenswrapper[8993]: I1204 11:39:23.086623 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a2aabd50-bfed-4ab5-ad19-f84ec50203ec-utilities\") pod \"a2aabd50-bfed-4ab5-ad19-f84ec50203ec\" (UID: \"a2aabd50-bfed-4ab5-ad19-f84ec50203ec\") " Dec 04 11:39:23.086978 master-0 kubenswrapper[8993]: I1204 11:39:23.086720 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a2aabd50-bfed-4ab5-ad19-f84ec50203ec-catalog-content\") pod \"a2aabd50-bfed-4ab5-ad19-f84ec50203ec\" (UID: \"a2aabd50-bfed-4ab5-ad19-f84ec50203ec\") " Dec 04 11:39:23.086978 master-0 kubenswrapper[8993]: I1204 11:39:23.086769 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hc6z5\" (UniqueName: \"kubernetes.io/projected/a2aabd50-bfed-4ab5-ad19-f84ec50203ec-kube-api-access-hc6z5\") pod \"a2aabd50-bfed-4ab5-ad19-f84ec50203ec\" (UID: \"a2aabd50-bfed-4ab5-ad19-f84ec50203ec\") " Dec 04 11:39:23.086978 master-0 kubenswrapper[8993]: I1204 11:39:23.086798 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c-catalog-content\") pod \"2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c\" (UID: \"2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c\") " Dec 04 11:39:23.086978 master-0 kubenswrapper[8993]: I1204 11:39:23.086849 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c-utilities\") pod \"2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c\" (UID: \"2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c\") " Dec 04 11:39:23.088021 master-0 kubenswrapper[8993]: I1204 11:39:23.087975 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c-utilities" (OuterVolumeSpecName: "utilities") pod "2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c" (UID: "2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 11:39:23.090075 master-0 kubenswrapper[8993]: I1204 11:39:23.090013 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2aabd50-bfed-4ab5-ad19-f84ec50203ec-utilities" (OuterVolumeSpecName: "utilities") pod "a2aabd50-bfed-4ab5-ad19-f84ec50203ec" (UID: "a2aabd50-bfed-4ab5-ad19-f84ec50203ec"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 11:39:23.091897 master-0 kubenswrapper[8993]: I1204 11:39:23.091834 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2aabd50-bfed-4ab5-ad19-f84ec50203ec-kube-api-access-hc6z5" (OuterVolumeSpecName: "kube-api-access-hc6z5") pod "a2aabd50-bfed-4ab5-ad19-f84ec50203ec" (UID: "a2aabd50-bfed-4ab5-ad19-f84ec50203ec"). InnerVolumeSpecName "kube-api-access-hc6z5". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:39:23.092713 master-0 kubenswrapper[8993]: I1204 11:39:23.092676 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c-kube-api-access-62vpr" (OuterVolumeSpecName: "kube-api-access-62vpr") pod "2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c" (UID: "2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c"). InnerVolumeSpecName "kube-api-access-62vpr". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:39:23.144996 master-0 kubenswrapper[8993]: I1204 11:39:23.144788 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2aabd50-bfed-4ab5-ad19-f84ec50203ec-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "a2aabd50-bfed-4ab5-ad19-f84ec50203ec" (UID: "a2aabd50-bfed-4ab5-ad19-f84ec50203ec"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 11:39:23.156378 master-0 kubenswrapper[8993]: I1204 11:39:23.156264 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c" (UID: "2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 11:39:23.189081 master-0 kubenswrapper[8993]: I1204 11:39:23.188995 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-62vpr\" (UniqueName: \"kubernetes.io/projected/2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c-kube-api-access-62vpr\") on node \"master-0\" DevicePath \"\"" Dec 04 11:39:23.189081 master-0 kubenswrapper[8993]: I1204 11:39:23.189059 8993 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a2aabd50-bfed-4ab5-ad19-f84ec50203ec-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 11:39:23.189081 master-0 kubenswrapper[8993]: I1204 11:39:23.189078 8993 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a2aabd50-bfed-4ab5-ad19-f84ec50203ec-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 11:39:23.189081 master-0 kubenswrapper[8993]: I1204 11:39:23.189091 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hc6z5\" (UniqueName: \"kubernetes.io/projected/a2aabd50-bfed-4ab5-ad19-f84ec50203ec-kube-api-access-hc6z5\") on node \"master-0\" DevicePath \"\"" Dec 04 11:39:23.189081 master-0 kubenswrapper[8993]: I1204 11:39:23.189104 8993 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 11:39:23.189596 master-0 kubenswrapper[8993]: I1204 11:39:23.189115 8993 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 11:39:23.341185 master-0 kubenswrapper[8993]: I1204 11:39:23.341117 8993 generic.go:334] "Generic (PLEG): container finished" podID="a0710bdf-3961-48d6-864a-efbd6d68e852" containerID="4f8471393d269f5a7f4cfca62361f53ea2107573029fedd35fb5f054330f7e70" exitCode=0 Dec 04 11:39:23.348782 master-0 kubenswrapper[8993]: I1204 11:39:23.348729 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-7f22v_2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c/extract-content/0.log" Dec 04 11:39:23.349349 master-0 kubenswrapper[8993]: I1204 11:39:23.349286 8993 generic.go:334] "Generic (PLEG): container finished" podID="2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c" containerID="bf01610f07d799dee957df874d54a814bddfc7f890d6afabc5cc027100265399" exitCode=2 Dec 04 11:39:23.349433 master-0 kubenswrapper[8993]: I1204 11:39:23.349409 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-7f22v" Dec 04 11:39:23.352918 master-0 kubenswrapper[8993]: I1204 11:39:23.352857 8993 generic.go:334] "Generic (PLEG): container finished" podID="018e9ad3-c071-45c6-bfa6-e53dda20c757" containerID="36c3fd8199ca96cb8487d893a32aa639b7c393be6ed6496e16f59c0791abf527" exitCode=0 Dec 04 11:39:23.355863 master-0 kubenswrapper[8993]: I1204 11:39:23.355815 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-ghr5b" Dec 04 11:39:24.365468 master-0 kubenswrapper[8993]: I1204 11:39:24.365304 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_network-operator-79767b7ff9-5bgzx_ffaf95be-586c-40fa-b15f-1beaffe7ff1c/network-operator/0.log" Dec 04 11:39:24.365468 master-0 kubenswrapper[8993]: I1204 11:39:24.365380 8993 generic.go:334] "Generic (PLEG): container finished" podID="ffaf95be-586c-40fa-b15f-1beaffe7ff1c" containerID="38994ab2ae9659964fed86de7d58ee76405c493bf0a90b3260a8bc5301b5819a" exitCode=255 Dec 04 11:39:24.530128 master-0 kubenswrapper[8993]: I1204 11:39:24.529883 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-2p882" Dec 04 11:39:24.718266 master-0 kubenswrapper[8993]: I1204 11:39:24.718156 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a0710bdf-3961-48d6-864a-efbd6d68e852-catalog-content\") pod \"a0710bdf-3961-48d6-864a-efbd6d68e852\" (UID: \"a0710bdf-3961-48d6-864a-efbd6d68e852\") " Dec 04 11:39:24.718266 master-0 kubenswrapper[8993]: I1204 11:39:24.718247 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkxnr\" (UniqueName: \"kubernetes.io/projected/a0710bdf-3961-48d6-864a-efbd6d68e852-kube-api-access-dkxnr\") pod \"a0710bdf-3961-48d6-864a-efbd6d68e852\" (UID: \"a0710bdf-3961-48d6-864a-efbd6d68e852\") " Dec 04 11:39:24.718266 master-0 kubenswrapper[8993]: I1204 11:39:24.718271 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a0710bdf-3961-48d6-864a-efbd6d68e852-utilities\") pod \"a0710bdf-3961-48d6-864a-efbd6d68e852\" (UID: \"a0710bdf-3961-48d6-864a-efbd6d68e852\") " Dec 04 11:39:24.719519 master-0 kubenswrapper[8993]: I1204 11:39:24.719470 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0710bdf-3961-48d6-864a-efbd6d68e852-utilities" (OuterVolumeSpecName: "utilities") pod "a0710bdf-3961-48d6-864a-efbd6d68e852" (UID: "a0710bdf-3961-48d6-864a-efbd6d68e852"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 11:39:24.722058 master-0 kubenswrapper[8993]: I1204 11:39:24.721976 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0710bdf-3961-48d6-864a-efbd6d68e852-kube-api-access-dkxnr" (OuterVolumeSpecName: "kube-api-access-dkxnr") pod "a0710bdf-3961-48d6-864a-efbd6d68e852" (UID: "a0710bdf-3961-48d6-864a-efbd6d68e852"). InnerVolumeSpecName "kube-api-access-dkxnr". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:39:24.774490 master-0 kubenswrapper[8993]: I1204 11:39:24.774404 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0710bdf-3961-48d6-864a-efbd6d68e852-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "a0710bdf-3961-48d6-864a-efbd6d68e852" (UID: "a0710bdf-3961-48d6-864a-efbd6d68e852"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 11:39:24.820226 master-0 kubenswrapper[8993]: I1204 11:39:24.820158 8993 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a0710bdf-3961-48d6-864a-efbd6d68e852-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 11:39:24.820226 master-0 kubenswrapper[8993]: I1204 11:39:24.820217 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dkxnr\" (UniqueName: \"kubernetes.io/projected/a0710bdf-3961-48d6-864a-efbd6d68e852-kube-api-access-dkxnr\") on node \"master-0\" DevicePath \"\"" Dec 04 11:39:24.820368 master-0 kubenswrapper[8993]: I1204 11:39:24.820236 8993 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a0710bdf-3961-48d6-864a-efbd6d68e852-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 11:39:24.948971 master-0 kubenswrapper[8993]: E1204 11:39:24.948890 8993 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-pod7746ae23_c2f8_431c_9e52_dc3d0f9404d3.slice/crio-bc7ebd29438234ac605bc7aa0cb9e2c9cf8ce4ca7e6c3b5534b80edf20cd0afa\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-podf24bc354_1fe3_4dd1_b0a0_3dc86a14aff3.slice/crio-85449a546194f1b7d82572b88b05b009dbf13dc608b9793959a5abd709bf99f0\": RecentStats: unable to find data in memory cache]" Dec 04 11:39:25.219105 master-0 kubenswrapper[8993]: E1204 11:39:25.218652 8993 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{etcd-master-0-master-0.187e0034e7555b86 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0-master-0,UID:cc0396a9a2689b3e8c132c12640cbe83,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd},},Reason:Killing,Message:Stopping container etcd,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:38:51.195243398 +0000 UTC m=+65.586184851,LastTimestamp:2025-12-04 11:38:51.195243398 +0000 UTC m=+65.586184851,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:39:25.384675 master-0 kubenswrapper[8993]: I1204 11:39:25.384578 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-2p882" Dec 04 11:39:25.884996 master-0 kubenswrapper[8993]: I1204 11:39:25.884754 8993 prober.go:107] "Probe failed" probeType="Startup" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" probeResult="failure" output="Get \"https://192.168.32.10:10257/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:39:27.400284 master-0 kubenswrapper[8993]: I1204 11:39:27.400209 8993 generic.go:334] "Generic (PLEG): container finished" podID="c6e9271a-44ea-4612-ab60-4a9d489ed062" containerID="dc75d44b8be7e058788b5cd96125d7bea4962e131339dd256a97c23ba994b1b7" exitCode=0 Dec 04 11:39:29.284500 master-0 kubenswrapper[8993]: I1204 11:39:29.284402 8993 patch_prober.go:28] interesting pod/authentication-operator-6c968fdfdf-nrrfw container/authentication-operator namespace/openshift-authentication-operator: Liveness probe status=failure output="Get \"https://10.128.0.11:8443/healthz\": dial tcp 10.128.0.11:8443: connect: connection refused" start-of-body= Dec 04 11:39:29.285302 master-0 kubenswrapper[8993]: I1204 11:39:29.284536 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" podUID="42b3be0f-1d82-4a64-abb4-0118a6960efd" containerName="authentication-operator" probeResult="failure" output="Get \"https://10.128.0.11:8443/healthz\": dial tcp 10.128.0.11:8443: connect: connection refused" Dec 04 11:39:29.416142 master-0 kubenswrapper[8993]: I1204 11:39:29.416077 8993 generic.go:334] "Generic (PLEG): container finished" podID="fd9f8671-8066-4990-b45d-8b619aa5d9ec" containerID="e0e04ce110c25a2c4a312ed2fdb876c28e02526d17e1277179eb5a2f7c3254e0" exitCode=0 Dec 04 11:39:31.263865 master-0 kubenswrapper[8993]: E1204 11:39:31.263677 8993 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:39:33.438835 master-0 kubenswrapper[8993]: I1204 11:39:33.438757 8993 generic.go:334] "Generic (PLEG): container finished" podID="8e5e33b0-4e2e-464c-ba5b-cbd2048004f8" containerID="b6e0393f35b37b796e29e063a198964a882daa0edec21adc6f195e441be69db7" exitCode=0 Dec 04 11:39:34.447969 master-0 kubenswrapper[8993]: I1204 11:39:34.447881 8993 generic.go:334] "Generic (PLEG): container finished" podID="27576028-d64a-47cd-b76b-d524e41efe37" containerID="125cdcb9380437c2c74e709578e049126370c6c2e8787828f7e5e31c2a5f5cbe" exitCode=0 Dec 04 11:39:35.072494 master-0 kubenswrapper[8993]: E1204 11:39:35.072399 8993 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-podf24bc354_1fe3_4dd1_b0a0_3dc86a14aff3.slice/crio-85449a546194f1b7d82572b88b05b009dbf13dc608b9793959a5abd709bf99f0\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-pod7746ae23_c2f8_431c_9e52_dc3d0f9404d3.slice/crio-bc7ebd29438234ac605bc7aa0cb9e2c9cf8ce4ca7e6c3b5534b80edf20cd0afa\": RecentStats: unable to find data in memory cache]" Dec 04 11:39:35.307286 master-0 kubenswrapper[8993]: E1204 11:39:35.307162 8993 kubelet.go:1929] "Failed creating a mirror pod for" err="Internal error occurred: admission plugin \"LimitRanger\" failed to complete mutation in 13s" pod="openshift-etcd/etcd-master-0" Dec 04 11:39:35.885439 master-0 kubenswrapper[8993]: I1204 11:39:35.885332 8993 prober.go:107] "Probe failed" probeType="Startup" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" probeResult="failure" output="Get \"https://192.168.32.10:10257/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:39:38.469467 master-0 kubenswrapper[8993]: E1204 11:39:38.469252 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:39:28Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:39:28Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:39:28Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:39:28Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3e65409fc2b27ad0aaeb500a39e264663d2980821f099b830b551785ce4ce8b\\\"],\\\"sizeBytes\\\":1631758507},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9014f384de5f9a0b7418d5869ad349abb9588d16bd09ed650a163c045315dbff\\\"],\\\"sizeBytes\\\":1232140918},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b472823604757237c2d16bd6f6221f4cf562aa3b05942c7f602e1e8b2e55a7c6\\\"],\\\"sizeBytes\\\":983705650},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d5891cdd7dcf7c9081de8b364b4c96446b7f946f7880fbae291a4592a198264\\\"],\\\"sizeBytes\\\":938303566},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:631a3798b749fecc041a99929eb946618df723e15055e805ff752a1a1273481c\\\"],\\\"sizeBytes\\\":870567329},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1ca78c423f43f89a0411e40393642f64e4f8df9e5f61c25e31047c4cce170f9\\\"],\\\"sizeBytes\\\":857069957},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b12f830c3316aa4dc061c2d00c74126282b3e2bcccc301eab00d57fff3c4c7c\\\"],\\\"sizeBytes\\\":767284906},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cb3ec61f9a932a9ad13bdeb44bcf9477a8d5f728151d7f19ed3ef7d4b02b3a82\\\"],\\\"sizeBytes\\\":682371258},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:916566bb9d0143352324233d460ad94697719c11c8c9158e3aea8f475941751f\\\"],\\\"sizeBytes\\\":677523572},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5451aa441e5b8d8689c032405d410c8049a849ef2edf77e5b6a5ce2838c6569b\\\"],\\\"sizeBytes\\\":672407260},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9724d2036305cbd729e1f484c5bad89971de977fff8a6723fef1873858dd1123\\\"],\\\"sizeBytes\\\":616108962},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:df606f3b71d4376d1a2108c09f0d3dab455fc30bcb67c60e91590c105e9025bf\\\"],\\\"sizeBytes\\\":583836304},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79f99fd6cce984287932edf0d009660bb488d663081f3d62ec3b23bc8bfbf6c2\\\"],\\\"sizeBytes\\\":576619763},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eddedae7578d79b5a3f748000ae5c00b9f14a04710f9f9ec7b52fc569be5dfb8\\\"],\\\"sizeBytes\\\":552673986},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:aa24edce3d740f84c40018e94cdbf2bc7375268d13d57c2d664e43a46ccea3fc\\\"],\\\"sizeBytes\\\":543227406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:188637a52cafee61ec461e92fb0c605e28be325b9ac1f2ac8a37d68e97654718\\\"],\\\"sizeBytes\\\":532719167},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde59e48cd5dee3721f34d249cb119cc3259fd857965d34f9c7ed83b0c363a1\\\"],\\\"sizeBytes\\\":532402162},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f4d4282cb53325e737ad68abbfcb70687ae04fb50353f4f0ba0ba5703b15009a\\\"],\\\"sizeBytes\\\":512838054},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-release@sha256:8c885ea0b3c5124989f0a9b93eba98eb9fca6bbd0262772d85d90bf713a4d572\\\"],\\\"sizeBytes\\\":512452153},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0f43c31aa3359159d4557dad3cfaf812d8ce44db9cb9ae970e06d3479070b660\\\"],\\\"sizeBytes\\\":509437356},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e85850a4ae1a1e3ec2c590a4936d640882b6550124da22031c85b526afbf52df\\\"],\\\"sizeBytes\\\":507687221},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8375671da86aa527ee7e291d86971b0baa823ffc7663b5a983084456e76c0f59\\\"],\\\"sizeBytes\\\":506741476},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:831f30660844091d6154e2674d3a9da6f34271bf8a2c40b56f7416066318742b\\\"],\\\"sizeBytes\\\":505649178},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:86af77350cfe6fd69280157e4162aa0147873d9431c641ae4ad3e881ff768a73\\\"],\\\"sizeBytes\\\":505628211},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a824e468cf8dd61d347e35b2ee5bc2f815666957647098e21a1bb56ff613e5b9\\\"],\\\"sizeBytes\\\":503340749},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8139ed65c0a0a4b0f253b715c11cc52be027efe8a4774da9ccce35c78ef439da\\\"],\\\"sizeBytes\\\":503011144},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8eabac819f289e29d75c7ab172d8124554849a47f0b00770928c3eb19a5a31c4\\\"],\\\"sizeBytes\\\":502436444},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:10e57ca7611f79710f05777dc6a8f31c7e04eb09da4d8d793a5acfbf0e4692d7\\\"],\\\"sizeBytes\\\":500943492},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f042fa25014f3d37f3ea967d21f361d2a11833ae18f2c750318101b25d2497ce\\\"],\\\"sizeBytes\\\":500848684},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91af633e585621630c40d14f188e37d36b44678d0a59e582d850bf8d593d3a0c\\\"],\\\"sizeBytes\\\":499798563},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d64c13fe7663a0b4ae61d103b1b7598adcf317a01826f296bcb66b1a2de83c96\\\"],\\\"sizeBytes\\\":499705918},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:75d996f6147edb88c09fd1a052099de66638590d7d03a735006244bc9e19f898\\\"],\\\"sizeBytes\\\":499082775},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3b8d91a25eeb9f02041e947adb3487da3e7ab8449d3d2ad015827e7954df7b34\\\"],\\\"sizeBytes\\\":490455952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1f952cec1e5332b84bdffa249cd426f39087058d6544ddcec650a414c15a9b68\\\"],\\\"sizeBytes\\\":489528665},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c416b201d480bddb5a4960ec42f4740761a1335001cf84ba5ae19ad6857771b1\\\"],\\\"sizeBytes\\\":481559117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c3a77aa4d03b89ea284e3467a268e5989a77a2ef63e685eb1d5c5ea5b3922b7a\\\"],\\\"sizeBytes\\\":478917802},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eb928c13a46d3fb45f4a881892d023a92d610a5430be0ffd916aaf8da8e7d297\\\"],\\\"sizeBytes\\\":478642572},{\\\"names\\\":[],\\\"sizeBytes\\\":465285478},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fd3e9f8f00a59bda7483ec7dc8a0ed602f9ca30e3d72b22072dbdf2819da3f61\\\"],\\\"sizeBytes\\\":465144618},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3c1edf52f70bf9b1d1457e0c4111bc79cdaa1edd659ddbdb9d8176eff8b46956\\\"],\\\"sizeBytes\\\":462727837},{\\\"names\\\":[],\\\"sizeBytes\\\":461702648},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c69ffd8f8dcceedc2d6eb306cea33f8beabc1be1308cd5f4ee8b9a8e3eab9843\\\"],\\\"sizeBytes\\\":459552216},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d3ce2cbf1032ad0f24f204db73687002fcf302e86ebde3945801c74351b64576\\\"],\\\"sizeBytes\\\":458169255},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7664a2d4cb10e82ed32abbf95799f43fc3d10135d7dd94799730de504a89680a\\\"],\\\"sizeBytes\\\":452589750},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4ecc5bac651ff1942865baee5159582e9602c89b47eeab18400a32abcba8f690\\\"],\\\"sizeBytes\\\":451039520},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2632d7f05d5a992e91038ded81c715898f3fe803420a9b67a0201e9fd8075213\\\"],\\\"sizeBytes\\\":443291941},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f0aa9cd04713acc5c6fea721bd849e1500da8ae945e0b32000887f34d786e0b\\\"],\\\"sizeBytes\\\":442509555},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e438b814f8e16f00b3fc4b69991af80eee79ae111d2a707f34aa64b2ccbb6eb\\\"],\\\"sizeBytes\\\":437737925},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b00c658332d6c6786bd969b26097c20a78c79c045f1692a8809234f5fb586c22\\\"],\\\"sizeBytes\\\":433122306},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a3d37aa7a22c68afa963ecfb4b43c52cccf152580cd66e4d5382fb69e4037cc\\\"],\\\"sizeBytes\\\":406053031}]}}\" for node \"master-0\": Patch \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0/status?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:39:39.284107 master-0 kubenswrapper[8993]: I1204 11:39:39.284016 8993 patch_prober.go:28] interesting pod/authentication-operator-6c968fdfdf-nrrfw container/authentication-operator namespace/openshift-authentication-operator: Liveness probe status=failure output="Get \"https://10.128.0.11:8443/healthz\": dial tcp 10.128.0.11:8443: connect: connection refused" start-of-body= Dec 04 11:39:39.284428 master-0 kubenswrapper[8993]: I1204 11:39:39.284123 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" podUID="42b3be0f-1d82-4a64-abb4-0118a6960efd" containerName="authentication-operator" probeResult="failure" output="Get \"https://10.128.0.11:8443/healthz\": dial tcp 10.128.0.11:8443: connect: connection refused" Dec 04 11:39:39.489374 master-0 kubenswrapper[8993]: I1204 11:39:39.489285 8993 generic.go:334] "Generic (PLEG): container finished" podID="c24e01603234fe8003f8aae8171b0065" containerID="66bc8b1ef32ed555b89bf441dddf70148acb178d161951788f2034d094677933" exitCode=0 Dec 04 11:39:41.264722 master-0 kubenswrapper[8993]: E1204 11:39:41.264623 8993 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:39:45.210176 master-0 kubenswrapper[8993]: E1204 11:39:45.210060 8993 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-podf24bc354_1fe3_4dd1_b0a0_3dc86a14aff3.slice/crio-85449a546194f1b7d82572b88b05b009dbf13dc608b9793959a5abd709bf99f0\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-pod7746ae23_c2f8_431c_9e52_dc3d0f9404d3.slice/crio-bc7ebd29438234ac605bc7aa0cb9e2c9cf8ce4ca7e6c3b5534b80edf20cd0afa\": RecentStats: unable to find data in memory cache]" Dec 04 11:39:45.885782 master-0 kubenswrapper[8993]: I1204 11:39:45.885665 8993 prober.go:107] "Probe failed" probeType="Startup" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" probeResult="failure" output="Get \"https://192.168.32.10:10257/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:39:48.469996 master-0 kubenswrapper[8993]: E1204 11:39:48.469907 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:39:51.265360 master-0 kubenswrapper[8993]: E1204 11:39:51.265228 8993 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:39:51.265360 master-0 kubenswrapper[8993]: I1204 11:39:51.265337 8993 controller.go:115] "failed to update lease using latest lease, fallback to ensure lease" err="failed 5 attempts to update lease" Dec 04 11:39:52.032901 master-0 kubenswrapper[8993]: I1204 11:39:52.032774 8993 status_manager.go:851] "Failed to get status for pod" podUID="f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3" pod="openshift-etcd/installer-1-master-0" err="the server was unable to return a response in the time allotted, but may still be processing the request (get pods installer-1-master-0)" Dec 04 11:39:55.596644 master-0 kubenswrapper[8993]: I1204 11:39:55.596562 8993 generic.go:334] "Generic (PLEG): container finished" podID="42b3be0f-1d82-4a64-abb4-0118a6960efd" containerID="8543749f8386d25fbc9d05c27b7ab7559de13cecd2f9d2e22a588c804bace527" exitCode=0 Dec 04 11:39:55.598229 master-0 kubenswrapper[8993]: I1204 11:39:55.598172 8993 generic.go:334] "Generic (PLEG): container finished" podID="bac00ac5-0371-48fd-b1cc-60438f08ae94" containerID="c2365e3e1212552c67b403c1062c118ea5e3306eac11c30d2c954d48de545647" exitCode=0 Dec 04 11:39:55.599679 master-0 kubenswrapper[8993]: I1204 11:39:55.599641 8993 generic.go:334] "Generic (PLEG): container finished" podID="ccf81538-4d5a-4c26-8e54-fe39331a625d" containerID="36ec3b979824ab62e6f7509543dc4f347e7c4493e3f1c85b36fa97144a94acc1" exitCode=0 Dec 04 11:39:55.834832 master-0 kubenswrapper[8993]: E1204 11:39:55.834712 8993 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:39:55.835750 master-0 kubenswrapper[8993]: E1204 11:39:55.835695 8993 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="34.042s" Dec 04 11:39:55.848658 master-0 kubenswrapper[8993]: I1204 11:39:55.848585 8993 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0-master-0" podUID="" Dec 04 11:39:56.608175 master-0 kubenswrapper[8993]: I1204 11:39:56.608135 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-node-identity_network-node-identity-f8hvq_7203ec93-6572-4032-825c-140029a86058/approver/0.log" Dec 04 11:39:56.609538 master-0 kubenswrapper[8993]: I1204 11:39:56.609463 8993 generic.go:334] "Generic (PLEG): container finished" podID="7203ec93-6572-4032-825c-140029a86058" containerID="9b4ba98e62019491fc3009d22881e8502c26c25aed860943c3e8a4e83ac5e2e1" exitCode=1 Dec 04 11:39:57.627623 master-0 kubenswrapper[8993]: I1204 11:39:57.627548 8993 generic.go:334] "Generic (PLEG): container finished" podID="a5b826c3-8638-4cf5-b974-b24e4282ce00" containerID="ccce88b1ca2f9a134e692a16b1bcd6669f59f655145c0cf6017bc4ec59640741" exitCode=0 Dec 04 11:39:58.470362 master-0 kubenswrapper[8993]: E1204 11:39:58.470271 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:39:58.957145 master-0 kubenswrapper[8993]: E1204 11:39:58.957058 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:39:58.957145 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(a7ea781eb62388abf3d4251d464a1c215aed96cb83a2b09a854429643ac8236c): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"a7ea781eb62388abf3d4251d464a1c215aed96cb83a2b09a854429643ac8236c" Netns:"/var/run/netns/f0df9b09-6ce7-41e5-a134-04f90f5a7bad" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=a7ea781eb62388abf3d4251d464a1c215aed96cb83a2b09a854429643ac8236c;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378" Path:"" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:39:58.957145 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:39:58.957145 master-0 kubenswrapper[8993]: > Dec 04 11:39:58.957658 master-0 kubenswrapper[8993]: E1204 11:39:58.957177 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:39:58.957658 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(a7ea781eb62388abf3d4251d464a1c215aed96cb83a2b09a854429643ac8236c): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"a7ea781eb62388abf3d4251d464a1c215aed96cb83a2b09a854429643ac8236c" Netns:"/var/run/netns/f0df9b09-6ce7-41e5-a134-04f90f5a7bad" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=a7ea781eb62388abf3d4251d464a1c215aed96cb83a2b09a854429643ac8236c;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378" Path:"" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:39:58.957658 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:39:58.957658 master-0 kubenswrapper[8993]: > pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:39:58.957658 master-0 kubenswrapper[8993]: E1204 11:39:58.957200 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:39:58.957658 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(a7ea781eb62388abf3d4251d464a1c215aed96cb83a2b09a854429643ac8236c): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"a7ea781eb62388abf3d4251d464a1c215aed96cb83a2b09a854429643ac8236c" Netns:"/var/run/netns/f0df9b09-6ce7-41e5-a134-04f90f5a7bad" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=a7ea781eb62388abf3d4251d464a1c215aed96cb83a2b09a854429643ac8236c;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378" Path:"" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:39:58.957658 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:39:58.957658 master-0 kubenswrapper[8993]: > pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:39:58.957658 master-0 kubenswrapper[8993]: E1204 11:39:58.957270 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"machine-api-operator-88d48b57d-9fjtd_openshift-machine-api(c50317d3-f7cd-4133-845e-44add57ac378)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"machine-api-operator-88d48b57d-9fjtd_openshift-machine-api(c50317d3-f7cd-4133-845e-44add57ac378)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(a7ea781eb62388abf3d4251d464a1c215aed96cb83a2b09a854429643ac8236c): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"a7ea781eb62388abf3d4251d464a1c215aed96cb83a2b09a854429643ac8236c\\\" Netns:\\\"/var/run/netns/f0df9b09-6ce7-41e5-a134-04f90f5a7bad\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=a7ea781eb62388abf3d4251d464a1c215aed96cb83a2b09a854429643ac8236c;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" podUID="c50317d3-f7cd-4133-845e-44add57ac378" Dec 04 11:39:59.221962 master-0 kubenswrapper[8993]: E1204 11:39:59.221738 8993 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{machine-approver-f797d8546-qvgbq.187e00358759c5e2 openshift-cluster-machine-approver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-cluster-machine-approver,Name:machine-approver-f797d8546-qvgbq,UID:c835660f-5a79-4679-b9be-8543ca6ef5a1,APIVersion:v1,ResourceVersion:7595,FieldPath:spec.containers{machine-approver-controller},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8cc27777e72233024fe84ee1faa168aec715a0b24912a3ce70715ddccba328df\" in 13.018s (13.018s including waiting). Image size: 461702648 bytes.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:38:53.87988733 +0000 UTC m=+68.270828763,LastTimestamp:2025-12-04 11:38:53.87988733 +0000 UTC m=+68.270828763,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:39:59.639633 master-0 kubenswrapper[8993]: I1204 11:39:59.639575 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:39:59.640073 master-0 kubenswrapper[8993]: I1204 11:39:59.640045 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:40:01.266464 master-0 kubenswrapper[8993]: E1204 11:40:01.266347 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="200ms" Dec 04 11:40:08.470646 master-0 kubenswrapper[8993]: E1204 11:40:08.470576 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:40:11.467223 master-0 kubenswrapper[8993]: E1204 11:40:11.467030 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="400ms" Dec 04 11:40:18.390050 master-0 kubenswrapper[8993]: I1204 11:40:18.390000 8993 patch_prober.go:28] interesting pod/etcd-operator-5bf4d88c6f-2bpmr container/etcd-operator namespace/openshift-etcd-operator: Liveness probe status=failure output="Get \"https://10.128.0.21:8443/healthz\": dial tcp 10.128.0.21:8443: connect: connection refused" start-of-body= Dec 04 11:40:18.390712 master-0 kubenswrapper[8993]: I1204 11:40:18.390669 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" podUID="c6e9271a-44ea-4612-ab60-4a9d489ed062" containerName="etcd-operator" probeResult="failure" output="Get \"https://10.128.0.21:8443/healthz\": dial tcp 10.128.0.21:8443: connect: connection refused" Dec 04 11:40:18.472615 master-0 kubenswrapper[8993]: E1204 11:40:18.472558 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": the server was unable to return a response in the time allotted, but may still be processing the request (get nodes master-0)" Dec 04 11:40:18.472615 master-0 kubenswrapper[8993]: E1204 11:40:18.472596 8993 kubelet_node_status.go:572] "Unable to update node status" err="update node status exceeds retry count" Dec 04 11:40:20.760390 master-0 kubenswrapper[8993]: I1204 11:40:20.760195 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/0.log" Dec 04 11:40:20.760390 master-0 kubenswrapper[8993]: I1204 11:40:20.760263 8993 generic.go:334] "Generic (PLEG): container finished" podID="b011b1f1-3235-4e20-825b-ce711c052407" containerID="8c8f5ab95655b4b56cfeec6bbc9fe176ccf7048325a2476ad9f982e855b05fb0" exitCode=1 Dec 04 11:40:21.869300 master-0 kubenswrapper[8993]: E1204 11:40:21.869142 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="800ms" Dec 04 11:40:21.905635 master-0 kubenswrapper[8993]: E1204 11:40:21.905526 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:40:21.905635 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-rxhpq_openshift-marketplace_5ae25dd5-dfdb-42f6-97d0-14ad17743c95_0(430bdcc88caaa1762f9556d2b54d19f20fc0a57316355ff65c95ea047594de49): error adding pod openshift-marketplace_community-operators-rxhpq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"430bdcc88caaa1762f9556d2b54d19f20fc0a57316355ff65c95ea047594de49" Netns:"/var/run/netns/5e9b3bbd-c0ca-4799-bed4-87bb864607e6" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-rxhpq;K8S_POD_INFRA_CONTAINER_ID=430bdcc88caaa1762f9556d2b54d19f20fc0a57316355ff65c95ea047594de49;K8S_POD_UID=5ae25dd5-dfdb-42f6-97d0-14ad17743c95" Path:"" ERRORED: error configuring pod [openshift-marketplace/community-operators-rxhpq] networking: Multus: [openshift-marketplace/community-operators-rxhpq/5ae25dd5-dfdb-42f6-97d0-14ad17743c95]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-rxhpq in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-rxhpq in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-rxhpq?timeout=1m0s": context deadline exceeded (Client.Timeout exceeded while awaiting headers) Dec 04 11:40:21.905635 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:40:21.905635 master-0 kubenswrapper[8993]: > Dec 04 11:40:21.906006 master-0 kubenswrapper[8993]: E1204 11:40:21.905649 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:40:21.906006 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-rxhpq_openshift-marketplace_5ae25dd5-dfdb-42f6-97d0-14ad17743c95_0(430bdcc88caaa1762f9556d2b54d19f20fc0a57316355ff65c95ea047594de49): error adding pod openshift-marketplace_community-operators-rxhpq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"430bdcc88caaa1762f9556d2b54d19f20fc0a57316355ff65c95ea047594de49" Netns:"/var/run/netns/5e9b3bbd-c0ca-4799-bed4-87bb864607e6" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-rxhpq;K8S_POD_INFRA_CONTAINER_ID=430bdcc88caaa1762f9556d2b54d19f20fc0a57316355ff65c95ea047594de49;K8S_POD_UID=5ae25dd5-dfdb-42f6-97d0-14ad17743c95" Path:"" ERRORED: error configuring pod [openshift-marketplace/community-operators-rxhpq] networking: Multus: [openshift-marketplace/community-operators-rxhpq/5ae25dd5-dfdb-42f6-97d0-14ad17743c95]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-rxhpq in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-rxhpq in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-rxhpq?timeout=1m0s": context deadline exceeded (Client.Timeout exceeded while awaiting headers) Dec 04 11:40:21.906006 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:40:21.906006 master-0 kubenswrapper[8993]: > pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:40:21.906006 master-0 kubenswrapper[8993]: E1204 11:40:21.905675 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:40:21.906006 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-rxhpq_openshift-marketplace_5ae25dd5-dfdb-42f6-97d0-14ad17743c95_0(430bdcc88caaa1762f9556d2b54d19f20fc0a57316355ff65c95ea047594de49): error adding pod openshift-marketplace_community-operators-rxhpq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"430bdcc88caaa1762f9556d2b54d19f20fc0a57316355ff65c95ea047594de49" Netns:"/var/run/netns/5e9b3bbd-c0ca-4799-bed4-87bb864607e6" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-rxhpq;K8S_POD_INFRA_CONTAINER_ID=430bdcc88caaa1762f9556d2b54d19f20fc0a57316355ff65c95ea047594de49;K8S_POD_UID=5ae25dd5-dfdb-42f6-97d0-14ad17743c95" Path:"" ERRORED: error configuring pod [openshift-marketplace/community-operators-rxhpq] networking: Multus: [openshift-marketplace/community-operators-rxhpq/5ae25dd5-dfdb-42f6-97d0-14ad17743c95]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-rxhpq in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-rxhpq in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-rxhpq?timeout=1m0s": context deadline exceeded (Client.Timeout exceeded while awaiting headers) Dec 04 11:40:21.906006 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:40:21.906006 master-0 kubenswrapper[8993]: > pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:40:21.906006 master-0 kubenswrapper[8993]: E1204 11:40:21.905774 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"community-operators-rxhpq_openshift-marketplace(5ae25dd5-dfdb-42f6-97d0-14ad17743c95)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"community-operators-rxhpq_openshift-marketplace(5ae25dd5-dfdb-42f6-97d0-14ad17743c95)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-rxhpq_openshift-marketplace_5ae25dd5-dfdb-42f6-97d0-14ad17743c95_0(430bdcc88caaa1762f9556d2b54d19f20fc0a57316355ff65c95ea047594de49): error adding pod openshift-marketplace_community-operators-rxhpq to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"430bdcc88caaa1762f9556d2b54d19f20fc0a57316355ff65c95ea047594de49\\\" Netns:\\\"/var/run/netns/5e9b3bbd-c0ca-4799-bed4-87bb864607e6\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-rxhpq;K8S_POD_INFRA_CONTAINER_ID=430bdcc88caaa1762f9556d2b54d19f20fc0a57316355ff65c95ea047594de49;K8S_POD_UID=5ae25dd5-dfdb-42f6-97d0-14ad17743c95\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-marketplace/community-operators-rxhpq] networking: Multus: [openshift-marketplace/community-operators-rxhpq/5ae25dd5-dfdb-42f6-97d0-14ad17743c95]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-rxhpq in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-rxhpq in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-rxhpq?timeout=1m0s\\\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-marketplace/community-operators-rxhpq" podUID="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" Dec 04 11:40:22.032754 master-0 kubenswrapper[8993]: E1204 11:40:22.032669 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:40:22.032754 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_780ea907-dec5-426e-9de2-158f59c09f71_0(39d9f19548dde8f3c52d8466f9b78f509959aa0e34a1e3caa685d387b613b98e): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"39d9f19548dde8f3c52d8466f9b78f509959aa0e34a1e3caa685d387b613b98e" Netns:"/var/run/netns/f5b9decb-f3bb-461d-8a7f-0333c0e461c8" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=39d9f19548dde8f3c52d8466f9b78f509959aa0e34a1e3caa685d387b613b98e;K8S_POD_UID=780ea907-dec5-426e-9de2-158f59c09f71" Path:"" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/780ea907-dec5-426e-9de2-158f59c09f71]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:40:22.032754 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:40:22.032754 master-0 kubenswrapper[8993]: > Dec 04 11:40:22.033001 master-0 kubenswrapper[8993]: E1204 11:40:22.032786 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:40:22.033001 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_780ea907-dec5-426e-9de2-158f59c09f71_0(39d9f19548dde8f3c52d8466f9b78f509959aa0e34a1e3caa685d387b613b98e): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"39d9f19548dde8f3c52d8466f9b78f509959aa0e34a1e3caa685d387b613b98e" Netns:"/var/run/netns/f5b9decb-f3bb-461d-8a7f-0333c0e461c8" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=39d9f19548dde8f3c52d8466f9b78f509959aa0e34a1e3caa685d387b613b98e;K8S_POD_UID=780ea907-dec5-426e-9de2-158f59c09f71" Path:"" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/780ea907-dec5-426e-9de2-158f59c09f71]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:40:22.033001 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:40:22.033001 master-0 kubenswrapper[8993]: > pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:40:22.033001 master-0 kubenswrapper[8993]: E1204 11:40:22.032847 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:40:22.033001 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_780ea907-dec5-426e-9de2-158f59c09f71_0(39d9f19548dde8f3c52d8466f9b78f509959aa0e34a1e3caa685d387b613b98e): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"39d9f19548dde8f3c52d8466f9b78f509959aa0e34a1e3caa685d387b613b98e" Netns:"/var/run/netns/f5b9decb-f3bb-461d-8a7f-0333c0e461c8" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=39d9f19548dde8f3c52d8466f9b78f509959aa0e34a1e3caa685d387b613b98e;K8S_POD_UID=780ea907-dec5-426e-9de2-158f59c09f71" Path:"" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/780ea907-dec5-426e-9de2-158f59c09f71]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:40:22.033001 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:40:22.033001 master-0 kubenswrapper[8993]: > pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:40:22.033001 master-0 kubenswrapper[8993]: E1204 11:40:22.032936 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"installer-4-master-0_openshift-kube-scheduler(780ea907-dec5-426e-9de2-158f59c09f71)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"installer-4-master-0_openshift-kube-scheduler(780ea907-dec5-426e-9de2-158f59c09f71)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_780ea907-dec5-426e-9de2-158f59c09f71_0(39d9f19548dde8f3c52d8466f9b78f509959aa0e34a1e3caa685d387b613b98e): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"39d9f19548dde8f3c52d8466f9b78f509959aa0e34a1e3caa685d387b613b98e\\\" Netns:\\\"/var/run/netns/f5b9decb-f3bb-461d-8a7f-0333c0e461c8\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=39d9f19548dde8f3c52d8466f9b78f509959aa0e34a1e3caa685d387b613b98e;K8S_POD_UID=780ea907-dec5-426e-9de2-158f59c09f71\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/780ea907-dec5-426e-9de2-158f59c09f71]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-kube-scheduler/installer-4-master-0" podUID="780ea907-dec5-426e-9de2-158f59c09f71" Dec 04 11:40:22.053777 master-0 kubenswrapper[8993]: E1204 11:40:22.053605 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:40:22.053777 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_controller-manager-6686654b8d-rrndk_openshift-controller-manager_24506aa4-ab78-49df-bb58-59093498f13d_0(80084e6d846b9ab14d689920224de665b033fb5b2fda92ba002f913e4ec488c5): error adding pod openshift-controller-manager_controller-manager-6686654b8d-rrndk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"80084e6d846b9ab14d689920224de665b033fb5b2fda92ba002f913e4ec488c5" Netns:"/var/run/netns/d7e501b9-d461-4a07-adb8-dcf7d33c4eaf" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-controller-manager;K8S_POD_NAME=controller-manager-6686654b8d-rrndk;K8S_POD_INFRA_CONTAINER_ID=80084e6d846b9ab14d689920224de665b033fb5b2fda92ba002f913e4ec488c5;K8S_POD_UID=24506aa4-ab78-49df-bb58-59093498f13d" Path:"" ERRORED: error configuring pod [openshift-controller-manager/controller-manager-6686654b8d-rrndk] networking: Multus: [openshift-controller-manager/controller-manager-6686654b8d-rrndk/24506aa4-ab78-49df-bb58-59093498f13d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: SetNetworkStatus: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-controller-manager/pods/controller-manager-6686654b8d-rrndk?timeout=1m0s": context deadline exceeded Dec 04 11:40:22.053777 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:40:22.053777 master-0 kubenswrapper[8993]: > Dec 04 11:40:22.053777 master-0 kubenswrapper[8993]: E1204 11:40:22.053701 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:40:22.053777 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_controller-manager-6686654b8d-rrndk_openshift-controller-manager_24506aa4-ab78-49df-bb58-59093498f13d_0(80084e6d846b9ab14d689920224de665b033fb5b2fda92ba002f913e4ec488c5): error adding pod openshift-controller-manager_controller-manager-6686654b8d-rrndk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"80084e6d846b9ab14d689920224de665b033fb5b2fda92ba002f913e4ec488c5" Netns:"/var/run/netns/d7e501b9-d461-4a07-adb8-dcf7d33c4eaf" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-controller-manager;K8S_POD_NAME=controller-manager-6686654b8d-rrndk;K8S_POD_INFRA_CONTAINER_ID=80084e6d846b9ab14d689920224de665b033fb5b2fda92ba002f913e4ec488c5;K8S_POD_UID=24506aa4-ab78-49df-bb58-59093498f13d" Path:"" ERRORED: error configuring pod [openshift-controller-manager/controller-manager-6686654b8d-rrndk] networking: Multus: [openshift-controller-manager/controller-manager-6686654b8d-rrndk/24506aa4-ab78-49df-bb58-59093498f13d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: SetNetworkStatus: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-controller-manager/pods/controller-manager-6686654b8d-rrndk?timeout=1m0s": context deadline exceeded Dec 04 11:40:22.053777 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:40:22.053777 master-0 kubenswrapper[8993]: > pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:40:22.053777 master-0 kubenswrapper[8993]: E1204 11:40:22.053742 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:40:22.053777 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_controller-manager-6686654b8d-rrndk_openshift-controller-manager_24506aa4-ab78-49df-bb58-59093498f13d_0(80084e6d846b9ab14d689920224de665b033fb5b2fda92ba002f913e4ec488c5): error adding pod openshift-controller-manager_controller-manager-6686654b8d-rrndk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"80084e6d846b9ab14d689920224de665b033fb5b2fda92ba002f913e4ec488c5" Netns:"/var/run/netns/d7e501b9-d461-4a07-adb8-dcf7d33c4eaf" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-controller-manager;K8S_POD_NAME=controller-manager-6686654b8d-rrndk;K8S_POD_INFRA_CONTAINER_ID=80084e6d846b9ab14d689920224de665b033fb5b2fda92ba002f913e4ec488c5;K8S_POD_UID=24506aa4-ab78-49df-bb58-59093498f13d" Path:"" ERRORED: error configuring pod [openshift-controller-manager/controller-manager-6686654b8d-rrndk] networking: Multus: [openshift-controller-manager/controller-manager-6686654b8d-rrndk/24506aa4-ab78-49df-bb58-59093498f13d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: SetNetworkStatus: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-controller-manager/pods/controller-manager-6686654b8d-rrndk?timeout=1m0s": context deadline exceeded Dec 04 11:40:22.053777 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:40:22.053777 master-0 kubenswrapper[8993]: > pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:40:22.054799 master-0 kubenswrapper[8993]: E1204 11:40:22.053838 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"controller-manager-6686654b8d-rrndk_openshift-controller-manager(24506aa4-ab78-49df-bb58-59093498f13d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"controller-manager-6686654b8d-rrndk_openshift-controller-manager(24506aa4-ab78-49df-bb58-59093498f13d)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_controller-manager-6686654b8d-rrndk_openshift-controller-manager_24506aa4-ab78-49df-bb58-59093498f13d_0(80084e6d846b9ab14d689920224de665b033fb5b2fda92ba002f913e4ec488c5): error adding pod openshift-controller-manager_controller-manager-6686654b8d-rrndk to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"80084e6d846b9ab14d689920224de665b033fb5b2fda92ba002f913e4ec488c5\\\" Netns:\\\"/var/run/netns/d7e501b9-d461-4a07-adb8-dcf7d33c4eaf\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-controller-manager;K8S_POD_NAME=controller-manager-6686654b8d-rrndk;K8S_POD_INFRA_CONTAINER_ID=80084e6d846b9ab14d689920224de665b033fb5b2fda92ba002f913e4ec488c5;K8S_POD_UID=24506aa4-ab78-49df-bb58-59093498f13d\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-controller-manager/controller-manager-6686654b8d-rrndk] networking: Multus: [openshift-controller-manager/controller-manager-6686654b8d-rrndk/24506aa4-ab78-49df-bb58-59093498f13d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: SetNetworkStatus: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-controller-manager/pods/controller-manager-6686654b8d-rrndk?timeout=1m0s\\\": context deadline exceeded\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" podUID="24506aa4-ab78-49df-bb58-59093498f13d" Dec 04 11:40:22.060881 master-0 kubenswrapper[8993]: E1204 11:40:22.060822 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:40:22.060881 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager_855d7874-16b1-47d0-82f6-d2b0c89b9a84_0(896aef82e1d6cb28b4d2159f1388c189773aa632f6eace1e5d447c4fed3a97a7): error adding pod openshift-operator-lifecycle-manager_packageserver-675f5c767c-mtdrq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"896aef82e1d6cb28b4d2159f1388c189773aa632f6eace1e5d447c4fed3a97a7" Netns:"/var/run/netns/8aec4def-e56e-4b8f-ae8d-b88220ffeb08" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-operator-lifecycle-manager;K8S_POD_NAME=packageserver-675f5c767c-mtdrq;K8S_POD_INFRA_CONTAINER_ID=896aef82e1d6cb28b4d2159f1388c189773aa632f6eace1e5d447c4fed3a97a7;K8S_POD_UID=855d7874-16b1-47d0-82f6-d2b0c89b9a84" Path:"" ERRORED: error configuring pod [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq] networking: Multus: [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq/855d7874-16b1-47d0-82f6-d2b0c89b9a84]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: SetNetworkStatus: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-operator-lifecycle-manager/pods/packageserver-675f5c767c-mtdrq?timeout=1m0s": context deadline exceeded Dec 04 11:40:22.060881 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:40:22.060881 master-0 kubenswrapper[8993]: > Dec 04 11:40:22.061055 master-0 kubenswrapper[8993]: E1204 11:40:22.060897 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:40:22.061055 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager_855d7874-16b1-47d0-82f6-d2b0c89b9a84_0(896aef82e1d6cb28b4d2159f1388c189773aa632f6eace1e5d447c4fed3a97a7): error adding pod openshift-operator-lifecycle-manager_packageserver-675f5c767c-mtdrq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"896aef82e1d6cb28b4d2159f1388c189773aa632f6eace1e5d447c4fed3a97a7" Netns:"/var/run/netns/8aec4def-e56e-4b8f-ae8d-b88220ffeb08" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-operator-lifecycle-manager;K8S_POD_NAME=packageserver-675f5c767c-mtdrq;K8S_POD_INFRA_CONTAINER_ID=896aef82e1d6cb28b4d2159f1388c189773aa632f6eace1e5d447c4fed3a97a7;K8S_POD_UID=855d7874-16b1-47d0-82f6-d2b0c89b9a84" Path:"" ERRORED: error configuring pod [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq] networking: Multus: [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq/855d7874-16b1-47d0-82f6-d2b0c89b9a84]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: SetNetworkStatus: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-operator-lifecycle-manager/pods/packageserver-675f5c767c-mtdrq?timeout=1m0s": context deadline exceeded Dec 04 11:40:22.061055 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:40:22.061055 master-0 kubenswrapper[8993]: > pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:40:22.061055 master-0 kubenswrapper[8993]: E1204 11:40:22.060921 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:40:22.061055 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager_855d7874-16b1-47d0-82f6-d2b0c89b9a84_0(896aef82e1d6cb28b4d2159f1388c189773aa632f6eace1e5d447c4fed3a97a7): error adding pod openshift-operator-lifecycle-manager_packageserver-675f5c767c-mtdrq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"896aef82e1d6cb28b4d2159f1388c189773aa632f6eace1e5d447c4fed3a97a7" Netns:"/var/run/netns/8aec4def-e56e-4b8f-ae8d-b88220ffeb08" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-operator-lifecycle-manager;K8S_POD_NAME=packageserver-675f5c767c-mtdrq;K8S_POD_INFRA_CONTAINER_ID=896aef82e1d6cb28b4d2159f1388c189773aa632f6eace1e5d447c4fed3a97a7;K8S_POD_UID=855d7874-16b1-47d0-82f6-d2b0c89b9a84" Path:"" ERRORED: error configuring pod [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq] networking: Multus: [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq/855d7874-16b1-47d0-82f6-d2b0c89b9a84]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: SetNetworkStatus: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-operator-lifecycle-manager/pods/packageserver-675f5c767c-mtdrq?timeout=1m0s": context deadline exceeded Dec 04 11:40:22.061055 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:40:22.061055 master-0 kubenswrapper[8993]: > pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:40:22.061055 master-0 kubenswrapper[8993]: E1204 11:40:22.060984 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager(855d7874-16b1-47d0-82f6-d2b0c89b9a84)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager(855d7874-16b1-47d0-82f6-d2b0c89b9a84)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager_855d7874-16b1-47d0-82f6-d2b0c89b9a84_0(896aef82e1d6cb28b4d2159f1388c189773aa632f6eace1e5d447c4fed3a97a7): error adding pod openshift-operator-lifecycle-manager_packageserver-675f5c767c-mtdrq to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"896aef82e1d6cb28b4d2159f1388c189773aa632f6eace1e5d447c4fed3a97a7\\\" Netns:\\\"/var/run/netns/8aec4def-e56e-4b8f-ae8d-b88220ffeb08\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-operator-lifecycle-manager;K8S_POD_NAME=packageserver-675f5c767c-mtdrq;K8S_POD_INFRA_CONTAINER_ID=896aef82e1d6cb28b4d2159f1388c189773aa632f6eace1e5d447c4fed3a97a7;K8S_POD_UID=855d7874-16b1-47d0-82f6-d2b0c89b9a84\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq] networking: Multus: [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq/855d7874-16b1-47d0-82f6-d2b0c89b9a84]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: SetNetworkStatus: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-operator-lifecycle-manager/pods/packageserver-675f5c767c-mtdrq?timeout=1m0s\\\": context deadline exceeded\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" podUID="855d7874-16b1-47d0-82f6-d2b0c89b9a84" Dec 04 11:40:22.073546 master-0 kubenswrapper[8993]: E1204 11:40:22.073479 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:40:22.073546 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_38e7be62-e4f5-42ba-89f0-83aca874a092_0(07b26902c86c19476e0b1231675a3a2190e6256c4ece69045cbb7f750231e1e8): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"07b26902c86c19476e0b1231675a3a2190e6256c4ece69045cbb7f750231e1e8" Netns:"/var/run/netns/f85fdd93-a4af-4e9a-9d1a-34ea0b226cb0" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=07b26902c86c19476e0b1231675a3a2190e6256c4ece69045cbb7f750231e1e8;K8S_POD_UID=38e7be62-e4f5-42ba-89f0-83aca874a092" Path:"" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/38e7be62-e4f5-42ba-89f0-83aca874a092]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:40:22.073546 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:40:22.073546 master-0 kubenswrapper[8993]: > Dec 04 11:40:22.073723 master-0 kubenswrapper[8993]: E1204 11:40:22.073568 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:40:22.073723 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_38e7be62-e4f5-42ba-89f0-83aca874a092_0(07b26902c86c19476e0b1231675a3a2190e6256c4ece69045cbb7f750231e1e8): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"07b26902c86c19476e0b1231675a3a2190e6256c4ece69045cbb7f750231e1e8" Netns:"/var/run/netns/f85fdd93-a4af-4e9a-9d1a-34ea0b226cb0" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=07b26902c86c19476e0b1231675a3a2190e6256c4ece69045cbb7f750231e1e8;K8S_POD_UID=38e7be62-e4f5-42ba-89f0-83aca874a092" Path:"" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/38e7be62-e4f5-42ba-89f0-83aca874a092]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:40:22.073723 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:40:22.073723 master-0 kubenswrapper[8993]: > pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:40:22.073723 master-0 kubenswrapper[8993]: E1204 11:40:22.073600 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:40:22.073723 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_38e7be62-e4f5-42ba-89f0-83aca874a092_0(07b26902c86c19476e0b1231675a3a2190e6256c4ece69045cbb7f750231e1e8): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"07b26902c86c19476e0b1231675a3a2190e6256c4ece69045cbb7f750231e1e8" Netns:"/var/run/netns/f85fdd93-a4af-4e9a-9d1a-34ea0b226cb0" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=07b26902c86c19476e0b1231675a3a2190e6256c4ece69045cbb7f750231e1e8;K8S_POD_UID=38e7be62-e4f5-42ba-89f0-83aca874a092" Path:"" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/38e7be62-e4f5-42ba-89f0-83aca874a092]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:40:22.073723 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:40:22.073723 master-0 kubenswrapper[8993]: > pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:40:22.073723 master-0 kubenswrapper[8993]: E1204 11:40:22.073673 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"installer-2-master-0_openshift-kube-controller-manager(38e7be62-e4f5-42ba-89f0-83aca874a092)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"installer-2-master-0_openshift-kube-controller-manager(38e7be62-e4f5-42ba-89f0-83aca874a092)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_38e7be62-e4f5-42ba-89f0-83aca874a092_0(07b26902c86c19476e0b1231675a3a2190e6256c4ece69045cbb7f750231e1e8): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"07b26902c86c19476e0b1231675a3a2190e6256c4ece69045cbb7f750231e1e8\\\" Netns:\\\"/var/run/netns/f85fdd93-a4af-4e9a-9d1a-34ea0b226cb0\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=07b26902c86c19476e0b1231675a3a2190e6256c4ece69045cbb7f750231e1e8;K8S_POD_UID=38e7be62-e4f5-42ba-89f0-83aca874a092\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/38e7be62-e4f5-42ba-89f0-83aca874a092]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-kube-controller-manager/installer-2-master-0" podUID="38e7be62-e4f5-42ba-89f0-83aca874a092" Dec 04 11:40:22.245960 master-0 kubenswrapper[8993]: E1204 11:40:22.245878 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:40:22.245960 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager_e4d7939a-5961-4608-b910-73e71aa55bf6_0(9519a074afd2181f00fe2f6116d50a06885facad038c0cb4784a9787e54f04e8): error adding pod openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"9519a074afd2181f00fe2f6116d50a06885facad038c0cb4784a9787e54f04e8" Netns:"/var/run/netns/e22c2237-8bd6-44a7-8811-bb69ea806f2b" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-route-controller-manager;K8S_POD_NAME=route-controller-manager-95cb5f987-46bsk;K8S_POD_INFRA_CONTAINER_ID=9519a074afd2181f00fe2f6116d50a06885facad038c0cb4784a9787e54f04e8;K8S_POD_UID=e4d7939a-5961-4608-b910-73e71aa55bf6" Path:"" ERRORED: error configuring pod [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk] networking: Multus: [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk/e4d7939a-5961-4608-b910-73e71aa55bf6]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: SetNetworkStatus: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:40:22.245960 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:40:22.245960 master-0 kubenswrapper[8993]: > Dec 04 11:40:22.246363 master-0 kubenswrapper[8993]: E1204 11:40:22.245979 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:40:22.246363 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager_e4d7939a-5961-4608-b910-73e71aa55bf6_0(9519a074afd2181f00fe2f6116d50a06885facad038c0cb4784a9787e54f04e8): error adding pod openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"9519a074afd2181f00fe2f6116d50a06885facad038c0cb4784a9787e54f04e8" Netns:"/var/run/netns/e22c2237-8bd6-44a7-8811-bb69ea806f2b" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-route-controller-manager;K8S_POD_NAME=route-controller-manager-95cb5f987-46bsk;K8S_POD_INFRA_CONTAINER_ID=9519a074afd2181f00fe2f6116d50a06885facad038c0cb4784a9787e54f04e8;K8S_POD_UID=e4d7939a-5961-4608-b910-73e71aa55bf6" Path:"" ERRORED: error configuring pod [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk] networking: Multus: [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk/e4d7939a-5961-4608-b910-73e71aa55bf6]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: SetNetworkStatus: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:40:22.246363 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:40:22.246363 master-0 kubenswrapper[8993]: > pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:40:22.246363 master-0 kubenswrapper[8993]: E1204 11:40:22.246005 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:40:22.246363 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager_e4d7939a-5961-4608-b910-73e71aa55bf6_0(9519a074afd2181f00fe2f6116d50a06885facad038c0cb4784a9787e54f04e8): error adding pod openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"9519a074afd2181f00fe2f6116d50a06885facad038c0cb4784a9787e54f04e8" Netns:"/var/run/netns/e22c2237-8bd6-44a7-8811-bb69ea806f2b" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-route-controller-manager;K8S_POD_NAME=route-controller-manager-95cb5f987-46bsk;K8S_POD_INFRA_CONTAINER_ID=9519a074afd2181f00fe2f6116d50a06885facad038c0cb4784a9787e54f04e8;K8S_POD_UID=e4d7939a-5961-4608-b910-73e71aa55bf6" Path:"" ERRORED: error configuring pod [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk] networking: Multus: [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk/e4d7939a-5961-4608-b910-73e71aa55bf6]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: SetNetworkStatus: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:40:22.246363 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:40:22.246363 master-0 kubenswrapper[8993]: > pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:40:22.246363 master-0 kubenswrapper[8993]: E1204 11:40:22.246083 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager(e4d7939a-5961-4608-b910-73e71aa55bf6)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager(e4d7939a-5961-4608-b910-73e71aa55bf6)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager_e4d7939a-5961-4608-b910-73e71aa55bf6_0(9519a074afd2181f00fe2f6116d50a06885facad038c0cb4784a9787e54f04e8): error adding pod openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"9519a074afd2181f00fe2f6116d50a06885facad038c0cb4784a9787e54f04e8\\\" Netns:\\\"/var/run/netns/e22c2237-8bd6-44a7-8811-bb69ea806f2b\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-route-controller-manager;K8S_POD_NAME=route-controller-manager-95cb5f987-46bsk;K8S_POD_INFRA_CONTAINER_ID=9519a074afd2181f00fe2f6116d50a06885facad038c0cb4784a9787e54f04e8;K8S_POD_UID=e4d7939a-5961-4608-b910-73e71aa55bf6\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk] networking: Multus: [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk/e4d7939a-5961-4608-b910-73e71aa55bf6]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: SetNetworkStatus: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" Dec 04 11:40:22.250793 master-0 kubenswrapper[8993]: E1204 11:40:22.250479 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:40:22.250793 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_certified-operators-8qs8v_openshift-marketplace_b620f29d-dcde-4f98-9fb6-dd479dcdcf7c_0(f318ad61b0980d76ec38b561966b7553196e5e4cd94d3483dfaba5a5a10a15dc): error adding pod openshift-marketplace_certified-operators-8qs8v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f318ad61b0980d76ec38b561966b7553196e5e4cd94d3483dfaba5a5a10a15dc" Netns:"/var/run/netns/1b61f214-7db3-4926-85d9-cbacbb41d76b" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=certified-operators-8qs8v;K8S_POD_INFRA_CONTAINER_ID=f318ad61b0980d76ec38b561966b7553196e5e4cd94d3483dfaba5a5a10a15dc;K8S_POD_UID=b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" Path:"" ERRORED: error configuring pod [openshift-marketplace/certified-operators-8qs8v] networking: Multus: [openshift-marketplace/certified-operators-8qs8v/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod certified-operators-8qs8v in out of cluster comm: SetNetworkStatus: failed to update the pod certified-operators-8qs8v in out of cluster comm: status update failed for pod /: the server was unable to return a response in the time allotted, but may still be processing the request (get pods certified-operators-8qs8v) Dec 04 11:40:22.250793 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:40:22.250793 master-0 kubenswrapper[8993]: > Dec 04 11:40:22.250793 master-0 kubenswrapper[8993]: E1204 11:40:22.250580 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:40:22.250793 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_certified-operators-8qs8v_openshift-marketplace_b620f29d-dcde-4f98-9fb6-dd479dcdcf7c_0(f318ad61b0980d76ec38b561966b7553196e5e4cd94d3483dfaba5a5a10a15dc): error adding pod openshift-marketplace_certified-operators-8qs8v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f318ad61b0980d76ec38b561966b7553196e5e4cd94d3483dfaba5a5a10a15dc" Netns:"/var/run/netns/1b61f214-7db3-4926-85d9-cbacbb41d76b" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=certified-operators-8qs8v;K8S_POD_INFRA_CONTAINER_ID=f318ad61b0980d76ec38b561966b7553196e5e4cd94d3483dfaba5a5a10a15dc;K8S_POD_UID=b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" Path:"" ERRORED: error configuring pod [openshift-marketplace/certified-operators-8qs8v] networking: Multus: [openshift-marketplace/certified-operators-8qs8v/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod certified-operators-8qs8v in out of cluster comm: SetNetworkStatus: failed to update the pod certified-operators-8qs8v in out of cluster comm: status update failed for pod /: the server was unable to return a response in the time allotted, but may still be processing the request (get pods certified-operators-8qs8v) Dec 04 11:40:22.250793 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:40:22.250793 master-0 kubenswrapper[8993]: > pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:40:22.250793 master-0 kubenswrapper[8993]: E1204 11:40:22.250609 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:40:22.250793 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_certified-operators-8qs8v_openshift-marketplace_b620f29d-dcde-4f98-9fb6-dd479dcdcf7c_0(f318ad61b0980d76ec38b561966b7553196e5e4cd94d3483dfaba5a5a10a15dc): error adding pod openshift-marketplace_certified-operators-8qs8v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f318ad61b0980d76ec38b561966b7553196e5e4cd94d3483dfaba5a5a10a15dc" Netns:"/var/run/netns/1b61f214-7db3-4926-85d9-cbacbb41d76b" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=certified-operators-8qs8v;K8S_POD_INFRA_CONTAINER_ID=f318ad61b0980d76ec38b561966b7553196e5e4cd94d3483dfaba5a5a10a15dc;K8S_POD_UID=b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" Path:"" ERRORED: error configuring pod [openshift-marketplace/certified-operators-8qs8v] networking: Multus: [openshift-marketplace/certified-operators-8qs8v/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod certified-operators-8qs8v in out of cluster comm: SetNetworkStatus: failed to update the pod certified-operators-8qs8v in out of cluster comm: status update failed for pod /: the server was unable to return a response in the time allotted, but may still be processing the request (get pods certified-operators-8qs8v) Dec 04 11:40:22.250793 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:40:22.250793 master-0 kubenswrapper[8993]: > pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:40:22.250793 master-0 kubenswrapper[8993]: E1204 11:40:22.250710 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"certified-operators-8qs8v_openshift-marketplace(b620f29d-dcde-4f98-9fb6-dd479dcdcf7c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"certified-operators-8qs8v_openshift-marketplace(b620f29d-dcde-4f98-9fb6-dd479dcdcf7c)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_certified-operators-8qs8v_openshift-marketplace_b620f29d-dcde-4f98-9fb6-dd479dcdcf7c_0(f318ad61b0980d76ec38b561966b7553196e5e4cd94d3483dfaba5a5a10a15dc): error adding pod openshift-marketplace_certified-operators-8qs8v to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"f318ad61b0980d76ec38b561966b7553196e5e4cd94d3483dfaba5a5a10a15dc\\\" Netns:\\\"/var/run/netns/1b61f214-7db3-4926-85d9-cbacbb41d76b\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=certified-operators-8qs8v;K8S_POD_INFRA_CONTAINER_ID=f318ad61b0980d76ec38b561966b7553196e5e4cd94d3483dfaba5a5a10a15dc;K8S_POD_UID=b620f29d-dcde-4f98-9fb6-dd479dcdcf7c\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-marketplace/certified-operators-8qs8v] networking: Multus: [openshift-marketplace/certified-operators-8qs8v/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod certified-operators-8qs8v in out of cluster comm: SetNetworkStatus: failed to update the pod certified-operators-8qs8v in out of cluster comm: status update failed for pod /: the server was unable to return a response in the time allotted, but may still be processing the request (get pods certified-operators-8qs8v)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-marketplace/certified-operators-8qs8v" podUID="b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" Dec 04 11:40:22.773574 master-0 kubenswrapper[8993]: I1204 11:40:22.773535 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-78f758c7b9-zgkh5_7e3160a9-11d1-4845-ba30-1a49ae7339a9/cluster-baremetal-operator/0.log" Dec 04 11:40:22.773888 master-0 kubenswrapper[8993]: I1204 11:40:22.773864 8993 generic.go:334] "Generic (PLEG): container finished" podID="7e3160a9-11d1-4845-ba30-1a49ae7339a9" containerID="e0f56c17864ba0f74d6e33ee62008f6da1f6df237d3a2bf24da757af97c1cd89" exitCode=1 Dec 04 11:40:22.774051 master-0 kubenswrapper[8993]: I1204 11:40:22.774038 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:40:22.774326 master-0 kubenswrapper[8993]: I1204 11:40:22.774266 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:40:22.774382 master-0 kubenswrapper[8993]: I1204 11:40:22.774317 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:40:22.774425 master-0 kubenswrapper[8993]: I1204 11:40:22.774223 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:40:22.774487 master-0 kubenswrapper[8993]: I1204 11:40:22.774171 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:40:22.775124 master-0 kubenswrapper[8993]: I1204 11:40:22.774204 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:40:22.785687 master-0 kubenswrapper[8993]: I1204 11:40:22.776096 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:40:22.785687 master-0 kubenswrapper[8993]: I1204 11:40:22.775779 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:40:22.785687 master-0 kubenswrapper[8993]: I1204 11:40:22.776613 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:40:22.785687 master-0 kubenswrapper[8993]: I1204 11:40:22.778031 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:40:22.785687 master-0 kubenswrapper[8993]: I1204 11:40:22.783655 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:40:22.788113 master-0 kubenswrapper[8993]: I1204 11:40:22.788052 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:40:22.788297 master-0 kubenswrapper[8993]: I1204 11:40:22.788231 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:40:22.788472 master-0 kubenswrapper[8993]: I1204 11:40:22.788410 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:40:23.785219 master-0 kubenswrapper[8993]: I1204 11:40:23.785147 8993 generic.go:334] "Generic (PLEG): container finished" podID="8b47694fcc32464ab24d09c23d6efb57" containerID="68cefdb59268cb33333146cf2f74e7763f9033ac08d79970d8869684b7700cf2" exitCode=1 Dec 04 11:40:28.816515 master-0 kubenswrapper[8993]: I1204 11:40:28.816456 8993 generic.go:334] "Generic (PLEG): container finished" podID="b668f740-dbc3-48e0-9ebc-83bae3a43c83" containerID="397481b3f91ac25f72eb86f49a721b3557eba7e4607ac9ea2395672278f1bcfc" exitCode=0 Dec 04 11:40:29.853110 master-0 kubenswrapper[8993]: E1204 11:40:29.853031 8993 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:40:29.854136 master-0 kubenswrapper[8993]: E1204 11:40:29.853320 8993 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="34.018s" Dec 04 11:40:29.854136 master-0 kubenswrapper[8993]: I1204 11:40:29.853357 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:40:29.854136 master-0 kubenswrapper[8993]: I1204 11:40:29.853397 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:40:29.854136 master-0 kubenswrapper[8993]: I1204 11:40:29.853415 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:40:29.855297 master-0 kubenswrapper[8993]: I1204 11:40:29.855257 8993 scope.go:117] "RemoveContainer" containerID="8c8f5ab95655b4b56cfeec6bbc9fe176ccf7048325a2476ad9f982e855b05fb0" Dec 04 11:40:29.855435 master-0 kubenswrapper[8993]: I1204 11:40:29.855370 8993 scope.go:117] "RemoveContainer" containerID="b6e0393f35b37b796e29e063a198964a882daa0edec21adc6f195e441be69db7" Dec 04 11:40:29.857945 master-0 kubenswrapper[8993]: I1204 11:40:29.857907 8993 scope.go:117] "RemoveContainer" containerID="dc75d44b8be7e058788b5cd96125d7bea4962e131339dd256a97c23ba994b1b7" Dec 04 11:40:29.859296 master-0 kubenswrapper[8993]: I1204 11:40:29.858515 8993 scope.go:117] "RemoveContainer" containerID="c2365e3e1212552c67b403c1062c118ea5e3306eac11c30d2c954d48de545647" Dec 04 11:40:29.859296 master-0 kubenswrapper[8993]: I1204 11:40:29.858602 8993 scope.go:117] "RemoveContainer" containerID="38994ab2ae9659964fed86de7d58ee76405c493bf0a90b3260a8bc5301b5819a" Dec 04 11:40:29.860073 master-0 kubenswrapper[8993]: I1204 11:40:29.860015 8993 scope.go:117] "RemoveContainer" containerID="125cdcb9380437c2c74e709578e049126370c6c2e8787828f7e5e31c2a5f5cbe" Dec 04 11:40:29.860552 master-0 kubenswrapper[8993]: I1204 11:40:29.860515 8993 scope.go:117] "RemoveContainer" containerID="8543749f8386d25fbc9d05c27b7ab7559de13cecd2f9d2e22a588c804bace527" Dec 04 11:40:29.862144 master-0 kubenswrapper[8993]: I1204 11:40:29.861699 8993 scope.go:117] "RemoveContainer" containerID="68cefdb59268cb33333146cf2f74e7763f9033ac08d79970d8869684b7700cf2" Dec 04 11:40:29.862144 master-0 kubenswrapper[8993]: I1204 11:40:29.861889 8993 scope.go:117] "RemoveContainer" containerID="e0e04ce110c25a2c4a312ed2fdb876c28e02526d17e1277179eb5a2f7c3254e0" Dec 04 11:40:29.862440 master-0 kubenswrapper[8993]: E1204 11:40:29.862223 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-controller-manager pod=bootstrap-kube-controller-manager-master-0_kube-system(8b47694fcc32464ab24d09c23d6efb57)\"" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" Dec 04 11:40:29.862440 master-0 kubenswrapper[8993]: I1204 11:40:29.862396 8993 scope.go:117] "RemoveContainer" containerID="9b4ba98e62019491fc3009d22881e8502c26c25aed860943c3e8a4e83ac5e2e1" Dec 04 11:40:29.870834 master-0 kubenswrapper[8993]: I1204 11:40:29.870752 8993 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0-master-0" podUID="" Dec 04 11:40:30.830845 master-0 kubenswrapper[8993]: I1204 11:40:30.830730 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/0.log" Dec 04 11:40:30.834864 master-0 kubenswrapper[8993]: I1204 11:40:30.834827 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-node-identity_network-node-identity-f8hvq_7203ec93-6572-4032-825c-140029a86058/approver/0.log" Dec 04 11:40:30.843730 master-0 kubenswrapper[8993]: I1204 11:40:30.843691 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_network-operator-79767b7ff9-5bgzx_ffaf95be-586c-40fa-b15f-1beaffe7ff1c/network-operator/0.log" Dec 04 11:40:32.670654 master-0 kubenswrapper[8993]: E1204 11:40:32.670494 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="1.6s" Dec 04 11:40:33.224940 master-0 kubenswrapper[8993]: E1204 11:40:33.224688 8993 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{cluster-baremetal-operator-78f758c7b9-zgkh5.187e0035882a9595 openshift-machine-api 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-api,Name:cluster-baremetal-operator-78f758c7b9-zgkh5,UID:7e3160a9-11d1-4845-ba30-1a49ae7339a9,APIVersion:v1,ResourceVersion:8419,FieldPath:spec.containers{cluster-baremetal-operator},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a92c310ce30dcb3de85d6aac868e0d80919670fa29ef83d55edd96b0cae35563\" in 10.381s (10.381s including waiting). Image size: 465285478 bytes.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:38:53.893571989 +0000 UTC m=+68.284513422,LastTimestamp:2025-12-04 11:38:53.893571989 +0000 UTC m=+68.284513422,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:40:37.898263 master-0 kubenswrapper[8993]: I1204 11:40:37.898152 8993 generic.go:334] "Generic (PLEG): container finished" podID="fd4c4c6f-380a-4cda-9a21-352b55ec2d98" containerID="efdaa968c7f62ed279952ab0bc764a0bd7b1fa6435a03cf5affa209a48cd298e" exitCode=0 Dec 04 11:40:38.837014 master-0 kubenswrapper[8993]: E1204 11:40:38.836747 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:40:28Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:40:28Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:40:28Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:40:28Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3e65409fc2b27ad0aaeb500a39e264663d2980821f099b830b551785ce4ce8b\\\"],\\\"sizeBytes\\\":1631758507},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:2efbb545a141552851226bea008b13d92cbb084339bcfd6923b38d23c382145e\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:e5c3ad640f9c0c84490a0e0da7a1850b7873867936a5b604c07a8075c3a710d0\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1610175307},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9014f384de5f9a0b7418d5869ad349abb9588d16bd09ed650a163c045315dbff\\\"],\\\"sizeBytes\\\":1232140918},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:98141b7d0b74195f511ccd4c41ba6c8a69fef01f22b2fb8ef2d024109e93a3a9\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:bd4a56267fe7d489c5a0705c4b9f5c43170dd39b6684e2497a49c5416ae6e14f\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1205106509},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:9eadf94ba5e517edf53c9b21d83f18cb3790ddc768f10d0ca92be97c56a0eecb\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:e096abcd79df184b3151d2fe670d52596bae8c1f2d1fa8851c41821afe1ba59e\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1201434959},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:e8990432556acad31519b1a73ec32f32d27c2034cf9e5cc4db8980efc7331594\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:ebe9f523f5c211a3a0f2570331dddcd5be15b12c1fecd9b8b121f881bfaad029\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.18\\\"],\\\"sizeBytes\\\":1129027903},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b472823604757237c2d16bd6f6221f4cf562aa3b05942c7f602e1e8b2e55a7c6\\\"],\\\"sizeBytes\\\":983705650},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d5891cdd7dcf7c9081de8b364b4c96446b7f946f7880fbae291a4592a198264\\\"],\\\"sizeBytes\\\":938303566},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:01d2e67fd74086da701c39dac5b821822351cb0151f9afe72821c05df19953ad\\\"],\\\"sizeBytes\\\":912722556},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:61664aa69b33349cc6de45e44ae6033e7f483c034ea01c0d9a8ca08a12d88e3a\\\"],\\\"sizeBytes\\\":874825223},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:631a3798b749fecc041a99929eb946618df723e15055e805ff752a1a1273481c\\\"],\\\"sizeBytes\\\":870567329},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1ca78c423f43f89a0411e40393642f64e4f8df9e5f61c25e31047c4cce170f9\\\"],\\\"sizeBytes\\\":857069957},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b12f830c3316aa4dc061c2d00c74126282b3e2bcccc301eab00d57fff3c4c7c\\\"],\\\"sizeBytes\\\":767284906},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cb3ec61f9a932a9ad13bdeb44bcf9477a8d5f728151d7f19ed3ef7d4b02b3a82\\\"],\\\"sizeBytes\\\":682371258},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:916566bb9d0143352324233d460ad94697719c11c8c9158e3aea8f475941751f\\\"],\\\"sizeBytes\\\":677523572},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5451aa441e5b8d8689c032405d410c8049a849ef2edf77e5b6a5ce2838c6569b\\\"],\\\"sizeBytes\\\":672407260},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9724d2036305cbd729e1f484c5bad89971de977fff8a6723fef1873858dd1123\\\"],\\\"sizeBytes\\\":616108962},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:df606f3b71d4376d1a2108c09f0d3dab455fc30bcb67c60e91590c105e9025bf\\\"],\\\"sizeBytes\\\":583836304},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79f99fd6cce984287932edf0d009660bb488d663081f3d62ec3b23bc8bfbf6c2\\\"],\\\"sizeBytes\\\":576619763},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eddedae7578d79b5a3f748000ae5c00b9f14a04710f9f9ec7b52fc569be5dfb8\\\"],\\\"sizeBytes\\\":552673986},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dd38b8be3af889b0f97e2df41517c89a11260901432a9a1ee943195bb3a22737\\\"],\\\"sizeBytes\\\":551889548},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:aa24edce3d740f84c40018e94cdbf2bc7375268d13d57c2d664e43a46ccea3fc\\\"],\\\"sizeBytes\\\":543227406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:188637a52cafee61ec461e92fb0c605e28be325b9ac1f2ac8a37d68e97654718\\\"],\\\"sizeBytes\\\":532719167},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde59e48cd5dee3721f34d249cb119cc3259fd857965d34f9c7ed83b0c363a1\\\"],\\\"sizeBytes\\\":532402162},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f4d4282cb53325e737ad68abbfcb70687ae04fb50353f4f0ba0ba5703b15009a\\\"],\\\"sizeBytes\\\":512838054},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-release@sha256:8c885ea0b3c5124989f0a9b93eba98eb9fca6bbd0262772d85d90bf713a4d572\\\"],\\\"sizeBytes\\\":512452153},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0f43c31aa3359159d4557dad3cfaf812d8ce44db9cb9ae970e06d3479070b660\\\"],\\\"sizeBytes\\\":509437356},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:97d26892192b552c16527bf2771e1b86528ab581a02dd9279cdf71c194830e3e\\\"],\\\"sizeBytes\\\":508042119},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e85850a4ae1a1e3ec2c590a4936d640882b6550124da22031c85b526afbf52df\\\"],\\\"sizeBytes\\\":507687221},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8375671da86aa527ee7e291d86971b0baa823ffc7663b5a983084456e76c0f59\\\"],\\\"sizeBytes\\\":506741476},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:831f30660844091d6154e2674d3a9da6f34271bf8a2c40b56f7416066318742b\\\"],\\\"sizeBytes\\\":505649178},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:86af77350cfe6fd69280157e4162aa0147873d9431c641ae4ad3e881ff768a73\\\"],\\\"sizeBytes\\\":505628211},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a824e468cf8dd61d347e35b2ee5bc2f815666957647098e21a1bb56ff613e5b9\\\"],\\\"sizeBytes\\\":503340749},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8139ed65c0a0a4b0f253b715c11cc52be027efe8a4774da9ccce35c78ef439da\\\"],\\\"sizeBytes\\\":503011144},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8eabac819f289e29d75c7ab172d8124554849a47f0b00770928c3eb19a5a31c4\\\"],\\\"sizeBytes\\\":502436444},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:10e57ca7611f79710f05777dc6a8f31c7e04eb09da4d8d793a5acfbf0e4692d7\\\"],\\\"sizeBytes\\\":500943492},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f042fa25014f3d37f3ea967d21f361d2a11833ae18f2c750318101b25d2497ce\\\"],\\\"sizeBytes\\\":500848684},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91af633e585621630c40d14f188e37d36b44678d0a59e582d850bf8d593d3a0c\\\"],\\\"sizeBytes\\\":499798563},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d64c13fe7663a0b4ae61d103b1b7598adcf317a01826f296bcb66b1a2de83c96\\\"],\\\"sizeBytes\\\":499705918},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:33a20002692769235e95271ab071783c57ff50681088fa1035b86af31e73cf20\\\"],\\\"sizeBytes\\\":499125567},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:75d996f6147edb88c09fd1a052099de66638590d7d03a735006244bc9e19f898\\\"],\\\"sizeBytes\\\":499082775},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3b8d91a25eeb9f02041e947adb3487da3e7ab8449d3d2ad015827e7954df7b34\\\"],\\\"sizeBytes\\\":490455952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1f952cec1e5332b84bdffa249cd426f39087058d6544ddcec650a414c15a9b68\\\"],\\\"sizeBytes\\\":489528665},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c416b201d480bddb5a4960ec42f4740761a1335001cf84ba5ae19ad6857771b1\\\"],\\\"sizeBytes\\\":481559117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c3a77aa4d03b89ea284e3467a268e5989a77a2ef63e685eb1d5c5ea5b3922b7a\\\"],\\\"sizeBytes\\\":478917802},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eb928c13a46d3fb45f4a881892d023a92d610a5430be0ffd916aaf8da8e7d297\\\"],\\\"sizeBytes\\\":478642572},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a92c310ce30dcb3de85d6aac868e0d80919670fa29ef83d55edd96b0cae35563\\\"],\\\"sizeBytes\\\":465285478},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fd3e9f8f00a59bda7483ec7dc8a0ed602f9ca30e3d72b22072dbdf2819da3f61\\\"],\\\"sizeBytes\\\":465144618},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3c1edf52f70bf9b1d1457e0c4111bc79cdaa1edd659ddbdb9d8176eff8b46956\\\"],\\\"sizeBytes\\\":462727837},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8cc27777e72233024fe84ee1faa168aec715a0b24912a3ce70715ddccba328df\\\"],\\\"sizeBytes\\\":461702648}]}}\" for node \"master-0\": Patch \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0/status?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:40:38.863636 master-0 kubenswrapper[8993]: I1204 11:40:38.863553 8993 patch_prober.go:28] interesting pod/marketplace-operator-f797b99b6-hjjrk container/marketplace-operator namespace/openshift-marketplace: Liveness probe status=failure output="Get \"http://10.128.0.14:8080/healthz\": dial tcp 10.128.0.14:8080: connect: connection refused" start-of-body= Dec 04 11:40:38.864009 master-0 kubenswrapper[8993]: I1204 11:40:38.863663 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" podUID="fd4c4c6f-380a-4cda-9a21-352b55ec2d98" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.128.0.14:8080/healthz\": dial tcp 10.128.0.14:8080: connect: connection refused" Dec 04 11:40:38.864074 master-0 kubenswrapper[8993]: I1204 11:40:38.864012 8993 patch_prober.go:28] interesting pod/marketplace-operator-f797b99b6-hjjrk container/marketplace-operator namespace/openshift-marketplace: Readiness probe status=failure output="Get \"http://10.128.0.14:8080/healthz\": dial tcp 10.128.0.14:8080: connect: connection refused" start-of-body= Dec 04 11:40:38.864219 master-0 kubenswrapper[8993]: I1204 11:40:38.864145 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" podUID="fd4c4c6f-380a-4cda-9a21-352b55ec2d98" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.128.0.14:8080/healthz\": dial tcp 10.128.0.14:8080: connect: connection refused" Dec 04 11:40:44.272196 master-0 kubenswrapper[8993]: E1204 11:40:44.271962 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="3.2s" Dec 04 11:40:48.837391 master-0 kubenswrapper[8993]: E1204 11:40:48.837259 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:40:48.863046 master-0 kubenswrapper[8993]: I1204 11:40:48.862923 8993 patch_prober.go:28] interesting pod/marketplace-operator-f797b99b6-hjjrk container/marketplace-operator namespace/openshift-marketplace: Readiness probe status=failure output="Get \"http://10.128.0.14:8080/healthz\": dial tcp 10.128.0.14:8080: connect: connection refused" start-of-body= Dec 04 11:40:48.863046 master-0 kubenswrapper[8993]: I1204 11:40:48.862924 8993 patch_prober.go:28] interesting pod/marketplace-operator-f797b99b6-hjjrk container/marketplace-operator namespace/openshift-marketplace: Liveness probe status=failure output="Get \"http://10.128.0.14:8080/healthz\": dial tcp 10.128.0.14:8080: connect: connection refused" start-of-body= Dec 04 11:40:48.863046 master-0 kubenswrapper[8993]: I1204 11:40:48.863025 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" podUID="fd4c4c6f-380a-4cda-9a21-352b55ec2d98" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.128.0.14:8080/healthz\": dial tcp 10.128.0.14:8080: connect: connection refused" Dec 04 11:40:48.863411 master-0 kubenswrapper[8993]: I1204 11:40:48.863110 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" podUID="fd4c4c6f-380a-4cda-9a21-352b55ec2d98" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.128.0.14:8080/healthz\": dial tcp 10.128.0.14:8080: connect: connection refused" Dec 04 11:40:52.037599 master-0 kubenswrapper[8993]: I1204 11:40:52.037494 8993 status_manager.go:851] "Failed to get status for pod" podUID="c835660f-5a79-4679-b9be-8543ca6ef5a1" pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" err="the server was unable to return a response in the time allotted, but may still be processing the request (get pods machine-approver-f797d8546-qvgbq)" Dec 04 11:40:52.996346 master-0 kubenswrapper[8993]: I1204 11:40:52.996149 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_cluster-storage-operator-dcf7fc84b-fncfd_f797ab14-0eb5-48b4-b914-f434f67c4c49/cluster-storage-operator/0.log" Dec 04 11:40:52.996346 master-0 kubenswrapper[8993]: I1204 11:40:52.996239 8993 generic.go:334] "Generic (PLEG): container finished" podID="f797ab14-0eb5-48b4-b914-f434f67c4c49" containerID="560ba30f370ec40b8f7156e79883f77ace5f0c511592152f47a88a654d161d5b" exitCode=255 Dec 04 11:40:52.999310 master-0 kubenswrapper[8993]: I1204 11:40:52.999241 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-6c8676f99d-7z948_3322cc5a-f1f7-4522-b423-19fb7f38cd43/openshift-controller-manager-operator/1.log" Dec 04 11:40:53.000580 master-0 kubenswrapper[8993]: I1204 11:40:53.000466 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-6c8676f99d-7z948_3322cc5a-f1f7-4522-b423-19fb7f38cd43/openshift-controller-manager-operator/0.log" Dec 04 11:40:53.000737 master-0 kubenswrapper[8993]: I1204 11:40:53.000601 8993 generic.go:334] "Generic (PLEG): container finished" podID="3322cc5a-f1f7-4522-b423-19fb7f38cd43" containerID="4efa514695b682bb2d4ad336643391490d8d1ea01e30ed9629a1ef982abb6433" exitCode=255 Dec 04 11:40:57.473608 master-0 kubenswrapper[8993]: E1204 11:40:57.473464 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="6.4s" Dec 04 11:40:58.032307 master-0 kubenswrapper[8993]: I1204 11:40:58.032174 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/0.log" Dec 04 11:40:58.032307 master-0 kubenswrapper[8993]: I1204 11:40:58.032288 8993 generic.go:334] "Generic (PLEG): container finished" podID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" containerID="8024196dc7d7114b2537f80438f2f5ad83a892cee7caa5f4d34fca2b46d86f82" exitCode=1 Dec 04 11:40:58.837733 master-0 kubenswrapper[8993]: E1204 11:40:58.837635 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:40:58.862919 master-0 kubenswrapper[8993]: I1204 11:40:58.862791 8993 patch_prober.go:28] interesting pod/marketplace-operator-f797b99b6-hjjrk container/marketplace-operator namespace/openshift-marketplace: Liveness probe status=failure output="Get \"http://10.128.0.14:8080/healthz\": dial tcp 10.128.0.14:8080: connect: connection refused" start-of-body= Dec 04 11:40:58.863207 master-0 kubenswrapper[8993]: I1204 11:40:58.862950 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" podUID="fd4c4c6f-380a-4cda-9a21-352b55ec2d98" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.128.0.14:8080/healthz\": dial tcp 10.128.0.14:8080: connect: connection refused" Dec 04 11:40:58.863207 master-0 kubenswrapper[8993]: I1204 11:40:58.862795 8993 patch_prober.go:28] interesting pod/marketplace-operator-f797b99b6-hjjrk container/marketplace-operator namespace/openshift-marketplace: Readiness probe status=failure output="Get \"http://10.128.0.14:8080/healthz\": dial tcp 10.128.0.14:8080: connect: connection refused" start-of-body= Dec 04 11:40:58.863207 master-0 kubenswrapper[8993]: I1204 11:40:58.863115 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" podUID="fd4c4c6f-380a-4cda-9a21-352b55ec2d98" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.128.0.14:8080/healthz\": dial tcp 10.128.0.14:8080: connect: connection refused" Dec 04 11:41:00.368076 master-0 kubenswrapper[8993]: E1204 11:41:00.368009 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:41:00.368076 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(af14fe68c8083f31be169d50a9e29c2a4846a7a7df4592fdfda1587a1b3dc88a): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"af14fe68c8083f31be169d50a9e29c2a4846a7a7df4592fdfda1587a1b3dc88a" Netns:"/var/run/netns/d8d0e1e9-6bc3-435a-b27b-ff4ea6b4043d" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=af14fe68c8083f31be169d50a9e29c2a4846a7a7df4592fdfda1587a1b3dc88a;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378" Path:"" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:41:00.368076 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:00.368076 master-0 kubenswrapper[8993]: > Dec 04 11:41:00.368560 master-0 kubenswrapper[8993]: E1204 11:41:00.368113 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:41:00.368560 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(af14fe68c8083f31be169d50a9e29c2a4846a7a7df4592fdfda1587a1b3dc88a): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"af14fe68c8083f31be169d50a9e29c2a4846a7a7df4592fdfda1587a1b3dc88a" Netns:"/var/run/netns/d8d0e1e9-6bc3-435a-b27b-ff4ea6b4043d" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=af14fe68c8083f31be169d50a9e29c2a4846a7a7df4592fdfda1587a1b3dc88a;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378" Path:"" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:41:00.368560 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:00.368560 master-0 kubenswrapper[8993]: > pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:41:00.368560 master-0 kubenswrapper[8993]: E1204 11:41:00.368144 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:41:00.368560 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(af14fe68c8083f31be169d50a9e29c2a4846a7a7df4592fdfda1587a1b3dc88a): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"af14fe68c8083f31be169d50a9e29c2a4846a7a7df4592fdfda1587a1b3dc88a" Netns:"/var/run/netns/d8d0e1e9-6bc3-435a-b27b-ff4ea6b4043d" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=af14fe68c8083f31be169d50a9e29c2a4846a7a7df4592fdfda1587a1b3dc88a;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378" Path:"" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:41:00.368560 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:00.368560 master-0 kubenswrapper[8993]: > pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:41:00.368560 master-0 kubenswrapper[8993]: E1204 11:41:00.368231 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"machine-api-operator-88d48b57d-9fjtd_openshift-machine-api(c50317d3-f7cd-4133-845e-44add57ac378)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"machine-api-operator-88d48b57d-9fjtd_openshift-machine-api(c50317d3-f7cd-4133-845e-44add57ac378)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(af14fe68c8083f31be169d50a9e29c2a4846a7a7df4592fdfda1587a1b3dc88a): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"af14fe68c8083f31be169d50a9e29c2a4846a7a7df4592fdfda1587a1b3dc88a\\\" Netns:\\\"/var/run/netns/d8d0e1e9-6bc3-435a-b27b-ff4ea6b4043d\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=af14fe68c8083f31be169d50a9e29c2a4846a7a7df4592fdfda1587a1b3dc88a;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" podUID="c50317d3-f7cd-4133-845e-44add57ac378" Dec 04 11:41:01.064924 master-0 kubenswrapper[8993]: I1204 11:41:01.064862 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-controller_operator-controller-controller-manager-7cbd59c7f8-qcz9t_1897bad8-3875-4bd6-b877-b1abe1fe76c7/manager/0.log" Dec 04 11:41:01.064924 master-0 kubenswrapper[8993]: I1204 11:41:01.064921 8993 generic.go:334] "Generic (PLEG): container finished" podID="1897bad8-3875-4bd6-b877-b1abe1fe76c7" containerID="9c2fc9403fab0d35870e3bc56e7a58963be646e5a41f7dc3511733d940fb3a34" exitCode=1 Dec 04 11:41:01.067641 master-0 kubenswrapper[8993]: I1204 11:41:01.067597 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-catalogd_catalogd-controller-manager-7cc89f4c4c-fd9pv_ee9a47b1-cdd9-43bc-8115-8851f29106e6/manager/0.log" Dec 04 11:41:01.068106 master-0 kubenswrapper[8993]: I1204 11:41:01.068063 8993 generic.go:334] "Generic (PLEG): container finished" podID="ee9a47b1-cdd9-43bc-8115-8851f29106e6" containerID="72abc724ed2d61f11cccbb7ec6d373328f957dd321cb6fd0e7f3d01b800d6a97" exitCode=1 Dec 04 11:41:01.068184 master-0 kubenswrapper[8993]: I1204 11:41:01.068166 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:41:01.068689 master-0 kubenswrapper[8993]: I1204 11:41:01.068662 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:41:03.874590 master-0 kubenswrapper[8993]: E1204 11:41:03.874506 8993 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:41:03.875940 master-0 kubenswrapper[8993]: E1204 11:41:03.874867 8993 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="34.021s" Dec 04 11:41:03.875940 master-0 kubenswrapper[8993]: I1204 11:41:03.874938 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:41:03.875940 master-0 kubenswrapper[8993]: I1204 11:41:03.875673 8993 scope.go:117] "RemoveContainer" containerID="efdaa968c7f62ed279952ab0bc764a0bd7b1fa6435a03cf5affa209a48cd298e" Dec 04 11:41:03.882519 master-0 kubenswrapper[8993]: I1204 11:41:03.882458 8993 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0-master-0" podUID="" Dec 04 11:41:07.228485 master-0 kubenswrapper[8993]: E1204 11:41:07.228223 8993 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{bootstrap-kube-controller-manager-master-0.187e003970800f6f kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-controller-manager-master-0,UID:8b47694fcc32464ab24d09c23d6efb57,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d5891cdd7dcf7c9081de8b364b4c96446b7f946f7880fbae291a4592a198264\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:39:10.676389743 +0000 UTC m=+85.067331196,LastTimestamp:2025-12-04 11:39:10.676389743 +0000 UTC m=+85.067331196,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:41:08.838214 master-0 kubenswrapper[8993]: E1204 11:41:08.838073 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:41:09.002586 master-0 kubenswrapper[8993]: I1204 11:41:09.002476 8993 patch_prober.go:28] interesting pod/catalogd-controller-manager-7cc89f4c4c-fd9pv container/manager namespace/openshift-catalogd: Readiness probe status=failure output="Get \"http://10.128.0.40:8081/readyz\": dial tcp 10.128.0.40:8081: connect: connection refused" start-of-body= Dec 04 11:41:09.002586 master-0 kubenswrapper[8993]: I1204 11:41:09.002570 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" podUID="ee9a47b1-cdd9-43bc-8115-8851f29106e6" containerName="manager" probeResult="failure" output="Get \"http://10.128.0.40:8081/readyz\": dial tcp 10.128.0.40:8081: connect: connection refused" Dec 04 11:41:09.448993 master-0 kubenswrapper[8993]: I1204 11:41:09.448851 8993 patch_prober.go:28] interesting pod/operator-controller-controller-manager-7cbd59c7f8-qcz9t container/manager namespace/openshift-operator-controller: Readiness probe status=failure output="Get \"http://10.128.0.41:8081/readyz\": dial tcp 10.128.0.41:8081: connect: connection refused" start-of-body= Dec 04 11:41:09.449566 master-0 kubenswrapper[8993]: I1204 11:41:09.448978 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" podUID="1897bad8-3875-4bd6-b877-b1abe1fe76c7" containerName="manager" probeResult="failure" output="Get \"http://10.128.0.41:8081/readyz\": dial tcp 10.128.0.41:8081: connect: connection refused" Dec 04 11:41:13.875043 master-0 kubenswrapper[8993]: E1204 11:41:13.874919 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 11:41:14.170185 master-0 kubenswrapper[8993]: I1204 11:41:14.170012 8993 generic.go:334] "Generic (PLEG): container finished" podID="287fba2d-f56d-4ec0-b796-7849a68fb411" containerID="a98c972089f945f20cf6cc807089551b4b9f89664b6a5a78412dd79091e473a5" exitCode=0 Dec 04 11:41:18.839051 master-0 kubenswrapper[8993]: E1204 11:41:18.838938 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:41:18.839763 master-0 kubenswrapper[8993]: E1204 11:41:18.839747 8993 kubelet_node_status.go:572] "Unable to update node status" err="update node status exceeds retry count" Dec 04 11:41:19.002540 master-0 kubenswrapper[8993]: I1204 11:41:19.002378 8993 patch_prober.go:28] interesting pod/catalogd-controller-manager-7cc89f4c4c-fd9pv container/manager namespace/openshift-catalogd: Liveness probe status=failure output="Get \"http://10.128.0.40:8081/healthz\": dial tcp 10.128.0.40:8081: connect: connection refused" start-of-body= Dec 04 11:41:19.002540 master-0 kubenswrapper[8993]: I1204 11:41:19.002525 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" podUID="ee9a47b1-cdd9-43bc-8115-8851f29106e6" containerName="manager" probeResult="failure" output="Get \"http://10.128.0.40:8081/healthz\": dial tcp 10.128.0.40:8081: connect: connection refused" Dec 04 11:41:19.003043 master-0 kubenswrapper[8993]: I1204 11:41:19.002401 8993 patch_prober.go:28] interesting pod/catalogd-controller-manager-7cc89f4c4c-fd9pv container/manager namespace/openshift-catalogd: Readiness probe status=failure output="Get \"http://10.128.0.40:8081/readyz\": dial tcp 10.128.0.40:8081: connect: connection refused" start-of-body= Dec 04 11:41:19.003043 master-0 kubenswrapper[8993]: I1204 11:41:19.002609 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" podUID="ee9a47b1-cdd9-43bc-8115-8851f29106e6" containerName="manager" probeResult="failure" output="Get \"http://10.128.0.40:8081/readyz\": dial tcp 10.128.0.40:8081: connect: connection refused" Dec 04 11:41:19.448038 master-0 kubenswrapper[8993]: I1204 11:41:19.447945 8993 patch_prober.go:28] interesting pod/operator-controller-controller-manager-7cbd59c7f8-qcz9t container/manager namespace/openshift-operator-controller: Readiness probe status=failure output="Get \"http://10.128.0.41:8081/readyz\": dial tcp 10.128.0.41:8081: connect: connection refused" start-of-body= Dec 04 11:41:19.448534 master-0 kubenswrapper[8993]: I1204 11:41:19.448034 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" podUID="1897bad8-3875-4bd6-b877-b1abe1fe76c7" containerName="manager" probeResult="failure" output="Get \"http://10.128.0.41:8081/readyz\": dial tcp 10.128.0.41:8081: connect: connection refused" Dec 04 11:41:19.448534 master-0 kubenswrapper[8993]: I1204 11:41:19.448124 8993 patch_prober.go:28] interesting pod/operator-controller-controller-manager-7cbd59c7f8-qcz9t container/manager namespace/openshift-operator-controller: Liveness probe status=failure output="Get \"http://10.128.0.41:8081/healthz\": dial tcp 10.128.0.41:8081: connect: connection refused" start-of-body= Dec 04 11:41:19.448534 master-0 kubenswrapper[8993]: I1204 11:41:19.448255 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" podUID="1897bad8-3875-4bd6-b877-b1abe1fe76c7" containerName="manager" probeResult="failure" output="Get \"http://10.128.0.41:8081/healthz\": dial tcp 10.128.0.41:8081: connect: connection refused" Dec 04 11:41:21.568711 master-0 kubenswrapper[8993]: I1204 11:41:21.568661 8993 scope.go:117] "RemoveContainer" containerID="2486b68bc3517ab1664fcb1823dbcafa72bb90a8386d8e6780a8a95866e68263" Dec 04 11:41:21.588258 master-0 kubenswrapper[8993]: I1204 11:41:21.588202 8993 scope.go:117] "RemoveContainer" containerID="4ed3912e9d934219e324f1b3be9ecb2f87f15e4be5f71ebe6a2e74f6f7ff9948" Dec 04 11:41:23.617138 master-0 kubenswrapper[8993]: E1204 11:41:23.617040 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:41:23.617138 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_38e7be62-e4f5-42ba-89f0-83aca874a092_0(acf5a98f600bd6c83a28743f2310f72c5e66e0b63da427c52d49a771c7352c34): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"acf5a98f600bd6c83a28743f2310f72c5e66e0b63da427c52d49a771c7352c34" Netns:"/var/run/netns/05576a5b-072e-4965-beb5-cc6ad5a5f495" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=acf5a98f600bd6c83a28743f2310f72c5e66e0b63da427c52d49a771c7352c34;K8S_POD_UID=38e7be62-e4f5-42ba-89f0-83aca874a092" Path:"" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/38e7be62-e4f5-42ba-89f0-83aca874a092]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:41:23.617138 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:23.617138 master-0 kubenswrapper[8993]: > Dec 04 11:41:23.617772 master-0 kubenswrapper[8993]: E1204 11:41:23.617154 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:41:23.617772 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_38e7be62-e4f5-42ba-89f0-83aca874a092_0(acf5a98f600bd6c83a28743f2310f72c5e66e0b63da427c52d49a771c7352c34): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"acf5a98f600bd6c83a28743f2310f72c5e66e0b63da427c52d49a771c7352c34" Netns:"/var/run/netns/05576a5b-072e-4965-beb5-cc6ad5a5f495" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=acf5a98f600bd6c83a28743f2310f72c5e66e0b63da427c52d49a771c7352c34;K8S_POD_UID=38e7be62-e4f5-42ba-89f0-83aca874a092" Path:"" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/38e7be62-e4f5-42ba-89f0-83aca874a092]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:41:23.617772 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:23.617772 master-0 kubenswrapper[8993]: > pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:41:23.617772 master-0 kubenswrapper[8993]: E1204 11:41:23.617183 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:41:23.617772 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_38e7be62-e4f5-42ba-89f0-83aca874a092_0(acf5a98f600bd6c83a28743f2310f72c5e66e0b63da427c52d49a771c7352c34): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"acf5a98f600bd6c83a28743f2310f72c5e66e0b63da427c52d49a771c7352c34" Netns:"/var/run/netns/05576a5b-072e-4965-beb5-cc6ad5a5f495" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=acf5a98f600bd6c83a28743f2310f72c5e66e0b63da427c52d49a771c7352c34;K8S_POD_UID=38e7be62-e4f5-42ba-89f0-83aca874a092" Path:"" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/38e7be62-e4f5-42ba-89f0-83aca874a092]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:41:23.617772 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:23.617772 master-0 kubenswrapper[8993]: > pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:41:23.617772 master-0 kubenswrapper[8993]: E1204 11:41:23.617280 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"installer-2-master-0_openshift-kube-controller-manager(38e7be62-e4f5-42ba-89f0-83aca874a092)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"installer-2-master-0_openshift-kube-controller-manager(38e7be62-e4f5-42ba-89f0-83aca874a092)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_38e7be62-e4f5-42ba-89f0-83aca874a092_0(acf5a98f600bd6c83a28743f2310f72c5e66e0b63da427c52d49a771c7352c34): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"acf5a98f600bd6c83a28743f2310f72c5e66e0b63da427c52d49a771c7352c34\\\" Netns:\\\"/var/run/netns/05576a5b-072e-4965-beb5-cc6ad5a5f495\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=acf5a98f600bd6c83a28743f2310f72c5e66e0b63da427c52d49a771c7352c34;K8S_POD_UID=38e7be62-e4f5-42ba-89f0-83aca874a092\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/38e7be62-e4f5-42ba-89f0-83aca874a092]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-kube-controller-manager/installer-2-master-0" podUID="38e7be62-e4f5-42ba-89f0-83aca874a092" Dec 04 11:41:23.734384 master-0 kubenswrapper[8993]: E1204 11:41:23.734308 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:41:23.734384 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager_e4d7939a-5961-4608-b910-73e71aa55bf6_0(aea5fc223c451dccb2eb2f140edba281c9bae377ca308d1bba7b28f3cd4f529d): error adding pod openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"aea5fc223c451dccb2eb2f140edba281c9bae377ca308d1bba7b28f3cd4f529d" Netns:"/var/run/netns/13e2d887-db77-4ff8-8664-99e6741ac5b6" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-route-controller-manager;K8S_POD_NAME=route-controller-manager-95cb5f987-46bsk;K8S_POD_INFRA_CONTAINER_ID=aea5fc223c451dccb2eb2f140edba281c9bae377ca308d1bba7b28f3cd4f529d;K8S_POD_UID=e4d7939a-5961-4608-b910-73e71aa55bf6" Path:"" ERRORED: error configuring pod [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk] networking: Multus: [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk/e4d7939a-5961-4608-b910-73e71aa55bf6]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: SetNetworkStatus: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:41:23.734384 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:23.734384 master-0 kubenswrapper[8993]: > Dec 04 11:41:23.734579 master-0 kubenswrapper[8993]: E1204 11:41:23.734412 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:41:23.734579 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager_e4d7939a-5961-4608-b910-73e71aa55bf6_0(aea5fc223c451dccb2eb2f140edba281c9bae377ca308d1bba7b28f3cd4f529d): error adding pod openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"aea5fc223c451dccb2eb2f140edba281c9bae377ca308d1bba7b28f3cd4f529d" Netns:"/var/run/netns/13e2d887-db77-4ff8-8664-99e6741ac5b6" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-route-controller-manager;K8S_POD_NAME=route-controller-manager-95cb5f987-46bsk;K8S_POD_INFRA_CONTAINER_ID=aea5fc223c451dccb2eb2f140edba281c9bae377ca308d1bba7b28f3cd4f529d;K8S_POD_UID=e4d7939a-5961-4608-b910-73e71aa55bf6" Path:"" ERRORED: error configuring pod [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk] networking: Multus: [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk/e4d7939a-5961-4608-b910-73e71aa55bf6]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: SetNetworkStatus: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:41:23.734579 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:23.734579 master-0 kubenswrapper[8993]: > pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:41:23.734579 master-0 kubenswrapper[8993]: E1204 11:41:23.734437 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:41:23.734579 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager_e4d7939a-5961-4608-b910-73e71aa55bf6_0(aea5fc223c451dccb2eb2f140edba281c9bae377ca308d1bba7b28f3cd4f529d): error adding pod openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"aea5fc223c451dccb2eb2f140edba281c9bae377ca308d1bba7b28f3cd4f529d" Netns:"/var/run/netns/13e2d887-db77-4ff8-8664-99e6741ac5b6" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-route-controller-manager;K8S_POD_NAME=route-controller-manager-95cb5f987-46bsk;K8S_POD_INFRA_CONTAINER_ID=aea5fc223c451dccb2eb2f140edba281c9bae377ca308d1bba7b28f3cd4f529d;K8S_POD_UID=e4d7939a-5961-4608-b910-73e71aa55bf6" Path:"" ERRORED: error configuring pod [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk] networking: Multus: [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk/e4d7939a-5961-4608-b910-73e71aa55bf6]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: SetNetworkStatus: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:41:23.734579 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:23.734579 master-0 kubenswrapper[8993]: > pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:41:23.734579 master-0 kubenswrapper[8993]: E1204 11:41:23.734517 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager(e4d7939a-5961-4608-b910-73e71aa55bf6)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager(e4d7939a-5961-4608-b910-73e71aa55bf6)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager_e4d7939a-5961-4608-b910-73e71aa55bf6_0(aea5fc223c451dccb2eb2f140edba281c9bae377ca308d1bba7b28f3cd4f529d): error adding pod openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"aea5fc223c451dccb2eb2f140edba281c9bae377ca308d1bba7b28f3cd4f529d\\\" Netns:\\\"/var/run/netns/13e2d887-db77-4ff8-8664-99e6741ac5b6\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-route-controller-manager;K8S_POD_NAME=route-controller-manager-95cb5f987-46bsk;K8S_POD_INFRA_CONTAINER_ID=aea5fc223c451dccb2eb2f140edba281c9bae377ca308d1bba7b28f3cd4f529d;K8S_POD_UID=e4d7939a-5961-4608-b910-73e71aa55bf6\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk] networking: Multus: [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk/e4d7939a-5961-4608-b910-73e71aa55bf6]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: SetNetworkStatus: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" Dec 04 11:41:23.793397 master-0 kubenswrapper[8993]: E1204 11:41:23.793326 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:41:23.793397 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_controller-manager-6686654b8d-rrndk_openshift-controller-manager_24506aa4-ab78-49df-bb58-59093498f13d_0(dd455792c3c0c609a825558a90a6fdaff70c7f5c28eaeed93416f3bf654b7a11): error adding pod openshift-controller-manager_controller-manager-6686654b8d-rrndk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"dd455792c3c0c609a825558a90a6fdaff70c7f5c28eaeed93416f3bf654b7a11" Netns:"/var/run/netns/0314a257-ead8-4ab3-afce-07d51d75d96d" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-controller-manager;K8S_POD_NAME=controller-manager-6686654b8d-rrndk;K8S_POD_INFRA_CONTAINER_ID=dd455792c3c0c609a825558a90a6fdaff70c7f5c28eaeed93416f3bf654b7a11;K8S_POD_UID=24506aa4-ab78-49df-bb58-59093498f13d" Path:"" ERRORED: error configuring pod [openshift-controller-manager/controller-manager-6686654b8d-rrndk] networking: Multus: [openshift-controller-manager/controller-manager-6686654b8d-rrndk/24506aa4-ab78-49df-bb58-59093498f13d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: SetNetworkStatus: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-controller-manager/pods/controller-manager-6686654b8d-rrndk?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:41:23.793397 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:23.793397 master-0 kubenswrapper[8993]: > Dec 04 11:41:23.793632 master-0 kubenswrapper[8993]: E1204 11:41:23.793426 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:41:23.793632 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_controller-manager-6686654b8d-rrndk_openshift-controller-manager_24506aa4-ab78-49df-bb58-59093498f13d_0(dd455792c3c0c609a825558a90a6fdaff70c7f5c28eaeed93416f3bf654b7a11): error adding pod openshift-controller-manager_controller-manager-6686654b8d-rrndk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"dd455792c3c0c609a825558a90a6fdaff70c7f5c28eaeed93416f3bf654b7a11" Netns:"/var/run/netns/0314a257-ead8-4ab3-afce-07d51d75d96d" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-controller-manager;K8S_POD_NAME=controller-manager-6686654b8d-rrndk;K8S_POD_INFRA_CONTAINER_ID=dd455792c3c0c609a825558a90a6fdaff70c7f5c28eaeed93416f3bf654b7a11;K8S_POD_UID=24506aa4-ab78-49df-bb58-59093498f13d" Path:"" ERRORED: error configuring pod [openshift-controller-manager/controller-manager-6686654b8d-rrndk] networking: Multus: [openshift-controller-manager/controller-manager-6686654b8d-rrndk/24506aa4-ab78-49df-bb58-59093498f13d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: SetNetworkStatus: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-controller-manager/pods/controller-manager-6686654b8d-rrndk?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:41:23.793632 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:23.793632 master-0 kubenswrapper[8993]: > pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:41:23.793632 master-0 kubenswrapper[8993]: E1204 11:41:23.793452 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:41:23.793632 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_controller-manager-6686654b8d-rrndk_openshift-controller-manager_24506aa4-ab78-49df-bb58-59093498f13d_0(dd455792c3c0c609a825558a90a6fdaff70c7f5c28eaeed93416f3bf654b7a11): error adding pod openshift-controller-manager_controller-manager-6686654b8d-rrndk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"dd455792c3c0c609a825558a90a6fdaff70c7f5c28eaeed93416f3bf654b7a11" Netns:"/var/run/netns/0314a257-ead8-4ab3-afce-07d51d75d96d" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-controller-manager;K8S_POD_NAME=controller-manager-6686654b8d-rrndk;K8S_POD_INFRA_CONTAINER_ID=dd455792c3c0c609a825558a90a6fdaff70c7f5c28eaeed93416f3bf654b7a11;K8S_POD_UID=24506aa4-ab78-49df-bb58-59093498f13d" Path:"" ERRORED: error configuring pod [openshift-controller-manager/controller-manager-6686654b8d-rrndk] networking: Multus: [openshift-controller-manager/controller-manager-6686654b8d-rrndk/24506aa4-ab78-49df-bb58-59093498f13d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: SetNetworkStatus: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-controller-manager/pods/controller-manager-6686654b8d-rrndk?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:41:23.793632 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:23.793632 master-0 kubenswrapper[8993]: > pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:41:23.793632 master-0 kubenswrapper[8993]: E1204 11:41:23.793540 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"controller-manager-6686654b8d-rrndk_openshift-controller-manager(24506aa4-ab78-49df-bb58-59093498f13d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"controller-manager-6686654b8d-rrndk_openshift-controller-manager(24506aa4-ab78-49df-bb58-59093498f13d)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_controller-manager-6686654b8d-rrndk_openshift-controller-manager_24506aa4-ab78-49df-bb58-59093498f13d_0(dd455792c3c0c609a825558a90a6fdaff70c7f5c28eaeed93416f3bf654b7a11): error adding pod openshift-controller-manager_controller-manager-6686654b8d-rrndk to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"dd455792c3c0c609a825558a90a6fdaff70c7f5c28eaeed93416f3bf654b7a11\\\" Netns:\\\"/var/run/netns/0314a257-ead8-4ab3-afce-07d51d75d96d\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-controller-manager;K8S_POD_NAME=controller-manager-6686654b8d-rrndk;K8S_POD_INFRA_CONTAINER_ID=dd455792c3c0c609a825558a90a6fdaff70c7f5c28eaeed93416f3bf654b7a11;K8S_POD_UID=24506aa4-ab78-49df-bb58-59093498f13d\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-controller-manager/controller-manager-6686654b8d-rrndk] networking: Multus: [openshift-controller-manager/controller-manager-6686654b8d-rrndk/24506aa4-ab78-49df-bb58-59093498f13d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: SetNetworkStatus: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-controller-manager/pods/controller-manager-6686654b8d-rrndk?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" podUID="24506aa4-ab78-49df-bb58-59093498f13d" Dec 04 11:41:23.939469 master-0 kubenswrapper[8993]: E1204 11:41:23.939392 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:41:23.939469 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager_855d7874-16b1-47d0-82f6-d2b0c89b9a84_0(b5269202f491395be1819acda94362a4aa1e2a9aed4f6562916b06241919d0f4): error adding pod openshift-operator-lifecycle-manager_packageserver-675f5c767c-mtdrq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"b5269202f491395be1819acda94362a4aa1e2a9aed4f6562916b06241919d0f4" Netns:"/var/run/netns/59d1358a-5227-419d-89e4-6be9839ac080" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-operator-lifecycle-manager;K8S_POD_NAME=packageserver-675f5c767c-mtdrq;K8S_POD_INFRA_CONTAINER_ID=b5269202f491395be1819acda94362a4aa1e2a9aed4f6562916b06241919d0f4;K8S_POD_UID=855d7874-16b1-47d0-82f6-d2b0c89b9a84" Path:"" ERRORED: error configuring pod [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq] networking: Multus: [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq/855d7874-16b1-47d0-82f6-d2b0c89b9a84]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: SetNetworkStatus: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-operator-lifecycle-manager/pods/packageserver-675f5c767c-mtdrq?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:41:23.939469 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:23.939469 master-0 kubenswrapper[8993]: > Dec 04 11:41:23.939672 master-0 kubenswrapper[8993]: E1204 11:41:23.939498 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:41:23.939672 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager_855d7874-16b1-47d0-82f6-d2b0c89b9a84_0(b5269202f491395be1819acda94362a4aa1e2a9aed4f6562916b06241919d0f4): error adding pod openshift-operator-lifecycle-manager_packageserver-675f5c767c-mtdrq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"b5269202f491395be1819acda94362a4aa1e2a9aed4f6562916b06241919d0f4" Netns:"/var/run/netns/59d1358a-5227-419d-89e4-6be9839ac080" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-operator-lifecycle-manager;K8S_POD_NAME=packageserver-675f5c767c-mtdrq;K8S_POD_INFRA_CONTAINER_ID=b5269202f491395be1819acda94362a4aa1e2a9aed4f6562916b06241919d0f4;K8S_POD_UID=855d7874-16b1-47d0-82f6-d2b0c89b9a84" Path:"" ERRORED: error configuring pod [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq] networking: Multus: [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq/855d7874-16b1-47d0-82f6-d2b0c89b9a84]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: SetNetworkStatus: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-operator-lifecycle-manager/pods/packageserver-675f5c767c-mtdrq?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:41:23.939672 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:23.939672 master-0 kubenswrapper[8993]: > pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:41:23.939672 master-0 kubenswrapper[8993]: E1204 11:41:23.939521 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:41:23.939672 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager_855d7874-16b1-47d0-82f6-d2b0c89b9a84_0(b5269202f491395be1819acda94362a4aa1e2a9aed4f6562916b06241919d0f4): error adding pod openshift-operator-lifecycle-manager_packageserver-675f5c767c-mtdrq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"b5269202f491395be1819acda94362a4aa1e2a9aed4f6562916b06241919d0f4" Netns:"/var/run/netns/59d1358a-5227-419d-89e4-6be9839ac080" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-operator-lifecycle-manager;K8S_POD_NAME=packageserver-675f5c767c-mtdrq;K8S_POD_INFRA_CONTAINER_ID=b5269202f491395be1819acda94362a4aa1e2a9aed4f6562916b06241919d0f4;K8S_POD_UID=855d7874-16b1-47d0-82f6-d2b0c89b9a84" Path:"" ERRORED: error configuring pod [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq] networking: Multus: [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq/855d7874-16b1-47d0-82f6-d2b0c89b9a84]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: SetNetworkStatus: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-operator-lifecycle-manager/pods/packageserver-675f5c767c-mtdrq?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:41:23.939672 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:23.939672 master-0 kubenswrapper[8993]: > pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:41:23.939672 master-0 kubenswrapper[8993]: E1204 11:41:23.939598 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager(855d7874-16b1-47d0-82f6-d2b0c89b9a84)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager(855d7874-16b1-47d0-82f6-d2b0c89b9a84)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager_855d7874-16b1-47d0-82f6-d2b0c89b9a84_0(b5269202f491395be1819acda94362a4aa1e2a9aed4f6562916b06241919d0f4): error adding pod openshift-operator-lifecycle-manager_packageserver-675f5c767c-mtdrq to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"b5269202f491395be1819acda94362a4aa1e2a9aed4f6562916b06241919d0f4\\\" Netns:\\\"/var/run/netns/59d1358a-5227-419d-89e4-6be9839ac080\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-operator-lifecycle-manager;K8S_POD_NAME=packageserver-675f5c767c-mtdrq;K8S_POD_INFRA_CONTAINER_ID=b5269202f491395be1819acda94362a4aa1e2a9aed4f6562916b06241919d0f4;K8S_POD_UID=855d7874-16b1-47d0-82f6-d2b0c89b9a84\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq] networking: Multus: [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq/855d7874-16b1-47d0-82f6-d2b0c89b9a84]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: SetNetworkStatus: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-operator-lifecycle-manager/pods/packageserver-675f5c767c-mtdrq?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" podUID="855d7874-16b1-47d0-82f6-d2b0c89b9a84" Dec 04 11:41:23.944191 master-0 kubenswrapper[8993]: E1204 11:41:23.944116 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:41:23.944191 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_780ea907-dec5-426e-9de2-158f59c09f71_0(339a8481bda65b7069e3ce1cf4b8ccd417d7360be9c3218744cf0e0f593c5a48): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"339a8481bda65b7069e3ce1cf4b8ccd417d7360be9c3218744cf0e0f593c5a48" Netns:"/var/run/netns/a79669c1-92bf-44f8-8b5e-600fe749e0c5" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=339a8481bda65b7069e3ce1cf4b8ccd417d7360be9c3218744cf0e0f593c5a48;K8S_POD_UID=780ea907-dec5-426e-9de2-158f59c09f71" Path:"" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/780ea907-dec5-426e-9de2-158f59c09f71]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s": context deadline exceeded Dec 04 11:41:23.944191 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:23.944191 master-0 kubenswrapper[8993]: > Dec 04 11:41:23.944327 master-0 kubenswrapper[8993]: E1204 11:41:23.944223 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:41:23.944327 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_780ea907-dec5-426e-9de2-158f59c09f71_0(339a8481bda65b7069e3ce1cf4b8ccd417d7360be9c3218744cf0e0f593c5a48): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"339a8481bda65b7069e3ce1cf4b8ccd417d7360be9c3218744cf0e0f593c5a48" Netns:"/var/run/netns/a79669c1-92bf-44f8-8b5e-600fe749e0c5" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=339a8481bda65b7069e3ce1cf4b8ccd417d7360be9c3218744cf0e0f593c5a48;K8S_POD_UID=780ea907-dec5-426e-9de2-158f59c09f71" Path:"" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/780ea907-dec5-426e-9de2-158f59c09f71]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s": context deadline exceeded Dec 04 11:41:23.944327 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:23.944327 master-0 kubenswrapper[8993]: > pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:41:23.944327 master-0 kubenswrapper[8993]: E1204 11:41:23.944263 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:41:23.944327 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_780ea907-dec5-426e-9de2-158f59c09f71_0(339a8481bda65b7069e3ce1cf4b8ccd417d7360be9c3218744cf0e0f593c5a48): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"339a8481bda65b7069e3ce1cf4b8ccd417d7360be9c3218744cf0e0f593c5a48" Netns:"/var/run/netns/a79669c1-92bf-44f8-8b5e-600fe749e0c5" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=339a8481bda65b7069e3ce1cf4b8ccd417d7360be9c3218744cf0e0f593c5a48;K8S_POD_UID=780ea907-dec5-426e-9de2-158f59c09f71" Path:"" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/780ea907-dec5-426e-9de2-158f59c09f71]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s": context deadline exceeded Dec 04 11:41:23.944327 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:23.944327 master-0 kubenswrapper[8993]: > pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:41:23.944557 master-0 kubenswrapper[8993]: E1204 11:41:23.944341 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"installer-4-master-0_openshift-kube-scheduler(780ea907-dec5-426e-9de2-158f59c09f71)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"installer-4-master-0_openshift-kube-scheduler(780ea907-dec5-426e-9de2-158f59c09f71)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_780ea907-dec5-426e-9de2-158f59c09f71_0(339a8481bda65b7069e3ce1cf4b8ccd417d7360be9c3218744cf0e0f593c5a48): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"339a8481bda65b7069e3ce1cf4b8ccd417d7360be9c3218744cf0e0f593c5a48\\\" Netns:\\\"/var/run/netns/a79669c1-92bf-44f8-8b5e-600fe749e0c5\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=339a8481bda65b7069e3ce1cf4b8ccd417d7360be9c3218744cf0e0f593c5a48;K8S_POD_UID=780ea907-dec5-426e-9de2-158f59c09f71\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/780ea907-dec5-426e-9de2-158f59c09f71]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s\\\": context deadline exceeded\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-kube-scheduler/installer-4-master-0" podUID="780ea907-dec5-426e-9de2-158f59c09f71" Dec 04 11:41:23.949688 master-0 kubenswrapper[8993]: E1204 11:41:23.949637 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:41:23.949688 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_certified-operators-8qs8v_openshift-marketplace_b620f29d-dcde-4f98-9fb6-dd479dcdcf7c_0(fec003270bef36eba6a5a9668b9257cb885914f50d7e88621385b420031b7359): error adding pod openshift-marketplace_certified-operators-8qs8v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"fec003270bef36eba6a5a9668b9257cb885914f50d7e88621385b420031b7359" Netns:"/var/run/netns/c137c805-c71b-4d0f-abf7-55926f050522" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=certified-operators-8qs8v;K8S_POD_INFRA_CONTAINER_ID=fec003270bef36eba6a5a9668b9257cb885914f50d7e88621385b420031b7359;K8S_POD_UID=b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" Path:"" ERRORED: error configuring pod [openshift-marketplace/certified-operators-8qs8v] networking: Multus: [openshift-marketplace/certified-operators-8qs8v/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod certified-operators-8qs8v in out of cluster comm: SetNetworkStatus: failed to update the pod certified-operators-8qs8v in out of cluster comm: status update failed for pod /: the server was unable to return a response in the time allotted, but may still be processing the request (get pods certified-operators-8qs8v) Dec 04 11:41:23.949688 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:23.949688 master-0 kubenswrapper[8993]: > Dec 04 11:41:23.949947 master-0 kubenswrapper[8993]: E1204 11:41:23.949699 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:41:23.949947 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_certified-operators-8qs8v_openshift-marketplace_b620f29d-dcde-4f98-9fb6-dd479dcdcf7c_0(fec003270bef36eba6a5a9668b9257cb885914f50d7e88621385b420031b7359): error adding pod openshift-marketplace_certified-operators-8qs8v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"fec003270bef36eba6a5a9668b9257cb885914f50d7e88621385b420031b7359" Netns:"/var/run/netns/c137c805-c71b-4d0f-abf7-55926f050522" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=certified-operators-8qs8v;K8S_POD_INFRA_CONTAINER_ID=fec003270bef36eba6a5a9668b9257cb885914f50d7e88621385b420031b7359;K8S_POD_UID=b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" Path:"" ERRORED: error configuring pod [openshift-marketplace/certified-operators-8qs8v] networking: Multus: [openshift-marketplace/certified-operators-8qs8v/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod certified-operators-8qs8v in out of cluster comm: SetNetworkStatus: failed to update the pod certified-operators-8qs8v in out of cluster comm: status update failed for pod /: the server was unable to return a response in the time allotted, but may still be processing the request (get pods certified-operators-8qs8v) Dec 04 11:41:23.949947 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:23.949947 master-0 kubenswrapper[8993]: > pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:41:23.949947 master-0 kubenswrapper[8993]: E1204 11:41:23.949725 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:41:23.949947 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_certified-operators-8qs8v_openshift-marketplace_b620f29d-dcde-4f98-9fb6-dd479dcdcf7c_0(fec003270bef36eba6a5a9668b9257cb885914f50d7e88621385b420031b7359): error adding pod openshift-marketplace_certified-operators-8qs8v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"fec003270bef36eba6a5a9668b9257cb885914f50d7e88621385b420031b7359" Netns:"/var/run/netns/c137c805-c71b-4d0f-abf7-55926f050522" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=certified-operators-8qs8v;K8S_POD_INFRA_CONTAINER_ID=fec003270bef36eba6a5a9668b9257cb885914f50d7e88621385b420031b7359;K8S_POD_UID=b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" Path:"" ERRORED: error configuring pod [openshift-marketplace/certified-operators-8qs8v] networking: Multus: [openshift-marketplace/certified-operators-8qs8v/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod certified-operators-8qs8v in out of cluster comm: SetNetworkStatus: failed to update the pod certified-operators-8qs8v in out of cluster comm: status update failed for pod /: the server was unable to return a response in the time allotted, but may still be processing the request (get pods certified-operators-8qs8v) Dec 04 11:41:23.949947 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:23.949947 master-0 kubenswrapper[8993]: > pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:41:23.949947 master-0 kubenswrapper[8993]: E1204 11:41:23.949794 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"certified-operators-8qs8v_openshift-marketplace(b620f29d-dcde-4f98-9fb6-dd479dcdcf7c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"certified-operators-8qs8v_openshift-marketplace(b620f29d-dcde-4f98-9fb6-dd479dcdcf7c)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_certified-operators-8qs8v_openshift-marketplace_b620f29d-dcde-4f98-9fb6-dd479dcdcf7c_0(fec003270bef36eba6a5a9668b9257cb885914f50d7e88621385b420031b7359): error adding pod openshift-marketplace_certified-operators-8qs8v to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"fec003270bef36eba6a5a9668b9257cb885914f50d7e88621385b420031b7359\\\" Netns:\\\"/var/run/netns/c137c805-c71b-4d0f-abf7-55926f050522\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=certified-operators-8qs8v;K8S_POD_INFRA_CONTAINER_ID=fec003270bef36eba6a5a9668b9257cb885914f50d7e88621385b420031b7359;K8S_POD_UID=b620f29d-dcde-4f98-9fb6-dd479dcdcf7c\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-marketplace/certified-operators-8qs8v] networking: Multus: [openshift-marketplace/certified-operators-8qs8v/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod certified-operators-8qs8v in out of cluster comm: SetNetworkStatus: failed to update the pod certified-operators-8qs8v in out of cluster comm: status update failed for pod /: the server was unable to return a response in the time allotted, but may still be processing the request (get pods certified-operators-8qs8v)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-marketplace/certified-operators-8qs8v" podUID="b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" Dec 04 11:41:23.954599 master-0 kubenswrapper[8993]: E1204 11:41:23.954539 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:41:23.954599 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-rxhpq_openshift-marketplace_5ae25dd5-dfdb-42f6-97d0-14ad17743c95_0(652d70c8af64d6dd54a5fa84dd4bc7a269eecdaf0219d1fb02b060f818f69894): error adding pod openshift-marketplace_community-operators-rxhpq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"652d70c8af64d6dd54a5fa84dd4bc7a269eecdaf0219d1fb02b060f818f69894" Netns:"/var/run/netns/b8ff09ab-23a1-4c12-ac5f-c9e7449a07b2" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-rxhpq;K8S_POD_INFRA_CONTAINER_ID=652d70c8af64d6dd54a5fa84dd4bc7a269eecdaf0219d1fb02b060f818f69894;K8S_POD_UID=5ae25dd5-dfdb-42f6-97d0-14ad17743c95" Path:"" ERRORED: error configuring pod [openshift-marketplace/community-operators-rxhpq] networking: Multus: [openshift-marketplace/community-operators-rxhpq/5ae25dd5-dfdb-42f6-97d0-14ad17743c95]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-rxhpq in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-rxhpq in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-rxhpq?timeout=1m0s": context deadline exceeded Dec 04 11:41:23.954599 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:23.954599 master-0 kubenswrapper[8993]: > Dec 04 11:41:23.954755 master-0 kubenswrapper[8993]: E1204 11:41:23.954612 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:41:23.954755 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-rxhpq_openshift-marketplace_5ae25dd5-dfdb-42f6-97d0-14ad17743c95_0(652d70c8af64d6dd54a5fa84dd4bc7a269eecdaf0219d1fb02b060f818f69894): error adding pod openshift-marketplace_community-operators-rxhpq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"652d70c8af64d6dd54a5fa84dd4bc7a269eecdaf0219d1fb02b060f818f69894" Netns:"/var/run/netns/b8ff09ab-23a1-4c12-ac5f-c9e7449a07b2" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-rxhpq;K8S_POD_INFRA_CONTAINER_ID=652d70c8af64d6dd54a5fa84dd4bc7a269eecdaf0219d1fb02b060f818f69894;K8S_POD_UID=5ae25dd5-dfdb-42f6-97d0-14ad17743c95" Path:"" ERRORED: error configuring pod [openshift-marketplace/community-operators-rxhpq] networking: Multus: [openshift-marketplace/community-operators-rxhpq/5ae25dd5-dfdb-42f6-97d0-14ad17743c95]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-rxhpq in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-rxhpq in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-rxhpq?timeout=1m0s": context deadline exceeded Dec 04 11:41:23.954755 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:23.954755 master-0 kubenswrapper[8993]: > pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:41:23.954755 master-0 kubenswrapper[8993]: E1204 11:41:23.954633 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:41:23.954755 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-rxhpq_openshift-marketplace_5ae25dd5-dfdb-42f6-97d0-14ad17743c95_0(652d70c8af64d6dd54a5fa84dd4bc7a269eecdaf0219d1fb02b060f818f69894): error adding pod openshift-marketplace_community-operators-rxhpq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"652d70c8af64d6dd54a5fa84dd4bc7a269eecdaf0219d1fb02b060f818f69894" Netns:"/var/run/netns/b8ff09ab-23a1-4c12-ac5f-c9e7449a07b2" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-rxhpq;K8S_POD_INFRA_CONTAINER_ID=652d70c8af64d6dd54a5fa84dd4bc7a269eecdaf0219d1fb02b060f818f69894;K8S_POD_UID=5ae25dd5-dfdb-42f6-97d0-14ad17743c95" Path:"" ERRORED: error configuring pod [openshift-marketplace/community-operators-rxhpq] networking: Multus: [openshift-marketplace/community-operators-rxhpq/5ae25dd5-dfdb-42f6-97d0-14ad17743c95]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-rxhpq in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-rxhpq in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-rxhpq?timeout=1m0s": context deadline exceeded Dec 04 11:41:23.954755 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:41:23.954755 master-0 kubenswrapper[8993]: > pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:41:23.954755 master-0 kubenswrapper[8993]: E1204 11:41:23.954703 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"community-operators-rxhpq_openshift-marketplace(5ae25dd5-dfdb-42f6-97d0-14ad17743c95)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"community-operators-rxhpq_openshift-marketplace(5ae25dd5-dfdb-42f6-97d0-14ad17743c95)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-rxhpq_openshift-marketplace_5ae25dd5-dfdb-42f6-97d0-14ad17743c95_0(652d70c8af64d6dd54a5fa84dd4bc7a269eecdaf0219d1fb02b060f818f69894): error adding pod openshift-marketplace_community-operators-rxhpq to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"652d70c8af64d6dd54a5fa84dd4bc7a269eecdaf0219d1fb02b060f818f69894\\\" Netns:\\\"/var/run/netns/b8ff09ab-23a1-4c12-ac5f-c9e7449a07b2\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-rxhpq;K8S_POD_INFRA_CONTAINER_ID=652d70c8af64d6dd54a5fa84dd4bc7a269eecdaf0219d1fb02b060f818f69894;K8S_POD_UID=5ae25dd5-dfdb-42f6-97d0-14ad17743c95\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-marketplace/community-operators-rxhpq] networking: Multus: [openshift-marketplace/community-operators-rxhpq/5ae25dd5-dfdb-42f6-97d0-14ad17743c95]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-rxhpq in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-rxhpq in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-rxhpq?timeout=1m0s\\\": context deadline exceeded\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-marketplace/community-operators-rxhpq" podUID="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" Dec 04 11:41:28.258698 master-0 kubenswrapper[8993]: I1204 11:41:28.258634 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_control-plane-machine-set-operator-7df95c79b5-7w5lm_14bd3485-aa02-4984-b4a3-59f360b1b327/control-plane-machine-set-operator/0.log" Dec 04 11:41:28.258698 master-0 kubenswrapper[8993]: I1204 11:41:28.258692 8993 generic.go:334] "Generic (PLEG): container finished" podID="14bd3485-aa02-4984-b4a3-59f360b1b327" containerID="aeee1a4ddc268ca9307b81e79359b2f59515c9c502aecb0723e30ace49120598" exitCode=1 Dec 04 11:41:29.002397 master-0 kubenswrapper[8993]: I1204 11:41:29.002339 8993 patch_prober.go:28] interesting pod/catalogd-controller-manager-7cc89f4c4c-fd9pv container/manager namespace/openshift-catalogd: Readiness probe status=failure output="Get \"http://10.128.0.40:8081/readyz\": dial tcp 10.128.0.40:8081: connect: connection refused" start-of-body= Dec 04 11:41:29.002397 master-0 kubenswrapper[8993]: I1204 11:41:29.002407 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" podUID="ee9a47b1-cdd9-43bc-8115-8851f29106e6" containerName="manager" probeResult="failure" output="Get \"http://10.128.0.40:8081/readyz\": dial tcp 10.128.0.40:8081: connect: connection refused" Dec 04 11:41:29.449181 master-0 kubenswrapper[8993]: I1204 11:41:29.449049 8993 patch_prober.go:28] interesting pod/operator-controller-controller-manager-7cbd59c7f8-qcz9t container/manager namespace/openshift-operator-controller: Readiness probe status=failure output="Get \"http://10.128.0.41:8081/readyz\": dial tcp 10.128.0.41:8081: connect: connection refused" start-of-body= Dec 04 11:41:29.449726 master-0 kubenswrapper[8993]: I1204 11:41:29.449179 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" podUID="1897bad8-3875-4bd6-b877-b1abe1fe76c7" containerName="manager" probeResult="failure" output="Get \"http://10.128.0.41:8081/readyz\": dial tcp 10.128.0.41:8081: connect: connection refused" Dec 04 11:41:30.877241 master-0 kubenswrapper[8993]: E1204 11:41:30.877115 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 11:41:37.885993 master-0 kubenswrapper[8993]: E1204 11:41:37.885874 8993 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:41:37.887160 master-0 kubenswrapper[8993]: E1204 11:41:37.886267 8993 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="34.011s" Dec 04 11:41:37.887160 master-0 kubenswrapper[8993]: I1204 11:41:37.886922 8993 scope.go:117] "RemoveContainer" containerID="e0f56c17864ba0f74d6e33ee62008f6da1f6df237d3a2bf24da757af97c1cd89" Dec 04 11:41:37.887160 master-0 kubenswrapper[8993]: I1204 11:41:37.887073 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:41:37.887488 master-0 kubenswrapper[8993]: I1204 11:41:37.887459 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:41:37.887773 master-0 kubenswrapper[8993]: I1204 11:41:37.887608 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:41:37.887773 master-0 kubenswrapper[8993]: I1204 11:41:37.887682 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:41:37.887773 master-0 kubenswrapper[8993]: I1204 11:41:37.887697 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" event={"ID":"cdb50850-779d-4179-ba1d-65ffeb4bb2e9","Type":"ContainerStarted","Data":"21890527e3939ef8c71ed600b954fbd30bb4b48d4a2e73ffc24208dce81ed478"} Dec 04 11:41:37.888649 master-0 kubenswrapper[8993]: I1204 11:41:37.887883 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:41:37.888649 master-0 kubenswrapper[8993]: I1204 11:41:37.888020 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:41:37.888649 master-0 kubenswrapper[8993]: I1204 11:41:37.888209 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:41:37.888649 master-0 kubenswrapper[8993]: I1204 11:41:37.888239 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:41:37.888649 master-0 kubenswrapper[8993]: I1204 11:41:37.888595 8993 scope.go:117] "RemoveContainer" containerID="560ba30f370ec40b8f7156e79883f77ace5f0c511592152f47a88a654d161d5b" Dec 04 11:41:37.890008 master-0 kubenswrapper[8993]: I1204 11:41:37.889430 8993 scope.go:117] "RemoveContainer" containerID="9c2fc9403fab0d35870e3bc56e7a58963be646e5a41f7dc3511733d940fb3a34" Dec 04 11:41:37.890008 master-0 kubenswrapper[8993]: I1204 11:41:37.889669 8993 scope.go:117] "RemoveContainer" containerID="397481b3f91ac25f72eb86f49a721b3557eba7e4607ac9ea2395672278f1bcfc" Dec 04 11:41:37.890008 master-0 kubenswrapper[8993]: I1204 11:41:37.889846 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:41:37.890008 master-0 kubenswrapper[8993]: I1204 11:41:37.890006 8993 scope.go:117] "RemoveContainer" containerID="36ec3b979824ab62e6f7509543dc4f347e7c4493e3f1c85b36fa97144a94acc1" Dec 04 11:41:37.890345 master-0 kubenswrapper[8993]: I1204 11:41:37.890272 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:41:37.891108 master-0 kubenswrapper[8993]: I1204 11:41:37.890405 8993 scope.go:117] "RemoveContainer" containerID="4efa514695b682bb2d4ad336643391490d8d1ea01e30ed9629a1ef982abb6433" Dec 04 11:41:37.891108 master-0 kubenswrapper[8993]: I1204 11:41:37.890574 8993 scope.go:117] "RemoveContainer" containerID="ccce88b1ca2f9a134e692a16b1bcd6669f59f655145c0cf6017bc4ec59640741" Dec 04 11:41:37.891108 master-0 kubenswrapper[8993]: I1204 11:41:37.890899 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:41:37.892107 master-0 kubenswrapper[8993]: I1204 11:41:37.891209 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:41:37.892107 master-0 kubenswrapper[8993]: I1204 11:41:37.891775 8993 scope.go:117] "RemoveContainer" containerID="68cefdb59268cb33333146cf2f74e7763f9033ac08d79970d8869684b7700cf2" Dec 04 11:41:37.892107 master-0 kubenswrapper[8993]: I1204 11:41:37.891922 8993 scope.go:117] "RemoveContainer" containerID="72abc724ed2d61f11cccbb7ec6d373328f957dd321cb6fd0e7f3d01b800d6a97" Dec 04 11:41:37.901268 master-0 kubenswrapper[8993]: I1204 11:41:37.901207 8993 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0-master-0" podUID="" Dec 04 11:41:38.328397 master-0 kubenswrapper[8993]: I1204 11:41:38.328351 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-78f758c7b9-zgkh5_7e3160a9-11d1-4845-ba30-1a49ae7339a9/cluster-baremetal-operator/0.log" Dec 04 11:41:38.335006 master-0 kubenswrapper[8993]: I1204 11:41:38.334078 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_cluster-storage-operator-dcf7fc84b-fncfd_f797ab14-0eb5-48b4-b914-f434f67c4c49/cluster-storage-operator/0.log" Dec 04 11:41:38.344173 master-0 kubenswrapper[8993]: I1204 11:41:38.343664 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-6c8676f99d-7z948_3322cc5a-f1f7-4522-b423-19fb7f38cd43/openshift-controller-manager-operator/1.log" Dec 04 11:41:38.347254 master-0 kubenswrapper[8993]: I1204 11:41:38.345448 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-6c8676f99d-7z948_3322cc5a-f1f7-4522-b423-19fb7f38cd43/openshift-controller-manager-operator/0.log" Dec 04 11:41:39.172795 master-0 kubenswrapper[8993]: E1204 11:41:39.172583 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:41:29Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:41:29Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:41:29Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:41:29Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3e65409fc2b27ad0aaeb500a39e264663d2980821f099b830b551785ce4ce8b\\\"],\\\"sizeBytes\\\":1631758507},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:2efbb545a141552851226bea008b13d92cbb084339bcfd6923b38d23c382145e\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:e5c3ad640f9c0c84490a0e0da7a1850b7873867936a5b604c07a8075c3a710d0\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1610175307},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9014f384de5f9a0b7418d5869ad349abb9588d16bd09ed650a163c045315dbff\\\"],\\\"sizeBytes\\\":1232140918},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:98141b7d0b74195f511ccd4c41ba6c8a69fef01f22b2fb8ef2d024109e93a3a9\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:bd4a56267fe7d489c5a0705c4b9f5c43170dd39b6684e2497a49c5416ae6e14f\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1205106509},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:9eadf94ba5e517edf53c9b21d83f18cb3790ddc768f10d0ca92be97c56a0eecb\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:e096abcd79df184b3151d2fe670d52596bae8c1f2d1fa8851c41821afe1ba59e\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1201434959},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:e8990432556acad31519b1a73ec32f32d27c2034cf9e5cc4db8980efc7331594\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:ebe9f523f5c211a3a0f2570331dddcd5be15b12c1fecd9b8b121f881bfaad029\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.18\\\"],\\\"sizeBytes\\\":1129027903},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b472823604757237c2d16bd6f6221f4cf562aa3b05942c7f602e1e8b2e55a7c6\\\"],\\\"sizeBytes\\\":983705650},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d5891cdd7dcf7c9081de8b364b4c96446b7f946f7880fbae291a4592a198264\\\"],\\\"sizeBytes\\\":938303566},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:01d2e67fd74086da701c39dac5b821822351cb0151f9afe72821c05df19953ad\\\"],\\\"sizeBytes\\\":912722556},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:61664aa69b33349cc6de45e44ae6033e7f483c034ea01c0d9a8ca08a12d88e3a\\\"],\\\"sizeBytes\\\":874825223},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:631a3798b749fecc041a99929eb946618df723e15055e805ff752a1a1273481c\\\"],\\\"sizeBytes\\\":870567329},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1ca78c423f43f89a0411e40393642f64e4f8df9e5f61c25e31047c4cce170f9\\\"],\\\"sizeBytes\\\":857069957},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b12f830c3316aa4dc061c2d00c74126282b3e2bcccc301eab00d57fff3c4c7c\\\"],\\\"sizeBytes\\\":767284906},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cb3ec61f9a932a9ad13bdeb44bcf9477a8d5f728151d7f19ed3ef7d4b02b3a82\\\"],\\\"sizeBytes\\\":682371258},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:916566bb9d0143352324233d460ad94697719c11c8c9158e3aea8f475941751f\\\"],\\\"sizeBytes\\\":677523572},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5451aa441e5b8d8689c032405d410c8049a849ef2edf77e5b6a5ce2838c6569b\\\"],\\\"sizeBytes\\\":672407260},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9724d2036305cbd729e1f484c5bad89971de977fff8a6723fef1873858dd1123\\\"],\\\"sizeBytes\\\":616108962},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:df606f3b71d4376d1a2108c09f0d3dab455fc30bcb67c60e91590c105e9025bf\\\"],\\\"sizeBytes\\\":583836304},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79f99fd6cce984287932edf0d009660bb488d663081f3d62ec3b23bc8bfbf6c2\\\"],\\\"sizeBytes\\\":576619763},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eddedae7578d79b5a3f748000ae5c00b9f14a04710f9f9ec7b52fc569be5dfb8\\\"],\\\"sizeBytes\\\":552673986},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dd38b8be3af889b0f97e2df41517c89a11260901432a9a1ee943195bb3a22737\\\"],\\\"sizeBytes\\\":551889548},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:aa24edce3d740f84c40018e94cdbf2bc7375268d13d57c2d664e43a46ccea3fc\\\"],\\\"sizeBytes\\\":543227406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:188637a52cafee61ec461e92fb0c605e28be325b9ac1f2ac8a37d68e97654718\\\"],\\\"sizeBytes\\\":532719167},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde59e48cd5dee3721f34d249cb119cc3259fd857965d34f9c7ed83b0c363a1\\\"],\\\"sizeBytes\\\":532402162},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f4d4282cb53325e737ad68abbfcb70687ae04fb50353f4f0ba0ba5703b15009a\\\"],\\\"sizeBytes\\\":512838054},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-release@sha256:8c885ea0b3c5124989f0a9b93eba98eb9fca6bbd0262772d85d90bf713a4d572\\\"],\\\"sizeBytes\\\":512452153},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0f43c31aa3359159d4557dad3cfaf812d8ce44db9cb9ae970e06d3479070b660\\\"],\\\"sizeBytes\\\":509437356},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:97d26892192b552c16527bf2771e1b86528ab581a02dd9279cdf71c194830e3e\\\"],\\\"sizeBytes\\\":508042119},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e85850a4ae1a1e3ec2c590a4936d640882b6550124da22031c85b526afbf52df\\\"],\\\"sizeBytes\\\":507687221},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8375671da86aa527ee7e291d86971b0baa823ffc7663b5a983084456e76c0f59\\\"],\\\"sizeBytes\\\":506741476},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:831f30660844091d6154e2674d3a9da6f34271bf8a2c40b56f7416066318742b\\\"],\\\"sizeBytes\\\":505649178},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:86af77350cfe6fd69280157e4162aa0147873d9431c641ae4ad3e881ff768a73\\\"],\\\"sizeBytes\\\":505628211},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a824e468cf8dd61d347e35b2ee5bc2f815666957647098e21a1bb56ff613e5b9\\\"],\\\"sizeBytes\\\":503340749},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8139ed65c0a0a4b0f253b715c11cc52be027efe8a4774da9ccce35c78ef439da\\\"],\\\"sizeBytes\\\":503011144},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8eabac819f289e29d75c7ab172d8124554849a47f0b00770928c3eb19a5a31c4\\\"],\\\"sizeBytes\\\":502436444},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:10e57ca7611f79710f05777dc6a8f31c7e04eb09da4d8d793a5acfbf0e4692d7\\\"],\\\"sizeBytes\\\":500943492},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f042fa25014f3d37f3ea967d21f361d2a11833ae18f2c750318101b25d2497ce\\\"],\\\"sizeBytes\\\":500848684},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91af633e585621630c40d14f188e37d36b44678d0a59e582d850bf8d593d3a0c\\\"],\\\"sizeBytes\\\":499798563},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d64c13fe7663a0b4ae61d103b1b7598adcf317a01826f296bcb66b1a2de83c96\\\"],\\\"sizeBytes\\\":499705918},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:33a20002692769235e95271ab071783c57ff50681088fa1035b86af31e73cf20\\\"],\\\"sizeBytes\\\":499125567},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:75d996f6147edb88c09fd1a052099de66638590d7d03a735006244bc9e19f898\\\"],\\\"sizeBytes\\\":499082775},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3b8d91a25eeb9f02041e947adb3487da3e7ab8449d3d2ad015827e7954df7b34\\\"],\\\"sizeBytes\\\":490455952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1f952cec1e5332b84bdffa249cd426f39087058d6544ddcec650a414c15a9b68\\\"],\\\"sizeBytes\\\":489528665},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c416b201d480bddb5a4960ec42f4740761a1335001cf84ba5ae19ad6857771b1\\\"],\\\"sizeBytes\\\":481559117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c3a77aa4d03b89ea284e3467a268e5989a77a2ef63e685eb1d5c5ea5b3922b7a\\\"],\\\"sizeBytes\\\":478917802},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eb928c13a46d3fb45f4a881892d023a92d610a5430be0ffd916aaf8da8e7d297\\\"],\\\"sizeBytes\\\":478642572},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a92c310ce30dcb3de85d6aac868e0d80919670fa29ef83d55edd96b0cae35563\\\"],\\\"sizeBytes\\\":465285478},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fd3e9f8f00a59bda7483ec7dc8a0ed602f9ca30e3d72b22072dbdf2819da3f61\\\"],\\\"sizeBytes\\\":465144618},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3c1edf52f70bf9b1d1457e0c4111bc79cdaa1edd659ddbdb9d8176eff8b46956\\\"],\\\"sizeBytes\\\":462727837},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8cc27777e72233024fe84ee1faa168aec715a0b24912a3ce70715ddccba328df\\\"],\\\"sizeBytes\\\":461702648}]}}\" for node \"master-0\": Patch \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0/status?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:41:39.359038 master-0 kubenswrapper[8993]: I1204 11:41:39.358976 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-controller_operator-controller-controller-manager-7cbd59c7f8-qcz9t_1897bad8-3875-4bd6-b877-b1abe1fe76c7/manager/0.log" Dec 04 11:41:39.361123 master-0 kubenswrapper[8993]: I1204 11:41:39.361081 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-catalogd_catalogd-controller-manager-7cc89f4c4c-fd9pv_ee9a47b1-cdd9-43bc-8115-8851f29106e6/manager/0.log" Dec 04 11:41:41.231326 master-0 kubenswrapper[8993]: E1204 11:41:41.231185 8993 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{bootstrap-kube-scheduler-master-0.187e003970808e46 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:bootstrap-kube-scheduler-master-0,UID:5e09e2af7200e6f9be469dbfd9bb1127,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d5891cdd7dcf7c9081de8b364b4c96446b7f946f7880fbae291a4592a198264\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:39:10.676422214 +0000 UTC m=+85.067363657,LastTimestamp:2025-12-04 11:39:10.676422214 +0000 UTC m=+85.067363657,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:41:47.878745 master-0 kubenswrapper[8993]: E1204 11:41:47.878572 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 11:41:49.173945 master-0 kubenswrapper[8993]: E1204 11:41:49.173769 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:41:50.900604 master-0 kubenswrapper[8993]: E1204 11:41:50.900550 8993 kubelet.go:1929] "Failed creating a mirror pod for" err="Internal error occurred: admission plugin \"LimitRanger\" failed to complete mutation in 13s" pod="openshift-etcd/etcd-master-0" Dec 04 11:41:51.444143 master-0 kubenswrapper[8993]: I1204 11:41:51.443943 8993 generic.go:334] "Generic (PLEG): container finished" podID="c24e01603234fe8003f8aae8171b0065" containerID="2d094b63c81e57115143f4d4ba1077d84f6869b12329f7e6615de922e672c39f" exitCode=0 Dec 04 11:41:52.039309 master-0 kubenswrapper[8993]: I1204 11:41:52.039206 8993 status_manager.go:851] "Failed to get status for pod" podUID="64d30b80-2336-49c2-a2c2-1e0694036a84" pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" err="the server was unable to return a response in the time allotted, but may still be processing the request (get pods cloud-credential-operator-698c598cfc-95jdn)" Dec 04 11:41:59.175213 master-0 kubenswrapper[8993]: E1204 11:41:59.175145 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:42:01.512312 master-0 kubenswrapper[8993]: I1204 11:42:01.512135 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_network-operator-79767b7ff9-5bgzx_ffaf95be-586c-40fa-b15f-1beaffe7ff1c/network-operator/1.log" Dec 04 11:42:01.512963 master-0 kubenswrapper[8993]: I1204 11:42:01.512927 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_network-operator-79767b7ff9-5bgzx_ffaf95be-586c-40fa-b15f-1beaffe7ff1c/network-operator/0.log" Dec 04 11:42:01.513043 master-0 kubenswrapper[8993]: I1204 11:42:01.512987 8993 generic.go:334] "Generic (PLEG): container finished" podID="ffaf95be-586c-40fa-b15f-1beaffe7ff1c" containerID="10a13e320db86cab3c629c14a604cd412c42b909da0c8bde7337860edd2f6505" exitCode=255 Dec 04 11:42:01.515311 master-0 kubenswrapper[8993]: I1204 11:42:01.515212 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler-operator_openshift-kube-scheduler-operator-5f85974995-g4rwv_27576028-d64a-47cd-b76b-d524e41efe37/kube-scheduler-operator-container/1.log" Dec 04 11:42:01.515823 master-0 kubenswrapper[8993]: I1204 11:42:01.515779 8993 generic.go:334] "Generic (PLEG): container finished" podID="27576028-d64a-47cd-b76b-d524e41efe37" containerID="a5c78a2d8242e27c86fe1aef51f9f44b2ab668d62560b3158373aada11376ae9" exitCode=255 Dec 04 11:42:01.517612 master-0 kubenswrapper[8993]: I1204 11:42:01.517574 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd-operator_etcd-operator-5bf4d88c6f-2bpmr_c6e9271a-44ea-4612-ab60-4a9d489ed062/etcd-operator/1.log" Dec 04 11:42:01.518072 master-0 kubenswrapper[8993]: I1204 11:42:01.518023 8993 generic.go:334] "Generic (PLEG): container finished" podID="c6e9271a-44ea-4612-ab60-4a9d489ed062" containerID="0c42072520a6b53c6aa158c37fe784801234cd135b1f4b11a3d79b213d89865e" exitCode=255 Dec 04 11:42:01.519772 master-0 kubenswrapper[8993]: I1204 11:42:01.519740 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication-operator_authentication-operator-6c968fdfdf-nrrfw_42b3be0f-1d82-4a64-abb4-0118a6960efd/authentication-operator/1.log" Dec 04 11:42:01.520327 master-0 kubenswrapper[8993]: I1204 11:42:01.520205 8993 generic.go:334] "Generic (PLEG): container finished" podID="42b3be0f-1d82-4a64-abb4-0118a6960efd" containerID="05275cb6451e1a77bd316f718a2831588e2ee8d0a474e33a3702ad4134ac254b" exitCode=255 Dec 04 11:42:01.521941 master-0 kubenswrapper[8993]: I1204 11:42:01.521906 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager-operator_kube-controller-manager-operator-848f645654-7hmhg_bac00ac5-0371-48fd-b1cc-60438f08ae94/kube-controller-manager-operator/1.log" Dec 04 11:42:01.522382 master-0 kubenswrapper[8993]: I1204 11:42:01.522337 8993 generic.go:334] "Generic (PLEG): container finished" podID="bac00ac5-0371-48fd-b1cc-60438f08ae94" containerID="2be6d5a0843c9ad0cefac288764262419d2b3e8c45c39b2471e38c3ea1a83dce" exitCode=255 Dec 04 11:42:01.524252 master-0 kubenswrapper[8993]: I1204 11:42:01.524216 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-77758bc754-8smqn_8e5e33b0-4e2e-464c-ba5b-cbd2048004f8/service-ca-operator/1.log" Dec 04 11:42:01.524682 master-0 kubenswrapper[8993]: I1204 11:42:01.524645 8993 generic.go:334] "Generic (PLEG): container finished" podID="8e5e33b0-4e2e-464c-ba5b-cbd2048004f8" containerID="bf092013477d028b4e0ff6d6621a140759c75991960cac0199edb383102625b9" exitCode=255 Dec 04 11:42:01.526879 master-0 kubenswrapper[8993]: I1204 11:42:01.526786 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-b9c5dfc78-dcxkw_fd9f8671-8066-4990-b45d-8b619aa5d9ec/kube-storage-version-migrator-operator/1.log" Dec 04 11:42:01.527417 master-0 kubenswrapper[8993]: I1204 11:42:01.527363 8993 generic.go:334] "Generic (PLEG): container finished" podID="fd9f8671-8066-4990-b45d-8b619aa5d9ec" containerID="eeb6c3dc3fc4ac2310a94746d140288965ceb78f995753a5fcb2fc6a20648fed" exitCode=255 Dec 04 11:42:01.685436 master-0 kubenswrapper[8993]: E1204 11:42:01.685370 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:42:01.685436 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(21bc0e2f8c3e2b30320dbc8a79d7d97b34ea191a5786a54f69ac61586aa362d5): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"21bc0e2f8c3e2b30320dbc8a79d7d97b34ea191a5786a54f69ac61586aa362d5" Netns:"/var/run/netns/2052808d-2414-40cf-bf30-07beb222e23d" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=21bc0e2f8c3e2b30320dbc8a79d7d97b34ea191a5786a54f69ac61586aa362d5;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378" Path:"" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:42:01.685436 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:42:01.685436 master-0 kubenswrapper[8993]: > Dec 04 11:42:01.685600 master-0 kubenswrapper[8993]: E1204 11:42:01.685481 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:42:01.685600 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(21bc0e2f8c3e2b30320dbc8a79d7d97b34ea191a5786a54f69ac61586aa362d5): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"21bc0e2f8c3e2b30320dbc8a79d7d97b34ea191a5786a54f69ac61586aa362d5" Netns:"/var/run/netns/2052808d-2414-40cf-bf30-07beb222e23d" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=21bc0e2f8c3e2b30320dbc8a79d7d97b34ea191a5786a54f69ac61586aa362d5;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378" Path:"" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:42:01.685600 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:42:01.685600 master-0 kubenswrapper[8993]: > pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:42:01.685600 master-0 kubenswrapper[8993]: E1204 11:42:01.685526 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:42:01.685600 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(21bc0e2f8c3e2b30320dbc8a79d7d97b34ea191a5786a54f69ac61586aa362d5): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"21bc0e2f8c3e2b30320dbc8a79d7d97b34ea191a5786a54f69ac61586aa362d5" Netns:"/var/run/netns/2052808d-2414-40cf-bf30-07beb222e23d" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=21bc0e2f8c3e2b30320dbc8a79d7d97b34ea191a5786a54f69ac61586aa362d5;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378" Path:"" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:42:01.685600 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:42:01.685600 master-0 kubenswrapper[8993]: > pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:42:01.685852 master-0 kubenswrapper[8993]: E1204 11:42:01.685664 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"machine-api-operator-88d48b57d-9fjtd_openshift-machine-api(c50317d3-f7cd-4133-845e-44add57ac378)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"machine-api-operator-88d48b57d-9fjtd_openshift-machine-api(c50317d3-f7cd-4133-845e-44add57ac378)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(21bc0e2f8c3e2b30320dbc8a79d7d97b34ea191a5786a54f69ac61586aa362d5): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"21bc0e2f8c3e2b30320dbc8a79d7d97b34ea191a5786a54f69ac61586aa362d5\\\" Netns:\\\"/var/run/netns/2052808d-2414-40cf-bf30-07beb222e23d\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=21bc0e2f8c3e2b30320dbc8a79d7d97b34ea191a5786a54f69ac61586aa362d5;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" podUID="c50317d3-f7cd-4133-845e-44add57ac378" Dec 04 11:42:02.533800 master-0 kubenswrapper[8993]: I1204 11:42:02.533707 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:42:02.534632 master-0 kubenswrapper[8993]: I1204 11:42:02.534315 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:42:04.879978 master-0 kubenswrapper[8993]: E1204 11:42:04.879795 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 11:42:09.175860 master-0 kubenswrapper[8993]: E1204 11:42:09.175681 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:42:11.904325 master-0 kubenswrapper[8993]: E1204 11:42:11.904163 8993 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:42:11.905102 master-0 kubenswrapper[8993]: E1204 11:42:11.904421 8993 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="34.016s" Dec 04 11:42:11.905102 master-0 kubenswrapper[8993]: I1204 11:42:11.904546 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:42:11.905580 master-0 kubenswrapper[8993]: I1204 11:42:11.905452 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:42:11.906417 master-0 kubenswrapper[8993]: I1204 11:42:11.905800 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:42:11.906417 master-0 kubenswrapper[8993]: I1204 11:42:11.906042 8993 scope.go:117] "RemoveContainer" containerID="8024196dc7d7114b2537f80438f2f5ad83a892cee7caa5f4d34fca2b46d86f82" Dec 04 11:42:11.906417 master-0 kubenswrapper[8993]: I1204 11:42:11.906285 8993 scope.go:117] "RemoveContainer" containerID="a98c972089f945f20cf6cc807089551b4b9f89664b6a5a78412dd79091e473a5" Dec 04 11:42:11.907138 master-0 kubenswrapper[8993]: I1204 11:42:11.906538 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:42:11.909182 master-0 kubenswrapper[8993]: I1204 11:42:11.907255 8993 scope.go:117] "RemoveContainer" containerID="aeee1a4ddc268ca9307b81e79359b2f59515c9c502aecb0723e30ace49120598" Dec 04 11:42:11.909182 master-0 kubenswrapper[8993]: I1204 11:42:11.907321 8993 scope.go:117] "RemoveContainer" containerID="10a13e320db86cab3c629c14a604cd412c42b909da0c8bde7337860edd2f6505" Dec 04 11:42:11.909182 master-0 kubenswrapper[8993]: I1204 11:42:11.908725 8993 scope.go:117] "RemoveContainer" containerID="eeb6c3dc3fc4ac2310a94746d140288965ceb78f995753a5fcb2fc6a20648fed" Dec 04 11:42:11.910363 master-0 kubenswrapper[8993]: I1204 11:42:11.909187 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:42:11.910363 master-0 kubenswrapper[8993]: I1204 11:42:11.909257 8993 scope.go:117] "RemoveContainer" containerID="bf092013477d028b4e0ff6d6621a140759c75991960cac0199edb383102625b9" Dec 04 11:42:11.910363 master-0 kubenswrapper[8993]: I1204 11:42:11.909410 8993 scope.go:117] "RemoveContainer" containerID="05275cb6451e1a77bd316f718a2831588e2ee8d0a474e33a3702ad4134ac254b" Dec 04 11:42:11.910363 master-0 kubenswrapper[8993]: I1204 11:42:11.910035 8993 scope.go:117] "RemoveContainer" containerID="a5c78a2d8242e27c86fe1aef51f9f44b2ab668d62560b3158373aada11376ae9" Dec 04 11:42:11.914625 master-0 kubenswrapper[8993]: I1204 11:42:11.914580 8993 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0-master-0" podUID="" Dec 04 11:42:12.602433 master-0 kubenswrapper[8993]: I1204 11:42:12.602375 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-b9c5dfc78-dcxkw_fd9f8671-8066-4990-b45d-8b619aa5d9ec/kube-storage-version-migrator-operator/1.log" Dec 04 11:42:12.605934 master-0 kubenswrapper[8993]: I1204 11:42:12.605900 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_network-operator-79767b7ff9-5bgzx_ffaf95be-586c-40fa-b15f-1beaffe7ff1c/network-operator/1.log" Dec 04 11:42:12.606554 master-0 kubenswrapper[8993]: I1204 11:42:12.606524 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_network-operator-79767b7ff9-5bgzx_ffaf95be-586c-40fa-b15f-1beaffe7ff1c/network-operator/0.log" Dec 04 11:42:12.608926 master-0 kubenswrapper[8993]: I1204 11:42:12.608885 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler-operator_openshift-kube-scheduler-operator-5f85974995-g4rwv_27576028-d64a-47cd-b76b-d524e41efe37/kube-scheduler-operator-container/1.log" Dec 04 11:42:12.611122 master-0 kubenswrapper[8993]: I1204 11:42:12.611075 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication-operator_authentication-operator-6c968fdfdf-nrrfw_42b3be0f-1d82-4a64-abb4-0118a6960efd/authentication-operator/1.log" Dec 04 11:42:12.615358 master-0 kubenswrapper[8993]: I1204 11:42:12.615331 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/0.log" Dec 04 11:42:12.616926 master-0 kubenswrapper[8993]: I1204 11:42:12.616902 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_control-plane-machine-set-operator-7df95c79b5-7w5lm_14bd3485-aa02-4984-b4a3-59f360b1b327/control-plane-machine-set-operator/0.log" Dec 04 11:42:12.618294 master-0 kubenswrapper[8993]: I1204 11:42:12.618270 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-77758bc754-8smqn_8e5e33b0-4e2e-464c-ba5b-cbd2048004f8/service-ca-operator/1.log" Dec 04 11:42:15.233938 master-0 kubenswrapper[8993]: E1204 11:42:15.233739 8993 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{openshift-controller-manager-operator-6c8676f99d-7z948.187e003b1b241eeb openshift-controller-manager-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-controller-manager-operator,Name:openshift-controller-manager-operator-6c8676f99d-7z948,UID:3322cc5a-f1f7-4522-b423-19fb7f38cd43,APIVersion:v1,ResourceVersion:3842,FieldPath:spec.containers{openshift-controller-manager-operator},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8eabac819f289e29d75c7ab172d8124554849a47f0b00770928c3eb19a5a31c4\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:39:17.834235627 +0000 UTC m=+92.225177070,LastTimestamp:2025-12-04 11:39:17.834235627 +0000 UTC m=+92.225177070,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:42:18.390764 master-0 kubenswrapper[8993]: I1204 11:42:18.390594 8993 patch_prober.go:28] interesting pod/etcd-operator-5bf4d88c6f-2bpmr container/etcd-operator namespace/openshift-etcd-operator: Liveness probe status=failure output="Get \"https://10.128.0.21:8443/healthz\": dial tcp 10.128.0.21:8443: connect: connection refused" start-of-body= Dec 04 11:42:18.390764 master-0 kubenswrapper[8993]: I1204 11:42:18.390736 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" podUID="c6e9271a-44ea-4612-ab60-4a9d489ed062" containerName="etcd-operator" probeResult="failure" output="Get \"https://10.128.0.21:8443/healthz\": dial tcp 10.128.0.21:8443: connect: connection refused" Dec 04 11:42:19.176286 master-0 kubenswrapper[8993]: E1204 11:42:19.176185 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:42:19.176286 master-0 kubenswrapper[8993]: E1204 11:42:19.176245 8993 kubelet_node_status.go:572] "Unable to update node status" err="update node status exceeds retry count" Dec 04 11:42:21.631118 master-0 kubenswrapper[8993]: I1204 11:42:21.631053 8993 scope.go:117] "RemoveContainer" containerID="0d3125af9f225e916c36216370812055c372bf043dda0792009085c501b96333" Dec 04 11:42:21.881569 master-0 kubenswrapper[8993]: E1204 11:42:21.881406 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 11:42:30.734219 master-0 kubenswrapper[8993]: I1204 11:42:30.733980 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/1.log" Dec 04 11:42:30.735152 master-0 kubenswrapper[8993]: I1204 11:42:30.734907 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/0.log" Dec 04 11:42:30.735152 master-0 kubenswrapper[8993]: I1204 11:42:30.734985 8993 generic.go:334] "Generic (PLEG): container finished" podID="b011b1f1-3235-4e20-825b-ce711c052407" containerID="1d2b175fde83364b4666d8066712242360f76256f651e330ae881c16c680384c" exitCode=1 Dec 04 11:42:38.602249 master-0 kubenswrapper[8993]: E1204 11:42:38.602140 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:42:38.602249 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_780ea907-dec5-426e-9de2-158f59c09f71_0(369b0e712547133da414f9c9a855b9d0e50ac7147d0b5cb829923e11cbca3b38): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"369b0e712547133da414f9c9a855b9d0e50ac7147d0b5cb829923e11cbca3b38" Netns:"/var/run/netns/0ef64b83-96aa-4011-8bd8-49872e23d186" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=369b0e712547133da414f9c9a855b9d0e50ac7147d0b5cb829923e11cbca3b38;K8S_POD_UID=780ea907-dec5-426e-9de2-158f59c09f71" Path:"" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/780ea907-dec5-426e-9de2-158f59c09f71]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:42:38.602249 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:42:38.602249 master-0 kubenswrapper[8993]: > Dec 04 11:42:38.602249 master-0 kubenswrapper[8993]: E1204 11:42:38.602241 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:42:38.602249 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_780ea907-dec5-426e-9de2-158f59c09f71_0(369b0e712547133da414f9c9a855b9d0e50ac7147d0b5cb829923e11cbca3b38): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"369b0e712547133da414f9c9a855b9d0e50ac7147d0b5cb829923e11cbca3b38" Netns:"/var/run/netns/0ef64b83-96aa-4011-8bd8-49872e23d186" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=369b0e712547133da414f9c9a855b9d0e50ac7147d0b5cb829923e11cbca3b38;K8S_POD_UID=780ea907-dec5-426e-9de2-158f59c09f71" Path:"" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/780ea907-dec5-426e-9de2-158f59c09f71]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:42:38.602249 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:42:38.602249 master-0 kubenswrapper[8993]: > pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:42:38.603002 master-0 kubenswrapper[8993]: E1204 11:42:38.602265 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:42:38.603002 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_780ea907-dec5-426e-9de2-158f59c09f71_0(369b0e712547133da414f9c9a855b9d0e50ac7147d0b5cb829923e11cbca3b38): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"369b0e712547133da414f9c9a855b9d0e50ac7147d0b5cb829923e11cbca3b38" Netns:"/var/run/netns/0ef64b83-96aa-4011-8bd8-49872e23d186" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=369b0e712547133da414f9c9a855b9d0e50ac7147d0b5cb829923e11cbca3b38;K8S_POD_UID=780ea907-dec5-426e-9de2-158f59c09f71" Path:"" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/780ea907-dec5-426e-9de2-158f59c09f71]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:42:38.603002 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:42:38.603002 master-0 kubenswrapper[8993]: > pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:42:38.603002 master-0 kubenswrapper[8993]: E1204 11:42:38.602332 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"installer-4-master-0_openshift-kube-scheduler(780ea907-dec5-426e-9de2-158f59c09f71)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"installer-4-master-0_openshift-kube-scheduler(780ea907-dec5-426e-9de2-158f59c09f71)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_780ea907-dec5-426e-9de2-158f59c09f71_0(369b0e712547133da414f9c9a855b9d0e50ac7147d0b5cb829923e11cbca3b38): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"369b0e712547133da414f9c9a855b9d0e50ac7147d0b5cb829923e11cbca3b38\\\" Netns:\\\"/var/run/netns/0ef64b83-96aa-4011-8bd8-49872e23d186\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=369b0e712547133da414f9c9a855b9d0e50ac7147d0b5cb829923e11cbca3b38;K8S_POD_UID=780ea907-dec5-426e-9de2-158f59c09f71\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/780ea907-dec5-426e-9de2-158f59c09f71]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-kube-scheduler/installer-4-master-0" podUID="780ea907-dec5-426e-9de2-158f59c09f71" Dec 04 11:42:38.702368 master-0 kubenswrapper[8993]: E1204 11:42:38.702301 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:42:38.702368 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_controller-manager-6686654b8d-rrndk_openshift-controller-manager_24506aa4-ab78-49df-bb58-59093498f13d_0(2d160b6d52d8b992b0177da71ff6a4532495aa60365c9fbd31af5eef7c1b5925): error adding pod openshift-controller-manager_controller-manager-6686654b8d-rrndk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"2d160b6d52d8b992b0177da71ff6a4532495aa60365c9fbd31af5eef7c1b5925" Netns:"/var/run/netns/e76f4cd1-de22-49cc-8cce-dc93a58a95e5" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-controller-manager;K8S_POD_NAME=controller-manager-6686654b8d-rrndk;K8S_POD_INFRA_CONTAINER_ID=2d160b6d52d8b992b0177da71ff6a4532495aa60365c9fbd31af5eef7c1b5925;K8S_POD_UID=24506aa4-ab78-49df-bb58-59093498f13d" Path:"" ERRORED: error configuring pod [openshift-controller-manager/controller-manager-6686654b8d-rrndk] networking: Multus: [openshift-controller-manager/controller-manager-6686654b8d-rrndk/24506aa4-ab78-49df-bb58-59093498f13d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: SetNetworkStatus: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-controller-manager/pods/controller-manager-6686654b8d-rrndk?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:42:38.702368 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:42:38.702368 master-0 kubenswrapper[8993]: > Dec 04 11:42:38.702530 master-0 kubenswrapper[8993]: E1204 11:42:38.702416 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:42:38.702530 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_controller-manager-6686654b8d-rrndk_openshift-controller-manager_24506aa4-ab78-49df-bb58-59093498f13d_0(2d160b6d52d8b992b0177da71ff6a4532495aa60365c9fbd31af5eef7c1b5925): error adding pod openshift-controller-manager_controller-manager-6686654b8d-rrndk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"2d160b6d52d8b992b0177da71ff6a4532495aa60365c9fbd31af5eef7c1b5925" Netns:"/var/run/netns/e76f4cd1-de22-49cc-8cce-dc93a58a95e5" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-controller-manager;K8S_POD_NAME=controller-manager-6686654b8d-rrndk;K8S_POD_INFRA_CONTAINER_ID=2d160b6d52d8b992b0177da71ff6a4532495aa60365c9fbd31af5eef7c1b5925;K8S_POD_UID=24506aa4-ab78-49df-bb58-59093498f13d" Path:"" ERRORED: error configuring pod [openshift-controller-manager/controller-manager-6686654b8d-rrndk] networking: Multus: [openshift-controller-manager/controller-manager-6686654b8d-rrndk/24506aa4-ab78-49df-bb58-59093498f13d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: SetNetworkStatus: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-controller-manager/pods/controller-manager-6686654b8d-rrndk?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:42:38.702530 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:42:38.702530 master-0 kubenswrapper[8993]: > pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:42:38.702530 master-0 kubenswrapper[8993]: E1204 11:42:38.702454 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:42:38.702530 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_controller-manager-6686654b8d-rrndk_openshift-controller-manager_24506aa4-ab78-49df-bb58-59093498f13d_0(2d160b6d52d8b992b0177da71ff6a4532495aa60365c9fbd31af5eef7c1b5925): error adding pod openshift-controller-manager_controller-manager-6686654b8d-rrndk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"2d160b6d52d8b992b0177da71ff6a4532495aa60365c9fbd31af5eef7c1b5925" Netns:"/var/run/netns/e76f4cd1-de22-49cc-8cce-dc93a58a95e5" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-controller-manager;K8S_POD_NAME=controller-manager-6686654b8d-rrndk;K8S_POD_INFRA_CONTAINER_ID=2d160b6d52d8b992b0177da71ff6a4532495aa60365c9fbd31af5eef7c1b5925;K8S_POD_UID=24506aa4-ab78-49df-bb58-59093498f13d" Path:"" ERRORED: error configuring pod [openshift-controller-manager/controller-manager-6686654b8d-rrndk] networking: Multus: [openshift-controller-manager/controller-manager-6686654b8d-rrndk/24506aa4-ab78-49df-bb58-59093498f13d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: SetNetworkStatus: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-controller-manager/pods/controller-manager-6686654b8d-rrndk?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:42:38.702530 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:42:38.702530 master-0 kubenswrapper[8993]: > pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:42:38.702784 master-0 kubenswrapper[8993]: E1204 11:42:38.702537 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"controller-manager-6686654b8d-rrndk_openshift-controller-manager(24506aa4-ab78-49df-bb58-59093498f13d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"controller-manager-6686654b8d-rrndk_openshift-controller-manager(24506aa4-ab78-49df-bb58-59093498f13d)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_controller-manager-6686654b8d-rrndk_openshift-controller-manager_24506aa4-ab78-49df-bb58-59093498f13d_0(2d160b6d52d8b992b0177da71ff6a4532495aa60365c9fbd31af5eef7c1b5925): error adding pod openshift-controller-manager_controller-manager-6686654b8d-rrndk to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"2d160b6d52d8b992b0177da71ff6a4532495aa60365c9fbd31af5eef7c1b5925\\\" Netns:\\\"/var/run/netns/e76f4cd1-de22-49cc-8cce-dc93a58a95e5\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-controller-manager;K8S_POD_NAME=controller-manager-6686654b8d-rrndk;K8S_POD_INFRA_CONTAINER_ID=2d160b6d52d8b992b0177da71ff6a4532495aa60365c9fbd31af5eef7c1b5925;K8S_POD_UID=24506aa4-ab78-49df-bb58-59093498f13d\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-controller-manager/controller-manager-6686654b8d-rrndk] networking: Multus: [openshift-controller-manager/controller-manager-6686654b8d-rrndk/24506aa4-ab78-49df-bb58-59093498f13d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: SetNetworkStatus: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-controller-manager/pods/controller-manager-6686654b8d-rrndk?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" podUID="24506aa4-ab78-49df-bb58-59093498f13d" Dec 04 11:42:38.796460 master-0 kubenswrapper[8993]: I1204 11:42:38.796341 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-78f758c7b9-zgkh5_7e3160a9-11d1-4845-ba30-1a49ae7339a9/cluster-baremetal-operator/1.log" Dec 04 11:42:38.797668 master-0 kubenswrapper[8993]: I1204 11:42:38.797612 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-78f758c7b9-zgkh5_7e3160a9-11d1-4845-ba30-1a49ae7339a9/cluster-baremetal-operator/0.log" Dec 04 11:42:38.797731 master-0 kubenswrapper[8993]: I1204 11:42:38.797686 8993 generic.go:334] "Generic (PLEG): container finished" podID="7e3160a9-11d1-4845-ba30-1a49ae7339a9" containerID="5fa138fec5781e4f43a612b1bd94ac0c3aeea88a18ee976d82cc9fc5ee5a4d9a" exitCode=1 Dec 04 11:42:38.834691 master-0 kubenswrapper[8993]: E1204 11:42:38.834620 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:42:38.834691 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-rxhpq_openshift-marketplace_5ae25dd5-dfdb-42f6-97d0-14ad17743c95_0(2a08ae233b0c6df618013e5730e922895daf39d0d046d0e5a3e095a6944ada39): error adding pod openshift-marketplace_community-operators-rxhpq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"2a08ae233b0c6df618013e5730e922895daf39d0d046d0e5a3e095a6944ada39" Netns:"/var/run/netns/ab61f939-0bac-4447-a61f-6ec731121164" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-rxhpq;K8S_POD_INFRA_CONTAINER_ID=2a08ae233b0c6df618013e5730e922895daf39d0d046d0e5a3e095a6944ada39;K8S_POD_UID=5ae25dd5-dfdb-42f6-97d0-14ad17743c95" Path:"" ERRORED: error configuring pod [openshift-marketplace/community-operators-rxhpq] networking: Multus: [openshift-marketplace/community-operators-rxhpq/5ae25dd5-dfdb-42f6-97d0-14ad17743c95]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-rxhpq in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-rxhpq in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-rxhpq?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:42:38.834691 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:42:38.834691 master-0 kubenswrapper[8993]: > Dec 04 11:42:38.834897 master-0 kubenswrapper[8993]: E1204 11:42:38.834720 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:42:38.834897 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-rxhpq_openshift-marketplace_5ae25dd5-dfdb-42f6-97d0-14ad17743c95_0(2a08ae233b0c6df618013e5730e922895daf39d0d046d0e5a3e095a6944ada39): error adding pod openshift-marketplace_community-operators-rxhpq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"2a08ae233b0c6df618013e5730e922895daf39d0d046d0e5a3e095a6944ada39" Netns:"/var/run/netns/ab61f939-0bac-4447-a61f-6ec731121164" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-rxhpq;K8S_POD_INFRA_CONTAINER_ID=2a08ae233b0c6df618013e5730e922895daf39d0d046d0e5a3e095a6944ada39;K8S_POD_UID=5ae25dd5-dfdb-42f6-97d0-14ad17743c95" Path:"" ERRORED: error configuring pod [openshift-marketplace/community-operators-rxhpq] networking: Multus: [openshift-marketplace/community-operators-rxhpq/5ae25dd5-dfdb-42f6-97d0-14ad17743c95]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-rxhpq in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-rxhpq in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-rxhpq?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:42:38.834897 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:42:38.834897 master-0 kubenswrapper[8993]: > pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:42:38.834897 master-0 kubenswrapper[8993]: E1204 11:42:38.834743 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:42:38.834897 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-rxhpq_openshift-marketplace_5ae25dd5-dfdb-42f6-97d0-14ad17743c95_0(2a08ae233b0c6df618013e5730e922895daf39d0d046d0e5a3e095a6944ada39): error adding pod openshift-marketplace_community-operators-rxhpq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"2a08ae233b0c6df618013e5730e922895daf39d0d046d0e5a3e095a6944ada39" Netns:"/var/run/netns/ab61f939-0bac-4447-a61f-6ec731121164" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-rxhpq;K8S_POD_INFRA_CONTAINER_ID=2a08ae233b0c6df618013e5730e922895daf39d0d046d0e5a3e095a6944ada39;K8S_POD_UID=5ae25dd5-dfdb-42f6-97d0-14ad17743c95" Path:"" ERRORED: error configuring pod [openshift-marketplace/community-operators-rxhpq] networking: Multus: [openshift-marketplace/community-operators-rxhpq/5ae25dd5-dfdb-42f6-97d0-14ad17743c95]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-rxhpq in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-rxhpq in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-rxhpq?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:42:38.834897 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:42:38.834897 master-0 kubenswrapper[8993]: > pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:42:38.834897 master-0 kubenswrapper[8993]: E1204 11:42:38.834827 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"community-operators-rxhpq_openshift-marketplace(5ae25dd5-dfdb-42f6-97d0-14ad17743c95)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"community-operators-rxhpq_openshift-marketplace(5ae25dd5-dfdb-42f6-97d0-14ad17743c95)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-rxhpq_openshift-marketplace_5ae25dd5-dfdb-42f6-97d0-14ad17743c95_0(2a08ae233b0c6df618013e5730e922895daf39d0d046d0e5a3e095a6944ada39): error adding pod openshift-marketplace_community-operators-rxhpq to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"2a08ae233b0c6df618013e5730e922895daf39d0d046d0e5a3e095a6944ada39\\\" Netns:\\\"/var/run/netns/ab61f939-0bac-4447-a61f-6ec731121164\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-rxhpq;K8S_POD_INFRA_CONTAINER_ID=2a08ae233b0c6df618013e5730e922895daf39d0d046d0e5a3e095a6944ada39;K8S_POD_UID=5ae25dd5-dfdb-42f6-97d0-14ad17743c95\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-marketplace/community-operators-rxhpq] networking: Multus: [openshift-marketplace/community-operators-rxhpq/5ae25dd5-dfdb-42f6-97d0-14ad17743c95]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-rxhpq in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-rxhpq in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-rxhpq?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-marketplace/community-operators-rxhpq" podUID="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" Dec 04 11:42:38.884081 master-0 kubenswrapper[8993]: E1204 11:42:38.883248 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 11:42:38.900019 master-0 kubenswrapper[8993]: E1204 11:42:38.899919 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:42:38.900019 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_38e7be62-e4f5-42ba-89f0-83aca874a092_0(d1537d2edd419ed8b01c58612db0b8ec6b2e006099ec1b3cdcd856307a088d63): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"d1537d2edd419ed8b01c58612db0b8ec6b2e006099ec1b3cdcd856307a088d63" Netns:"/var/run/netns/5a243ddf-ba4d-40c2-894c-e6b946852288" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=d1537d2edd419ed8b01c58612db0b8ec6b2e006099ec1b3cdcd856307a088d63;K8S_POD_UID=38e7be62-e4f5-42ba-89f0-83aca874a092" Path:"" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/38e7be62-e4f5-42ba-89f0-83aca874a092]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:42:38.900019 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:42:38.900019 master-0 kubenswrapper[8993]: > Dec 04 11:42:38.900208 master-0 kubenswrapper[8993]: E1204 11:42:38.900060 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:42:38.900208 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_38e7be62-e4f5-42ba-89f0-83aca874a092_0(d1537d2edd419ed8b01c58612db0b8ec6b2e006099ec1b3cdcd856307a088d63): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"d1537d2edd419ed8b01c58612db0b8ec6b2e006099ec1b3cdcd856307a088d63" Netns:"/var/run/netns/5a243ddf-ba4d-40c2-894c-e6b946852288" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=d1537d2edd419ed8b01c58612db0b8ec6b2e006099ec1b3cdcd856307a088d63;K8S_POD_UID=38e7be62-e4f5-42ba-89f0-83aca874a092" Path:"" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/38e7be62-e4f5-42ba-89f0-83aca874a092]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:42:38.900208 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:42:38.900208 master-0 kubenswrapper[8993]: > pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:42:38.900208 master-0 kubenswrapper[8993]: E1204 11:42:38.900089 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:42:38.900208 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_38e7be62-e4f5-42ba-89f0-83aca874a092_0(d1537d2edd419ed8b01c58612db0b8ec6b2e006099ec1b3cdcd856307a088d63): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"d1537d2edd419ed8b01c58612db0b8ec6b2e006099ec1b3cdcd856307a088d63" Netns:"/var/run/netns/5a243ddf-ba4d-40c2-894c-e6b946852288" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=d1537d2edd419ed8b01c58612db0b8ec6b2e006099ec1b3cdcd856307a088d63;K8S_POD_UID=38e7be62-e4f5-42ba-89f0-83aca874a092" Path:"" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/38e7be62-e4f5-42ba-89f0-83aca874a092]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:42:38.900208 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:42:38.900208 master-0 kubenswrapper[8993]: > pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:42:38.900432 master-0 kubenswrapper[8993]: E1204 11:42:38.900172 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"installer-2-master-0_openshift-kube-controller-manager(38e7be62-e4f5-42ba-89f0-83aca874a092)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"installer-2-master-0_openshift-kube-controller-manager(38e7be62-e4f5-42ba-89f0-83aca874a092)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_38e7be62-e4f5-42ba-89f0-83aca874a092_0(d1537d2edd419ed8b01c58612db0b8ec6b2e006099ec1b3cdcd856307a088d63): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"d1537d2edd419ed8b01c58612db0b8ec6b2e006099ec1b3cdcd856307a088d63\\\" Netns:\\\"/var/run/netns/5a243ddf-ba4d-40c2-894c-e6b946852288\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=d1537d2edd419ed8b01c58612db0b8ec6b2e006099ec1b3cdcd856307a088d63;K8S_POD_UID=38e7be62-e4f5-42ba-89f0-83aca874a092\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/38e7be62-e4f5-42ba-89f0-83aca874a092]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-kube-controller-manager/installer-2-master-0" podUID="38e7be62-e4f5-42ba-89f0-83aca874a092" Dec 04 11:42:38.907486 master-0 kubenswrapper[8993]: E1204 11:42:38.907382 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:42:38.907486 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_certified-operators-8qs8v_openshift-marketplace_b620f29d-dcde-4f98-9fb6-dd479dcdcf7c_0(a2f1cab9913e82565ffcd50d70d2eba4367c89704fc9961444619678bf490ab9): error adding pod openshift-marketplace_certified-operators-8qs8v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"a2f1cab9913e82565ffcd50d70d2eba4367c89704fc9961444619678bf490ab9" Netns:"/var/run/netns/fb614bdf-d900-473a-9d5e-c49d2ba563da" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=certified-operators-8qs8v;K8S_POD_INFRA_CONTAINER_ID=a2f1cab9913e82565ffcd50d70d2eba4367c89704fc9961444619678bf490ab9;K8S_POD_UID=b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" Path:"" ERRORED: error configuring pod [openshift-marketplace/certified-operators-8qs8v] networking: Multus: [openshift-marketplace/certified-operators-8qs8v/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod certified-operators-8qs8v in out of cluster comm: SetNetworkStatus: failed to update the pod certified-operators-8qs8v in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/certified-operators-8qs8v?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:42:38.907486 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:42:38.907486 master-0 kubenswrapper[8993]: > Dec 04 11:42:38.907697 master-0 kubenswrapper[8993]: E1204 11:42:38.907543 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:42:38.907697 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_certified-operators-8qs8v_openshift-marketplace_b620f29d-dcde-4f98-9fb6-dd479dcdcf7c_0(a2f1cab9913e82565ffcd50d70d2eba4367c89704fc9961444619678bf490ab9): error adding pod openshift-marketplace_certified-operators-8qs8v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"a2f1cab9913e82565ffcd50d70d2eba4367c89704fc9961444619678bf490ab9" Netns:"/var/run/netns/fb614bdf-d900-473a-9d5e-c49d2ba563da" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=certified-operators-8qs8v;K8S_POD_INFRA_CONTAINER_ID=a2f1cab9913e82565ffcd50d70d2eba4367c89704fc9961444619678bf490ab9;K8S_POD_UID=b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" Path:"" ERRORED: error configuring pod [openshift-marketplace/certified-operators-8qs8v] networking: Multus: [openshift-marketplace/certified-operators-8qs8v/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod certified-operators-8qs8v in out of cluster comm: SetNetworkStatus: failed to update the pod certified-operators-8qs8v in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/certified-operators-8qs8v?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:42:38.907697 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:42:38.907697 master-0 kubenswrapper[8993]: > pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:42:38.907697 master-0 kubenswrapper[8993]: E1204 11:42:38.907574 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:42:38.907697 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_certified-operators-8qs8v_openshift-marketplace_b620f29d-dcde-4f98-9fb6-dd479dcdcf7c_0(a2f1cab9913e82565ffcd50d70d2eba4367c89704fc9961444619678bf490ab9): error adding pod openshift-marketplace_certified-operators-8qs8v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"a2f1cab9913e82565ffcd50d70d2eba4367c89704fc9961444619678bf490ab9" Netns:"/var/run/netns/fb614bdf-d900-473a-9d5e-c49d2ba563da" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=certified-operators-8qs8v;K8S_POD_INFRA_CONTAINER_ID=a2f1cab9913e82565ffcd50d70d2eba4367c89704fc9961444619678bf490ab9;K8S_POD_UID=b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" Path:"" ERRORED: error configuring pod [openshift-marketplace/certified-operators-8qs8v] networking: Multus: [openshift-marketplace/certified-operators-8qs8v/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod certified-operators-8qs8v in out of cluster comm: SetNetworkStatus: failed to update the pod certified-operators-8qs8v in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/certified-operators-8qs8v?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:42:38.907697 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:42:38.907697 master-0 kubenswrapper[8993]: > pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:42:38.907960 master-0 kubenswrapper[8993]: E1204 11:42:38.907697 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"certified-operators-8qs8v_openshift-marketplace(b620f29d-dcde-4f98-9fb6-dd479dcdcf7c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"certified-operators-8qs8v_openshift-marketplace(b620f29d-dcde-4f98-9fb6-dd479dcdcf7c)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_certified-operators-8qs8v_openshift-marketplace_b620f29d-dcde-4f98-9fb6-dd479dcdcf7c_0(a2f1cab9913e82565ffcd50d70d2eba4367c89704fc9961444619678bf490ab9): error adding pod openshift-marketplace_certified-operators-8qs8v to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"a2f1cab9913e82565ffcd50d70d2eba4367c89704fc9961444619678bf490ab9\\\" Netns:\\\"/var/run/netns/fb614bdf-d900-473a-9d5e-c49d2ba563da\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=certified-operators-8qs8v;K8S_POD_INFRA_CONTAINER_ID=a2f1cab9913e82565ffcd50d70d2eba4367c89704fc9961444619678bf490ab9;K8S_POD_UID=b620f29d-dcde-4f98-9fb6-dd479dcdcf7c\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-marketplace/certified-operators-8qs8v] networking: Multus: [openshift-marketplace/certified-operators-8qs8v/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod certified-operators-8qs8v in out of cluster comm: SetNetworkStatus: failed to update the pod certified-operators-8qs8v in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/certified-operators-8qs8v?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-marketplace/certified-operators-8qs8v" podUID="b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" Dec 04 11:42:39.494195 master-0 kubenswrapper[8993]: E1204 11:42:39.493871 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:42:29Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:42:29Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:42:29Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:42:29Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3e65409fc2b27ad0aaeb500a39e264663d2980821f099b830b551785ce4ce8b\\\"],\\\"sizeBytes\\\":1631758507},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:2efbb545a141552851226bea008b13d92cbb084339bcfd6923b38d23c382145e\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:e5c3ad640f9c0c84490a0e0da7a1850b7873867936a5b604c07a8075c3a710d0\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1610175307},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9014f384de5f9a0b7418d5869ad349abb9588d16bd09ed650a163c045315dbff\\\"],\\\"sizeBytes\\\":1232140918},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:98141b7d0b74195f511ccd4c41ba6c8a69fef01f22b2fb8ef2d024109e93a3a9\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:bd4a56267fe7d489c5a0705c4b9f5c43170dd39b6684e2497a49c5416ae6e14f\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1205106509},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:9eadf94ba5e517edf53c9b21d83f18cb3790ddc768f10d0ca92be97c56a0eecb\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:e096abcd79df184b3151d2fe670d52596bae8c1f2d1fa8851c41821afe1ba59e\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1201434959},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:e8990432556acad31519b1a73ec32f32d27c2034cf9e5cc4db8980efc7331594\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:ebe9f523f5c211a3a0f2570331dddcd5be15b12c1fecd9b8b121f881bfaad029\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.18\\\"],\\\"sizeBytes\\\":1129027903},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b472823604757237c2d16bd6f6221f4cf562aa3b05942c7f602e1e8b2e55a7c6\\\"],\\\"sizeBytes\\\":983705650},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d5891cdd7dcf7c9081de8b364b4c96446b7f946f7880fbae291a4592a198264\\\"],\\\"sizeBytes\\\":938303566},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:01d2e67fd74086da701c39dac5b821822351cb0151f9afe72821c05df19953ad\\\"],\\\"sizeBytes\\\":912722556},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:61664aa69b33349cc6de45e44ae6033e7f483c034ea01c0d9a8ca08a12d88e3a\\\"],\\\"sizeBytes\\\":874825223},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:631a3798b749fecc041a99929eb946618df723e15055e805ff752a1a1273481c\\\"],\\\"sizeBytes\\\":870567329},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1ca78c423f43f89a0411e40393642f64e4f8df9e5f61c25e31047c4cce170f9\\\"],\\\"sizeBytes\\\":857069957},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b12f830c3316aa4dc061c2d00c74126282b3e2bcccc301eab00d57fff3c4c7c\\\"],\\\"sizeBytes\\\":767284906},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cb3ec61f9a932a9ad13bdeb44bcf9477a8d5f728151d7f19ed3ef7d4b02b3a82\\\"],\\\"sizeBytes\\\":682371258},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:916566bb9d0143352324233d460ad94697719c11c8c9158e3aea8f475941751f\\\"],\\\"sizeBytes\\\":677523572},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5451aa441e5b8d8689c032405d410c8049a849ef2edf77e5b6a5ce2838c6569b\\\"],\\\"sizeBytes\\\":672407260},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9724d2036305cbd729e1f484c5bad89971de977fff8a6723fef1873858dd1123\\\"],\\\"sizeBytes\\\":616108962},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:df606f3b71d4376d1a2108c09f0d3dab455fc30bcb67c60e91590c105e9025bf\\\"],\\\"sizeBytes\\\":583836304},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79f99fd6cce984287932edf0d009660bb488d663081f3d62ec3b23bc8bfbf6c2\\\"],\\\"sizeBytes\\\":576619763},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eddedae7578d79b5a3f748000ae5c00b9f14a04710f9f9ec7b52fc569be5dfb8\\\"],\\\"sizeBytes\\\":552673986},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dd38b8be3af889b0f97e2df41517c89a11260901432a9a1ee943195bb3a22737\\\"],\\\"sizeBytes\\\":551889548},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:aa24edce3d740f84c40018e94cdbf2bc7375268d13d57c2d664e43a46ccea3fc\\\"],\\\"sizeBytes\\\":543227406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:188637a52cafee61ec461e92fb0c605e28be325b9ac1f2ac8a37d68e97654718\\\"],\\\"sizeBytes\\\":532719167},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde59e48cd5dee3721f34d249cb119cc3259fd857965d34f9c7ed83b0c363a1\\\"],\\\"sizeBytes\\\":532402162},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f4d4282cb53325e737ad68abbfcb70687ae04fb50353f4f0ba0ba5703b15009a\\\"],\\\"sizeBytes\\\":512838054},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-release@sha256:8c885ea0b3c5124989f0a9b93eba98eb9fca6bbd0262772d85d90bf713a4d572\\\"],\\\"sizeBytes\\\":512452153},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0f43c31aa3359159d4557dad3cfaf812d8ce44db9cb9ae970e06d3479070b660\\\"],\\\"sizeBytes\\\":509437356},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:97d26892192b552c16527bf2771e1b86528ab581a02dd9279cdf71c194830e3e\\\"],\\\"sizeBytes\\\":508042119},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e85850a4ae1a1e3ec2c590a4936d640882b6550124da22031c85b526afbf52df\\\"],\\\"sizeBytes\\\":507687221},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8375671da86aa527ee7e291d86971b0baa823ffc7663b5a983084456e76c0f59\\\"],\\\"sizeBytes\\\":506741476},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:831f30660844091d6154e2674d3a9da6f34271bf8a2c40b56f7416066318742b\\\"],\\\"sizeBytes\\\":505649178},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:86af77350cfe6fd69280157e4162aa0147873d9431c641ae4ad3e881ff768a73\\\"],\\\"sizeBytes\\\":505628211},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a824e468cf8dd61d347e35b2ee5bc2f815666957647098e21a1bb56ff613e5b9\\\"],\\\"sizeBytes\\\":503340749},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8139ed65c0a0a4b0f253b715c11cc52be027efe8a4774da9ccce35c78ef439da\\\"],\\\"sizeBytes\\\":503011144},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8eabac819f289e29d75c7ab172d8124554849a47f0b00770928c3eb19a5a31c4\\\"],\\\"sizeBytes\\\":502436444},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:10e57ca7611f79710f05777dc6a8f31c7e04eb09da4d8d793a5acfbf0e4692d7\\\"],\\\"sizeBytes\\\":500943492},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f042fa25014f3d37f3ea967d21f361d2a11833ae18f2c750318101b25d2497ce\\\"],\\\"sizeBytes\\\":500848684},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91af633e585621630c40d14f188e37d36b44678d0a59e582d850bf8d593d3a0c\\\"],\\\"sizeBytes\\\":499798563},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d64c13fe7663a0b4ae61d103b1b7598adcf317a01826f296bcb66b1a2de83c96\\\"],\\\"sizeBytes\\\":499705918},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:33a20002692769235e95271ab071783c57ff50681088fa1035b86af31e73cf20\\\"],\\\"sizeBytes\\\":499125567},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:75d996f6147edb88c09fd1a052099de66638590d7d03a735006244bc9e19f898\\\"],\\\"sizeBytes\\\":499082775},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3b8d91a25eeb9f02041e947adb3487da3e7ab8449d3d2ad015827e7954df7b34\\\"],\\\"sizeBytes\\\":490455952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1f952cec1e5332b84bdffa249cd426f39087058d6544ddcec650a414c15a9b68\\\"],\\\"sizeBytes\\\":489528665},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c416b201d480bddb5a4960ec42f4740761a1335001cf84ba5ae19ad6857771b1\\\"],\\\"sizeBytes\\\":481559117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c3a77aa4d03b89ea284e3467a268e5989a77a2ef63e685eb1d5c5ea5b3922b7a\\\"],\\\"sizeBytes\\\":478917802},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eb928c13a46d3fb45f4a881892d023a92d610a5430be0ffd916aaf8da8e7d297\\\"],\\\"sizeBytes\\\":478642572},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a92c310ce30dcb3de85d6aac868e0d80919670fa29ef83d55edd96b0cae35563\\\"],\\\"sizeBytes\\\":465285478},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fd3e9f8f00a59bda7483ec7dc8a0ed602f9ca30e3d72b22072dbdf2819da3f61\\\"],\\\"sizeBytes\\\":465144618},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3c1edf52f70bf9b1d1457e0c4111bc79cdaa1edd659ddbdb9d8176eff8b46956\\\"],\\\"sizeBytes\\\":462727837},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8cc27777e72233024fe84ee1faa168aec715a0b24912a3ce70715ddccba328df\\\"],\\\"sizeBytes\\\":461702648}]}}\" for node \"master-0\": Patch \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0/status?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:42:39.813128 master-0 kubenswrapper[8993]: I1204 11:42:39.813018 8993 generic.go:334] "Generic (PLEG): container finished" podID="8b47694fcc32464ab24d09c23d6efb57" containerID="d63039df99a06e3559d65dad05cc9c8b2039b1a8f335a3c51eec53ca5b198558" exitCode=1 Dec 04 11:42:42.844838 master-0 kubenswrapper[8993]: I1204 11:42:42.844739 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/1.log" Dec 04 11:42:42.845562 master-0 kubenswrapper[8993]: I1204 11:42:42.845522 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/0.log" Dec 04 11:42:42.845622 master-0 kubenswrapper[8993]: I1204 11:42:42.845578 8993 generic.go:334] "Generic (PLEG): container finished" podID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" containerID="5601978092c465a26e532b8cb8f66b5633a31c07893435c149ed0029a0397280" exitCode=1 Dec 04 11:42:45.794894 master-0 kubenswrapper[8993]: I1204 11:42:45.794793 8993 kubelet.go:1505] "Image garbage collection succeeded" Dec 04 11:42:45.918328 master-0 kubenswrapper[8993]: E1204 11:42:45.918235 8993 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:42:45.918667 master-0 kubenswrapper[8993]: E1204 11:42:45.918546 8993 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="34.014s" Dec 04 11:42:45.918667 master-0 kubenswrapper[8993]: I1204 11:42:45.918593 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-krbbd" Dec 04 11:42:45.918667 master-0 kubenswrapper[8993]: I1204 11:42:45.918621 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-krbbd" Dec 04 11:42:45.918667 master-0 kubenswrapper[8993]: I1204 11:42:45.918639 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:42:45.918853 master-0 kubenswrapper[8993]: I1204 11:42:45.918712 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:42:45.918853 master-0 kubenswrapper[8993]: I1204 11:42:45.918847 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-krbbd" Dec 04 11:42:45.918914 master-0 kubenswrapper[8993]: I1204 11:42:45.918861 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:42:45.921834 master-0 kubenswrapper[8993]: I1204 11:42:45.921729 8993 scope.go:117] "RemoveContainer" containerID="d63039df99a06e3559d65dad05cc9c8b2039b1a8f335a3c51eec53ca5b198558" Dec 04 11:42:45.922123 master-0 kubenswrapper[8993]: E1204 11:42:45.922073 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-controller-manager pod=bootstrap-kube-controller-manager-master-0_kube-system(8b47694fcc32464ab24d09c23d6efb57)\"" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" Dec 04 11:42:45.927484 master-0 kubenswrapper[8993]: I1204 11:42:45.927399 8993 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0-master-0" podUID="" Dec 04 11:42:49.236559 master-0 kubenswrapper[8993]: E1204 11:42:49.236412 8993 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event=< Dec 04 11:42:49.236559 master-0 kubenswrapper[8993]: &Event{ObjectMeta:{etcd-operator-5bf4d88c6f-2bpmr.187e003b3c481755 openshift-etcd-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd-operator,Name:etcd-operator-5bf4d88c6f-2bpmr,UID:c6e9271a-44ea-4612-ab60-4a9d489ed062,APIVersion:v1,ResourceVersion:3813,FieldPath:spec.containers{etcd-operator},},Reason:ProbeError,Message:Liveness probe error: Get "https://10.128.0.21:8443/healthz": dial tcp 10.128.0.21:8443: connect: connection refused Dec 04 11:42:49.236559 master-0 kubenswrapper[8993]: body: Dec 04 11:42:49.236559 master-0 kubenswrapper[8993]: ,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:39:18.390241109 +0000 UTC m=+92.781182542,LastTimestamp:2025-12-04 11:39:18.390241109 +0000 UTC m=+92.781182542,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,} Dec 04 11:42:49.236559 master-0 kubenswrapper[8993]: > Dec 04 11:42:49.285440 master-0 kubenswrapper[8993]: I1204 11:42:49.285348 8993 patch_prober.go:28] interesting pod/authentication-operator-6c968fdfdf-nrrfw container/authentication-operator namespace/openshift-authentication-operator: Liveness probe status=failure output="Get \"https://10.128.0.11:8443/healthz\": dial tcp 10.128.0.11:8443: connect: connection refused" start-of-body= Dec 04 11:42:49.286055 master-0 kubenswrapper[8993]: I1204 11:42:49.285998 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" podUID="42b3be0f-1d82-4a64-abb4-0118a6960efd" containerName="authentication-operator" probeResult="failure" output="Get \"https://10.128.0.11:8443/healthz\": dial tcp 10.128.0.11:8443: connect: connection refused" Dec 04 11:42:49.495654 master-0 kubenswrapper[8993]: E1204 11:42:49.495444 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:42:52.041112 master-0 kubenswrapper[8993]: I1204 11:42:52.041011 8993 status_manager.go:851] "Failed to get status for pod" podUID="f797ab14-0eb5-48b4-b914-f434f67c4c49" pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" err="the server was unable to return a response in the time allotted, but may still be processing the request (get pods cluster-storage-operator-dcf7fc84b-fncfd)" Dec 04 11:42:55.884024 master-0 kubenswrapper[8993]: E1204 11:42:55.883882 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": context deadline exceeded" interval="7s" Dec 04 11:42:59.285333 master-0 kubenswrapper[8993]: I1204 11:42:59.285238 8993 patch_prober.go:28] interesting pod/authentication-operator-6c968fdfdf-nrrfw container/authentication-operator namespace/openshift-authentication-operator: Liveness probe status=failure output="Get \"https://10.128.0.11:8443/healthz\": dial tcp 10.128.0.11:8443: connect: connection refused" start-of-body= Dec 04 11:42:59.285333 master-0 kubenswrapper[8993]: I1204 11:42:59.285323 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" podUID="42b3be0f-1d82-4a64-abb4-0118a6960efd" containerName="authentication-operator" probeResult="failure" output="Get \"https://10.128.0.11:8443/healthz\": dial tcp 10.128.0.11:8443: connect: connection refused" Dec 04 11:42:59.495853 master-0 kubenswrapper[8993]: E1204 11:42:59.495755 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:43:03.204548 master-0 kubenswrapper[8993]: E1204 11:43:03.204477 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:43:03.204548 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(97bd237a7b73814f3563223ef08fe64c059bb01e4f8387a182eaaae722ea06a1): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"97bd237a7b73814f3563223ef08fe64c059bb01e4f8387a182eaaae722ea06a1" Netns:"/var/run/netns/577c5238-fde8-4e8e-9202-5e640ae52ce7" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=97bd237a7b73814f3563223ef08fe64c059bb01e4f8387a182eaaae722ea06a1;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378" Path:"" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:43:03.204548 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:43:03.204548 master-0 kubenswrapper[8993]: > Dec 04 11:43:03.205099 master-0 kubenswrapper[8993]: E1204 11:43:03.204575 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:43:03.205099 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(97bd237a7b73814f3563223ef08fe64c059bb01e4f8387a182eaaae722ea06a1): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"97bd237a7b73814f3563223ef08fe64c059bb01e4f8387a182eaaae722ea06a1" Netns:"/var/run/netns/577c5238-fde8-4e8e-9202-5e640ae52ce7" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=97bd237a7b73814f3563223ef08fe64c059bb01e4f8387a182eaaae722ea06a1;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378" Path:"" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:43:03.205099 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:43:03.205099 master-0 kubenswrapper[8993]: > pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:43:03.205099 master-0 kubenswrapper[8993]: E1204 11:43:03.204602 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:43:03.205099 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(97bd237a7b73814f3563223ef08fe64c059bb01e4f8387a182eaaae722ea06a1): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"97bd237a7b73814f3563223ef08fe64c059bb01e4f8387a182eaaae722ea06a1" Netns:"/var/run/netns/577c5238-fde8-4e8e-9202-5e640ae52ce7" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=97bd237a7b73814f3563223ef08fe64c059bb01e4f8387a182eaaae722ea06a1;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378" Path:"" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:43:03.205099 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:43:03.205099 master-0 kubenswrapper[8993]: > pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:43:03.205099 master-0 kubenswrapper[8993]: E1204 11:43:03.204667 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"machine-api-operator-88d48b57d-9fjtd_openshift-machine-api(c50317d3-f7cd-4133-845e-44add57ac378)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"machine-api-operator-88d48b57d-9fjtd_openshift-machine-api(c50317d3-f7cd-4133-845e-44add57ac378)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(97bd237a7b73814f3563223ef08fe64c059bb01e4f8387a182eaaae722ea06a1): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"97bd237a7b73814f3563223ef08fe64c059bb01e4f8387a182eaaae722ea06a1\\\" Netns:\\\"/var/run/netns/577c5238-fde8-4e8e-9202-5e640ae52ce7\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=97bd237a7b73814f3563223ef08fe64c059bb01e4f8387a182eaaae722ea06a1;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" podUID="c50317d3-f7cd-4133-845e-44add57ac378" Dec 04 11:43:03.982377 master-0 kubenswrapper[8993]: I1204 11:43:03.982295 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:43:03.983069 master-0 kubenswrapper[8993]: I1204 11:43:03.983036 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:43:09.020475 master-0 kubenswrapper[8993]: I1204 11:43:09.020407 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_cluster-storage-operator-dcf7fc84b-fncfd_f797ab14-0eb5-48b4-b914-f434f67c4c49/cluster-storage-operator/1.log" Dec 04 11:43:09.022303 master-0 kubenswrapper[8993]: I1204 11:43:09.022246 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_cluster-storage-operator-dcf7fc84b-fncfd_f797ab14-0eb5-48b4-b914-f434f67c4c49/cluster-storage-operator/0.log" Dec 04 11:43:09.022415 master-0 kubenswrapper[8993]: I1204 11:43:09.022339 8993 generic.go:334] "Generic (PLEG): container finished" podID="f797ab14-0eb5-48b4-b914-f434f67c4c49" containerID="3a28dcf3ab15a5ab11146a0fd47986bde79e431316166b88f994d0a65f348758" exitCode=255 Dec 04 11:43:09.024731 master-0 kubenswrapper[8993]: I1204 11:43:09.024660 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-6c8676f99d-7z948_3322cc5a-f1f7-4522-b423-19fb7f38cd43/openshift-controller-manager-operator/2.log" Dec 04 11:43:09.025606 master-0 kubenswrapper[8993]: I1204 11:43:09.025529 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-6c8676f99d-7z948_3322cc5a-f1f7-4522-b423-19fb7f38cd43/openshift-controller-manager-operator/1.log" Dec 04 11:43:09.026802 master-0 kubenswrapper[8993]: I1204 11:43:09.026763 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-6c8676f99d-7z948_3322cc5a-f1f7-4522-b423-19fb7f38cd43/openshift-controller-manager-operator/0.log" Dec 04 11:43:09.027096 master-0 kubenswrapper[8993]: I1204 11:43:09.027059 8993 generic.go:334] "Generic (PLEG): container finished" podID="3322cc5a-f1f7-4522-b423-19fb7f38cd43" containerID="6877d7c7591492108bb34420d09a7376ef5637c76a3beefad5f4c2e362c72978" exitCode=255 Dec 04 11:43:09.029559 master-0 kubenswrapper[8993]: I1204 11:43:09.029493 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver-operator_kube-apiserver-operator-765d9ff747-gr68k_ccf81538-4d5a-4c26-8e54-fe39331a625d/kube-apiserver-operator/1.log" Dec 04 11:43:09.030140 master-0 kubenswrapper[8993]: I1204 11:43:09.030087 8993 generic.go:334] "Generic (PLEG): container finished" podID="ccf81538-4d5a-4c26-8e54-fe39331a625d" containerID="6740e091e7513192b7c4fc2e37bc11133fd10dfdaf1d0800e4f08d8808fea4fc" exitCode=255 Dec 04 11:43:09.032187 master-0 kubenswrapper[8993]: I1204 11:43:09.032119 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-apiserver-operator_openshift-apiserver-operator-7bf7f6b755-sh6qf_a5b826c3-8638-4cf5-b974-b24e4282ce00/openshift-apiserver-operator/1.log" Dec 04 11:43:09.032721 master-0 kubenswrapper[8993]: I1204 11:43:09.032668 8993 generic.go:334] "Generic (PLEG): container finished" podID="a5b826c3-8638-4cf5-b974-b24e4282ce00" containerID="bc1d5c88553d9975dfd695327c0f71abfbae1a4a9e554283b59af5847061176e" exitCode=255 Dec 04 11:43:09.284392 master-0 kubenswrapper[8993]: I1204 11:43:09.284250 8993 patch_prober.go:28] interesting pod/authentication-operator-6c968fdfdf-nrrfw container/authentication-operator namespace/openshift-authentication-operator: Liveness probe status=failure output="Get \"https://10.128.0.11:8443/healthz\": dial tcp 10.128.0.11:8443: connect: connection refused" start-of-body= Dec 04 11:43:09.284392 master-0 kubenswrapper[8993]: I1204 11:43:09.284352 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" podUID="42b3be0f-1d82-4a64-abb4-0118a6960efd" containerName="authentication-operator" probeResult="failure" output="Get \"https://10.128.0.11:8443/healthz\": dial tcp 10.128.0.11:8443: connect: connection refused" Dec 04 11:43:09.496798 master-0 kubenswrapper[8993]: E1204 11:43:09.496730 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:43:12.639009 master-0 kubenswrapper[8993]: E1204 11:43:12.638898 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:43:12.639009 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager_855d7874-16b1-47d0-82f6-d2b0c89b9a84_0(50d5ddf79bd5de442fb43ec994762ef41de345f87e9c87e14eaf6c0f2b22e980): error adding pod openshift-operator-lifecycle-manager_packageserver-675f5c767c-mtdrq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"50d5ddf79bd5de442fb43ec994762ef41de345f87e9c87e14eaf6c0f2b22e980" Netns:"/var/run/netns/9708ead0-bfd0-4a87-9250-4e5efff45dab" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-operator-lifecycle-manager;K8S_POD_NAME=packageserver-675f5c767c-mtdrq;K8S_POD_INFRA_CONTAINER_ID=50d5ddf79bd5de442fb43ec994762ef41de345f87e9c87e14eaf6c0f2b22e980;K8S_POD_UID=855d7874-16b1-47d0-82f6-d2b0c89b9a84" Path:"" ERRORED: error configuring pod [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq] networking: Multus: [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq/855d7874-16b1-47d0-82f6-d2b0c89b9a84]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: SetNetworkStatus: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-operator-lifecycle-manager/pods/packageserver-675f5c767c-mtdrq?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:43:12.639009 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:43:12.639009 master-0 kubenswrapper[8993]: > Dec 04 11:43:12.640222 master-0 kubenswrapper[8993]: E1204 11:43:12.639088 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:43:12.640222 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager_855d7874-16b1-47d0-82f6-d2b0c89b9a84_0(50d5ddf79bd5de442fb43ec994762ef41de345f87e9c87e14eaf6c0f2b22e980): error adding pod openshift-operator-lifecycle-manager_packageserver-675f5c767c-mtdrq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"50d5ddf79bd5de442fb43ec994762ef41de345f87e9c87e14eaf6c0f2b22e980" Netns:"/var/run/netns/9708ead0-bfd0-4a87-9250-4e5efff45dab" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-operator-lifecycle-manager;K8S_POD_NAME=packageserver-675f5c767c-mtdrq;K8S_POD_INFRA_CONTAINER_ID=50d5ddf79bd5de442fb43ec994762ef41de345f87e9c87e14eaf6c0f2b22e980;K8S_POD_UID=855d7874-16b1-47d0-82f6-d2b0c89b9a84" Path:"" ERRORED: error configuring pod [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq] networking: Multus: [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq/855d7874-16b1-47d0-82f6-d2b0c89b9a84]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: SetNetworkStatus: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-operator-lifecycle-manager/pods/packageserver-675f5c767c-mtdrq?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:43:12.640222 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:43:12.640222 master-0 kubenswrapper[8993]: > pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:43:12.640222 master-0 kubenswrapper[8993]: E1204 11:43:12.639121 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:43:12.640222 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager_855d7874-16b1-47d0-82f6-d2b0c89b9a84_0(50d5ddf79bd5de442fb43ec994762ef41de345f87e9c87e14eaf6c0f2b22e980): error adding pod openshift-operator-lifecycle-manager_packageserver-675f5c767c-mtdrq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"50d5ddf79bd5de442fb43ec994762ef41de345f87e9c87e14eaf6c0f2b22e980" Netns:"/var/run/netns/9708ead0-bfd0-4a87-9250-4e5efff45dab" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-operator-lifecycle-manager;K8S_POD_NAME=packageserver-675f5c767c-mtdrq;K8S_POD_INFRA_CONTAINER_ID=50d5ddf79bd5de442fb43ec994762ef41de345f87e9c87e14eaf6c0f2b22e980;K8S_POD_UID=855d7874-16b1-47d0-82f6-d2b0c89b9a84" Path:"" ERRORED: error configuring pod [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq] networking: Multus: [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq/855d7874-16b1-47d0-82f6-d2b0c89b9a84]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: SetNetworkStatus: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-operator-lifecycle-manager/pods/packageserver-675f5c767c-mtdrq?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:43:12.640222 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:43:12.640222 master-0 kubenswrapper[8993]: > pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:43:12.640222 master-0 kubenswrapper[8993]: E1204 11:43:12.639190 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager(855d7874-16b1-47d0-82f6-d2b0c89b9a84)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager(855d7874-16b1-47d0-82f6-d2b0c89b9a84)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager_855d7874-16b1-47d0-82f6-d2b0c89b9a84_0(50d5ddf79bd5de442fb43ec994762ef41de345f87e9c87e14eaf6c0f2b22e980): error adding pod openshift-operator-lifecycle-manager_packageserver-675f5c767c-mtdrq to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"50d5ddf79bd5de442fb43ec994762ef41de345f87e9c87e14eaf6c0f2b22e980\\\" Netns:\\\"/var/run/netns/9708ead0-bfd0-4a87-9250-4e5efff45dab\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-operator-lifecycle-manager;K8S_POD_NAME=packageserver-675f5c767c-mtdrq;K8S_POD_INFRA_CONTAINER_ID=50d5ddf79bd5de442fb43ec994762ef41de345f87e9c87e14eaf6c0f2b22e980;K8S_POD_UID=855d7874-16b1-47d0-82f6-d2b0c89b9a84\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq] networking: Multus: [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq/855d7874-16b1-47d0-82f6-d2b0c89b9a84]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: SetNetworkStatus: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-operator-lifecycle-manager/pods/packageserver-675f5c767c-mtdrq?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" podUID="855d7874-16b1-47d0-82f6-d2b0c89b9a84" Dec 04 11:43:12.733073 master-0 kubenswrapper[8993]: E1204 11:43:12.733007 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:43:12.733073 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager_e4d7939a-5961-4608-b910-73e71aa55bf6_0(639b179c776f4ece5a98ff46eeb6b6de6d24a404e0d5f5af53ad6080b597a9d1): error adding pod openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"639b179c776f4ece5a98ff46eeb6b6de6d24a404e0d5f5af53ad6080b597a9d1" Netns:"/var/run/netns/e33289fb-8fac-4c47-9f5b-3d6ca06ce72b" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-route-controller-manager;K8S_POD_NAME=route-controller-manager-95cb5f987-46bsk;K8S_POD_INFRA_CONTAINER_ID=639b179c776f4ece5a98ff46eeb6b6de6d24a404e0d5f5af53ad6080b597a9d1;K8S_POD_UID=e4d7939a-5961-4608-b910-73e71aa55bf6" Path:"" ERRORED: error configuring pod [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk] networking: Multus: [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk/e4d7939a-5961-4608-b910-73e71aa55bf6]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: SetNetworkStatus: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:43:12.733073 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:43:12.733073 master-0 kubenswrapper[8993]: > Dec 04 11:43:12.733259 master-0 kubenswrapper[8993]: E1204 11:43:12.733109 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:43:12.733259 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager_e4d7939a-5961-4608-b910-73e71aa55bf6_0(639b179c776f4ece5a98ff46eeb6b6de6d24a404e0d5f5af53ad6080b597a9d1): error adding pod openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"639b179c776f4ece5a98ff46eeb6b6de6d24a404e0d5f5af53ad6080b597a9d1" Netns:"/var/run/netns/e33289fb-8fac-4c47-9f5b-3d6ca06ce72b" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-route-controller-manager;K8S_POD_NAME=route-controller-manager-95cb5f987-46bsk;K8S_POD_INFRA_CONTAINER_ID=639b179c776f4ece5a98ff46eeb6b6de6d24a404e0d5f5af53ad6080b597a9d1;K8S_POD_UID=e4d7939a-5961-4608-b910-73e71aa55bf6" Path:"" ERRORED: error configuring pod [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk] networking: Multus: [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk/e4d7939a-5961-4608-b910-73e71aa55bf6]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: SetNetworkStatus: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:43:12.733259 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:43:12.733259 master-0 kubenswrapper[8993]: > pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:43:12.733259 master-0 kubenswrapper[8993]: E1204 11:43:12.733138 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:43:12.733259 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager_e4d7939a-5961-4608-b910-73e71aa55bf6_0(639b179c776f4ece5a98ff46eeb6b6de6d24a404e0d5f5af53ad6080b597a9d1): error adding pod openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"639b179c776f4ece5a98ff46eeb6b6de6d24a404e0d5f5af53ad6080b597a9d1" Netns:"/var/run/netns/e33289fb-8fac-4c47-9f5b-3d6ca06ce72b" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-route-controller-manager;K8S_POD_NAME=route-controller-manager-95cb5f987-46bsk;K8S_POD_INFRA_CONTAINER_ID=639b179c776f4ece5a98ff46eeb6b6de6d24a404e0d5f5af53ad6080b597a9d1;K8S_POD_UID=e4d7939a-5961-4608-b910-73e71aa55bf6" Path:"" ERRORED: error configuring pod [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk] networking: Multus: [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk/e4d7939a-5961-4608-b910-73e71aa55bf6]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: SetNetworkStatus: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:43:12.733259 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:43:12.733259 master-0 kubenswrapper[8993]: > pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:43:12.733465 master-0 kubenswrapper[8993]: E1204 11:43:12.733219 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager(e4d7939a-5961-4608-b910-73e71aa55bf6)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager(e4d7939a-5961-4608-b910-73e71aa55bf6)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager_e4d7939a-5961-4608-b910-73e71aa55bf6_0(639b179c776f4ece5a98ff46eeb6b6de6d24a404e0d5f5af53ad6080b597a9d1): error adding pod openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"639b179c776f4ece5a98ff46eeb6b6de6d24a404e0d5f5af53ad6080b597a9d1\\\" Netns:\\\"/var/run/netns/e33289fb-8fac-4c47-9f5b-3d6ca06ce72b\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-route-controller-manager;K8S_POD_NAME=route-controller-manager-95cb5f987-46bsk;K8S_POD_INFRA_CONTAINER_ID=639b179c776f4ece5a98ff46eeb6b6de6d24a404e0d5f5af53ad6080b597a9d1;K8S_POD_UID=e4d7939a-5961-4608-b910-73e71aa55bf6\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk] networking: Multus: [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk/e4d7939a-5961-4608-b910-73e71aa55bf6]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: SetNetworkStatus: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" Dec 04 11:43:12.884830 master-0 kubenswrapper[8993]: E1204 11:43:12.884611 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 11:43:19.497474 master-0 kubenswrapper[8993]: E1204 11:43:19.497377 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:43:19.497474 master-0 kubenswrapper[8993]: E1204 11:43:19.497432 8993 kubelet_node_status.go:572] "Unable to update node status" err="update node status exceeds retry count" Dec 04 11:43:19.931311 master-0 kubenswrapper[8993]: E1204 11:43:19.931175 8993 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:43:19.931777 master-0 kubenswrapper[8993]: E1204 11:43:19.931724 8993 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="34.013s" Dec 04 11:43:19.931862 master-0 kubenswrapper[8993]: I1204 11:43:19.931836 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:43:19.931898 master-0 kubenswrapper[8993]: I1204 11:43:19.931879 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:43:19.931978 master-0 kubenswrapper[8993]: I1204 11:43:19.931928 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" event={"ID":"cdb50850-779d-4179-ba1d-65ffeb4bb2e9","Type":"ContainerStarted","Data":"3bcbd231509913c4a508bf39ec4788d7227ea3b5ad2a02de0790fac547297cf4"} Dec 04 11:43:19.932022 master-0 kubenswrapper[8993]: I1204 11:43:19.932009 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:43:19.932055 master-0 kubenswrapper[8993]: I1204 11:43:19.932035 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:43:19.932434 master-0 kubenswrapper[8993]: I1204 11:43:19.932363 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:43:19.932917 master-0 kubenswrapper[8993]: I1204 11:43:19.932833 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:43:19.933059 master-0 kubenswrapper[8993]: I1204 11:43:19.933016 8993 scope.go:117] "RemoveContainer" containerID="0c42072520a6b53c6aa158c37fe784801234cd135b1f4b11a3d79b213d89865e" Dec 04 11:43:19.933386 master-0 kubenswrapper[8993]: I1204 11:43:19.933330 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:43:19.933443 master-0 kubenswrapper[8993]: I1204 11:43:19.933404 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:43:19.933627 master-0 kubenswrapper[8993]: I1204 11:43:19.933591 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:43:19.934404 master-0 kubenswrapper[8993]: I1204 11:43:19.934167 8993 scope.go:117] "RemoveContainer" containerID="d63039df99a06e3559d65dad05cc9c8b2039b1a8f335a3c51eec53ca5b198558" Dec 04 11:43:19.934404 master-0 kubenswrapper[8993]: I1204 11:43:19.934239 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:43:19.934404 master-0 kubenswrapper[8993]: I1204 11:43:19.934349 8993 scope.go:117] "RemoveContainer" containerID="6740e091e7513192b7c4fc2e37bc11133fd10dfdaf1d0800e4f08d8808fea4fc" Dec 04 11:43:19.935108 master-0 kubenswrapper[8993]: I1204 11:43:19.935064 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:43:19.935301 master-0 kubenswrapper[8993]: I1204 11:43:19.935260 8993 scope.go:117] "RemoveContainer" containerID="6877d7c7591492108bb34420d09a7376ef5637c76a3beefad5f4c2e362c72978" Dec 04 11:43:19.935551 master-0 kubenswrapper[8993]: I1204 11:43:19.935450 8993 scope.go:117] "RemoveContainer" containerID="2be6d5a0843c9ad0cefac288764262419d2b3e8c45c39b2471e38c3ea1a83dce" Dec 04 11:43:19.935856 master-0 kubenswrapper[8993]: I1204 11:43:19.935833 8993 scope.go:117] "RemoveContainer" containerID="bc1d5c88553d9975dfd695327c0f71abfbae1a4a9e554283b59af5847061176e" Dec 04 11:43:19.936383 master-0 kubenswrapper[8993]: I1204 11:43:19.936337 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:43:19.936894 master-0 kubenswrapper[8993]: E1204 11:43:19.936838 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"openshift-controller-manager-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=openshift-controller-manager-operator pod=openshift-controller-manager-operator-6c8676f99d-7z948_openshift-controller-manager-operator(3322cc5a-f1f7-4522-b423-19fb7f38cd43)\"" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" podUID="3322cc5a-f1f7-4522-b423-19fb7f38cd43" Dec 04 11:43:19.936958 master-0 kubenswrapper[8993]: I1204 11:43:19.936931 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:43:19.936997 master-0 kubenswrapper[8993]: I1204 11:43:19.936953 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:43:19.937161 master-0 kubenswrapper[8993]: I1204 11:43:19.937132 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:43:19.937327 master-0 kubenswrapper[8993]: I1204 11:43:19.937269 8993 scope.go:117] "RemoveContainer" containerID="5fa138fec5781e4f43a612b1bd94ac0c3aeea88a18ee976d82cc9fc5ee5a4d9a" Dec 04 11:43:19.946001 master-0 kubenswrapper[8993]: I1204 11:43:19.945957 8993 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0-master-0" podUID="" Dec 04 11:43:21.114338 master-0 kubenswrapper[8993]: I1204 11:43:21.114205 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd-operator_etcd-operator-5bf4d88c6f-2bpmr_c6e9271a-44ea-4612-ab60-4a9d489ed062/etcd-operator/1.log" Dec 04 11:43:21.117734 master-0 kubenswrapper[8993]: I1204 11:43:21.117663 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-apiserver-operator_openshift-apiserver-operator-7bf7f6b755-sh6qf_a5b826c3-8638-4cf5-b974-b24e4282ce00/openshift-apiserver-operator/1.log" Dec 04 11:43:21.124449 master-0 kubenswrapper[8993]: I1204 11:43:21.124394 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager-operator_kube-controller-manager-operator-848f645654-7hmhg_bac00ac5-0371-48fd-b1cc-60438f08ae94/kube-controller-manager-operator/1.log" Dec 04 11:43:21.127299 master-0 kubenswrapper[8993]: I1204 11:43:21.127264 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver-operator_kube-apiserver-operator-765d9ff747-gr68k_ccf81538-4d5a-4c26-8e54-fe39331a625d/kube-apiserver-operator/1.log" Dec 04 11:43:21.129839 master-0 kubenswrapper[8993]: I1204 11:43:21.129780 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-78f758c7b9-zgkh5_7e3160a9-11d1-4845-ba30-1a49ae7339a9/cluster-baremetal-operator/1.log" Dec 04 11:43:21.130585 master-0 kubenswrapper[8993]: I1204 11:43:21.130542 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-78f758c7b9-zgkh5_7e3160a9-11d1-4845-ba30-1a49ae7339a9/cluster-baremetal-operator/0.log" Dec 04 11:43:23.240322 master-0 kubenswrapper[8993]: E1204 11:43:23.240082 8993 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{etcd-operator-5bf4d88c6f-2bpmr.187e003b3c48ef47 openshift-etcd-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd-operator,Name:etcd-operator-5bf4d88c6f-2bpmr,UID:c6e9271a-44ea-4612-ab60-4a9d489ed062,APIVersion:v1,ResourceVersion:3813,FieldPath:spec.containers{etcd-operator},},Reason:Unhealthy,Message:Liveness probe failed: Get \"https://10.128.0.21:8443/healthz\": dial tcp 10.128.0.21:8443: connect: connection refused,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:39:18.390296391 +0000 UTC m=+92.781237814,LastTimestamp:2025-12-04 11:39:18.390296391 +0000 UTC m=+92.781237814,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:43:28.174990 master-0 kubenswrapper[8993]: I1204 11:43:28.174889 8993 generic.go:334] "Generic (PLEG): container finished" podID="1243d581-fa11-4db1-a01a-0cf64eb3ef74" containerID="42bf9b312d3d677a209c2f4ed476e28aa24937e7036328cd0eb57e2a02bb1e2a" exitCode=0 Dec 04 11:43:29.886350 master-0 kubenswrapper[8993]: E1204 11:43:29.886220 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 11:43:32.943989 master-0 kubenswrapper[8993]: E1204 11:43:32.943927 8993 kubelet.go:1929] "Failed creating a mirror pod for" err="Internal error occurred: admission plugin \"LimitRanger\" failed to complete mutation in 13s" pod="openshift-etcd/etcd-master-0" Dec 04 11:43:33.207413 master-0 kubenswrapper[8993]: I1204 11:43:33.207331 8993 generic.go:334] "Generic (PLEG): container finished" podID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerID="456f267c13077df8fde873615eb32f2c8011d7876410ffb6709899a5fdee25ce" exitCode=0 Dec 04 11:43:33.209171 master-0 kubenswrapper[8993]: I1204 11:43:33.209138 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-olm-operator_cluster-olm-operator-56fcb6cc5f-4xwp2_0158c2f3-20e5-43f4-875d-c5ad8f6112df/cluster-olm-operator/0.log" Dec 04 11:43:33.210303 master-0 kubenswrapper[8993]: I1204 11:43:33.210279 8993 generic.go:334] "Generic (PLEG): container finished" podID="0158c2f3-20e5-43f4-875d-c5ad8f6112df" containerID="db80abb8e4c0e90fdd2ce38c6760862b2f66436f0df8b6e38dd7af704d246cce" exitCode=0 Dec 04 11:43:35.091629 master-0 kubenswrapper[8993]: I1204 11:43:35.091556 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Liveness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:43:35.092202 master-0 kubenswrapper[8993]: I1204 11:43:35.091642 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:43:35.357131 master-0 kubenswrapper[8993]: I1204 11:43:35.356994 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:43:35.357131 master-0 kubenswrapper[8993]: I1204 11:43:35.357073 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:43:36.248747 master-0 kubenswrapper[8993]: I1204 11:43:36.248460 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_cluster-node-tuning-operator-85cff47f46-4gv5j_6f15dcdb-c968-429c-9d1d-63c2becad337/cluster-node-tuning-operator/0.log" Dec 04 11:43:36.248747 master-0 kubenswrapper[8993]: I1204 11:43:36.248544 8993 generic.go:334] "Generic (PLEG): container finished" podID="6f15dcdb-c968-429c-9d1d-63c2becad337" containerID="d6c550a785a1145fdc343107de5010ef2c2358de520cd277331cd0afa9b20bdf" exitCode=1 Dec 04 11:43:38.091639 master-0 kubenswrapper[8993]: I1204 11:43:38.091525 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Liveness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:43:38.091639 master-0 kubenswrapper[8993]: I1204 11:43:38.091623 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:43:38.357943 master-0 kubenswrapper[8993]: I1204 11:43:38.357650 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:43:38.357943 master-0 kubenswrapper[8993]: I1204 11:43:38.357753 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:43:39.274624 master-0 kubenswrapper[8993]: I1204 11:43:39.274413 8993 generic.go:334] "Generic (PLEG): container finished" podID="b668f740-dbc3-48e0-9ebc-83bae3a43c83" containerID="48b19d28904c411ce854b75b8b7b3d47463402f85314112ea64f27cc79cc6747" exitCode=0 Dec 04 11:43:39.603929 master-0 kubenswrapper[8993]: E1204 11:43:39.603736 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:43:29Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:43:29Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:43:29Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:43:29Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3e65409fc2b27ad0aaeb500a39e264663d2980821f099b830b551785ce4ce8b\\\"],\\\"sizeBytes\\\":1631758507},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:2efbb545a141552851226bea008b13d92cbb084339bcfd6923b38d23c382145e\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:e5c3ad640f9c0c84490a0e0da7a1850b7873867936a5b604c07a8075c3a710d0\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1610175307},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9014f384de5f9a0b7418d5869ad349abb9588d16bd09ed650a163c045315dbff\\\"],\\\"sizeBytes\\\":1232140918},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:98141b7d0b74195f511ccd4c41ba6c8a69fef01f22b2fb8ef2d024109e93a3a9\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:bd4a56267fe7d489c5a0705c4b9f5c43170dd39b6684e2497a49c5416ae6e14f\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1205106509},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:9eadf94ba5e517edf53c9b21d83f18cb3790ddc768f10d0ca92be97c56a0eecb\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:e096abcd79df184b3151d2fe670d52596bae8c1f2d1fa8851c41821afe1ba59e\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.18\\\"],\\\"sizeBytes\\\":1201434959},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:e8990432556acad31519b1a73ec32f32d27c2034cf9e5cc4db8980efc7331594\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:ebe9f523f5c211a3a0f2570331dddcd5be15b12c1fecd9b8b121f881bfaad029\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.18\\\"],\\\"sizeBytes\\\":1129027903},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b472823604757237c2d16bd6f6221f4cf562aa3b05942c7f602e1e8b2e55a7c6\\\"],\\\"sizeBytes\\\":983705650},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d5891cdd7dcf7c9081de8b364b4c96446b7f946f7880fbae291a4592a198264\\\"],\\\"sizeBytes\\\":938303566},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:01d2e67fd74086da701c39dac5b821822351cb0151f9afe72821c05df19953ad\\\"],\\\"sizeBytes\\\":912722556},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:61664aa69b33349cc6de45e44ae6033e7f483c034ea01c0d9a8ca08a12d88e3a\\\"],\\\"sizeBytes\\\":874825223},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:631a3798b749fecc041a99929eb946618df723e15055e805ff752a1a1273481c\\\"],\\\"sizeBytes\\\":870567329},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1ca78c423f43f89a0411e40393642f64e4f8df9e5f61c25e31047c4cce170f9\\\"],\\\"sizeBytes\\\":857069957},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b12f830c3316aa4dc061c2d00c74126282b3e2bcccc301eab00d57fff3c4c7c\\\"],\\\"sizeBytes\\\":767284906},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cb3ec61f9a932a9ad13bdeb44bcf9477a8d5f728151d7f19ed3ef7d4b02b3a82\\\"],\\\"sizeBytes\\\":682371258},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:916566bb9d0143352324233d460ad94697719c11c8c9158e3aea8f475941751f\\\"],\\\"sizeBytes\\\":677523572},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5451aa441e5b8d8689c032405d410c8049a849ef2edf77e5b6a5ce2838c6569b\\\"],\\\"sizeBytes\\\":672407260},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9724d2036305cbd729e1f484c5bad89971de977fff8a6723fef1873858dd1123\\\"],\\\"sizeBytes\\\":616108962},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:df606f3b71d4376d1a2108c09f0d3dab455fc30bcb67c60e91590c105e9025bf\\\"],\\\"sizeBytes\\\":583836304},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79f99fd6cce984287932edf0d009660bb488d663081f3d62ec3b23bc8bfbf6c2\\\"],\\\"sizeBytes\\\":576619763},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eddedae7578d79b5a3f748000ae5c00b9f14a04710f9f9ec7b52fc569be5dfb8\\\"],\\\"sizeBytes\\\":552673986},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dd38b8be3af889b0f97e2df41517c89a11260901432a9a1ee943195bb3a22737\\\"],\\\"sizeBytes\\\":551889548},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:aa24edce3d740f84c40018e94cdbf2bc7375268d13d57c2d664e43a46ccea3fc\\\"],\\\"sizeBytes\\\":543227406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:188637a52cafee61ec461e92fb0c605e28be325b9ac1f2ac8a37d68e97654718\\\"],\\\"sizeBytes\\\":532719167},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde59e48cd5dee3721f34d249cb119cc3259fd857965d34f9c7ed83b0c363a1\\\"],\\\"sizeBytes\\\":532402162},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f4d4282cb53325e737ad68abbfcb70687ae04fb50353f4f0ba0ba5703b15009a\\\"],\\\"sizeBytes\\\":512838054},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-release@sha256:8c885ea0b3c5124989f0a9b93eba98eb9fca6bbd0262772d85d90bf713a4d572\\\"],\\\"sizeBytes\\\":512452153},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0f43c31aa3359159d4557dad3cfaf812d8ce44db9cb9ae970e06d3479070b660\\\"],\\\"sizeBytes\\\":509437356},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:97d26892192b552c16527bf2771e1b86528ab581a02dd9279cdf71c194830e3e\\\"],\\\"sizeBytes\\\":508042119},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e85850a4ae1a1e3ec2c590a4936d640882b6550124da22031c85b526afbf52df\\\"],\\\"sizeBytes\\\":507687221},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8375671da86aa527ee7e291d86971b0baa823ffc7663b5a983084456e76c0f59\\\"],\\\"sizeBytes\\\":506741476},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:831f30660844091d6154e2674d3a9da6f34271bf8a2c40b56f7416066318742b\\\"],\\\"sizeBytes\\\":505649178},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:86af77350cfe6fd69280157e4162aa0147873d9431c641ae4ad3e881ff768a73\\\"],\\\"sizeBytes\\\":505628211},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a824e468cf8dd61d347e35b2ee5bc2f815666957647098e21a1bb56ff613e5b9\\\"],\\\"sizeBytes\\\":503340749},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8139ed65c0a0a4b0f253b715c11cc52be027efe8a4774da9ccce35c78ef439da\\\"],\\\"sizeBytes\\\":503011144},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8eabac819f289e29d75c7ab172d8124554849a47f0b00770928c3eb19a5a31c4\\\"],\\\"sizeBytes\\\":502436444},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:10e57ca7611f79710f05777dc6a8f31c7e04eb09da4d8d793a5acfbf0e4692d7\\\"],\\\"sizeBytes\\\":500943492},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f042fa25014f3d37f3ea967d21f361d2a11833ae18f2c750318101b25d2497ce\\\"],\\\"sizeBytes\\\":500848684},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91af633e585621630c40d14f188e37d36b44678d0a59e582d850bf8d593d3a0c\\\"],\\\"sizeBytes\\\":499798563},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d64c13fe7663a0b4ae61d103b1b7598adcf317a01826f296bcb66b1a2de83c96\\\"],\\\"sizeBytes\\\":499705918},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:33a20002692769235e95271ab071783c57ff50681088fa1035b86af31e73cf20\\\"],\\\"sizeBytes\\\":499125567},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:75d996f6147edb88c09fd1a052099de66638590d7d03a735006244bc9e19f898\\\"],\\\"sizeBytes\\\":499082775},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3b8d91a25eeb9f02041e947adb3487da3e7ab8449d3d2ad015827e7954df7b34\\\"],\\\"sizeBytes\\\":490455952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1f952cec1e5332b84bdffa249cd426f39087058d6544ddcec650a414c15a9b68\\\"],\\\"sizeBytes\\\":489528665},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c416b201d480bddb5a4960ec42f4740761a1335001cf84ba5ae19ad6857771b1\\\"],\\\"sizeBytes\\\":481559117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c3a77aa4d03b89ea284e3467a268e5989a77a2ef63e685eb1d5c5ea5b3922b7a\\\"],\\\"sizeBytes\\\":478917802},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eb928c13a46d3fb45f4a881892d023a92d610a5430be0ffd916aaf8da8e7d297\\\"],\\\"sizeBytes\\\":478642572},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a92c310ce30dcb3de85d6aac868e0d80919670fa29ef83d55edd96b0cae35563\\\"],\\\"sizeBytes\\\":465285478},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fd3e9f8f00a59bda7483ec7dc8a0ed602f9ca30e3d72b22072dbdf2819da3f61\\\"],\\\"sizeBytes\\\":465144618},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3c1edf52f70bf9b1d1457e0c4111bc79cdaa1edd659ddbdb9d8176eff8b46956\\\"],\\\"sizeBytes\\\":462727837},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8cc27777e72233024fe84ee1faa168aec715a0b24912a3ce70715ddccba328df\\\"],\\\"sizeBytes\\\":461702648}]}}\" for node \"master-0\": Patch \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0/status?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:43:41.091704 master-0 kubenswrapper[8993]: I1204 11:43:41.091627 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Liveness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:43:41.092597 master-0 kubenswrapper[8993]: I1204 11:43:41.092558 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:43:41.357980 master-0 kubenswrapper[8993]: I1204 11:43:41.357711 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:43:41.357980 master-0 kubenswrapper[8993]: I1204 11:43:41.357879 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:43:42.879925 master-0 kubenswrapper[8993]: I1204 11:43:42.879846 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_network-operator-79767b7ff9-5bgzx_ffaf95be-586c-40fa-b15f-1beaffe7ff1c/network-operator/2.log" Dec 04 11:43:42.880709 master-0 kubenswrapper[8993]: I1204 11:43:42.880453 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_network-operator-79767b7ff9-5bgzx_ffaf95be-586c-40fa-b15f-1beaffe7ff1c/network-operator/1.log" Dec 04 11:43:42.881145 master-0 kubenswrapper[8993]: I1204 11:43:42.881093 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_network-operator-79767b7ff9-5bgzx_ffaf95be-586c-40fa-b15f-1beaffe7ff1c/network-operator/0.log" Dec 04 11:43:42.881259 master-0 kubenswrapper[8993]: I1204 11:43:42.881154 8993 generic.go:334] "Generic (PLEG): container finished" podID="ffaf95be-586c-40fa-b15f-1beaffe7ff1c" containerID="f0266ae130e78641667767b4e7c8f6513c8fa351825903565f61acb84ef9c0ac" exitCode=255 Dec 04 11:43:42.883115 master-0 kubenswrapper[8993]: I1204 11:43:42.883069 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication-operator_authentication-operator-6c968fdfdf-nrrfw_42b3be0f-1d82-4a64-abb4-0118a6960efd/authentication-operator/2.log" Dec 04 11:43:42.883600 master-0 kubenswrapper[8993]: I1204 11:43:42.883565 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication-operator_authentication-operator-6c968fdfdf-nrrfw_42b3be0f-1d82-4a64-abb4-0118a6960efd/authentication-operator/1.log" Dec 04 11:43:42.884338 master-0 kubenswrapper[8993]: I1204 11:43:42.884292 8993 generic.go:334] "Generic (PLEG): container finished" podID="42b3be0f-1d82-4a64-abb4-0118a6960efd" containerID="a6d14a522051fb2206df06257821a6c013ab79cc060f6af18a92935eb6c12df9" exitCode=255 Dec 04 11:43:42.886404 master-0 kubenswrapper[8993]: I1204 11:43:42.886364 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-77758bc754-8smqn_8e5e33b0-4e2e-464c-ba5b-cbd2048004f8/service-ca-operator/2.log" Dec 04 11:43:42.886865 master-0 kubenswrapper[8993]: I1204 11:43:42.886828 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-77758bc754-8smqn_8e5e33b0-4e2e-464c-ba5b-cbd2048004f8/service-ca-operator/1.log" Dec 04 11:43:42.887282 master-0 kubenswrapper[8993]: I1204 11:43:42.887250 8993 generic.go:334] "Generic (PLEG): container finished" podID="8e5e33b0-4e2e-464c-ba5b-cbd2048004f8" containerID="602399891f95b4f2d3b03e62ba9f8e399daa0e9695e2efa23e0a025273d42dbf" exitCode=255 Dec 04 11:43:42.889169 master-0 kubenswrapper[8993]: I1204 11:43:42.889128 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-b9c5dfc78-dcxkw_fd9f8671-8066-4990-b45d-8b619aa5d9ec/kube-storage-version-migrator-operator/2.log" Dec 04 11:43:42.889643 master-0 kubenswrapper[8993]: I1204 11:43:42.889611 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-b9c5dfc78-dcxkw_fd9f8671-8066-4990-b45d-8b619aa5d9ec/kube-storage-version-migrator-operator/1.log" Dec 04 11:43:42.890775 master-0 kubenswrapper[8993]: I1204 11:43:42.890727 8993 generic.go:334] "Generic (PLEG): container finished" podID="fd9f8671-8066-4990-b45d-8b619aa5d9ec" containerID="313a5a3e45bfc56240a41a6b2d15c82ca825cd210b3e33c0eb74e4e915c86d54" exitCode=255 Dec 04 11:43:43.903018 master-0 kubenswrapper[8993]: I1204 11:43:43.902892 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler-operator_openshift-kube-scheduler-operator-5f85974995-g4rwv_27576028-d64a-47cd-b76b-d524e41efe37/kube-scheduler-operator-container/2.log" Dec 04 11:43:43.904381 master-0 kubenswrapper[8993]: I1204 11:43:43.903953 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler-operator_openshift-kube-scheduler-operator-5f85974995-g4rwv_27576028-d64a-47cd-b76b-d524e41efe37/kube-scheduler-operator-container/1.log" Dec 04 11:43:43.904745 master-0 kubenswrapper[8993]: I1204 11:43:43.904674 8993 generic.go:334] "Generic (PLEG): container finished" podID="27576028-d64a-47cd-b76b-d524e41efe37" containerID="6c60e9f210f8345eb6f6fc04cca90e4cb57c82e255bdcd593b988c293e0489ca" exitCode=255 Dec 04 11:43:44.356851 master-0 kubenswrapper[8993]: I1204 11:43:44.356685 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:43:44.357247 master-0 kubenswrapper[8993]: I1204 11:43:44.356915 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:43:46.887065 master-0 kubenswrapper[8993]: E1204 11:43:46.886970 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 11:43:47.357174 master-0 kubenswrapper[8993]: I1204 11:43:47.357069 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:43:47.357515 master-0 kubenswrapper[8993]: I1204 11:43:47.357234 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:43:50.357587 master-0 kubenswrapper[8993]: I1204 11:43:50.357442 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:43:50.357587 master-0 kubenswrapper[8993]: I1204 11:43:50.357559 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:43:52.043486 master-0 kubenswrapper[8993]: I1204 11:43:52.043354 8993 status_manager.go:851] "Failed to get status for pod" podUID="2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c" pod="openshift-marketplace/redhat-operators-7f22v" err="the server was unable to return a response in the time allotted, but may still be processing the request (get pods redhat-operators-7f22v)" Dec 04 11:43:53.357457 master-0 kubenswrapper[8993]: I1204 11:43:53.357365 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:43:53.357457 master-0 kubenswrapper[8993]: I1204 11:43:53.357439 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:43:53.949635 master-0 kubenswrapper[8993]: E1204 11:43:53.949552 8993 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:43:53.949921 master-0 kubenswrapper[8993]: E1204 11:43:53.949835 8993 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="34.013s" Dec 04 11:43:53.950011 master-0 kubenswrapper[8993]: I1204 11:43:53.949983 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:43:53.950464 master-0 kubenswrapper[8993]: I1204 11:43:53.950402 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:43:53.950703 master-0 kubenswrapper[8993]: I1204 11:43:53.950682 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:43:53.951477 master-0 kubenswrapper[8993]: I1204 11:43:53.951414 8993 scope.go:117] "RemoveContainer" containerID="f0266ae130e78641667767b4e7c8f6513c8fa351825903565f61acb84ef9c0ac" Dec 04 11:43:53.951477 master-0 kubenswrapper[8993]: I1204 11:43:53.951381 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:43:53.953294 master-0 kubenswrapper[8993]: E1204 11:43:53.951589 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"network-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=network-operator pod=network-operator-79767b7ff9-5bgzx_openshift-network-operator(ffaf95be-586c-40fa-b15f-1beaffe7ff1c)\"" pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" podUID="ffaf95be-586c-40fa-b15f-1beaffe7ff1c" Dec 04 11:43:53.953294 master-0 kubenswrapper[8993]: I1204 11:43:53.951635 8993 scope.go:117] "RemoveContainer" containerID="313a5a3e45bfc56240a41a6b2d15c82ca825cd210b3e33c0eb74e4e915c86d54" Dec 04 11:43:53.953294 master-0 kubenswrapper[8993]: E1204 11:43:53.952004 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-storage-version-migrator-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-storage-version-migrator-operator pod=kube-storage-version-migrator-operator-b9c5dfc78-dcxkw_openshift-kube-storage-version-migrator-operator(fd9f8671-8066-4990-b45d-8b619aa5d9ec)\"" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" podUID="fd9f8671-8066-4990-b45d-8b619aa5d9ec" Dec 04 11:43:53.953294 master-0 kubenswrapper[8993]: I1204 11:43:53.952427 8993 scope.go:117] "RemoveContainer" containerID="a6d14a522051fb2206df06257821a6c013ab79cc060f6af18a92935eb6c12df9" Dec 04 11:43:53.953294 master-0 kubenswrapper[8993]: I1204 11:43:53.952544 8993 scope.go:117] "RemoveContainer" containerID="602399891f95b4f2d3b03e62ba9f8e399daa0e9695e2efa23e0a025273d42dbf" Dec 04 11:43:53.953294 master-0 kubenswrapper[8993]: E1204 11:43:53.952646 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"authentication-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=authentication-operator pod=authentication-operator-6c968fdfdf-nrrfw_openshift-authentication-operator(42b3be0f-1d82-4a64-abb4-0118a6960efd)\"" pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" podUID="42b3be0f-1d82-4a64-abb4-0118a6960efd" Dec 04 11:43:53.953294 master-0 kubenswrapper[8993]: I1204 11:43:53.952825 8993 scope.go:117] "RemoveContainer" containerID="1d2b175fde83364b4666d8066712242360f76256f651e330ae881c16c680384c" Dec 04 11:43:53.953294 master-0 kubenswrapper[8993]: I1204 11:43:53.952890 8993 scope.go:117] "RemoveContainer" containerID="5601978092c465a26e532b8cb8f66b5633a31c07893435c149ed0029a0397280" Dec 04 11:43:53.953294 master-0 kubenswrapper[8993]: E1204 11:43:53.952898 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"service-ca-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=service-ca-operator pod=service-ca-operator-77758bc754-8smqn_openshift-service-ca-operator(8e5e33b0-4e2e-464c-ba5b-cbd2048004f8)\"" pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" podUID="8e5e33b0-4e2e-464c-ba5b-cbd2048004f8" Dec 04 11:43:53.953294 master-0 kubenswrapper[8993]: I1204 11:43:53.953303 8993 scope.go:117] "RemoveContainer" containerID="6c60e9f210f8345eb6f6fc04cca90e4cb57c82e255bdcd593b988c293e0489ca" Dec 04 11:43:53.955184 master-0 kubenswrapper[8993]: I1204 11:43:53.953441 8993 scope.go:117] "RemoveContainer" containerID="6877d7c7591492108bb34420d09a7376ef5637c76a3beefad5f4c2e362c72978" Dec 04 11:43:53.955184 master-0 kubenswrapper[8993]: E1204 11:43:53.953517 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-scheduler-operator-container\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-scheduler-operator-container pod=openshift-kube-scheduler-operator-5f85974995-g4rwv_openshift-kube-scheduler-operator(27576028-d64a-47cd-b76b-d524e41efe37)\"" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" podUID="27576028-d64a-47cd-b76b-d524e41efe37" Dec 04 11:43:53.955184 master-0 kubenswrapper[8993]: I1204 11:43:53.953559 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:43:53.955184 master-0 kubenswrapper[8993]: I1204 11:43:53.953600 8993 scope.go:117] "RemoveContainer" containerID="42bf9b312d3d677a209c2f4ed476e28aa24937e7036328cd0eb57e2a02bb1e2a" Dec 04 11:43:53.957682 master-0 kubenswrapper[8993]: I1204 11:43:53.957627 8993 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0-master-0" podUID="" Dec 04 11:43:53.984983 master-0 kubenswrapper[8993]: I1204 11:43:53.984912 8993 generic.go:334] "Generic (PLEG): container finished" podID="1ade9186-b262-4b5e-9c6f-ba89f0130fb6" containerID="b4a708629c00edd600857e5208cac33c83ecd3ee4160351814e5fc4f907308cf" exitCode=0 Dec 04 11:43:54.994247 master-0 kubenswrapper[8993]: I1204 11:43:54.994174 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/1.log" Dec 04 11:43:54.995465 master-0 kubenswrapper[8993]: I1204 11:43:54.995426 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/0.log" Dec 04 11:43:55.000027 master-0 kubenswrapper[8993]: I1204 11:43:55.000001 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/1.log" Dec 04 11:43:55.000639 master-0 kubenswrapper[8993]: I1204 11:43:55.000587 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/0.log" Dec 04 11:43:55.003608 master-0 kubenswrapper[8993]: I1204 11:43:55.003545 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-6c8676f99d-7z948_3322cc5a-f1f7-4522-b423-19fb7f38cd43/openshift-controller-manager-operator/2.log" Dec 04 11:43:55.004116 master-0 kubenswrapper[8993]: I1204 11:43:55.004074 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-6c8676f99d-7z948_3322cc5a-f1f7-4522-b423-19fb7f38cd43/openshift-controller-manager-operator/1.log" Dec 04 11:43:55.004888 master-0 kubenswrapper[8993]: I1204 11:43:55.004847 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-6c8676f99d-7z948_3322cc5a-f1f7-4522-b423-19fb7f38cd43/openshift-controller-manager-operator/0.log" Dec 04 11:43:56.357498 master-0 kubenswrapper[8993]: I1204 11:43:56.357377 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:43:56.358316 master-0 kubenswrapper[8993]: I1204 11:43:56.357526 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:43:57.243400 master-0 kubenswrapper[8993]: E1204 11:43:57.243233 8993 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{cluster-samples-operator-797cfd8b47-8wqgp.187e003b4e6d09e9 openshift-cluster-samples-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-cluster-samples-operator,Name:cluster-samples-operator-797cfd8b47-8wqgp,UID:ccf1cb9e-8885-4224-92d5-d1b116bc0090,APIVersion:v1,ResourceVersion:8109,FieldPath:spec.containers{cluster-samples-operator},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1386b0fcb731d843f15fb64532f8b676c927821d69dd3d4503c973c3e2a04216\" in 35.136s (35.136s including waiting). Image size: 449978499 bytes.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:39:18.694652393 +0000 UTC m=+93.085593826,LastTimestamp:2025-12-04 11:39:18.694652393 +0000 UTC m=+93.085593826,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:43:59.357248 master-0 kubenswrapper[8993]: I1204 11:43:59.357130 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:43:59.357908 master-0 kubenswrapper[8993]: I1204 11:43:59.357269 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:44:02.358000 master-0 kubenswrapper[8993]: I1204 11:44:02.357913 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:44:02.358000 master-0 kubenswrapper[8993]: I1204 11:44:02.357996 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:44:02.604345 master-0 kubenswrapper[8993]: I1204 11:44:02.604249 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": dial tcp [::1]:10357: connect: connection refused" Dec 04 11:44:03.059431 master-0 kubenswrapper[8993]: I1204 11:44:03.059347 8993 generic.go:334] "Generic (PLEG): container finished" podID="8b47694fcc32464ab24d09c23d6efb57" containerID="a573a12b7e61507c596e1178d09644f02ee9de55d89553ed9fce32978b18dcf3" exitCode=0 Dec 04 11:44:03.888644 master-0 kubenswrapper[8993]: E1204 11:44:03.888490 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 11:44:04.787423 master-0 kubenswrapper[8993]: E1204 11:44:04.787343 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:44:04.787423 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(b8a357e4d9b7049620c368e3117a218cab578e2787de9134003b973d9b4b0f47): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"b8a357e4d9b7049620c368e3117a218cab578e2787de9134003b973d9b4b0f47" Netns:"/var/run/netns/afdfd7cd-85b7-4aec-840d-af54b181ee50" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=b8a357e4d9b7049620c368e3117a218cab578e2787de9134003b973d9b4b0f47;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378" Path:"" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:44:04.787423 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:04.787423 master-0 kubenswrapper[8993]: > Dec 04 11:44:04.787647 master-0 kubenswrapper[8993]: E1204 11:44:04.787473 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:44:04.787647 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(b8a357e4d9b7049620c368e3117a218cab578e2787de9134003b973d9b4b0f47): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"b8a357e4d9b7049620c368e3117a218cab578e2787de9134003b973d9b4b0f47" Netns:"/var/run/netns/afdfd7cd-85b7-4aec-840d-af54b181ee50" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=b8a357e4d9b7049620c368e3117a218cab578e2787de9134003b973d9b4b0f47;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378" Path:"" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:44:04.787647 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:04.787647 master-0 kubenswrapper[8993]: > pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:44:04.787647 master-0 kubenswrapper[8993]: E1204 11:44:04.787507 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:44:04.787647 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(b8a357e4d9b7049620c368e3117a218cab578e2787de9134003b973d9b4b0f47): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"b8a357e4d9b7049620c368e3117a218cab578e2787de9134003b973d9b4b0f47" Netns:"/var/run/netns/afdfd7cd-85b7-4aec-840d-af54b181ee50" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=b8a357e4d9b7049620c368e3117a218cab578e2787de9134003b973d9b4b0f47;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378" Path:"" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:44:04.787647 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:04.787647 master-0 kubenswrapper[8993]: > pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:44:04.787896 master-0 kubenswrapper[8993]: E1204 11:44:04.787609 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"machine-api-operator-88d48b57d-9fjtd_openshift-machine-api(c50317d3-f7cd-4133-845e-44add57ac378)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"machine-api-operator-88d48b57d-9fjtd_openshift-machine-api(c50317d3-f7cd-4133-845e-44add57ac378)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(b8a357e4d9b7049620c368e3117a218cab578e2787de9134003b973d9b4b0f47): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"b8a357e4d9b7049620c368e3117a218cab578e2787de9134003b973d9b4b0f47\\\" Netns:\\\"/var/run/netns/afdfd7cd-85b7-4aec-840d-af54b181ee50\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=b8a357e4d9b7049620c368e3117a218cab578e2787de9134003b973d9b4b0f47;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" podUID="c50317d3-f7cd-4133-845e-44add57ac378" Dec 04 11:44:05.073161 master-0 kubenswrapper[8993]: I1204 11:44:05.073051 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:44:05.074248 master-0 kubenswrapper[8993]: I1204 11:44:05.073974 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:44:05.357242 master-0 kubenswrapper[8993]: I1204 11:44:05.357023 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:44:05.357242 master-0 kubenswrapper[8993]: I1204 11:44:05.357142 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:44:06.435712 master-0 kubenswrapper[8993]: I1204 11:44:06.435635 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": dial tcp [::1]:10357: connect: connection refused" Dec 04 11:44:08.100255 master-0 kubenswrapper[8993]: I1204 11:44:08.100182 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-lifecycle-manager_package-server-manager-67477646d4-7hndf_72faf6d6-e8ca-43d1-b93e-67c11f8d3b46/package-server-manager/0.log" Dec 04 11:44:08.100976 master-0 kubenswrapper[8993]: I1204 11:44:08.100780 8993 generic.go:334] "Generic (PLEG): container finished" podID="72faf6d6-e8ca-43d1-b93e-67c11f8d3b46" containerID="75e7ab729f90601f1a3824e70ddebf2fb143cea828b4fc655dacf16540161a43" exitCode=1 Dec 04 11:44:08.357219 master-0 kubenswrapper[8993]: I1204 11:44:08.357031 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:44:08.357219 master-0 kubenswrapper[8993]: I1204 11:44:08.357136 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:44:08.865891 master-0 kubenswrapper[8993]: I1204 11:44:08.865800 8993 patch_prober.go:28] interesting pod/package-server-manager-67477646d4-7hndf container/package-server-manager namespace/openshift-operator-lifecycle-manager: Liveness probe status=failure output="Get \"http://10.128.0.13:8080/healthz\": dial tcp 10.128.0.13:8080: connect: connection refused" start-of-body= Dec 04 11:44:08.866153 master-0 kubenswrapper[8993]: I1204 11:44:08.865800 8993 patch_prober.go:28] interesting pod/package-server-manager-67477646d4-7hndf container/package-server-manager namespace/openshift-operator-lifecycle-manager: Readiness probe status=failure output="Get \"http://10.128.0.13:8080/healthz\": dial tcp 10.128.0.13:8080: connect: connection refused" start-of-body= Dec 04 11:44:08.866153 master-0 kubenswrapper[8993]: I1204 11:44:08.865914 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" podUID="72faf6d6-e8ca-43d1-b93e-67c11f8d3b46" containerName="package-server-manager" probeResult="failure" output="Get \"http://10.128.0.13:8080/healthz\": dial tcp 10.128.0.13:8080: connect: connection refused" Dec 04 11:44:08.866153 master-0 kubenswrapper[8993]: I1204 11:44:08.865977 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" podUID="72faf6d6-e8ca-43d1-b93e-67c11f8d3b46" containerName="package-server-manager" probeResult="failure" output="Get \"http://10.128.0.13:8080/healthz\": dial tcp 10.128.0.13:8080: connect: connection refused" Dec 04 11:44:11.126836 master-0 kubenswrapper[8993]: I1204 11:44:11.126730 8993 generic.go:334] "Generic (PLEG): container finished" podID="a399a87b-8153-4045-a8d3-63fd88ae280f" containerID="067d901be9a85d08d5b38edc8f0dc976efa622744a3bc1f1c7a19a180b2e2f65" exitCode=0 Dec 04 11:44:11.357080 master-0 kubenswrapper[8993]: I1204 11:44:11.356948 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:44:11.357450 master-0 kubenswrapper[8993]: I1204 11:44:11.357085 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:44:12.605074 master-0 kubenswrapper[8993]: I1204 11:44:12.604951 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": dial tcp [::1]:10357: connect: connection refused" Dec 04 11:44:14.357352 master-0 kubenswrapper[8993]: I1204 11:44:14.357247 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:44:14.357352 master-0 kubenswrapper[8993]: I1204 11:44:14.357361 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:44:15.153717 master-0 kubenswrapper[8993]: I1204 11:44:15.153644 8993 generic.go:334] "Generic (PLEG): container finished" podID="031d300e-24b4-481c-8b82-fe8cdb3fcef7" containerID="90cc3b6000c187ca85e3ebde189fcb0fb0c22a655e72a22fb82a8f151adb8963" exitCode=0 Dec 04 11:44:16.435186 master-0 kubenswrapper[8993]: I1204 11:44:16.435070 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": dial tcp [::1]:10357: connect: connection refused" Dec 04 11:44:17.356772 master-0 kubenswrapper[8993]: I1204 11:44:17.356681 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:44:17.356772 master-0 kubenswrapper[8993]: I1204 11:44:17.356772 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:44:18.390290 master-0 kubenswrapper[8993]: I1204 11:44:18.390172 8993 patch_prober.go:28] interesting pod/etcd-operator-5bf4d88c6f-2bpmr container/etcd-operator namespace/openshift-etcd-operator: Liveness probe status=failure output="Get \"https://10.128.0.21:8443/healthz\": dial tcp 10.128.0.21:8443: connect: connection refused" start-of-body= Dec 04 11:44:18.390290 master-0 kubenswrapper[8993]: I1204 11:44:18.390258 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" podUID="c6e9271a-44ea-4612-ab60-4a9d489ed062" containerName="etcd-operator" probeResult="failure" output="Get \"https://10.128.0.21:8443/healthz\": dial tcp 10.128.0.21:8443: connect: connection refused" Dec 04 11:44:18.865572 master-0 kubenswrapper[8993]: I1204 11:44:18.865200 8993 patch_prober.go:28] interesting pod/package-server-manager-67477646d4-7hndf container/package-server-manager namespace/openshift-operator-lifecycle-manager: Readiness probe status=failure output="Get \"http://10.128.0.13:8080/healthz\": dial tcp 10.128.0.13:8080: connect: connection refused" start-of-body= Dec 04 11:44:18.865572 master-0 kubenswrapper[8993]: I1204 11:44:18.865266 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" podUID="72faf6d6-e8ca-43d1-b93e-67c11f8d3b46" containerName="package-server-manager" probeResult="failure" output="Get \"http://10.128.0.13:8080/healthz\": dial tcp 10.128.0.13:8080: connect: connection refused" Dec 04 11:44:18.865572 master-0 kubenswrapper[8993]: I1204 11:44:18.865484 8993 patch_prober.go:28] interesting pod/package-server-manager-67477646d4-7hndf container/package-server-manager namespace/openshift-operator-lifecycle-manager: Liveness probe status=failure output="Get \"http://10.128.0.13:8080/healthz\": dial tcp 10.128.0.13:8080: connect: connection refused" start-of-body= Dec 04 11:44:18.866119 master-0 kubenswrapper[8993]: I1204 11:44:18.865579 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" podUID="72faf6d6-e8ca-43d1-b93e-67c11f8d3b46" containerName="package-server-manager" probeResult="failure" output="Get \"http://10.128.0.13:8080/healthz\": dial tcp 10.128.0.13:8080: connect: connection refused" Dec 04 11:44:20.357838 master-0 kubenswrapper[8993]: I1204 11:44:20.357683 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:44:20.358853 master-0 kubenswrapper[8993]: I1204 11:44:20.357915 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:44:20.690208 master-0 kubenswrapper[8993]: E1204 11:44:20.686347 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:44:20.690208 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_38e7be62-e4f5-42ba-89f0-83aca874a092_0(04ebacdbcb644ae006a00ae82dfcd15d62a4254c398f5c5c941eb7cab1b204e1): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"04ebacdbcb644ae006a00ae82dfcd15d62a4254c398f5c5c941eb7cab1b204e1" Netns:"/var/run/netns/7a5fa44b-229f-4be7-a3ea-eefe545a0517" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=04ebacdbcb644ae006a00ae82dfcd15d62a4254c398f5c5c941eb7cab1b204e1;K8S_POD_UID=38e7be62-e4f5-42ba-89f0-83aca874a092" Path:"" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/38e7be62-e4f5-42ba-89f0-83aca874a092]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:44:20.690208 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:20.690208 master-0 kubenswrapper[8993]: > Dec 04 11:44:20.690208 master-0 kubenswrapper[8993]: E1204 11:44:20.686507 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:44:20.690208 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_38e7be62-e4f5-42ba-89f0-83aca874a092_0(04ebacdbcb644ae006a00ae82dfcd15d62a4254c398f5c5c941eb7cab1b204e1): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"04ebacdbcb644ae006a00ae82dfcd15d62a4254c398f5c5c941eb7cab1b204e1" Netns:"/var/run/netns/7a5fa44b-229f-4be7-a3ea-eefe545a0517" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=04ebacdbcb644ae006a00ae82dfcd15d62a4254c398f5c5c941eb7cab1b204e1;K8S_POD_UID=38e7be62-e4f5-42ba-89f0-83aca874a092" Path:"" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/38e7be62-e4f5-42ba-89f0-83aca874a092]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:44:20.690208 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:20.690208 master-0 kubenswrapper[8993]: > pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:44:20.690208 master-0 kubenswrapper[8993]: E1204 11:44:20.686534 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:44:20.690208 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_38e7be62-e4f5-42ba-89f0-83aca874a092_0(04ebacdbcb644ae006a00ae82dfcd15d62a4254c398f5c5c941eb7cab1b204e1): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"04ebacdbcb644ae006a00ae82dfcd15d62a4254c398f5c5c941eb7cab1b204e1" Netns:"/var/run/netns/7a5fa44b-229f-4be7-a3ea-eefe545a0517" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=04ebacdbcb644ae006a00ae82dfcd15d62a4254c398f5c5c941eb7cab1b204e1;K8S_POD_UID=38e7be62-e4f5-42ba-89f0-83aca874a092" Path:"" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/38e7be62-e4f5-42ba-89f0-83aca874a092]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:44:20.690208 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:20.690208 master-0 kubenswrapper[8993]: > pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:44:20.690208 master-0 kubenswrapper[8993]: E1204 11:44:20.686609 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"installer-2-master-0_openshift-kube-controller-manager(38e7be62-e4f5-42ba-89f0-83aca874a092)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"installer-2-master-0_openshift-kube-controller-manager(38e7be62-e4f5-42ba-89f0-83aca874a092)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-2-master-0_openshift-kube-controller-manager_38e7be62-e4f5-42ba-89f0-83aca874a092_0(04ebacdbcb644ae006a00ae82dfcd15d62a4254c398f5c5c941eb7cab1b204e1): error adding pod openshift-kube-controller-manager_installer-2-master-0 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"04ebacdbcb644ae006a00ae82dfcd15d62a4254c398f5c5c941eb7cab1b204e1\\\" Netns:\\\"/var/run/netns/7a5fa44b-229f-4be7-a3ea-eefe545a0517\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-controller-manager;K8S_POD_NAME=installer-2-master-0;K8S_POD_INFRA_CONTAINER_ID=04ebacdbcb644ae006a00ae82dfcd15d62a4254c398f5c5c941eb7cab1b204e1;K8S_POD_UID=38e7be62-e4f5-42ba-89f0-83aca874a092\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-kube-controller-manager/installer-2-master-0] networking: Multus: [openshift-kube-controller-manager/installer-2-master-0/38e7be62-e4f5-42ba-89f0-83aca874a092]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-2-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-2-master-0 in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/installer-2-master-0?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-kube-controller-manager/installer-2-master-0" podUID="38e7be62-e4f5-42ba-89f0-83aca874a092" Dec 04 11:44:20.798298 master-0 kubenswrapper[8993]: E1204 11:44:20.798210 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:44:20.798298 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_780ea907-dec5-426e-9de2-158f59c09f71_0(bed382eba2a719f3151923c86b8ac4743d06c032477ad90976b29f8a069a781e): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"bed382eba2a719f3151923c86b8ac4743d06c032477ad90976b29f8a069a781e" Netns:"/var/run/netns/a65c453e-1eb1-43ed-bfdc-02ac76de4d95" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=bed382eba2a719f3151923c86b8ac4743d06c032477ad90976b29f8a069a781e;K8S_POD_UID=780ea907-dec5-426e-9de2-158f59c09f71" Path:"" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/780ea907-dec5-426e-9de2-158f59c09f71]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:44:20.798298 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:20.798298 master-0 kubenswrapper[8993]: > Dec 04 11:44:20.798611 master-0 kubenswrapper[8993]: E1204 11:44:20.798304 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:44:20.798611 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_780ea907-dec5-426e-9de2-158f59c09f71_0(bed382eba2a719f3151923c86b8ac4743d06c032477ad90976b29f8a069a781e): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"bed382eba2a719f3151923c86b8ac4743d06c032477ad90976b29f8a069a781e" Netns:"/var/run/netns/a65c453e-1eb1-43ed-bfdc-02ac76de4d95" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=bed382eba2a719f3151923c86b8ac4743d06c032477ad90976b29f8a069a781e;K8S_POD_UID=780ea907-dec5-426e-9de2-158f59c09f71" Path:"" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/780ea907-dec5-426e-9de2-158f59c09f71]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:44:20.798611 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:20.798611 master-0 kubenswrapper[8993]: > pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:44:20.798611 master-0 kubenswrapper[8993]: E1204 11:44:20.798330 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:44:20.798611 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_780ea907-dec5-426e-9de2-158f59c09f71_0(bed382eba2a719f3151923c86b8ac4743d06c032477ad90976b29f8a069a781e): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"bed382eba2a719f3151923c86b8ac4743d06c032477ad90976b29f8a069a781e" Netns:"/var/run/netns/a65c453e-1eb1-43ed-bfdc-02ac76de4d95" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=bed382eba2a719f3151923c86b8ac4743d06c032477ad90976b29f8a069a781e;K8S_POD_UID=780ea907-dec5-426e-9de2-158f59c09f71" Path:"" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/780ea907-dec5-426e-9de2-158f59c09f71]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:44:20.798611 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:20.798611 master-0 kubenswrapper[8993]: > pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:44:20.798611 master-0 kubenswrapper[8993]: E1204 11:44:20.798400 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"installer-4-master-0_openshift-kube-scheduler(780ea907-dec5-426e-9de2-158f59c09f71)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"installer-4-master-0_openshift-kube-scheduler(780ea907-dec5-426e-9de2-158f59c09f71)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-4-master-0_openshift-kube-scheduler_780ea907-dec5-426e-9de2-158f59c09f71_0(bed382eba2a719f3151923c86b8ac4743d06c032477ad90976b29f8a069a781e): error adding pod openshift-kube-scheduler_installer-4-master-0 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"bed382eba2a719f3151923c86b8ac4743d06c032477ad90976b29f8a069a781e\\\" Netns:\\\"/var/run/netns/a65c453e-1eb1-43ed-bfdc-02ac76de4d95\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-kube-scheduler;K8S_POD_NAME=installer-4-master-0;K8S_POD_INFRA_CONTAINER_ID=bed382eba2a719f3151923c86b8ac4743d06c032477ad90976b29f8a069a781e;K8S_POD_UID=780ea907-dec5-426e-9de2-158f59c09f71\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-kube-scheduler/installer-4-master-0] networking: Multus: [openshift-kube-scheduler/installer-4-master-0/780ea907-dec5-426e-9de2-158f59c09f71]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod installer-4-master-0 in out of cluster comm: SetNetworkStatus: failed to update the pod installer-4-master-0 in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-scheduler/pods/installer-4-master-0?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-kube-scheduler/installer-4-master-0" podUID="780ea907-dec5-426e-9de2-158f59c09f71" Dec 04 11:44:20.916511 master-0 kubenswrapper[8993]: E1204 11:44:20.915195 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:44:20.916511 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-rxhpq_openshift-marketplace_5ae25dd5-dfdb-42f6-97d0-14ad17743c95_0(0ecca18a3a940680db77cae1d8b8234a78f0c29efebfeaa15eb406faccfeda9d): error adding pod openshift-marketplace_community-operators-rxhpq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"0ecca18a3a940680db77cae1d8b8234a78f0c29efebfeaa15eb406faccfeda9d" Netns:"/var/run/netns/65ce7944-cb85-4670-bb15-4627a14de53b" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-rxhpq;K8S_POD_INFRA_CONTAINER_ID=0ecca18a3a940680db77cae1d8b8234a78f0c29efebfeaa15eb406faccfeda9d;K8S_POD_UID=5ae25dd5-dfdb-42f6-97d0-14ad17743c95" Path:"" ERRORED: error configuring pod [openshift-marketplace/community-operators-rxhpq] networking: Multus: [openshift-marketplace/community-operators-rxhpq/5ae25dd5-dfdb-42f6-97d0-14ad17743c95]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-rxhpq in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-rxhpq in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-rxhpq?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:44:20.916511 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:20.916511 master-0 kubenswrapper[8993]: > Dec 04 11:44:20.916511 master-0 kubenswrapper[8993]: E1204 11:44:20.915284 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:44:20.916511 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-rxhpq_openshift-marketplace_5ae25dd5-dfdb-42f6-97d0-14ad17743c95_0(0ecca18a3a940680db77cae1d8b8234a78f0c29efebfeaa15eb406faccfeda9d): error adding pod openshift-marketplace_community-operators-rxhpq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"0ecca18a3a940680db77cae1d8b8234a78f0c29efebfeaa15eb406faccfeda9d" Netns:"/var/run/netns/65ce7944-cb85-4670-bb15-4627a14de53b" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-rxhpq;K8S_POD_INFRA_CONTAINER_ID=0ecca18a3a940680db77cae1d8b8234a78f0c29efebfeaa15eb406faccfeda9d;K8S_POD_UID=5ae25dd5-dfdb-42f6-97d0-14ad17743c95" Path:"" ERRORED: error configuring pod [openshift-marketplace/community-operators-rxhpq] networking: Multus: [openshift-marketplace/community-operators-rxhpq/5ae25dd5-dfdb-42f6-97d0-14ad17743c95]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-rxhpq in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-rxhpq in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-rxhpq?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:44:20.916511 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:20.916511 master-0 kubenswrapper[8993]: > pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:44:20.916511 master-0 kubenswrapper[8993]: E1204 11:44:20.915305 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:44:20.916511 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-rxhpq_openshift-marketplace_5ae25dd5-dfdb-42f6-97d0-14ad17743c95_0(0ecca18a3a940680db77cae1d8b8234a78f0c29efebfeaa15eb406faccfeda9d): error adding pod openshift-marketplace_community-operators-rxhpq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"0ecca18a3a940680db77cae1d8b8234a78f0c29efebfeaa15eb406faccfeda9d" Netns:"/var/run/netns/65ce7944-cb85-4670-bb15-4627a14de53b" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-rxhpq;K8S_POD_INFRA_CONTAINER_ID=0ecca18a3a940680db77cae1d8b8234a78f0c29efebfeaa15eb406faccfeda9d;K8S_POD_UID=5ae25dd5-dfdb-42f6-97d0-14ad17743c95" Path:"" ERRORED: error configuring pod [openshift-marketplace/community-operators-rxhpq] networking: Multus: [openshift-marketplace/community-operators-rxhpq/5ae25dd5-dfdb-42f6-97d0-14ad17743c95]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-rxhpq in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-rxhpq in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-rxhpq?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:44:20.916511 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:20.916511 master-0 kubenswrapper[8993]: > pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:44:20.916511 master-0 kubenswrapper[8993]: E1204 11:44:20.915371 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"community-operators-rxhpq_openshift-marketplace(5ae25dd5-dfdb-42f6-97d0-14ad17743c95)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"community-operators-rxhpq_openshift-marketplace(5ae25dd5-dfdb-42f6-97d0-14ad17743c95)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_community-operators-rxhpq_openshift-marketplace_5ae25dd5-dfdb-42f6-97d0-14ad17743c95_0(0ecca18a3a940680db77cae1d8b8234a78f0c29efebfeaa15eb406faccfeda9d): error adding pod openshift-marketplace_community-operators-rxhpq to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"0ecca18a3a940680db77cae1d8b8234a78f0c29efebfeaa15eb406faccfeda9d\\\" Netns:\\\"/var/run/netns/65ce7944-cb85-4670-bb15-4627a14de53b\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=community-operators-rxhpq;K8S_POD_INFRA_CONTAINER_ID=0ecca18a3a940680db77cae1d8b8234a78f0c29efebfeaa15eb406faccfeda9d;K8S_POD_UID=5ae25dd5-dfdb-42f6-97d0-14ad17743c95\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-marketplace/community-operators-rxhpq] networking: Multus: [openshift-marketplace/community-operators-rxhpq/5ae25dd5-dfdb-42f6-97d0-14ad17743c95]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod community-operators-rxhpq in out of cluster comm: SetNetworkStatus: failed to update the pod community-operators-rxhpq in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-rxhpq?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-marketplace/community-operators-rxhpq" podUID="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" Dec 04 11:44:20.924475 master-0 kubenswrapper[8993]: E1204 11:44:20.924131 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:44:20.924475 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_controller-manager-6686654b8d-rrndk_openshift-controller-manager_24506aa4-ab78-49df-bb58-59093498f13d_0(cfd724b83db7eda66758ee8447129a7dfeb31809a751bc0358c6f09a9428e9ee): error adding pod openshift-controller-manager_controller-manager-6686654b8d-rrndk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"cfd724b83db7eda66758ee8447129a7dfeb31809a751bc0358c6f09a9428e9ee" Netns:"/var/run/netns/189d0a6b-f161-4d53-a497-b9eb33e6c80e" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-controller-manager;K8S_POD_NAME=controller-manager-6686654b8d-rrndk;K8S_POD_INFRA_CONTAINER_ID=cfd724b83db7eda66758ee8447129a7dfeb31809a751bc0358c6f09a9428e9ee;K8S_POD_UID=24506aa4-ab78-49df-bb58-59093498f13d" Path:"" ERRORED: error configuring pod [openshift-controller-manager/controller-manager-6686654b8d-rrndk] networking: Multus: [openshift-controller-manager/controller-manager-6686654b8d-rrndk/24506aa4-ab78-49df-bb58-59093498f13d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: SetNetworkStatus: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-controller-manager/pods/controller-manager-6686654b8d-rrndk?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:44:20.924475 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:20.924475 master-0 kubenswrapper[8993]: > Dec 04 11:44:20.924475 master-0 kubenswrapper[8993]: E1204 11:44:20.924184 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:44:20.924475 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_controller-manager-6686654b8d-rrndk_openshift-controller-manager_24506aa4-ab78-49df-bb58-59093498f13d_0(cfd724b83db7eda66758ee8447129a7dfeb31809a751bc0358c6f09a9428e9ee): error adding pod openshift-controller-manager_controller-manager-6686654b8d-rrndk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"cfd724b83db7eda66758ee8447129a7dfeb31809a751bc0358c6f09a9428e9ee" Netns:"/var/run/netns/189d0a6b-f161-4d53-a497-b9eb33e6c80e" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-controller-manager;K8S_POD_NAME=controller-manager-6686654b8d-rrndk;K8S_POD_INFRA_CONTAINER_ID=cfd724b83db7eda66758ee8447129a7dfeb31809a751bc0358c6f09a9428e9ee;K8S_POD_UID=24506aa4-ab78-49df-bb58-59093498f13d" Path:"" ERRORED: error configuring pod [openshift-controller-manager/controller-manager-6686654b8d-rrndk] networking: Multus: [openshift-controller-manager/controller-manager-6686654b8d-rrndk/24506aa4-ab78-49df-bb58-59093498f13d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: SetNetworkStatus: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-controller-manager/pods/controller-manager-6686654b8d-rrndk?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:44:20.924475 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:20.924475 master-0 kubenswrapper[8993]: > pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:44:20.924475 master-0 kubenswrapper[8993]: E1204 11:44:20.924202 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:44:20.924475 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_controller-manager-6686654b8d-rrndk_openshift-controller-manager_24506aa4-ab78-49df-bb58-59093498f13d_0(cfd724b83db7eda66758ee8447129a7dfeb31809a751bc0358c6f09a9428e9ee): error adding pod openshift-controller-manager_controller-manager-6686654b8d-rrndk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"cfd724b83db7eda66758ee8447129a7dfeb31809a751bc0358c6f09a9428e9ee" Netns:"/var/run/netns/189d0a6b-f161-4d53-a497-b9eb33e6c80e" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-controller-manager;K8S_POD_NAME=controller-manager-6686654b8d-rrndk;K8S_POD_INFRA_CONTAINER_ID=cfd724b83db7eda66758ee8447129a7dfeb31809a751bc0358c6f09a9428e9ee;K8S_POD_UID=24506aa4-ab78-49df-bb58-59093498f13d" Path:"" ERRORED: error configuring pod [openshift-controller-manager/controller-manager-6686654b8d-rrndk] networking: Multus: [openshift-controller-manager/controller-manager-6686654b8d-rrndk/24506aa4-ab78-49df-bb58-59093498f13d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: SetNetworkStatus: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-controller-manager/pods/controller-manager-6686654b8d-rrndk?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:44:20.924475 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:20.924475 master-0 kubenswrapper[8993]: > pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:44:20.924475 master-0 kubenswrapper[8993]: E1204 11:44:20.924250 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"controller-manager-6686654b8d-rrndk_openshift-controller-manager(24506aa4-ab78-49df-bb58-59093498f13d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"controller-manager-6686654b8d-rrndk_openshift-controller-manager(24506aa4-ab78-49df-bb58-59093498f13d)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_controller-manager-6686654b8d-rrndk_openshift-controller-manager_24506aa4-ab78-49df-bb58-59093498f13d_0(cfd724b83db7eda66758ee8447129a7dfeb31809a751bc0358c6f09a9428e9ee): error adding pod openshift-controller-manager_controller-manager-6686654b8d-rrndk to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"cfd724b83db7eda66758ee8447129a7dfeb31809a751bc0358c6f09a9428e9ee\\\" Netns:\\\"/var/run/netns/189d0a6b-f161-4d53-a497-b9eb33e6c80e\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-controller-manager;K8S_POD_NAME=controller-manager-6686654b8d-rrndk;K8S_POD_INFRA_CONTAINER_ID=cfd724b83db7eda66758ee8447129a7dfeb31809a751bc0358c6f09a9428e9ee;K8S_POD_UID=24506aa4-ab78-49df-bb58-59093498f13d\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-controller-manager/controller-manager-6686654b8d-rrndk] networking: Multus: [openshift-controller-manager/controller-manager-6686654b8d-rrndk/24506aa4-ab78-49df-bb58-59093498f13d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: SetNetworkStatus: failed to update the pod controller-manager-6686654b8d-rrndk in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-controller-manager/pods/controller-manager-6686654b8d-rrndk?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" podUID="24506aa4-ab78-49df-bb58-59093498f13d" Dec 04 11:44:20.933500 master-0 kubenswrapper[8993]: E1204 11:44:20.933120 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:44:20.933500 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_certified-operators-8qs8v_openshift-marketplace_b620f29d-dcde-4f98-9fb6-dd479dcdcf7c_0(e74346efbf42471b8e65ff042f712147ecf9da8b437316001d266d242514be2d): error adding pod openshift-marketplace_certified-operators-8qs8v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"e74346efbf42471b8e65ff042f712147ecf9da8b437316001d266d242514be2d" Netns:"/var/run/netns/dbad1133-6a04-4887-b892-91abbd10de95" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=certified-operators-8qs8v;K8S_POD_INFRA_CONTAINER_ID=e74346efbf42471b8e65ff042f712147ecf9da8b437316001d266d242514be2d;K8S_POD_UID=b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" Path:"" ERRORED: error configuring pod [openshift-marketplace/certified-operators-8qs8v] networking: Multus: [openshift-marketplace/certified-operators-8qs8v/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod certified-operators-8qs8v in out of cluster comm: SetNetworkStatus: failed to update the pod certified-operators-8qs8v in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/certified-operators-8qs8v?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:44:20.933500 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:20.933500 master-0 kubenswrapper[8993]: > Dec 04 11:44:20.933500 master-0 kubenswrapper[8993]: E1204 11:44:20.933176 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:44:20.933500 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_certified-operators-8qs8v_openshift-marketplace_b620f29d-dcde-4f98-9fb6-dd479dcdcf7c_0(e74346efbf42471b8e65ff042f712147ecf9da8b437316001d266d242514be2d): error adding pod openshift-marketplace_certified-operators-8qs8v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"e74346efbf42471b8e65ff042f712147ecf9da8b437316001d266d242514be2d" Netns:"/var/run/netns/dbad1133-6a04-4887-b892-91abbd10de95" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=certified-operators-8qs8v;K8S_POD_INFRA_CONTAINER_ID=e74346efbf42471b8e65ff042f712147ecf9da8b437316001d266d242514be2d;K8S_POD_UID=b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" Path:"" ERRORED: error configuring pod [openshift-marketplace/certified-operators-8qs8v] networking: Multus: [openshift-marketplace/certified-operators-8qs8v/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod certified-operators-8qs8v in out of cluster comm: SetNetworkStatus: failed to update the pod certified-operators-8qs8v in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/certified-operators-8qs8v?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:44:20.933500 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:20.933500 master-0 kubenswrapper[8993]: > pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:44:20.933500 master-0 kubenswrapper[8993]: E1204 11:44:20.933192 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:44:20.933500 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_certified-operators-8qs8v_openshift-marketplace_b620f29d-dcde-4f98-9fb6-dd479dcdcf7c_0(e74346efbf42471b8e65ff042f712147ecf9da8b437316001d266d242514be2d): error adding pod openshift-marketplace_certified-operators-8qs8v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"e74346efbf42471b8e65ff042f712147ecf9da8b437316001d266d242514be2d" Netns:"/var/run/netns/dbad1133-6a04-4887-b892-91abbd10de95" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=certified-operators-8qs8v;K8S_POD_INFRA_CONTAINER_ID=e74346efbf42471b8e65ff042f712147ecf9da8b437316001d266d242514be2d;K8S_POD_UID=b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" Path:"" ERRORED: error configuring pod [openshift-marketplace/certified-operators-8qs8v] networking: Multus: [openshift-marketplace/certified-operators-8qs8v/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod certified-operators-8qs8v in out of cluster comm: SetNetworkStatus: failed to update the pod certified-operators-8qs8v in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/certified-operators-8qs8v?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:44:20.933500 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:20.933500 master-0 kubenswrapper[8993]: > pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:44:20.933500 master-0 kubenswrapper[8993]: E1204 11:44:20.933256 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"certified-operators-8qs8v_openshift-marketplace(b620f29d-dcde-4f98-9fb6-dd479dcdcf7c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"certified-operators-8qs8v_openshift-marketplace(b620f29d-dcde-4f98-9fb6-dd479dcdcf7c)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_certified-operators-8qs8v_openshift-marketplace_b620f29d-dcde-4f98-9fb6-dd479dcdcf7c_0(e74346efbf42471b8e65ff042f712147ecf9da8b437316001d266d242514be2d): error adding pod openshift-marketplace_certified-operators-8qs8v to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"e74346efbf42471b8e65ff042f712147ecf9da8b437316001d266d242514be2d\\\" Netns:\\\"/var/run/netns/dbad1133-6a04-4887-b892-91abbd10de95\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-marketplace;K8S_POD_NAME=certified-operators-8qs8v;K8S_POD_INFRA_CONTAINER_ID=e74346efbf42471b8e65ff042f712147ecf9da8b437316001d266d242514be2d;K8S_POD_UID=b620f29d-dcde-4f98-9fb6-dd479dcdcf7c\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-marketplace/certified-operators-8qs8v] networking: Multus: [openshift-marketplace/certified-operators-8qs8v/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod certified-operators-8qs8v in out of cluster comm: SetNetworkStatus: failed to update the pod certified-operators-8qs8v in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/certified-operators-8qs8v?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-marketplace/certified-operators-8qs8v" podUID="b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" Dec 04 11:44:21.194271 master-0 kubenswrapper[8993]: I1204 11:44:21.194055 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-78f758c7b9-zgkh5_7e3160a9-11d1-4845-ba30-1a49ae7339a9/cluster-baremetal-operator/2.log" Dec 04 11:44:21.195117 master-0 kubenswrapper[8993]: I1204 11:44:21.194973 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-78f758c7b9-zgkh5_7e3160a9-11d1-4845-ba30-1a49ae7339a9/cluster-baremetal-operator/1.log" Dec 04 11:44:21.196232 master-0 kubenswrapper[8993]: I1204 11:44:21.196169 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-78f758c7b9-zgkh5_7e3160a9-11d1-4845-ba30-1a49ae7339a9/cluster-baremetal-operator/0.log" Dec 04 11:44:21.196369 master-0 kubenswrapper[8993]: I1204 11:44:21.196233 8993 generic.go:334] "Generic (PLEG): container finished" podID="7e3160a9-11d1-4845-ba30-1a49ae7339a9" containerID="5a4d065f4aef4c58a64842a3b127c4de733504b1bb6ebdb85310e09d409339ca" exitCode=1 Dec 04 11:44:21.678560 master-0 kubenswrapper[8993]: I1204 11:44:21.678507 8993 scope.go:117] "RemoveContainer" containerID="f8eb928e51ec9bf13f9354409288ca080a3ee9211f423ab53973ca61d201ddbb" Dec 04 11:44:21.707750 master-0 kubenswrapper[8993]: I1204 11:44:21.707705 8993 scope.go:117] "RemoveContainer" containerID="a126ca57c03b18fb6fa405d36e189ab201f4700a3aff868c2ddd170df50ee89e" Dec 04 11:44:22.605207 master-0 kubenswrapper[8993]: I1204 11:44:22.605079 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": dial tcp [::1]:10357: connect: connection refused" Dec 04 11:44:23.358218 master-0 kubenswrapper[8993]: I1204 11:44:23.358114 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:44:23.358218 master-0 kubenswrapper[8993]: I1204 11:44:23.358201 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:44:25.235070 master-0 kubenswrapper[8993]: I1204 11:44:25.234852 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/2.log" Dec 04 11:44:25.236422 master-0 kubenswrapper[8993]: I1204 11:44:25.235761 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/1.log" Dec 04 11:44:25.236422 master-0 kubenswrapper[8993]: I1204 11:44:25.236306 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/0.log" Dec 04 11:44:25.236422 master-0 kubenswrapper[8993]: I1204 11:44:25.236341 8993 generic.go:334] "Generic (PLEG): container finished" podID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" containerID="470ab1d7deaea833e2123e55c64ae492c4fd69592633e3def3e6d22b517c513f" exitCode=1 Dec 04 11:44:26.357355 master-0 kubenswrapper[8993]: I1204 11:44:26.357266 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:44:26.357355 master-0 kubenswrapper[8993]: I1204 11:44:26.357356 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:44:26.435740 master-0 kubenswrapper[8993]: I1204 11:44:26.435600 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": dial tcp [::1]:10357: connect: connection refused" Dec 04 11:44:27.961673 master-0 kubenswrapper[8993]: E1204 11:44:27.961604 8993 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:44:27.962365 master-0 kubenswrapper[8993]: E1204 11:44:27.961980 8993 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="34.012s" Dec 04 11:44:27.962365 master-0 kubenswrapper[8993]: I1204 11:44:27.962144 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:44:27.963091 master-0 kubenswrapper[8993]: I1204 11:44:27.963046 8993 scope.go:117] "RemoveContainer" containerID="6c60e9f210f8345eb6f6fc04cca90e4cb57c82e255bdcd593b988c293e0489ca" Dec 04 11:44:27.963524 master-0 kubenswrapper[8993]: I1204 11:44:27.963474 8993 scope.go:117] "RemoveContainer" containerID="a573a12b7e61507c596e1178d09644f02ee9de55d89553ed9fce32978b18dcf3" Dec 04 11:44:27.963680 master-0 kubenswrapper[8993]: I1204 11:44:27.963621 8993 scope.go:117] "RemoveContainer" containerID="313a5a3e45bfc56240a41a6b2d15c82ca825cd210b3e33c0eb74e4e915c86d54" Dec 04 11:44:27.963781 master-0 kubenswrapper[8993]: I1204 11:44:27.963760 8993 scope.go:117] "RemoveContainer" containerID="3a28dcf3ab15a5ab11146a0fd47986bde79e431316166b88f994d0a65f348758" Dec 04 11:44:27.964035 master-0 kubenswrapper[8993]: I1204 11:44:27.963974 8993 scope.go:117] "RemoveContainer" containerID="a6d14a522051fb2206df06257821a6c013ab79cc060f6af18a92935eb6c12df9" Dec 04 11:44:27.965392 master-0 kubenswrapper[8993]: I1204 11:44:27.965357 8993 scope.go:117] "RemoveContainer" containerID="75e7ab729f90601f1a3824e70ddebf2fb143cea828b4fc655dacf16540161a43" Dec 04 11:44:27.968623 master-0 kubenswrapper[8993]: I1204 11:44:27.968564 8993 scope.go:117] "RemoveContainer" containerID="602399891f95b4f2d3b03e62ba9f8e399daa0e9695e2efa23e0a025273d42dbf" Dec 04 11:44:27.970076 master-0 kubenswrapper[8993]: I1204 11:44:27.970045 8993 scope.go:117] "RemoveContainer" containerID="f0266ae130e78641667767b4e7c8f6513c8fa351825903565f61acb84ef9c0ac" Dec 04 11:44:27.970902 master-0 kubenswrapper[8993]: I1204 11:44:27.970858 8993 scope.go:117] "RemoveContainer" containerID="db80abb8e4c0e90fdd2ce38c6760862b2f66436f0df8b6e38dd7af704d246cce" Dec 04 11:44:27.976707 master-0 kubenswrapper[8993]: I1204 11:44:27.975834 8993 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0-master-0" podUID="" Dec 04 11:44:29.264178 master-0 kubenswrapper[8993]: I1204 11:44:29.264133 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler-operator_openshift-kube-scheduler-operator-5f85974995-g4rwv_27576028-d64a-47cd-b76b-d524e41efe37/kube-scheduler-operator-container/2.log" Dec 04 11:44:29.265395 master-0 kubenswrapper[8993]: I1204 11:44:29.265321 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler-operator_openshift-kube-scheduler-operator-5f85974995-g4rwv_27576028-d64a-47cd-b76b-d524e41efe37/kube-scheduler-operator-container/1.log" Dec 04 11:44:29.268502 master-0 kubenswrapper[8993]: I1204 11:44:29.268483 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_network-operator-79767b7ff9-5bgzx_ffaf95be-586c-40fa-b15f-1beaffe7ff1c/network-operator/2.log" Dec 04 11:44:29.269077 master-0 kubenswrapper[8993]: I1204 11:44:29.269048 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_network-operator-79767b7ff9-5bgzx_ffaf95be-586c-40fa-b15f-1beaffe7ff1c/network-operator/1.log" Dec 04 11:44:29.269652 master-0 kubenswrapper[8993]: I1204 11:44:29.269633 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_network-operator-79767b7ff9-5bgzx_ffaf95be-586c-40fa-b15f-1beaffe7ff1c/network-operator/0.log" Dec 04 11:44:29.272999 master-0 kubenswrapper[8993]: I1204 11:44:29.272968 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication-operator_authentication-operator-6c968fdfdf-nrrfw_42b3be0f-1d82-4a64-abb4-0118a6960efd/authentication-operator/2.log" Dec 04 11:44:29.273543 master-0 kubenswrapper[8993]: I1204 11:44:29.273510 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication-operator_authentication-operator-6c968fdfdf-nrrfw_42b3be0f-1d82-4a64-abb4-0118a6960efd/authentication-operator/1.log" Dec 04 11:44:29.276357 master-0 kubenswrapper[8993]: I1204 11:44:29.276315 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-b9c5dfc78-dcxkw_fd9f8671-8066-4990-b45d-8b619aa5d9ec/kube-storage-version-migrator-operator/2.log" Dec 04 11:44:29.276847 master-0 kubenswrapper[8993]: I1204 11:44:29.276777 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-b9c5dfc78-dcxkw_fd9f8671-8066-4990-b45d-8b619aa5d9ec/kube-storage-version-migrator-operator/1.log" Dec 04 11:44:29.285739 master-0 kubenswrapper[8993]: I1204 11:44:29.285702 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_cluster-storage-operator-dcf7fc84b-fncfd_f797ab14-0eb5-48b4-b914-f434f67c4c49/cluster-storage-operator/1.log" Dec 04 11:44:29.286330 master-0 kubenswrapper[8993]: I1204 11:44:29.286313 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_cluster-storage-operator-dcf7fc84b-fncfd_f797ab14-0eb5-48b4-b914-f434f67c4c49/cluster-storage-operator/0.log" Dec 04 11:44:29.288897 master-0 kubenswrapper[8993]: I1204 11:44:29.288876 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-77758bc754-8smqn_8e5e33b0-4e2e-464c-ba5b-cbd2048004f8/service-ca-operator/2.log" Dec 04 11:44:29.289321 master-0 kubenswrapper[8993]: I1204 11:44:29.289305 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-77758bc754-8smqn_8e5e33b0-4e2e-464c-ba5b-cbd2048004f8/service-ca-operator/1.log" Dec 04 11:44:29.291849 master-0 kubenswrapper[8993]: I1204 11:44:29.291795 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-lifecycle-manager_package-server-manager-67477646d4-7hndf_72faf6d6-e8ca-43d1-b93e-67c11f8d3b46/package-server-manager/0.log" Dec 04 11:44:29.357127 master-0 kubenswrapper[8993]: I1204 11:44:29.357013 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:44:29.357458 master-0 kubenswrapper[8993]: I1204 11:44:29.357139 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:44:32.357361 master-0 kubenswrapper[8993]: I1204 11:44:32.357284 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:44:32.357361 master-0 kubenswrapper[8993]: I1204 11:44:32.357366 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:44:35.356395 master-0 kubenswrapper[8993]: I1204 11:44:35.356346 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:44:35.357098 master-0 kubenswrapper[8993]: I1204 11:44:35.357006 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:44:38.357180 master-0 kubenswrapper[8993]: I1204 11:44:38.357066 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:44:38.357180 master-0 kubenswrapper[8993]: I1204 11:44:38.357173 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:44:41.357259 master-0 kubenswrapper[8993]: I1204 11:44:41.357145 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:44:41.358065 master-0 kubenswrapper[8993]: I1204 11:44:41.357304 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:44:44.357454 master-0 kubenswrapper[8993]: I1204 11:44:44.357362 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:44:44.358123 master-0 kubenswrapper[8993]: I1204 11:44:44.357466 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:44:47.357010 master-0 kubenswrapper[8993]: I1204 11:44:47.356855 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:44:47.357010 master-0 kubenswrapper[8993]: I1204 11:44:47.356993 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:44:49.842452 master-0 kubenswrapper[8993]: I1204 11:44:49.842362 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-autoscaler-operator-5f49d774cd-894dk_e7fc7c16-5bca-49e5-aff0-7a8f80c6b639/cluster-autoscaler-operator/0.log" Dec 04 11:44:49.843199 master-0 kubenswrapper[8993]: I1204 11:44:49.842963 8993 generic.go:334] "Generic (PLEG): container finished" podID="e7fc7c16-5bca-49e5-aff0-7a8f80c6b639" containerID="aaf8e0a82bd40fc3c589ed457817ceadfe679e3e1748948884223dddb5917051" exitCode=255 Dec 04 11:44:50.356849 master-0 kubenswrapper[8993]: I1204 11:44:50.356697 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:44:50.356849 master-0 kubenswrapper[8993]: I1204 11:44:50.356798 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:44:52.046045 master-0 kubenswrapper[8993]: I1204 11:44:52.045950 8993 status_manager.go:851] "Failed to get status for pod" podUID="7746ae23-c2f8-431c-9e52-dc3d0f9404d3" pod="openshift-kube-scheduler/installer-1-master-0" err="the server was unable to return a response in the time allotted, but may still be processing the request (get pods installer-1-master-0)" Dec 04 11:44:53.357172 master-0 kubenswrapper[8993]: I1204 11:44:53.357034 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:44:53.358123 master-0 kubenswrapper[8993]: I1204 11:44:53.357192 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:44:54.650259 master-0 kubenswrapper[8993]: E1204 11:44:54.650153 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:44:54.650259 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager_e4d7939a-5961-4608-b910-73e71aa55bf6_0(6d3b3f16703c335a06514238952905813ef880930cb5654115a32b53928d3f6c): error adding pod openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"6d3b3f16703c335a06514238952905813ef880930cb5654115a32b53928d3f6c" Netns:"/var/run/netns/e47c14cb-63b2-4e70-a12c-95b0aeef97d3" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-route-controller-manager;K8S_POD_NAME=route-controller-manager-95cb5f987-46bsk;K8S_POD_INFRA_CONTAINER_ID=6d3b3f16703c335a06514238952905813ef880930cb5654115a32b53928d3f6c;K8S_POD_UID=e4d7939a-5961-4608-b910-73e71aa55bf6" Path:"" ERRORED: error configuring pod [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk] networking: Multus: [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk/e4d7939a-5961-4608-b910-73e71aa55bf6]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: SetNetworkStatus: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:44:54.650259 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:54.650259 master-0 kubenswrapper[8993]: > Dec 04 11:44:54.651595 master-0 kubenswrapper[8993]: E1204 11:44:54.650282 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:44:54.651595 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager_e4d7939a-5961-4608-b910-73e71aa55bf6_0(6d3b3f16703c335a06514238952905813ef880930cb5654115a32b53928d3f6c): error adding pod openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"6d3b3f16703c335a06514238952905813ef880930cb5654115a32b53928d3f6c" Netns:"/var/run/netns/e47c14cb-63b2-4e70-a12c-95b0aeef97d3" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-route-controller-manager;K8S_POD_NAME=route-controller-manager-95cb5f987-46bsk;K8S_POD_INFRA_CONTAINER_ID=6d3b3f16703c335a06514238952905813ef880930cb5654115a32b53928d3f6c;K8S_POD_UID=e4d7939a-5961-4608-b910-73e71aa55bf6" Path:"" ERRORED: error configuring pod [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk] networking: Multus: [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk/e4d7939a-5961-4608-b910-73e71aa55bf6]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: SetNetworkStatus: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:44:54.651595 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:54.651595 master-0 kubenswrapper[8993]: > pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:44:54.651595 master-0 kubenswrapper[8993]: E1204 11:44:54.650319 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:44:54.651595 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager_e4d7939a-5961-4608-b910-73e71aa55bf6_0(6d3b3f16703c335a06514238952905813ef880930cb5654115a32b53928d3f6c): error adding pod openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"6d3b3f16703c335a06514238952905813ef880930cb5654115a32b53928d3f6c" Netns:"/var/run/netns/e47c14cb-63b2-4e70-a12c-95b0aeef97d3" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-route-controller-manager;K8S_POD_NAME=route-controller-manager-95cb5f987-46bsk;K8S_POD_INFRA_CONTAINER_ID=6d3b3f16703c335a06514238952905813ef880930cb5654115a32b53928d3f6c;K8S_POD_UID=e4d7939a-5961-4608-b910-73e71aa55bf6" Path:"" ERRORED: error configuring pod [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk] networking: Multus: [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk/e4d7939a-5961-4608-b910-73e71aa55bf6]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: SetNetworkStatus: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk?timeout=1m0s": net/http: request canceled (Client.Timeout exceeded while awaiting headers) Dec 04 11:44:54.651595 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:54.651595 master-0 kubenswrapper[8993]: > pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:44:54.651595 master-0 kubenswrapper[8993]: E1204 11:44:54.650453 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager(e4d7939a-5961-4608-b910-73e71aa55bf6)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager(e4d7939a-5961-4608-b910-73e71aa55bf6)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager_e4d7939a-5961-4608-b910-73e71aa55bf6_0(6d3b3f16703c335a06514238952905813ef880930cb5654115a32b53928d3f6c): error adding pod openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"6d3b3f16703c335a06514238952905813ef880930cb5654115a32b53928d3f6c\\\" Netns:\\\"/var/run/netns/e47c14cb-63b2-4e70-a12c-95b0aeef97d3\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-route-controller-manager;K8S_POD_NAME=route-controller-manager-95cb5f987-46bsk;K8S_POD_INFRA_CONTAINER_ID=6d3b3f16703c335a06514238952905813ef880930cb5654115a32b53928d3f6c;K8S_POD_UID=e4d7939a-5961-4608-b910-73e71aa55bf6\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk] networking: Multus: [openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk/e4d7939a-5961-4608-b910-73e71aa55bf6]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: SetNetworkStatus: failed to update the pod route-controller-manager-95cb5f987-46bsk in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk?timeout=1m0s\\\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" Dec 04 11:44:54.750060 master-0 kubenswrapper[8993]: E1204 11:44:54.748788 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:44:54.750060 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager_855d7874-16b1-47d0-82f6-d2b0c89b9a84_0(08bff72cbcb288755b606d271a90590d5de4969e52f24b14dfba197207176aab): error adding pod openshift-operator-lifecycle-manager_packageserver-675f5c767c-mtdrq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"08bff72cbcb288755b606d271a90590d5de4969e52f24b14dfba197207176aab" Netns:"/var/run/netns/a579b1af-3832-4c4e-8db5-2e91b975a454" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-operator-lifecycle-manager;K8S_POD_NAME=packageserver-675f5c767c-mtdrq;K8S_POD_INFRA_CONTAINER_ID=08bff72cbcb288755b606d271a90590d5de4969e52f24b14dfba197207176aab;K8S_POD_UID=855d7874-16b1-47d0-82f6-d2b0c89b9a84" Path:"" ERRORED: error configuring pod [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq] networking: Multus: [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq/855d7874-16b1-47d0-82f6-d2b0c89b9a84]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: SetNetworkStatus: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: status update failed for pod /: the server was unable to return a response in the time allotted, but may still be processing the request (get pods packageserver-675f5c767c-mtdrq) Dec 04 11:44:54.750060 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:54.750060 master-0 kubenswrapper[8993]: > Dec 04 11:44:54.750060 master-0 kubenswrapper[8993]: E1204 11:44:54.748909 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:44:54.750060 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager_855d7874-16b1-47d0-82f6-d2b0c89b9a84_0(08bff72cbcb288755b606d271a90590d5de4969e52f24b14dfba197207176aab): error adding pod openshift-operator-lifecycle-manager_packageserver-675f5c767c-mtdrq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"08bff72cbcb288755b606d271a90590d5de4969e52f24b14dfba197207176aab" Netns:"/var/run/netns/a579b1af-3832-4c4e-8db5-2e91b975a454" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-operator-lifecycle-manager;K8S_POD_NAME=packageserver-675f5c767c-mtdrq;K8S_POD_INFRA_CONTAINER_ID=08bff72cbcb288755b606d271a90590d5de4969e52f24b14dfba197207176aab;K8S_POD_UID=855d7874-16b1-47d0-82f6-d2b0c89b9a84" Path:"" ERRORED: error configuring pod [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq] networking: Multus: [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq/855d7874-16b1-47d0-82f6-d2b0c89b9a84]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: SetNetworkStatus: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: status update failed for pod /: the server was unable to return a response in the time allotted, but may still be processing the request (get pods packageserver-675f5c767c-mtdrq) Dec 04 11:44:54.750060 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:54.750060 master-0 kubenswrapper[8993]: > pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:44:54.750060 master-0 kubenswrapper[8993]: E1204 11:44:54.749009 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:44:54.750060 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager_855d7874-16b1-47d0-82f6-d2b0c89b9a84_0(08bff72cbcb288755b606d271a90590d5de4969e52f24b14dfba197207176aab): error adding pod openshift-operator-lifecycle-manager_packageserver-675f5c767c-mtdrq to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"08bff72cbcb288755b606d271a90590d5de4969e52f24b14dfba197207176aab" Netns:"/var/run/netns/a579b1af-3832-4c4e-8db5-2e91b975a454" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-operator-lifecycle-manager;K8S_POD_NAME=packageserver-675f5c767c-mtdrq;K8S_POD_INFRA_CONTAINER_ID=08bff72cbcb288755b606d271a90590d5de4969e52f24b14dfba197207176aab;K8S_POD_UID=855d7874-16b1-47d0-82f6-d2b0c89b9a84" Path:"" ERRORED: error configuring pod [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq] networking: Multus: [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq/855d7874-16b1-47d0-82f6-d2b0c89b9a84]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: SetNetworkStatus: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: status update failed for pod /: the server was unable to return a response in the time allotted, but may still be processing the request (get pods packageserver-675f5c767c-mtdrq) Dec 04 11:44:54.750060 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:44:54.750060 master-0 kubenswrapper[8993]: > pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:44:54.750060 master-0 kubenswrapper[8993]: E1204 11:44:54.749108 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager(855d7874-16b1-47d0-82f6-d2b0c89b9a84)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager(855d7874-16b1-47d0-82f6-d2b0c89b9a84)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_packageserver-675f5c767c-mtdrq_openshift-operator-lifecycle-manager_855d7874-16b1-47d0-82f6-d2b0c89b9a84_0(08bff72cbcb288755b606d271a90590d5de4969e52f24b14dfba197207176aab): error adding pod openshift-operator-lifecycle-manager_packageserver-675f5c767c-mtdrq to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"08bff72cbcb288755b606d271a90590d5de4969e52f24b14dfba197207176aab\\\" Netns:\\\"/var/run/netns/a579b1af-3832-4c4e-8db5-2e91b975a454\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-operator-lifecycle-manager;K8S_POD_NAME=packageserver-675f5c767c-mtdrq;K8S_POD_INFRA_CONTAINER_ID=08bff72cbcb288755b606d271a90590d5de4969e52f24b14dfba197207176aab;K8S_POD_UID=855d7874-16b1-47d0-82f6-d2b0c89b9a84\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq] networking: Multus: [openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq/855d7874-16b1-47d0-82f6-d2b0c89b9a84]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: SetNetworkStatus: failed to update the pod packageserver-675f5c767c-mtdrq in out of cluster comm: status update failed for pod /: the server was unable to return a response in the time allotted, but may still be processing the request (get pods packageserver-675f5c767c-mtdrq)\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" podUID="855d7874-16b1-47d0-82f6-d2b0c89b9a84" Dec 04 11:44:56.357669 master-0 kubenswrapper[8993]: I1204 11:44:56.357534 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:44:56.358519 master-0 kubenswrapper[8993]: I1204 11:44:56.357674 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:44:59.356997 master-0 kubenswrapper[8993]: I1204 11:44:59.356905 8993 patch_prober.go:28] interesting pod/openshift-config-operator-68758cbcdb-zh8g5 container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" start-of-body= Dec 04 11:44:59.356997 master-0 kubenswrapper[8993]: I1204 11:44:59.356974 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" podUID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.128.0.10:8443/healthz\": dial tcp 10.128.0.10:8443: connect: connection refused" Dec 04 11:45:01.978638 master-0 kubenswrapper[8993]: E1204 11:45:01.978520 8993 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0-master-0" Dec 04 11:45:01.980209 master-0 kubenswrapper[8993]: E1204 11:45:01.978903 8993 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="34.017s" Dec 04 11:45:01.980209 master-0 kubenswrapper[8993]: I1204 11:45:01.979577 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:45:01.980209 master-0 kubenswrapper[8993]: I1204 11:45:01.979753 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:45:01.980209 master-0 kubenswrapper[8993]: I1204 11:45:01.980172 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:45:01.980543 master-0 kubenswrapper[8993]: I1204 11:45:01.980231 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:45:01.980543 master-0 kubenswrapper[8993]: I1204 11:45:01.980272 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:45:01.981889 master-0 kubenswrapper[8993]: I1204 11:45:01.981519 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:45:01.982872 master-0 kubenswrapper[8993]: I1204 11:45:01.982474 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:45:01.982872 master-0 kubenswrapper[8993]: I1204 11:45:01.982723 8993 scope.go:117] "RemoveContainer" containerID="5a4d065f4aef4c58a64842a3b127c4de733504b1bb6ebdb85310e09d409339ca" Dec 04 11:45:01.983923 master-0 kubenswrapper[8993]: I1204 11:45:01.983130 8993 scope.go:117] "RemoveContainer" containerID="d6c550a785a1145fdc343107de5010ef2c2358de520cd277331cd0afa9b20bdf" Dec 04 11:45:01.983923 master-0 kubenswrapper[8993]: I1204 11:45:01.983453 8993 scope.go:117] "RemoveContainer" containerID="90cc3b6000c187ca85e3ebde189fcb0fb0c22a655e72a22fb82a8f151adb8963" Dec 04 11:45:01.987680 master-0 kubenswrapper[8993]: I1204 11:45:01.987588 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:45:01.987768 master-0 kubenswrapper[8993]: I1204 11:45:01.987688 8993 scope.go:117] "RemoveContainer" containerID="456f267c13077df8fde873615eb32f2c8011d7876410ffb6709899a5fdee25ce" Dec 04 11:45:01.990897 master-0 kubenswrapper[8993]: I1204 11:45:01.990846 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:45:01.991319 master-0 kubenswrapper[8993]: I1204 11:45:01.991247 8993 scope.go:117] "RemoveContainer" containerID="470ab1d7deaea833e2123e55c64ae492c4fd69592633e3def3e6d22b517c513f" Dec 04 11:45:01.992511 master-0 kubenswrapper[8993]: I1204 11:45:01.992468 8993 scope.go:117] "RemoveContainer" containerID="067d901be9a85d08d5b38edc8f0dc976efa622744a3bc1f1c7a19a180b2e2f65" Dec 04 11:45:01.996601 master-0 kubenswrapper[8993]: I1204 11:45:01.996538 8993 scope.go:117] "RemoveContainer" containerID="48b19d28904c411ce854b75b8b7b3d47463402f85314112ea64f27cc79cc6747" Dec 04 11:45:02.004367 master-0 kubenswrapper[8993]: I1204 11:45:02.004289 8993 scope.go:117] "RemoveContainer" containerID="b4a708629c00edd600857e5208cac33c83ecd3ee4160351814e5fc4f907308cf" Dec 04 11:45:02.004680 master-0 kubenswrapper[8993]: I1204 11:45:02.004631 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:45:02.010522 master-0 kubenswrapper[8993]: I1204 11:45:02.010473 8993 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0-master-0" podUID="" Dec 04 11:45:02.947786 master-0 kubenswrapper[8993]: I1204 11:45:02.947725 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_cluster-node-tuning-operator-85cff47f46-4gv5j_6f15dcdb-c968-429c-9d1d-63c2becad337/cluster-node-tuning-operator/0.log" Dec 04 11:45:02.950491 master-0 kubenswrapper[8993]: I1204 11:45:02.950458 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-78f758c7b9-zgkh5_7e3160a9-11d1-4845-ba30-1a49ae7339a9/cluster-baremetal-operator/2.log" Dec 04 11:45:02.951100 master-0 kubenswrapper[8993]: I1204 11:45:02.951057 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-78f758c7b9-zgkh5_7e3160a9-11d1-4845-ba30-1a49ae7339a9/cluster-baremetal-operator/1.log" Dec 04 11:45:02.952065 master-0 kubenswrapper[8993]: I1204 11:45:02.952032 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-78f758c7b9-zgkh5_7e3160a9-11d1-4845-ba30-1a49ae7339a9/cluster-baremetal-operator/0.log" Dec 04 11:45:02.960601 master-0 kubenswrapper[8993]: I1204 11:45:02.960545 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/2.log" Dec 04 11:45:02.961069 master-0 kubenswrapper[8993]: I1204 11:45:02.961031 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/1.log" Dec 04 11:45:02.961514 master-0 kubenswrapper[8993]: I1204 11:45:02.961478 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/0.log" Dec 04 11:45:03.977158 master-0 kubenswrapper[8993]: I1204 11:45:03.977116 8993 generic.go:334] "Generic (PLEG): container finished" podID="8b47694fcc32464ab24d09c23d6efb57" containerID="c0669a25eca640b16ba8b2ecfd0f28795bd45ad2500d4e00f1ed214c5294a0cd" exitCode=1 Dec 04 11:45:05.727939 master-0 kubenswrapper[8993]: E1204 11:45:05.727171 8993 log.go:32] "RunPodSandbox from runtime service failed" err=< Dec 04 11:45:05.727939 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(5d2384d86be2f95b3966a53aba3cff3d8ac082133332b4d7e800c63a2574036a): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"5d2384d86be2f95b3966a53aba3cff3d8ac082133332b4d7e800c63a2574036a" Netns:"/var/run/netns/5587937f-ddb7-4990-8879-cff0c5f010ae" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=5d2384d86be2f95b3966a53aba3cff3d8ac082133332b4d7e800c63a2574036a;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378" Path:"" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s": context deadline exceeded Dec 04 11:45:05.727939 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:45:05.727939 master-0 kubenswrapper[8993]: > Dec 04 11:45:05.727939 master-0 kubenswrapper[8993]: E1204 11:45:05.727293 8993 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err=< Dec 04 11:45:05.727939 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(5d2384d86be2f95b3966a53aba3cff3d8ac082133332b4d7e800c63a2574036a): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"5d2384d86be2f95b3966a53aba3cff3d8ac082133332b4d7e800c63a2574036a" Netns:"/var/run/netns/5587937f-ddb7-4990-8879-cff0c5f010ae" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=5d2384d86be2f95b3966a53aba3cff3d8ac082133332b4d7e800c63a2574036a;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378" Path:"" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s": context deadline exceeded Dec 04 11:45:05.727939 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:45:05.727939 master-0 kubenswrapper[8993]: > pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:45:05.727939 master-0 kubenswrapper[8993]: E1204 11:45:05.727357 8993 kuberuntime_manager.go:1170] "CreatePodSandbox for pod failed" err=< Dec 04 11:45:05.727939 master-0 kubenswrapper[8993]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(5d2384d86be2f95b3966a53aba3cff3d8ac082133332b4d7e800c63a2574036a): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"5d2384d86be2f95b3966a53aba3cff3d8ac082133332b4d7e800c63a2574036a" Netns:"/var/run/netns/5587937f-ddb7-4990-8879-cff0c5f010ae" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=5d2384d86be2f95b3966a53aba3cff3d8ac082133332b4d7e800c63a2574036a;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378" Path:"" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get "https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s": context deadline exceeded Dec 04 11:45:05.727939 master-0 kubenswrapper[8993]: ': StdinData: {"binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Dec 04 11:45:05.727939 master-0 kubenswrapper[8993]: > pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:45:05.727939 master-0 kubenswrapper[8993]: E1204 11:45:05.727424 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"machine-api-operator-88d48b57d-9fjtd_openshift-machine-api(c50317d3-f7cd-4133-845e-44add57ac378)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"machine-api-operator-88d48b57d-9fjtd_openshift-machine-api(c50317d3-f7cd-4133-845e-44add57ac378)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_machine-api-operator-88d48b57d-9fjtd_openshift-machine-api_c50317d3-f7cd-4133-845e-44add57ac378_0(5d2384d86be2f95b3966a53aba3cff3d8ac082133332b4d7e800c63a2574036a): error adding pod openshift-machine-api_machine-api-operator-88d48b57d-9fjtd to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"5d2384d86be2f95b3966a53aba3cff3d8ac082133332b4d7e800c63a2574036a\\\" Netns:\\\"/var/run/netns/5587937f-ddb7-4990-8879-cff0c5f010ae\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-machine-api;K8S_POD_NAME=machine-api-operator-88d48b57d-9fjtd;K8S_POD_INFRA_CONTAINER_ID=5d2384d86be2f95b3966a53aba3cff3d8ac082133332b4d7e800c63a2574036a;K8S_POD_UID=c50317d3-f7cd-4133-845e-44add57ac378\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd] networking: Multus: [openshift-machine-api/machine-api-operator-88d48b57d-9fjtd/c50317d3-f7cd-4133-845e-44add57ac378]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: SetNetworkStatus: failed to update the pod machine-api-operator-88d48b57d-9fjtd in out of cluster comm: status update failed for pod /: Get \\\"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/pods/machine-api-operator-88d48b57d-9fjtd?timeout=1m0s\\\": context deadline exceeded\\n': StdinData: {\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" podUID="c50317d3-f7cd-4133-845e-44add57ac378" Dec 04 11:45:05.989503 master-0 kubenswrapper[8993]: I1204 11:45:05.989400 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:45:05.990108 master-0 kubenswrapper[8993]: I1204 11:45:05.990083 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:45:10.706675 master-0 kubenswrapper[8993]: E1204 11:45:10.706593 8993 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="8.727s" Dec 04 11:45:10.748031 master-0 kubenswrapper[8993]: I1204 11:45:10.742641 8993 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0-master-0" podUID="" Dec 04 11:45:10.753236 master-0 kubenswrapper[8993]: I1204 11:45:10.753137 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:45:10.753376 master-0 kubenswrapper[8993]: I1204 11:45:10.753335 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:45:10.753376 master-0 kubenswrapper[8993]: I1204 11:45:10.753365 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:45:10.753376 master-0 kubenswrapper[8993]: I1204 11:45:10.753379 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:45:10.753564 master-0 kubenswrapper[8993]: I1204 11:45:10.753465 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:45:10.753564 master-0 kubenswrapper[8993]: I1204 11:45:10.753482 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-krbbd" Dec 04 11:45:10.753564 master-0 kubenswrapper[8993]: I1204 11:45:10.753502 8993 status_manager.go:317] "Container readiness changed for unknown container" pod="kube-system/bootstrap-kube-controller-manager-master-0" containerID="cri-o://d63039df99a06e3559d65dad05cc9c8b2039b1a8f335a3c51eec53ca5b198558" Dec 04 11:45:10.753564 master-0 kubenswrapper[8993]: I1204 11:45:10.753514 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:45:10.753564 master-0 kubenswrapper[8993]: I1204 11:45:10.753528 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" event={"ID":"c835660f-5a79-4679-b9be-8543ca6ef5a1","Type":"ContainerStarted","Data":"749b44ec9e8d4f00f1e655c70a503d3b1ce1085e0a7eecca2e01f8fe90a6e0c2"} Dec 04 11:45:10.753885 master-0 kubenswrapper[8993]: I1204 11:45:10.753577 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:45:10.753885 master-0 kubenswrapper[8993]: I1204 11:45:10.753610 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:45:10.753885 master-0 kubenswrapper[8993]: I1204 11:45:10.753623 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:45:10.753885 master-0 kubenswrapper[8993]: I1204 11:45:10.753637 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-etcd/etcd-master-0" Dec 04 11:45:10.753885 master-0 kubenswrapper[8993]: I1204 11:45:10.753665 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:45:10.753885 master-0 kubenswrapper[8993]: I1204 11:45:10.753679 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:45:10.753885 master-0 kubenswrapper[8993]: I1204 11:45:10.753692 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:45:10.753885 master-0 kubenswrapper[8993]: I1204 11:45:10.753718 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:45:10.753885 master-0 kubenswrapper[8993]: I1204 11:45:10.753860 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-etcd/etcd-master-0" Dec 04 11:45:10.753885 master-0 kubenswrapper[8993]: I1204 11:45:10.753881 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wksdw" event={"ID":"018e9ad3-c071-45c6-bfa6-e53dda20c757","Type":"ContainerStarted","Data":"36c3fd8199ca96cb8487d893a32aa639b7c393be6ed6496e16f59c0791abf527"} Dec 04 11:45:10.753885 master-0 kubenswrapper[8993]: I1204 11:45:10.753898 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:45:10.754521 master-0 kubenswrapper[8993]: I1204 11:45:10.753935 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:45:10.754521 master-0 kubenswrapper[8993]: I1204 11:45:10.753949 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"8b47694fcc32464ab24d09c23d6efb57","Type":"ContainerStarted","Data":"68cefdb59268cb33333146cf2f74e7763f9033ac08d79970d8869684b7700cf2"} Dec 04 11:45:10.754521 master-0 kubenswrapper[8993]: I1204 11:45:10.753964 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:45:10.754521 master-0 kubenswrapper[8993]: I1204 11:45:10.753979 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:45:10.754521 master-0 kubenswrapper[8993]: I1204 11:45:10.753989 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:45:10.754521 master-0 kubenswrapper[8993]: I1204 11:45:10.754043 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-etcd/etcd-master-0" Dec 04 11:45:10.754521 master-0 kubenswrapper[8993]: I1204 11:45:10.754053 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:45:10.754521 master-0 kubenswrapper[8993]: I1204 11:45:10.754068 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" event={"ID":"7e3160a9-11d1-4845-ba30-1a49ae7339a9","Type":"ContainerStarted","Data":"e0f56c17864ba0f74d6e33ee62008f6da1f6df237d3a2bf24da757af97c1cd89"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.754086 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-1-master-0" event={"ID":"2dea9140-7c02-46cd-9b67-a2aee143c3a8","Type":"ContainerDied","Data":"97e14d6795f3ba77eb346fd28cc32caafbe4ac4a888e237d49c89ec74001590a"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.754954 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" event={"ID":"64d30b80-2336-49c2-a2c2-1e0694036a84","Type":"ContainerStarted","Data":"a7c32d6c73b938a3cbdf6ca02a06d64b482f8211939e165dbab4373af7c10541"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.754992 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-7f22v" event={"ID":"2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c","Type":"ContainerStarted","Data":"bf01610f07d799dee957df874d54a814bddfc7f890d6afabc5cc027100265399"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755009 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-55965856b6-skbmb" event={"ID":"b668f740-dbc3-48e0-9ebc-83bae3a43c83","Type":"ContainerStarted","Data":"397481b3f91ac25f72eb86f49a721b3557eba7e4607ac9ea2395672278f1bcfc"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755027 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-ghr5b" event={"ID":"a2aabd50-bfed-4ab5-ad19-f84ec50203ec","Type":"ContainerDied","Data":"d2725ac4d78fdf9566061ef8100f1f04d68cc38c172c702bd00a3a8215aa8d8e"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755046 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755083 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755098 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755115 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"c24e01603234fe8003f8aae8171b0065","Type":"ContainerDied","Data":"ec5adef1bc610591b982f90e781d407a1f1f553e2257a5524d4e326fae0da502"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755150 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-797cfd8b47-8wqgp" event={"ID":"ccf1cb9e-8885-4224-92d5-d1b116bc0090","Type":"ContainerStarted","Data":"24facb4e9f87c7e6c3a6d534f2d50d158053ac816ff2d9e538097bf79e4a7704"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755167 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" event={"ID":"f797ab14-0eb5-48b4-b914-f434f67c4c49","Type":"ContainerStarted","Data":"560ba30f370ec40b8f7156e79883f77ace5f0c511592152f47a88a654d161d5b"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755183 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" event={"ID":"3322cc5a-f1f7-4522-b423-19fb7f38cd43","Type":"ContainerStarted","Data":"4efa514695b682bb2d4ad336643391490d8d1ea01e30ed9629a1ef982abb6433"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755199 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-krbbd" event={"ID":"349b1e1d-db56-4960-b6ff-e2f5f07d4aaa","Type":"ContainerDied","Data":"df46ed9cb416f80d99a93862b94cdddf077285002596e27aa33cd31815366ba5"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755258 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" event={"ID":"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639","Type":"ContainerStarted","Data":"aaf8e0a82bd40fc3c589ed457817ceadfe679e3e1748948884223dddb5917051"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755275 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-scheduler-master-0" event={"ID":"5e09e2af7200e6f9be469dbfd9bb1127","Type":"ContainerStarted","Data":"9260d10a9ce4831a4fadd13bf96406e1fd7010c72540b33131aee4c3a133c938"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755308 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-krbbd" event={"ID":"349b1e1d-db56-4960-b6ff-e2f5f07d4aaa","Type":"ContainerStarted","Data":"4890abf2d3f01658d86ae12259448cdd3826f537570b783848a6220e06481aa8"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755322 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2p882" event={"ID":"a0710bdf-3961-48d6-864a-efbd6d68e852","Type":"ContainerDied","Data":"4f8471393d269f5a7f4cfca62361f53ea2107573029fedd35fb5f054330f7e70"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755337 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-797cfd8b47-8wqgp" event={"ID":"ccf1cb9e-8885-4224-92d5-d1b116bc0090","Type":"ContainerStarted","Data":"16d26cd24f93302960c3cd257591c56fe6c1a281352ddd7672f6da379efb840a"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755781 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" event={"ID":"7e3160a9-11d1-4845-ba30-1a49ae7339a9","Type":"ContainerStarted","Data":"aa2ca6d7bed669be922ad1ba5a0a322f3c44a0ef60988942199ce95ffc405be9"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755826 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-7f22v" event={"ID":"2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c","Type":"ContainerDied","Data":"bf01610f07d799dee957df874d54a814bddfc7f890d6afabc5cc027100265399"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755844 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-7f22v" event={"ID":"2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c","Type":"ContainerDied","Data":"ee17c5a232895ee588633b4fc8647abb50bd0280101befcae43811f2596f07e7"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755858 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wksdw" event={"ID":"018e9ad3-c071-45c6-bfa6-e53dda20c757","Type":"ContainerDied","Data":"36c3fd8199ca96cb8487d893a32aa639b7c393be6ed6496e16f59c0791abf527"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755874 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-ghr5b" event={"ID":"a2aabd50-bfed-4ab5-ad19-f84ec50203ec","Type":"ContainerDied","Data":"aa452c9783f0b829a2a3835614811770f6302ac6216bafb11edc376776d3168c"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755924 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" event={"ID":"ffaf95be-586c-40fa-b15f-1beaffe7ff1c","Type":"ContainerDied","Data":"38994ab2ae9659964fed86de7d58ee76405c493bf0a90b3260a8bc5301b5819a"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755946 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" event={"ID":"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48","Type":"ContainerStarted","Data":"760657f653245b292cc835a469bd76ffdf70307718fd7139083e006a5e12f961"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755961 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" event={"ID":"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48","Type":"ContainerStarted","Data":"7169aa966534042a209dbc77d82db08548c2b38ca834a1a1b58302b3c9862901"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.755974 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" event={"ID":"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48","Type":"ContainerStarted","Data":"a88d1f0e1d80ac478f7ad73d99091a69eb94f507aee6c58fd48df49c97a44d8d"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756006 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2p882" event={"ID":"a0710bdf-3961-48d6-864a-efbd6d68e852","Type":"ContainerDied","Data":"fa9c7f76d1131adc2959e788aafcb6d95d23ded230dc81a5ae7f70e4e6a74fe0"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756022 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" event={"ID":"c6e9271a-44ea-4612-ab60-4a9d489ed062","Type":"ContainerDied","Data":"dc75d44b8be7e058788b5cd96125d7bea4962e131339dd256a97c23ba994b1b7"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756045 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" event={"ID":"fd9f8671-8066-4990-b45d-8b619aa5d9ec","Type":"ContainerDied","Data":"e0e04ce110c25a2c4a312ed2fdb876c28e02526d17e1277179eb5a2f7c3254e0"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756082 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" event={"ID":"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8","Type":"ContainerDied","Data":"b6e0393f35b37b796e29e063a198964a882daa0edec21adc6f195e441be69db7"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756103 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" event={"ID":"27576028-d64a-47cd-b76b-d524e41efe37","Type":"ContainerDied","Data":"125cdcb9380437c2c74e709578e049126370c6c2e8787828f7e5e31c2a5f5cbe"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756122 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"c24e01603234fe8003f8aae8171b0065","Type":"ContainerDied","Data":"66bc8b1ef32ed555b89bf441dddf70148acb178d161951788f2034d094677933"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756158 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" event={"ID":"42b3be0f-1d82-4a64-abb4-0118a6960efd","Type":"ContainerDied","Data":"8543749f8386d25fbc9d05c27b7ab7559de13cecd2f9d2e22a588c804bace527"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756175 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" event={"ID":"bac00ac5-0371-48fd-b1cc-60438f08ae94","Type":"ContainerDied","Data":"c2365e3e1212552c67b403c1062c118ea5e3306eac11c30d2c954d48de545647"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756193 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" event={"ID":"ccf81538-4d5a-4c26-8e54-fe39331a625d","Type":"ContainerDied","Data":"36ec3b979824ab62e6f7509543dc4f347e7c4493e3f1c85b36fa97144a94acc1"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756210 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-f8hvq" event={"ID":"7203ec93-6572-4032-825c-140029a86058","Type":"ContainerDied","Data":"9b4ba98e62019491fc3009d22881e8502c26c25aed860943c3e8a4e83ac5e2e1"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756244 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" event={"ID":"a5b826c3-8638-4cf5-b974-b24e4282ce00","Type":"ContainerDied","Data":"ccce88b1ca2f9a134e692a16b1bcd6669f59f655145c0cf6017bc4ec59640741"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756263 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" event={"ID":"b011b1f1-3235-4e20-825b-ce711c052407","Type":"ContainerDied","Data":"8c8f5ab95655b4b56cfeec6bbc9fe176ccf7048325a2476ad9f982e855b05fb0"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756290 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" event={"ID":"7e3160a9-11d1-4845-ba30-1a49ae7339a9","Type":"ContainerDied","Data":"e0f56c17864ba0f74d6e33ee62008f6da1f6df237d3a2bf24da757af97c1cd89"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756328 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"8b47694fcc32464ab24d09c23d6efb57","Type":"ContainerDied","Data":"68cefdb59268cb33333146cf2f74e7763f9033ac08d79970d8869684b7700cf2"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756349 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-55965856b6-skbmb" event={"ID":"b668f740-dbc3-48e0-9ebc-83bae3a43c83","Type":"ContainerDied","Data":"397481b3f91ac25f72eb86f49a721b3557eba7e4607ac9ea2395672278f1bcfc"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756365 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" event={"ID":"b011b1f1-3235-4e20-825b-ce711c052407","Type":"ContainerStarted","Data":"1d2b175fde83364b4666d8066712242360f76256f651e330ae881c16c680384c"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756397 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" event={"ID":"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8","Type":"ContainerStarted","Data":"bf092013477d028b4e0ff6d6621a140759c75991960cac0199edb383102625b9"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756413 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-f8hvq" event={"ID":"7203ec93-6572-4032-825c-140029a86058","Type":"ContainerStarted","Data":"6ee863793f57b0f18fae063e87f584d73fae0eb1eb8a1275618f4008ffa23d64"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756427 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" event={"ID":"27576028-d64a-47cd-b76b-d524e41efe37","Type":"ContainerStarted","Data":"a5c78a2d8242e27c86fe1aef51f9f44b2ab668d62560b3158373aada11376ae9"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756448 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" event={"ID":"c6e9271a-44ea-4612-ab60-4a9d489ed062","Type":"ContainerStarted","Data":"0c42072520a6b53c6aa158c37fe784801234cd135b1f4b11a3d79b213d89865e"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756481 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" event={"ID":"42b3be0f-1d82-4a64-abb4-0118a6960efd","Type":"ContainerStarted","Data":"05275cb6451e1a77bd316f718a2831588e2ee8d0a474e33a3702ad4134ac254b"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756499 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" event={"ID":"fd9f8671-8066-4990-b45d-8b619aa5d9ec","Type":"ContainerStarted","Data":"eeb6c3dc3fc4ac2310a94746d140288965ceb78f995753a5fcb2fc6a20648fed"} Dec 04 11:45:10.756382 master-0 kubenswrapper[8993]: I1204 11:45:10.756514 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" event={"ID":"ffaf95be-586c-40fa-b15f-1beaffe7ff1c","Type":"ContainerStarted","Data":"10a13e320db86cab3c629c14a604cd412c42b909da0c8bde7337860edd2f6505"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.756531 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" event={"ID":"bac00ac5-0371-48fd-b1cc-60438f08ae94","Type":"ContainerStarted","Data":"2be6d5a0843c9ad0cefac288764262419d2b3e8c45c39b2471e38c3ea1a83dce"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.756565 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" event={"ID":"fd4c4c6f-380a-4cda-9a21-352b55ec2d98","Type":"ContainerDied","Data":"efdaa968c7f62ed279952ab0bc764a0bd7b1fa6435a03cf5affa209a48cd298e"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.756582 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" event={"ID":"f797ab14-0eb5-48b4-b914-f434f67c4c49","Type":"ContainerDied","Data":"560ba30f370ec40b8f7156e79883f77ace5f0c511592152f47a88a654d161d5b"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.756600 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" event={"ID":"3322cc5a-f1f7-4522-b423-19fb7f38cd43","Type":"ContainerDied","Data":"4efa514695b682bb2d4ad336643391490d8d1ea01e30ed9629a1ef982abb6433"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.756639 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" event={"ID":"38fc8086-a00c-4a2a-8a0e-c57e9d9d0103","Type":"ContainerDied","Data":"8024196dc7d7114b2537f80438f2f5ad83a892cee7caa5f4d34fca2b46d86f82"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.756661 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" event={"ID":"1897bad8-3875-4bd6-b877-b1abe1fe76c7","Type":"ContainerDied","Data":"9c2fc9403fab0d35870e3bc56e7a58963be646e5a41f7dc3511733d940fb3a34"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.756676 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" event={"ID":"ee9a47b1-cdd9-43bc-8115-8851f29106e6","Type":"ContainerDied","Data":"72abc724ed2d61f11cccbb7ec6d373328f957dd321cb6fd0e7f3d01b800d6a97"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.756747 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" event={"ID":"fd4c4c6f-380a-4cda-9a21-352b55ec2d98","Type":"ContainerStarted","Data":"44b8506d6a819dafeb21c5a4e661b7d718d0df7d433b1764865e76d91ef84eca"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.756760 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" event={"ID":"287fba2d-f56d-4ec0-b796-7849a68fb411","Type":"ContainerDied","Data":"a98c972089f945f20cf6cc807089551b4b9f89664b6a5a78412dd79091e473a5"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.756780 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm" event={"ID":"14bd3485-aa02-4984-b4a3-59f360b1b327","Type":"ContainerDied","Data":"aeee1a4ddc268ca9307b81e79359b2f59515c9c502aecb0723e30ace49120598"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.756830 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" event={"ID":"7e3160a9-11d1-4845-ba30-1a49ae7339a9","Type":"ContainerStarted","Data":"5fa138fec5781e4f43a612b1bd94ac0c3aeea88a18ee976d82cc9fc5ee5a4d9a"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.756846 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" event={"ID":"a5b826c3-8638-4cf5-b974-b24e4282ce00","Type":"ContainerStarted","Data":"bc1d5c88553d9975dfd695327c0f71abfbae1a4a9e554283b59af5847061176e"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.756863 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" event={"ID":"f797ab14-0eb5-48b4-b914-f434f67c4c49","Type":"ContainerStarted","Data":"3a28dcf3ab15a5ab11146a0fd47986bde79e431316166b88f994d0a65f348758"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.756875 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-55965856b6-skbmb" event={"ID":"b668f740-dbc3-48e0-9ebc-83bae3a43c83","Type":"ContainerStarted","Data":"48b19d28904c411ce854b75b8b7b3d47463402f85314112ea64f27cc79cc6747"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.756909 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" event={"ID":"3322cc5a-f1f7-4522-b423-19fb7f38cd43","Type":"ContainerStarted","Data":"6877d7c7591492108bb34420d09a7376ef5637c76a3beefad5f4c2e362c72978"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.756922 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" event={"ID":"1897bad8-3875-4bd6-b877-b1abe1fe76c7","Type":"ContainerStarted","Data":"87d19ac7ca9a3b1f2ae18249fc9bca976ae2df5c1da057ed782ff5452aa064ed"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.756934 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" event={"ID":"ee9a47b1-cdd9-43bc-8115-8851f29106e6","Type":"ContainerStarted","Data":"51591cda8f462b13281f43dbc0b6afc384282884d691dc6e5a5e8196ffa850e4"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.756945 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wksdw" event={"ID":"018e9ad3-c071-45c6-bfa6-e53dda20c757","Type":"ContainerStarted","Data":"3d68eb88a37078379b18b69356bfc6b497e7a91118ad08e72df2b6d4ecb2d105"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.756957 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"8b47694fcc32464ab24d09c23d6efb57","Type":"ContainerStarted","Data":"d63039df99a06e3559d65dad05cc9c8b2039b1a8f335a3c51eec53ca5b198558"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.756994 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" event={"ID":"ccf81538-4d5a-4c26-8e54-fe39331a625d","Type":"ContainerStarted","Data":"6740e091e7513192b7c4fc2e37bc11133fd10dfdaf1d0800e4f08d8808fea4fc"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757008 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"c24e01603234fe8003f8aae8171b0065","Type":"ContainerDied","Data":"2d094b63c81e57115143f4d4ba1077d84f6869b12329f7e6615de922e672c39f"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757021 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" event={"ID":"ffaf95be-586c-40fa-b15f-1beaffe7ff1c","Type":"ContainerDied","Data":"10a13e320db86cab3c629c14a604cd412c42b909da0c8bde7337860edd2f6505"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757034 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" event={"ID":"27576028-d64a-47cd-b76b-d524e41efe37","Type":"ContainerDied","Data":"a5c78a2d8242e27c86fe1aef51f9f44b2ab668d62560b3158373aada11376ae9"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757048 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" event={"ID":"c6e9271a-44ea-4612-ab60-4a9d489ed062","Type":"ContainerDied","Data":"0c42072520a6b53c6aa158c37fe784801234cd135b1f4b11a3d79b213d89865e"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757084 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" event={"ID":"42b3be0f-1d82-4a64-abb4-0118a6960efd","Type":"ContainerDied","Data":"05275cb6451e1a77bd316f718a2831588e2ee8d0a474e33a3702ad4134ac254b"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757098 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" event={"ID":"bac00ac5-0371-48fd-b1cc-60438f08ae94","Type":"ContainerDied","Data":"2be6d5a0843c9ad0cefac288764262419d2b3e8c45c39b2471e38c3ea1a83dce"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757110 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" event={"ID":"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8","Type":"ContainerDied","Data":"bf092013477d028b4e0ff6d6621a140759c75991960cac0199edb383102625b9"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757122 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" event={"ID":"fd9f8671-8066-4990-b45d-8b619aa5d9ec","Type":"ContainerDied","Data":"eeb6c3dc3fc4ac2310a94746d140288965ceb78f995753a5fcb2fc6a20648fed"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757163 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" event={"ID":"fd9f8671-8066-4990-b45d-8b619aa5d9ec","Type":"ContainerStarted","Data":"313a5a3e45bfc56240a41a6b2d15c82ca825cd210b3e33c0eb74e4e915c86d54"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757180 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" event={"ID":"ffaf95be-586c-40fa-b15f-1beaffe7ff1c","Type":"ContainerStarted","Data":"f0266ae130e78641667767b4e7c8f6513c8fa351825903565f61acb84ef9c0ac"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757193 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" event={"ID":"27576028-d64a-47cd-b76b-d524e41efe37","Type":"ContainerStarted","Data":"6c60e9f210f8345eb6f6fc04cca90e4cb57c82e255bdcd593b988c293e0489ca"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757204 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" event={"ID":"42b3be0f-1d82-4a64-abb4-0118a6960efd","Type":"ContainerStarted","Data":"a6d14a522051fb2206df06257821a6c013ab79cc060f6af18a92935eb6c12df9"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757239 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" event={"ID":"287fba2d-f56d-4ec0-b796-7849a68fb411","Type":"ContainerStarted","Data":"de49dc04e865afee596ae644e0ffa161db1e2290ebe2db9cc519ab9cf67d5aa9"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757255 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" event={"ID":"38fc8086-a00c-4a2a-8a0e-c57e9d9d0103","Type":"ContainerStarted","Data":"5601978092c465a26e532b8cb8f66b5633a31c07893435c149ed0029a0397280"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757268 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm" event={"ID":"14bd3485-aa02-4984-b4a3-59f360b1b327","Type":"ContainerStarted","Data":"41aa69685919e7f8f8af95aebbe0bc4d44d4ceec0966f5cc37e23c82ff7f99c8"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757281 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" event={"ID":"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8","Type":"ContainerStarted","Data":"602399891f95b4f2d3b03e62ba9f8e399daa0e9695e2efa23e0a025273d42dbf"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757315 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" event={"ID":"b011b1f1-3235-4e20-825b-ce711c052407","Type":"ContainerDied","Data":"1d2b175fde83364b4666d8066712242360f76256f651e330ae881c16c680384c"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757330 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"8c8f5ab95655b4b56cfeec6bbc9fe176ccf7048325a2476ad9f982e855b05fb0"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757347 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" event={"ID":"7e3160a9-11d1-4845-ba30-1a49ae7339a9","Type":"ContainerDied","Data":"5fa138fec5781e4f43a612b1bd94ac0c3aeea88a18ee976d82cc9fc5ee5a4d9a"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757358 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"5fa138fec5781e4f43a612b1bd94ac0c3aeea88a18ee976d82cc9fc5ee5a4d9a"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757366 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"e0f56c17864ba0f74d6e33ee62008f6da1f6df237d3a2bf24da757af97c1cd89"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757393 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"8b47694fcc32464ab24d09c23d6efb57","Type":"ContainerDied","Data":"d63039df99a06e3559d65dad05cc9c8b2039b1a8f335a3c51eec53ca5b198558"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757405 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"d63039df99a06e3559d65dad05cc9c8b2039b1a8f335a3c51eec53ca5b198558"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757414 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"68cefdb59268cb33333146cf2f74e7763f9033ac08d79970d8869684b7700cf2"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757422 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"9f168b6e831554c513b271c722d3ec7e4db28ab5d11f8b57803ff03a30c8af06"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757432 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" event={"ID":"38fc8086-a00c-4a2a-8a0e-c57e9d9d0103","Type":"ContainerDied","Data":"5601978092c465a26e532b8cb8f66b5633a31c07893435c149ed0029a0397280"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757443 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"5601978092c465a26e532b8cb8f66b5633a31c07893435c149ed0029a0397280"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757451 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"8024196dc7d7114b2537f80438f2f5ad83a892cee7caa5f4d34fca2b46d86f82"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757479 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" event={"ID":"f797ab14-0eb5-48b4-b914-f434f67c4c49","Type":"ContainerDied","Data":"3a28dcf3ab15a5ab11146a0fd47986bde79e431316166b88f994d0a65f348758"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757492 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"560ba30f370ec40b8f7156e79883f77ace5f0c511592152f47a88a654d161d5b"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757502 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" event={"ID":"3322cc5a-f1f7-4522-b423-19fb7f38cd43","Type":"ContainerDied","Data":"6877d7c7591492108bb34420d09a7376ef5637c76a3beefad5f4c2e362c72978"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757513 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"4efa514695b682bb2d4ad336643391490d8d1ea01e30ed9629a1ef982abb6433"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757523 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"c8d34e789c5970b0307d273982d5779a2dcd6c7a7b38f7401ca6eca1e3af06ea"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757552 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" event={"ID":"ccf81538-4d5a-4c26-8e54-fe39331a625d","Type":"ContainerDied","Data":"6740e091e7513192b7c4fc2e37bc11133fd10dfdaf1d0800e4f08d8808fea4fc"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757563 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"36ec3b979824ab62e6f7509543dc4f347e7c4493e3f1c85b36fa97144a94acc1"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757573 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" event={"ID":"a5b826c3-8638-4cf5-b974-b24e4282ce00","Type":"ContainerDied","Data":"bc1d5c88553d9975dfd695327c0f71abfbae1a4a9e554283b59af5847061176e"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757584 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"ccce88b1ca2f9a134e692a16b1bcd6669f59f655145c0cf6017bc4ec59640741"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757596 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" event={"ID":"c6e9271a-44ea-4612-ab60-4a9d489ed062","Type":"ContainerStarted","Data":"c917a114b6504bcd9d7c8dd2abb103105fc2fc1c7c60d8e3237ba96133b8d6ed"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757609 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" event={"ID":"a5b826c3-8638-4cf5-b974-b24e4282ce00","Type":"ContainerStarted","Data":"29a193498b176ae14f0ca7dff8d35917ba4713a9868840310a0be48351f34521"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757642 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"8b47694fcc32464ab24d09c23d6efb57","Type":"ContainerStarted","Data":"c0669a25eca640b16ba8b2ecfd0f28795bd45ad2500d4e00f1ed214c5294a0cd"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757653 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" event={"ID":"bac00ac5-0371-48fd-b1cc-60438f08ae94","Type":"ContainerStarted","Data":"e0fdeac9876b7627a8946145261c72d16f488a3fb3a2e313379790f4879d5017"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757665 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" event={"ID":"ccf81538-4d5a-4c26-8e54-fe39331a625d","Type":"ContainerStarted","Data":"fa82cd61790ebe17dba45d17ac4fc09f5a6705740362c96127dc7edfc6054c63"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757676 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" event={"ID":"7e3160a9-11d1-4845-ba30-1a49ae7339a9","Type":"ContainerStarted","Data":"5a4d065f4aef4c58a64842a3b127c4de733504b1bb6ebdb85310e09d409339ca"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757688 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" event={"ID":"1243d581-fa11-4db1-a01a-0cf64eb3ef74","Type":"ContainerDied","Data":"42bf9b312d3d677a209c2f4ed476e28aa24937e7036328cd0eb57e2a02bb1e2a"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757724 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" event={"ID":"00601c1a-efd4-4366-bdc9-d768afa252b0","Type":"ContainerDied","Data":"456f267c13077df8fde873615eb32f2c8011d7876410ffb6709899a5fdee25ce"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757740 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" event={"ID":"0158c2f3-20e5-43f4-875d-c5ad8f6112df","Type":"ContainerDied","Data":"db80abb8e4c0e90fdd2ce38c6760862b2f66436f0df8b6e38dd7af704d246cce"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757755 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"c24e01603234fe8003f8aae8171b0065","Type":"ContainerStarted","Data":"8b81f63230ddbea8d6c3b6ea050a2360f845a5d55e81ef1040b4c5957b64a5a9"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757767 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"c24e01603234fe8003f8aae8171b0065","Type":"ContainerStarted","Data":"523e8ed8e33638d0ea4ff55875cbc5c0f5dd8aa2e781f8660e98dcc61870abcd"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757797 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"c24e01603234fe8003f8aae8171b0065","Type":"ContainerStarted","Data":"82403cfe9ce30e64366d586bd3d4971dd579fb9deb2bccf711ab036c03a0fbed"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757834 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"c24e01603234fe8003f8aae8171b0065","Type":"ContainerStarted","Data":"33f85176404395dbaf1cfdb77d7cfa2b94036a1d9cca44a7d3462ef387eb7691"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757846 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"c24e01603234fe8003f8aae8171b0065","Type":"ContainerStarted","Data":"eb58bcb651b87ccd2e45033c9114cc61c10ad998bb008845b3973e82a145bb2c"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757856 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" event={"ID":"6f15dcdb-c968-429c-9d1d-63c2becad337","Type":"ContainerDied","Data":"d6c550a785a1145fdc343107de5010ef2c2358de520cd277331cd0afa9b20bdf"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757871 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-55965856b6-skbmb" event={"ID":"b668f740-dbc3-48e0-9ebc-83bae3a43c83","Type":"ContainerDied","Data":"48b19d28904c411ce854b75b8b7b3d47463402f85314112ea64f27cc79cc6747"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757883 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"397481b3f91ac25f72eb86f49a721b3557eba7e4607ac9ea2395672278f1bcfc"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757916 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" event={"ID":"ffaf95be-586c-40fa-b15f-1beaffe7ff1c","Type":"ContainerDied","Data":"f0266ae130e78641667767b4e7c8f6513c8fa351825903565f61acb84ef9c0ac"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757927 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"10a13e320db86cab3c629c14a604cd412c42b909da0c8bde7337860edd2f6505"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757935 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"38994ab2ae9659964fed86de7d58ee76405c493bf0a90b3260a8bc5301b5819a"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757944 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" event={"ID":"42b3be0f-1d82-4a64-abb4-0118a6960efd","Type":"ContainerDied","Data":"a6d14a522051fb2206df06257821a6c013ab79cc060f6af18a92935eb6c12df9"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757952 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"05275cb6451e1a77bd316f718a2831588e2ee8d0a474e33a3702ad4134ac254b"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757960 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"8543749f8386d25fbc9d05c27b7ab7559de13cecd2f9d2e22a588c804bace527"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757986 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" event={"ID":"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8","Type":"ContainerDied","Data":"602399891f95b4f2d3b03e62ba9f8e399daa0e9695e2efa23e0a025273d42dbf"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.757997 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"bf092013477d028b4e0ff6d6621a140759c75991960cac0199edb383102625b9"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758003 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"b6e0393f35b37b796e29e063a198964a882daa0edec21adc6f195e441be69db7"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758013 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" event={"ID":"fd9f8671-8066-4990-b45d-8b619aa5d9ec","Type":"ContainerDied","Data":"313a5a3e45bfc56240a41a6b2d15c82ca825cd210b3e33c0eb74e4e915c86d54"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758024 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"eeb6c3dc3fc4ac2310a94746d140288965ceb78f995753a5fcb2fc6a20648fed"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758031 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"e0e04ce110c25a2c4a312ed2fdb876c28e02526d17e1277179eb5a2f7c3254e0"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758040 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" event={"ID":"27576028-d64a-47cd-b76b-d524e41efe37","Type":"ContainerDied","Data":"6c60e9f210f8345eb6f6fc04cca90e4cb57c82e255bdcd593b988c293e0489ca"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758068 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"a5c78a2d8242e27c86fe1aef51f9f44b2ab668d62560b3158373aada11376ae9"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758076 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"125cdcb9380437c2c74e709578e049126370c6c2e8787828f7e5e31c2a5f5cbe"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758086 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" event={"ID":"1ade9186-b262-4b5e-9c6f-ba89f0130fb6","Type":"ContainerDied","Data":"b4a708629c00edd600857e5208cac33c83ecd3ee4160351814e5fc4f907308cf"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758103 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" event={"ID":"b011b1f1-3235-4e20-825b-ce711c052407","Type":"ContainerStarted","Data":"8eac3c76c85aa13d87ba20dccfb5f290a5bb846720ceb909d474ed9c1de8d4a1"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758115 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" event={"ID":"1243d581-fa11-4db1-a01a-0cf64eb3ef74","Type":"ContainerStarted","Data":"450c33434fcc742db8779a3f1f1227abf6b374f6577a9ed078feb154828442af"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758143 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" event={"ID":"38fc8086-a00c-4a2a-8a0e-c57e9d9d0103","Type":"ContainerStarted","Data":"470ab1d7deaea833e2123e55c64ae492c4fd69592633e3def3e6d22b517c513f"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758155 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" event={"ID":"3322cc5a-f1f7-4522-b423-19fb7f38cd43","Type":"ContainerStarted","Data":"a39ca33d8356cc3dbacc15a33d88f7f3eadcf0d16af1ac588f4e782ea1463d52"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758170 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"8b47694fcc32464ab24d09c23d6efb57","Type":"ContainerDied","Data":"a573a12b7e61507c596e1178d09644f02ee9de55d89553ed9fce32978b18dcf3"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758183 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" event={"ID":"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46","Type":"ContainerDied","Data":"75e7ab729f90601f1a3824e70ddebf2fb143cea828b4fc655dacf16540161a43"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758195 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" event={"ID":"a399a87b-8153-4045-a8d3-63fd88ae280f","Type":"ContainerDied","Data":"067d901be9a85d08d5b38edc8f0dc976efa622744a3bc1f1c7a19a180b2e2f65"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758230 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-6bc8656fdc-2q7f5" event={"ID":"031d300e-24b4-481c-8b82-fe8cdb3fcef7","Type":"ContainerDied","Data":"90cc3b6000c187ca85e3ebde189fcb0fb0c22a655e72a22fb82a8f151adb8963"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758245 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" event={"ID":"7e3160a9-11d1-4845-ba30-1a49ae7339a9","Type":"ContainerDied","Data":"5a4d065f4aef4c58a64842a3b127c4de733504b1bb6ebdb85310e09d409339ca"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758255 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"5fa138fec5781e4f43a612b1bd94ac0c3aeea88a18ee976d82cc9fc5ee5a4d9a"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758262 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"e0f56c17864ba0f74d6e33ee62008f6da1f6df237d3a2bf24da757af97c1cd89"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758277 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" event={"ID":"38fc8086-a00c-4a2a-8a0e-c57e9d9d0103","Type":"ContainerDied","Data":"470ab1d7deaea833e2123e55c64ae492c4fd69592633e3def3e6d22b517c513f"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758306 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"5601978092c465a26e532b8cb8f66b5633a31c07893435c149ed0029a0397280"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758315 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"8024196dc7d7114b2537f80438f2f5ad83a892cee7caa5f4d34fca2b46d86f82"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758324 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" event={"ID":"27576028-d64a-47cd-b76b-d524e41efe37","Type":"ContainerStarted","Data":"5bd81ae6aaed1722c0d3f93b82b95663992c61dfa9898968bad69d44a6b4c6ca"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758337 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" event={"ID":"ffaf95be-586c-40fa-b15f-1beaffe7ff1c","Type":"ContainerStarted","Data":"f9e507455e646a26023961f555cf20cd9c754df7c6eb7c8d6f74aa6bd2bece6c"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758349 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" event={"ID":"42b3be0f-1d82-4a64-abb4-0118a6960efd","Type":"ContainerStarted","Data":"30a32ee2c91e00362356c25e062529920ef5ebdce171e46e07e4a515186d182b"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758382 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" event={"ID":"fd9f8671-8066-4990-b45d-8b619aa5d9ec","Type":"ContainerStarted","Data":"1cffe972f64278af41c2f8763a71bbb64f7f719300efa47c1cb1f0a4d8df9393"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.758398 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" event={"ID":"0158c2f3-20e5-43f4-875d-c5ad8f6112df","Type":"ContainerStarted","Data":"9a03b5c40589d3a810d32697eb50f020ca5b5a56dfcc81e46b6de1f98841e2a3"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.759169 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.759558 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.763325 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.763696 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: W1204 11:45:10.764152 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae25dd5_dfdb_42f6_97d0_14ad17743c95.slice/crio-597a9e4435c6089676e0fa68a7916eee6043cc3e40b07033c316c40839d7d999 WatchSource:0}: Error finding container 597a9e4435c6089676e0fa68a7916eee6043cc3e40b07033c316c40839d7d999: Status 404 returned error can't find the container with id 597a9e4435c6089676e0fa68a7916eee6043cc3e40b07033c316c40839d7d999 Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.764713 8993 scope.go:117] "RemoveContainer" containerID="aaf8e0a82bd40fc3c589ed457817ceadfe679e3e1748948884223dddb5917051" Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.766454 8993 scope.go:117] "RemoveContainer" containerID="c88107d86ca094e0fb66d5f48c269fd63501da09c2e45e6167e8bdd22853011e" Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.767651 8993 scope.go:117] "RemoveContainer" containerID="c0669a25eca640b16ba8b2ecfd0f28795bd45ad2500d4e00f1ed214c5294a0cd" Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.768968 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"8b47694fcc32464ab24d09c23d6efb57","Type":"ContainerStarted","Data":"88e39a153093f8e114cb7d99b1715d4855f5b301a06532da1e8598576d2b5a0d"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.769055 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" event={"ID":"f797ab14-0eb5-48b4-b914-f434f67c4c49","Type":"ContainerStarted","Data":"a7c9e295ef31ee529de35de69419b7f4fb1bbde8ad44813a8db193a07a67f946"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.769075 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" event={"ID":"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8","Type":"ContainerStarted","Data":"8feda6d58ce3528bf1cb14bff418f320e1e6dc261d75dd615a2c1773dacee750"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.769095 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" event={"ID":"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46","Type":"ContainerStarted","Data":"d9c0a6f2319e382b7fe02ed5c5fa7e0a89c76eff9a028d94eddc90a3aa1de179"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.769128 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" event={"ID":"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639","Type":"ContainerDied","Data":"aaf8e0a82bd40fc3c589ed457817ceadfe679e3e1748948884223dddb5917051"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.769222 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-6bc8656fdc-2q7f5" event={"ID":"031d300e-24b4-481c-8b82-fe8cdb3fcef7","Type":"ContainerStarted","Data":"53618e2881e7531a20171c8c77886b4e3ff73637b9908af667c0ecd3f6bd4f2a"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.769247 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" event={"ID":"6f15dcdb-c968-429c-9d1d-63c2becad337","Type":"ContainerStarted","Data":"a2ccae65671ed8e1587834a54d81391f1b1881f39ee38aa28b193fa6cecc39da"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.769260 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" event={"ID":"7e3160a9-11d1-4845-ba30-1a49ae7339a9","Type":"ContainerStarted","Data":"fb9fc7d90e1a7f1b9941af4021fef36a6cf8ea28ed08b7fb03d0f413775fbd30"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.769274 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" event={"ID":"a399a87b-8153-4045-a8d3-63fd88ae280f","Type":"ContainerStarted","Data":"8203c30c9d158150398a01d336c4969a20aab618396e7ab3bc78d00c326809cc"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.769288 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" event={"ID":"00601c1a-efd4-4366-bdc9-d768afa252b0","Type":"ContainerStarted","Data":"b39d773eeb06c94ed873f23019963b13d823be075cea71fea6112c87855ab230"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.769299 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" event={"ID":"38fc8086-a00c-4a2a-8a0e-c57e9d9d0103","Type":"ContainerStarted","Data":"83f6253eb08fd5330a71b18eaa18e87490f360d95e0ec3c32cf54a01fa26f615"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.769310 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" event={"ID":"1ade9186-b262-4b5e-9c6f-ba89f0130fb6","Type":"ContainerStarted","Data":"c1818ca43db2765bb639a6e97b3c2f8506a31edb0b1a76aecba6684bf041bcbf"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.769325 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-55965856b6-skbmb" event={"ID":"b668f740-dbc3-48e0-9ebc-83bae3a43c83","Type":"ContainerStarted","Data":"bed70bf30148867a8a16081ae314392185a58e46ed42f5d7051fb60e7ace284d"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.769337 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" event={"ID":"8b47694fcc32464ab24d09c23d6efb57","Type":"ContainerDied","Data":"c0669a25eca640b16ba8b2ecfd0f28795bd45ad2500d4e00f1ed214c5294a0cd"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.769351 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"d63039df99a06e3559d65dad05cc9c8b2039b1a8f335a3c51eec53ca5b198558"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.769365 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"68cefdb59268cb33333146cf2f74e7763f9033ac08d79970d8869684b7700cf2"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: I1204 11:45:10.769371 8993 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"9f168b6e831554c513b271c722d3ec7e4db28ab5d11f8b57803ff03a30c8af06"} Dec 04 11:45:10.778068 master-0 kubenswrapper[8993]: E1204 11:45:10.773158 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-controller-manager pod=bootstrap-kube-controller-manager-master-0_kube-system(8b47694fcc32464ab24d09c23d6efb57)\"" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" Dec 04 11:45:10.798117 master-0 kubenswrapper[8993]: I1204 11:45:10.796452 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd/etcd-master-0"] Dec 04 11:45:10.818245 master-0 kubenswrapper[8993]: I1204 11:45:10.817142 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-etcd/etcd-master-0-master-0"] Dec 04 11:45:10.818245 master-0 kubenswrapper[8993]: I1204 11:45:10.817170 8993 kubelet.go:2649] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-etcd/etcd-master-0-master-0" mirrorPodUID="7e74b8ba-3439-488f-8788-429977efc90e" Dec 04 11:45:10.837754 master-0 kubenswrapper[8993]: I1204 11:45:10.821871 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/machine-api-operator-88d48b57d-9fjtd"] Dec 04 11:45:10.837754 master-0 kubenswrapper[8993]: I1204 11:45:10.836616 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/installer-4-master-0"] Dec 04 11:45:10.853403 master-0 kubenswrapper[8993]: I1204 11:45:10.853336 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-etcd/etcd-master-0-master-0"] Dec 04 11:45:10.853403 master-0 kubenswrapper[8993]: I1204 11:45:10.853388 8993 kubelet.go:2673] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-etcd/etcd-master-0-master-0" mirrorPodUID="7e74b8ba-3439-488f-8788-429977efc90e" Dec 04 11:45:10.857268 master-0 kubenswrapper[8993]: I1204 11:45:10.856426 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-2-master-0"] Dec 04 11:45:10.864563 master-0 kubenswrapper[8993]: I1204 11:45:10.864289 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-6686654b8d-rrndk"] Dec 04 11:45:10.869834 master-0 kubenswrapper[8993]: I1204 11:45:10.864850 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-rxhpq"] Dec 04 11:45:10.869834 master-0 kubenswrapper[8993]: I1204 11:45:10.867473 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-8qs8v"] Dec 04 11:45:10.888715 master-0 kubenswrapper[8993]: I1204 11:45:10.888653 8993 scope.go:117] "RemoveContainer" containerID="d2725ac4d78fdf9566061ef8100f1f04d68cc38c172c702bd00a3a8215aa8d8e" Dec 04 11:45:10.934296 master-0 kubenswrapper[8993]: I1204 11:45:10.914645 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-797cfd8b47-8wqgp" podStartSLOduration=354.778461516 podStartE2EDuration="6m29.91461532s" podCreationTimestamp="2025-12-04 11:38:41 +0000 UTC" firstStartedPulling="2025-12-04 11:38:43.558481939 +0000 UTC m=+57.949423372" lastFinishedPulling="2025-12-04 11:39:18.694635743 +0000 UTC m=+93.085577176" observedRunningTime="2025-12-04 11:45:10.847897321 +0000 UTC m=+445.238838754" watchObservedRunningTime="2025-12-04 11:45:10.91461532 +0000 UTC m=+445.305556763" Dec 04 11:45:10.934296 master-0 kubenswrapper[8993]: I1204 11:45:10.931609 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" podStartSLOduration=378.550448025 podStartE2EDuration="6m28.931577044s" podCreationTimestamp="2025-12-04 11:38:42 +0000 UTC" firstStartedPulling="2025-12-04 11:38:43.51243033 +0000 UTC m=+57.903371773" lastFinishedPulling="2025-12-04 11:38:53.893559359 +0000 UTC m=+68.284500792" observedRunningTime="2025-12-04 11:45:10.895982411 +0000 UTC m=+445.286923844" watchObservedRunningTime="2025-12-04 11:45:10.931577044 +0000 UTC m=+445.322518477" Dec 04 11:45:10.943511 master-0 kubenswrapper[8993]: I1204 11:45:10.906758 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-ghr5b"] Dec 04 11:45:10.943511 master-0 kubenswrapper[8993]: I1204 11:45:10.942550 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-ghr5b"] Dec 04 11:45:11.056717 master-0 kubenswrapper[8993]: I1204 11:45:11.056570 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-55965856b6-skbmb" podStartSLOduration=351.429772447 podStartE2EDuration="6m28.056552414s" podCreationTimestamp="2025-12-04 11:38:43 +0000 UTC" firstStartedPulling="2025-12-04 11:38:44.804246799 +0000 UTC m=+59.195188232" lastFinishedPulling="2025-12-04 11:39:21.431026766 +0000 UTC m=+95.821968199" observedRunningTime="2025-12-04 11:45:11.055411486 +0000 UTC m=+445.446352919" watchObservedRunningTime="2025-12-04 11:45:11.056552414 +0000 UTC m=+445.447493847" Dec 04 11:45:11.105828 master-0 kubenswrapper[8993]: I1204 11:45:11.105762 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" event={"ID":"24506aa4-ab78-49df-bb58-59093498f13d","Type":"ContainerStarted","Data":"97556f365f16c1ec11f0ae822f90781c5b826eb96ebe11fadb15589661eb05b6"} Dec 04 11:45:11.109581 master-0 kubenswrapper[8993]: I1204 11:45:11.108891 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-4-master-0" event={"ID":"780ea907-dec5-426e-9de2-158f59c09f71","Type":"ContainerStarted","Data":"8f4cb521a519dffc9145fbbff972ea7e9fae270d474192cc7dc2e095425a0edd"} Dec 04 11:45:11.122977 master-0 kubenswrapper[8993]: I1204 11:45:11.119010 8993 scope.go:117] "RemoveContainer" containerID="3d224218c60e1e7468baaba3d9d1b53375aeedd487691935fc138aa3c833f437" Dec 04 11:45:11.122977 master-0 kubenswrapper[8993]: I1204 11:45:11.119005 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-rxhpq" event={"ID":"5ae25dd5-dfdb-42f6-97d0-14ad17743c95","Type":"ContainerStarted","Data":"597a9e4435c6089676e0fa68a7916eee6043cc3e40b07033c316c40839d7d999"} Dec 04 11:45:11.122977 master-0 kubenswrapper[8993]: I1204 11:45:11.119726 8993 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Dec 04 11:45:11.129834 master-0 kubenswrapper[8993]: I1204 11:45:11.129758 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" event={"ID":"c50317d3-f7cd-4133-845e-44add57ac378","Type":"ContainerStarted","Data":"1de82f0d2145eda0963037fc5194d3ed0ef6f28ba0425692586ec1b2d5c1a8d7"} Dec 04 11:45:11.134708 master-0 kubenswrapper[8993]: I1204 11:45:11.134618 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-2-master-0" event={"ID":"38e7be62-e4f5-42ba-89f0-83aca874a092","Type":"ContainerStarted","Data":"6f6c1368ad9227af2c52859d3ca6113c4596b01abb133cabab18d8effbf3af73"} Dec 04 11:45:11.177144 master-0 kubenswrapper[8993]: I1204 11:45:11.167330 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-8qs8v" event={"ID":"b620f29d-dcde-4f98-9fb6-dd479dcdcf7c","Type":"ContainerStarted","Data":"d2441e00fc894bfa5cbf2617e8f186e2a83b2ef94e0fc84c991a8adba8c891ea"} Dec 04 11:45:11.177144 master-0 kubenswrapper[8993]: I1204 11:45:11.171229 8993 scope.go:117] "RemoveContainer" containerID="c0669a25eca640b16ba8b2ecfd0f28795bd45ad2500d4e00f1ed214c5294a0cd" Dec 04 11:45:11.177144 master-0 kubenswrapper[8993]: E1204 11:45:11.171416 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-controller-manager pod=bootstrap-kube-controller-manager-master-0_kube-system(8b47694fcc32464ab24d09c23d6efb57)\"" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" Dec 04 11:45:11.177144 master-0 kubenswrapper[8993]: I1204 11:45:11.174686 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:45:11.177144 master-0 kubenswrapper[8993]: I1204 11:45:11.174720 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-controller-manager/installer-1-master-0"] Dec 04 11:45:11.177144 master-0 kubenswrapper[8993]: I1204 11:45:11.174735 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:45:11.197756 master-0 kubenswrapper[8993]: I1204 11:45:11.189914 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-controller-manager/installer-1-master-0"] Dec 04 11:45:11.197756 master-0 kubenswrapper[8993]: I1204 11:45:11.195192 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" podStartSLOduration=382.79747935299997 podStartE2EDuration="6m26.195167679s" podCreationTimestamp="2025-12-04 11:38:45 +0000 UTC" firstStartedPulling="2025-12-04 11:39:21.149604121 +0000 UTC m=+95.540545554" lastFinishedPulling="2025-12-04 11:39:24.547292447 +0000 UTC m=+98.938233880" observedRunningTime="2025-12-04 11:45:11.178586458 +0000 UTC m=+445.569527891" watchObservedRunningTime="2025-12-04 11:45:11.195167679 +0000 UTC m=+445.586109112" Dec 04 11:45:11.199289 master-0 kubenswrapper[8993]: E1204 11:45:11.199235 8993 kubelet.go:1929] "Failed creating a mirror pod for" err="pods \"etcd-master-0\" already exists" pod="openshift-etcd/etcd-master-0" Dec 04 11:45:11.199463 master-0 kubenswrapper[8993]: I1204 11:45:11.199406 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:45:11.205149 master-0 kubenswrapper[8993]: I1204 11:45:11.205092 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-etcd/etcd-master-0" Dec 04 11:45:11.206394 master-0 kubenswrapper[8993]: I1204 11:45:11.206351 8993 scope.go:117] "RemoveContainer" containerID="4f8471393d269f5a7f4cfca62361f53ea2107573029fedd35fb5f054330f7e70" Dec 04 11:45:11.216293 master-0 kubenswrapper[8993]: I1204 11:45:11.216204 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" podStartSLOduration=388.216181846 podStartE2EDuration="6m28.216181846s" podCreationTimestamp="2025-12-04 11:38:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:45:11.212377811 +0000 UTC m=+445.603319264" watchObservedRunningTime="2025-12-04 11:45:11.216181846 +0000 UTC m=+445.607123279" Dec 04 11:45:11.246834 master-0 kubenswrapper[8993]: I1204 11:45:11.246701 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" podStartSLOduration=351.393514636 podStartE2EDuration="6m28.246660641s" podCreationTimestamp="2025-12-04 11:38:43 +0000 UTC" firstStartedPulling="2025-12-04 11:38:44.587889892 +0000 UTC m=+58.978831325" lastFinishedPulling="2025-12-04 11:39:21.441035897 +0000 UTC m=+95.831977330" observedRunningTime="2025-12-04 11:45:11.242075642 +0000 UTC m=+445.633017095" watchObservedRunningTime="2025-12-04 11:45:11.246660641 +0000 UTC m=+445.637602094" Dec 04 11:45:11.255692 master-0 kubenswrapper[8993]: I1204 11:45:11.253572 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:45:11.298872 master-0 kubenswrapper[8993]: I1204 11:45:11.298633 8993 scope.go:117] "RemoveContainer" containerID="8b462edb24709c28f1c57773708761f546f09cea56bd49fe8e39f36f60a1efa2" Dec 04 11:45:11.367953 master-0 kubenswrapper[8993]: I1204 11:45:11.361840 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-2p882"] Dec 04 11:45:11.372915 master-0 kubenswrapper[8993]: I1204 11:45:11.372802 8993 scope.go:117] "RemoveContainer" containerID="bf01610f07d799dee957df874d54a814bddfc7f890d6afabc5cc027100265399" Dec 04 11:45:11.374272 master-0 kubenswrapper[8993]: I1204 11:45:11.374213 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-2p882"] Dec 04 11:45:11.396437 master-0 kubenswrapper[8993]: I1204 11:45:11.396376 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk"] Dec 04 11:45:11.416729 master-0 kubenswrapper[8993]: I1204 11:45:11.416694 8993 scope.go:117] "RemoveContainer" containerID="736abedc363f924ab7e5e68cb6da6ea2f0b1b26806032413a9c3e2d40ef9bfc5" Dec 04 11:45:11.422507 master-0 kubenswrapper[8993]: W1204 11:45:11.422471 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d7939a_5961_4608_b910_73e71aa55bf6.slice/crio-2258f6af8e03d9e9b2176864d007811f1c2157002d410c1abd99bd0f7a698646 WatchSource:0}: Error finding container 2258f6af8e03d9e9b2176864d007811f1c2157002d410c1abd99bd0f7a698646: Status 404 returned error can't find the container with id 2258f6af8e03d9e9b2176864d007811f1c2157002d410c1abd99bd0f7a698646 Dec 04 11:45:11.440303 master-0 kubenswrapper[8993]: I1204 11:45:11.440255 8993 scope.go:117] "RemoveContainer" containerID="bf01610f07d799dee957df874d54a814bddfc7f890d6afabc5cc027100265399" Dec 04 11:45:11.440777 master-0 kubenswrapper[8993]: E1204 11:45:11.440741 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf01610f07d799dee957df874d54a814bddfc7f890d6afabc5cc027100265399\": container with ID starting with bf01610f07d799dee957df874d54a814bddfc7f890d6afabc5cc027100265399 not found: ID does not exist" containerID="bf01610f07d799dee957df874d54a814bddfc7f890d6afabc5cc027100265399" Dec 04 11:45:11.440875 master-0 kubenswrapper[8993]: I1204 11:45:11.440823 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf01610f07d799dee957df874d54a814bddfc7f890d6afabc5cc027100265399"} err="failed to get container status \"bf01610f07d799dee957df874d54a814bddfc7f890d6afabc5cc027100265399\": rpc error: code = NotFound desc = could not find container \"bf01610f07d799dee957df874d54a814bddfc7f890d6afabc5cc027100265399\": container with ID starting with bf01610f07d799dee957df874d54a814bddfc7f890d6afabc5cc027100265399 not found: ID does not exist" Dec 04 11:45:11.440875 master-0 kubenswrapper[8993]: I1204 11:45:11.440859 8993 scope.go:117] "RemoveContainer" containerID="736abedc363f924ab7e5e68cb6da6ea2f0b1b26806032413a9c3e2d40ef9bfc5" Dec 04 11:45:11.441197 master-0 kubenswrapper[8993]: E1204 11:45:11.441157 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"736abedc363f924ab7e5e68cb6da6ea2f0b1b26806032413a9c3e2d40ef9bfc5\": container with ID starting with 736abedc363f924ab7e5e68cb6da6ea2f0b1b26806032413a9c3e2d40ef9bfc5 not found: ID does not exist" containerID="736abedc363f924ab7e5e68cb6da6ea2f0b1b26806032413a9c3e2d40ef9bfc5" Dec 04 11:45:11.441243 master-0 kubenswrapper[8993]: I1204 11:45:11.441202 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"736abedc363f924ab7e5e68cb6da6ea2f0b1b26806032413a9c3e2d40ef9bfc5"} err="failed to get container status \"736abedc363f924ab7e5e68cb6da6ea2f0b1b26806032413a9c3e2d40ef9bfc5\": rpc error: code = NotFound desc = could not find container \"736abedc363f924ab7e5e68cb6da6ea2f0b1b26806032413a9c3e2d40ef9bfc5\": container with ID starting with 736abedc363f924ab7e5e68cb6da6ea2f0b1b26806032413a9c3e2d40ef9bfc5 not found: ID does not exist" Dec 04 11:45:11.441243 master-0 kubenswrapper[8993]: I1204 11:45:11.441229 8993 scope.go:117] "RemoveContainer" containerID="d2725ac4d78fdf9566061ef8100f1f04d68cc38c172c702bd00a3a8215aa8d8e" Dec 04 11:45:11.441556 master-0 kubenswrapper[8993]: E1204 11:45:11.441518 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2725ac4d78fdf9566061ef8100f1f04d68cc38c172c702bd00a3a8215aa8d8e\": container with ID starting with d2725ac4d78fdf9566061ef8100f1f04d68cc38c172c702bd00a3a8215aa8d8e not found: ID does not exist" containerID="d2725ac4d78fdf9566061ef8100f1f04d68cc38c172c702bd00a3a8215aa8d8e" Dec 04 11:45:11.441611 master-0 kubenswrapper[8993]: I1204 11:45:11.441552 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2725ac4d78fdf9566061ef8100f1f04d68cc38c172c702bd00a3a8215aa8d8e"} err="failed to get container status \"d2725ac4d78fdf9566061ef8100f1f04d68cc38c172c702bd00a3a8215aa8d8e\": rpc error: code = NotFound desc = could not find container \"d2725ac4d78fdf9566061ef8100f1f04d68cc38c172c702bd00a3a8215aa8d8e\": container with ID starting with d2725ac4d78fdf9566061ef8100f1f04d68cc38c172c702bd00a3a8215aa8d8e not found: ID does not exist" Dec 04 11:45:11.441611 master-0 kubenswrapper[8993]: I1204 11:45:11.441571 8993 scope.go:117] "RemoveContainer" containerID="3d224218c60e1e7468baaba3d9d1b53375aeedd487691935fc138aa3c833f437" Dec 04 11:45:11.441932 master-0 kubenswrapper[8993]: E1204 11:45:11.441899 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d224218c60e1e7468baaba3d9d1b53375aeedd487691935fc138aa3c833f437\": container with ID starting with 3d224218c60e1e7468baaba3d9d1b53375aeedd487691935fc138aa3c833f437 not found: ID does not exist" containerID="3d224218c60e1e7468baaba3d9d1b53375aeedd487691935fc138aa3c833f437" Dec 04 11:45:11.442033 master-0 kubenswrapper[8993]: I1204 11:45:11.442008 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d224218c60e1e7468baaba3d9d1b53375aeedd487691935fc138aa3c833f437"} err="failed to get container status \"3d224218c60e1e7468baaba3d9d1b53375aeedd487691935fc138aa3c833f437\": rpc error: code = NotFound desc = could not find container \"3d224218c60e1e7468baaba3d9d1b53375aeedd487691935fc138aa3c833f437\": container with ID starting with 3d224218c60e1e7468baaba3d9d1b53375aeedd487691935fc138aa3c833f437 not found: ID does not exist" Dec 04 11:45:11.442109 master-0 kubenswrapper[8993]: I1204 11:45:11.442097 8993 scope.go:117] "RemoveContainer" containerID="10a13e320db86cab3c629c14a604cd412c42b909da0c8bde7337860edd2f6505" Dec 04 11:45:11.489033 master-0 kubenswrapper[8993]: I1204 11:45:11.488996 8993 scope.go:117] "RemoveContainer" containerID="38994ab2ae9659964fed86de7d58ee76405c493bf0a90b3260a8bc5301b5819a" Dec 04 11:45:11.521520 master-0 kubenswrapper[8993]: I1204 11:45:11.521426 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-krbbd" podStartSLOduration=353.535756795 podStartE2EDuration="6m34.521405382s" podCreationTimestamp="2025-12-04 11:38:37 +0000 UTC" firstStartedPulling="2025-12-04 11:38:41.771863152 +0000 UTC m=+56.162804585" lastFinishedPulling="2025-12-04 11:39:22.757511739 +0000 UTC m=+97.148453172" observedRunningTime="2025-12-04 11:45:11.519253812 +0000 UTC m=+445.910195255" watchObservedRunningTime="2025-12-04 11:45:11.521405382 +0000 UTC m=+445.912346825" Dec 04 11:45:11.524440 master-0 kubenswrapper[8993]: I1204 11:45:11.523721 8993 scope.go:117] "RemoveContainer" containerID="4f8471393d269f5a7f4cfca62361f53ea2107573029fedd35fb5f054330f7e70" Dec 04 11:45:11.524652 master-0 kubenswrapper[8993]: E1204 11:45:11.524589 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f8471393d269f5a7f4cfca62361f53ea2107573029fedd35fb5f054330f7e70\": container with ID starting with 4f8471393d269f5a7f4cfca62361f53ea2107573029fedd35fb5f054330f7e70 not found: ID does not exist" containerID="4f8471393d269f5a7f4cfca62361f53ea2107573029fedd35fb5f054330f7e70" Dec 04 11:45:11.524857 master-0 kubenswrapper[8993]: I1204 11:45:11.524667 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f8471393d269f5a7f4cfca62361f53ea2107573029fedd35fb5f054330f7e70"} err="failed to get container status \"4f8471393d269f5a7f4cfca62361f53ea2107573029fedd35fb5f054330f7e70\": rpc error: code = NotFound desc = could not find container \"4f8471393d269f5a7f4cfca62361f53ea2107573029fedd35fb5f054330f7e70\": container with ID starting with 4f8471393d269f5a7f4cfca62361f53ea2107573029fedd35fb5f054330f7e70 not found: ID does not exist" Dec 04 11:45:11.524857 master-0 kubenswrapper[8993]: I1204 11:45:11.524747 8993 scope.go:117] "RemoveContainer" containerID="8b462edb24709c28f1c57773708761f546f09cea56bd49fe8e39f36f60a1efa2" Dec 04 11:45:11.525560 master-0 kubenswrapper[8993]: E1204 11:45:11.525516 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b462edb24709c28f1c57773708761f546f09cea56bd49fe8e39f36f60a1efa2\": container with ID starting with 8b462edb24709c28f1c57773708761f546f09cea56bd49fe8e39f36f60a1efa2 not found: ID does not exist" containerID="8b462edb24709c28f1c57773708761f546f09cea56bd49fe8e39f36f60a1efa2" Dec 04 11:45:11.525609 master-0 kubenswrapper[8993]: I1204 11:45:11.525555 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b462edb24709c28f1c57773708761f546f09cea56bd49fe8e39f36f60a1efa2"} err="failed to get container status \"8b462edb24709c28f1c57773708761f546f09cea56bd49fe8e39f36f60a1efa2\": rpc error: code = NotFound desc = could not find container \"8b462edb24709c28f1c57773708761f546f09cea56bd49fe8e39f36f60a1efa2\": container with ID starting with 8b462edb24709c28f1c57773708761f546f09cea56bd49fe8e39f36f60a1efa2 not found: ID does not exist" Dec 04 11:45:11.525609 master-0 kubenswrapper[8993]: I1204 11:45:11.525595 8993 scope.go:117] "RemoveContainer" containerID="dc75d44b8be7e058788b5cd96125d7bea4962e131339dd256a97c23ba994b1b7" Dec 04 11:45:11.559083 master-0 kubenswrapper[8993]: I1204 11:45:11.559035 8993 scope.go:117] "RemoveContainer" containerID="eeb6c3dc3fc4ac2310a94746d140288965ceb78f995753a5fcb2fc6a20648fed" Dec 04 11:45:11.569364 master-0 kubenswrapper[8993]: I1204 11:45:11.569288 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq"] Dec 04 11:45:11.591424 master-0 kubenswrapper[8993]: I1204 11:45:11.589924 8993 scope.go:117] "RemoveContainer" containerID="e0e04ce110c25a2c4a312ed2fdb876c28e02526d17e1277179eb5a2f7c3254e0" Dec 04 11:45:11.638713 master-0 kubenswrapper[8993]: I1204 11:45:11.638412 8993 scope.go:117] "RemoveContainer" containerID="bf092013477d028b4e0ff6d6621a140759c75991960cac0199edb383102625b9" Dec 04 11:45:11.661548 master-0 kubenswrapper[8993]: I1204 11:45:11.661481 8993 scope.go:117] "RemoveContainer" containerID="b6e0393f35b37b796e29e063a198964a882daa0edec21adc6f195e441be69db7" Dec 04 11:45:11.687851 master-0 kubenswrapper[8993]: I1204 11:45:11.687759 8993 scope.go:117] "RemoveContainer" containerID="a5c78a2d8242e27c86fe1aef51f9f44b2ab668d62560b3158373aada11376ae9" Dec 04 11:45:11.767166 master-0 kubenswrapper[8993]: I1204 11:45:11.767123 8993 scope.go:117] "RemoveContainer" containerID="125cdcb9380437c2c74e709578e049126370c6c2e8787828f7e5e31c2a5f5cbe" Dec 04 11:45:11.815610 master-0 kubenswrapper[8993]: I1204 11:45:11.815508 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dea9140-7c02-46cd-9b67-a2aee143c3a8" path="/var/lib/kubelet/pods/2dea9140-7c02-46cd-9b67-a2aee143c3a8/volumes" Dec 04 11:45:11.816423 master-0 kubenswrapper[8993]: I1204 11:45:11.816221 8993 scope.go:117] "RemoveContainer" containerID="05275cb6451e1a77bd316f718a2831588e2ee8d0a474e33a3702ad4134ac254b" Dec 04 11:45:11.816423 master-0 kubenswrapper[8993]: I1204 11:45:11.816354 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0710bdf-3961-48d6-864a-efbd6d68e852" path="/var/lib/kubelet/pods/a0710bdf-3961-48d6-864a-efbd6d68e852/volumes" Dec 04 11:45:11.817869 master-0 kubenswrapper[8993]: I1204 11:45:11.817835 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2aabd50-bfed-4ab5-ad19-f84ec50203ec" path="/var/lib/kubelet/pods/a2aabd50-bfed-4ab5-ad19-f84ec50203ec/volumes" Dec 04 11:45:11.856177 master-0 kubenswrapper[8993]: I1204 11:45:11.856126 8993 scope.go:117] "RemoveContainer" containerID="8543749f8386d25fbc9d05c27b7ab7559de13cecd2f9d2e22a588c804bace527" Dec 04 11:45:11.898783 master-0 kubenswrapper[8993]: I1204 11:45:11.898593 8993 scope.go:117] "RemoveContainer" containerID="c2365e3e1212552c67b403c1062c118ea5e3306eac11c30d2c954d48de545647" Dec 04 11:45:11.932798 master-0 kubenswrapper[8993]: I1204 11:45:11.932673 8993 scope.go:117] "RemoveContainer" containerID="36ec3b979824ab62e6f7509543dc4f347e7c4493e3f1c85b36fa97144a94acc1" Dec 04 11:45:11.960692 master-0 kubenswrapper[8993]: I1204 11:45:11.960585 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" podStartSLOduration=381.942113119 podStartE2EDuration="6m34.96056075s" podCreationTimestamp="2025-12-04 11:38:37 +0000 UTC" firstStartedPulling="2025-12-04 11:38:40.861416368 +0000 UTC m=+55.252357801" lastFinishedPulling="2025-12-04 11:38:53.879863999 +0000 UTC m=+68.270805432" observedRunningTime="2025-12-04 11:45:11.959508185 +0000 UTC m=+446.350449618" watchObservedRunningTime="2025-12-04 11:45:11.96056075 +0000 UTC m=+446.351502183" Dec 04 11:45:11.967142 master-0 kubenswrapper[8993]: I1204 11:45:11.967092 8993 scope.go:117] "RemoveContainer" containerID="ccce88b1ca2f9a134e692a16b1bcd6669f59f655145c0cf6017bc4ec59640741" Dec 04 11:45:11.981927 master-0 kubenswrapper[8993]: I1204 11:45:11.981587 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" podStartSLOduration=352.385189456 podStartE2EDuration="6m30.981570606s" podCreationTimestamp="2025-12-04 11:38:41 +0000 UTC" firstStartedPulling="2025-12-04 11:38:42.527643939 +0000 UTC m=+56.918585372" lastFinishedPulling="2025-12-04 11:39:21.124025089 +0000 UTC m=+95.514966522" observedRunningTime="2025-12-04 11:45:11.97832152 +0000 UTC m=+446.369262953" watchObservedRunningTime="2025-12-04 11:45:11.981570606 +0000 UTC m=+446.372512029" Dec 04 11:45:11.992921 master-0 kubenswrapper[8993]: I1204 11:45:11.992871 8993 scope.go:117] "RemoveContainer" containerID="8c8f5ab95655b4b56cfeec6bbc9fe176ccf7048325a2476ad9f982e855b05fb0" Dec 04 11:45:12.015767 master-0 kubenswrapper[8993]: I1204 11:45:12.013106 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" podStartSLOduration=353.28058553 podStartE2EDuration="6m28.013077234s" podCreationTimestamp="2025-12-04 11:38:44 +0000 UTC" firstStartedPulling="2025-12-04 11:38:46.709936259 +0000 UTC m=+61.100877692" lastFinishedPulling="2025-12-04 11:39:21.442427963 +0000 UTC m=+95.833369396" observedRunningTime="2025-12-04 11:45:12.008778394 +0000 UTC m=+446.399719827" watchObservedRunningTime="2025-12-04 11:45:12.013077234 +0000 UTC m=+446.404018667" Dec 04 11:45:12.037734 master-0 kubenswrapper[8993]: I1204 11:45:12.037618 8993 scope.go:117] "RemoveContainer" containerID="5fa138fec5781e4f43a612b1bd94ac0c3aeea88a18ee976d82cc9fc5ee5a4d9a" Dec 04 11:45:12.072741 master-0 kubenswrapper[8993]: I1204 11:45:12.072255 8993 scope.go:117] "RemoveContainer" containerID="e0f56c17864ba0f74d6e33ee62008f6da1f6df237d3a2bf24da757af97c1cd89" Dec 04 11:45:12.095709 master-0 kubenswrapper[8993]: I1204 11:45:12.095669 8993 scope.go:117] "RemoveContainer" containerID="d63039df99a06e3559d65dad05cc9c8b2039b1a8f335a3c51eec53ca5b198558" Dec 04 11:45:12.128009 master-0 kubenswrapper[8993]: I1204 11:45:12.127944 8993 scope.go:117] "RemoveContainer" containerID="68cefdb59268cb33333146cf2f74e7763f9033ac08d79970d8869684b7700cf2" Dec 04 11:45:12.158120 master-0 kubenswrapper[8993]: I1204 11:45:12.157735 8993 scope.go:117] "RemoveContainer" containerID="9f168b6e831554c513b271c722d3ec7e4db28ab5d11f8b57803ff03a30c8af06" Dec 04 11:45:12.178520 master-0 kubenswrapper[8993]: I1204 11:45:12.178455 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd-operator_etcd-operator-5bf4d88c6f-2bpmr_c6e9271a-44ea-4612-ab60-4a9d489ed062/etcd-operator/1.log" Dec 04 11:45:12.182458 master-0 kubenswrapper[8993]: I1204 11:45:12.182389 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-7f22v"] Dec 04 11:45:12.183310 master-0 kubenswrapper[8993]: I1204 11:45:12.183280 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/1.log" Dec 04 11:45:12.184930 master-0 kubenswrapper[8993]: I1204 11:45:12.184796 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-7f22v"] Dec 04 11:45:12.188870 master-0 kubenswrapper[8993]: I1204 11:45:12.188707 8993 scope.go:117] "RemoveContainer" containerID="397481b3f91ac25f72eb86f49a721b3557eba7e4607ac9ea2395672278f1bcfc" Dec 04 11:45:12.193330 master-0 kubenswrapper[8993]: I1204 11:45:12.193209 8993 generic.go:334] "Generic (PLEG): container finished" podID="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" containerID="fbb615d6c9d1ef25aa2db62084390ffbce46178d8659706ad341ef8739a6266d" exitCode=0 Dec 04 11:45:12.193439 master-0 kubenswrapper[8993]: I1204 11:45:12.193316 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-rxhpq" event={"ID":"5ae25dd5-dfdb-42f6-97d0-14ad17743c95","Type":"ContainerDied","Data":"fbb615d6c9d1ef25aa2db62084390ffbce46178d8659706ad341ef8739a6266d"} Dec 04 11:45:12.211712 master-0 kubenswrapper[8993]: I1204 11:45:12.211644 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-77758bc754-8smqn_8e5e33b0-4e2e-464c-ba5b-cbd2048004f8/service-ca-operator/2.log" Dec 04 11:45:12.215574 master-0 kubenswrapper[8993]: I1204 11:45:12.215513 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-b9c5dfc78-dcxkw_fd9f8671-8066-4990-b45d-8b619aa5d9ec/kube-storage-version-migrator-operator/2.log" Dec 04 11:45:12.220380 master-0 kubenswrapper[8993]: I1204 11:45:12.220318 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-autoscaler-operator-5f49d774cd-894dk_e7fc7c16-5bca-49e5-aff0-7a8f80c6b639/cluster-autoscaler-operator/0.log" Dec 04 11:45:12.222025 master-0 kubenswrapper[8993]: I1204 11:45:12.221960 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" event={"ID":"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639","Type":"ContainerStarted","Data":"4d95860537918a04cf76c6b27375da7f45face6b265a8eec014e0a60e0abd873"} Dec 04 11:45:12.228577 master-0 kubenswrapper[8993]: I1204 11:45:12.228422 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver-operator_kube-apiserver-operator-765d9ff747-gr68k_ccf81538-4d5a-4c26-8e54-fe39331a625d/kube-apiserver-operator/1.log" Dec 04 11:45:12.231149 master-0 kubenswrapper[8993]: I1204 11:45:12.231081 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-78f758c7b9-zgkh5_7e3160a9-11d1-4845-ba30-1a49ae7339a9/cluster-baremetal-operator/2.log" Dec 04 11:45:12.234859 master-0 kubenswrapper[8993]: I1204 11:45:12.234778 8993 scope.go:117] "RemoveContainer" containerID="560ba30f370ec40b8f7156e79883f77ace5f0c511592152f47a88a654d161d5b" Dec 04 11:45:12.235038 master-0 kubenswrapper[8993]: I1204 11:45:12.234991 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication-operator_authentication-operator-6c968fdfdf-nrrfw_42b3be0f-1d82-4a64-abb4-0118a6960efd/authentication-operator/2.log" Dec 04 11:45:12.238172 master-0 kubenswrapper[8993]: I1204 11:45:12.238095 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-apiserver-operator_openshift-apiserver-operator-7bf7f6b755-sh6qf_a5b826c3-8638-4cf5-b974-b24e4282ce00/openshift-apiserver-operator/1.log" Dec 04 11:45:12.240818 master-0 kubenswrapper[8993]: I1204 11:45:12.240733 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-2-master-0" event={"ID":"38e7be62-e4f5-42ba-89f0-83aca874a092","Type":"ContainerStarted","Data":"5a3415efa00f234c75a3ef12f121cd45062cac0bc8779f480bd4cc3b20b6aea6"} Dec 04 11:45:12.245275 master-0 kubenswrapper[8993]: I1204 11:45:12.245217 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" event={"ID":"24506aa4-ab78-49df-bb58-59093498f13d","Type":"ContainerStarted","Data":"89ac9be46243609bde604f4ef89b49eac3ee3ceca2042c8efeae7607ac835469"} Dec 04 11:45:12.245553 master-0 kubenswrapper[8993]: I1204 11:45:12.245517 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:45:12.247623 master-0 kubenswrapper[8993]: I1204 11:45:12.247591 8993 generic.go:334] "Generic (PLEG): container finished" podID="b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" containerID="45c8fa1ff0262056ef5a835c1716884b40d7aada299e2327b7d384d12656f5f4" exitCode=0 Dec 04 11:45:12.247757 master-0 kubenswrapper[8993]: I1204 11:45:12.247710 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-8qs8v" event={"ID":"b620f29d-dcde-4f98-9fb6-dd479dcdcf7c","Type":"ContainerStarted","Data":"72b6ea20a14f1d37ebf32d8152e62c089293a4e895690df2e1e95cac0e8c0aa1"} Dec 04 11:45:12.247856 master-0 kubenswrapper[8993]: I1204 11:45:12.247766 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-8qs8v" event={"ID":"b620f29d-dcde-4f98-9fb6-dd479dcdcf7c","Type":"ContainerDied","Data":"45c8fa1ff0262056ef5a835c1716884b40d7aada299e2327b7d384d12656f5f4"} Dec 04 11:45:12.250691 master-0 kubenswrapper[8993]: I1204 11:45:12.250655 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:45:12.253214 master-0 kubenswrapper[8993]: I1204 11:45:12.253177 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-4-master-0" event={"ID":"780ea907-dec5-426e-9de2-158f59c09f71","Type":"ContainerStarted","Data":"8e2bcd64158b0463f9bafc73ea2efd8e5f7562257e1c40b5ab47bc4fcd4b79db"} Dec 04 11:45:12.255959 master-0 kubenswrapper[8993]: I1204 11:45:12.255917 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler-operator_openshift-kube-scheduler-operator-5f85974995-g4rwv_27576028-d64a-47cd-b76b-d524e41efe37/kube-scheduler-operator-container/2.log" Dec 04 11:45:12.260133 master-0 kubenswrapper[8993]: I1204 11:45:12.260086 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_network-operator-79767b7ff9-5bgzx_ffaf95be-586c-40fa-b15f-1beaffe7ff1c/network-operator/2.log" Dec 04 11:45:12.262398 master-0 kubenswrapper[8993]: I1204 11:45:12.262246 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd/etcd-master-0" podStartSLOduration=10.262215009 podStartE2EDuration="10.262215009s" podCreationTimestamp="2025-12-04 11:45:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:45:12.258961512 +0000 UTC m=+446.649902955" watchObservedRunningTime="2025-12-04 11:45:12.262215009 +0000 UTC m=+446.653156442" Dec 04 11:45:12.263655 master-0 kubenswrapper[8993]: I1204 11:45:12.263595 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" event={"ID":"e4d7939a-5961-4608-b910-73e71aa55bf6","Type":"ContainerStarted","Data":"d859cb27e867f25cc9dc636a000b6297269eff79e613711203786b4339047231"} Dec 04 11:45:12.263655 master-0 kubenswrapper[8993]: I1204 11:45:12.263652 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" event={"ID":"e4d7939a-5961-4608-b910-73e71aa55bf6","Type":"ContainerStarted","Data":"2258f6af8e03d9e9b2176864d007811f1c2157002d410c1abd99bd0f7a698646"} Dec 04 11:45:12.264864 master-0 kubenswrapper[8993]: I1204 11:45:12.264816 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:45:12.266820 master-0 kubenswrapper[8993]: I1204 11:45:12.266770 8993 scope.go:117] "RemoveContainer" containerID="4efa514695b682bb2d4ad336643391490d8d1ea01e30ed9629a1ef982abb6433" Dec 04 11:45:12.268047 master-0 kubenswrapper[8993]: I1204 11:45:12.268019 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager-operator_kube-controller-manager-operator-848f645654-7hmhg_bac00ac5-0371-48fd-b1cc-60438f08ae94/kube-controller-manager-operator/1.log" Dec 04 11:45:12.271876 master-0 kubenswrapper[8993]: I1204 11:45:12.271617 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:45:12.279525 master-0 kubenswrapper[8993]: I1204 11:45:12.279138 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" event={"ID":"855d7874-16b1-47d0-82f6-d2b0c89b9a84","Type":"ContainerStarted","Data":"b25a12539ab81f598452dfcf6976eadfc75662455306195b0f50f7f733268c7e"} Dec 04 11:45:12.279525 master-0 kubenswrapper[8993]: I1204 11:45:12.279253 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" event={"ID":"855d7874-16b1-47d0-82f6-d2b0c89b9a84","Type":"ContainerStarted","Data":"be595cb0f6bc539259ae33f4c798872444db87c19b714237c536b92a4a7a1a6c"} Dec 04 11:45:12.280758 master-0 kubenswrapper[8993]: I1204 11:45:12.279685 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:45:12.284590 master-0 kubenswrapper[8993]: I1204 11:45:12.284530 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" event={"ID":"c50317d3-f7cd-4133-845e-44add57ac378","Type":"ContainerStarted","Data":"98d20604fd8ab25d783000ee1ca78a071d7a0dba8eedff22a4aa8bd932bbf14d"} Dec 04 11:45:12.332267 master-0 kubenswrapper[8993]: I1204 11:45:12.332158 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-scheduler/installer-1-master-0"] Dec 04 11:45:12.334536 master-0 kubenswrapper[8993]: I1204 11:45:12.334468 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-scheduler/installer-1-master-0"] Dec 04 11:45:12.336791 master-0 kubenswrapper[8993]: I1204 11:45:12.335639 8993 scope.go:117] "RemoveContainer" containerID="c8d34e789c5970b0307d273982d5779a2dcd6c7a7b38f7401ca6eca1e3af06ea" Dec 04 11:45:12.360298 master-0 kubenswrapper[8993]: I1204 11:45:12.360252 8993 scope.go:117] "RemoveContainer" containerID="5601978092c465a26e532b8cb8f66b5633a31c07893435c149ed0029a0397280" Dec 04 11:45:12.383967 master-0 kubenswrapper[8993]: I1204 11:45:12.383878 8993 scope.go:117] "RemoveContainer" containerID="8024196dc7d7114b2537f80438f2f5ad83a892cee7caa5f4d34fca2b46d86f82" Dec 04 11:45:12.405536 master-0 kubenswrapper[8993]: I1204 11:45:12.405481 8993 scope.go:117] "RemoveContainer" containerID="10a13e320db86cab3c629c14a604cd412c42b909da0c8bde7337860edd2f6505" Dec 04 11:45:12.406193 master-0 kubenswrapper[8993]: E1204 11:45:12.406138 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10a13e320db86cab3c629c14a604cd412c42b909da0c8bde7337860edd2f6505\": container with ID starting with 10a13e320db86cab3c629c14a604cd412c42b909da0c8bde7337860edd2f6505 not found: ID does not exist" containerID="10a13e320db86cab3c629c14a604cd412c42b909da0c8bde7337860edd2f6505" Dec 04 11:45:12.406264 master-0 kubenswrapper[8993]: I1204 11:45:12.406190 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10a13e320db86cab3c629c14a604cd412c42b909da0c8bde7337860edd2f6505"} err="failed to get container status \"10a13e320db86cab3c629c14a604cd412c42b909da0c8bde7337860edd2f6505\": rpc error: code = NotFound desc = could not find container \"10a13e320db86cab3c629c14a604cd412c42b909da0c8bde7337860edd2f6505\": container with ID starting with 10a13e320db86cab3c629c14a604cd412c42b909da0c8bde7337860edd2f6505 not found: ID does not exist" Dec 04 11:45:12.406264 master-0 kubenswrapper[8993]: I1204 11:45:12.406217 8993 scope.go:117] "RemoveContainer" containerID="38994ab2ae9659964fed86de7d58ee76405c493bf0a90b3260a8bc5301b5819a" Dec 04 11:45:12.406571 master-0 kubenswrapper[8993]: E1204 11:45:12.406525 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38994ab2ae9659964fed86de7d58ee76405c493bf0a90b3260a8bc5301b5819a\": container with ID starting with 38994ab2ae9659964fed86de7d58ee76405c493bf0a90b3260a8bc5301b5819a not found: ID does not exist" containerID="38994ab2ae9659964fed86de7d58ee76405c493bf0a90b3260a8bc5301b5819a" Dec 04 11:45:12.406571 master-0 kubenswrapper[8993]: I1204 11:45:12.406562 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38994ab2ae9659964fed86de7d58ee76405c493bf0a90b3260a8bc5301b5819a"} err="failed to get container status \"38994ab2ae9659964fed86de7d58ee76405c493bf0a90b3260a8bc5301b5819a\": rpc error: code = NotFound desc = could not find container \"38994ab2ae9659964fed86de7d58ee76405c493bf0a90b3260a8bc5301b5819a\": container with ID starting with 38994ab2ae9659964fed86de7d58ee76405c493bf0a90b3260a8bc5301b5819a not found: ID does not exist" Dec 04 11:45:12.406662 master-0 kubenswrapper[8993]: I1204 11:45:12.406582 8993 scope.go:117] "RemoveContainer" containerID="a5c78a2d8242e27c86fe1aef51f9f44b2ab668d62560b3158373aada11376ae9" Dec 04 11:45:12.407216 master-0 kubenswrapper[8993]: E1204 11:45:12.407167 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5c78a2d8242e27c86fe1aef51f9f44b2ab668d62560b3158373aada11376ae9\": container with ID starting with a5c78a2d8242e27c86fe1aef51f9f44b2ab668d62560b3158373aada11376ae9 not found: ID does not exist" containerID="a5c78a2d8242e27c86fe1aef51f9f44b2ab668d62560b3158373aada11376ae9" Dec 04 11:45:12.407310 master-0 kubenswrapper[8993]: I1204 11:45:12.407208 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5c78a2d8242e27c86fe1aef51f9f44b2ab668d62560b3158373aada11376ae9"} err="failed to get container status \"a5c78a2d8242e27c86fe1aef51f9f44b2ab668d62560b3158373aada11376ae9\": rpc error: code = NotFound desc = could not find container \"a5c78a2d8242e27c86fe1aef51f9f44b2ab668d62560b3158373aada11376ae9\": container with ID starting with a5c78a2d8242e27c86fe1aef51f9f44b2ab668d62560b3158373aada11376ae9 not found: ID does not exist" Dec 04 11:45:12.407310 master-0 kubenswrapper[8993]: I1204 11:45:12.407302 8993 scope.go:117] "RemoveContainer" containerID="125cdcb9380437c2c74e709578e049126370c6c2e8787828f7e5e31c2a5f5cbe" Dec 04 11:45:12.412791 master-0 kubenswrapper[8993]: E1204 11:45:12.412739 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"125cdcb9380437c2c74e709578e049126370c6c2e8787828f7e5e31c2a5f5cbe\": container with ID starting with 125cdcb9380437c2c74e709578e049126370c6c2e8787828f7e5e31c2a5f5cbe not found: ID does not exist" containerID="125cdcb9380437c2c74e709578e049126370c6c2e8787828f7e5e31c2a5f5cbe" Dec 04 11:45:12.412791 master-0 kubenswrapper[8993]: I1204 11:45:12.412779 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"125cdcb9380437c2c74e709578e049126370c6c2e8787828f7e5e31c2a5f5cbe"} err="failed to get container status \"125cdcb9380437c2c74e709578e049126370c6c2e8787828f7e5e31c2a5f5cbe\": rpc error: code = NotFound desc = could not find container \"125cdcb9380437c2c74e709578e049126370c6c2e8787828f7e5e31c2a5f5cbe\": container with ID starting with 125cdcb9380437c2c74e709578e049126370c6c2e8787828f7e5e31c2a5f5cbe not found: ID does not exist" Dec 04 11:45:12.412964 master-0 kubenswrapper[8993]: I1204 11:45:12.412799 8993 scope.go:117] "RemoveContainer" containerID="dc75d44b8be7e058788b5cd96125d7bea4962e131339dd256a97c23ba994b1b7" Dec 04 11:45:12.413281 master-0 kubenswrapper[8993]: E1204 11:45:12.413242 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc75d44b8be7e058788b5cd96125d7bea4962e131339dd256a97c23ba994b1b7\": container with ID starting with dc75d44b8be7e058788b5cd96125d7bea4962e131339dd256a97c23ba994b1b7 not found: ID does not exist" containerID="dc75d44b8be7e058788b5cd96125d7bea4962e131339dd256a97c23ba994b1b7" Dec 04 11:45:12.413329 master-0 kubenswrapper[8993]: I1204 11:45:12.413289 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc75d44b8be7e058788b5cd96125d7bea4962e131339dd256a97c23ba994b1b7"} err="failed to get container status \"dc75d44b8be7e058788b5cd96125d7bea4962e131339dd256a97c23ba994b1b7\": rpc error: code = NotFound desc = could not find container \"dc75d44b8be7e058788b5cd96125d7bea4962e131339dd256a97c23ba994b1b7\": container with ID starting with dc75d44b8be7e058788b5cd96125d7bea4962e131339dd256a97c23ba994b1b7 not found: ID does not exist" Dec 04 11:45:12.413329 master-0 kubenswrapper[8993]: I1204 11:45:12.413309 8993 scope.go:117] "RemoveContainer" containerID="05275cb6451e1a77bd316f718a2831588e2ee8d0a474e33a3702ad4134ac254b" Dec 04 11:45:12.413778 master-0 kubenswrapper[8993]: E1204 11:45:12.413739 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05275cb6451e1a77bd316f718a2831588e2ee8d0a474e33a3702ad4134ac254b\": container with ID starting with 05275cb6451e1a77bd316f718a2831588e2ee8d0a474e33a3702ad4134ac254b not found: ID does not exist" containerID="05275cb6451e1a77bd316f718a2831588e2ee8d0a474e33a3702ad4134ac254b" Dec 04 11:45:12.413778 master-0 kubenswrapper[8993]: I1204 11:45:12.413768 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05275cb6451e1a77bd316f718a2831588e2ee8d0a474e33a3702ad4134ac254b"} err="failed to get container status \"05275cb6451e1a77bd316f718a2831588e2ee8d0a474e33a3702ad4134ac254b\": rpc error: code = NotFound desc = could not find container \"05275cb6451e1a77bd316f718a2831588e2ee8d0a474e33a3702ad4134ac254b\": container with ID starting with 05275cb6451e1a77bd316f718a2831588e2ee8d0a474e33a3702ad4134ac254b not found: ID does not exist" Dec 04 11:45:12.413888 master-0 kubenswrapper[8993]: I1204 11:45:12.413784 8993 scope.go:117] "RemoveContainer" containerID="8543749f8386d25fbc9d05c27b7ab7559de13cecd2f9d2e22a588c804bace527" Dec 04 11:45:12.414068 master-0 kubenswrapper[8993]: E1204 11:45:12.414035 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8543749f8386d25fbc9d05c27b7ab7559de13cecd2f9d2e22a588c804bace527\": container with ID starting with 8543749f8386d25fbc9d05c27b7ab7559de13cecd2f9d2e22a588c804bace527 not found: ID does not exist" containerID="8543749f8386d25fbc9d05c27b7ab7559de13cecd2f9d2e22a588c804bace527" Dec 04 11:45:12.414114 master-0 kubenswrapper[8993]: I1204 11:45:12.414081 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8543749f8386d25fbc9d05c27b7ab7559de13cecd2f9d2e22a588c804bace527"} err="failed to get container status \"8543749f8386d25fbc9d05c27b7ab7559de13cecd2f9d2e22a588c804bace527\": rpc error: code = NotFound desc = could not find container \"8543749f8386d25fbc9d05c27b7ab7559de13cecd2f9d2e22a588c804bace527\": container with ID starting with 8543749f8386d25fbc9d05c27b7ab7559de13cecd2f9d2e22a588c804bace527 not found: ID does not exist" Dec 04 11:45:12.414114 master-0 kubenswrapper[8993]: I1204 11:45:12.414096 8993 scope.go:117] "RemoveContainer" containerID="c2365e3e1212552c67b403c1062c118ea5e3306eac11c30d2c954d48de545647" Dec 04 11:45:12.414388 master-0 kubenswrapper[8993]: E1204 11:45:12.414351 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2365e3e1212552c67b403c1062c118ea5e3306eac11c30d2c954d48de545647\": container with ID starting with c2365e3e1212552c67b403c1062c118ea5e3306eac11c30d2c954d48de545647 not found: ID does not exist" containerID="c2365e3e1212552c67b403c1062c118ea5e3306eac11c30d2c954d48de545647" Dec 04 11:45:12.414437 master-0 kubenswrapper[8993]: I1204 11:45:12.414384 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2365e3e1212552c67b403c1062c118ea5e3306eac11c30d2c954d48de545647"} err="failed to get container status \"c2365e3e1212552c67b403c1062c118ea5e3306eac11c30d2c954d48de545647\": rpc error: code = NotFound desc = could not find container \"c2365e3e1212552c67b403c1062c118ea5e3306eac11c30d2c954d48de545647\": container with ID starting with c2365e3e1212552c67b403c1062c118ea5e3306eac11c30d2c954d48de545647 not found: ID does not exist" Dec 04 11:45:12.414437 master-0 kubenswrapper[8993]: I1204 11:45:12.414400 8993 scope.go:117] "RemoveContainer" containerID="bf092013477d028b4e0ff6d6621a140759c75991960cac0199edb383102625b9" Dec 04 11:45:12.414738 master-0 kubenswrapper[8993]: E1204 11:45:12.414688 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf092013477d028b4e0ff6d6621a140759c75991960cac0199edb383102625b9\": container with ID starting with bf092013477d028b4e0ff6d6621a140759c75991960cac0199edb383102625b9 not found: ID does not exist" containerID="bf092013477d028b4e0ff6d6621a140759c75991960cac0199edb383102625b9" Dec 04 11:45:12.414738 master-0 kubenswrapper[8993]: I1204 11:45:12.414717 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf092013477d028b4e0ff6d6621a140759c75991960cac0199edb383102625b9"} err="failed to get container status \"bf092013477d028b4e0ff6d6621a140759c75991960cac0199edb383102625b9\": rpc error: code = NotFound desc = could not find container \"bf092013477d028b4e0ff6d6621a140759c75991960cac0199edb383102625b9\": container with ID starting with bf092013477d028b4e0ff6d6621a140759c75991960cac0199edb383102625b9 not found: ID does not exist" Dec 04 11:45:12.414738 master-0 kubenswrapper[8993]: I1204 11:45:12.414731 8993 scope.go:117] "RemoveContainer" containerID="b6e0393f35b37b796e29e063a198964a882daa0edec21adc6f195e441be69db7" Dec 04 11:45:12.415077 master-0 kubenswrapper[8993]: E1204 11:45:12.415018 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6e0393f35b37b796e29e063a198964a882daa0edec21adc6f195e441be69db7\": container with ID starting with b6e0393f35b37b796e29e063a198964a882daa0edec21adc6f195e441be69db7 not found: ID does not exist" containerID="b6e0393f35b37b796e29e063a198964a882daa0edec21adc6f195e441be69db7" Dec 04 11:45:12.415131 master-0 kubenswrapper[8993]: I1204 11:45:12.415085 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e0393f35b37b796e29e063a198964a882daa0edec21adc6f195e441be69db7"} err="failed to get container status \"b6e0393f35b37b796e29e063a198964a882daa0edec21adc6f195e441be69db7\": rpc error: code = NotFound desc = could not find container \"b6e0393f35b37b796e29e063a198964a882daa0edec21adc6f195e441be69db7\": container with ID starting with b6e0393f35b37b796e29e063a198964a882daa0edec21adc6f195e441be69db7 not found: ID does not exist" Dec 04 11:45:12.415131 master-0 kubenswrapper[8993]: I1204 11:45:12.415101 8993 scope.go:117] "RemoveContainer" containerID="eeb6c3dc3fc4ac2310a94746d140288965ceb78f995753a5fcb2fc6a20648fed" Dec 04 11:45:12.415560 master-0 kubenswrapper[8993]: E1204 11:45:12.415516 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeb6c3dc3fc4ac2310a94746d140288965ceb78f995753a5fcb2fc6a20648fed\": container with ID starting with eeb6c3dc3fc4ac2310a94746d140288965ceb78f995753a5fcb2fc6a20648fed not found: ID does not exist" containerID="eeb6c3dc3fc4ac2310a94746d140288965ceb78f995753a5fcb2fc6a20648fed" Dec 04 11:45:12.415560 master-0 kubenswrapper[8993]: I1204 11:45:12.415550 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeb6c3dc3fc4ac2310a94746d140288965ceb78f995753a5fcb2fc6a20648fed"} err="failed to get container status \"eeb6c3dc3fc4ac2310a94746d140288965ceb78f995753a5fcb2fc6a20648fed\": rpc error: code = NotFound desc = could not find container \"eeb6c3dc3fc4ac2310a94746d140288965ceb78f995753a5fcb2fc6a20648fed\": container with ID starting with eeb6c3dc3fc4ac2310a94746d140288965ceb78f995753a5fcb2fc6a20648fed not found: ID does not exist" Dec 04 11:45:12.415644 master-0 kubenswrapper[8993]: I1204 11:45:12.415571 8993 scope.go:117] "RemoveContainer" containerID="e0e04ce110c25a2c4a312ed2fdb876c28e02526d17e1277179eb5a2f7c3254e0" Dec 04 11:45:12.415906 master-0 kubenswrapper[8993]: E1204 11:45:12.415867 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0e04ce110c25a2c4a312ed2fdb876c28e02526d17e1277179eb5a2f7c3254e0\": container with ID starting with e0e04ce110c25a2c4a312ed2fdb876c28e02526d17e1277179eb5a2f7c3254e0 not found: ID does not exist" containerID="e0e04ce110c25a2c4a312ed2fdb876c28e02526d17e1277179eb5a2f7c3254e0" Dec 04 11:45:12.415959 master-0 kubenswrapper[8993]: I1204 11:45:12.415902 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0e04ce110c25a2c4a312ed2fdb876c28e02526d17e1277179eb5a2f7c3254e0"} err="failed to get container status \"e0e04ce110c25a2c4a312ed2fdb876c28e02526d17e1277179eb5a2f7c3254e0\": rpc error: code = NotFound desc = could not find container \"e0e04ce110c25a2c4a312ed2fdb876c28e02526d17e1277179eb5a2f7c3254e0\": container with ID starting with e0e04ce110c25a2c4a312ed2fdb876c28e02526d17e1277179eb5a2f7c3254e0 not found: ID does not exist" Dec 04 11:45:12.430952 master-0 kubenswrapper[8993]: I1204 11:45:12.430861 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-wksdw" podStartSLOduration=216.994326293 podStartE2EDuration="6m29.430842835s" podCreationTimestamp="2025-12-04 11:38:43 +0000 UTC" firstStartedPulling="2025-12-04 11:38:45.927429994 +0000 UTC m=+60.318371427" lastFinishedPulling="2025-12-04 11:41:38.363946536 +0000 UTC m=+232.754887969" observedRunningTime="2025-12-04 11:45:12.42671076 +0000 UTC m=+446.817652193" watchObservedRunningTime="2025-12-04 11:45:12.430842835 +0000 UTC m=+446.821784268" Dec 04 11:45:12.496837 master-0 kubenswrapper[8993]: I1204 11:45:12.496595 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" podStartSLOduration=387.496568801 podStartE2EDuration="6m27.496568801s" podCreationTimestamp="2025-12-04 11:38:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:45:12.495980162 +0000 UTC m=+446.886921595" watchObservedRunningTime="2025-12-04 11:45:12.496568801 +0000 UTC m=+446.887510244" Dec 04 11:45:12.539091 master-0 kubenswrapper[8993]: I1204 11:45:12.538979 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler/installer-4-master-0" podStartSLOduration=388.538944554 podStartE2EDuration="6m28.538944554s" podCreationTimestamp="2025-12-04 11:38:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:45:12.535408189 +0000 UTC m=+446.926349622" watchObservedRunningTime="2025-12-04 11:45:12.538944554 +0000 UTC m=+446.929885987" Dec 04 11:45:12.558005 master-0 kubenswrapper[8993]: I1204 11:45:12.557105 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/installer-2-master-0" podStartSLOduration=386.557083957 podStartE2EDuration="6m26.557083957s" podCreationTimestamp="2025-12-04 11:38:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:45:12.553408716 +0000 UTC m=+446.944350149" watchObservedRunningTime="2025-12-04 11:45:12.557083957 +0000 UTC m=+446.948025390" Dec 04 11:45:12.602991 master-0 kubenswrapper[8993]: I1204 11:45:12.602857 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:45:12.603737 master-0 kubenswrapper[8993]: I1204 11:45:12.603703 8993 scope.go:117] "RemoveContainer" containerID="c0669a25eca640b16ba8b2ecfd0f28795bd45ad2500d4e00f1ed214c5294a0cd" Dec 04 11:45:12.604012 master-0 kubenswrapper[8993]: E1204 11:45:12.603979 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-controller-manager pod=bootstrap-kube-controller-manager-master-0_kube-system(8b47694fcc32464ab24d09c23d6efb57)\"" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" Dec 04 11:45:12.626620 master-0 kubenswrapper[8993]: I1204 11:45:12.626527 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" podStartSLOduration=388.626507753 podStartE2EDuration="6m28.626507753s" podCreationTimestamp="2025-12-04 11:38:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:45:12.624505918 +0000 UTC m=+447.015447381" watchObservedRunningTime="2025-12-04 11:45:12.626507753 +0000 UTC m=+447.017449186" Dec 04 11:45:12.645953 master-0 kubenswrapper[8993]: I1204 11:45:12.645854 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podStartSLOduration=387.645832824 podStartE2EDuration="6m27.645832824s" podCreationTimestamp="2025-12-04 11:38:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:45:12.642073412 +0000 UTC m=+447.033014865" watchObservedRunningTime="2025-12-04 11:45:12.645832824 +0000 UTC m=+447.036774257" Dec 04 11:45:12.884826 master-0 kubenswrapper[8993]: I1204 11:45:12.884725 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:45:13.280899 master-0 kubenswrapper[8993]: I1204 11:45:13.280783 8993 patch_prober.go:28] interesting pod/packageserver-675f5c767c-mtdrq container/packageserver namespace/openshift-operator-lifecycle-manager: Readiness probe status=failure output="Get \"https://10.128.0.64:5443/healthz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:45:13.281265 master-0 kubenswrapper[8993]: I1204 11:45:13.280926 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" podUID="855d7874-16b1-47d0-82f6-d2b0c89b9a84" containerName="packageserver" probeResult="failure" output="Get \"https://10.128.0.64:5443/healthz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Dec 04 11:45:13.311557 master-0 kubenswrapper[8993]: I1204 11:45:13.311274 8993 generic.go:334] "Generic (PLEG): container finished" podID="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" containerID="b831427379e3db6806a6998a0a6732a8a35135454ae340aeb1971b3048c51a2b" exitCode=0 Dec 04 11:45:13.311557 master-0 kubenswrapper[8993]: I1204 11:45:13.311406 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-rxhpq" event={"ID":"5ae25dd5-dfdb-42f6-97d0-14ad17743c95","Type":"ContainerDied","Data":"b831427379e3db6806a6998a0a6732a8a35135454ae340aeb1971b3048c51a2b"} Dec 04 11:45:13.314962 master-0 kubenswrapper[8993]: I1204 11:45:13.314925 8993 scope.go:117] "RemoveContainer" containerID="c0669a25eca640b16ba8b2ecfd0f28795bd45ad2500d4e00f1ed214c5294a0cd" Dec 04 11:45:13.315691 master-0 kubenswrapper[8993]: E1204 11:45:13.315201 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-controller-manager pod=bootstrap-kube-controller-manager-master-0_kube-system(8b47694fcc32464ab24d09c23d6efb57)\"" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" Dec 04 11:45:13.317708 master-0 kubenswrapper[8993]: I1204 11:45:13.317618 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_cluster-storage-operator-dcf7fc84b-fncfd_f797ab14-0eb5-48b4-b914-f434f67c4c49/cluster-storage-operator/1.log" Dec 04 11:45:13.328740 master-0 kubenswrapper[8993]: I1204 11:45:13.328686 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/2.log" Dec 04 11:45:13.334700 master-0 kubenswrapper[8993]: I1204 11:45:13.334613 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-6c8676f99d-7z948_3322cc5a-f1f7-4522-b423-19fb7f38cd43/openshift-controller-manager-operator/2.log" Dec 04 11:45:13.336836 master-0 kubenswrapper[8993]: I1204 11:45:13.336741 8993 generic.go:334] "Generic (PLEG): container finished" podID="b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" containerID="72b6ea20a14f1d37ebf32d8152e62c089293a4e895690df2e1e95cac0e8c0aa1" exitCode=0 Dec 04 11:45:13.336900 master-0 kubenswrapper[8993]: I1204 11:45:13.336849 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-8qs8v" event={"ID":"b620f29d-dcde-4f98-9fb6-dd479dcdcf7c","Type":"ContainerDied","Data":"72b6ea20a14f1d37ebf32d8152e62c089293a4e895690df2e1e95cac0e8c0aa1"} Dec 04 11:45:13.801423 master-0 kubenswrapper[8993]: I1204 11:45:13.801367 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c" path="/var/lib/kubelet/pods/2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c/volumes" Dec 04 11:45:13.802141 master-0 kubenswrapper[8993]: I1204 11:45:13.802098 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7746ae23-c2f8-431c-9e52-dc3d0f9404d3" path="/var/lib/kubelet/pods/7746ae23-c2f8-431c-9e52-dc3d0f9404d3/volumes" Dec 04 11:45:14.342829 master-0 kubenswrapper[8993]: I1204 11:45:14.337910 8993 patch_prober.go:28] interesting pod/packageserver-675f5c767c-mtdrq container/packageserver namespace/openshift-operator-lifecycle-manager: Readiness probe status=failure output="Get \"https://10.128.0.64:5443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:45:14.342829 master-0 kubenswrapper[8993]: I1204 11:45:14.338056 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" podUID="855d7874-16b1-47d0-82f6-d2b0c89b9a84" containerName="packageserver" probeResult="failure" output="Get \"https://10.128.0.64:5443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:45:14.366833 master-0 kubenswrapper[8993]: I1204 11:45:14.365186 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-8qs8v" event={"ID":"b620f29d-dcde-4f98-9fb6-dd479dcdcf7c","Type":"ContainerStarted","Data":"ace0461aff7106aeb143cc31c89860571a7b07704db7e3b46dc17268b8f57646"} Dec 04 11:45:14.373834 master-0 kubenswrapper[8993]: I1204 11:45:14.373432 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-rxhpq" event={"ID":"5ae25dd5-dfdb-42f6-97d0-14ad17743c95","Type":"ContainerStarted","Data":"49678595908a2e2c41b725aaca9c6b1ef9e4be6d996c893089f19d41f04a3117"} Dec 04 11:45:14.425573 master-0 kubenswrapper[8993]: I1204 11:45:14.425427 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-8qs8v" podStartSLOduration=386.900397876 podStartE2EDuration="6m29.425353546s" podCreationTimestamp="2025-12-04 11:38:45 +0000 UTC" firstStartedPulling="2025-12-04 11:45:11.188181032 +0000 UTC m=+445.579122465" lastFinishedPulling="2025-12-04 11:45:13.713136702 +0000 UTC m=+448.104078135" observedRunningTime="2025-12-04 11:45:14.396624548 +0000 UTC m=+448.787565981" watchObservedRunningTime="2025-12-04 11:45:14.425353546 +0000 UTC m=+448.816294999" Dec 04 11:45:14.425926 master-0 kubenswrapper[8993]: I1204 11:45:14.425858 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-rxhpq" podStartSLOduration=388.923936443 podStartE2EDuration="6m30.425850171s" podCreationTimestamp="2025-12-04 11:38:44 +0000 UTC" firstStartedPulling="2025-12-04 11:45:12.195338915 +0000 UTC m=+446.586280348" lastFinishedPulling="2025-12-04 11:45:13.697252643 +0000 UTC m=+448.088194076" observedRunningTime="2025-12-04 11:45:14.418240353 +0000 UTC m=+448.809181796" watchObservedRunningTime="2025-12-04 11:45:14.425850171 +0000 UTC m=+448.816791604" Dec 04 11:45:14.490457 master-0 kubenswrapper[8993]: I1204 11:45:14.490328 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:45:14.491160 master-0 kubenswrapper[8993]: I1204 11:45:14.491122 8993 scope.go:117] "RemoveContainer" containerID="c0669a25eca640b16ba8b2ecfd0f28795bd45ad2500d4e00f1ed214c5294a0cd" Dec 04 11:45:14.491434 master-0 kubenswrapper[8993]: E1204 11:45:14.491396 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-controller-manager pod=bootstrap-kube-controller-manager-master-0_kube-system(8b47694fcc32464ab24d09c23d6efb57)\"" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" Dec 04 11:45:15.374902 master-0 kubenswrapper[8993]: I1204 11:45:15.374777 8993 patch_prober.go:28] interesting pod/packageserver-675f5c767c-mtdrq container/packageserver namespace/openshift-operator-lifecycle-manager: Readiness probe status=failure output="Get \"https://10.128.0.64:5443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:45:15.374902 master-0 kubenswrapper[8993]: I1204 11:45:15.374899 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" podUID="855d7874-16b1-47d0-82f6-d2b0c89b9a84" containerName="packageserver" probeResult="failure" output="Get \"https://10.128.0.64:5443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:45:15.429784 master-0 kubenswrapper[8993]: I1204 11:45:15.428846 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:45:15.429784 master-0 kubenswrapper[8993]: I1204 11:45:15.428940 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:45:15.814897 master-0 kubenswrapper[8993]: I1204 11:45:15.814837 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:45:15.816311 master-0 kubenswrapper[8993]: I1204 11:45:15.816278 8993 scope.go:117] "RemoveContainer" containerID="c0669a25eca640b16ba8b2ecfd0f28795bd45ad2500d4e00f1ed214c5294a0cd" Dec 04 11:45:15.816609 master-0 kubenswrapper[8993]: E1204 11:45:15.816573 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-controller-manager pod=bootstrap-kube-controller-manager-master-0_kube-system(8b47694fcc32464ab24d09c23d6efb57)\"" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" Dec 04 11:45:15.819037 master-0 kubenswrapper[8993]: I1204 11:45:15.819000 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:45:16.015103 master-0 kubenswrapper[8993]: I1204 11:45:16.014437 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:45:16.355354 master-0 kubenswrapper[8993]: I1204 11:45:16.355251 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:45:16.355354 master-0 kubenswrapper[8993]: I1204 11:45:16.355348 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:45:16.388360 master-0 kubenswrapper[8993]: I1204 11:45:16.388319 8993 scope.go:117] "RemoveContainer" containerID="c0669a25eca640b16ba8b2ecfd0f28795bd45ad2500d4e00f1ed214c5294a0cd" Dec 04 11:45:16.388947 master-0 kubenswrapper[8993]: E1204 11:45:16.388568 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-controller-manager pod=bootstrap-kube-controller-manager-master-0_kube-system(8b47694fcc32464ab24d09c23d6efb57)\"" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" Dec 04 11:45:16.394155 master-0 kubenswrapper[8993]: I1204 11:45:16.394103 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:45:16.396409 master-0 kubenswrapper[8993]: I1204 11:45:16.396354 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:45:16.470903 master-0 kubenswrapper[8993]: I1204 11:45:16.470834 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/community-operators-rxhpq" podUID="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" containerName="registry-server" probeResult="failure" output=< Dec 04 11:45:16.470903 master-0 kubenswrapper[8993]: timeout: failed to connect service ":50051" within 1s Dec 04 11:45:16.470903 master-0 kubenswrapper[8993]: > Dec 04 11:45:17.395349 master-0 kubenswrapper[8993]: I1204 11:45:17.394854 8993 scope.go:117] "RemoveContainer" containerID="c0669a25eca640b16ba8b2ecfd0f28795bd45ad2500d4e00f1ed214c5294a0cd" Dec 04 11:45:17.395349 master-0 kubenswrapper[8993]: E1204 11:45:17.395107 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-controller-manager pod=bootstrap-kube-controller-manager-master-0_kube-system(8b47694fcc32464ab24d09c23d6efb57)\"" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" Dec 04 11:45:18.401573 master-0 kubenswrapper[8993]: I1204 11:45:18.401293 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" event={"ID":"c50317d3-f7cd-4133-845e-44add57ac378","Type":"ContainerStarted","Data":"bf5e3c44e8b979c1b2a2791e8de129301f2196277f040ae6c9ab59c2dfb23a10"} Dec 04 11:45:18.493571 master-0 kubenswrapper[8993]: I1204 11:45:18.493485 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" podStartSLOduration=386.55751532 podStartE2EDuration="6m33.493463299s" podCreationTimestamp="2025-12-04 11:38:45 +0000 UTC" firstStartedPulling="2025-12-04 11:45:11.119616393 +0000 UTC m=+445.510557826" lastFinishedPulling="2025-12-04 11:45:18.055564362 +0000 UTC m=+452.446505805" observedRunningTime="2025-12-04 11:45:18.490706149 +0000 UTC m=+452.881647582" watchObservedRunningTime="2025-12-04 11:45:18.493463299 +0000 UTC m=+452.884404732" Dec 04 11:45:25.470424 master-0 kubenswrapper[8993]: I1204 11:45:25.470366 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:45:25.511935 master-0 kubenswrapper[8993]: I1204 11:45:25.511866 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:45:26.398955 master-0 kubenswrapper[8993]: I1204 11:45:26.398891 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:45:30.207104 master-0 kubenswrapper[8993]: I1204 11:45:30.207039 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-krbbd"] Dec 04 11:45:30.207638 master-0 kubenswrapper[8993]: I1204 11:45:30.207318 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-krbbd" podUID="349b1e1d-db56-4960-b6ff-e2f5f07d4aaa" containerName="registry-server" containerID="cri-o://4890abf2d3f01658d86ae12259448cdd3826f537570b783848a6220e06481aa8" gracePeriod=2 Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: I1204 11:45:30.444728 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-svhl4"] Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: E1204 11:45:30.445076 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a2aabd50-bfed-4ab5-ad19-f84ec50203ec" containerName="extract-utilities" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: I1204 11:45:30.445093 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2aabd50-bfed-4ab5-ad19-f84ec50203ec" containerName="extract-utilities" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: E1204 11:45:30.445120 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a2aabd50-bfed-4ab5-ad19-f84ec50203ec" containerName="extract-content" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: I1204 11:45:30.445131 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2aabd50-bfed-4ab5-ad19-f84ec50203ec" containerName="extract-content" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: E1204 11:45:30.445145 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3" containerName="installer" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: I1204 11:45:30.445153 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3" containerName="installer" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: E1204 11:45:30.445172 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a0710bdf-3961-48d6-864a-efbd6d68e852" containerName="extract-content" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: I1204 11:45:30.445179 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0710bdf-3961-48d6-864a-efbd6d68e852" containerName="extract-content" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: E1204 11:45:30.445194 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0a3dbe2b-a659-46c2-93e8-19bd30ee2260" containerName="installer" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: I1204 11:45:30.445201 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a3dbe2b-a659-46c2-93e8-19bd30ee2260" containerName="installer" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: E1204 11:45:30.445215 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c" containerName="extract-content" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: I1204 11:45:30.445223 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c" containerName="extract-content" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: E1204 11:45:30.445236 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a0710bdf-3961-48d6-864a-efbd6d68e852" containerName="extract-utilities" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: I1204 11:45:30.445243 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0710bdf-3961-48d6-864a-efbd6d68e852" containerName="extract-utilities" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: E1204 11:45:30.445255 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2dea9140-7c02-46cd-9b67-a2aee143c3a8" containerName="installer" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: I1204 11:45:30.445262 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dea9140-7c02-46cd-9b67-a2aee143c3a8" containerName="installer" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: E1204 11:45:30.445276 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c" containerName="extract-utilities" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: I1204 11:45:30.445286 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c" containerName="extract-utilities" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: E1204 11:45:30.445300 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7746ae23-c2f8-431c-9e52-dc3d0f9404d3" containerName="installer" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: I1204 11:45:30.445308 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="7746ae23-c2f8-431c-9e52-dc3d0f9404d3" containerName="installer" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: I1204 11:45:30.445452 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="2bb4e9d8-3c4d-4d43-9285-8707f8db5a2c" containerName="extract-content" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: I1204 11:45:30.445473 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="0a3dbe2b-a659-46c2-93e8-19bd30ee2260" containerName="installer" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: I1204 11:45:30.445481 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="a2aabd50-bfed-4ab5-ad19-f84ec50203ec" containerName="extract-content" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: I1204 11:45:30.445493 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3" containerName="installer" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: I1204 11:45:30.445511 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="a0710bdf-3961-48d6-864a-efbd6d68e852" containerName="extract-content" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: I1204 11:45:30.445520 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="7746ae23-c2f8-431c-9e52-dc3d0f9404d3" containerName="installer" Dec 04 11:45:30.445875 master-0 kubenswrapper[8993]: I1204 11:45:30.445534 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="2dea9140-7c02-46cd-9b67-a2aee143c3a8" containerName="installer" Dec 04 11:45:30.450538 master-0 kubenswrapper[8993]: I1204 11:45:30.448518 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:45:30.451563 master-0 kubenswrapper[8993]: I1204 11:45:30.451478 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"redhat-marketplace-dockercfg-kpc5q" Dec 04 11:45:30.463685 master-0 kubenswrapper[8993]: I1204 11:45:30.463553 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-svhl4"] Dec 04 11:45:30.482109 master-0 kubenswrapper[8993]: I1204 11:45:30.481505 8993 generic.go:334] "Generic (PLEG): container finished" podID="349b1e1d-db56-4960-b6ff-e2f5f07d4aaa" containerID="4890abf2d3f01658d86ae12259448cdd3826f537570b783848a6220e06481aa8" exitCode=0 Dec 04 11:45:30.482109 master-0 kubenswrapper[8993]: I1204 11:45:30.481646 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-krbbd" event={"ID":"349b1e1d-db56-4960-b6ff-e2f5f07d4aaa","Type":"ContainerDied","Data":"4890abf2d3f01658d86ae12259448cdd3826f537570b783848a6220e06481aa8"} Dec 04 11:45:30.621019 master-0 kubenswrapper[8993]: I1204 11:45:30.620885 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-krbbd" Dec 04 11:45:30.635982 master-0 kubenswrapper[8993]: I1204 11:45:30.635893 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mzvm\" (UniqueName: \"kubernetes.io/projected/f925fe60-b5b7-4a5a-9800-3546334da725-kube-api-access-2mzvm\") pod \"redhat-marketplace-svhl4\" (UID: \"f925fe60-b5b7-4a5a-9800-3546334da725\") " pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:45:30.636330 master-0 kubenswrapper[8993]: I1204 11:45:30.635996 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f925fe60-b5b7-4a5a-9800-3546334da725-utilities\") pod \"redhat-marketplace-svhl4\" (UID: \"f925fe60-b5b7-4a5a-9800-3546334da725\") " pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:45:30.636330 master-0 kubenswrapper[8993]: I1204 11:45:30.636044 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f925fe60-b5b7-4a5a-9800-3546334da725-catalog-content\") pod \"redhat-marketplace-svhl4\" (UID: \"f925fe60-b5b7-4a5a-9800-3546334da725\") " pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:45:30.737207 master-0 kubenswrapper[8993]: I1204 11:45:30.737024 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/349b1e1d-db56-4960-b6ff-e2f5f07d4aaa-catalog-content\") pod \"349b1e1d-db56-4960-b6ff-e2f5f07d4aaa\" (UID: \"349b1e1d-db56-4960-b6ff-e2f5f07d4aaa\") " Dec 04 11:45:30.737207 master-0 kubenswrapper[8993]: I1204 11:45:30.737134 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qz65b\" (UniqueName: \"kubernetes.io/projected/349b1e1d-db56-4960-b6ff-e2f5f07d4aaa-kube-api-access-qz65b\") pod \"349b1e1d-db56-4960-b6ff-e2f5f07d4aaa\" (UID: \"349b1e1d-db56-4960-b6ff-e2f5f07d4aaa\") " Dec 04 11:45:30.737207 master-0 kubenswrapper[8993]: I1204 11:45:30.737184 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/349b1e1d-db56-4960-b6ff-e2f5f07d4aaa-utilities\") pod \"349b1e1d-db56-4960-b6ff-e2f5f07d4aaa\" (UID: \"349b1e1d-db56-4960-b6ff-e2f5f07d4aaa\") " Dec 04 11:45:30.737509 master-0 kubenswrapper[8993]: I1204 11:45:30.737437 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f925fe60-b5b7-4a5a-9800-3546334da725-utilities\") pod \"redhat-marketplace-svhl4\" (UID: \"f925fe60-b5b7-4a5a-9800-3546334da725\") " pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:45:30.738230 master-0 kubenswrapper[8993]: I1204 11:45:30.738152 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f925fe60-b5b7-4a5a-9800-3546334da725-catalog-content\") pod \"redhat-marketplace-svhl4\" (UID: \"f925fe60-b5b7-4a5a-9800-3546334da725\") " pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:45:30.738312 master-0 kubenswrapper[8993]: I1204 11:45:30.738220 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/349b1e1d-db56-4960-b6ff-e2f5f07d4aaa-utilities" (OuterVolumeSpecName: "utilities") pod "349b1e1d-db56-4960-b6ff-e2f5f07d4aaa" (UID: "349b1e1d-db56-4960-b6ff-e2f5f07d4aaa"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 11:45:30.738312 master-0 kubenswrapper[8993]: I1204 11:45:30.738260 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f925fe60-b5b7-4a5a-9800-3546334da725-utilities\") pod \"redhat-marketplace-svhl4\" (UID: \"f925fe60-b5b7-4a5a-9800-3546334da725\") " pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:45:30.738464 master-0 kubenswrapper[8993]: I1204 11:45:30.738425 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2mzvm\" (UniqueName: \"kubernetes.io/projected/f925fe60-b5b7-4a5a-9800-3546334da725-kube-api-access-2mzvm\") pod \"redhat-marketplace-svhl4\" (UID: \"f925fe60-b5b7-4a5a-9800-3546334da725\") " pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:45:30.738620 master-0 kubenswrapper[8993]: I1204 11:45:30.738574 8993 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/349b1e1d-db56-4960-b6ff-e2f5f07d4aaa-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 11:45:30.738772 master-0 kubenswrapper[8993]: I1204 11:45:30.738740 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f925fe60-b5b7-4a5a-9800-3546334da725-catalog-content\") pod \"redhat-marketplace-svhl4\" (UID: \"f925fe60-b5b7-4a5a-9800-3546334da725\") " pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:45:30.741558 master-0 kubenswrapper[8993]: I1204 11:45:30.741498 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/349b1e1d-db56-4960-b6ff-e2f5f07d4aaa-kube-api-access-qz65b" (OuterVolumeSpecName: "kube-api-access-qz65b") pod "349b1e1d-db56-4960-b6ff-e2f5f07d4aaa" (UID: "349b1e1d-db56-4960-b6ff-e2f5f07d4aaa"). InnerVolumeSpecName "kube-api-access-qz65b". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:45:30.757004 master-0 kubenswrapper[8993]: I1204 11:45:30.756963 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mzvm\" (UniqueName: \"kubernetes.io/projected/f925fe60-b5b7-4a5a-9800-3546334da725-kube-api-access-2mzvm\") pod \"redhat-marketplace-svhl4\" (UID: \"f925fe60-b5b7-4a5a-9800-3546334da725\") " pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:45:30.757955 master-0 kubenswrapper[8993]: I1204 11:45:30.757856 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/349b1e1d-db56-4960-b6ff-e2f5f07d4aaa-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "349b1e1d-db56-4960-b6ff-e2f5f07d4aaa" (UID: "349b1e1d-db56-4960-b6ff-e2f5f07d4aaa"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 11:45:30.786123 master-0 kubenswrapper[8993]: I1204 11:45:30.785918 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:45:30.839617 master-0 kubenswrapper[8993]: I1204 11:45:30.839550 8993 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/349b1e1d-db56-4960-b6ff-e2f5f07d4aaa-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 11:45:30.839617 master-0 kubenswrapper[8993]: I1204 11:45:30.839604 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qz65b\" (UniqueName: \"kubernetes.io/projected/349b1e1d-db56-4960-b6ff-e2f5f07d4aaa-kube-api-access-qz65b\") on node \"master-0\" DevicePath \"\"" Dec 04 11:45:31.188731 master-0 kubenswrapper[8993]: I1204 11:45:31.188416 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-svhl4"] Dec 04 11:45:31.194851 master-0 kubenswrapper[8993]: W1204 11:45:31.194292 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf925fe60_b5b7_4a5a_9800_3546334da725.slice/crio-1f986c9fd7cca35aea4ff3881bdd60a51656018288bec2bb4cbd1618b75a974f WatchSource:0}: Error finding container 1f986c9fd7cca35aea4ff3881bdd60a51656018288bec2bb4cbd1618b75a974f: Status 404 returned error can't find the container with id 1f986c9fd7cca35aea4ff3881bdd60a51656018288bec2bb4cbd1618b75a974f Dec 04 11:45:31.493358 master-0 kubenswrapper[8993]: I1204 11:45:31.493068 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-krbbd" event={"ID":"349b1e1d-db56-4960-b6ff-e2f5f07d4aaa","Type":"ContainerDied","Data":"4b154ea5d1a65a00f9a58abb9bd66c22de4b2bf96d4f551828820cb8bf05f648"} Dec 04 11:45:31.493358 master-0 kubenswrapper[8993]: I1204 11:45:31.493148 8993 scope.go:117] "RemoveContainer" containerID="4890abf2d3f01658d86ae12259448cdd3826f537570b783848a6220e06481aa8" Dec 04 11:45:31.493358 master-0 kubenswrapper[8993]: I1204 11:45:31.493178 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-krbbd" Dec 04 11:45:31.495512 master-0 kubenswrapper[8993]: I1204 11:45:31.495470 8993 generic.go:334] "Generic (PLEG): container finished" podID="f925fe60-b5b7-4a5a-9800-3546334da725" containerID="df513947d42fcfc7e28c368c7b0fd21d796bd49821548340d2c09133a5199f62" exitCode=0 Dec 04 11:45:31.495585 master-0 kubenswrapper[8993]: I1204 11:45:31.495531 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-svhl4" event={"ID":"f925fe60-b5b7-4a5a-9800-3546334da725","Type":"ContainerDied","Data":"df513947d42fcfc7e28c368c7b0fd21d796bd49821548340d2c09133a5199f62"} Dec 04 11:45:31.495585 master-0 kubenswrapper[8993]: I1204 11:45:31.495570 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-svhl4" event={"ID":"f925fe60-b5b7-4a5a-9800-3546334da725","Type":"ContainerStarted","Data":"1f986c9fd7cca35aea4ff3881bdd60a51656018288bec2bb4cbd1618b75a974f"} Dec 04 11:45:31.511651 master-0 kubenswrapper[8993]: I1204 11:45:31.511594 8993 scope.go:117] "RemoveContainer" containerID="df46ed9cb416f80d99a93862b94cdddf077285002596e27aa33cd31815366ba5" Dec 04 11:45:31.544938 master-0 kubenswrapper[8993]: I1204 11:45:31.544869 8993 scope.go:117] "RemoveContainer" containerID="c29a5ac71e4cb432d40dfd2f98df48e6c19a408bcb1d6775f4fb6aa8804f1a0d" Dec 04 11:45:31.557896 master-0 kubenswrapper[8993]: I1204 11:45:31.557148 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-krbbd"] Dec 04 11:45:31.568936 master-0 kubenswrapper[8993]: I1204 11:45:31.568374 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-krbbd"] Dec 04 11:45:31.794948 master-0 kubenswrapper[8993]: I1204 11:45:31.794726 8993 scope.go:117] "RemoveContainer" containerID="c0669a25eca640b16ba8b2ecfd0f28795bd45ad2500d4e00f1ed214c5294a0cd" Dec 04 11:45:31.795287 master-0 kubenswrapper[8993]: E1204 11:45:31.795062 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-controller-manager pod=bootstrap-kube-controller-manager-master-0_kube-system(8b47694fcc32464ab24d09c23d6efb57)\"" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" Dec 04 11:45:31.803755 master-0 kubenswrapper[8993]: I1204 11:45:31.803678 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="349b1e1d-db56-4960-b6ff-e2f5f07d4aaa" path="/var/lib/kubelet/pods/349b1e1d-db56-4960-b6ff-e2f5f07d4aaa/volumes" Dec 04 11:45:32.506400 master-0 kubenswrapper[8993]: I1204 11:45:32.506336 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/3.log" Dec 04 11:45:32.507082 master-0 kubenswrapper[8993]: I1204 11:45:32.507042 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/2.log" Dec 04 11:45:32.507146 master-0 kubenswrapper[8993]: I1204 11:45:32.507111 8993 generic.go:334] "Generic (PLEG): container finished" podID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" containerID="83f6253eb08fd5330a71b18eaa18e87490f360d95e0ec3c32cf54a01fa26f615" exitCode=1 Dec 04 11:45:32.507266 master-0 kubenswrapper[8993]: I1204 11:45:32.507222 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" event={"ID":"38fc8086-a00c-4a2a-8a0e-c57e9d9d0103","Type":"ContainerDied","Data":"83f6253eb08fd5330a71b18eaa18e87490f360d95e0ec3c32cf54a01fa26f615"} Dec 04 11:45:32.507323 master-0 kubenswrapper[8993]: I1204 11:45:32.507303 8993 scope.go:117] "RemoveContainer" containerID="470ab1d7deaea833e2123e55c64ae492c4fd69592633e3def3e6d22b517c513f" Dec 04 11:45:32.508001 master-0 kubenswrapper[8993]: I1204 11:45:32.507970 8993 scope.go:117] "RemoveContainer" containerID="83f6253eb08fd5330a71b18eaa18e87490f360d95e0ec3c32cf54a01fa26f615" Dec 04 11:45:32.508242 master-0 kubenswrapper[8993]: E1204 11:45:32.508210 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:45:33.516978 master-0 kubenswrapper[8993]: I1204 11:45:33.516917 8993 generic.go:334] "Generic (PLEG): container finished" podID="f925fe60-b5b7-4a5a-9800-3546334da725" containerID="c2a6d218b69395e0dc6ee485bd5a6692aa5d9c907c1da87b18a5c7791ac08730" exitCode=0 Dec 04 11:45:33.517531 master-0 kubenswrapper[8993]: I1204 11:45:33.517022 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-svhl4" event={"ID":"f925fe60-b5b7-4a5a-9800-3546334da725","Type":"ContainerDied","Data":"c2a6d218b69395e0dc6ee485bd5a6692aa5d9c907c1da87b18a5c7791ac08730"} Dec 04 11:45:33.519753 master-0 kubenswrapper[8993]: I1204 11:45:33.519715 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/3.log" Dec 04 11:45:35.536417 master-0 kubenswrapper[8993]: I1204 11:45:35.536239 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-svhl4" event={"ID":"f925fe60-b5b7-4a5a-9800-3546334da725","Type":"ContainerStarted","Data":"cc2efca87595e5d94d1f3a7a7785e1ce6e3ba50c86083afa9187eb039b4b8470"} Dec 04 11:45:35.576130 master-0 kubenswrapper[8993]: I1204 11:45:35.576041 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-svhl4" podStartSLOduration=2.09661623 podStartE2EDuration="5.576022183s" podCreationTimestamp="2025-12-04 11:45:30 +0000 UTC" firstStartedPulling="2025-12-04 11:45:31.497776518 +0000 UTC m=+465.888717951" lastFinishedPulling="2025-12-04 11:45:34.977182471 +0000 UTC m=+469.368123904" observedRunningTime="2025-12-04 11:45:35.574309246 +0000 UTC m=+469.965250679" watchObservedRunningTime="2025-12-04 11:45:35.576022183 +0000 UTC m=+469.966963616" Dec 04 11:45:40.786314 master-0 kubenswrapper[8993]: I1204 11:45:40.786201 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:45:40.787109 master-0 kubenswrapper[8993]: I1204 11:45:40.786348 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:45:40.834826 master-0 kubenswrapper[8993]: I1204 11:45:40.834724 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:45:41.612175 master-0 kubenswrapper[8993]: I1204 11:45:41.612108 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:45:43.795126 master-0 kubenswrapper[8993]: I1204 11:45:43.795039 8993 scope.go:117] "RemoveContainer" containerID="c0669a25eca640b16ba8b2ecfd0f28795bd45ad2500d4e00f1ed214c5294a0cd" Dec 04 11:45:44.226057 master-0 kubenswrapper[8993]: I1204 11:45:44.225997 8993 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["kube-system/bootstrap-kube-controller-manager-master-0"] Dec 04 11:45:44.227987 master-0 kubenswrapper[8993]: I1204 11:45:44.227951 8993 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 11:45:44.228299 master-0 kubenswrapper[8993]: E1204 11:45:44.228274 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" Dec 04 11:45:44.228299 master-0 kubenswrapper[8993]: I1204 11:45:44.228296 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" Dec 04 11:45:44.228379 master-0 kubenswrapper[8993]: E1204 11:45:44.228308 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" Dec 04 11:45:44.228379 master-0 kubenswrapper[8993]: I1204 11:45:44.228317 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" Dec 04 11:45:44.228379 master-0 kubenswrapper[8993]: E1204 11:45:44.228329 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="cluster-policy-controller" Dec 04 11:45:44.228379 master-0 kubenswrapper[8993]: I1204 11:45:44.228338 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="cluster-policy-controller" Dec 04 11:45:44.228379 master-0 kubenswrapper[8993]: E1204 11:45:44.228349 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="cluster-policy-controller" Dec 04 11:45:44.228379 master-0 kubenswrapper[8993]: I1204 11:45:44.228356 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="cluster-policy-controller" Dec 04 11:45:44.228379 master-0 kubenswrapper[8993]: E1204 11:45:44.228373 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" Dec 04 11:45:44.228379 master-0 kubenswrapper[8993]: I1204 11:45:44.228383 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" Dec 04 11:45:44.228602 master-0 kubenswrapper[8993]: E1204 11:45:44.228405 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="349b1e1d-db56-4960-b6ff-e2f5f07d4aaa" containerName="extract-content" Dec 04 11:45:44.228602 master-0 kubenswrapper[8993]: I1204 11:45:44.228413 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="349b1e1d-db56-4960-b6ff-e2f5f07d4aaa" containerName="extract-content" Dec 04 11:45:44.228602 master-0 kubenswrapper[8993]: E1204 11:45:44.228428 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" Dec 04 11:45:44.228602 master-0 kubenswrapper[8993]: I1204 11:45:44.228437 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" Dec 04 11:45:44.228602 master-0 kubenswrapper[8993]: E1204 11:45:44.228445 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="349b1e1d-db56-4960-b6ff-e2f5f07d4aaa" containerName="registry-server" Dec 04 11:45:44.228602 master-0 kubenswrapper[8993]: I1204 11:45:44.228453 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="349b1e1d-db56-4960-b6ff-e2f5f07d4aaa" containerName="registry-server" Dec 04 11:45:44.228602 master-0 kubenswrapper[8993]: E1204 11:45:44.228473 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="349b1e1d-db56-4960-b6ff-e2f5f07d4aaa" containerName="extract-utilities" Dec 04 11:45:44.228602 master-0 kubenswrapper[8993]: I1204 11:45:44.228483 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="349b1e1d-db56-4960-b6ff-e2f5f07d4aaa" containerName="extract-utilities" Dec 04 11:45:44.228602 master-0 kubenswrapper[8993]: I1204 11:45:44.228601 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" Dec 04 11:45:44.229235 master-0 kubenswrapper[8993]: I1204 11:45:44.228615 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="cluster-policy-controller" Dec 04 11:45:44.229235 master-0 kubenswrapper[8993]: I1204 11:45:44.228628 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" Dec 04 11:45:44.229235 master-0 kubenswrapper[8993]: I1204 11:45:44.228639 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" Dec 04 11:45:44.229235 master-0 kubenswrapper[8993]: I1204 11:45:44.228684 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" Dec 04 11:45:44.229235 master-0 kubenswrapper[8993]: I1204 11:45:44.228704 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="cluster-policy-controller" Dec 04 11:45:44.229235 master-0 kubenswrapper[8993]: I1204 11:45:44.228715 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="349b1e1d-db56-4960-b6ff-e2f5f07d4aaa" containerName="registry-server" Dec 04 11:45:44.229235 master-0 kubenswrapper[8993]: E1204 11:45:44.228863 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" Dec 04 11:45:44.229235 master-0 kubenswrapper[8993]: I1204 11:45:44.228874 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" Dec 04 11:45:44.229235 master-0 kubenswrapper[8993]: E1204 11:45:44.228893 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" Dec 04 11:45:44.229235 master-0 kubenswrapper[8993]: I1204 11:45:44.228900 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" Dec 04 11:45:44.229235 master-0 kubenswrapper[8993]: I1204 11:45:44.229052 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" Dec 04 11:45:44.229235 master-0 kubenswrapper[8993]: I1204 11:45:44.229064 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" Dec 04 11:45:44.230070 master-0 kubenswrapper[8993]: I1204 11:45:44.230042 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:45:44.235538 master-0 kubenswrapper[8993]: I1204 11:45:44.235496 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/e6b437c60bb18680f4492b00b294e872-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"e6b437c60bb18680f4492b00b294e872\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:45:44.235620 master-0 kubenswrapper[8993]: I1204 11:45:44.235543 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/e6b437c60bb18680f4492b00b294e872-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"e6b437c60bb18680f4492b00b294e872\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:45:44.271687 master-0 kubenswrapper[8993]: I1204 11:45:44.271635 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 11:45:44.339697 master-0 kubenswrapper[8993]: I1204 11:45:44.339514 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/e6b437c60bb18680f4492b00b294e872-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"e6b437c60bb18680f4492b00b294e872\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:45:44.339697 master-0 kubenswrapper[8993]: I1204 11:45:44.339662 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/e6b437c60bb18680f4492b00b294e872-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"e6b437c60bb18680f4492b00b294e872\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:45:44.339998 master-0 kubenswrapper[8993]: I1204 11:45:44.339963 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/e6b437c60bb18680f4492b00b294e872-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"e6b437c60bb18680f4492b00b294e872\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:45:44.340093 master-0 kubenswrapper[8993]: I1204 11:45:44.340064 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/e6b437c60bb18680f4492b00b294e872-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"e6b437c60bb18680f4492b00b294e872\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:45:44.570569 master-0 kubenswrapper[8993]: I1204 11:45:44.570513 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:45:44.595887 master-0 kubenswrapper[8993]: I1204 11:45:44.595727 8993 generic.go:334] "Generic (PLEG): container finished" podID="38e7be62-e4f5-42ba-89f0-83aca874a092" containerID="5a3415efa00f234c75a3ef12f121cd45062cac0bc8779f480bd4cc3b20b6aea6" exitCode=0 Dec 04 11:45:44.595887 master-0 kubenswrapper[8993]: I1204 11:45:44.595824 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-2-master-0" event={"ID":"38e7be62-e4f5-42ba-89f0-83aca874a092","Type":"ContainerDied","Data":"5a3415efa00f234c75a3ef12f121cd45062cac0bc8779f480bd4cc3b20b6aea6"} Dec 04 11:45:44.600451 master-0 kubenswrapper[8993]: I1204 11:45:44.600359 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="cluster-policy-controller" containerID="cri-o://88e39a153093f8e114cb7d99b1715d4855f5b301a06532da1e8598576d2b5a0d" gracePeriod=30 Dec 04 11:45:44.600645 master-0 kubenswrapper[8993]: I1204 11:45:44.600402 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="8b47694fcc32464ab24d09c23d6efb57" containerName="kube-controller-manager" containerID="cri-o://4ff6dee660e0c3e8bcafff494b4715340832b97803c0a26ac5506e662b53b1ee" gracePeriod=30 Dec 04 11:45:44.609956 master-0 kubenswrapper[8993]: W1204 11:45:44.609895 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6b437c60bb18680f4492b00b294e872.slice/crio-c2e0a5f7188ebd1ad7d4edbad094215c2f60dd9e9a0830dce848050e834e809c WatchSource:0}: Error finding container c2e0a5f7188ebd1ad7d4edbad094215c2f60dd9e9a0830dce848050e834e809c: Status 404 returned error can't find the container with id c2e0a5f7188ebd1ad7d4edbad094215c2f60dd9e9a0830dce848050e834e809c Dec 04 11:45:44.774664 master-0 kubenswrapper[8993]: I1204 11:45:44.774564 8993 kubelet.go:2706] "Unable to find pod for mirror pod, skipping" mirrorPod="kube-system/bootstrap-kube-controller-manager-master-0" mirrorPodUID="e9e2da7c-7cca-4df6-b282-28df8e6134f8" Dec 04 11:45:44.827434 master-0 kubenswrapper[8993]: I1204 11:45:44.827383 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:45:44.877719 master-0 kubenswrapper[8993]: I1204 11:45:44.877633 8993 kubelet.go:2706] "Unable to find pod for mirror pod, skipping" mirrorPod="kube-system/bootstrap-kube-controller-manager-master-0" mirrorPodUID="e9e2da7c-7cca-4df6-b282-28df8e6134f8" Dec 04 11:45:44.947278 master-0 kubenswrapper[8993]: I1204 11:45:44.947221 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-secrets\") pod \"8b47694fcc32464ab24d09c23d6efb57\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " Dec 04 11:45:44.947278 master-0 kubenswrapper[8993]: I1204 11:45:44.947266 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-config\") pod \"8b47694fcc32464ab24d09c23d6efb57\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " Dec 04 11:45:44.947532 master-0 kubenswrapper[8993]: I1204 11:45:44.947343 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-logs\") pod \"8b47694fcc32464ab24d09c23d6efb57\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " Dec 04 11:45:44.947532 master-0 kubenswrapper[8993]: I1204 11:45:44.947365 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-etc-kubernetes-cloud\") pod \"8b47694fcc32464ab24d09c23d6efb57\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " Dec 04 11:45:44.947532 master-0 kubenswrapper[8993]: I1204 11:45:44.947407 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-secrets" (OuterVolumeSpecName: "secrets") pod "8b47694fcc32464ab24d09c23d6efb57" (UID: "8b47694fcc32464ab24d09c23d6efb57"). InnerVolumeSpecName "secrets". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:45:44.947532 master-0 kubenswrapper[8993]: I1204 11:45:44.947466 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-ssl-certs-host\") pod \"8b47694fcc32464ab24d09c23d6efb57\" (UID: \"8b47694fcc32464ab24d09c23d6efb57\") " Dec 04 11:45:44.947682 master-0 kubenswrapper[8993]: I1204 11:45:44.947522 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-etc-kubernetes-cloud" (OuterVolumeSpecName: "etc-kubernetes-cloud") pod "8b47694fcc32464ab24d09c23d6efb57" (UID: "8b47694fcc32464ab24d09c23d6efb57"). InnerVolumeSpecName "etc-kubernetes-cloud". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:45:44.947682 master-0 kubenswrapper[8993]: I1204 11:45:44.947522 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-config" (OuterVolumeSpecName: "config") pod "8b47694fcc32464ab24d09c23d6efb57" (UID: "8b47694fcc32464ab24d09c23d6efb57"). InnerVolumeSpecName "config". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:45:44.947682 master-0 kubenswrapper[8993]: I1204 11:45:44.947523 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-logs" (OuterVolumeSpecName: "logs") pod "8b47694fcc32464ab24d09c23d6efb57" (UID: "8b47694fcc32464ab24d09c23d6efb57"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:45:44.947682 master-0 kubenswrapper[8993]: I1204 11:45:44.947617 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-ssl-certs-host" (OuterVolumeSpecName: "ssl-certs-host") pod "8b47694fcc32464ab24d09c23d6efb57" (UID: "8b47694fcc32464ab24d09c23d6efb57"). InnerVolumeSpecName "ssl-certs-host". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:45:44.948439 master-0 kubenswrapper[8993]: I1204 11:45:44.948374 8993 reconciler_common.go:293] "Volume detached for volume \"ssl-certs-host\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-ssl-certs-host\") on node \"master-0\" DevicePath \"\"" Dec 04 11:45:44.948439 master-0 kubenswrapper[8993]: I1204 11:45:44.948436 8993 reconciler_common.go:293] "Volume detached for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-secrets\") on node \"master-0\" DevicePath \"\"" Dec 04 11:45:44.948524 master-0 kubenswrapper[8993]: I1204 11:45:44.948451 8993 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-config\") on node \"master-0\" DevicePath \"\"" Dec 04 11:45:44.948524 master-0 kubenswrapper[8993]: I1204 11:45:44.948462 8993 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 11:45:44.948524 master-0 kubenswrapper[8993]: I1204 11:45:44.948472 8993 reconciler_common.go:293] "Volume detached for volume \"etc-kubernetes-cloud\" (UniqueName: \"kubernetes.io/host-path/8b47694fcc32464ab24d09c23d6efb57-etc-kubernetes-cloud\") on node \"master-0\" DevicePath \"\"" Dec 04 11:45:45.611540 master-0 kubenswrapper[8993]: I1204 11:45:45.611464 8993 generic.go:334] "Generic (PLEG): container finished" podID="8b47694fcc32464ab24d09c23d6efb57" containerID="4ff6dee660e0c3e8bcafff494b4715340832b97803c0a26ac5506e662b53b1ee" exitCode=2 Dec 04 11:45:45.611540 master-0 kubenswrapper[8993]: I1204 11:45:45.611514 8993 generic.go:334] "Generic (PLEG): container finished" podID="8b47694fcc32464ab24d09c23d6efb57" containerID="88e39a153093f8e114cb7d99b1715d4855f5b301a06532da1e8598576d2b5a0d" exitCode=0 Dec 04 11:45:45.611829 master-0 kubenswrapper[8993]: I1204 11:45:45.611607 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kube-system/bootstrap-kube-controller-manager-master-0" Dec 04 11:45:45.611829 master-0 kubenswrapper[8993]: I1204 11:45:45.611640 8993 scope.go:117] "RemoveContainer" containerID="c0669a25eca640b16ba8b2ecfd0f28795bd45ad2500d4e00f1ed214c5294a0cd" Dec 04 11:45:45.611829 master-0 kubenswrapper[8993]: I1204 11:45:45.611606 8993 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="adbccd36bc5c65e5e88e6060aa8c07788d2d0acd9edee809c8e2d70678390332" Dec 04 11:45:45.632312 master-0 kubenswrapper[8993]: I1204 11:45:45.632229 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"11e29c5651a5425702af55ec3b8ee473df3972ab82e099ae3490c6b27969c94a"} Dec 04 11:45:45.632503 master-0 kubenswrapper[8993]: I1204 11:45:45.632326 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"e30c4f89d35ad5263f068564bf28a28f0a440fdebaf2e79af19479aa140713a6"} Dec 04 11:45:45.632503 master-0 kubenswrapper[8993]: I1204 11:45:45.632345 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"f78a7d287972772a3c979bede114291f869074b909122bce68dcbdb34f2d707c"} Dec 04 11:45:45.632503 master-0 kubenswrapper[8993]: I1204 11:45:45.632355 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"c2e0a5f7188ebd1ad7d4edbad094215c2f60dd9e9a0830dce848050e834e809c"} Dec 04 11:45:45.643657 master-0 kubenswrapper[8993]: I1204 11:45:45.643614 8993 scope.go:117] "RemoveContainer" containerID="a573a12b7e61507c596e1178d09644f02ee9de55d89553ed9fce32978b18dcf3" Dec 04 11:45:45.798053 master-0 kubenswrapper[8993]: I1204 11:45:45.797990 8993 scope.go:117] "RemoveContainer" containerID="83f6253eb08fd5330a71b18eaa18e87490f360d95e0ec3c32cf54a01fa26f615" Dec 04 11:45:45.798371 master-0 kubenswrapper[8993]: E1204 11:45:45.798266 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:45:45.804553 master-0 kubenswrapper[8993]: I1204 11:45:45.804472 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b47694fcc32464ab24d09c23d6efb57" path="/var/lib/kubelet/pods/8b47694fcc32464ab24d09c23d6efb57/volumes" Dec 04 11:45:45.805087 master-0 kubenswrapper[8993]: I1204 11:45:45.805046 8993 mirror_client.go:130] "Deleting a mirror pod" pod="kube-system/bootstrap-kube-controller-manager-master-0" podUID="" Dec 04 11:45:45.823567 master-0 kubenswrapper[8993]: I1204 11:45:45.823495 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["kube-system/bootstrap-kube-controller-manager-master-0"] Dec 04 11:45:45.823567 master-0 kubenswrapper[8993]: I1204 11:45:45.823542 8993 kubelet.go:2649] "Unable to find pod for mirror pod, skipping" mirrorPod="kube-system/bootstrap-kube-controller-manager-master-0" mirrorPodUID="e9e2da7c-7cca-4df6-b282-28df8e6134f8" Dec 04 11:45:45.830883 master-0 kubenswrapper[8993]: I1204 11:45:45.830761 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["kube-system/bootstrap-kube-controller-manager-master-0"] Dec 04 11:45:45.830883 master-0 kubenswrapper[8993]: I1204 11:45:45.830867 8993 kubelet.go:2673] "Unable to find pod for mirror pod, skipping" mirrorPod="kube-system/bootstrap-kube-controller-manager-master-0" mirrorPodUID="e9e2da7c-7cca-4df6-b282-28df8e6134f8" Dec 04 11:45:45.892587 master-0 kubenswrapper[8993]: I1204 11:45:45.892532 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:45:46.064990 master-0 kubenswrapper[8993]: I1204 11:45:46.064892 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/38e7be62-e4f5-42ba-89f0-83aca874a092-kube-api-access\") pod \"38e7be62-e4f5-42ba-89f0-83aca874a092\" (UID: \"38e7be62-e4f5-42ba-89f0-83aca874a092\") " Dec 04 11:45:46.065192 master-0 kubenswrapper[8993]: I1204 11:45:46.065082 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/38e7be62-e4f5-42ba-89f0-83aca874a092-kubelet-dir\") pod \"38e7be62-e4f5-42ba-89f0-83aca874a092\" (UID: \"38e7be62-e4f5-42ba-89f0-83aca874a092\") " Dec 04 11:45:46.065192 master-0 kubenswrapper[8993]: I1204 11:45:46.065130 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/38e7be62-e4f5-42ba-89f0-83aca874a092-var-lock\") pod \"38e7be62-e4f5-42ba-89f0-83aca874a092\" (UID: \"38e7be62-e4f5-42ba-89f0-83aca874a092\") " Dec 04 11:45:46.065274 master-0 kubenswrapper[8993]: I1204 11:45:46.065219 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/38e7be62-e4f5-42ba-89f0-83aca874a092-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "38e7be62-e4f5-42ba-89f0-83aca874a092" (UID: "38e7be62-e4f5-42ba-89f0-83aca874a092"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:45:46.065403 master-0 kubenswrapper[8993]: I1204 11:45:46.065338 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/38e7be62-e4f5-42ba-89f0-83aca874a092-var-lock" (OuterVolumeSpecName: "var-lock") pod "38e7be62-e4f5-42ba-89f0-83aca874a092" (UID: "38e7be62-e4f5-42ba-89f0-83aca874a092"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:45:46.065578 master-0 kubenswrapper[8993]: I1204 11:45:46.065540 8993 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/38e7be62-e4f5-42ba-89f0-83aca874a092-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:45:46.065578 master-0 kubenswrapper[8993]: I1204 11:45:46.065573 8993 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/38e7be62-e4f5-42ba-89f0-83aca874a092-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 11:45:46.068441 master-0 kubenswrapper[8993]: I1204 11:45:46.068401 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38e7be62-e4f5-42ba-89f0-83aca874a092-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "38e7be62-e4f5-42ba-89f0-83aca874a092" (UID: "38e7be62-e4f5-42ba-89f0-83aca874a092"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:45:46.166678 master-0 kubenswrapper[8993]: I1204 11:45:46.166595 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/38e7be62-e4f5-42ba-89f0-83aca874a092-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 11:45:46.640629 master-0 kubenswrapper[8993]: I1204 11:45:46.640494 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-2-master-0" event={"ID":"38e7be62-e4f5-42ba-89f0-83aca874a092","Type":"ContainerDied","Data":"6f6c1368ad9227af2c52859d3ca6113c4596b01abb133cabab18d8effbf3af73"} Dec 04 11:45:46.640629 master-0 kubenswrapper[8993]: I1204 11:45:46.640625 8993 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f6c1368ad9227af2c52859d3ca6113c4596b01abb133cabab18d8effbf3af73" Dec 04 11:45:46.640962 master-0 kubenswrapper[8993]: I1204 11:45:46.640720 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:45:46.644174 master-0 kubenswrapper[8993]: I1204 11:45:46.644117 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"a4300d8490d9cbb0f00793e382d3ed2318a1bd59a39a4b37b7e8bc4be83371b7"} Dec 04 11:45:46.689955 master-0 kubenswrapper[8993]: I1204 11:45:46.689797 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podStartSLOduration=2.689774675 podStartE2EDuration="2.689774675s" podCreationTimestamp="2025-12-04 11:45:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:45:46.687823302 +0000 UTC m=+481.078764745" watchObservedRunningTime="2025-12-04 11:45:46.689774675 +0000 UTC m=+481.080716108" Dec 04 11:45:49.669162 master-0 kubenswrapper[8993]: I1204 11:45:49.669055 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-autoscaler-operator-5f49d774cd-894dk_e7fc7c16-5bca-49e5-aff0-7a8f80c6b639/cluster-autoscaler-operator/1.log" Dec 04 11:45:49.670504 master-0 kubenswrapper[8993]: I1204 11:45:49.669715 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-autoscaler-operator-5f49d774cd-894dk_e7fc7c16-5bca-49e5-aff0-7a8f80c6b639/cluster-autoscaler-operator/0.log" Dec 04 11:45:49.670504 master-0 kubenswrapper[8993]: I1204 11:45:49.670254 8993 generic.go:334] "Generic (PLEG): container finished" podID="e7fc7c16-5bca-49e5-aff0-7a8f80c6b639" containerID="4d95860537918a04cf76c6b27375da7f45face6b265a8eec014e0a60e0abd873" exitCode=255 Dec 04 11:45:49.670504 master-0 kubenswrapper[8993]: I1204 11:45:49.670308 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" event={"ID":"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639","Type":"ContainerDied","Data":"4d95860537918a04cf76c6b27375da7f45face6b265a8eec014e0a60e0abd873"} Dec 04 11:45:49.670504 master-0 kubenswrapper[8993]: I1204 11:45:49.670387 8993 scope.go:117] "RemoveContainer" containerID="aaf8e0a82bd40fc3c589ed457817ceadfe679e3e1748948884223dddb5917051" Dec 04 11:45:49.671142 master-0 kubenswrapper[8993]: I1204 11:45:49.671083 8993 scope.go:117] "RemoveContainer" containerID="4d95860537918a04cf76c6b27375da7f45face6b265a8eec014e0a60e0abd873" Dec 04 11:45:49.671392 master-0 kubenswrapper[8993]: E1204 11:45:49.671336 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-autoscaler-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cluster-autoscaler-operator pod=cluster-autoscaler-operator-5f49d774cd-894dk_openshift-machine-api(e7fc7c16-5bca-49e5-aff0-7a8f80c6b639)\"" pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" podUID="e7fc7c16-5bca-49e5-aff0-7a8f80c6b639" Dec 04 11:45:50.679497 master-0 kubenswrapper[8993]: I1204 11:45:50.679403 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-autoscaler-operator-5f49d774cd-894dk_e7fc7c16-5bca-49e5-aff0-7a8f80c6b639/cluster-autoscaler-operator/1.log" Dec 04 11:45:52.511487 master-0 kubenswrapper[8993]: I1204 11:45:52.511427 8993 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["kube-system/bootstrap-kube-scheduler-master-0"] Dec 04 11:45:52.512016 master-0 kubenswrapper[8993]: I1204 11:45:52.511683 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="kube-system/bootstrap-kube-scheduler-master-0" podUID="5e09e2af7200e6f9be469dbfd9bb1127" containerName="kube-scheduler" containerID="cri-o://9260d10a9ce4831a4fadd13bf96406e1fd7010c72540b33131aee4c3a133c938" gracePeriod=30 Dec 04 11:45:52.514010 master-0 kubenswrapper[8993]: I1204 11:45:52.513873 8993 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-scheduler/openshift-kube-scheduler-master-0"] Dec 04 11:45:52.514431 master-0 kubenswrapper[8993]: E1204 11:45:52.514359 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5e09e2af7200e6f9be469dbfd9bb1127" containerName="kube-scheduler" Dec 04 11:45:52.514431 master-0 kubenswrapper[8993]: I1204 11:45:52.514409 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e09e2af7200e6f9be469dbfd9bb1127" containerName="kube-scheduler" Dec 04 11:45:52.514619 master-0 kubenswrapper[8993]: E1204 11:45:52.514453 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="38e7be62-e4f5-42ba-89f0-83aca874a092" containerName="installer" Dec 04 11:45:52.514619 master-0 kubenswrapper[8993]: I1204 11:45:52.514469 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="38e7be62-e4f5-42ba-89f0-83aca874a092" containerName="installer" Dec 04 11:45:52.514992 master-0 kubenswrapper[8993]: I1204 11:45:52.514672 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="38e7be62-e4f5-42ba-89f0-83aca874a092" containerName="installer" Dec 04 11:45:52.514992 master-0 kubenswrapper[8993]: I1204 11:45:52.514954 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="5e09e2af7200e6f9be469dbfd9bb1127" containerName="kube-scheduler" Dec 04 11:45:52.515119 master-0 kubenswrapper[8993]: I1204 11:45:52.514999 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="5e09e2af7200e6f9be469dbfd9bb1127" containerName="kube-scheduler" Dec 04 11:45:52.515273 master-0 kubenswrapper[8993]: E1204 11:45:52.515213 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5e09e2af7200e6f9be469dbfd9bb1127" containerName="kube-scheduler" Dec 04 11:45:52.515273 master-0 kubenswrapper[8993]: I1204 11:45:52.515243 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e09e2af7200e6f9be469dbfd9bb1127" containerName="kube-scheduler" Dec 04 11:45:52.517562 master-0 kubenswrapper[8993]: I1204 11:45:52.517362 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 11:45:52.553727 master-0 kubenswrapper[8993]: I1204 11:45:52.553621 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/bdd20c68f1ccfd1240fb273af0638d01-cert-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"bdd20c68f1ccfd1240fb273af0638d01\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 11:45:52.553727 master-0 kubenswrapper[8993]: I1204 11:45:52.553739 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/bdd20c68f1ccfd1240fb273af0638d01-resource-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"bdd20c68f1ccfd1240fb273af0638d01\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 11:45:52.555955 master-0 kubenswrapper[8993]: I1204 11:45:52.555896 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler/openshift-kube-scheduler-master-0"] Dec 04 11:45:52.654708 master-0 kubenswrapper[8993]: I1204 11:45:52.654589 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/bdd20c68f1ccfd1240fb273af0638d01-resource-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"bdd20c68f1ccfd1240fb273af0638d01\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 11:45:52.654708 master-0 kubenswrapper[8993]: I1204 11:45:52.654668 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/bdd20c68f1ccfd1240fb273af0638d01-cert-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"bdd20c68f1ccfd1240fb273af0638d01\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 11:45:52.654708 master-0 kubenswrapper[8993]: I1204 11:45:52.654701 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/bdd20c68f1ccfd1240fb273af0638d01-resource-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"bdd20c68f1ccfd1240fb273af0638d01\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 11:45:52.654708 master-0 kubenswrapper[8993]: I1204 11:45:52.654728 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/bdd20c68f1ccfd1240fb273af0638d01-cert-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"bdd20c68f1ccfd1240fb273af0638d01\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 11:45:52.695567 master-0 kubenswrapper[8993]: I1204 11:45:52.695418 8993 generic.go:334] "Generic (PLEG): container finished" podID="5e09e2af7200e6f9be469dbfd9bb1127" containerID="9260d10a9ce4831a4fadd13bf96406e1fd7010c72540b33131aee4c3a133c938" exitCode=0 Dec 04 11:45:52.695567 master-0 kubenswrapper[8993]: I1204 11:45:52.695517 8993 scope.go:117] "RemoveContainer" containerID="28bd405676e81717d938eefd29fce0475230f84557116212e1a3920f34143d20" Dec 04 11:45:52.853311 master-0 kubenswrapper[8993]: I1204 11:45:52.853147 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 11:45:52.926536 master-0 kubenswrapper[8993]: I1204 11:45:52.926192 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 11:45:52.960149 master-0 kubenswrapper[8993]: I1204 11:45:52.960078 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/5e09e2af7200e6f9be469dbfd9bb1127-secrets\") pod \"5e09e2af7200e6f9be469dbfd9bb1127\" (UID: \"5e09e2af7200e6f9be469dbfd9bb1127\") " Dec 04 11:45:52.962643 master-0 kubenswrapper[8993]: I1204 11:45:52.960175 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/5e09e2af7200e6f9be469dbfd9bb1127-logs\") pod \"5e09e2af7200e6f9be469dbfd9bb1127\" (UID: \"5e09e2af7200e6f9be469dbfd9bb1127\") " Dec 04 11:45:52.962643 master-0 kubenswrapper[8993]: I1204 11:45:52.960216 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/5e09e2af7200e6f9be469dbfd9bb1127-secrets" (OuterVolumeSpecName: "secrets") pod "5e09e2af7200e6f9be469dbfd9bb1127" (UID: "5e09e2af7200e6f9be469dbfd9bb1127"). InnerVolumeSpecName "secrets". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:45:52.962643 master-0 kubenswrapper[8993]: I1204 11:45:52.960280 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/5e09e2af7200e6f9be469dbfd9bb1127-logs" (OuterVolumeSpecName: "logs") pod "5e09e2af7200e6f9be469dbfd9bb1127" (UID: "5e09e2af7200e6f9be469dbfd9bb1127"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:45:52.962643 master-0 kubenswrapper[8993]: I1204 11:45:52.960648 8993 reconciler_common.go:293] "Volume detached for volume \"secrets\" (UniqueName: \"kubernetes.io/host-path/5e09e2af7200e6f9be469dbfd9bb1127-secrets\") on node \"master-0\" DevicePath \"\"" Dec 04 11:45:53.063294 master-0 kubenswrapper[8993]: I1204 11:45:53.061694 8993 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/host-path/5e09e2af7200e6f9be469dbfd9bb1127-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 11:45:53.071914 master-0 kubenswrapper[8993]: I1204 11:45:53.065180 8993 kubelet.go:2706] "Unable to find pod for mirror pod, skipping" mirrorPod="kube-system/bootstrap-kube-scheduler-master-0" mirrorPodUID="08e44d03-9168-41c6-b30e-ecb05c6152d0" Dec 04 11:45:53.705316 master-0 kubenswrapper[8993]: I1204 11:45:53.705149 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kube-system/bootstrap-kube-scheduler-master-0" Dec 04 11:45:53.705316 master-0 kubenswrapper[8993]: I1204 11:45:53.705216 8993 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6080c82a1de6439e859491a681111c8d2ae9907c581f1c30e651428ab5f16038" Dec 04 11:45:53.707387 master-0 kubenswrapper[8993]: I1204 11:45:53.707330 8993 generic.go:334] "Generic (PLEG): container finished" podID="780ea907-dec5-426e-9de2-158f59c09f71" containerID="8e2bcd64158b0463f9bafc73ea2efd8e5f7562257e1c40b5ab47bc4fcd4b79db" exitCode=0 Dec 04 11:45:53.707492 master-0 kubenswrapper[8993]: I1204 11:45:53.707434 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-4-master-0" event={"ID":"780ea907-dec5-426e-9de2-158f59c09f71","Type":"ContainerDied","Data":"8e2bcd64158b0463f9bafc73ea2efd8e5f7562257e1c40b5ab47bc4fcd4b79db"} Dec 04 11:45:53.710795 master-0 kubenswrapper[8993]: I1204 11:45:53.710692 8993 generic.go:334] "Generic (PLEG): container finished" podID="bdd20c68f1ccfd1240fb273af0638d01" containerID="f22a84f6fb348e29fba57d1a09fc02c20059513a38fe36937800076d569de9eb" exitCode=0 Dec 04 11:45:53.710894 master-0 kubenswrapper[8993]: I1204 11:45:53.710795 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"bdd20c68f1ccfd1240fb273af0638d01","Type":"ContainerDied","Data":"f22a84f6fb348e29fba57d1a09fc02c20059513a38fe36937800076d569de9eb"} Dec 04 11:45:53.710894 master-0 kubenswrapper[8993]: I1204 11:45:53.710855 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"bdd20c68f1ccfd1240fb273af0638d01","Type":"ContainerStarted","Data":"5a1b18048a411d2d744b17951526af70eccaa227a92df3b43814bef05c92e2a1"} Dec 04 11:45:53.801267 master-0 kubenswrapper[8993]: I1204 11:45:53.801214 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e09e2af7200e6f9be469dbfd9bb1127" path="/var/lib/kubelet/pods/5e09e2af7200e6f9be469dbfd9bb1127/volumes" Dec 04 11:45:53.801554 master-0 kubenswrapper[8993]: I1204 11:45:53.801534 8993 mirror_client.go:130] "Deleting a mirror pod" pod="kube-system/bootstrap-kube-scheduler-master-0" podUID="" Dec 04 11:45:54.056401 master-0 kubenswrapper[8993]: I1204 11:45:54.056334 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["kube-system/bootstrap-kube-scheduler-master-0"] Dec 04 11:45:54.056401 master-0 kubenswrapper[8993]: I1204 11:45:54.056392 8993 kubelet.go:2649] "Unable to find pod for mirror pod, skipping" mirrorPod="kube-system/bootstrap-kube-scheduler-master-0" mirrorPodUID="08e44d03-9168-41c6-b30e-ecb05c6152d0" Dec 04 11:45:54.065165 master-0 kubenswrapper[8993]: I1204 11:45:54.065110 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["kube-system/bootstrap-kube-scheduler-master-0"] Dec 04 11:45:54.065165 master-0 kubenswrapper[8993]: I1204 11:45:54.065162 8993 kubelet.go:2673] "Unable to find pod for mirror pod, skipping" mirrorPod="kube-system/bootstrap-kube-scheduler-master-0" mirrorPodUID="08e44d03-9168-41c6-b30e-ecb05c6152d0" Dec 04 11:45:54.571618 master-0 kubenswrapper[8993]: I1204 11:45:54.571553 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:45:54.571618 master-0 kubenswrapper[8993]: I1204 11:45:54.571619 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:45:54.571757 master-0 kubenswrapper[8993]: I1204 11:45:54.571632 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:45:54.572178 master-0 kubenswrapper[8993]: I1204 11:45:54.572115 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:45:54.576338 master-0 kubenswrapper[8993]: I1204 11:45:54.576297 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:45:54.721651 master-0 kubenswrapper[8993]: I1204 11:45:54.721552 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"bdd20c68f1ccfd1240fb273af0638d01","Type":"ContainerStarted","Data":"1dd3e9bec426604298540a62160aa04995ba35e82eac44c41bf666b47786e5c9"} Dec 04 11:45:54.721651 master-0 kubenswrapper[8993]: I1204 11:45:54.721650 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"bdd20c68f1ccfd1240fb273af0638d01","Type":"ContainerStarted","Data":"83e55c475e3dc5500479af8907cda3d13a24a31c8ee5c2278bdd8d400f5e7292"} Dec 04 11:45:54.721651 master-0 kubenswrapper[8993]: I1204 11:45:54.721673 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"bdd20c68f1ccfd1240fb273af0638d01","Type":"ContainerStarted","Data":"e892e4a03cb775cc984461c05f66ebb315e6e3256740bfe4765f9efa5a82a35d"} Dec 04 11:45:54.727012 master-0 kubenswrapper[8993]: I1204 11:45:54.726970 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:45:55.038495 master-0 kubenswrapper[8993]: I1204 11:45:55.038418 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:45:55.197742 master-0 kubenswrapper[8993]: I1204 11:45:55.197662 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/780ea907-dec5-426e-9de2-158f59c09f71-kubelet-dir\") pod \"780ea907-dec5-426e-9de2-158f59c09f71\" (UID: \"780ea907-dec5-426e-9de2-158f59c09f71\") " Dec 04 11:45:55.197742 master-0 kubenswrapper[8993]: I1204 11:45:55.197731 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/780ea907-dec5-426e-9de2-158f59c09f71-kube-api-access\") pod \"780ea907-dec5-426e-9de2-158f59c09f71\" (UID: \"780ea907-dec5-426e-9de2-158f59c09f71\") " Dec 04 11:45:55.198052 master-0 kubenswrapper[8993]: I1204 11:45:55.197795 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/780ea907-dec5-426e-9de2-158f59c09f71-var-lock\") pod \"780ea907-dec5-426e-9de2-158f59c09f71\" (UID: \"780ea907-dec5-426e-9de2-158f59c09f71\") " Dec 04 11:45:55.198052 master-0 kubenswrapper[8993]: I1204 11:45:55.197799 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/780ea907-dec5-426e-9de2-158f59c09f71-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "780ea907-dec5-426e-9de2-158f59c09f71" (UID: "780ea907-dec5-426e-9de2-158f59c09f71"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:45:55.198225 master-0 kubenswrapper[8993]: I1204 11:45:55.198198 8993 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/780ea907-dec5-426e-9de2-158f59c09f71-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:45:55.198305 master-0 kubenswrapper[8993]: I1204 11:45:55.198218 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/780ea907-dec5-426e-9de2-158f59c09f71-var-lock" (OuterVolumeSpecName: "var-lock") pod "780ea907-dec5-426e-9de2-158f59c09f71" (UID: "780ea907-dec5-426e-9de2-158f59c09f71"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:45:55.200728 master-0 kubenswrapper[8993]: I1204 11:45:55.200634 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/780ea907-dec5-426e-9de2-158f59c09f71-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "780ea907-dec5-426e-9de2-158f59c09f71" (UID: "780ea907-dec5-426e-9de2-158f59c09f71"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:45:55.300089 master-0 kubenswrapper[8993]: I1204 11:45:55.299907 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/780ea907-dec5-426e-9de2-158f59c09f71-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 11:45:55.300089 master-0 kubenswrapper[8993]: I1204 11:45:55.299961 8993 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/780ea907-dec5-426e-9de2-158f59c09f71-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 11:45:55.728677 master-0 kubenswrapper[8993]: I1204 11:45:55.728622 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-4-master-0" event={"ID":"780ea907-dec5-426e-9de2-158f59c09f71","Type":"ContainerDied","Data":"8f4cb521a519dffc9145fbbff972ea7e9fae270d474192cc7dc2e095425a0edd"} Dec 04 11:45:55.729305 master-0 kubenswrapper[8993]: I1204 11:45:55.729283 8993 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f4cb521a519dffc9145fbbff972ea7e9fae270d474192cc7dc2e095425a0edd" Dec 04 11:45:55.729407 master-0 kubenswrapper[8993]: I1204 11:45:55.729392 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 11:45:55.729525 master-0 kubenswrapper[8993]: I1204 11:45:55.728711 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:45:57.572680 master-0 kubenswrapper[8993]: I1204 11:45:57.572524 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:45:57.573400 master-0 kubenswrapper[8993]: I1204 11:45:57.572693 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:45:59.794405 master-0 kubenswrapper[8993]: I1204 11:45:59.794330 8993 scope.go:117] "RemoveContainer" containerID="83f6253eb08fd5330a71b18eaa18e87490f360d95e0ec3c32cf54a01fa26f615" Dec 04 11:45:59.794954 master-0 kubenswrapper[8993]: E1204 11:45:59.794607 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:46:03.796039 master-0 kubenswrapper[8993]: I1204 11:46:03.795122 8993 scope.go:117] "RemoveContainer" containerID="4d95860537918a04cf76c6b27375da7f45face6b265a8eec014e0a60e0abd873" Dec 04 11:46:04.201708 master-0 kubenswrapper[8993]: I1204 11:46:04.200215 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" podStartSLOduration=12.200193208 podStartE2EDuration="12.200193208s" podCreationTimestamp="2025-12-04 11:45:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:45:55.80263656 +0000 UTC m=+490.193578003" watchObservedRunningTime="2025-12-04 11:46:04.200193208 +0000 UTC m=+498.591134661" Dec 04 11:46:04.804018 master-0 kubenswrapper[8993]: I1204 11:46:04.803953 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-autoscaler-operator-5f49d774cd-894dk_e7fc7c16-5bca-49e5-aff0-7a8f80c6b639/cluster-autoscaler-operator/1.log" Dec 04 11:46:04.804696 master-0 kubenswrapper[8993]: I1204 11:46:04.804622 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" event={"ID":"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639","Type":"ContainerStarted","Data":"f06d1731c63d1c3b95fb1ded6be8b346f6f343eb1c39fb1931d998db924768a0"} Dec 04 11:46:07.571773 master-0 kubenswrapper[8993]: I1204 11:46:07.571708 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:46:07.572373 master-0 kubenswrapper[8993]: I1204 11:46:07.572341 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:46:14.794931 master-0 kubenswrapper[8993]: I1204 11:46:14.794862 8993 scope.go:117] "RemoveContainer" containerID="83f6253eb08fd5330a71b18eaa18e87490f360d95e0ec3c32cf54a01fa26f615" Dec 04 11:46:15.509654 master-0 kubenswrapper[8993]: I1204 11:46:15.509561 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": read tcp 127.0.0.1:57002->127.0.0.1:10357: read: connection reset by peer" start-of-body= Dec 04 11:46:15.510023 master-0 kubenswrapper[8993]: I1204 11:46:15.509674 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": read tcp 127.0.0.1:57002->127.0.0.1:10357: read: connection reset by peer" Dec 04 11:46:15.510023 master-0 kubenswrapper[8993]: I1204 11:46:15.509744 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:46:15.511023 master-0 kubenswrapper[8993]: I1204 11:46:15.510690 8993 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="cluster-policy-controller" containerStatusID={"Type":"cri-o","ID":"e30c4f89d35ad5263f068564bf28a28f0a440fdebaf2e79af19479aa140713a6"} pod="openshift-kube-controller-manager/kube-controller-manager-master-0" containerMessage="Container cluster-policy-controller failed startup probe, will be restarted" Dec 04 11:46:15.511023 master-0 kubenswrapper[8993]: I1204 11:46:15.510788 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" containerID="cri-o://e30c4f89d35ad5263f068564bf28a28f0a440fdebaf2e79af19479aa140713a6" gracePeriod=30 Dec 04 11:46:15.875931 master-0 kubenswrapper[8993]: I1204 11:46:15.875864 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/3.log" Dec 04 11:46:15.876498 master-0 kubenswrapper[8993]: I1204 11:46:15.875966 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" event={"ID":"38fc8086-a00c-4a2a-8a0e-c57e9d9d0103","Type":"ContainerStarted","Data":"111212ae304e7d5562b925c64b167a8bb0864329ef48752767ee9569f220fa38"} Dec 04 11:46:15.883207 master-0 kubenswrapper[8993]: I1204 11:46:15.883157 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/0.log" Dec 04 11:46:15.883515 master-0 kubenswrapper[8993]: I1204 11:46:15.883472 8993 generic.go:334] "Generic (PLEG): container finished" podID="e6b437c60bb18680f4492b00b294e872" containerID="e30c4f89d35ad5263f068564bf28a28f0a440fdebaf2e79af19479aa140713a6" exitCode=255 Dec 04 11:46:15.883572 master-0 kubenswrapper[8993]: I1204 11:46:15.883510 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerDied","Data":"e30c4f89d35ad5263f068564bf28a28f0a440fdebaf2e79af19479aa140713a6"} Dec 04 11:46:15.883572 master-0 kubenswrapper[8993]: I1204 11:46:15.883549 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"56919140478a65747356284cd22e3152f6b26f273198c564f14b1607f69dd216"} Dec 04 11:46:21.807118 master-0 kubenswrapper[8993]: I1204 11:46:21.806987 8993 scope.go:117] "RemoveContainer" containerID="9260d10a9ce4831a4fadd13bf96406e1fd7010c72540b33131aee4c3a133c938" Dec 04 11:46:24.571663 master-0 kubenswrapper[8993]: I1204 11:46:24.571538 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:46:24.572318 master-0 kubenswrapper[8993]: I1204 11:46:24.571742 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:46:27.571790 master-0 kubenswrapper[8993]: I1204 11:46:27.571631 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:46:27.571790 master-0 kubenswrapper[8993]: I1204 11:46:27.571776 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:46:37.572323 master-0 kubenswrapper[8993]: I1204 11:46:37.572199 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:46:37.573315 master-0 kubenswrapper[8993]: I1204 11:46:37.572332 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:46:42.861300 master-0 kubenswrapper[8993]: I1204 11:46:42.861149 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 11:46:46.091852 master-0 kubenswrapper[8993]: I1204 11:46:46.091759 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": read tcp 127.0.0.1:36998->127.0.0.1:10357: read: connection reset by peer" start-of-body= Dec 04 11:46:46.092449 master-0 kubenswrapper[8993]: I1204 11:46:46.091891 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": read tcp 127.0.0.1:36998->127.0.0.1:10357: read: connection reset by peer" Dec 04 11:46:46.092449 master-0 kubenswrapper[8993]: I1204 11:46:46.091964 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:46:46.093318 master-0 kubenswrapper[8993]: I1204 11:46:46.092703 8993 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="cluster-policy-controller" containerStatusID={"Type":"cri-o","ID":"56919140478a65747356284cd22e3152f6b26f273198c564f14b1607f69dd216"} pod="openshift-kube-controller-manager/kube-controller-manager-master-0" containerMessage="Container cluster-policy-controller failed startup probe, will be restarted" Dec 04 11:46:46.093318 master-0 kubenswrapper[8993]: I1204 11:46:46.092798 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" containerID="cri-o://56919140478a65747356284cd22e3152f6b26f273198c564f14b1607f69dd216" gracePeriod=30 Dec 04 11:46:47.099221 master-0 kubenswrapper[8993]: I1204 11:46:47.099165 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/1.log" Dec 04 11:46:47.101332 master-0 kubenswrapper[8993]: I1204 11:46:47.101311 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/0.log" Dec 04 11:46:47.102342 master-0 kubenswrapper[8993]: I1204 11:46:47.102264 8993 generic.go:334] "Generic (PLEG): container finished" podID="e6b437c60bb18680f4492b00b294e872" containerID="56919140478a65747356284cd22e3152f6b26f273198c564f14b1607f69dd216" exitCode=255 Dec 04 11:46:47.102342 master-0 kubenswrapper[8993]: I1204 11:46:47.102325 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerDied","Data":"56919140478a65747356284cd22e3152f6b26f273198c564f14b1607f69dd216"} Dec 04 11:46:47.102492 master-0 kubenswrapper[8993]: I1204 11:46:47.102358 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"52d72e6599a6d84d8f528ef96ffea838d8bb8a07b80e06f1985aaab8c7993dca"} Dec 04 11:46:47.102492 master-0 kubenswrapper[8993]: I1204 11:46:47.102380 8993 scope.go:117] "RemoveContainer" containerID="e30c4f89d35ad5263f068564bf28a28f0a440fdebaf2e79af19479aa140713a6" Dec 04 11:46:48.112760 master-0 kubenswrapper[8993]: I1204 11:46:48.112689 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/1.log" Dec 04 11:46:54.571708 master-0 kubenswrapper[8993]: I1204 11:46:54.571563 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:46:54.571708 master-0 kubenswrapper[8993]: I1204 11:46:54.571635 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:46:57.572449 master-0 kubenswrapper[8993]: I1204 11:46:57.572351 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:46:57.573157 master-0 kubenswrapper[8993]: I1204 11:46:57.572457 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:47:07.572530 master-0 kubenswrapper[8993]: I1204 11:47:07.572396 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": context deadline exceeded" start-of-body= Dec 04 11:47:07.573368 master-0 kubenswrapper[8993]: I1204 11:47:07.572550 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": context deadline exceeded" Dec 04 11:47:16.695972 master-0 kubenswrapper[8993]: I1204 11:47:16.695877 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": read tcp 127.0.0.1:55798->127.0.0.1:10357: read: connection reset by peer" start-of-body= Dec 04 11:47:16.696538 master-0 kubenswrapper[8993]: I1204 11:47:16.696018 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": read tcp 127.0.0.1:55798->127.0.0.1:10357: read: connection reset by peer" Dec 04 11:47:16.696538 master-0 kubenswrapper[8993]: I1204 11:47:16.696119 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:47:16.697653 master-0 kubenswrapper[8993]: I1204 11:47:16.697260 8993 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="cluster-policy-controller" containerStatusID={"Type":"cri-o","ID":"52d72e6599a6d84d8f528ef96ffea838d8bb8a07b80e06f1985aaab8c7993dca"} pod="openshift-kube-controller-manager/kube-controller-manager-master-0" containerMessage="Container cluster-policy-controller failed startup probe, will be restarted" Dec 04 11:47:16.697653 master-0 kubenswrapper[8993]: I1204 11:47:16.697397 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" containerID="cri-o://52d72e6599a6d84d8f528ef96ffea838d8bb8a07b80e06f1985aaab8c7993dca" gracePeriod=30 Dec 04 11:47:17.315433 master-0 kubenswrapper[8993]: I1204 11:47:17.315308 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/2.log" Dec 04 11:47:17.315904 master-0 kubenswrapper[8993]: I1204 11:47:17.315875 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/1.log" Dec 04 11:47:17.317176 master-0 kubenswrapper[8993]: I1204 11:47:17.317078 8993 generic.go:334] "Generic (PLEG): container finished" podID="e6b437c60bb18680f4492b00b294e872" containerID="52d72e6599a6d84d8f528ef96ffea838d8bb8a07b80e06f1985aaab8c7993dca" exitCode=255 Dec 04 11:47:17.317176 master-0 kubenswrapper[8993]: I1204 11:47:17.317143 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerDied","Data":"52d72e6599a6d84d8f528ef96ffea838d8bb8a07b80e06f1985aaab8c7993dca"} Dec 04 11:47:17.317176 master-0 kubenswrapper[8993]: I1204 11:47:17.317192 8993 scope.go:117] "RemoveContainer" containerID="56919140478a65747356284cd22e3152f6b26f273198c564f14b1607f69dd216" Dec 04 11:47:18.326609 master-0 kubenswrapper[8993]: I1204 11:47:18.326549 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/2.log" Dec 04 11:47:18.328095 master-0 kubenswrapper[8993]: I1204 11:47:18.328057 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"b3a2a0e973083f9cd822145c484e3da586ef3a855b2d812a9fc84ce3e943a2e3"} Dec 04 11:47:24.571615 master-0 kubenswrapper[8993]: I1204 11:47:24.571507 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:47:24.572429 master-0 kubenswrapper[8993]: I1204 11:47:24.571789 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:47:25.380489 master-0 kubenswrapper[8993]: I1204 11:47:25.380411 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/2.log" Dec 04 11:47:25.381175 master-0 kubenswrapper[8993]: I1204 11:47:25.381130 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/1.log" Dec 04 11:47:25.381547 master-0 kubenswrapper[8993]: I1204 11:47:25.381511 8993 generic.go:334] "Generic (PLEG): container finished" podID="b011b1f1-3235-4e20-825b-ce711c052407" containerID="8eac3c76c85aa13d87ba20dccfb5f290a5bb846720ceb909d474ed9c1de8d4a1" exitCode=1 Dec 04 11:47:25.381633 master-0 kubenswrapper[8993]: I1204 11:47:25.381595 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" event={"ID":"b011b1f1-3235-4e20-825b-ce711c052407","Type":"ContainerDied","Data":"8eac3c76c85aa13d87ba20dccfb5f290a5bb846720ceb909d474ed9c1de8d4a1"} Dec 04 11:47:25.381686 master-0 kubenswrapper[8993]: I1204 11:47:25.381663 8993 scope.go:117] "RemoveContainer" containerID="1d2b175fde83364b4666d8066712242360f76256f651e330ae881c16c680384c" Dec 04 11:47:25.382610 master-0 kubenswrapper[8993]: I1204 11:47:25.382583 8993 scope.go:117] "RemoveContainer" containerID="8eac3c76c85aa13d87ba20dccfb5f290a5bb846720ceb909d474ed9c1de8d4a1" Dec 04 11:47:25.382899 master-0 kubenswrapper[8993]: E1204 11:47:25.382867 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=ingress-operator pod=ingress-operator-8649c48786-cx2b2_openshift-ingress-operator(b011b1f1-3235-4e20-825b-ce711c052407)\"" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" podUID="b011b1f1-3235-4e20-825b-ce711c052407" Dec 04 11:47:26.390854 master-0 kubenswrapper[8993]: I1204 11:47:26.390646 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/2.log" Dec 04 11:47:27.572302 master-0 kubenswrapper[8993]: I1204 11:47:27.572217 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:47:27.572945 master-0 kubenswrapper[8993]: I1204 11:47:27.572324 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:47:37.571383 master-0 kubenswrapper[8993]: I1204 11:47:37.571269 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:47:37.572180 master-0 kubenswrapper[8993]: I1204 11:47:37.571412 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:47:38.794393 master-0 kubenswrapper[8993]: I1204 11:47:38.794301 8993 scope.go:117] "RemoveContainer" containerID="8eac3c76c85aa13d87ba20dccfb5f290a5bb846720ceb909d474ed9c1de8d4a1" Dec 04 11:47:38.795017 master-0 kubenswrapper[8993]: E1204 11:47:38.794623 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=ingress-operator pod=ingress-operator-8649c48786-cx2b2_openshift-ingress-operator(b011b1f1-3235-4e20-825b-ce711c052407)\"" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" podUID="b011b1f1-3235-4e20-825b-ce711c052407" Dec 04 11:47:47.571981 master-0 kubenswrapper[8993]: I1204 11:47:47.571901 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:47:47.572641 master-0 kubenswrapper[8993]: I1204 11:47:47.572005 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:47:47.572641 master-0 kubenswrapper[8993]: I1204 11:47:47.572067 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:47:47.572787 master-0 kubenswrapper[8993]: I1204 11:47:47.572724 8993 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="cluster-policy-controller" containerStatusID={"Type":"cri-o","ID":"b3a2a0e973083f9cd822145c484e3da586ef3a855b2d812a9fc84ce3e943a2e3"} pod="openshift-kube-controller-manager/kube-controller-manager-master-0" containerMessage="Container cluster-policy-controller failed startup probe, will be restarted" Dec 04 11:47:47.572891 master-0 kubenswrapper[8993]: I1204 11:47:47.572870 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" containerID="cri-o://b3a2a0e973083f9cd822145c484e3da586ef3a855b2d812a9fc84ce3e943a2e3" gracePeriod=30 Dec 04 11:47:48.533403 master-0 kubenswrapper[8993]: I1204 11:47:48.533304 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/3.log" Dec 04 11:47:48.534405 master-0 kubenswrapper[8993]: I1204 11:47:48.534345 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/2.log" Dec 04 11:47:48.535979 master-0 kubenswrapper[8993]: I1204 11:47:48.535915 8993 generic.go:334] "Generic (PLEG): container finished" podID="e6b437c60bb18680f4492b00b294e872" containerID="b3a2a0e973083f9cd822145c484e3da586ef3a855b2d812a9fc84ce3e943a2e3" exitCode=255 Dec 04 11:47:48.536062 master-0 kubenswrapper[8993]: I1204 11:47:48.535980 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerDied","Data":"b3a2a0e973083f9cd822145c484e3da586ef3a855b2d812a9fc84ce3e943a2e3"} Dec 04 11:47:48.536062 master-0 kubenswrapper[8993]: I1204 11:47:48.536043 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"d61369e5e89ed783cc29ee7980417a93fb67e9ce7d6ee475e015128f006c5afb"} Dec 04 11:47:48.536160 master-0 kubenswrapper[8993]: I1204 11:47:48.536068 8993 scope.go:117] "RemoveContainer" containerID="52d72e6599a6d84d8f528ef96ffea838d8bb8a07b80e06f1985aaab8c7993dca" Dec 04 11:47:49.555669 master-0 kubenswrapper[8993]: I1204 11:47:49.555595 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/3.log" Dec 04 11:47:52.793659 master-0 kubenswrapper[8993]: I1204 11:47:52.793595 8993 scope.go:117] "RemoveContainer" containerID="8eac3c76c85aa13d87ba20dccfb5f290a5bb846720ceb909d474ed9c1de8d4a1" Dec 04 11:47:53.580967 master-0 kubenswrapper[8993]: I1204 11:47:53.580788 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/2.log" Dec 04 11:47:53.581413 master-0 kubenswrapper[8993]: I1204 11:47:53.581192 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" event={"ID":"b011b1f1-3235-4e20-825b-ce711c052407","Type":"ContainerStarted","Data":"b1b01aacbe726c1a48bdae3716b824c6fb7d8a51508f9d95ea11272ad0522b94"} Dec 04 11:47:54.571037 master-0 kubenswrapper[8993]: I1204 11:47:54.570921 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:47:54.571779 master-0 kubenswrapper[8993]: I1204 11:47:54.571073 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:47:57.571558 master-0 kubenswrapper[8993]: I1204 11:47:57.571402 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:47:57.571558 master-0 kubenswrapper[8993]: I1204 11:47:57.571540 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:48:07.572085 master-0 kubenswrapper[8993]: I1204 11:48:07.571978 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:48:07.572085 master-0 kubenswrapper[8993]: I1204 11:48:07.572081 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:48:17.571065 master-0 kubenswrapper[8993]: I1204 11:48:17.570950 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:48:17.571065 master-0 kubenswrapper[8993]: I1204 11:48:17.571067 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:48:17.571693 master-0 kubenswrapper[8993]: I1204 11:48:17.571165 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:48:17.572078 master-0 kubenswrapper[8993]: I1204 11:48:17.572036 8993 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="cluster-policy-controller" containerStatusID={"Type":"cri-o","ID":"d61369e5e89ed783cc29ee7980417a93fb67e9ce7d6ee475e015128f006c5afb"} pod="openshift-kube-controller-manager/kube-controller-manager-master-0" containerMessage="Container cluster-policy-controller failed startup probe, will be restarted" Dec 04 11:48:17.572198 master-0 kubenswrapper[8993]: I1204 11:48:17.572162 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" containerID="cri-o://d61369e5e89ed783cc29ee7980417a93fb67e9ce7d6ee475e015128f006c5afb" gracePeriod=30 Dec 04 11:48:17.689735 master-0 kubenswrapper[8993]: E1204 11:48:17.689677 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:48:17.754113 master-0 kubenswrapper[8993]: I1204 11:48:17.754024 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/4.log" Dec 04 11:48:17.754727 master-0 kubenswrapper[8993]: I1204 11:48:17.754670 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/3.log" Dec 04 11:48:17.756412 master-0 kubenswrapper[8993]: I1204 11:48:17.756354 8993 generic.go:334] "Generic (PLEG): container finished" podID="e6b437c60bb18680f4492b00b294e872" containerID="d61369e5e89ed783cc29ee7980417a93fb67e9ce7d6ee475e015128f006c5afb" exitCode=255 Dec 04 11:48:17.756512 master-0 kubenswrapper[8993]: I1204 11:48:17.756416 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerDied","Data":"d61369e5e89ed783cc29ee7980417a93fb67e9ce7d6ee475e015128f006c5afb"} Dec 04 11:48:17.756512 master-0 kubenswrapper[8993]: I1204 11:48:17.756472 8993 scope.go:117] "RemoveContainer" containerID="b3a2a0e973083f9cd822145c484e3da586ef3a855b2d812a9fc84ce3e943a2e3" Dec 04 11:48:17.757443 master-0 kubenswrapper[8993]: I1204 11:48:17.757398 8993 scope.go:117] "RemoveContainer" containerID="d61369e5e89ed783cc29ee7980417a93fb67e9ce7d6ee475e015128f006c5afb" Dec 04 11:48:17.757758 master-0 kubenswrapper[8993]: E1204 11:48:17.757712 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:48:18.765241 master-0 kubenswrapper[8993]: I1204 11:48:18.765173 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/4.log" Dec 04 11:48:24.571107 master-0 kubenswrapper[8993]: I1204 11:48:24.571011 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:48:24.571956 master-0 kubenswrapper[8993]: I1204 11:48:24.571926 8993 scope.go:117] "RemoveContainer" containerID="d61369e5e89ed783cc29ee7980417a93fb67e9ce7d6ee475e015128f006c5afb" Dec 04 11:48:24.572217 master-0 kubenswrapper[8993]: E1204 11:48:24.572186 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:48:35.797867 master-0 kubenswrapper[8993]: I1204 11:48:35.797776 8993 scope.go:117] "RemoveContainer" containerID="d61369e5e89ed783cc29ee7980417a93fb67e9ce7d6ee475e015128f006c5afb" Dec 04 11:48:35.798531 master-0 kubenswrapper[8993]: E1204 11:48:35.798058 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:48:49.795229 master-0 kubenswrapper[8993]: I1204 11:48:49.795130 8993 scope.go:117] "RemoveContainer" containerID="d61369e5e89ed783cc29ee7980417a93fb67e9ce7d6ee475e015128f006c5afb" Dec 04 11:48:49.796610 master-0 kubenswrapper[8993]: E1204 11:48:49.795463 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:49:02.794839 master-0 kubenswrapper[8993]: I1204 11:49:02.794756 8993 scope.go:117] "RemoveContainer" containerID="d61369e5e89ed783cc29ee7980417a93fb67e9ce7d6ee475e015128f006c5afb" Dec 04 11:49:03.052047 master-0 kubenswrapper[8993]: I1204 11:49:03.051926 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/4.log" Dec 04 11:49:03.053437 master-0 kubenswrapper[8993]: I1204 11:49:03.053387 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"460d7f059ee8ee4626a535f82e61c3712a9cf7f763c5ff20c19a344581f3b8eb"} Dec 04 11:49:04.572050 master-0 kubenswrapper[8993]: I1204 11:49:04.571912 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:49:04.572050 master-0 kubenswrapper[8993]: I1204 11:49:04.572033 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:49:07.572828 master-0 kubenswrapper[8993]: I1204 11:49:07.572730 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:49:07.573462 master-0 kubenswrapper[8993]: I1204 11:49:07.572847 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:49:17.572219 master-0 kubenswrapper[8993]: I1204 11:49:17.572124 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:49:17.572219 master-0 kubenswrapper[8993]: I1204 11:49:17.572225 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:49:27.571273 master-0 kubenswrapper[8993]: I1204 11:49:27.571204 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:49:27.571925 master-0 kubenswrapper[8993]: I1204 11:49:27.571892 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:49:27.572061 master-0 kubenswrapper[8993]: I1204 11:49:27.572049 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:49:27.572900 master-0 kubenswrapper[8993]: I1204 11:49:27.572879 8993 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="cluster-policy-controller" containerStatusID={"Type":"cri-o","ID":"460d7f059ee8ee4626a535f82e61c3712a9cf7f763c5ff20c19a344581f3b8eb"} pod="openshift-kube-controller-manager/kube-controller-manager-master-0" containerMessage="Container cluster-policy-controller failed startup probe, will be restarted" Dec 04 11:49:27.573058 master-0 kubenswrapper[8993]: I1204 11:49:27.573041 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" containerID="cri-o://460d7f059ee8ee4626a535f82e61c3712a9cf7f763c5ff20c19a344581f3b8eb" gracePeriod=30 Dec 04 11:49:27.694855 master-0 kubenswrapper[8993]: E1204 11:49:27.694785 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:49:28.210279 master-0 kubenswrapper[8993]: I1204 11:49:28.210214 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/5.log" Dec 04 11:49:28.211131 master-0 kubenswrapper[8993]: I1204 11:49:28.211078 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/4.log" Dec 04 11:49:28.212574 master-0 kubenswrapper[8993]: I1204 11:49:28.212517 8993 generic.go:334] "Generic (PLEG): container finished" podID="e6b437c60bb18680f4492b00b294e872" containerID="460d7f059ee8ee4626a535f82e61c3712a9cf7f763c5ff20c19a344581f3b8eb" exitCode=255 Dec 04 11:49:28.212664 master-0 kubenswrapper[8993]: I1204 11:49:28.212576 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerDied","Data":"460d7f059ee8ee4626a535f82e61c3712a9cf7f763c5ff20c19a344581f3b8eb"} Dec 04 11:49:28.212664 master-0 kubenswrapper[8993]: I1204 11:49:28.212638 8993 scope.go:117] "RemoveContainer" containerID="d61369e5e89ed783cc29ee7980417a93fb67e9ce7d6ee475e015128f006c5afb" Dec 04 11:49:28.214450 master-0 kubenswrapper[8993]: I1204 11:49:28.213299 8993 scope.go:117] "RemoveContainer" containerID="460d7f059ee8ee4626a535f82e61c3712a9cf7f763c5ff20c19a344581f3b8eb" Dec 04 11:49:28.214450 master-0 kubenswrapper[8993]: E1204 11:49:28.213613 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:49:29.222215 master-0 kubenswrapper[8993]: I1204 11:49:29.222180 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/5.log" Dec 04 11:49:34.571747 master-0 kubenswrapper[8993]: I1204 11:49:34.571618 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:49:34.572933 master-0 kubenswrapper[8993]: I1204 11:49:34.572892 8993 scope.go:117] "RemoveContainer" containerID="460d7f059ee8ee4626a535f82e61c3712a9cf7f763c5ff20c19a344581f3b8eb" Dec 04 11:49:34.573301 master-0 kubenswrapper[8993]: E1204 11:49:34.573253 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:49:47.794393 master-0 kubenswrapper[8993]: I1204 11:49:47.794307 8993 scope.go:117] "RemoveContainer" containerID="460d7f059ee8ee4626a535f82e61c3712a9cf7f763c5ff20c19a344581f3b8eb" Dec 04 11:49:47.795318 master-0 kubenswrapper[8993]: E1204 11:49:47.794587 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:49:54.443458 master-0 kubenswrapper[8993]: I1204 11:49:54.443399 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/3.log" Dec 04 11:49:54.444371 master-0 kubenswrapper[8993]: I1204 11:49:54.444340 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/2.log" Dec 04 11:49:54.444929 master-0 kubenswrapper[8993]: I1204 11:49:54.444881 8993 generic.go:334] "Generic (PLEG): container finished" podID="b011b1f1-3235-4e20-825b-ce711c052407" containerID="b1b01aacbe726c1a48bdae3716b824c6fb7d8a51508f9d95ea11272ad0522b94" exitCode=1 Dec 04 11:49:54.445002 master-0 kubenswrapper[8993]: I1204 11:49:54.444938 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" event={"ID":"b011b1f1-3235-4e20-825b-ce711c052407","Type":"ContainerDied","Data":"b1b01aacbe726c1a48bdae3716b824c6fb7d8a51508f9d95ea11272ad0522b94"} Dec 04 11:49:54.445041 master-0 kubenswrapper[8993]: I1204 11:49:54.445010 8993 scope.go:117] "RemoveContainer" containerID="8eac3c76c85aa13d87ba20dccfb5f290a5bb846720ceb909d474ed9c1de8d4a1" Dec 04 11:49:54.447223 master-0 kubenswrapper[8993]: I1204 11:49:54.447171 8993 scope.go:117] "RemoveContainer" containerID="b1b01aacbe726c1a48bdae3716b824c6fb7d8a51508f9d95ea11272ad0522b94" Dec 04 11:49:54.447556 master-0 kubenswrapper[8993]: E1204 11:49:54.447522 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 40s restarting failed container=ingress-operator pod=ingress-operator-8649c48786-cx2b2_openshift-ingress-operator(b011b1f1-3235-4e20-825b-ce711c052407)\"" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" podUID="b011b1f1-3235-4e20-825b-ce711c052407" Dec 04 11:49:55.452894 master-0 kubenswrapper[8993]: I1204 11:49:55.452831 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/3.log" Dec 04 11:50:01.794385 master-0 kubenswrapper[8993]: I1204 11:50:01.794304 8993 scope.go:117] "RemoveContainer" containerID="460d7f059ee8ee4626a535f82e61c3712a9cf7f763c5ff20c19a344581f3b8eb" Dec 04 11:50:01.795179 master-0 kubenswrapper[8993]: E1204 11:50:01.794789 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:50:05.793853 master-0 kubenswrapper[8993]: I1204 11:50:05.793771 8993 scope.go:117] "RemoveContainer" containerID="b1b01aacbe726c1a48bdae3716b824c6fb7d8a51508f9d95ea11272ad0522b94" Dec 04 11:50:05.794523 master-0 kubenswrapper[8993]: E1204 11:50:05.794110 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 40s restarting failed container=ingress-operator pod=ingress-operator-8649c48786-cx2b2_openshift-ingress-operator(b011b1f1-3235-4e20-825b-ce711c052407)\"" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" podUID="b011b1f1-3235-4e20-825b-ce711c052407" Dec 04 11:50:13.794539 master-0 kubenswrapper[8993]: I1204 11:50:13.794452 8993 scope.go:117] "RemoveContainer" containerID="460d7f059ee8ee4626a535f82e61c3712a9cf7f763c5ff20c19a344581f3b8eb" Dec 04 11:50:13.795304 master-0 kubenswrapper[8993]: E1204 11:50:13.794750 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:50:18.794259 master-0 kubenswrapper[8993]: I1204 11:50:18.794219 8993 scope.go:117] "RemoveContainer" containerID="b1b01aacbe726c1a48bdae3716b824c6fb7d8a51508f9d95ea11272ad0522b94" Dec 04 11:50:18.794798 master-0 kubenswrapper[8993]: E1204 11:50:18.794400 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 40s restarting failed container=ingress-operator pod=ingress-operator-8649c48786-cx2b2_openshift-ingress-operator(b011b1f1-3235-4e20-825b-ce711c052407)\"" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" podUID="b011b1f1-3235-4e20-825b-ce711c052407" Dec 04 11:50:21.880408 master-0 kubenswrapper[8993]: I1204 11:50:21.880329 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd/installer-2-master-0"] Dec 04 11:50:21.881068 master-0 kubenswrapper[8993]: E1204 11:50:21.880644 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="780ea907-dec5-426e-9de2-158f59c09f71" containerName="installer" Dec 04 11:50:21.881068 master-0 kubenswrapper[8993]: I1204 11:50:21.880661 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="780ea907-dec5-426e-9de2-158f59c09f71" containerName="installer" Dec 04 11:50:21.881068 master-0 kubenswrapper[8993]: I1204 11:50:21.880772 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="780ea907-dec5-426e-9de2-158f59c09f71" containerName="installer" Dec 04 11:50:21.881280 master-0 kubenswrapper[8993]: I1204 11:50:21.881255 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-2-master-0" Dec 04 11:50:21.883520 master-0 kubenswrapper[8993]: I1204 11:50:21.883457 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd"/"kube-root-ca.crt" Dec 04 11:50:21.883718 master-0 kubenswrapper[8993]: I1204 11:50:21.883684 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd"/"installer-sa-dockercfg-gxq4x" Dec 04 11:50:21.894015 master-0 kubenswrapper[8993]: I1204 11:50:21.893978 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd/installer-2-master-0"] Dec 04 11:50:21.975965 master-0 kubenswrapper[8993]: I1204 11:50:21.975882 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/c6335f99-eb41-4b1d-93df-4a24f0ce23bc-var-lock\") pod \"installer-2-master-0\" (UID: \"c6335f99-eb41-4b1d-93df-4a24f0ce23bc\") " pod="openshift-etcd/installer-2-master-0" Dec 04 11:50:21.976655 master-0 kubenswrapper[8993]: I1204 11:50:21.976620 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/c6335f99-eb41-4b1d-93df-4a24f0ce23bc-kube-api-access\") pod \"installer-2-master-0\" (UID: \"c6335f99-eb41-4b1d-93df-4a24f0ce23bc\") " pod="openshift-etcd/installer-2-master-0" Dec 04 11:50:21.977149 master-0 kubenswrapper[8993]: I1204 11:50:21.977110 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6335f99-eb41-4b1d-93df-4a24f0ce23bc-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"c6335f99-eb41-4b1d-93df-4a24f0ce23bc\") " pod="openshift-etcd/installer-2-master-0" Dec 04 11:50:22.078716 master-0 kubenswrapper[8993]: I1204 11:50:22.078648 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6335f99-eb41-4b1d-93df-4a24f0ce23bc-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"c6335f99-eb41-4b1d-93df-4a24f0ce23bc\") " pod="openshift-etcd/installer-2-master-0" Dec 04 11:50:22.079257 master-0 kubenswrapper[8993]: I1204 11:50:22.078778 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6335f99-eb41-4b1d-93df-4a24f0ce23bc-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"c6335f99-eb41-4b1d-93df-4a24f0ce23bc\") " pod="openshift-etcd/installer-2-master-0" Dec 04 11:50:22.079257 master-0 kubenswrapper[8993]: I1204 11:50:22.078859 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/c6335f99-eb41-4b1d-93df-4a24f0ce23bc-var-lock\") pod \"installer-2-master-0\" (UID: \"c6335f99-eb41-4b1d-93df-4a24f0ce23bc\") " pod="openshift-etcd/installer-2-master-0" Dec 04 11:50:22.079257 master-0 kubenswrapper[8993]: I1204 11:50:22.078901 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/c6335f99-eb41-4b1d-93df-4a24f0ce23bc-kube-api-access\") pod \"installer-2-master-0\" (UID: \"c6335f99-eb41-4b1d-93df-4a24f0ce23bc\") " pod="openshift-etcd/installer-2-master-0" Dec 04 11:50:22.079257 master-0 kubenswrapper[8993]: I1204 11:50:22.079116 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/c6335f99-eb41-4b1d-93df-4a24f0ce23bc-var-lock\") pod \"installer-2-master-0\" (UID: \"c6335f99-eb41-4b1d-93df-4a24f0ce23bc\") " pod="openshift-etcd/installer-2-master-0" Dec 04 11:50:22.095069 master-0 kubenswrapper[8993]: I1204 11:50:22.094999 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/c6335f99-eb41-4b1d-93df-4a24f0ce23bc-kube-api-access\") pod \"installer-2-master-0\" (UID: \"c6335f99-eb41-4b1d-93df-4a24f0ce23bc\") " pod="openshift-etcd/installer-2-master-0" Dec 04 11:50:22.203565 master-0 kubenswrapper[8993]: I1204 11:50:22.203411 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-2-master-0" Dec 04 11:50:22.609485 master-0 kubenswrapper[8993]: I1204 11:50:22.609336 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd/installer-2-master-0"] Dec 04 11:50:22.617130 master-0 kubenswrapper[8993]: W1204 11:50:22.617057 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc6335f99_eb41_4b1d_93df_4a24f0ce23bc.slice/crio-e526280d34ec437bd97a8b63aabde2fa2c77527089e55d85797209e690ed274b WatchSource:0}: Error finding container e526280d34ec437bd97a8b63aabde2fa2c77527089e55d85797209e690ed274b: Status 404 returned error can't find the container with id e526280d34ec437bd97a8b63aabde2fa2c77527089e55d85797209e690ed274b Dec 04 11:50:22.630945 master-0 kubenswrapper[8993]: I1204 11:50:22.630835 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-2-master-0" event={"ID":"c6335f99-eb41-4b1d-93df-4a24f0ce23bc","Type":"ContainerStarted","Data":"e526280d34ec437bd97a8b63aabde2fa2c77527089e55d85797209e690ed274b"} Dec 04 11:50:23.638377 master-0 kubenswrapper[8993]: I1204 11:50:23.638268 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-2-master-0" event={"ID":"c6335f99-eb41-4b1d-93df-4a24f0ce23bc","Type":"ContainerStarted","Data":"66b953a48576619ad5ef1fc4d68b6166f875d5145d22f93448f049810d8b1236"} Dec 04 11:50:23.661923 master-0 kubenswrapper[8993]: I1204 11:50:23.661548 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd/installer-2-master-0" podStartSLOduration=2.661528743 podStartE2EDuration="2.661528743s" podCreationTimestamp="2025-12-04 11:50:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:50:23.658316023 +0000 UTC m=+758.049257466" watchObservedRunningTime="2025-12-04 11:50:23.661528743 +0000 UTC m=+758.052470176" Dec 04 11:50:24.683622 master-0 kubenswrapper[8993]: I1204 11:50:24.683503 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/installer-3-master-0"] Dec 04 11:50:24.684511 master-0 kubenswrapper[8993]: I1204 11:50:24.684475 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 11:50:24.686614 master-0 kubenswrapper[8993]: I1204 11:50:24.686571 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager"/"kube-root-ca.crt" Dec 04 11:50:24.687774 master-0 kubenswrapper[8993]: I1204 11:50:24.687744 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager"/"installer-sa-dockercfg-vn92f" Dec 04 11:50:24.696730 master-0 kubenswrapper[8993]: I1204 11:50:24.696670 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-3-master-0"] Dec 04 11:50:24.814017 master-0 kubenswrapper[8993]: I1204 11:50:24.813924 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/27c4e782-11b4-43a3-9ffd-34bf4e40bbc4-var-lock\") pod \"installer-3-master-0\" (UID: \"27c4e782-11b4-43a3-9ffd-34bf4e40bbc4\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 11:50:24.814017 master-0 kubenswrapper[8993]: I1204 11:50:24.814020 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/27c4e782-11b4-43a3-9ffd-34bf4e40bbc4-kube-api-access\") pod \"installer-3-master-0\" (UID: \"27c4e782-11b4-43a3-9ffd-34bf4e40bbc4\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 11:50:24.814385 master-0 kubenswrapper[8993]: I1204 11:50:24.814135 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27c4e782-11b4-43a3-9ffd-34bf4e40bbc4-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"27c4e782-11b4-43a3-9ffd-34bf4e40bbc4\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 11:50:24.915741 master-0 kubenswrapper[8993]: I1204 11:50:24.915636 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/27c4e782-11b4-43a3-9ffd-34bf4e40bbc4-var-lock\") pod \"installer-3-master-0\" (UID: \"27c4e782-11b4-43a3-9ffd-34bf4e40bbc4\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 11:50:24.916019 master-0 kubenswrapper[8993]: I1204 11:50:24.915789 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/27c4e782-11b4-43a3-9ffd-34bf4e40bbc4-var-lock\") pod \"installer-3-master-0\" (UID: \"27c4e782-11b4-43a3-9ffd-34bf4e40bbc4\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 11:50:24.916472 master-0 kubenswrapper[8993]: I1204 11:50:24.916413 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/27c4e782-11b4-43a3-9ffd-34bf4e40bbc4-kube-api-access\") pod \"installer-3-master-0\" (UID: \"27c4e782-11b4-43a3-9ffd-34bf4e40bbc4\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 11:50:24.917181 master-0 kubenswrapper[8993]: I1204 11:50:24.916480 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27c4e782-11b4-43a3-9ffd-34bf4e40bbc4-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"27c4e782-11b4-43a3-9ffd-34bf4e40bbc4\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 11:50:24.917181 master-0 kubenswrapper[8993]: I1204 11:50:24.916859 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27c4e782-11b4-43a3-9ffd-34bf4e40bbc4-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"27c4e782-11b4-43a3-9ffd-34bf4e40bbc4\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 11:50:24.934845 master-0 kubenswrapper[8993]: I1204 11:50:24.934663 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/27c4e782-11b4-43a3-9ffd-34bf4e40bbc4-kube-api-access\") pod \"installer-3-master-0\" (UID: \"27c4e782-11b4-43a3-9ffd-34bf4e40bbc4\") " pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 11:50:25.004434 master-0 kubenswrapper[8993]: I1204 11:50:25.004341 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 11:50:25.411998 master-0 kubenswrapper[8993]: I1204 11:50:25.411920 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-3-master-0"] Dec 04 11:50:25.422839 master-0 kubenswrapper[8993]: W1204 11:50:25.422482 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod27c4e782_11b4_43a3_9ffd_34bf4e40bbc4.slice/crio-f10cd46382bef7256c0fac8a54a8e2e84ada2a13006e11bf8f929bfbffd0d8f6 WatchSource:0}: Error finding container f10cd46382bef7256c0fac8a54a8e2e84ada2a13006e11bf8f929bfbffd0d8f6: Status 404 returned error can't find the container with id f10cd46382bef7256c0fac8a54a8e2e84ada2a13006e11bf8f929bfbffd0d8f6 Dec 04 11:50:25.652378 master-0 kubenswrapper[8993]: I1204 11:50:25.652291 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-3-master-0" event={"ID":"27c4e782-11b4-43a3-9ffd-34bf4e40bbc4","Type":"ContainerStarted","Data":"f10cd46382bef7256c0fac8a54a8e2e84ada2a13006e11bf8f929bfbffd0d8f6"} Dec 04 11:50:26.660596 master-0 kubenswrapper[8993]: I1204 11:50:26.660508 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-3-master-0" event={"ID":"27c4e782-11b4-43a3-9ffd-34bf4e40bbc4","Type":"ContainerStarted","Data":"b78e17b7306f7adda3e6d7075255514653aaae6ce42d92ca0bc99707e1589503"} Dec 04 11:50:26.690713 master-0 kubenswrapper[8993]: I1204 11:50:26.690615 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/installer-3-master-0" podStartSLOduration=2.690591197 podStartE2EDuration="2.690591197s" podCreationTimestamp="2025-12-04 11:50:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:50:26.689381141 +0000 UTC m=+761.080322594" watchObservedRunningTime="2025-12-04 11:50:26.690591197 +0000 UTC m=+761.081532630" Dec 04 11:50:28.794567 master-0 kubenswrapper[8993]: I1204 11:50:28.794459 8993 scope.go:117] "RemoveContainer" containerID="460d7f059ee8ee4626a535f82e61c3712a9cf7f763c5ff20c19a344581f3b8eb" Dec 04 11:50:28.795470 master-0 kubenswrapper[8993]: E1204 11:50:28.794835 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:50:29.793782 master-0 kubenswrapper[8993]: I1204 11:50:29.793699 8993 scope.go:117] "RemoveContainer" containerID="b1b01aacbe726c1a48bdae3716b824c6fb7d8a51508f9d95ea11272ad0522b94" Dec 04 11:50:29.794026 master-0 kubenswrapper[8993]: E1204 11:50:29.793976 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 40s restarting failed container=ingress-operator pod=ingress-operator-8649c48786-cx2b2_openshift-ingress-operator(b011b1f1-3235-4e20-825b-ce711c052407)\"" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" podUID="b011b1f1-3235-4e20-825b-ce711c052407" Dec 04 11:50:42.793976 master-0 kubenswrapper[8993]: I1204 11:50:42.793913 8993 scope.go:117] "RemoveContainer" containerID="b1b01aacbe726c1a48bdae3716b824c6fb7d8a51508f9d95ea11272ad0522b94" Dec 04 11:50:43.779633 master-0 kubenswrapper[8993]: I1204 11:50:43.779582 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/3.log" Dec 04 11:50:43.780715 master-0 kubenswrapper[8993]: I1204 11:50:43.780661 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" event={"ID":"b011b1f1-3235-4e20-825b-ce711c052407","Type":"ContainerStarted","Data":"871a505c71fcc987e64230846e4890828086e506f1b1d8a3456559bac6ecba8e"} Dec 04 11:50:43.795467 master-0 kubenswrapper[8993]: I1204 11:50:43.795370 8993 scope.go:117] "RemoveContainer" containerID="460d7f059ee8ee4626a535f82e61c3712a9cf7f763c5ff20c19a344581f3b8eb" Dec 04 11:50:43.796239 master-0 kubenswrapper[8993]: E1204 11:50:43.795745 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:50:53.899487 master-0 kubenswrapper[8993]: E1204 11:50:53.899395 8993 file.go:109] "Unable to process watch event" err="can't process config file \"/etc/kubernetes/manifests/etcd-pod.yaml\": /etc/kubernetes/manifests/etcd-pod.yaml: couldn't parse as pod(Object 'Kind' is missing in 'null'), please check config file" Dec 04 11:50:53.900498 master-0 kubenswrapper[8993]: I1204 11:50:53.899486 8993 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-etcd/etcd-master-0"] Dec 04 11:50:53.900498 master-0 kubenswrapper[8993]: I1204 11:50:53.900084 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-etcd/etcd-master-0" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcdctl" containerID="cri-o://33f85176404395dbaf1cfdb77d7cfa2b94036a1d9cca44a7d3462ef387eb7691" gracePeriod=30 Dec 04 11:50:53.900498 master-0 kubenswrapper[8993]: I1204 11:50:53.900185 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-etcd/etcd-master-0" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcd-rev" containerID="cri-o://eb58bcb651b87ccd2e45033c9114cc61c10ad998bb008845b3973e82a145bb2c" gracePeriod=30 Dec 04 11:50:53.900498 master-0 kubenswrapper[8993]: I1204 11:50:53.900324 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-etcd/etcd-master-0" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcd" containerID="cri-o://82403cfe9ce30e64366d586bd3d4971dd579fb9deb2bccf711ab036c03a0fbed" gracePeriod=30 Dec 04 11:50:53.900498 master-0 kubenswrapper[8993]: I1204 11:50:53.900192 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-etcd/etcd-master-0" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcd-metrics" containerID="cri-o://523e8ed8e33638d0ea4ff55875cbc5c0f5dd8aa2e781f8660e98dcc61870abcd" gracePeriod=30 Dec 04 11:50:53.900769 master-0 kubenswrapper[8993]: I1204 11:50:53.900322 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-etcd/etcd-master-0" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcd-readyz" containerID="cri-o://8b81f63230ddbea8d6c3b6ea050a2360f845a5d55e81ef1040b4c5957b64a5a9" gracePeriod=30 Dec 04 11:50:53.904640 master-0 kubenswrapper[8993]: I1204 11:50:53.904559 8993 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-etcd/etcd-master-0"] Dec 04 11:50:53.905969 master-0 kubenswrapper[8993]: E1204 11:50:53.905918 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcd-rev" Dec 04 11:50:53.906177 master-0 kubenswrapper[8993]: I1204 11:50:53.905974 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcd-rev" Dec 04 11:50:53.906177 master-0 kubenswrapper[8993]: E1204 11:50:53.906018 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcd-readyz" Dec 04 11:50:53.906177 master-0 kubenswrapper[8993]: I1204 11:50:53.906036 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcd-readyz" Dec 04 11:50:53.906177 master-0 kubenswrapper[8993]: E1204 11:50:53.906064 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcd-ensure-env-vars" Dec 04 11:50:53.906177 master-0 kubenswrapper[8993]: I1204 11:50:53.906084 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcd-ensure-env-vars" Dec 04 11:50:53.906177 master-0 kubenswrapper[8993]: E1204 11:50:53.906119 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcd-resources-copy" Dec 04 11:50:53.906177 master-0 kubenswrapper[8993]: I1204 11:50:53.906136 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcd-resources-copy" Dec 04 11:50:53.906177 master-0 kubenswrapper[8993]: E1204 11:50:53.906169 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcdctl" Dec 04 11:50:53.906177 master-0 kubenswrapper[8993]: I1204 11:50:53.906189 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcdctl" Dec 04 11:50:53.914624 master-0 kubenswrapper[8993]: E1204 11:50:53.906218 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcd-metrics" Dec 04 11:50:53.914624 master-0 kubenswrapper[8993]: I1204 11:50:53.906236 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcd-metrics" Dec 04 11:50:53.920029 master-0 kubenswrapper[8993]: E1204 11:50:53.919968 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcd" Dec 04 11:50:53.920029 master-0 kubenswrapper[8993]: I1204 11:50:53.920020 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcd" Dec 04 11:50:53.920204 master-0 kubenswrapper[8993]: E1204 11:50:53.920058 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c24e01603234fe8003f8aae8171b0065" containerName="setup" Dec 04 11:50:53.920204 master-0 kubenswrapper[8993]: I1204 11:50:53.920067 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="c24e01603234fe8003f8aae8171b0065" containerName="setup" Dec 04 11:50:53.920451 master-0 kubenswrapper[8993]: I1204 11:50:53.920421 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcdctl" Dec 04 11:50:53.920451 master-0 kubenswrapper[8993]: I1204 11:50:53.920449 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcd-metrics" Dec 04 11:50:53.920574 master-0 kubenswrapper[8993]: I1204 11:50:53.920465 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcd-readyz" Dec 04 11:50:53.920574 master-0 kubenswrapper[8993]: I1204 11:50:53.920476 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcd-rev" Dec 04 11:50:53.920574 master-0 kubenswrapper[8993]: I1204 11:50:53.920503 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcd" Dec 04 11:50:53.938045 master-0 kubenswrapper[8993]: I1204 11:50:53.937992 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-cert-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:50:53.938255 master-0 kubenswrapper[8993]: I1204 11:50:53.938117 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-static-pod-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:50:53.938255 master-0 kubenswrapper[8993]: I1204 11:50:53.938164 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-data-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:50:53.938255 master-0 kubenswrapper[8993]: I1204 11:50:53.938199 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-log-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:50:53.938470 master-0 kubenswrapper[8993]: I1204 11:50:53.938279 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-usr-local-bin\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:50:53.938470 master-0 kubenswrapper[8993]: I1204 11:50:53.938347 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-resource-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:50:54.042307 master-0 kubenswrapper[8993]: I1204 11:50:54.042230 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-usr-local-bin\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:50:54.042501 master-0 kubenswrapper[8993]: I1204 11:50:54.042328 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-resource-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:50:54.042501 master-0 kubenswrapper[8993]: I1204 11:50:54.042402 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-cert-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:50:54.042501 master-0 kubenswrapper[8993]: I1204 11:50:54.042446 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-static-pod-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:50:54.042501 master-0 kubenswrapper[8993]: I1204 11:50:54.042481 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-data-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:50:54.042664 master-0 kubenswrapper[8993]: I1204 11:50:54.042503 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-log-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:50:54.042664 master-0 kubenswrapper[8993]: I1204 11:50:54.042595 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-log-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:50:54.042664 master-0 kubenswrapper[8993]: I1204 11:50:54.042661 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-usr-local-bin\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:50:54.042977 master-0 kubenswrapper[8993]: I1204 11:50:54.042698 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-resource-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:50:54.042977 master-0 kubenswrapper[8993]: I1204 11:50:54.042730 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-cert-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:50:54.042977 master-0 kubenswrapper[8993]: I1204 11:50:54.042763 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-static-pod-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:50:54.042977 master-0 kubenswrapper[8993]: I1204 11:50:54.042796 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-data-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:50:54.348448 master-0 kubenswrapper[8993]: I1204 11:50:54.348317 8993 patch_prober.go:28] interesting pod/etcd-master-0 container/etcd namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.32.10:9980/readyz\": dial tcp 192.168.32.10:9980: connect: connection refused" start-of-body= Dec 04 11:50:54.348448 master-0 kubenswrapper[8993]: I1204 11:50:54.348451 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-master-0" podUID="c24e01603234fe8003f8aae8171b0065" containerName="etcd" probeResult="failure" output="Get \"https://192.168.32.10:9980/readyz\": dial tcp 192.168.32.10:9980: connect: connection refused" Dec 04 11:50:54.846185 master-0 kubenswrapper[8993]: I1204 11:50:54.846105 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_c24e01603234fe8003f8aae8171b0065/etcd-rev/0.log" Dec 04 11:50:54.847505 master-0 kubenswrapper[8993]: I1204 11:50:54.847451 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_c24e01603234fe8003f8aae8171b0065/etcd-metrics/0.log" Dec 04 11:50:54.849294 master-0 kubenswrapper[8993]: I1204 11:50:54.849239 8993 generic.go:334] "Generic (PLEG): container finished" podID="c24e01603234fe8003f8aae8171b0065" containerID="eb58bcb651b87ccd2e45033c9114cc61c10ad998bb008845b3973e82a145bb2c" exitCode=2 Dec 04 11:50:54.849294 master-0 kubenswrapper[8993]: I1204 11:50:54.849270 8993 generic.go:334] "Generic (PLEG): container finished" podID="c24e01603234fe8003f8aae8171b0065" containerID="8b81f63230ddbea8d6c3b6ea050a2360f845a5d55e81ef1040b4c5957b64a5a9" exitCode=0 Dec 04 11:50:54.849294 master-0 kubenswrapper[8993]: I1204 11:50:54.849278 8993 generic.go:334] "Generic (PLEG): container finished" podID="c24e01603234fe8003f8aae8171b0065" containerID="523e8ed8e33638d0ea4ff55875cbc5c0f5dd8aa2e781f8660e98dcc61870abcd" exitCode=2 Dec 04 11:50:56.794631 master-0 kubenswrapper[8993]: I1204 11:50:56.794536 8993 scope.go:117] "RemoveContainer" containerID="460d7f059ee8ee4626a535f82e61c3712a9cf7f763c5ff20c19a344581f3b8eb" Dec 04 11:50:57.876061 master-0 kubenswrapper[8993]: I1204 11:50:57.875978 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/5.log" Dec 04 11:50:57.877490 master-0 kubenswrapper[8993]: I1204 11:50:57.877421 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"4c7562d535711adc8257706a397e2c0b860bbf4a88ab43084f8db587572f489c"} Dec 04 11:51:04.572069 master-0 kubenswrapper[8993]: I1204 11:51:04.571960 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:51:04.572069 master-0 kubenswrapper[8993]: I1204 11:51:04.572047 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:51:07.572420 master-0 kubenswrapper[8993]: I1204 11:51:07.572311 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:51:07.573013 master-0 kubenswrapper[8993]: I1204 11:51:07.572438 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:51:07.823023 master-0 kubenswrapper[8993]: E1204 11:51:07.822863 8993 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:51:08.945604 master-0 kubenswrapper[8993]: I1204 11:51:08.945500 8993 generic.go:334] "Generic (PLEG): container finished" podID="c6335f99-eb41-4b1d-93df-4a24f0ce23bc" containerID="66b953a48576619ad5ef1fc4d68b6166f875d5145d22f93448f049810d8b1236" exitCode=0 Dec 04 11:51:08.945604 master-0 kubenswrapper[8993]: I1204 11:51:08.945591 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-2-master-0" event={"ID":"c6335f99-eb41-4b1d-93df-4a24f0ce23bc","Type":"ContainerDied","Data":"66b953a48576619ad5ef1fc4d68b6166f875d5145d22f93448f049810d8b1236"} Dec 04 11:51:10.230117 master-0 kubenswrapper[8993]: I1204 11:51:10.230054 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-2-master-0" Dec 04 11:51:10.388670 master-0 kubenswrapper[8993]: I1204 11:51:10.388537 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6335f99-eb41-4b1d-93df-4a24f0ce23bc-kubelet-dir\") pod \"c6335f99-eb41-4b1d-93df-4a24f0ce23bc\" (UID: \"c6335f99-eb41-4b1d-93df-4a24f0ce23bc\") " Dec 04 11:51:10.388670 master-0 kubenswrapper[8993]: I1204 11:51:10.388632 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/c6335f99-eb41-4b1d-93df-4a24f0ce23bc-kube-api-access\") pod \"c6335f99-eb41-4b1d-93df-4a24f0ce23bc\" (UID: \"c6335f99-eb41-4b1d-93df-4a24f0ce23bc\") " Dec 04 11:51:10.388670 master-0 kubenswrapper[8993]: I1204 11:51:10.388651 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c6335f99-eb41-4b1d-93df-4a24f0ce23bc-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "c6335f99-eb41-4b1d-93df-4a24f0ce23bc" (UID: "c6335f99-eb41-4b1d-93df-4a24f0ce23bc"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:51:10.388670 master-0 kubenswrapper[8993]: I1204 11:51:10.388693 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/c6335f99-eb41-4b1d-93df-4a24f0ce23bc-var-lock\") pod \"c6335f99-eb41-4b1d-93df-4a24f0ce23bc\" (UID: \"c6335f99-eb41-4b1d-93df-4a24f0ce23bc\") " Dec 04 11:51:10.389339 master-0 kubenswrapper[8993]: I1204 11:51:10.388918 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c6335f99-eb41-4b1d-93df-4a24f0ce23bc-var-lock" (OuterVolumeSpecName: "var-lock") pod "c6335f99-eb41-4b1d-93df-4a24f0ce23bc" (UID: "c6335f99-eb41-4b1d-93df-4a24f0ce23bc"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:51:10.389339 master-0 kubenswrapper[8993]: I1204 11:51:10.389168 8993 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6335f99-eb41-4b1d-93df-4a24f0ce23bc-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:51:10.389339 master-0 kubenswrapper[8993]: I1204 11:51:10.389205 8993 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/c6335f99-eb41-4b1d-93df-4a24f0ce23bc-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 11:51:10.392045 master-0 kubenswrapper[8993]: I1204 11:51:10.391999 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6335f99-eb41-4b1d-93df-4a24f0ce23bc-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "c6335f99-eb41-4b1d-93df-4a24f0ce23bc" (UID: "c6335f99-eb41-4b1d-93df-4a24f0ce23bc"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:51:10.490334 master-0 kubenswrapper[8993]: I1204 11:51:10.490173 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/c6335f99-eb41-4b1d-93df-4a24f0ce23bc-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 11:51:10.960037 master-0 kubenswrapper[8993]: I1204 11:51:10.959987 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_installer-3-master-0_27c4e782-11b4-43a3-9ffd-34bf4e40bbc4/installer/0.log" Dec 04 11:51:10.960283 master-0 kubenswrapper[8993]: I1204 11:51:10.960052 8993 generic.go:334] "Generic (PLEG): container finished" podID="27c4e782-11b4-43a3-9ffd-34bf4e40bbc4" containerID="b78e17b7306f7adda3e6d7075255514653aaae6ce42d92ca0bc99707e1589503" exitCode=1 Dec 04 11:51:10.960283 master-0 kubenswrapper[8993]: I1204 11:51:10.960125 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-3-master-0" event={"ID":"27c4e782-11b4-43a3-9ffd-34bf4e40bbc4","Type":"ContainerDied","Data":"b78e17b7306f7adda3e6d7075255514653aaae6ce42d92ca0bc99707e1589503"} Dec 04 11:51:10.961740 master-0 kubenswrapper[8993]: I1204 11:51:10.961702 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-2-master-0" event={"ID":"c6335f99-eb41-4b1d-93df-4a24f0ce23bc","Type":"ContainerDied","Data":"e526280d34ec437bd97a8b63aabde2fa2c77527089e55d85797209e690ed274b"} Dec 04 11:51:10.961868 master-0 kubenswrapper[8993]: I1204 11:51:10.961852 8993 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e526280d34ec437bd97a8b63aabde2fa2c77527089e55d85797209e690ed274b" Dec 04 11:51:10.961942 master-0 kubenswrapper[8993]: I1204 11:51:10.961729 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-2-master-0" Dec 04 11:51:12.273277 master-0 kubenswrapper[8993]: I1204 11:51:12.273189 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_installer-3-master-0_27c4e782-11b4-43a3-9ffd-34bf4e40bbc4/installer/0.log" Dec 04 11:51:12.273849 master-0 kubenswrapper[8993]: I1204 11:51:12.273305 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 11:51:12.415631 master-0 kubenswrapper[8993]: I1204 11:51:12.415545 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/27c4e782-11b4-43a3-9ffd-34bf4e40bbc4-var-lock\") pod \"27c4e782-11b4-43a3-9ffd-34bf4e40bbc4\" (UID: \"27c4e782-11b4-43a3-9ffd-34bf4e40bbc4\") " Dec 04 11:51:12.415990 master-0 kubenswrapper[8993]: I1204 11:51:12.415653 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/27c4e782-11b4-43a3-9ffd-34bf4e40bbc4-kube-api-access\") pod \"27c4e782-11b4-43a3-9ffd-34bf4e40bbc4\" (UID: \"27c4e782-11b4-43a3-9ffd-34bf4e40bbc4\") " Dec 04 11:51:12.415990 master-0 kubenswrapper[8993]: I1204 11:51:12.415709 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27c4e782-11b4-43a3-9ffd-34bf4e40bbc4-kubelet-dir\") pod \"27c4e782-11b4-43a3-9ffd-34bf4e40bbc4\" (UID: \"27c4e782-11b4-43a3-9ffd-34bf4e40bbc4\") " Dec 04 11:51:12.415990 master-0 kubenswrapper[8993]: I1204 11:51:12.415978 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/27c4e782-11b4-43a3-9ffd-34bf4e40bbc4-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "27c4e782-11b4-43a3-9ffd-34bf4e40bbc4" (UID: "27c4e782-11b4-43a3-9ffd-34bf4e40bbc4"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:51:12.416387 master-0 kubenswrapper[8993]: I1204 11:51:12.416316 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/27c4e782-11b4-43a3-9ffd-34bf4e40bbc4-var-lock" (OuterVolumeSpecName: "var-lock") pod "27c4e782-11b4-43a3-9ffd-34bf4e40bbc4" (UID: "27c4e782-11b4-43a3-9ffd-34bf4e40bbc4"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:51:12.418576 master-0 kubenswrapper[8993]: I1204 11:51:12.418510 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27c4e782-11b4-43a3-9ffd-34bf4e40bbc4-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "27c4e782-11b4-43a3-9ffd-34bf4e40bbc4" (UID: "27c4e782-11b4-43a3-9ffd-34bf4e40bbc4"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:51:12.518067 master-0 kubenswrapper[8993]: I1204 11:51:12.517875 8993 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/27c4e782-11b4-43a3-9ffd-34bf4e40bbc4-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 11:51:12.518396 master-0 kubenswrapper[8993]: I1204 11:51:12.518376 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/27c4e782-11b4-43a3-9ffd-34bf4e40bbc4-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 11:51:12.518472 master-0 kubenswrapper[8993]: I1204 11:51:12.518461 8993 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27c4e782-11b4-43a3-9ffd-34bf4e40bbc4-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:51:12.975606 master-0 kubenswrapper[8993]: I1204 11:51:12.975541 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_installer-3-master-0_27c4e782-11b4-43a3-9ffd-34bf4e40bbc4/installer/0.log" Dec 04 11:51:12.975877 master-0 kubenswrapper[8993]: I1204 11:51:12.975630 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-3-master-0" event={"ID":"27c4e782-11b4-43a3-9ffd-34bf4e40bbc4","Type":"ContainerDied","Data":"f10cd46382bef7256c0fac8a54a8e2e84ada2a13006e11bf8f929bfbffd0d8f6"} Dec 04 11:51:12.975877 master-0 kubenswrapper[8993]: I1204 11:51:12.975669 8993 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f10cd46382bef7256c0fac8a54a8e2e84ada2a13006e11bf8f929bfbffd0d8f6" Dec 04 11:51:12.975877 master-0 kubenswrapper[8993]: I1204 11:51:12.975729 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 11:51:17.571760 master-0 kubenswrapper[8993]: I1204 11:51:17.571590 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:51:17.571760 master-0 kubenswrapper[8993]: I1204 11:51:17.571746 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:51:17.823425 master-0 kubenswrapper[8993]: E1204 11:51:17.823224 8993 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": context deadline exceeded" Dec 04 11:51:21.924130 master-0 kubenswrapper[8993]: I1204 11:51:21.924072 8993 scope.go:117] "RemoveContainer" containerID="88e39a153093f8e114cb7d99b1715d4855f5b301a06532da1e8598576d2b5a0d" Dec 04 11:51:24.053421 master-0 kubenswrapper[8993]: I1204 11:51:24.053361 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_c24e01603234fe8003f8aae8171b0065/etcd-rev/0.log" Dec 04 11:51:24.055154 master-0 kubenswrapper[8993]: I1204 11:51:24.055109 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_c24e01603234fe8003f8aae8171b0065/etcd-metrics/0.log" Dec 04 11:51:24.055292 master-0 kubenswrapper[8993]: I1204 11:51:24.055236 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_c24e01603234fe8003f8aae8171b0065/etcd-rev/0.log" Dec 04 11:51:24.056218 master-0 kubenswrapper[8993]: I1204 11:51:24.056180 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_c24e01603234fe8003f8aae8171b0065/etcd-metrics/0.log" Dec 04 11:51:24.056332 master-0 kubenswrapper[8993]: I1204 11:51:24.056293 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_c24e01603234fe8003f8aae8171b0065/etcd/0.log" Dec 04 11:51:24.057027 master-0 kubenswrapper[8993]: I1204 11:51:24.056983 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_c24e01603234fe8003f8aae8171b0065/etcd/0.log" Dec 04 11:51:24.057083 master-0 kubenswrapper[8993]: I1204 11:51:24.057026 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_c24e01603234fe8003f8aae8171b0065/etcdctl/0.log" Dec 04 11:51:24.057885 master-0 kubenswrapper[8993]: I1204 11:51:24.057853 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_c24e01603234fe8003f8aae8171b0065/etcdctl/0.log" Dec 04 11:51:24.059083 master-0 kubenswrapper[8993]: I1204 11:51:24.059042 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0" Dec 04 11:51:24.059430 master-0 kubenswrapper[8993]: I1204 11:51:24.059369 8993 generic.go:334] "Generic (PLEG): container finished" podID="c24e01603234fe8003f8aae8171b0065" containerID="82403cfe9ce30e64366d586bd3d4971dd579fb9deb2bccf711ab036c03a0fbed" exitCode=137 Dec 04 11:51:24.059430 master-0 kubenswrapper[8993]: I1204 11:51:24.059417 8993 generic.go:334] "Generic (PLEG): container finished" podID="c24e01603234fe8003f8aae8171b0065" containerID="33f85176404395dbaf1cfdb77d7cfa2b94036a1d9cca44a7d3462ef387eb7691" exitCode=137 Dec 04 11:51:24.059502 master-0 kubenswrapper[8993]: I1204 11:51:24.059462 8993 scope.go:117] "RemoveContainer" containerID="eb58bcb651b87ccd2e45033c9114cc61c10ad998bb008845b3973e82a145bb2c" Dec 04 11:51:24.078689 master-0 kubenswrapper[8993]: I1204 11:51:24.078608 8993 scope.go:117] "RemoveContainer" containerID="8b81f63230ddbea8d6c3b6ea050a2360f845a5d55e81ef1040b4c5957b64a5a9" Dec 04 11:51:24.098341 master-0 kubenswrapper[8993]: I1204 11:51:24.098284 8993 scope.go:117] "RemoveContainer" containerID="523e8ed8e33638d0ea4ff55875cbc5c0f5dd8aa2e781f8660e98dcc61870abcd" Dec 04 11:51:24.122567 master-0 kubenswrapper[8993]: I1204 11:51:24.122514 8993 scope.go:117] "RemoveContainer" containerID="82403cfe9ce30e64366d586bd3d4971dd579fb9deb2bccf711ab036c03a0fbed" Dec 04 11:51:24.149273 master-0 kubenswrapper[8993]: I1204 11:51:24.149026 8993 scope.go:117] "RemoveContainer" containerID="33f85176404395dbaf1cfdb77d7cfa2b94036a1d9cca44a7d3462ef387eb7691" Dec 04 11:51:24.175542 master-0 kubenswrapper[8993]: I1204 11:51:24.173072 8993 scope.go:117] "RemoveContainer" containerID="2d094b63c81e57115143f4d4ba1077d84f6869b12329f7e6615de922e672c39f" Dec 04 11:51:24.192865 master-0 kubenswrapper[8993]: I1204 11:51:24.191967 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-resource-dir\") pod \"c24e01603234fe8003f8aae8171b0065\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " Dec 04 11:51:24.192865 master-0 kubenswrapper[8993]: I1204 11:51:24.192079 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "c24e01603234fe8003f8aae8171b0065" (UID: "c24e01603234fe8003f8aae8171b0065"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:51:24.192865 master-0 kubenswrapper[8993]: I1204 11:51:24.192186 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-data-dir\") pod \"c24e01603234fe8003f8aae8171b0065\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " Dec 04 11:51:24.192865 master-0 kubenswrapper[8993]: I1204 11:51:24.192258 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-log-dir\") pod \"c24e01603234fe8003f8aae8171b0065\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " Dec 04 11:51:24.192865 master-0 kubenswrapper[8993]: I1204 11:51:24.192271 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-data-dir" (OuterVolumeSpecName: "data-dir") pod "c24e01603234fe8003f8aae8171b0065" (UID: "c24e01603234fe8003f8aae8171b0065"). InnerVolumeSpecName "data-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:51:24.192865 master-0 kubenswrapper[8993]: I1204 11:51:24.192560 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-log-dir" (OuterVolumeSpecName: "log-dir") pod "c24e01603234fe8003f8aae8171b0065" (UID: "c24e01603234fe8003f8aae8171b0065"). InnerVolumeSpecName "log-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:51:24.192865 master-0 kubenswrapper[8993]: I1204 11:51:24.192657 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-usr-local-bin\") pod \"c24e01603234fe8003f8aae8171b0065\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " Dec 04 11:51:24.192865 master-0 kubenswrapper[8993]: I1204 11:51:24.192706 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-static-pod-dir\") pod \"c24e01603234fe8003f8aae8171b0065\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " Dec 04 11:51:24.192865 master-0 kubenswrapper[8993]: I1204 11:51:24.192728 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-usr-local-bin" (OuterVolumeSpecName: "usr-local-bin") pod "c24e01603234fe8003f8aae8171b0065" (UID: "c24e01603234fe8003f8aae8171b0065"). InnerVolumeSpecName "usr-local-bin". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:51:24.192865 master-0 kubenswrapper[8993]: I1204 11:51:24.192746 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-cert-dir\") pod \"c24e01603234fe8003f8aae8171b0065\" (UID: \"c24e01603234fe8003f8aae8171b0065\") " Dec 04 11:51:24.192865 master-0 kubenswrapper[8993]: I1204 11:51:24.192848 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-cert-dir" (OuterVolumeSpecName: "cert-dir") pod "c24e01603234fe8003f8aae8171b0065" (UID: "c24e01603234fe8003f8aae8171b0065"). InnerVolumeSpecName "cert-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:51:24.193526 master-0 kubenswrapper[8993]: I1204 11:51:24.192919 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-static-pod-dir" (OuterVolumeSpecName: "static-pod-dir") pod "c24e01603234fe8003f8aae8171b0065" (UID: "c24e01603234fe8003f8aae8171b0065"). InnerVolumeSpecName "static-pod-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:51:24.193526 master-0 kubenswrapper[8993]: I1204 11:51:24.193412 8993 reconciler_common.go:293] "Volume detached for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-log-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:51:24.193526 master-0 kubenswrapper[8993]: I1204 11:51:24.193441 8993 reconciler_common.go:293] "Volume detached for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-usr-local-bin\") on node \"master-0\" DevicePath \"\"" Dec 04 11:51:24.193526 master-0 kubenswrapper[8993]: I1204 11:51:24.193455 8993 reconciler_common.go:293] "Volume detached for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-static-pod-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:51:24.193526 master-0 kubenswrapper[8993]: I1204 11:51:24.193464 8993 reconciler_common.go:293] "Volume detached for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-cert-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:51:24.193526 master-0 kubenswrapper[8993]: I1204 11:51:24.193476 8993 reconciler_common.go:293] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:51:24.193526 master-0 kubenswrapper[8993]: I1204 11:51:24.193485 8993 reconciler_common.go:293] "Volume detached for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/c24e01603234fe8003f8aae8171b0065-data-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:51:24.209592 master-0 kubenswrapper[8993]: I1204 11:51:24.209526 8993 scope.go:117] "RemoveContainer" containerID="66bc8b1ef32ed555b89bf441dddf70148acb178d161951788f2034d094677933" Dec 04 11:51:24.230964 master-0 kubenswrapper[8993]: I1204 11:51:24.230906 8993 scope.go:117] "RemoveContainer" containerID="ec5adef1bc610591b982f90e781d407a1f1f553e2257a5524d4e326fae0da502" Dec 04 11:51:24.249959 master-0 kubenswrapper[8993]: I1204 11:51:24.249879 8993 scope.go:117] "RemoveContainer" containerID="eb58bcb651b87ccd2e45033c9114cc61c10ad998bb008845b3973e82a145bb2c" Dec 04 11:51:24.250508 master-0 kubenswrapper[8993]: E1204 11:51:24.250463 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb58bcb651b87ccd2e45033c9114cc61c10ad998bb008845b3973e82a145bb2c\": container with ID starting with eb58bcb651b87ccd2e45033c9114cc61c10ad998bb008845b3973e82a145bb2c not found: ID does not exist" containerID="eb58bcb651b87ccd2e45033c9114cc61c10ad998bb008845b3973e82a145bb2c" Dec 04 11:51:24.250550 master-0 kubenswrapper[8993]: I1204 11:51:24.250518 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb58bcb651b87ccd2e45033c9114cc61c10ad998bb008845b3973e82a145bb2c"} err="failed to get container status \"eb58bcb651b87ccd2e45033c9114cc61c10ad998bb008845b3973e82a145bb2c\": rpc error: code = NotFound desc = could not find container \"eb58bcb651b87ccd2e45033c9114cc61c10ad998bb008845b3973e82a145bb2c\": container with ID starting with eb58bcb651b87ccd2e45033c9114cc61c10ad998bb008845b3973e82a145bb2c not found: ID does not exist" Dec 04 11:51:24.250593 master-0 kubenswrapper[8993]: I1204 11:51:24.250557 8993 scope.go:117] "RemoveContainer" containerID="8b81f63230ddbea8d6c3b6ea050a2360f845a5d55e81ef1040b4c5957b64a5a9" Dec 04 11:51:24.251146 master-0 kubenswrapper[8993]: E1204 11:51:24.251058 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b81f63230ddbea8d6c3b6ea050a2360f845a5d55e81ef1040b4c5957b64a5a9\": container with ID starting with 8b81f63230ddbea8d6c3b6ea050a2360f845a5d55e81ef1040b4c5957b64a5a9 not found: ID does not exist" containerID="8b81f63230ddbea8d6c3b6ea050a2360f845a5d55e81ef1040b4c5957b64a5a9" Dec 04 11:51:24.251197 master-0 kubenswrapper[8993]: I1204 11:51:24.251160 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b81f63230ddbea8d6c3b6ea050a2360f845a5d55e81ef1040b4c5957b64a5a9"} err="failed to get container status \"8b81f63230ddbea8d6c3b6ea050a2360f845a5d55e81ef1040b4c5957b64a5a9\": rpc error: code = NotFound desc = could not find container \"8b81f63230ddbea8d6c3b6ea050a2360f845a5d55e81ef1040b4c5957b64a5a9\": container with ID starting with 8b81f63230ddbea8d6c3b6ea050a2360f845a5d55e81ef1040b4c5957b64a5a9 not found: ID does not exist" Dec 04 11:51:24.251238 master-0 kubenswrapper[8993]: I1204 11:51:24.251202 8993 scope.go:117] "RemoveContainer" containerID="523e8ed8e33638d0ea4ff55875cbc5c0f5dd8aa2e781f8660e98dcc61870abcd" Dec 04 11:51:24.251657 master-0 kubenswrapper[8993]: E1204 11:51:24.251619 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"523e8ed8e33638d0ea4ff55875cbc5c0f5dd8aa2e781f8660e98dcc61870abcd\": container with ID starting with 523e8ed8e33638d0ea4ff55875cbc5c0f5dd8aa2e781f8660e98dcc61870abcd not found: ID does not exist" containerID="523e8ed8e33638d0ea4ff55875cbc5c0f5dd8aa2e781f8660e98dcc61870abcd" Dec 04 11:51:24.251700 master-0 kubenswrapper[8993]: I1204 11:51:24.251659 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"523e8ed8e33638d0ea4ff55875cbc5c0f5dd8aa2e781f8660e98dcc61870abcd"} err="failed to get container status \"523e8ed8e33638d0ea4ff55875cbc5c0f5dd8aa2e781f8660e98dcc61870abcd\": rpc error: code = NotFound desc = could not find container \"523e8ed8e33638d0ea4ff55875cbc5c0f5dd8aa2e781f8660e98dcc61870abcd\": container with ID starting with 523e8ed8e33638d0ea4ff55875cbc5c0f5dd8aa2e781f8660e98dcc61870abcd not found: ID does not exist" Dec 04 11:51:24.251700 master-0 kubenswrapper[8993]: I1204 11:51:24.251683 8993 scope.go:117] "RemoveContainer" containerID="82403cfe9ce30e64366d586bd3d4971dd579fb9deb2bccf711ab036c03a0fbed" Dec 04 11:51:24.253517 master-0 kubenswrapper[8993]: E1204 11:51:24.253448 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82403cfe9ce30e64366d586bd3d4971dd579fb9deb2bccf711ab036c03a0fbed\": container with ID starting with 82403cfe9ce30e64366d586bd3d4971dd579fb9deb2bccf711ab036c03a0fbed not found: ID does not exist" containerID="82403cfe9ce30e64366d586bd3d4971dd579fb9deb2bccf711ab036c03a0fbed" Dec 04 11:51:24.253580 master-0 kubenswrapper[8993]: I1204 11:51:24.253522 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82403cfe9ce30e64366d586bd3d4971dd579fb9deb2bccf711ab036c03a0fbed"} err="failed to get container status \"82403cfe9ce30e64366d586bd3d4971dd579fb9deb2bccf711ab036c03a0fbed\": rpc error: code = NotFound desc = could not find container \"82403cfe9ce30e64366d586bd3d4971dd579fb9deb2bccf711ab036c03a0fbed\": container with ID starting with 82403cfe9ce30e64366d586bd3d4971dd579fb9deb2bccf711ab036c03a0fbed not found: ID does not exist" Dec 04 11:51:24.253580 master-0 kubenswrapper[8993]: I1204 11:51:24.253569 8993 scope.go:117] "RemoveContainer" containerID="33f85176404395dbaf1cfdb77d7cfa2b94036a1d9cca44a7d3462ef387eb7691" Dec 04 11:51:24.254068 master-0 kubenswrapper[8993]: E1204 11:51:24.254021 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33f85176404395dbaf1cfdb77d7cfa2b94036a1d9cca44a7d3462ef387eb7691\": container with ID starting with 33f85176404395dbaf1cfdb77d7cfa2b94036a1d9cca44a7d3462ef387eb7691 not found: ID does not exist" containerID="33f85176404395dbaf1cfdb77d7cfa2b94036a1d9cca44a7d3462ef387eb7691" Dec 04 11:51:24.254068 master-0 kubenswrapper[8993]: I1204 11:51:24.254061 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33f85176404395dbaf1cfdb77d7cfa2b94036a1d9cca44a7d3462ef387eb7691"} err="failed to get container status \"33f85176404395dbaf1cfdb77d7cfa2b94036a1d9cca44a7d3462ef387eb7691\": rpc error: code = NotFound desc = could not find container \"33f85176404395dbaf1cfdb77d7cfa2b94036a1d9cca44a7d3462ef387eb7691\": container with ID starting with 33f85176404395dbaf1cfdb77d7cfa2b94036a1d9cca44a7d3462ef387eb7691 not found: ID does not exist" Dec 04 11:51:24.254176 master-0 kubenswrapper[8993]: I1204 11:51:24.254084 8993 scope.go:117] "RemoveContainer" containerID="2d094b63c81e57115143f4d4ba1077d84f6869b12329f7e6615de922e672c39f" Dec 04 11:51:24.254897 master-0 kubenswrapper[8993]: E1204 11:51:24.254720 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d094b63c81e57115143f4d4ba1077d84f6869b12329f7e6615de922e672c39f\": container with ID starting with 2d094b63c81e57115143f4d4ba1077d84f6869b12329f7e6615de922e672c39f not found: ID does not exist" containerID="2d094b63c81e57115143f4d4ba1077d84f6869b12329f7e6615de922e672c39f" Dec 04 11:51:24.254897 master-0 kubenswrapper[8993]: I1204 11:51:24.254762 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d094b63c81e57115143f4d4ba1077d84f6869b12329f7e6615de922e672c39f"} err="failed to get container status \"2d094b63c81e57115143f4d4ba1077d84f6869b12329f7e6615de922e672c39f\": rpc error: code = NotFound desc = could not find container \"2d094b63c81e57115143f4d4ba1077d84f6869b12329f7e6615de922e672c39f\": container with ID starting with 2d094b63c81e57115143f4d4ba1077d84f6869b12329f7e6615de922e672c39f not found: ID does not exist" Dec 04 11:51:24.254897 master-0 kubenswrapper[8993]: I1204 11:51:24.254788 8993 scope.go:117] "RemoveContainer" containerID="66bc8b1ef32ed555b89bf441dddf70148acb178d161951788f2034d094677933" Dec 04 11:51:24.255178 master-0 kubenswrapper[8993]: E1204 11:51:24.255138 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66bc8b1ef32ed555b89bf441dddf70148acb178d161951788f2034d094677933\": container with ID starting with 66bc8b1ef32ed555b89bf441dddf70148acb178d161951788f2034d094677933 not found: ID does not exist" containerID="66bc8b1ef32ed555b89bf441dddf70148acb178d161951788f2034d094677933" Dec 04 11:51:24.255222 master-0 kubenswrapper[8993]: I1204 11:51:24.255178 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66bc8b1ef32ed555b89bf441dddf70148acb178d161951788f2034d094677933"} err="failed to get container status \"66bc8b1ef32ed555b89bf441dddf70148acb178d161951788f2034d094677933\": rpc error: code = NotFound desc = could not find container \"66bc8b1ef32ed555b89bf441dddf70148acb178d161951788f2034d094677933\": container with ID starting with 66bc8b1ef32ed555b89bf441dddf70148acb178d161951788f2034d094677933 not found: ID does not exist" Dec 04 11:51:24.255222 master-0 kubenswrapper[8993]: I1204 11:51:24.255202 8993 scope.go:117] "RemoveContainer" containerID="ec5adef1bc610591b982f90e781d407a1f1f553e2257a5524d4e326fae0da502" Dec 04 11:51:24.255678 master-0 kubenswrapper[8993]: E1204 11:51:24.255642 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec5adef1bc610591b982f90e781d407a1f1f553e2257a5524d4e326fae0da502\": container with ID starting with ec5adef1bc610591b982f90e781d407a1f1f553e2257a5524d4e326fae0da502 not found: ID does not exist" containerID="ec5adef1bc610591b982f90e781d407a1f1f553e2257a5524d4e326fae0da502" Dec 04 11:51:24.255749 master-0 kubenswrapper[8993]: I1204 11:51:24.255675 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec5adef1bc610591b982f90e781d407a1f1f553e2257a5524d4e326fae0da502"} err="failed to get container status \"ec5adef1bc610591b982f90e781d407a1f1f553e2257a5524d4e326fae0da502\": rpc error: code = NotFound desc = could not find container \"ec5adef1bc610591b982f90e781d407a1f1f553e2257a5524d4e326fae0da502\": container with ID starting with ec5adef1bc610591b982f90e781d407a1f1f553e2257a5524d4e326fae0da502 not found: ID does not exist" Dec 04 11:51:24.255749 master-0 kubenswrapper[8993]: I1204 11:51:24.255701 8993 scope.go:117] "RemoveContainer" containerID="eb58bcb651b87ccd2e45033c9114cc61c10ad998bb008845b3973e82a145bb2c" Dec 04 11:51:24.256132 master-0 kubenswrapper[8993]: I1204 11:51:24.256082 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb58bcb651b87ccd2e45033c9114cc61c10ad998bb008845b3973e82a145bb2c"} err="failed to get container status \"eb58bcb651b87ccd2e45033c9114cc61c10ad998bb008845b3973e82a145bb2c\": rpc error: code = NotFound desc = could not find container \"eb58bcb651b87ccd2e45033c9114cc61c10ad998bb008845b3973e82a145bb2c\": container with ID starting with eb58bcb651b87ccd2e45033c9114cc61c10ad998bb008845b3973e82a145bb2c not found: ID does not exist" Dec 04 11:51:24.256132 master-0 kubenswrapper[8993]: I1204 11:51:24.256116 8993 scope.go:117] "RemoveContainer" containerID="8b81f63230ddbea8d6c3b6ea050a2360f845a5d55e81ef1040b4c5957b64a5a9" Dec 04 11:51:24.256598 master-0 kubenswrapper[8993]: I1204 11:51:24.256542 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b81f63230ddbea8d6c3b6ea050a2360f845a5d55e81ef1040b4c5957b64a5a9"} err="failed to get container status \"8b81f63230ddbea8d6c3b6ea050a2360f845a5d55e81ef1040b4c5957b64a5a9\": rpc error: code = NotFound desc = could not find container \"8b81f63230ddbea8d6c3b6ea050a2360f845a5d55e81ef1040b4c5957b64a5a9\": container with ID starting with 8b81f63230ddbea8d6c3b6ea050a2360f845a5d55e81ef1040b4c5957b64a5a9 not found: ID does not exist" Dec 04 11:51:24.256660 master-0 kubenswrapper[8993]: I1204 11:51:24.256602 8993 scope.go:117] "RemoveContainer" containerID="523e8ed8e33638d0ea4ff55875cbc5c0f5dd8aa2e781f8660e98dcc61870abcd" Dec 04 11:51:24.257237 master-0 kubenswrapper[8993]: I1204 11:51:24.257186 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"523e8ed8e33638d0ea4ff55875cbc5c0f5dd8aa2e781f8660e98dcc61870abcd"} err="failed to get container status \"523e8ed8e33638d0ea4ff55875cbc5c0f5dd8aa2e781f8660e98dcc61870abcd\": rpc error: code = NotFound desc = could not find container \"523e8ed8e33638d0ea4ff55875cbc5c0f5dd8aa2e781f8660e98dcc61870abcd\": container with ID starting with 523e8ed8e33638d0ea4ff55875cbc5c0f5dd8aa2e781f8660e98dcc61870abcd not found: ID does not exist" Dec 04 11:51:24.257237 master-0 kubenswrapper[8993]: I1204 11:51:24.257227 8993 scope.go:117] "RemoveContainer" containerID="82403cfe9ce30e64366d586bd3d4971dd579fb9deb2bccf711ab036c03a0fbed" Dec 04 11:51:24.257568 master-0 kubenswrapper[8993]: I1204 11:51:24.257533 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82403cfe9ce30e64366d586bd3d4971dd579fb9deb2bccf711ab036c03a0fbed"} err="failed to get container status \"82403cfe9ce30e64366d586bd3d4971dd579fb9deb2bccf711ab036c03a0fbed\": rpc error: code = NotFound desc = could not find container \"82403cfe9ce30e64366d586bd3d4971dd579fb9deb2bccf711ab036c03a0fbed\": container with ID starting with 82403cfe9ce30e64366d586bd3d4971dd579fb9deb2bccf711ab036c03a0fbed not found: ID does not exist" Dec 04 11:51:24.257568 master-0 kubenswrapper[8993]: I1204 11:51:24.257557 8993 scope.go:117] "RemoveContainer" containerID="33f85176404395dbaf1cfdb77d7cfa2b94036a1d9cca44a7d3462ef387eb7691" Dec 04 11:51:24.257852 master-0 kubenswrapper[8993]: I1204 11:51:24.257822 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33f85176404395dbaf1cfdb77d7cfa2b94036a1d9cca44a7d3462ef387eb7691"} err="failed to get container status \"33f85176404395dbaf1cfdb77d7cfa2b94036a1d9cca44a7d3462ef387eb7691\": rpc error: code = NotFound desc = could not find container \"33f85176404395dbaf1cfdb77d7cfa2b94036a1d9cca44a7d3462ef387eb7691\": container with ID starting with 33f85176404395dbaf1cfdb77d7cfa2b94036a1d9cca44a7d3462ef387eb7691 not found: ID does not exist" Dec 04 11:51:24.257852 master-0 kubenswrapper[8993]: I1204 11:51:24.257845 8993 scope.go:117] "RemoveContainer" containerID="2d094b63c81e57115143f4d4ba1077d84f6869b12329f7e6615de922e672c39f" Dec 04 11:51:24.258175 master-0 kubenswrapper[8993]: I1204 11:51:24.258134 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d094b63c81e57115143f4d4ba1077d84f6869b12329f7e6615de922e672c39f"} err="failed to get container status \"2d094b63c81e57115143f4d4ba1077d84f6869b12329f7e6615de922e672c39f\": rpc error: code = NotFound desc = could not find container \"2d094b63c81e57115143f4d4ba1077d84f6869b12329f7e6615de922e672c39f\": container with ID starting with 2d094b63c81e57115143f4d4ba1077d84f6869b12329f7e6615de922e672c39f not found: ID does not exist" Dec 04 11:51:24.258175 master-0 kubenswrapper[8993]: I1204 11:51:24.258163 8993 scope.go:117] "RemoveContainer" containerID="66bc8b1ef32ed555b89bf441dddf70148acb178d161951788f2034d094677933" Dec 04 11:51:24.258464 master-0 kubenswrapper[8993]: I1204 11:51:24.258407 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66bc8b1ef32ed555b89bf441dddf70148acb178d161951788f2034d094677933"} err="failed to get container status \"66bc8b1ef32ed555b89bf441dddf70148acb178d161951788f2034d094677933\": rpc error: code = NotFound desc = could not find container \"66bc8b1ef32ed555b89bf441dddf70148acb178d161951788f2034d094677933\": container with ID starting with 66bc8b1ef32ed555b89bf441dddf70148acb178d161951788f2034d094677933 not found: ID does not exist" Dec 04 11:51:24.258464 master-0 kubenswrapper[8993]: I1204 11:51:24.258448 8993 scope.go:117] "RemoveContainer" containerID="ec5adef1bc610591b982f90e781d407a1f1f553e2257a5524d4e326fae0da502" Dec 04 11:51:24.258762 master-0 kubenswrapper[8993]: I1204 11:51:24.258725 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec5adef1bc610591b982f90e781d407a1f1f553e2257a5524d4e326fae0da502"} err="failed to get container status \"ec5adef1bc610591b982f90e781d407a1f1f553e2257a5524d4e326fae0da502\": rpc error: code = NotFound desc = could not find container \"ec5adef1bc610591b982f90e781d407a1f1f553e2257a5524d4e326fae0da502\": container with ID starting with ec5adef1bc610591b982f90e781d407a1f1f553e2257a5524d4e326fae0da502 not found: ID does not exist" Dec 04 11:51:25.081538 master-0 kubenswrapper[8993]: I1204 11:51:25.081442 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0" Dec 04 11:51:25.800946 master-0 kubenswrapper[8993]: I1204 11:51:25.800779 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c24e01603234fe8003f8aae8171b0065" path="/var/lib/kubelet/pods/c24e01603234fe8003f8aae8171b0065/volumes" Dec 04 11:51:27.424150 master-0 kubenswrapper[8993]: I1204 11:51:27.424065 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": read tcp 127.0.0.1:47740->127.0.0.1:10357: read: connection reset by peer" start-of-body= Dec 04 11:51:27.424150 master-0 kubenswrapper[8993]: I1204 11:51:27.424173 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": read tcp 127.0.0.1:47740->127.0.0.1:10357: read: connection reset by peer" Dec 04 11:51:27.425226 master-0 kubenswrapper[8993]: I1204 11:51:27.424245 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:51:27.426419 master-0 kubenswrapper[8993]: I1204 11:51:27.425525 8993 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="cluster-policy-controller" containerStatusID={"Type":"cri-o","ID":"4c7562d535711adc8257706a397e2c0b860bbf4a88ab43084f8db587572f489c"} pod="openshift-kube-controller-manager/kube-controller-manager-master-0" containerMessage="Container cluster-policy-controller failed startup probe, will be restarted" Dec 04 11:51:27.426419 master-0 kubenswrapper[8993]: I1204 11:51:27.425857 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" containerID="cri-o://4c7562d535711adc8257706a397e2c0b860bbf4a88ab43084f8db587572f489c" gracePeriod=30 Dec 04 11:51:27.824399 master-0 kubenswrapper[8993]: E1204 11:51:27.824311 8993 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:51:27.917524 master-0 kubenswrapper[8993]: E1204 11:51:27.917363 8993 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{etcd-master-0.187e00dd2be6c4e5 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0,UID:c24e01603234fe8003f8aae8171b0065,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd-rev},},Reason:Killing,Message:Stopping container etcd-rev,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:50:53.900129509 +0000 UTC m=+788.291070972,LastTimestamp:2025-12-04 11:50:53.900129509 +0000 UTC m=+788.291070972,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:51:27.945147 master-0 kubenswrapper[8993]: E1204 11:51:27.945100 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:51:28.102937 master-0 kubenswrapper[8993]: I1204 11:51:28.102694 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/6.log" Dec 04 11:51:28.103484 master-0 kubenswrapper[8993]: I1204 11:51:28.103439 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/5.log" Dec 04 11:51:28.104842 master-0 kubenswrapper[8993]: I1204 11:51:28.104759 8993 generic.go:334] "Generic (PLEG): container finished" podID="e6b437c60bb18680f4492b00b294e872" containerID="4c7562d535711adc8257706a397e2c0b860bbf4a88ab43084f8db587572f489c" exitCode=255 Dec 04 11:51:28.104915 master-0 kubenswrapper[8993]: I1204 11:51:28.104855 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerDied","Data":"4c7562d535711adc8257706a397e2c0b860bbf4a88ab43084f8db587572f489c"} Dec 04 11:51:28.104962 master-0 kubenswrapper[8993]: I1204 11:51:28.104935 8993 scope.go:117] "RemoveContainer" containerID="460d7f059ee8ee4626a535f82e61c3712a9cf7f763c5ff20c19a344581f3b8eb" Dec 04 11:51:28.105494 master-0 kubenswrapper[8993]: I1204 11:51:28.105459 8993 scope.go:117] "RemoveContainer" containerID="4c7562d535711adc8257706a397e2c0b860bbf4a88ab43084f8db587572f489c" Dec 04 11:51:28.105772 master-0 kubenswrapper[8993]: E1204 11:51:28.105725 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:51:29.116535 master-0 kubenswrapper[8993]: I1204 11:51:29.116472 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/6.log" Dec 04 11:51:34.571752 master-0 kubenswrapper[8993]: I1204 11:51:34.571615 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:51:34.572648 master-0 kubenswrapper[8993]: I1204 11:51:34.572612 8993 scope.go:117] "RemoveContainer" containerID="4c7562d535711adc8257706a397e2c0b860bbf4a88ab43084f8db587572f489c" Dec 04 11:51:34.573463 master-0 kubenswrapper[8993]: E1204 11:51:34.572926 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:51:34.793245 master-0 kubenswrapper[8993]: I1204 11:51:34.793177 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0" Dec 04 11:51:34.813433 master-0 kubenswrapper[8993]: I1204 11:51:34.813363 8993 kubelet.go:1909] "Trying to delete pod" pod="openshift-etcd/etcd-master-0" podUID="cec85ded-d31e-47da-9e71-fa808f6cadc0" Dec 04 11:51:34.813433 master-0 kubenswrapper[8993]: I1204 11:51:34.813416 8993 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0" podUID="cec85ded-d31e-47da-9e71-fa808f6cadc0" Dec 04 11:51:37.825257 master-0 kubenswrapper[8993]: E1204 11:51:37.824946 8993 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:51:47.825798 master-0 kubenswrapper[8993]: E1204 11:51:47.825703 8993 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:51:47.825798 master-0 kubenswrapper[8993]: I1204 11:51:47.825790 8993 controller.go:115] "failed to update lease using latest lease, fallback to ensure lease" err="failed 5 attempts to update lease" Dec 04 11:51:49.794703 master-0 kubenswrapper[8993]: I1204 11:51:49.794627 8993 scope.go:117] "RemoveContainer" containerID="4c7562d535711adc8257706a397e2c0b860bbf4a88ab43084f8db587572f489c" Dec 04 11:51:49.795421 master-0 kubenswrapper[8993]: E1204 11:51:49.794950 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:51:55.813656 master-0 kubenswrapper[8993]: I1204 11:51:55.813567 8993 status_manager.go:851] "Failed to get status for pod" podUID="c24e01603234fe8003f8aae8171b0065" pod="openshift-etcd/etcd-master-0" err="the server was unable to return a response in the time allotted, but may still be processing the request (get pods etcd-master-0)" Dec 04 11:51:57.826234 master-0 kubenswrapper[8993]: E1204 11:51:57.826130 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="200ms" Dec 04 11:51:58.470350 master-0 kubenswrapper[8993]: I1204 11:51:58.470288 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-node-identity_network-node-identity-f8hvq_7203ec93-6572-4032-825c-140029a86058/approver/1.log" Dec 04 11:51:58.470839 master-0 kubenswrapper[8993]: I1204 11:51:58.470794 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-node-identity_network-node-identity-f8hvq_7203ec93-6572-4032-825c-140029a86058/approver/0.log" Dec 04 11:51:58.471225 master-0 kubenswrapper[8993]: I1204 11:51:58.471177 8993 generic.go:334] "Generic (PLEG): container finished" podID="7203ec93-6572-4032-825c-140029a86058" containerID="6ee863793f57b0f18fae063e87f584d73fae0eb1eb8a1275618f4008ffa23d64" exitCode=1 Dec 04 11:51:58.471300 master-0 kubenswrapper[8993]: I1204 11:51:58.471220 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-f8hvq" event={"ID":"7203ec93-6572-4032-825c-140029a86058","Type":"ContainerDied","Data":"6ee863793f57b0f18fae063e87f584d73fae0eb1eb8a1275618f4008ffa23d64"} Dec 04 11:51:58.471300 master-0 kubenswrapper[8993]: I1204 11:51:58.471271 8993 scope.go:117] "RemoveContainer" containerID="9b4ba98e62019491fc3009d22881e8502c26c25aed860943c3e8a4e83ac5e2e1" Dec 04 11:51:58.472164 master-0 kubenswrapper[8993]: I1204 11:51:58.472132 8993 scope.go:117] "RemoveContainer" containerID="6ee863793f57b0f18fae063e87f584d73fae0eb1eb8a1275618f4008ffa23d64" Dec 04 11:51:59.480834 master-0 kubenswrapper[8993]: I1204 11:51:59.480740 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-node-identity_network-node-identity-f8hvq_7203ec93-6572-4032-825c-140029a86058/approver/1.log" Dec 04 11:51:59.481606 master-0 kubenswrapper[8993]: I1204 11:51:59.481275 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-f8hvq" event={"ID":"7203ec93-6572-4032-825c-140029a86058","Type":"ContainerStarted","Data":"813c42ef38b80f036a503096d52dfe1af020f6bc0a58ddcb44f7160546682e9a"} Dec 04 11:52:00.794905 master-0 kubenswrapper[8993]: I1204 11:52:00.794843 8993 scope.go:117] "RemoveContainer" containerID="4c7562d535711adc8257706a397e2c0b860bbf4a88ab43084f8db587572f489c" Dec 04 11:52:00.795429 master-0 kubenswrapper[8993]: E1204 11:52:00.795276 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:52:01.943133 master-0 kubenswrapper[8993]: E1204 11:52:01.942947 8993 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{kube-controller-manager-master-0.187e0095395e7d0b openshift-kube-controller-manager 10476 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-master-0,UID:e6b437c60bb18680f4492b00b294e872,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{cluster-policy-controller},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d64c13fe7663a0b4ae61d103b1b7598adcf317a01826f296bcb66b1a2de83c96\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:45:44 +0000 UTC,LastTimestamp:2025-12-04 11:50:56.795739092 +0000 UTC m=+791.186680525,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:52:08.027747 master-0 kubenswrapper[8993]: E1204 11:52:08.027654 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="400ms" Dec 04 11:52:08.816384 master-0 kubenswrapper[8993]: E1204 11:52:08.816309 8993 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0" Dec 04 11:52:08.816926 master-0 kubenswrapper[8993]: I1204 11:52:08.816908 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0" Dec 04 11:52:08.837435 master-0 kubenswrapper[8993]: W1204 11:52:08.837373 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58d12e893528ad53a994f10901a644ea.slice/crio-941cfa04ddc49a585fc727a1dbdeb69c47e5f5f598b3a6ea4a0075889e24c1b1 WatchSource:0}: Error finding container 941cfa04ddc49a585fc727a1dbdeb69c47e5f5f598b3a6ea4a0075889e24c1b1: Status 404 returned error can't find the container with id 941cfa04ddc49a585fc727a1dbdeb69c47e5f5f598b3a6ea4a0075889e24c1b1 Dec 04 11:52:09.538648 master-0 kubenswrapper[8993]: I1204 11:52:09.538471 8993 generic.go:334] "Generic (PLEG): container finished" podID="58d12e893528ad53a994f10901a644ea" containerID="27595dd7e9f331fc7dddae56f41801fd05186c63f10ec084212462612cf2ce37" exitCode=0 Dec 04 11:52:09.538648 master-0 kubenswrapper[8993]: I1204 11:52:09.538545 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"58d12e893528ad53a994f10901a644ea","Type":"ContainerDied","Data":"27595dd7e9f331fc7dddae56f41801fd05186c63f10ec084212462612cf2ce37"} Dec 04 11:52:09.538648 master-0 kubenswrapper[8993]: I1204 11:52:09.538595 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"58d12e893528ad53a994f10901a644ea","Type":"ContainerStarted","Data":"941cfa04ddc49a585fc727a1dbdeb69c47e5f5f598b3a6ea4a0075889e24c1b1"} Dec 04 11:52:09.539361 master-0 kubenswrapper[8993]: I1204 11:52:09.538970 8993 kubelet.go:1909] "Trying to delete pod" pod="openshift-etcd/etcd-master-0" podUID="cec85ded-d31e-47da-9e71-fa808f6cadc0" Dec 04 11:52:09.539361 master-0 kubenswrapper[8993]: I1204 11:52:09.538985 8993 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0" podUID="cec85ded-d31e-47da-9e71-fa808f6cadc0" Dec 04 11:52:12.793904 master-0 kubenswrapper[8993]: I1204 11:52:12.793724 8993 scope.go:117] "RemoveContainer" containerID="4c7562d535711adc8257706a397e2c0b860bbf4a88ab43084f8db587572f489c" Dec 04 11:52:12.795328 master-0 kubenswrapper[8993]: E1204 11:52:12.794048 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:52:18.429689 master-0 kubenswrapper[8993]: E1204 11:52:18.429517 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="800ms" Dec 04 11:52:21.948589 master-0 kubenswrapper[8993]: I1204 11:52:21.948516 8993 scope.go:117] "RemoveContainer" containerID="4ff6dee660e0c3e8bcafff494b4715340832b97803c0a26ac5506e662b53b1ee" Dec 04 11:52:23.795253 master-0 kubenswrapper[8993]: I1204 11:52:23.795161 8993 scope.go:117] "RemoveContainer" containerID="4c7562d535711adc8257706a397e2c0b860bbf4a88ab43084f8db587572f489c" Dec 04 11:52:23.795841 master-0 kubenswrapper[8993]: E1204 11:52:23.795455 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:52:29.231443 master-0 kubenswrapper[8993]: E1204 11:52:29.231321 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="1.6s" Dec 04 11:52:35.946468 master-0 kubenswrapper[8993]: E1204 11:52:35.946291 8993 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{network-node-identity-f8hvq.187e004be0750b9f openshift-network-node-identity 9369 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-network-node-identity,Name:network-node-identity-f8hvq,UID:7203ec93-6572-4032-825c-140029a86058,APIVersion:v1,ResourceVersion:3298,FieldPath:spec.containers{approver},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3e65409fc2b27ad0aaeb500a39e264663d2980821f099b830b551785ce4ce8b\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:40:29 +0000 UTC,LastTimestamp:2025-12-04 11:51:58.473986097 +0000 UTC m=+852.864927530,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:52:37.717544 master-0 kubenswrapper[8993]: I1204 11:52:37.717474 8993 generic.go:334] "Generic (PLEG): container finished" podID="fd4c4c6f-380a-4cda-9a21-352b55ec2d98" containerID="44b8506d6a819dafeb21c5a4e661b7d718d0df7d433b1764865e76d91ef84eca" exitCode=0 Dec 04 11:52:37.717544 master-0 kubenswrapper[8993]: I1204 11:52:37.717529 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" event={"ID":"fd4c4c6f-380a-4cda-9a21-352b55ec2d98","Type":"ContainerDied","Data":"44b8506d6a819dafeb21c5a4e661b7d718d0df7d433b1764865e76d91ef84eca"} Dec 04 11:52:37.718268 master-0 kubenswrapper[8993]: I1204 11:52:37.717566 8993 scope.go:117] "RemoveContainer" containerID="efdaa968c7f62ed279952ab0bc764a0bd7b1fa6435a03cf5affa209a48cd298e" Dec 04 11:52:37.718268 master-0 kubenswrapper[8993]: I1204 11:52:37.718087 8993 scope.go:117] "RemoveContainer" containerID="44b8506d6a819dafeb21c5a4e661b7d718d0df7d433b1764865e76d91ef84eca" Dec 04 11:52:38.729254 master-0 kubenswrapper[8993]: I1204 11:52:38.729153 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" event={"ID":"fd4c4c6f-380a-4cda-9a21-352b55ec2d98","Type":"ContainerStarted","Data":"89db4c9e7a1f15edef2376bc38c5315348eb359a29dfa924891df6a33cb2f7e5"} Dec 04 11:52:38.729994 master-0 kubenswrapper[8993]: I1204 11:52:38.729937 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:52:38.732205 master-0 kubenswrapper[8993]: I1204 11:52:38.732107 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:52:38.795478 master-0 kubenswrapper[8993]: I1204 11:52:38.795345 8993 scope.go:117] "RemoveContainer" containerID="4c7562d535711adc8257706a397e2c0b860bbf4a88ab43084f8db587572f489c" Dec 04 11:52:38.796057 master-0 kubenswrapper[8993]: E1204 11:52:38.795992 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:52:40.832112 master-0 kubenswrapper[8993]: E1204 11:52:40.831995 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="3.2s" Dec 04 11:52:42.760895 master-0 kubenswrapper[8993]: I1204 11:52:42.760826 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-controller_operator-controller-controller-manager-7cbd59c7f8-qcz9t_1897bad8-3875-4bd6-b877-b1abe1fe76c7/manager/1.log" Dec 04 11:52:42.761955 master-0 kubenswrapper[8993]: I1204 11:52:42.761922 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-controller_operator-controller-controller-manager-7cbd59c7f8-qcz9t_1897bad8-3875-4bd6-b877-b1abe1fe76c7/manager/0.log" Dec 04 11:52:42.762023 master-0 kubenswrapper[8993]: I1204 11:52:42.761987 8993 generic.go:334] "Generic (PLEG): container finished" podID="1897bad8-3875-4bd6-b877-b1abe1fe76c7" containerID="87d19ac7ca9a3b1f2ae18249fc9bca976ae2df5c1da057ed782ff5452aa064ed" exitCode=1 Dec 04 11:52:42.762061 master-0 kubenswrapper[8993]: I1204 11:52:42.762031 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" event={"ID":"1897bad8-3875-4bd6-b877-b1abe1fe76c7","Type":"ContainerDied","Data":"87d19ac7ca9a3b1f2ae18249fc9bca976ae2df5c1da057ed782ff5452aa064ed"} Dec 04 11:52:42.762101 master-0 kubenswrapper[8993]: I1204 11:52:42.762083 8993 scope.go:117] "RemoveContainer" containerID="9c2fc9403fab0d35870e3bc56e7a58963be646e5a41f7dc3511733d940fb3a34" Dec 04 11:52:42.763163 master-0 kubenswrapper[8993]: I1204 11:52:42.763108 8993 scope.go:117] "RemoveContainer" containerID="87d19ac7ca9a3b1f2ae18249fc9bca976ae2df5c1da057ed782ff5452aa064ed" Dec 04 11:52:43.542070 master-0 kubenswrapper[8993]: E1204 11:52:43.541944 8993 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0" Dec 04 11:52:43.772282 master-0 kubenswrapper[8993]: I1204 11:52:43.772224 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-controller_operator-controller-controller-manager-7cbd59c7f8-qcz9t_1897bad8-3875-4bd6-b877-b1abe1fe76c7/manager/1.log" Dec 04 11:52:43.773547 master-0 kubenswrapper[8993]: I1204 11:52:43.773266 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" event={"ID":"1897bad8-3875-4bd6-b877-b1abe1fe76c7","Type":"ContainerStarted","Data":"516af80a6b1543d560759a7b981a4cb5acdf80045815ece9d76bdd6e0c80bd3b"} Dec 04 11:52:43.773547 master-0 kubenswrapper[8993]: I1204 11:52:43.773454 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:52:43.776339 master-0 kubenswrapper[8993]: I1204 11:52:43.776291 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-74f484689c-jmfn2_f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48/config-sync-controllers/0.log" Dec 04 11:52:43.776790 master-0 kubenswrapper[8993]: I1204 11:52:43.776745 8993 generic.go:334] "Generic (PLEG): container finished" podID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerID="7169aa966534042a209dbc77d82db08548c2b38ca834a1a1b58302b3c9862901" exitCode=1 Dec 04 11:52:43.776790 master-0 kubenswrapper[8993]: I1204 11:52:43.776786 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" event={"ID":"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48","Type":"ContainerDied","Data":"7169aa966534042a209dbc77d82db08548c2b38ca834a1a1b58302b3c9862901"} Dec 04 11:52:43.777130 master-0 kubenswrapper[8993]: I1204 11:52:43.777091 8993 scope.go:117] "RemoveContainer" containerID="7169aa966534042a209dbc77d82db08548c2b38ca834a1a1b58302b3c9862901" Dec 04 11:52:44.784986 master-0 kubenswrapper[8993]: I1204 11:52:44.784924 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-74f484689c-jmfn2_f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48/config-sync-controllers/0.log" Dec 04 11:52:44.785638 master-0 kubenswrapper[8993]: I1204 11:52:44.785414 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" event={"ID":"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48","Type":"ContainerStarted","Data":"522499db1b7f9c87ec01e1460e866cf06b4497c66a47056b8d594ba69f505901"} Dec 04 11:52:44.787304 master-0 kubenswrapper[8993]: I1204 11:52:44.787243 8993 generic.go:334] "Generic (PLEG): container finished" podID="58d12e893528ad53a994f10901a644ea" containerID="13b777a669c375f8fa5fb7dc16e22e01b0b37ff83c9fc781534d7ca1c75d6dcd" exitCode=0 Dec 04 11:52:44.787395 master-0 kubenswrapper[8993]: I1204 11:52:44.787320 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"58d12e893528ad53a994f10901a644ea","Type":"ContainerDied","Data":"13b777a669c375f8fa5fb7dc16e22e01b0b37ff83c9fc781534d7ca1c75d6dcd"} Dec 04 11:52:44.787735 master-0 kubenswrapper[8993]: I1204 11:52:44.787708 8993 kubelet.go:1909] "Trying to delete pod" pod="openshift-etcd/etcd-master-0" podUID="cec85ded-d31e-47da-9e71-fa808f6cadc0" Dec 04 11:52:44.787735 master-0 kubenswrapper[8993]: I1204 11:52:44.787728 8993 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0" podUID="cec85ded-d31e-47da-9e71-fa808f6cadc0" Dec 04 11:52:48.812999 master-0 kubenswrapper[8993]: I1204 11:52:48.812927 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/4.log" Dec 04 11:52:48.813644 master-0 kubenswrapper[8993]: I1204 11:52:48.813587 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/3.log" Dec 04 11:52:48.813704 master-0 kubenswrapper[8993]: I1204 11:52:48.813671 8993 generic.go:334] "Generic (PLEG): container finished" podID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" containerID="111212ae304e7d5562b925c64b167a8bb0864329ef48752767ee9569f220fa38" exitCode=1 Dec 04 11:52:48.813757 master-0 kubenswrapper[8993]: I1204 11:52:48.813720 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" event={"ID":"38fc8086-a00c-4a2a-8a0e-c57e9d9d0103","Type":"ContainerDied","Data":"111212ae304e7d5562b925c64b167a8bb0864329ef48752767ee9569f220fa38"} Dec 04 11:52:48.813824 master-0 kubenswrapper[8993]: I1204 11:52:48.813775 8993 scope.go:117] "RemoveContainer" containerID="83f6253eb08fd5330a71b18eaa18e87490f360d95e0ec3c32cf54a01fa26f615" Dec 04 11:52:48.814745 master-0 kubenswrapper[8993]: I1204 11:52:48.814672 8993 scope.go:117] "RemoveContainer" containerID="111212ae304e7d5562b925c64b167a8bb0864329ef48752767ee9569f220fa38" Dec 04 11:52:48.815297 master-0 kubenswrapper[8993]: E1204 11:52:48.815175 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:52:49.448865 master-0 kubenswrapper[8993]: I1204 11:52:49.448749 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:52:49.822855 master-0 kubenswrapper[8993]: I1204 11:52:49.822741 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/4.log" Dec 04 11:52:51.795046 master-0 kubenswrapper[8993]: I1204 11:52:51.794933 8993 scope.go:117] "RemoveContainer" containerID="4c7562d535711adc8257706a397e2c0b860bbf4a88ab43084f8db587572f489c" Dec 04 11:52:51.795788 master-0 kubenswrapper[8993]: E1204 11:52:51.795444 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:52:54.033638 master-0 kubenswrapper[8993]: E1204 11:52:54.033525 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="6.4s" Dec 04 11:52:55.815913 master-0 kubenswrapper[8993]: I1204 11:52:55.815823 8993 status_manager.go:851] "Failed to get status for pod" podUID="e6b437c60bb18680f4492b00b294e872" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" err="the server was unable to return a response in the time allotted, but may still be processing the request (get pods kube-controller-manager-master-0)" Dec 04 11:52:58.883437 master-0 kubenswrapper[8993]: I1204 11:52:58.883286 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-74f484689c-jmfn2_f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48/config-sync-controllers/0.log" Dec 04 11:52:58.883951 master-0 kubenswrapper[8993]: I1204 11:52:58.883929 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-74f484689c-jmfn2_f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48/cluster-cloud-controller-manager/0.log" Dec 04 11:52:58.883989 master-0 kubenswrapper[8993]: I1204 11:52:58.883970 8993 generic.go:334] "Generic (PLEG): container finished" podID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerID="a88d1f0e1d80ac478f7ad73d99091a69eb94f507aee6c58fd48df49c97a44d8d" exitCode=1 Dec 04 11:52:58.884028 master-0 kubenswrapper[8993]: I1204 11:52:58.884008 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" event={"ID":"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48","Type":"ContainerDied","Data":"a88d1f0e1d80ac478f7ad73d99091a69eb94f507aee6c58fd48df49c97a44d8d"} Dec 04 11:52:58.884551 master-0 kubenswrapper[8993]: I1204 11:52:58.884521 8993 scope.go:117] "RemoveContainer" containerID="a88d1f0e1d80ac478f7ad73d99091a69eb94f507aee6c58fd48df49c97a44d8d" Dec 04 11:52:59.794065 master-0 kubenswrapper[8993]: I1204 11:52:59.793952 8993 scope.go:117] "RemoveContainer" containerID="111212ae304e7d5562b925c64b167a8bb0864329ef48752767ee9569f220fa38" Dec 04 11:52:59.794643 master-0 kubenswrapper[8993]: E1204 11:52:59.794239 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:52:59.893299 master-0 kubenswrapper[8993]: I1204 11:52:59.893221 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-74f484689c-jmfn2_f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48/config-sync-controllers/0.log" Dec 04 11:52:59.894078 master-0 kubenswrapper[8993]: I1204 11:52:59.893983 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-74f484689c-jmfn2_f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48/cluster-cloud-controller-manager/0.log" Dec 04 11:52:59.894078 master-0 kubenswrapper[8993]: I1204 11:52:59.894060 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" event={"ID":"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48","Type":"ContainerStarted","Data":"e6c2fccf4e6fd6d2ffc424d145ecefb24910bddae93bdeeb548a2d4e20d0f630"} Dec 04 11:53:04.929236 master-0 kubenswrapper[8993]: I1204 11:53:04.928999 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-catalogd_catalogd-controller-manager-7cc89f4c4c-fd9pv_ee9a47b1-cdd9-43bc-8115-8851f29106e6/manager/1.log" Dec 04 11:53:04.930138 master-0 kubenswrapper[8993]: I1204 11:53:04.929787 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-catalogd_catalogd-controller-manager-7cc89f4c4c-fd9pv_ee9a47b1-cdd9-43bc-8115-8851f29106e6/manager/0.log" Dec 04 11:53:04.930671 master-0 kubenswrapper[8993]: I1204 11:53:04.930480 8993 generic.go:334] "Generic (PLEG): container finished" podID="ee9a47b1-cdd9-43bc-8115-8851f29106e6" containerID="51591cda8f462b13281f43dbc0b6afc384282884d691dc6e5a5e8196ffa850e4" exitCode=1 Dec 04 11:53:04.930774 master-0 kubenswrapper[8993]: I1204 11:53:04.930543 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" event={"ID":"ee9a47b1-cdd9-43bc-8115-8851f29106e6","Type":"ContainerDied","Data":"51591cda8f462b13281f43dbc0b6afc384282884d691dc6e5a5e8196ffa850e4"} Dec 04 11:53:04.930774 master-0 kubenswrapper[8993]: I1204 11:53:04.930759 8993 scope.go:117] "RemoveContainer" containerID="72abc724ed2d61f11cccbb7ec6d373328f957dd321cb6fd0e7f3d01b800d6a97" Dec 04 11:53:04.931699 master-0 kubenswrapper[8993]: I1204 11:53:04.931645 8993 scope.go:117] "RemoveContainer" containerID="51591cda8f462b13281f43dbc0b6afc384282884d691dc6e5a5e8196ffa850e4" Dec 04 11:53:05.794254 master-0 kubenswrapper[8993]: I1204 11:53:05.794181 8993 scope.go:117] "RemoveContainer" containerID="4c7562d535711adc8257706a397e2c0b860bbf4a88ab43084f8db587572f489c" Dec 04 11:53:05.794710 master-0 kubenswrapper[8993]: E1204 11:53:05.794468 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:53:05.941522 master-0 kubenswrapper[8993]: I1204 11:53:05.941460 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-catalogd_catalogd-controller-manager-7cc89f4c4c-fd9pv_ee9a47b1-cdd9-43bc-8115-8851f29106e6/manager/1.log" Dec 04 11:53:05.942202 master-0 kubenswrapper[8993]: I1204 11:53:05.941940 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" event={"ID":"ee9a47b1-cdd9-43bc-8115-8851f29106e6","Type":"ContainerStarted","Data":"2d0a3b6f732b806f42b1873563371670f077c7370590e28e69e27a142e4a3367"} Dec 04 11:53:05.942413 master-0 kubenswrapper[8993]: I1204 11:53:05.942378 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:53:09.949687 master-0 kubenswrapper[8993]: E1204 11:53:09.949518 8993 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{network-node-identity-f8hvq.187e004bf52ea1ec openshift-network-node-identity 9376 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-network-node-identity,Name:network-node-identity-f8hvq,UID:7203ec93-6572-4032-825c-140029a86058,APIVersion:v1,ResourceVersion:3298,FieldPath:spec.containers{approver},},Reason:Created,Message:Created container: approver,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:40:30 +0000 UTC,LastTimestamp:2025-12-04 11:51:58.599897234 +0000 UTC m=+852.991144267,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:53:10.435289 master-0 kubenswrapper[8993]: E1204 11:53:10.435197 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 11:53:13.795692 master-0 kubenswrapper[8993]: I1204 11:53:13.795590 8993 scope.go:117] "RemoveContainer" containerID="111212ae304e7d5562b925c64b167a8bb0864329ef48752767ee9569f220fa38" Dec 04 11:53:13.796694 master-0 kubenswrapper[8993]: E1204 11:53:13.796059 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:53:13.999458 master-0 kubenswrapper[8993]: I1204 11:53:13.999241 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/4.log" Dec 04 11:53:13.999949 master-0 kubenswrapper[8993]: I1204 11:53:13.999878 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/3.log" Dec 04 11:53:14.000277 master-0 kubenswrapper[8993]: I1204 11:53:14.000235 8993 generic.go:334] "Generic (PLEG): container finished" podID="b011b1f1-3235-4e20-825b-ce711c052407" containerID="871a505c71fcc987e64230846e4890828086e506f1b1d8a3456559bac6ecba8e" exitCode=1 Dec 04 11:53:14.000402 master-0 kubenswrapper[8993]: I1204 11:53:14.000284 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" event={"ID":"b011b1f1-3235-4e20-825b-ce711c052407","Type":"ContainerDied","Data":"871a505c71fcc987e64230846e4890828086e506f1b1d8a3456559bac6ecba8e"} Dec 04 11:53:14.000402 master-0 kubenswrapper[8993]: I1204 11:53:14.000325 8993 scope.go:117] "RemoveContainer" containerID="b1b01aacbe726c1a48bdae3716b824c6fb7d8a51508f9d95ea11272ad0522b94" Dec 04 11:53:14.001170 master-0 kubenswrapper[8993]: I1204 11:53:14.001059 8993 scope.go:117] "RemoveContainer" containerID="871a505c71fcc987e64230846e4890828086e506f1b1d8a3456559bac6ecba8e" Dec 04 11:53:14.001432 master-0 kubenswrapper[8993]: E1204 11:53:14.001359 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=ingress-operator pod=ingress-operator-8649c48786-cx2b2_openshift-ingress-operator(b011b1f1-3235-4e20-825b-ce711c052407)\"" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" podUID="b011b1f1-3235-4e20-825b-ce711c052407" Dec 04 11:53:15.008775 master-0 kubenswrapper[8993]: I1204 11:53:15.008723 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/4.log" Dec 04 11:53:17.794432 master-0 kubenswrapper[8993]: I1204 11:53:17.794138 8993 scope.go:117] "RemoveContainer" containerID="4c7562d535711adc8257706a397e2c0b860bbf4a88ab43084f8db587572f489c" Dec 04 11:53:17.794954 master-0 kubenswrapper[8993]: E1204 11:53:17.794548 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:53:18.791209 master-0 kubenswrapper[8993]: E1204 11:53:18.791121 8993 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0" Dec 04 11:53:19.004409 master-0 kubenswrapper[8993]: I1204 11:53:19.004267 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:53:19.046592 master-0 kubenswrapper[8993]: I1204 11:53:19.046467 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"58d12e893528ad53a994f10901a644ea","Type":"ContainerStarted","Data":"d1e0ff4c34bb2478448af3eb31ad0b50e5dd734dc0f6051803b3b18d3de656bf"} Dec 04 11:53:19.047228 master-0 kubenswrapper[8993]: I1204 11:53:19.047180 8993 kubelet.go:1909] "Trying to delete pod" pod="openshift-etcd/etcd-master-0" podUID="cec85ded-d31e-47da-9e71-fa808f6cadc0" Dec 04 11:53:19.047228 master-0 kubenswrapper[8993]: I1204 11:53:19.047219 8993 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0" podUID="cec85ded-d31e-47da-9e71-fa808f6cadc0" Dec 04 11:53:19.053520 master-0 kubenswrapper[8993]: E1204 11:53:19.053442 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:53:09Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:53:09Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:53:09Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:53:09Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"master-0\": Patch \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0/status?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:53:20.056344 master-0 kubenswrapper[8993]: I1204 11:53:20.056271 8993 generic.go:334] "Generic (PLEG): container finished" podID="58d12e893528ad53a994f10901a644ea" containerID="d1e0ff4c34bb2478448af3eb31ad0b50e5dd734dc0f6051803b3b18d3de656bf" exitCode=0 Dec 04 11:53:20.056344 master-0 kubenswrapper[8993]: I1204 11:53:20.056342 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"58d12e893528ad53a994f10901a644ea","Type":"ContainerDied","Data":"d1e0ff4c34bb2478448af3eb31ad0b50e5dd734dc0f6051803b3b18d3de656bf"} Dec 04 11:53:23.078055 master-0 kubenswrapper[8993]: I1204 11:53:23.077994 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_control-plane-machine-set-operator-7df95c79b5-7w5lm_14bd3485-aa02-4984-b4a3-59f360b1b327/control-plane-machine-set-operator/1.log" Dec 04 11:53:23.078668 master-0 kubenswrapper[8993]: I1204 11:53:23.078634 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_control-plane-machine-set-operator-7df95c79b5-7w5lm_14bd3485-aa02-4984-b4a3-59f360b1b327/control-plane-machine-set-operator/0.log" Dec 04 11:53:23.078716 master-0 kubenswrapper[8993]: I1204 11:53:23.078688 8993 generic.go:334] "Generic (PLEG): container finished" podID="14bd3485-aa02-4984-b4a3-59f360b1b327" containerID="41aa69685919e7f8f8af95aebbe0bc4d44d4ceec0966f5cc37e23c82ff7f99c8" exitCode=1 Dec 04 11:53:23.078775 master-0 kubenswrapper[8993]: I1204 11:53:23.078751 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm" event={"ID":"14bd3485-aa02-4984-b4a3-59f360b1b327","Type":"ContainerDied","Data":"41aa69685919e7f8f8af95aebbe0bc4d44d4ceec0966f5cc37e23c82ff7f99c8"} Dec 04 11:53:23.078864 master-0 kubenswrapper[8993]: I1204 11:53:23.078840 8993 scope.go:117] "RemoveContainer" containerID="aeee1a4ddc268ca9307b81e79359b2f59515c9c502aecb0723e30ace49120598" Dec 04 11:53:23.079471 master-0 kubenswrapper[8993]: I1204 11:53:23.079431 8993 scope.go:117] "RemoveContainer" containerID="41aa69685919e7f8f8af95aebbe0bc4d44d4ceec0966f5cc37e23c82ff7f99c8" Dec 04 11:53:24.096628 master-0 kubenswrapper[8993]: I1204 11:53:24.096560 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_control-plane-machine-set-operator-7df95c79b5-7w5lm_14bd3485-aa02-4984-b4a3-59f360b1b327/control-plane-machine-set-operator/1.log" Dec 04 11:53:24.097174 master-0 kubenswrapper[8993]: I1204 11:53:24.096657 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm" event={"ID":"14bd3485-aa02-4984-b4a3-59f360b1b327","Type":"ContainerStarted","Data":"50a247f3243f1bb031bb64b878cb6bfaf702184aa3baa530e6774c26f20acc72"} Dec 04 11:53:27.437389 master-0 kubenswrapper[8993]: E1204 11:53:27.437293 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 11:53:28.794105 master-0 kubenswrapper[8993]: I1204 11:53:28.793891 8993 scope.go:117] "RemoveContainer" containerID="871a505c71fcc987e64230846e4890828086e506f1b1d8a3456559bac6ecba8e" Dec 04 11:53:28.794780 master-0 kubenswrapper[8993]: E1204 11:53:28.794157 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=ingress-operator pod=ingress-operator-8649c48786-cx2b2_openshift-ingress-operator(b011b1f1-3235-4e20-825b-ce711c052407)\"" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" podUID="b011b1f1-3235-4e20-825b-ce711c052407" Dec 04 11:53:28.794780 master-0 kubenswrapper[8993]: I1204 11:53:28.794327 8993 scope.go:117] "RemoveContainer" containerID="111212ae304e7d5562b925c64b167a8bb0864329ef48752767ee9569f220fa38" Dec 04 11:53:28.794780 master-0 kubenswrapper[8993]: I1204 11:53:28.794467 8993 scope.go:117] "RemoveContainer" containerID="4c7562d535711adc8257706a397e2c0b860bbf4a88ab43084f8db587572f489c" Dec 04 11:53:28.794780 master-0 kubenswrapper[8993]: E1204 11:53:28.794700 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:53:28.794997 master-0 kubenswrapper[8993]: E1204 11:53:28.794797 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:53:29.054446 master-0 kubenswrapper[8993]: E1204 11:53:29.054325 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": the server was unable to return a response in the time allotted, but may still be processing the request (get nodes master-0)" Dec 04 11:53:29.128966 master-0 kubenswrapper[8993]: I1204 11:53:29.128931 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_bdd20c68f1ccfd1240fb273af0638d01/kube-scheduler/0.log" Dec 04 11:53:29.129460 master-0 kubenswrapper[8993]: I1204 11:53:29.129405 8993 generic.go:334] "Generic (PLEG): container finished" podID="bdd20c68f1ccfd1240fb273af0638d01" containerID="e892e4a03cb775cc984461c05f66ebb315e6e3256740bfe4765f9efa5a82a35d" exitCode=1 Dec 04 11:53:29.129537 master-0 kubenswrapper[8993]: I1204 11:53:29.129461 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"bdd20c68f1ccfd1240fb273af0638d01","Type":"ContainerDied","Data":"e892e4a03cb775cc984461c05f66ebb315e6e3256740bfe4765f9efa5a82a35d"} Dec 04 11:53:29.130043 master-0 kubenswrapper[8993]: I1204 11:53:29.130022 8993 scope.go:117] "RemoveContainer" containerID="e892e4a03cb775cc984461c05f66ebb315e6e3256740bfe4765f9efa5a82a35d" Dec 04 11:53:30.137256 master-0 kubenswrapper[8993]: I1204 11:53:30.137053 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-78f758c7b9-zgkh5_7e3160a9-11d1-4845-ba30-1a49ae7339a9/cluster-baremetal-operator/3.log" Dec 04 11:53:30.138221 master-0 kubenswrapper[8993]: I1204 11:53:30.138040 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-78f758c7b9-zgkh5_7e3160a9-11d1-4845-ba30-1a49ae7339a9/cluster-baremetal-operator/2.log" Dec 04 11:53:30.139060 master-0 kubenswrapper[8993]: I1204 11:53:30.138945 8993 generic.go:334] "Generic (PLEG): container finished" podID="7e3160a9-11d1-4845-ba30-1a49ae7339a9" containerID="fb9fc7d90e1a7f1b9941af4021fef36a6cf8ea28ed08b7fb03d0f413775fbd30" exitCode=1 Dec 04 11:53:30.139060 master-0 kubenswrapper[8993]: I1204 11:53:30.139025 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" event={"ID":"7e3160a9-11d1-4845-ba30-1a49ae7339a9","Type":"ContainerDied","Data":"fb9fc7d90e1a7f1b9941af4021fef36a6cf8ea28ed08b7fb03d0f413775fbd30"} Dec 04 11:53:30.139288 master-0 kubenswrapper[8993]: I1204 11:53:30.139092 8993 scope.go:117] "RemoveContainer" containerID="5a4d065f4aef4c58a64842a3b127c4de733504b1bb6ebdb85310e09d409339ca" Dec 04 11:53:30.139967 master-0 kubenswrapper[8993]: I1204 11:53:30.139910 8993 scope.go:117] "RemoveContainer" containerID="fb9fc7d90e1a7f1b9941af4021fef36a6cf8ea28ed08b7fb03d0f413775fbd30" Dec 04 11:53:30.140435 master-0 kubenswrapper[8993]: E1204 11:53:30.140371 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-baremetal-operator\" with CrashLoopBackOff: \"back-off 40s restarting failed container=cluster-baremetal-operator pod=cluster-baremetal-operator-78f758c7b9-zgkh5_openshift-machine-api(7e3160a9-11d1-4845-ba30-1a49ae7339a9)\"" pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" podUID="7e3160a9-11d1-4845-ba30-1a49ae7339a9" Dec 04 11:53:30.143869 master-0 kubenswrapper[8993]: I1204 11:53:30.143801 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_bdd20c68f1ccfd1240fb273af0638d01/kube-scheduler/0.log" Dec 04 11:53:30.144479 master-0 kubenswrapper[8993]: I1204 11:53:30.144433 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"bdd20c68f1ccfd1240fb273af0638d01","Type":"ContainerStarted","Data":"e2713a2b9adf8ac2cd64c11a8cc47639892df9751d3f6828f4bd8b7f6c344a80"} Dec 04 11:53:30.144826 master-0 kubenswrapper[8993]: I1204 11:53:30.144729 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 11:53:31.153088 master-0 kubenswrapper[8993]: I1204 11:53:31.153029 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-78f758c7b9-zgkh5_7e3160a9-11d1-4845-ba30-1a49ae7339a9/cluster-baremetal-operator/3.log" Dec 04 11:53:33.167638 master-0 kubenswrapper[8993]: I1204 11:53:33.167564 8993 generic.go:334] "Generic (PLEG): container finished" podID="287fba2d-f56d-4ec0-b796-7849a68fb411" containerID="de49dc04e865afee596ae644e0ffa161db1e2290ebe2db9cc519ab9cf67d5aa9" exitCode=0 Dec 04 11:53:33.168317 master-0 kubenswrapper[8993]: I1204 11:53:33.167673 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" event={"ID":"287fba2d-f56d-4ec0-b796-7849a68fb411","Type":"ContainerDied","Data":"de49dc04e865afee596ae644e0ffa161db1e2290ebe2db9cc519ab9cf67d5aa9"} Dec 04 11:53:33.168317 master-0 kubenswrapper[8993]: I1204 11:53:33.167766 8993 scope.go:117] "RemoveContainer" containerID="a98c972089f945f20cf6cc807089551b4b9f89664b6a5a78412dd79091e473a5" Dec 04 11:53:33.168475 master-0 kubenswrapper[8993]: I1204 11:53:33.168445 8993 scope.go:117] "RemoveContainer" containerID="de49dc04e865afee596ae644e0ffa161db1e2290ebe2db9cc519ab9cf67d5aa9" Dec 04 11:53:33.171698 master-0 kubenswrapper[8993]: I1204 11:53:33.171669 8993 generic.go:334] "Generic (PLEG): container finished" podID="cdb50850-779d-4179-ba1d-65ffeb4bb2e9" containerID="3bcbd231509913c4a508bf39ec4788d7227ea3b5ad2a02de0790fac547297cf4" exitCode=0 Dec 04 11:53:33.171769 master-0 kubenswrapper[8993]: I1204 11:53:33.171714 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" event={"ID":"cdb50850-779d-4179-ba1d-65ffeb4bb2e9","Type":"ContainerDied","Data":"3bcbd231509913c4a508bf39ec4788d7227ea3b5ad2a02de0790fac547297cf4"} Dec 04 11:53:33.172086 master-0 kubenswrapper[8993]: I1204 11:53:33.172065 8993 scope.go:117] "RemoveContainer" containerID="3bcbd231509913c4a508bf39ec4788d7227ea3b5ad2a02de0790fac547297cf4" Dec 04 11:53:34.195117 master-0 kubenswrapper[8993]: I1204 11:53:34.194990 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" event={"ID":"287fba2d-f56d-4ec0-b796-7849a68fb411","Type":"ContainerStarted","Data":"fc62eb51e2e45756c79eb4216ec20eaf9d1bb07904c8d41be1bbc0eb61439d70"} Dec 04 11:53:34.197272 master-0 kubenswrapper[8993]: I1204 11:53:34.197216 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" event={"ID":"cdb50850-779d-4179-ba1d-65ffeb4bb2e9","Type":"ContainerStarted","Data":"c5f5f1f7464567acecbfb64144a65775c557ceb3146468b7a5cd1ebd81a55aa4"} Dec 04 11:53:35.205872 master-0 kubenswrapper[8993]: I1204 11:53:35.205789 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-lifecycle-manager_package-server-manager-67477646d4-7hndf_72faf6d6-e8ca-43d1-b93e-67c11f8d3b46/package-server-manager/1.log" Dec 04 11:53:35.206545 master-0 kubenswrapper[8993]: I1204 11:53:35.206508 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-lifecycle-manager_package-server-manager-67477646d4-7hndf_72faf6d6-e8ca-43d1-b93e-67c11f8d3b46/package-server-manager/0.log" Dec 04 11:53:35.207307 master-0 kubenswrapper[8993]: I1204 11:53:35.207278 8993 generic.go:334] "Generic (PLEG): container finished" podID="72faf6d6-e8ca-43d1-b93e-67c11f8d3b46" containerID="d9c0a6f2319e382b7fe02ed5c5fa7e0a89c76eff9a028d94eddc90a3aa1de179" exitCode=1 Dec 04 11:53:35.207377 master-0 kubenswrapper[8993]: I1204 11:53:35.207317 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" event={"ID":"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46","Type":"ContainerDied","Data":"d9c0a6f2319e382b7fe02ed5c5fa7e0a89c76eff9a028d94eddc90a3aa1de179"} Dec 04 11:53:35.207412 master-0 kubenswrapper[8993]: I1204 11:53:35.207397 8993 scope.go:117] "RemoveContainer" containerID="75e7ab729f90601f1a3824e70ddebf2fb143cea828b4fc655dacf16540161a43" Dec 04 11:53:35.207968 master-0 kubenswrapper[8993]: I1204 11:53:35.207947 8993 scope.go:117] "RemoveContainer" containerID="d9c0a6f2319e382b7fe02ed5c5fa7e0a89c76eff9a028d94eddc90a3aa1de179" Dec 04 11:53:35.208150 master-0 kubenswrapper[8993]: E1204 11:53:35.208127 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"package-server-manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=package-server-manager pod=package-server-manager-67477646d4-7hndf_openshift-operator-lifecycle-manager(72faf6d6-e8ca-43d1-b93e-67c11f8d3b46)\"" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" podUID="72faf6d6-e8ca-43d1-b93e-67c11f8d3b46" Dec 04 11:53:36.217424 master-0 kubenswrapper[8993]: I1204 11:53:36.217369 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-lifecycle-manager_package-server-manager-67477646d4-7hndf_72faf6d6-e8ca-43d1-b93e-67c11f8d3b46/package-server-manager/1.log" Dec 04 11:53:38.231202 master-0 kubenswrapper[8993]: I1204 11:53:38.231133 8993 generic.go:334] "Generic (PLEG): container finished" podID="24506aa4-ab78-49df-bb58-59093498f13d" containerID="89ac9be46243609bde604f4ef89b49eac3ee3ceca2042c8efeae7607ac835469" exitCode=0 Dec 04 11:53:38.231868 master-0 kubenswrapper[8993]: I1204 11:53:38.231204 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" event={"ID":"24506aa4-ab78-49df-bb58-59093498f13d","Type":"ContainerDied","Data":"89ac9be46243609bde604f4ef89b49eac3ee3ceca2042c8efeae7607ac835469"} Dec 04 11:53:38.231868 master-0 kubenswrapper[8993]: I1204 11:53:38.231789 8993 scope.go:117] "RemoveContainer" containerID="89ac9be46243609bde604f4ef89b49eac3ee3ceca2042c8efeae7607ac835469" Dec 04 11:53:38.659469 master-0 kubenswrapper[8993]: I1204 11:53:38.659372 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:53:38.659469 master-0 kubenswrapper[8993]: I1204 11:53:38.659473 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:53:38.865763 master-0 kubenswrapper[8993]: I1204 11:53:38.865717 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:53:38.865763 master-0 kubenswrapper[8993]: I1204 11:53:38.865767 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:53:38.866414 master-0 kubenswrapper[8993]: I1204 11:53:38.866375 8993 scope.go:117] "RemoveContainer" containerID="d9c0a6f2319e382b7fe02ed5c5fa7e0a89c76eff9a028d94eddc90a3aa1de179" Dec 04 11:53:38.866656 master-0 kubenswrapper[8993]: E1204 11:53:38.866604 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"package-server-manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=package-server-manager pod=package-server-manager-67477646d4-7hndf_openshift-operator-lifecycle-manager(72faf6d6-e8ca-43d1-b93e-67c11f8d3b46)\"" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" podUID="72faf6d6-e8ca-43d1-b93e-67c11f8d3b46" Dec 04 11:53:39.055750 master-0 kubenswrapper[8993]: E1204 11:53:39.055485 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:53:39.240453 master-0 kubenswrapper[8993]: I1204 11:53:39.240382 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" event={"ID":"24506aa4-ab78-49df-bb58-59093498f13d","Type":"ContainerStarted","Data":"c38ff2120777ff8b1be511702637cc316f617c906d6a31bbe9e628d01aaa9983"} Dec 04 11:53:39.241156 master-0 kubenswrapper[8993]: I1204 11:53:39.240675 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:53:39.245642 master-0 kubenswrapper[8993]: I1204 11:53:39.245594 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:53:39.794370 master-0 kubenswrapper[8993]: I1204 11:53:39.794285 8993 scope.go:117] "RemoveContainer" containerID="111212ae304e7d5562b925c64b167a8bb0864329ef48752767ee9569f220fa38" Dec 04 11:53:39.794628 master-0 kubenswrapper[8993]: I1204 11:53:39.794510 8993 scope.go:117] "RemoveContainer" containerID="4c7562d535711adc8257706a397e2c0b860bbf4a88ab43084f8db587572f489c" Dec 04 11:53:39.794628 master-0 kubenswrapper[8993]: E1204 11:53:39.794577 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:53:39.794839 master-0 kubenswrapper[8993]: E1204 11:53:39.794794 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:53:40.249579 master-0 kubenswrapper[8993]: I1204 11:53:40.249502 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-machine-approver_machine-approver-f797d8546-qvgbq_c835660f-5a79-4679-b9be-8543ca6ef5a1/machine-approver-controller/0.log" Dec 04 11:53:40.250371 master-0 kubenswrapper[8993]: I1204 11:53:40.250079 8993 generic.go:334] "Generic (PLEG): container finished" podID="c835660f-5a79-4679-b9be-8543ca6ef5a1" containerID="749b44ec9e8d4f00f1e655c70a503d3b1ce1085e0a7eecca2e01f8fe90a6e0c2" exitCode=255 Dec 04 11:53:40.250371 master-0 kubenswrapper[8993]: I1204 11:53:40.250183 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" event={"ID":"c835660f-5a79-4679-b9be-8543ca6ef5a1","Type":"ContainerDied","Data":"749b44ec9e8d4f00f1e655c70a503d3b1ce1085e0a7eecca2e01f8fe90a6e0c2"} Dec 04 11:53:40.251073 master-0 kubenswrapper[8993]: I1204 11:53:40.251035 8993 scope.go:117] "RemoveContainer" containerID="749b44ec9e8d4f00f1e655c70a503d3b1ce1085e0a7eecca2e01f8fe90a6e0c2" Dec 04 11:53:41.262208 master-0 kubenswrapper[8993]: I1204 11:53:41.262057 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-machine-approver_machine-approver-f797d8546-qvgbq_c835660f-5a79-4679-b9be-8543ca6ef5a1/machine-approver-controller/0.log" Dec 04 11:53:41.263005 master-0 kubenswrapper[8993]: I1204 11:53:41.262955 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" event={"ID":"c835660f-5a79-4679-b9be-8543ca6ef5a1","Type":"ContainerStarted","Data":"699a63b2d7941ed4336c1635f023cff1f0486ae2fd4b4873876780d919314e24"} Dec 04 11:53:42.795040 master-0 kubenswrapper[8993]: I1204 11:53:42.794976 8993 scope.go:117] "RemoveContainer" containerID="fb9fc7d90e1a7f1b9941af4021fef36a6cf8ea28ed08b7fb03d0f413775fbd30" Dec 04 11:53:42.795601 master-0 kubenswrapper[8993]: I1204 11:53:42.795165 8993 scope.go:117] "RemoveContainer" containerID="871a505c71fcc987e64230846e4890828086e506f1b1d8a3456559bac6ecba8e" Dec 04 11:53:42.795601 master-0 kubenswrapper[8993]: E1204 11:53:42.795349 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-baremetal-operator\" with CrashLoopBackOff: \"back-off 40s restarting failed container=cluster-baremetal-operator pod=cluster-baremetal-operator-78f758c7b9-zgkh5_openshift-machine-api(7e3160a9-11d1-4845-ba30-1a49ae7339a9)\"" pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" podUID="7e3160a9-11d1-4845-ba30-1a49ae7339a9" Dec 04 11:53:42.795601 master-0 kubenswrapper[8993]: E1204 11:53:42.795572 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=ingress-operator pod=ingress-operator-8649c48786-cx2b2_openshift-ingress-operator(b011b1f1-3235-4e20-825b-ce711c052407)\"" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" podUID="b011b1f1-3235-4e20-825b-ce711c052407" Dec 04 11:53:43.952768 master-0 kubenswrapper[8993]: E1204 11:53:43.952535 8993 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{network-node-identity-f8hvq.187e004bf67a4ff7 openshift-network-node-identity 9379 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-network-node-identity,Name:network-node-identity-f8hvq,UID:7203ec93-6572-4032-825c-140029a86058,APIVersion:v1,ResourceVersion:3298,FieldPath:spec.containers{approver},},Reason:Started,Message:Started container approver,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:40:30 +0000 UTC,LastTimestamp:2025-12-04 11:51:58.610114454 +0000 UTC m=+853.001055887,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:53:44.438788 master-0 kubenswrapper[8993]: E1204 11:53:44.438715 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 11:53:49.056828 master-0 kubenswrapper[8993]: E1204 11:53:49.056667 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:53:52.794667 master-0 kubenswrapper[8993]: I1204 11:53:52.794588 8993 scope.go:117] "RemoveContainer" containerID="4c7562d535711adc8257706a397e2c0b860bbf4a88ab43084f8db587572f489c" Dec 04 11:53:52.795361 master-0 kubenswrapper[8993]: E1204 11:53:52.794938 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:53:52.795361 master-0 kubenswrapper[8993]: I1204 11:53:52.795088 8993 scope.go:117] "RemoveContainer" containerID="111212ae304e7d5562b925c64b167a8bb0864329ef48752767ee9569f220fa38" Dec 04 11:53:52.795361 master-0 kubenswrapper[8993]: E1204 11:53:52.795313 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:53:53.050003 master-0 kubenswrapper[8993]: E1204 11:53:53.049871 8993 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0" Dec 04 11:53:53.341291 master-0 kubenswrapper[8993]: I1204 11:53:53.341160 8993 kubelet.go:1909] "Trying to delete pod" pod="openshift-etcd/etcd-master-0" podUID="cec85ded-d31e-47da-9e71-fa808f6cadc0" Dec 04 11:53:53.341291 master-0 kubenswrapper[8993]: I1204 11:53:53.341212 8993 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0" podUID="cec85ded-d31e-47da-9e71-fa808f6cadc0" Dec 04 11:53:53.795450 master-0 kubenswrapper[8993]: I1204 11:53:53.795289 8993 scope.go:117] "RemoveContainer" containerID="fb9fc7d90e1a7f1b9941af4021fef36a6cf8ea28ed08b7fb03d0f413775fbd30" Dec 04 11:53:53.796112 master-0 kubenswrapper[8993]: E1204 11:53:53.795664 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-baremetal-operator\" with CrashLoopBackOff: \"back-off 40s restarting failed container=cluster-baremetal-operator pod=cluster-baremetal-operator-78f758c7b9-zgkh5_openshift-machine-api(7e3160a9-11d1-4845-ba30-1a49ae7339a9)\"" pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" podUID="7e3160a9-11d1-4845-ba30-1a49ae7339a9" Dec 04 11:53:54.795767 master-0 kubenswrapper[8993]: I1204 11:53:54.795649 8993 scope.go:117] "RemoveContainer" containerID="d9c0a6f2319e382b7fe02ed5c5fa7e0a89c76eff9a028d94eddc90a3aa1de179" Dec 04 11:53:55.355003 master-0 kubenswrapper[8993]: I1204 11:53:55.354895 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-lifecycle-manager_package-server-manager-67477646d4-7hndf_72faf6d6-e8ca-43d1-b93e-67c11f8d3b46/package-server-manager/1.log" Dec 04 11:53:55.355529 master-0 kubenswrapper[8993]: I1204 11:53:55.355484 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" event={"ID":"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46","Type":"ContainerStarted","Data":"b93952141b54f54e235f57ac8079e4842cc069b37f33f98481ce7921b6c9dcae"} Dec 04 11:53:55.355874 master-0 kubenswrapper[8993]: I1204 11:53:55.355784 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:53:55.817355 master-0 kubenswrapper[8993]: I1204 11:53:55.817253 8993 status_manager.go:851] "Failed to get status for pod" podUID="27c4e782-11b4-43a3-9ffd-34bf4e40bbc4" pod="openshift-kube-controller-manager/installer-3-master-0" err="the server was unable to return a response in the time allotted, but may still be processing the request (get pods installer-3-master-0)" Dec 04 11:53:57.795384 master-0 kubenswrapper[8993]: I1204 11:53:57.795306 8993 scope.go:117] "RemoveContainer" containerID="871a505c71fcc987e64230846e4890828086e506f1b1d8a3456559bac6ecba8e" Dec 04 11:53:57.795999 master-0 kubenswrapper[8993]: E1204 11:53:57.795609 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=ingress-operator pod=ingress-operator-8649c48786-cx2b2_openshift-ingress-operator(b011b1f1-3235-4e20-825b-ce711c052407)\"" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" podUID="b011b1f1-3235-4e20-825b-ce711c052407" Dec 04 11:53:59.057947 master-0 kubenswrapper[8993]: E1204 11:53:59.057861 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:53:59.057947 master-0 kubenswrapper[8993]: E1204 11:53:59.057934 8993 kubelet_node_status.go:572] "Unable to update node status" err="update node status exceeds retry count" Dec 04 11:54:01.440829 master-0 kubenswrapper[8993]: E1204 11:54:01.440710 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 11:54:04.794575 master-0 kubenswrapper[8993]: I1204 11:54:04.794502 8993 scope.go:117] "RemoveContainer" containerID="111212ae304e7d5562b925c64b167a8bb0864329ef48752767ee9569f220fa38" Dec 04 11:54:04.794575 master-0 kubenswrapper[8993]: I1204 11:54:04.794569 8993 scope.go:117] "RemoveContainer" containerID="4c7562d535711adc8257706a397e2c0b860bbf4a88ab43084f8db587572f489c" Dec 04 11:54:04.795338 master-0 kubenswrapper[8993]: E1204 11:54:04.794784 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:54:04.795338 master-0 kubenswrapper[8993]: E1204 11:54:04.794796 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:54:06.794502 master-0 kubenswrapper[8993]: I1204 11:54:06.794394 8993 scope.go:117] "RemoveContainer" containerID="fb9fc7d90e1a7f1b9941af4021fef36a6cf8ea28ed08b7fb03d0f413775fbd30" Dec 04 11:54:06.795090 master-0 kubenswrapper[8993]: E1204 11:54:06.794750 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-baremetal-operator\" with CrashLoopBackOff: \"back-off 40s restarting failed container=cluster-baremetal-operator pod=cluster-baremetal-operator-78f758c7b9-zgkh5_openshift-machine-api(7e3160a9-11d1-4845-ba30-1a49ae7339a9)\"" pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" podUID="7e3160a9-11d1-4845-ba30-1a49ae7339a9" Dec 04 11:54:11.795218 master-0 kubenswrapper[8993]: I1204 11:54:11.795109 8993 scope.go:117] "RemoveContainer" containerID="871a505c71fcc987e64230846e4890828086e506f1b1d8a3456559bac6ecba8e" Dec 04 11:54:11.796115 master-0 kubenswrapper[8993]: E1204 11:54:11.795890 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=ingress-operator pod=ingress-operator-8649c48786-cx2b2_openshift-ingress-operator(b011b1f1-3235-4e20-825b-ce711c052407)\"" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" podUID="b011b1f1-3235-4e20-825b-ce711c052407" Dec 04 11:54:15.794085 master-0 kubenswrapper[8993]: I1204 11:54:15.793972 8993 scope.go:117] "RemoveContainer" containerID="111212ae304e7d5562b925c64b167a8bb0864329ef48752767ee9569f220fa38" Dec 04 11:54:16.489869 master-0 kubenswrapper[8993]: I1204 11:54:16.489294 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/4.log" Dec 04 11:54:16.489869 master-0 kubenswrapper[8993]: I1204 11:54:16.489526 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" event={"ID":"38fc8086-a00c-4a2a-8a0e-c57e9d9d0103","Type":"ContainerStarted","Data":"c3d6e3ec1c2075f0d2c2e41480f7486576efc2d0e3c1b8e7a0df0f84b64a6eb3"} Dec 04 11:54:16.795043 master-0 kubenswrapper[8993]: I1204 11:54:16.794963 8993 scope.go:117] "RemoveContainer" containerID="4c7562d535711adc8257706a397e2c0b860bbf4a88ab43084f8db587572f489c" Dec 04 11:54:17.500184 master-0 kubenswrapper[8993]: I1204 11:54:17.500102 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/6.log" Dec 04 11:54:17.501143 master-0 kubenswrapper[8993]: I1204 11:54:17.501101 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce"} Dec 04 11:54:17.956396 master-0 kubenswrapper[8993]: E1204 11:54:17.956245 8993 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{etcd-master-0.187e00ee9ea8f93b openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0,UID:58d12e893528ad53a994f10901a644ea,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:188637a52cafee61ec461e92fb0c605e28be325b9ac1f2ac8a37d68e97654718\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:52:08.839903547 +0000 UTC m=+863.230844980,LastTimestamp:2025-12-04 11:52:08.839903547 +0000 UTC m=+863.230844980,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:54:18.442100 master-0 kubenswrapper[8993]: E1204 11:54:18.442003 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 11:54:21.794539 master-0 kubenswrapper[8993]: I1204 11:54:21.794452 8993 scope.go:117] "RemoveContainer" containerID="fb9fc7d90e1a7f1b9941af4021fef36a6cf8ea28ed08b7fb03d0f413775fbd30" Dec 04 11:54:22.532870 master-0 kubenswrapper[8993]: I1204 11:54:22.532791 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-78f758c7b9-zgkh5_7e3160a9-11d1-4845-ba30-1a49ae7339a9/cluster-baremetal-operator/3.log" Dec 04 11:54:22.533360 master-0 kubenswrapper[8993]: I1204 11:54:22.533301 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" event={"ID":"7e3160a9-11d1-4845-ba30-1a49ae7339a9","Type":"ContainerStarted","Data":"32e66f745e18dc99b4c4e9785252ea6bac8b15ebf03d317797384ca1ae5092e7"} Dec 04 11:54:23.854506 master-0 kubenswrapper[8993]: I1204 11:54:23.854432 8993 patch_prober.go:28] interesting pod/openshift-kube-scheduler-master-0 container/kube-scheduler namespace/openshift-kube-scheduler: Liveness probe status=failure output="Get \"https://192.168.32.10:10259/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:54:23.855260 master-0 kubenswrapper[8993]: I1204 11:54:23.854524 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler" probeResult="failure" output="Get \"https://192.168.32.10:10259/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:54:23.855260 master-0 kubenswrapper[8993]: I1204 11:54:23.854471 8993 patch_prober.go:28] interesting pod/openshift-kube-scheduler-master-0 container/kube-scheduler namespace/openshift-kube-scheduler: Readiness probe status=failure output="Get \"https://192.168.32.10:10259/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:54:23.855260 master-0 kubenswrapper[8993]: I1204 11:54:23.855106 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler" probeResult="failure" output="Get \"https://192.168.32.10:10259/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:54:24.570904 master-0 kubenswrapper[8993]: I1204 11:54:24.570785 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:54:24.570904 master-0 kubenswrapper[8993]: I1204 11:54:24.570911 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:54:25.794257 master-0 kubenswrapper[8993]: I1204 11:54:25.794210 8993 scope.go:117] "RemoveContainer" containerID="871a505c71fcc987e64230846e4890828086e506f1b1d8a3456559bac6ecba8e" Dec 04 11:54:25.794737 master-0 kubenswrapper[8993]: E1204 11:54:25.794448 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=ingress-operator pod=ingress-operator-8649c48786-cx2b2_openshift-ingress-operator(b011b1f1-3235-4e20-825b-ce711c052407)\"" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" podUID="b011b1f1-3235-4e20-825b-ce711c052407" Dec 04 11:54:27.344436 master-0 kubenswrapper[8993]: E1204 11:54:27.344332 8993 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0" Dec 04 11:54:27.565669 master-0 kubenswrapper[8993]: I1204 11:54:27.565597 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"58d12e893528ad53a994f10901a644ea","Type":"ContainerStarted","Data":"0e12e517b20bdc3b625c6c718dd1d388d2f2851647216efdfc0047fcce7e1020"} Dec 04 11:54:27.571433 master-0 kubenswrapper[8993]: I1204 11:54:27.571235 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:54:27.571433 master-0 kubenswrapper[8993]: I1204 11:54:27.571361 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:54:28.591719 master-0 kubenswrapper[8993]: I1204 11:54:28.591619 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"58d12e893528ad53a994f10901a644ea","Type":"ContainerStarted","Data":"88e1b2d27a0f75d0a4982d20bbe0ee0c9b6226aa4f25a9f4cb53e21dbc639d31"} Dec 04 11:54:28.591719 master-0 kubenswrapper[8993]: I1204 11:54:28.591695 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"58d12e893528ad53a994f10901a644ea","Type":"ContainerStarted","Data":"c3a7a8927a39103ec57f601056e2745862d11cbfef434599fc257cad09fa75c7"} Dec 04 11:54:28.591719 master-0 kubenswrapper[8993]: I1204 11:54:28.591706 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"58d12e893528ad53a994f10901a644ea","Type":"ContainerStarted","Data":"4d147a6535bb34c902004843cd295f21c14adf8a53e3d2475a55e6a0fc4042b8"} Dec 04 11:54:28.591719 master-0 kubenswrapper[8993]: I1204 11:54:28.591734 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"58d12e893528ad53a994f10901a644ea","Type":"ContainerStarted","Data":"99afa32d2f9e3268c6724b0a1688288ba191e2e74f21c5c1858581b217615c5e"} Dec 04 11:54:28.592603 master-0 kubenswrapper[8993]: I1204 11:54:28.592124 8993 kubelet.go:1909] "Trying to delete pod" pod="openshift-etcd/etcd-master-0" podUID="cec85ded-d31e-47da-9e71-fa808f6cadc0" Dec 04 11:54:28.592603 master-0 kubenswrapper[8993]: I1204 11:54:28.592206 8993 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0" podUID="cec85ded-d31e-47da-9e71-fa808f6cadc0" Dec 04 11:54:28.817290 master-0 kubenswrapper[8993]: I1204 11:54:28.817221 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-etcd/etcd-master-0" Dec 04 11:54:28.817290 master-0 kubenswrapper[8993]: I1204 11:54:28.817277 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-etcd/etcd-master-0" Dec 04 11:54:28.868360 master-0 kubenswrapper[8993]: I1204 11:54:28.868282 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:54:32.860079 master-0 kubenswrapper[8993]: I1204 11:54:32.860018 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 11:54:35.443332 master-0 kubenswrapper[8993]: E1204 11:54:35.443180 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 11:54:37.571272 master-0 kubenswrapper[8993]: I1204 11:54:37.571166 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:54:37.571272 master-0 kubenswrapper[8993]: I1204 11:54:37.571263 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:54:38.794680 master-0 kubenswrapper[8993]: I1204 11:54:38.794594 8993 scope.go:117] "RemoveContainer" containerID="871a505c71fcc987e64230846e4890828086e506f1b1d8a3456559bac6ecba8e" Dec 04 11:54:38.841323 master-0 kubenswrapper[8993]: I1204 11:54:38.841240 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-etcd/etcd-master-0" Dec 04 11:54:39.671268 master-0 kubenswrapper[8993]: I1204 11:54:39.671199 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/4.log" Dec 04 11:54:39.671733 master-0 kubenswrapper[8993]: I1204 11:54:39.671663 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" event={"ID":"b011b1f1-3235-4e20-825b-ce711c052407","Type":"ContainerStarted","Data":"6b81ee1ae28f16389ded7b634a062f62bd333e247fbc631f5edd514e5d0827da"} Dec 04 11:54:43.845599 master-0 kubenswrapper[8993]: I1204 11:54:43.845513 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-etcd/etcd-master-0" Dec 04 11:54:46.718391 master-0 kubenswrapper[8993]: I1204 11:54:46.718286 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/5.log" Dec 04 11:54:46.719433 master-0 kubenswrapper[8993]: I1204 11:54:46.719392 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/4.log" Dec 04 11:54:46.719490 master-0 kubenswrapper[8993]: I1204 11:54:46.719459 8993 generic.go:334] "Generic (PLEG): container finished" podID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" containerID="c3d6e3ec1c2075f0d2c2e41480f7486576efc2d0e3c1b8e7a0df0f84b64a6eb3" exitCode=1 Dec 04 11:54:46.719545 master-0 kubenswrapper[8993]: I1204 11:54:46.719501 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" event={"ID":"38fc8086-a00c-4a2a-8a0e-c57e9d9d0103","Type":"ContainerDied","Data":"c3d6e3ec1c2075f0d2c2e41480f7486576efc2d0e3c1b8e7a0df0f84b64a6eb3"} Dec 04 11:54:46.720015 master-0 kubenswrapper[8993]: I1204 11:54:46.719547 8993 scope.go:117] "RemoveContainer" containerID="111212ae304e7d5562b925c64b167a8bb0864329ef48752767ee9569f220fa38" Dec 04 11:54:46.720378 master-0 kubenswrapper[8993]: I1204 11:54:46.720327 8993 scope.go:117] "RemoveContainer" containerID="c3d6e3ec1c2075f0d2c2e41480f7486576efc2d0e3c1b8e7a0df0f84b64a6eb3" Dec 04 11:54:46.720653 master-0 kubenswrapper[8993]: E1204 11:54:46.720606 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:54:47.570998 master-0 kubenswrapper[8993]: I1204 11:54:47.570924 8993 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:54:47.571309 master-0 kubenswrapper[8993]: I1204 11:54:47.571016 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:54:47.571309 master-0 kubenswrapper[8993]: I1204 11:54:47.571113 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:54:47.571762 master-0 kubenswrapper[8993]: I1204 11:54:47.571721 8993 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="cluster-policy-controller" containerStatusID={"Type":"cri-o","ID":"f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce"} pod="openshift-kube-controller-manager/kube-controller-manager-master-0" containerMessage="Container cluster-policy-controller failed startup probe, will be restarted" Dec 04 11:54:47.571871 master-0 kubenswrapper[8993]: I1204 11:54:47.571826 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" containerID="cri-o://f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" gracePeriod=30 Dec 04 11:54:47.689362 master-0 kubenswrapper[8993]: E1204 11:54:47.689284 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:54:47.728780 master-0 kubenswrapper[8993]: I1204 11:54:47.728700 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/5.log" Dec 04 11:54:47.731385 master-0 kubenswrapper[8993]: I1204 11:54:47.731343 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/7.log" Dec 04 11:54:47.731816 master-0 kubenswrapper[8993]: I1204 11:54:47.731762 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/6.log" Dec 04 11:54:47.732652 master-0 kubenswrapper[8993]: I1204 11:54:47.732604 8993 generic.go:334] "Generic (PLEG): container finished" podID="e6b437c60bb18680f4492b00b294e872" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" exitCode=255 Dec 04 11:54:47.732710 master-0 kubenswrapper[8993]: I1204 11:54:47.732656 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerDied","Data":"f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce"} Dec 04 11:54:47.732710 master-0 kubenswrapper[8993]: I1204 11:54:47.732707 8993 scope.go:117] "RemoveContainer" containerID="4c7562d535711adc8257706a397e2c0b860bbf4a88ab43084f8db587572f489c" Dec 04 11:54:47.733423 master-0 kubenswrapper[8993]: I1204 11:54:47.733389 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:54:47.733711 master-0 kubenswrapper[8993]: E1204 11:54:47.733665 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:54:48.741201 master-0 kubenswrapper[8993]: I1204 11:54:48.741128 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/7.log" Dec 04 11:54:51.958848 master-0 kubenswrapper[8993]: E1204 11:54:51.958621 8993 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{etcd-master-0.187e00eeabcb6b99 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0,UID:58d12e893528ad53a994f10901a644ea,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:52:09.060264857 +0000 UTC m=+863.451206290,LastTimestamp:2025-12-04 11:52:09.060264857 +0000 UTC m=+863.451206290,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:54:52.444386 master-0 kubenswrapper[8993]: E1204 11:54:52.444235 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 11:54:54.571724 master-0 kubenswrapper[8993]: I1204 11:54:54.571651 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:54:54.572489 master-0 kubenswrapper[8993]: I1204 11:54:54.572456 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:54:54.572754 master-0 kubenswrapper[8993]: E1204 11:54:54.572714 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:54:55.819355 master-0 kubenswrapper[8993]: I1204 11:54:55.819273 8993 status_manager.go:851] "Failed to get status for pod" podUID="c6335f99-eb41-4b1d-93df-4a24f0ce23bc" pod="openshift-etcd/installer-2-master-0" err="the server was unable to return a response in the time allotted, but may still be processing the request (get pods installer-2-master-0)" Dec 04 11:54:58.794194 master-0 kubenswrapper[8993]: I1204 11:54:58.794127 8993 scope.go:117] "RemoveContainer" containerID="c3d6e3ec1c2075f0d2c2e41480f7486576efc2d0e3c1b8e7a0df0f84b64a6eb3" Dec 04 11:54:58.794871 master-0 kubenswrapper[8993]: E1204 11:54:58.794413 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:55:02.598846 master-0 kubenswrapper[8993]: E1204 11:55:02.598752 8993 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0" Dec 04 11:55:02.833189 master-0 kubenswrapper[8993]: I1204 11:55:02.833103 8993 kubelet.go:1909] "Trying to delete pod" pod="openshift-etcd/etcd-master-0" podUID="cec85ded-d31e-47da-9e71-fa808f6cadc0" Dec 04 11:55:02.833189 master-0 kubenswrapper[8993]: I1204 11:55:02.833162 8993 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0" podUID="cec85ded-d31e-47da-9e71-fa808f6cadc0" Dec 04 11:55:09.446086 master-0 kubenswrapper[8993]: E1204 11:55:09.445990 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 11:55:09.794430 master-0 kubenswrapper[8993]: I1204 11:55:09.794255 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:55:09.794733 master-0 kubenswrapper[8993]: E1204 11:55:09.794544 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:55:11.794763 master-0 kubenswrapper[8993]: I1204 11:55:11.794682 8993 scope.go:117] "RemoveContainer" containerID="c3d6e3ec1c2075f0d2c2e41480f7486576efc2d0e3c1b8e7a0df0f84b64a6eb3" Dec 04 11:55:11.795450 master-0 kubenswrapper[8993]: E1204 11:55:11.794946 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:55:22.794542 master-0 kubenswrapper[8993]: I1204 11:55:22.794462 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:55:22.795352 master-0 kubenswrapper[8993]: E1204 11:55:22.794783 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:55:25.961652 master-0 kubenswrapper[8993]: E1204 11:55:25.961462 8993 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{etcd-master-0.187e00eeac6ba869 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-master-0,UID:58d12e893528ad53a994f10901a644ea,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:52:09.070766185 +0000 UTC m=+863.461707618,LastTimestamp:2025-12-04 11:52:09.070766185 +0000 UTC m=+863.461707618,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:55:26.448849 master-0 kubenswrapper[8993]: E1204 11:55:26.448746 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 11:55:26.794887 master-0 kubenswrapper[8993]: I1204 11:55:26.794670 8993 scope.go:117] "RemoveContainer" containerID="c3d6e3ec1c2075f0d2c2e41480f7486576efc2d0e3c1b8e7a0df0f84b64a6eb3" Dec 04 11:55:26.795195 master-0 kubenswrapper[8993]: E1204 11:55:26.794969 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:55:33.794382 master-0 kubenswrapper[8993]: I1204 11:55:33.794311 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:55:33.795114 master-0 kubenswrapper[8993]: E1204 11:55:33.794612 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:55:36.836082 master-0 kubenswrapper[8993]: E1204 11:55:36.836019 8993 mirror_client.go:138] "Failed deleting a mirror pod" err="Timeout: request did not complete within requested timeout - context deadline exceeded" pod="openshift-etcd/etcd-master-0" Dec 04 11:55:38.068430 master-0 kubenswrapper[8993]: I1204 11:55:38.068367 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd-operator_etcd-operator-5bf4d88c6f-2bpmr_c6e9271a-44ea-4612-ab60-4a9d489ed062/etcd-operator/1.log" Dec 04 11:55:38.069025 master-0 kubenswrapper[8993]: I1204 11:55:38.068436 8993 generic.go:334] "Generic (PLEG): container finished" podID="c6e9271a-44ea-4612-ab60-4a9d489ed062" containerID="c917a114b6504bcd9d7c8dd2abb103105fc2fc1c7c60d8e3237ba96133b8d6ed" exitCode=0 Dec 04 11:55:38.069025 master-0 kubenswrapper[8993]: I1204 11:55:38.068483 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" event={"ID":"c6e9271a-44ea-4612-ab60-4a9d489ed062","Type":"ContainerDied","Data":"c917a114b6504bcd9d7c8dd2abb103105fc2fc1c7c60d8e3237ba96133b8d6ed"} Dec 04 11:55:38.069025 master-0 kubenswrapper[8993]: I1204 11:55:38.068530 8993 scope.go:117] "RemoveContainer" containerID="0c42072520a6b53c6aa158c37fe784801234cd135b1f4b11a3d79b213d89865e" Dec 04 11:55:38.069348 master-0 kubenswrapper[8993]: I1204 11:55:38.069227 8993 scope.go:117] "RemoveContainer" containerID="c917a114b6504bcd9d7c8dd2abb103105fc2fc1c7c60d8e3237ba96133b8d6ed" Dec 04 11:55:39.076604 master-0 kubenswrapper[8993]: I1204 11:55:39.076556 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-autoscaler-operator-5f49d774cd-894dk_e7fc7c16-5bca-49e5-aff0-7a8f80c6b639/cluster-autoscaler-operator/2.log" Dec 04 11:55:39.077268 master-0 kubenswrapper[8993]: I1204 11:55:39.077123 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-autoscaler-operator-5f49d774cd-894dk_e7fc7c16-5bca-49e5-aff0-7a8f80c6b639/cluster-autoscaler-operator/1.log" Dec 04 11:55:39.077624 master-0 kubenswrapper[8993]: I1204 11:55:39.077542 8993 generic.go:334] "Generic (PLEG): container finished" podID="e7fc7c16-5bca-49e5-aff0-7a8f80c6b639" containerID="f06d1731c63d1c3b95fb1ded6be8b346f6f343eb1c39fb1931d998db924768a0" exitCode=255 Dec 04 11:55:39.077624 master-0 kubenswrapper[8993]: I1204 11:55:39.077606 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" event={"ID":"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639","Type":"ContainerDied","Data":"f06d1731c63d1c3b95fb1ded6be8b346f6f343eb1c39fb1931d998db924768a0"} Dec 04 11:55:39.077938 master-0 kubenswrapper[8993]: I1204 11:55:39.077665 8993 scope.go:117] "RemoveContainer" containerID="4d95860537918a04cf76c6b27375da7f45face6b265a8eec014e0a60e0abd873" Dec 04 11:55:39.078365 master-0 kubenswrapper[8993]: I1204 11:55:39.078333 8993 scope.go:117] "RemoveContainer" containerID="f06d1731c63d1c3b95fb1ded6be8b346f6f343eb1c39fb1931d998db924768a0" Dec 04 11:55:39.078585 master-0 kubenswrapper[8993]: E1204 11:55:39.078536 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-autoscaler-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cluster-autoscaler-operator pod=cluster-autoscaler-operator-5f49d774cd-894dk_openshift-machine-api(e7fc7c16-5bca-49e5-aff0-7a8f80c6b639)\"" pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" podUID="e7fc7c16-5bca-49e5-aff0-7a8f80c6b639" Dec 04 11:55:39.080637 master-0 kubenswrapper[8993]: I1204 11:55:39.080572 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" event={"ID":"c6e9271a-44ea-4612-ab60-4a9d489ed062","Type":"ContainerStarted","Data":"5a33d408db9492b0f4398974afc4f5b49f3664c2c604efc289081ff9e70c7fd0"} Dec 04 11:55:40.090114 master-0 kubenswrapper[8993]: I1204 11:55:40.090015 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-autoscaler-operator-5f49d774cd-894dk_e7fc7c16-5bca-49e5-aff0-7a8f80c6b639/cluster-autoscaler-operator/2.log" Dec 04 11:55:40.794648 master-0 kubenswrapper[8993]: I1204 11:55:40.794504 8993 scope.go:117] "RemoveContainer" containerID="c3d6e3ec1c2075f0d2c2e41480f7486576efc2d0e3c1b8e7a0df0f84b64a6eb3" Dec 04 11:55:40.794893 master-0 kubenswrapper[8993]: E1204 11:55:40.794765 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:55:41.098136 master-0 kubenswrapper[8993]: I1204 11:55:41.098077 8993 generic.go:334] "Generic (PLEG): container finished" podID="1243d581-fa11-4db1-a01a-0cf64eb3ef74" containerID="450c33434fcc742db8779a3f1f1227abf6b374f6577a9ed078feb154828442af" exitCode=0 Dec 04 11:55:41.098136 master-0 kubenswrapper[8993]: I1204 11:55:41.098111 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" event={"ID":"1243d581-fa11-4db1-a01a-0cf64eb3ef74","Type":"ContainerDied","Data":"450c33434fcc742db8779a3f1f1227abf6b374f6577a9ed078feb154828442af"} Dec 04 11:55:41.098876 master-0 kubenswrapper[8993]: I1204 11:55:41.098183 8993 scope.go:117] "RemoveContainer" containerID="42bf9b312d3d677a209c2f4ed476e28aa24937e7036328cd0eb57e2a02bb1e2a" Dec 04 11:55:41.098876 master-0 kubenswrapper[8993]: I1204 11:55:41.098495 8993 scope.go:117] "RemoveContainer" containerID="450c33434fcc742db8779a3f1f1227abf6b374f6577a9ed078feb154828442af" Dec 04 11:55:42.105010 master-0 kubenswrapper[8993]: I1204 11:55:42.104877 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" event={"ID":"1243d581-fa11-4db1-a01a-0cf64eb3ef74","Type":"ContainerStarted","Data":"329ee46994193013e9d24c3a5d2a918ec4e9f995b4338bab95988c251d74bdc4"} Dec 04 11:55:42.106828 master-0 kubenswrapper[8993]: I1204 11:55:42.106773 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_network-operator-79767b7ff9-5bgzx_ffaf95be-586c-40fa-b15f-1beaffe7ff1c/network-operator/2.log" Dec 04 11:55:42.106939 master-0 kubenswrapper[8993]: I1204 11:55:42.106849 8993 generic.go:334] "Generic (PLEG): container finished" podID="ffaf95be-586c-40fa-b15f-1beaffe7ff1c" containerID="f9e507455e646a26023961f555cf20cd9c754df7c6eb7c8d6f74aa6bd2bece6c" exitCode=0 Dec 04 11:55:42.106939 master-0 kubenswrapper[8993]: I1204 11:55:42.106887 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" event={"ID":"ffaf95be-586c-40fa-b15f-1beaffe7ff1c","Type":"ContainerDied","Data":"f9e507455e646a26023961f555cf20cd9c754df7c6eb7c8d6f74aa6bd2bece6c"} Dec 04 11:55:42.106939 master-0 kubenswrapper[8993]: I1204 11:55:42.106927 8993 scope.go:117] "RemoveContainer" containerID="f0266ae130e78641667767b4e7c8f6513c8fa351825903565f61acb84ef9c0ac" Dec 04 11:55:42.107253 master-0 kubenswrapper[8993]: I1204 11:55:42.107221 8993 scope.go:117] "RemoveContainer" containerID="f9e507455e646a26023961f555cf20cd9c754df7c6eb7c8d6f74aa6bd2bece6c" Dec 04 11:55:43.120645 master-0 kubenswrapper[8993]: I1204 11:55:43.120536 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" event={"ID":"ffaf95be-586c-40fa-b15f-1beaffe7ff1c","Type":"ContainerStarted","Data":"52570c588141d63c84a7816d3288fc56be1480300a71ca9cdfc5c016aa9b2a98"} Dec 04 11:55:43.451326 master-0 kubenswrapper[8993]: E1204 11:55:43.451080 8993 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="7s" Dec 04 11:55:45.139655 master-0 kubenswrapper[8993]: I1204 11:55:45.139578 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager-operator_kube-controller-manager-operator-848f645654-7hmhg_bac00ac5-0371-48fd-b1cc-60438f08ae94/kube-controller-manager-operator/1.log" Dec 04 11:55:45.140478 master-0 kubenswrapper[8993]: I1204 11:55:45.139709 8993 generic.go:334] "Generic (PLEG): container finished" podID="bac00ac5-0371-48fd-b1cc-60438f08ae94" containerID="e0fdeac9876b7627a8946145261c72d16f488a3fb3a2e313379790f4879d5017" exitCode=0 Dec 04 11:55:45.140478 master-0 kubenswrapper[8993]: I1204 11:55:45.139768 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" event={"ID":"bac00ac5-0371-48fd-b1cc-60438f08ae94","Type":"ContainerDied","Data":"e0fdeac9876b7627a8946145261c72d16f488a3fb3a2e313379790f4879d5017"} Dec 04 11:55:45.140478 master-0 kubenswrapper[8993]: I1204 11:55:45.139863 8993 scope.go:117] "RemoveContainer" containerID="2be6d5a0843c9ad0cefac288764262419d2b3e8c45c39b2471e38c3ea1a83dce" Dec 04 11:55:45.140708 master-0 kubenswrapper[8993]: I1204 11:55:45.140644 8993 scope.go:117] "RemoveContainer" containerID="e0fdeac9876b7627a8946145261c72d16f488a3fb3a2e313379790f4879d5017" Dec 04 11:55:46.155041 master-0 kubenswrapper[8993]: I1204 11:55:46.154966 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" event={"ID":"bac00ac5-0371-48fd-b1cc-60438f08ae94","Type":"ContainerStarted","Data":"ecd7f604588d7f724b04cf8225b65a6a6b0f7f44acb72826e4d9692d423df77a"} Dec 04 11:55:46.156791 master-0 kubenswrapper[8993]: I1204 11:55:46.156734 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/7.log" Dec 04 11:55:46.158017 master-0 kubenswrapper[8993]: I1204 11:55:46.157977 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-cert-syncer/0.log" Dec 04 11:55:46.158507 master-0 kubenswrapper[8993]: I1204 11:55:46.158461 8993 generic.go:334] "Generic (PLEG): container finished" podID="e6b437c60bb18680f4492b00b294e872" containerID="11e29c5651a5425702af55ec3b8ee473df3972ab82e099ae3490c6b27969c94a" exitCode=1 Dec 04 11:55:46.158556 master-0 kubenswrapper[8993]: I1204 11:55:46.158495 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerDied","Data":"11e29c5651a5425702af55ec3b8ee473df3972ab82e099ae3490c6b27969c94a"} Dec 04 11:55:46.159216 master-0 kubenswrapper[8993]: I1204 11:55:46.159179 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:55:46.159258 master-0 kubenswrapper[8993]: I1204 11:55:46.159216 8993 scope.go:117] "RemoveContainer" containerID="11e29c5651a5425702af55ec3b8ee473df3972ab82e099ae3490c6b27969c94a" Dec 04 11:55:46.363055 master-0 kubenswrapper[8993]: E1204 11:55:46.362993 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:55:47.166471 master-0 kubenswrapper[8993]: I1204 11:55:47.166392 8993 generic.go:334] "Generic (PLEG): container finished" podID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerID="d859cb27e867f25cc9dc636a000b6297269eff79e613711203786b4339047231" exitCode=0 Dec 04 11:55:47.167104 master-0 kubenswrapper[8993]: I1204 11:55:47.166488 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" event={"ID":"e4d7939a-5961-4608-b910-73e71aa55bf6","Type":"ContainerDied","Data":"d859cb27e867f25cc9dc636a000b6297269eff79e613711203786b4339047231"} Dec 04 11:55:47.167104 master-0 kubenswrapper[8993]: I1204 11:55:47.166965 8993 scope.go:117] "RemoveContainer" containerID="d859cb27e867f25cc9dc636a000b6297269eff79e613711203786b4339047231" Dec 04 11:55:47.168712 master-0 kubenswrapper[8993]: I1204 11:55:47.168686 8993 generic.go:334] "Generic (PLEG): container finished" podID="1ade9186-b262-4b5e-9c6f-ba89f0130fb6" containerID="c1818ca43db2765bb639a6e97b3c2f8506a31edb0b1a76aecba6684bf041bcbf" exitCode=0 Dec 04 11:55:47.168820 master-0 kubenswrapper[8993]: I1204 11:55:47.168717 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" event={"ID":"1ade9186-b262-4b5e-9c6f-ba89f0130fb6","Type":"ContainerDied","Data":"c1818ca43db2765bb639a6e97b3c2f8506a31edb0b1a76aecba6684bf041bcbf"} Dec 04 11:55:47.168820 master-0 kubenswrapper[8993]: I1204 11:55:47.168773 8993 scope.go:117] "RemoveContainer" containerID="b4a708629c00edd600857e5208cac33c83ecd3ee4160351814e5fc4f907308cf" Dec 04 11:55:47.169497 master-0 kubenswrapper[8993]: I1204 11:55:47.169368 8993 scope.go:117] "RemoveContainer" containerID="c1818ca43db2765bb639a6e97b3c2f8506a31edb0b1a76aecba6684bf041bcbf" Dec 04 11:55:47.174332 master-0 kubenswrapper[8993]: I1204 11:55:47.173594 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-77758bc754-8smqn_8e5e33b0-4e2e-464c-ba5b-cbd2048004f8/service-ca-operator/2.log" Dec 04 11:55:47.174332 master-0 kubenswrapper[8993]: I1204 11:55:47.173663 8993 generic.go:334] "Generic (PLEG): container finished" podID="8e5e33b0-4e2e-464c-ba5b-cbd2048004f8" containerID="8feda6d58ce3528bf1cb14bff418f320e1e6dc261d75dd615a2c1773dacee750" exitCode=0 Dec 04 11:55:47.174332 master-0 kubenswrapper[8993]: I1204 11:55:47.173744 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" event={"ID":"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8","Type":"ContainerDied","Data":"8feda6d58ce3528bf1cb14bff418f320e1e6dc261d75dd615a2c1773dacee750"} Dec 04 11:55:47.174332 master-0 kubenswrapper[8993]: I1204 11:55:47.174328 8993 scope.go:117] "RemoveContainer" containerID="8feda6d58ce3528bf1cb14bff418f320e1e6dc261d75dd615a2c1773dacee750" Dec 04 11:55:47.182535 master-0 kubenswrapper[8993]: I1204 11:55:47.182476 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_cluster-node-tuning-operator-85cff47f46-4gv5j_6f15dcdb-c968-429c-9d1d-63c2becad337/cluster-node-tuning-operator/1.log" Dec 04 11:55:47.183319 master-0 kubenswrapper[8993]: I1204 11:55:47.183140 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_cluster-node-tuning-operator-85cff47f46-4gv5j_6f15dcdb-c968-429c-9d1d-63c2becad337/cluster-node-tuning-operator/0.log" Dec 04 11:55:47.183319 master-0 kubenswrapper[8993]: I1204 11:55:47.183195 8993 generic.go:334] "Generic (PLEG): container finished" podID="6f15dcdb-c968-429c-9d1d-63c2becad337" containerID="a2ccae65671ed8e1587834a54d81391f1b1881f39ee38aa28b193fa6cecc39da" exitCode=1 Dec 04 11:55:47.183319 master-0 kubenswrapper[8993]: I1204 11:55:47.183278 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" event={"ID":"6f15dcdb-c968-429c-9d1d-63c2becad337","Type":"ContainerDied","Data":"a2ccae65671ed8e1587834a54d81391f1b1881f39ee38aa28b193fa6cecc39da"} Dec 04 11:55:47.183877 master-0 kubenswrapper[8993]: I1204 11:55:47.183633 8993 scope.go:117] "RemoveContainer" containerID="a2ccae65671ed8e1587834a54d81391f1b1881f39ee38aa28b193fa6cecc39da" Dec 04 11:55:47.186276 master-0 kubenswrapper[8993]: I1204 11:55:47.185908 8993 generic.go:334] "Generic (PLEG): container finished" podID="031d300e-24b4-481c-8b82-fe8cdb3fcef7" containerID="53618e2881e7531a20171c8c77886b4e3ff73637b9908af667c0ecd3f6bd4f2a" exitCode=0 Dec 04 11:55:47.186276 master-0 kubenswrapper[8993]: I1204 11:55:47.185987 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-6bc8656fdc-2q7f5" event={"ID":"031d300e-24b4-481c-8b82-fe8cdb3fcef7","Type":"ContainerDied","Data":"53618e2881e7531a20171c8c77886b4e3ff73637b9908af667c0ecd3f6bd4f2a"} Dec 04 11:55:47.186429 master-0 kubenswrapper[8993]: I1204 11:55:47.186340 8993 scope.go:117] "RemoveContainer" containerID="53618e2881e7531a20171c8c77886b4e3ff73637b9908af667c0ecd3f6bd4f2a" Dec 04 11:55:47.188544 master-0 kubenswrapper[8993]: I1204 11:55:47.188495 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-6c8676f99d-7z948_3322cc5a-f1f7-4522-b423-19fb7f38cd43/openshift-controller-manager-operator/2.log" Dec 04 11:55:47.188626 master-0 kubenswrapper[8993]: I1204 11:55:47.188568 8993 generic.go:334] "Generic (PLEG): container finished" podID="3322cc5a-f1f7-4522-b423-19fb7f38cd43" containerID="a39ca33d8356cc3dbacc15a33d88f7f3eadcf0d16af1ac588f4e782ea1463d52" exitCode=0 Dec 04 11:55:47.189091 master-0 kubenswrapper[8993]: I1204 11:55:47.188682 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" event={"ID":"3322cc5a-f1f7-4522-b423-19fb7f38cd43","Type":"ContainerDied","Data":"a39ca33d8356cc3dbacc15a33d88f7f3eadcf0d16af1ac588f4e782ea1463d52"} Dec 04 11:55:47.189536 master-0 kubenswrapper[8993]: I1204 11:55:47.189388 8993 scope.go:117] "RemoveContainer" containerID="a39ca33d8356cc3dbacc15a33d88f7f3eadcf0d16af1ac588f4e782ea1463d52" Dec 04 11:55:47.191266 master-0 kubenswrapper[8993]: I1204 11:55:47.191235 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_machine-api-operator-88d48b57d-9fjtd_c50317d3-f7cd-4133-845e-44add57ac378/machine-api-operator/0.log" Dec 04 11:55:47.191760 master-0 kubenswrapper[8993]: I1204 11:55:47.191734 8993 generic.go:334] "Generic (PLEG): container finished" podID="c50317d3-f7cd-4133-845e-44add57ac378" containerID="bf5e3c44e8b979c1b2a2791e8de129301f2196277f040ae6c9ab59c2dfb23a10" exitCode=255 Dec 04 11:55:47.191947 master-0 kubenswrapper[8993]: I1204 11:55:47.191828 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" event={"ID":"c50317d3-f7cd-4133-845e-44add57ac378","Type":"ContainerDied","Data":"bf5e3c44e8b979c1b2a2791e8de129301f2196277f040ae6c9ab59c2dfb23a10"} Dec 04 11:55:47.194996 master-0 kubenswrapper[8993]: I1204 11:55:47.193814 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_cluster-storage-operator-dcf7fc84b-fncfd_f797ab14-0eb5-48b4-b914-f434f67c4c49/cluster-storage-operator/1.log" Dec 04 11:55:47.194996 master-0 kubenswrapper[8993]: I1204 11:55:47.193855 8993 generic.go:334] "Generic (PLEG): container finished" podID="f797ab14-0eb5-48b4-b914-f434f67c4c49" containerID="a7c9e295ef31ee529de35de69419b7f4fb1bbde8ad44813a8db193a07a67f946" exitCode=0 Dec 04 11:55:47.194996 master-0 kubenswrapper[8993]: I1204 11:55:47.193925 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" event={"ID":"f797ab14-0eb5-48b4-b914-f434f67c4c49","Type":"ContainerDied","Data":"a7c9e295ef31ee529de35de69419b7f4fb1bbde8ad44813a8db193a07a67f946"} Dec 04 11:55:47.194996 master-0 kubenswrapper[8993]: I1204 11:55:47.193937 8993 scope.go:117] "RemoveContainer" containerID="bf5e3c44e8b979c1b2a2791e8de129301f2196277f040ae6c9ab59c2dfb23a10" Dec 04 11:55:47.194996 master-0 kubenswrapper[8993]: I1204 11:55:47.194329 8993 scope.go:117] "RemoveContainer" containerID="a7c9e295ef31ee529de35de69419b7f4fb1bbde8ad44813a8db193a07a67f946" Dec 04 11:55:47.201354 master-0 kubenswrapper[8993]: I1204 11:55:47.197968 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/7.log" Dec 04 11:55:47.201354 master-0 kubenswrapper[8993]: I1204 11:55:47.199154 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-cert-syncer/0.log" Dec 04 11:55:47.201354 master-0 kubenswrapper[8993]: I1204 11:55:47.200034 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"c7daeda85ec183c8d113e00834a6cc8eb19542aa3278f40e44cf98acd7483141"} Dec 04 11:55:47.201354 master-0 kubenswrapper[8993]: I1204 11:55:47.200881 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:55:47.201354 master-0 kubenswrapper[8993]: E1204 11:55:47.201274 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:55:47.204516 master-0 kubenswrapper[8993]: I1204 11:55:47.204466 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler-operator_openshift-kube-scheduler-operator-5f85974995-g4rwv_27576028-d64a-47cd-b76b-d524e41efe37/kube-scheduler-operator-container/2.log" Dec 04 11:55:47.204909 master-0 kubenswrapper[8993]: I1204 11:55:47.204746 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" event={"ID":"27576028-d64a-47cd-b76b-d524e41efe37","Type":"ContainerDied","Data":"5bd81ae6aaed1722c0d3f93b82b95663992c61dfa9898968bad69d44a6b4c6ca"} Dec 04 11:55:47.204909 master-0 kubenswrapper[8993]: I1204 11:55:47.204592 8993 generic.go:334] "Generic (PLEG): container finished" podID="27576028-d64a-47cd-b76b-d524e41efe37" containerID="5bd81ae6aaed1722c0d3f93b82b95663992c61dfa9898968bad69d44a6b4c6ca" exitCode=0 Dec 04 11:55:47.206398 master-0 kubenswrapper[8993]: I1204 11:55:47.206336 8993 scope.go:117] "RemoveContainer" containerID="5bd81ae6aaed1722c0d3f93b82b95663992c61dfa9898968bad69d44a6b4c6ca" Dec 04 11:55:47.369750 master-0 kubenswrapper[8993]: I1204 11:55:47.369649 8993 scope.go:117] "RemoveContainer" containerID="602399891f95b4f2d3b03e62ba9f8e399daa0e9695e2efa23e0a025273d42dbf" Dec 04 11:55:47.452978 master-0 kubenswrapper[8993]: I1204 11:55:47.452868 8993 scope.go:117] "RemoveContainer" containerID="d6c550a785a1145fdc343107de5010ef2c2358de520cd277331cd0afa9b20bdf" Dec 04 11:55:47.486671 master-0 kubenswrapper[8993]: I1204 11:55:47.486506 8993 scope.go:117] "RemoveContainer" containerID="90cc3b6000c187ca85e3ebde189fcb0fb0c22a655e72a22fb82a8f151adb8963" Dec 04 11:55:47.568488 master-0 kubenswrapper[8993]: I1204 11:55:47.568425 8993 scope.go:117] "RemoveContainer" containerID="6877d7c7591492108bb34420d09a7376ef5637c76a3beefad5f4c2e362c72978" Dec 04 11:55:47.648676 master-0 kubenswrapper[8993]: I1204 11:55:47.648622 8993 scope.go:117] "RemoveContainer" containerID="3a28dcf3ab15a5ab11146a0fd47986bde79e431316166b88f994d0a65f348758" Dec 04 11:55:47.677974 master-0 kubenswrapper[8993]: I1204 11:55:47.677919 8993 scope.go:117] "RemoveContainer" containerID="6c60e9f210f8345eb6f6fc04cca90e4cb57c82e255bdcd593b988c293e0489ca" Dec 04 11:55:48.212717 master-0 kubenswrapper[8993]: I1204 11:55:48.212670 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" event={"ID":"1ade9186-b262-4b5e-9c6f-ba89f0130fb6","Type":"ContainerStarted","Data":"ccf27b7abfb6528c74fd1f7c21da05e349a9bda10d36d097585e26643cfe95b2"} Dec 04 11:55:48.215303 master-0 kubenswrapper[8993]: I1204 11:55:48.215273 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" event={"ID":"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8","Type":"ContainerStarted","Data":"5e2bad01cc53b7ce228313bfa3a308af4dcdbaf4a453394bacd04ea31b839a97"} Dec 04 11:55:48.217151 master-0 kubenswrapper[8993]: I1204 11:55:48.217078 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-6bc8656fdc-2q7f5" event={"ID":"031d300e-24b4-481c-8b82-fe8cdb3fcef7","Type":"ContainerStarted","Data":"8a0509384662f0d96506aeecfd3579793799f9a75c51361bc18fc4ccd76894fe"} Dec 04 11:55:48.219072 master-0 kubenswrapper[8993]: I1204 11:55:48.219014 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" event={"ID":"27576028-d64a-47cd-b76b-d524e41efe37","Type":"ContainerStarted","Data":"73ab5f0c3894d6ccba12451197f2930046ba04951f8b30a4bf51dc7bcde508cc"} Dec 04 11:55:48.221414 master-0 kubenswrapper[8993]: I1204 11:55:48.221349 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" event={"ID":"f797ab14-0eb5-48b4-b914-f434f67c4c49","Type":"ContainerStarted","Data":"1b02e40a7f243cb28b970534d0da36317acc883959fb116772f97c4dad46427d"} Dec 04 11:55:48.223609 master-0 kubenswrapper[8993]: I1204 11:55:48.223578 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_cluster-node-tuning-operator-85cff47f46-4gv5j_6f15dcdb-c968-429c-9d1d-63c2becad337/cluster-node-tuning-operator/1.log" Dec 04 11:55:48.223776 master-0 kubenswrapper[8993]: I1204 11:55:48.223679 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" event={"ID":"6f15dcdb-c968-429c-9d1d-63c2becad337","Type":"ContainerStarted","Data":"be438243594f3bf861e4019351de704cf0f44ae021f8193424a9d6d9b91f168c"} Dec 04 11:55:48.225844 master-0 kubenswrapper[8993]: I1204 11:55:48.225777 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" event={"ID":"3322cc5a-f1f7-4522-b423-19fb7f38cd43","Type":"ContainerStarted","Data":"6bc950db3ec1f7afbe92d39e38366383e0cef6eb9f745756096b42181a0164ac"} Dec 04 11:55:48.228468 master-0 kubenswrapper[8993]: I1204 11:55:48.228427 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_machine-api-operator-88d48b57d-9fjtd_c50317d3-f7cd-4133-845e-44add57ac378/machine-api-operator/0.log" Dec 04 11:55:48.228864 master-0 kubenswrapper[8993]: I1204 11:55:48.228830 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" event={"ID":"c50317d3-f7cd-4133-845e-44add57ac378","Type":"ContainerStarted","Data":"c5abefdcb3f076c4d8fa607cbb52db521c6fb9369a69d197d46f4eb8ebdfe177"} Dec 04 11:55:48.230665 master-0 kubenswrapper[8993]: I1204 11:55:48.230613 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" event={"ID":"e4d7939a-5961-4608-b910-73e71aa55bf6","Type":"ContainerStarted","Data":"b63dc777741930897797e6adb1b664297a0f1967d2d18f8fbd61bd116fd98669"} Dec 04 11:55:48.231002 master-0 kubenswrapper[8993]: I1204 11:55:48.230976 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:55:49.231491 master-0 kubenswrapper[8993]: I1204 11:55:49.231391 8993 patch_prober.go:28] interesting pod/route-controller-manager-95cb5f987-46bsk container/route-controller-manager namespace/openshift-route-controller-manager: Readiness probe status=failure output="Get \"https://10.128.0.70:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:55:49.231491 master-0 kubenswrapper[8993]: I1204 11:55:49.231485 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" probeResult="failure" output="Get \"https://10.128.0.70:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:55:49.794564 master-0 kubenswrapper[8993]: I1204 11:55:49.794450 8993 scope.go:117] "RemoveContainer" containerID="f06d1731c63d1c3b95fb1ded6be8b346f6f343eb1c39fb1931d998db924768a0" Dec 04 11:55:49.794879 master-0 kubenswrapper[8993]: E1204 11:55:49.794701 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-autoscaler-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cluster-autoscaler-operator pod=cluster-autoscaler-operator-5f49d774cd-894dk_openshift-machine-api(e7fc7c16-5bca-49e5-aff0-7a8f80c6b639)\"" pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" podUID="e7fc7c16-5bca-49e5-aff0-7a8f80c6b639" Dec 04 11:55:50.238285 master-0 kubenswrapper[8993]: I1204 11:55:50.238125 8993 patch_prober.go:28] interesting pod/route-controller-manager-95cb5f987-46bsk container/route-controller-manager namespace/openshift-route-controller-manager: Readiness probe status=failure output="Get \"https://10.128.0.70:8443/healthz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:55:50.238285 master-0 kubenswrapper[8993]: I1204 11:55:50.238254 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" probeResult="failure" output="Get \"https://10.128.0.70:8443/healthz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Dec 04 11:55:50.938265 master-0 kubenswrapper[8993]: E1204 11:55:50.938165 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:55:40Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:55:40Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:55:40Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-12-04T11:55:40Z\\\",\\\"type\\\":\\\"Ready\\\"}]}}\" for node \"master-0\": Patch \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0/status?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:55:52.028364 master-0 kubenswrapper[8993]: I1204 11:55:52.028225 8993 patch_prober.go:28] interesting pod/route-controller-manager-95cb5f987-46bsk container/route-controller-manager namespace/openshift-route-controller-manager: Readiness probe status=failure output="Get \"https://10.128.0.70:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:55:52.029061 master-0 kubenswrapper[8993]: I1204 11:55:52.028378 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" probeResult="failure" output="Get \"https://10.128.0.70:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:55:55.276265 master-0 kubenswrapper[8993]: I1204 11:55:55.276219 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_bdd20c68f1ccfd1240fb273af0638d01/kube-scheduler-cert-syncer/0.log" Dec 04 11:55:55.276954 master-0 kubenswrapper[8993]: I1204 11:55:55.276917 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_bdd20c68f1ccfd1240fb273af0638d01/kube-scheduler/0.log" Dec 04 11:55:55.277363 master-0 kubenswrapper[8993]: I1204 11:55:55.277330 8993 generic.go:334] "Generic (PLEG): container finished" podID="bdd20c68f1ccfd1240fb273af0638d01" containerID="83e55c475e3dc5500479af8907cda3d13a24a31c8ee5c2278bdd8d400f5e7292" exitCode=1 Dec 04 11:55:55.277419 master-0 kubenswrapper[8993]: I1204 11:55:55.277384 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"bdd20c68f1ccfd1240fb273af0638d01","Type":"ContainerDied","Data":"83e55c475e3dc5500479af8907cda3d13a24a31c8ee5c2278bdd8d400f5e7292"} Dec 04 11:55:55.278025 master-0 kubenswrapper[8993]: I1204 11:55:55.278001 8993 scope.go:117] "RemoveContainer" containerID="83e55c475e3dc5500479af8907cda3d13a24a31c8ee5c2278bdd8d400f5e7292" Dec 04 11:55:55.794417 master-0 kubenswrapper[8993]: I1204 11:55:55.794357 8993 scope.go:117] "RemoveContainer" containerID="c3d6e3ec1c2075f0d2c2e41480f7486576efc2d0e3c1b8e7a0df0f84b64a6eb3" Dec 04 11:55:55.794675 master-0 kubenswrapper[8993]: E1204 11:55:55.794643 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:55:55.823762 master-0 kubenswrapper[8993]: I1204 11:55:55.823684 8993 status_manager.go:851] "Failed to get status for pod" podUID="b011b1f1-3235-4e20-825b-ce711c052407" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" err="the server was unable to return a response in the time allotted, but may still be processing the request (get pods ingress-operator-8649c48786-cx2b2)" Dec 04 11:55:56.286603 master-0 kubenswrapper[8993]: I1204 11:55:56.286532 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_bdd20c68f1ccfd1240fb273af0638d01/kube-scheduler-cert-syncer/0.log" Dec 04 11:55:56.287544 master-0 kubenswrapper[8993]: I1204 11:55:56.287462 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_bdd20c68f1ccfd1240fb273af0638d01/kube-scheduler/0.log" Dec 04 11:55:56.288436 master-0 kubenswrapper[8993]: I1204 11:55:56.288365 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"bdd20c68f1ccfd1240fb273af0638d01","Type":"ContainerStarted","Data":"9e6711a29e80dd1a67221ee7d3cb99dca0b39d86d535ebc251bf63200ef5ce12"} Dec 04 11:56:00.794126 master-0 kubenswrapper[8993]: I1204 11:56:00.794083 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:56:00.795048 master-0 kubenswrapper[8993]: E1204 11:56:00.795021 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:56:00.939385 master-0 kubenswrapper[8993]: E1204 11:56:00.939270 8993 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 11:56:02.028658 master-0 kubenswrapper[8993]: I1204 11:56:02.028585 8993 patch_prober.go:28] interesting pod/route-controller-manager-95cb5f987-46bsk container/route-controller-manager namespace/openshift-route-controller-manager: Readiness probe status=failure output="Get \"https://10.128.0.70:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:56:02.029703 master-0 kubenswrapper[8993]: I1204 11:56:02.029592 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" probeResult="failure" output="Get \"https://10.128.0.70:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:56:04.794311 master-0 kubenswrapper[8993]: I1204 11:56:04.793939 8993 scope.go:117] "RemoveContainer" containerID="f06d1731c63d1c3b95fb1ded6be8b346f6f343eb1c39fb1931d998db924768a0" Dec 04 11:56:05.344900 master-0 kubenswrapper[8993]: I1204 11:56:05.344860 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-autoscaler-operator-5f49d774cd-894dk_e7fc7c16-5bca-49e5-aff0-7a8f80c6b639/cluster-autoscaler-operator/2.log" Dec 04 11:56:05.345571 master-0 kubenswrapper[8993]: I1204 11:56:05.345545 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" event={"ID":"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639","Type":"ContainerStarted","Data":"29db6007fa122142272c2e747034efd7c5978859754eee3760f27dbc521cf520"} Dec 04 11:56:09.795940 master-0 kubenswrapper[8993]: I1204 11:56:09.795173 8993 scope.go:117] "RemoveContainer" containerID="c3d6e3ec1c2075f0d2c2e41480f7486576efc2d0e3c1b8e7a0df0f84b64a6eb3" Dec 04 11:56:09.795940 master-0 kubenswrapper[8993]: E1204 11:56:09.795645 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:56:12.032512 master-0 kubenswrapper[8993]: I1204 11:56:12.032437 8993 patch_prober.go:28] interesting pod/route-controller-manager-95cb5f987-46bsk container/route-controller-manager namespace/openshift-route-controller-manager: Readiness probe status=failure output="Get \"https://10.128.0.70:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:56:12.032512 master-0 kubenswrapper[8993]: I1204 11:56:12.032507 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" probeResult="failure" output="Get \"https://10.128.0.70:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:56:14.794647 master-0 kubenswrapper[8993]: I1204 11:56:14.794479 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:56:14.795611 master-0 kubenswrapper[8993]: E1204 11:56:14.794752 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:56:22.028834 master-0 kubenswrapper[8993]: I1204 11:56:22.028758 8993 patch_prober.go:28] interesting pod/route-controller-manager-95cb5f987-46bsk container/route-controller-manager namespace/openshift-route-controller-manager: Readiness probe status=failure output="Get \"https://10.128.0.70:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:56:22.029412 master-0 kubenswrapper[8993]: I1204 11:56:22.028844 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" probeResult="failure" output="Get \"https://10.128.0.70:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:56:22.029412 master-0 kubenswrapper[8993]: I1204 11:56:22.028914 8993 patch_prober.go:28] interesting pod/route-controller-manager-95cb5f987-46bsk container/route-controller-manager namespace/openshift-route-controller-manager: Liveness probe status=failure output="Get \"https://10.128.0.70:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:56:22.029412 master-0 kubenswrapper[8993]: I1204 11:56:22.028963 8993 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" probeResult="failure" output="Get \"https://10.128.0.70:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:56:22.794509 master-0 kubenswrapper[8993]: I1204 11:56:22.794457 8993 scope.go:117] "RemoveContainer" containerID="c3d6e3ec1c2075f0d2c2e41480f7486576efc2d0e3c1b8e7a0df0f84b64a6eb3" Dec 04 11:56:22.795120 master-0 kubenswrapper[8993]: E1204 11:56:22.795088 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:56:26.484428 master-0 kubenswrapper[8993]: I1204 11:56:26.484117 8993 generic.go:334] "Generic (PLEG): container finished" podID="a399a87b-8153-4045-a8d3-63fd88ae280f" containerID="8203c30c9d158150398a01d336c4969a20aab618396e7ab3bc78d00c326809cc" exitCode=0 Dec 04 11:56:26.484428 master-0 kubenswrapper[8993]: I1204 11:56:26.484221 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" event={"ID":"a399a87b-8153-4045-a8d3-63fd88ae280f","Type":"ContainerDied","Data":"8203c30c9d158150398a01d336c4969a20aab618396e7ab3bc78d00c326809cc"} Dec 04 11:56:26.484428 master-0 kubenswrapper[8993]: I1204 11:56:26.484327 8993 scope.go:117] "RemoveContainer" containerID="067d901be9a85d08d5b38edc8f0dc976efa622744a3bc1f1c7a19a180b2e2f65" Dec 04 11:56:26.485034 master-0 kubenswrapper[8993]: I1204 11:56:26.484981 8993 scope.go:117] "RemoveContainer" containerID="8203c30c9d158150398a01d336c4969a20aab618396e7ab3bc78d00c326809cc" Dec 04 11:56:26.486957 master-0 kubenswrapper[8993]: I1204 11:56:26.486898 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk_e4d7939a-5961-4608-b910-73e71aa55bf6/route-controller-manager/1.log" Dec 04 11:56:26.487447 master-0 kubenswrapper[8993]: I1204 11:56:26.487402 8993 generic.go:334] "Generic (PLEG): container finished" podID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerID="b63dc777741930897797e6adb1b664297a0f1967d2d18f8fbd61bd116fd98669" exitCode=255 Dec 04 11:56:26.487500 master-0 kubenswrapper[8993]: I1204 11:56:26.487451 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" event={"ID":"e4d7939a-5961-4608-b910-73e71aa55bf6","Type":"ContainerDied","Data":"b63dc777741930897797e6adb1b664297a0f1967d2d18f8fbd61bd116fd98669"} Dec 04 11:56:26.487992 master-0 kubenswrapper[8993]: I1204 11:56:26.487958 8993 scope.go:117] "RemoveContainer" containerID="b63dc777741930897797e6adb1b664297a0f1967d2d18f8fbd61bd116fd98669" Dec 04 11:56:26.488227 master-0 kubenswrapper[8993]: E1204 11:56:26.488193 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"route-controller-manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=route-controller-manager pod=route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager(e4d7939a-5961-4608-b910-73e71aa55bf6)\"" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" Dec 04 11:56:26.526426 master-0 kubenswrapper[8993]: I1204 11:56:26.526375 8993 scope.go:117] "RemoveContainer" containerID="d859cb27e867f25cc9dc636a000b6297269eff79e613711203786b4339047231" Dec 04 11:56:27.496474 master-0 kubenswrapper[8993]: I1204 11:56:27.496411 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" event={"ID":"a399a87b-8153-4045-a8d3-63fd88ae280f","Type":"ContainerStarted","Data":"ca65c28331bad9eec792ccc54a97b6670a456f91f8ece05a18970c8e1f00c399"} Dec 04 11:56:27.497978 master-0 kubenswrapper[8993]: I1204 11:56:27.497949 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk_e4d7939a-5961-4608-b910-73e71aa55bf6/route-controller-manager/1.log" Dec 04 11:56:28.794460 master-0 kubenswrapper[8993]: I1204 11:56:28.794410 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:56:28.795159 master-0 kubenswrapper[8993]: E1204 11:56:28.794679 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:56:31.027491 master-0 kubenswrapper[8993]: I1204 11:56:31.027414 8993 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:56:31.028155 master-0 kubenswrapper[8993]: I1204 11:56:31.028130 8993 scope.go:117] "RemoveContainer" containerID="b63dc777741930897797e6adb1b664297a0f1967d2d18f8fbd61bd116fd98669" Dec 04 11:56:31.028365 master-0 kubenswrapper[8993]: E1204 11:56:31.028337 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"route-controller-manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=route-controller-manager pod=route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager(e4d7939a-5961-4608-b910-73e71aa55bf6)\"" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" Dec 04 11:56:34.794265 master-0 kubenswrapper[8993]: I1204 11:56:34.794181 8993 scope.go:117] "RemoveContainer" containerID="c3d6e3ec1c2075f0d2c2e41480f7486576efc2d0e3c1b8e7a0df0f84b64a6eb3" Dec 04 11:56:34.795175 master-0 kubenswrapper[8993]: E1204 11:56:34.794517 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:56:42.794487 master-0 kubenswrapper[8993]: I1204 11:56:42.794421 8993 kubelet.go:1909] "Trying to delete pod" pod="openshift-etcd/etcd-master-0" podUID="cec85ded-d31e-47da-9e71-fa808f6cadc0" Dec 04 11:56:42.794487 master-0 kubenswrapper[8993]: I1204 11:56:42.794477 8993 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0" podUID="cec85ded-d31e-47da-9e71-fa808f6cadc0" Dec 04 11:56:42.795519 master-0 kubenswrapper[8993]: I1204 11:56:42.795495 8993 scope.go:117] "RemoveContainer" containerID="b63dc777741930897797e6adb1b664297a0f1967d2d18f8fbd61bd116fd98669" Dec 04 11:56:42.809259 master-0 kubenswrapper[8993]: I1204 11:56:42.809182 8993 kubelet.go:1914] "Deleted mirror pod because it is outdated" pod="openshift-etcd/etcd-master-0" Dec 04 11:56:42.809480 master-0 kubenswrapper[8993]: I1204 11:56:42.809405 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-etcd/etcd-master-0"] Dec 04 11:56:42.814659 master-0 kubenswrapper[8993]: I1204 11:56:42.814591 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-etcd/etcd-master-0"] Dec 04 11:56:42.831174 master-0 kubenswrapper[8993]: I1204 11:56:42.831103 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd/etcd-master-0"] Dec 04 11:56:43.589480 master-0 kubenswrapper[8993]: I1204 11:56:43.589432 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk_e4d7939a-5961-4608-b910-73e71aa55bf6/route-controller-manager/1.log" Dec 04 11:56:43.589731 master-0 kubenswrapper[8993]: I1204 11:56:43.589541 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" event={"ID":"e4d7939a-5961-4608-b910-73e71aa55bf6","Type":"ContainerStarted","Data":"028cb113b8a4d0739d18a17371ebd3e1e120e22b132d20c18e57ba6391cc21d7"} Dec 04 11:56:43.590001 master-0 kubenswrapper[8993]: I1204 11:56:43.589973 8993 kubelet.go:1909] "Trying to delete pod" pod="openshift-etcd/etcd-master-0" podUID="cec85ded-d31e-47da-9e71-fa808f6cadc0" Dec 04 11:56:43.590001 master-0 kubenswrapper[8993]: I1204 11:56:43.590001 8993 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0" podUID="cec85ded-d31e-47da-9e71-fa808f6cadc0" Dec 04 11:56:43.590308 master-0 kubenswrapper[8993]: I1204 11:56:43.590270 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:56:43.629536 master-0 kubenswrapper[8993]: I1204 11:56:43.629461 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd/etcd-master-0" podStartSLOduration=1.629442632 podStartE2EDuration="1.629442632s" podCreationTimestamp="2025-12-04 11:56:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:56:43.629297278 +0000 UTC m=+1138.020238711" watchObservedRunningTime="2025-12-04 11:56:43.629442632 +0000 UTC m=+1138.020384065" Dec 04 11:56:43.743741 master-0 kubenswrapper[8993]: I1204 11:56:43.743695 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:56:43.794409 master-0 kubenswrapper[8993]: I1204 11:56:43.794159 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:56:43.794409 master-0 kubenswrapper[8993]: E1204 11:56:43.794411 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:56:47.794857 master-0 kubenswrapper[8993]: I1204 11:56:47.794776 8993 scope.go:117] "RemoveContainer" containerID="c3d6e3ec1c2075f0d2c2e41480f7486576efc2d0e3c1b8e7a0df0f84b64a6eb3" Dec 04 11:56:47.795485 master-0 kubenswrapper[8993]: E1204 11:56:47.795170 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:56:56.795115 master-0 kubenswrapper[8993]: I1204 11:56:56.794908 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:56:56.795847 master-0 kubenswrapper[8993]: E1204 11:56:56.795255 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:56:58.794801 master-0 kubenswrapper[8993]: I1204 11:56:58.794701 8993 scope.go:117] "RemoveContainer" containerID="c3d6e3ec1c2075f0d2c2e41480f7486576efc2d0e3c1b8e7a0df0f84b64a6eb3" Dec 04 11:56:58.795382 master-0 kubenswrapper[8993]: E1204 11:56:58.795067 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:57:10.794601 master-0 kubenswrapper[8993]: I1204 11:57:10.794505 8993 scope.go:117] "RemoveContainer" containerID="c3d6e3ec1c2075f0d2c2e41480f7486576efc2d0e3c1b8e7a0df0f84b64a6eb3" Dec 04 11:57:10.794601 master-0 kubenswrapper[8993]: I1204 11:57:10.794594 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:57:10.795431 master-0 kubenswrapper[8993]: E1204 11:57:10.794741 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:57:10.795431 master-0 kubenswrapper[8993]: E1204 11:57:10.794885 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:57:22.794672 master-0 kubenswrapper[8993]: I1204 11:57:22.794598 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:57:22.795716 master-0 kubenswrapper[8993]: E1204 11:57:22.794928 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:57:24.794081 master-0 kubenswrapper[8993]: I1204 11:57:24.793926 8993 scope.go:117] "RemoveContainer" containerID="c3d6e3ec1c2075f0d2c2e41480f7486576efc2d0e3c1b8e7a0df0f84b64a6eb3" Dec 04 11:57:24.794842 master-0 kubenswrapper[8993]: E1204 11:57:24.794251 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"snapshot-controller\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=snapshot-controller pod=csi-snapshot-controller-6b958b6f94-w74zr_openshift-cluster-storage-operator(38fc8086-a00c-4a2a-8a0e-c57e9d9d0103)\"" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" podUID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" Dec 04 11:57:37.794987 master-0 kubenswrapper[8993]: I1204 11:57:37.794925 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:57:37.795589 master-0 kubenswrapper[8993]: E1204 11:57:37.795255 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:57:39.794474 master-0 kubenswrapper[8993]: I1204 11:57:39.794387 8993 scope.go:117] "RemoveContainer" containerID="c3d6e3ec1c2075f0d2c2e41480f7486576efc2d0e3c1b8e7a0df0f84b64a6eb3" Dec 04 11:57:39.930110 master-0 kubenswrapper[8993]: I1204 11:57:39.930075 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/5.log" Dec 04 11:57:39.930849 master-0 kubenswrapper[8993]: I1204 11:57:39.930826 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/4.log" Dec 04 11:57:39.931298 master-0 kubenswrapper[8993]: I1204 11:57:39.931274 8993 generic.go:334] "Generic (PLEG): container finished" podID="b011b1f1-3235-4e20-825b-ce711c052407" containerID="6b81ee1ae28f16389ded7b634a062f62bd333e247fbc631f5edd514e5d0827da" exitCode=1 Dec 04 11:57:39.931409 master-0 kubenswrapper[8993]: I1204 11:57:39.931373 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" event={"ID":"b011b1f1-3235-4e20-825b-ce711c052407","Type":"ContainerDied","Data":"6b81ee1ae28f16389ded7b634a062f62bd333e247fbc631f5edd514e5d0827da"} Dec 04 11:57:39.931524 master-0 kubenswrapper[8993]: I1204 11:57:39.931508 8993 scope.go:117] "RemoveContainer" containerID="871a505c71fcc987e64230846e4890828086e506f1b1d8a3456559bac6ecba8e" Dec 04 11:57:39.932306 master-0 kubenswrapper[8993]: I1204 11:57:39.932278 8993 scope.go:117] "RemoveContainer" containerID="6b81ee1ae28f16389ded7b634a062f62bd333e247fbc631f5edd514e5d0827da" Dec 04 11:57:39.932671 master-0 kubenswrapper[8993]: E1204 11:57:39.932647 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=ingress-operator pod=ingress-operator-8649c48786-cx2b2_openshift-ingress-operator(b011b1f1-3235-4e20-825b-ce711c052407)\"" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" podUID="b011b1f1-3235-4e20-825b-ce711c052407" Dec 04 11:57:40.938114 master-0 kubenswrapper[8993]: I1204 11:57:40.938064 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/5.log" Dec 04 11:57:40.940528 master-0 kubenswrapper[8993]: I1204 11:57:40.940508 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/5.log" Dec 04 11:57:40.940608 master-0 kubenswrapper[8993]: I1204 11:57:40.940560 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" event={"ID":"38fc8086-a00c-4a2a-8a0e-c57e9d9d0103","Type":"ContainerStarted","Data":"e6dd3de655999dd73139dd633fcda105be0e68a4757cbd984035ddeac7e8ca3f"} Dec 04 11:57:49.795069 master-0 kubenswrapper[8993]: I1204 11:57:49.795019 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:57:49.795640 master-0 kubenswrapper[8993]: E1204 11:57:49.795326 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:57:50.795355 master-0 kubenswrapper[8993]: I1204 11:57:50.795312 8993 scope.go:117] "RemoveContainer" containerID="6b81ee1ae28f16389ded7b634a062f62bd333e247fbc631f5edd514e5d0827da" Dec 04 11:57:50.796858 master-0 kubenswrapper[8993]: E1204 11:57:50.796829 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=ingress-operator pod=ingress-operator-8649c48786-cx2b2_openshift-ingress-operator(b011b1f1-3235-4e20-825b-ce711c052407)\"" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" podUID="b011b1f1-3235-4e20-825b-ce711c052407" Dec 04 11:58:01.794490 master-0 kubenswrapper[8993]: I1204 11:58:01.794442 8993 scope.go:117] "RemoveContainer" containerID="6b81ee1ae28f16389ded7b634a062f62bd333e247fbc631f5edd514e5d0827da" Dec 04 11:58:01.795230 master-0 kubenswrapper[8993]: E1204 11:58:01.794723 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=ingress-operator pod=ingress-operator-8649c48786-cx2b2_openshift-ingress-operator(b011b1f1-3235-4e20-825b-ce711c052407)\"" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" podUID="b011b1f1-3235-4e20-825b-ce711c052407" Dec 04 11:58:03.098767 master-0 kubenswrapper[8993]: I1204 11:58:03.098674 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/installer-1-retry-1-master-0"] Dec 04 11:58:03.099385 master-0 kubenswrapper[8993]: E1204 11:58:03.099133 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c6335f99-eb41-4b1d-93df-4a24f0ce23bc" containerName="installer" Dec 04 11:58:03.099385 master-0 kubenswrapper[8993]: I1204 11:58:03.099154 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6335f99-eb41-4b1d-93df-4a24f0ce23bc" containerName="installer" Dec 04 11:58:03.099385 master-0 kubenswrapper[8993]: E1204 11:58:03.099187 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="27c4e782-11b4-43a3-9ffd-34bf4e40bbc4" containerName="installer" Dec 04 11:58:03.099385 master-0 kubenswrapper[8993]: I1204 11:58:03.099195 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="27c4e782-11b4-43a3-9ffd-34bf4e40bbc4" containerName="installer" Dec 04 11:58:03.099560 master-0 kubenswrapper[8993]: I1204 11:58:03.099413 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="27c4e782-11b4-43a3-9ffd-34bf4e40bbc4" containerName="installer" Dec 04 11:58:03.099560 master-0 kubenswrapper[8993]: I1204 11:58:03.099460 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="c6335f99-eb41-4b1d-93df-4a24f0ce23bc" containerName="installer" Dec 04 11:58:03.100252 master-0 kubenswrapper[8993]: I1204 11:58:03.100213 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-1-retry-1-master-0" Dec 04 11:58:03.102259 master-0 kubenswrapper[8993]: I1204 11:58:03.102221 8993 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver"/"installer-sa-dockercfg-79r7d" Dec 04 11:58:03.102981 master-0 kubenswrapper[8993]: I1204 11:58:03.102959 8993 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver"/"kube-root-ca.crt" Dec 04 11:58:03.126213 master-0 kubenswrapper[8993]: I1204 11:58:03.126148 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-1-retry-1-master-0"] Dec 04 11:58:03.163050 master-0 kubenswrapper[8993]: I1204 11:58:03.162973 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491-kube-api-access\") pod \"installer-1-retry-1-master-0\" (UID: \"4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491\") " pod="openshift-kube-apiserver/installer-1-retry-1-master-0" Dec 04 11:58:03.163050 master-0 kubenswrapper[8993]: I1204 11:58:03.163046 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491-kubelet-dir\") pod \"installer-1-retry-1-master-0\" (UID: \"4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491\") " pod="openshift-kube-apiserver/installer-1-retry-1-master-0" Dec 04 11:58:03.163342 master-0 kubenswrapper[8993]: I1204 11:58:03.163083 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491-var-lock\") pod \"installer-1-retry-1-master-0\" (UID: \"4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491\") " pod="openshift-kube-apiserver/installer-1-retry-1-master-0" Dec 04 11:58:03.264321 master-0 kubenswrapper[8993]: I1204 11:58:03.264255 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491-kube-api-access\") pod \"installer-1-retry-1-master-0\" (UID: \"4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491\") " pod="openshift-kube-apiserver/installer-1-retry-1-master-0" Dec 04 11:58:03.264321 master-0 kubenswrapper[8993]: I1204 11:58:03.264320 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491-kubelet-dir\") pod \"installer-1-retry-1-master-0\" (UID: \"4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491\") " pod="openshift-kube-apiserver/installer-1-retry-1-master-0" Dec 04 11:58:03.264615 master-0 kubenswrapper[8993]: I1204 11:58:03.264352 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491-var-lock\") pod \"installer-1-retry-1-master-0\" (UID: \"4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491\") " pod="openshift-kube-apiserver/installer-1-retry-1-master-0" Dec 04 11:58:03.264775 master-0 kubenswrapper[8993]: I1204 11:58:03.264666 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491-var-lock\") pod \"installer-1-retry-1-master-0\" (UID: \"4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491\") " pod="openshift-kube-apiserver/installer-1-retry-1-master-0" Dec 04 11:58:03.264875 master-0 kubenswrapper[8993]: I1204 11:58:03.264720 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491-kubelet-dir\") pod \"installer-1-retry-1-master-0\" (UID: \"4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491\") " pod="openshift-kube-apiserver/installer-1-retry-1-master-0" Dec 04 11:58:03.280682 master-0 kubenswrapper[8993]: I1204 11:58:03.280602 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491-kube-api-access\") pod \"installer-1-retry-1-master-0\" (UID: \"4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491\") " pod="openshift-kube-apiserver/installer-1-retry-1-master-0" Dec 04 11:58:03.418722 master-0 kubenswrapper[8993]: I1204 11:58:03.418522 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-1-retry-1-master-0" Dec 04 11:58:03.795615 master-0 kubenswrapper[8993]: I1204 11:58:03.795017 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:58:03.795615 master-0 kubenswrapper[8993]: E1204 11:58:03.795317 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:58:03.866909 master-0 kubenswrapper[8993]: I1204 11:58:03.866829 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-1-retry-1-master-0"] Dec 04 11:58:04.093963 master-0 kubenswrapper[8993]: I1204 11:58:04.093882 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-1-retry-1-master-0" event={"ID":"4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491","Type":"ContainerStarted","Data":"94e218e8d16edaeda65a04226930569ea4a5556ecc735d8f29bd11d61ca1a830"} Dec 04 11:58:05.103011 master-0 kubenswrapper[8993]: I1204 11:58:05.102946 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-1-retry-1-master-0" event={"ID":"4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491","Type":"ContainerStarted","Data":"56f66e86a303f06a82ff82c486a75d82a740c9bc6ff35f2853c6086d774366c6"} Dec 04 11:58:05.144549 master-0 kubenswrapper[8993]: I1204 11:58:05.144463 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/installer-1-retry-1-master-0" podStartSLOduration=2.144444926 podStartE2EDuration="2.144444926s" podCreationTimestamp="2025-12-04 11:58:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:58:05.141022394 +0000 UTC m=+1219.531963827" watchObservedRunningTime="2025-12-04 11:58:05.144444926 +0000 UTC m=+1219.535386359" Dec 04 11:58:09.907251 master-0 kubenswrapper[8993]: I1204 11:58:09.907180 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-apiserver/installer-1-retry-1-master-0"] Dec 04 11:58:09.907923 master-0 kubenswrapper[8993]: I1204 11:58:09.907469 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/installer-1-retry-1-master-0" podUID="4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491" containerName="installer" containerID="cri-o://56f66e86a303f06a82ff82c486a75d82a740c9bc6ff35f2853c6086d774366c6" gracePeriod=30 Dec 04 11:58:12.794051 master-0 kubenswrapper[8993]: I1204 11:58:12.793999 8993 scope.go:117] "RemoveContainer" containerID="6b81ee1ae28f16389ded7b634a062f62bd333e247fbc631f5edd514e5d0827da" Dec 04 11:58:12.794650 master-0 kubenswrapper[8993]: E1204 11:58:12.794327 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=ingress-operator pod=ingress-operator-8649c48786-cx2b2_openshift-ingress-operator(b011b1f1-3235-4e20-825b-ce711c052407)\"" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" podUID="b011b1f1-3235-4e20-825b-ce711c052407" Dec 04 11:58:14.494329 master-0 kubenswrapper[8993]: I1204 11:58:14.494258 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/installer-2-master-0"] Dec 04 11:58:14.495407 master-0 kubenswrapper[8993]: I1204 11:58:14.495384 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 11:58:14.508917 master-0 kubenswrapper[8993]: I1204 11:58:14.508866 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-2-master-0"] Dec 04 11:58:14.619626 master-0 kubenswrapper[8993]: I1204 11:58:14.619570 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/72c2307b-e2b0-4123-8a2f-3b2ef3dac740-var-lock\") pod \"installer-2-master-0\" (UID: \"72c2307b-e2b0-4123-8a2f-3b2ef3dac740\") " pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 11:58:14.620012 master-0 kubenswrapper[8993]: I1204 11:58:14.619984 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72c2307b-e2b0-4123-8a2f-3b2ef3dac740-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"72c2307b-e2b0-4123-8a2f-3b2ef3dac740\") " pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 11:58:14.620145 master-0 kubenswrapper[8993]: I1204 11:58:14.620125 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/72c2307b-e2b0-4123-8a2f-3b2ef3dac740-kube-api-access\") pod \"installer-2-master-0\" (UID: \"72c2307b-e2b0-4123-8a2f-3b2ef3dac740\") " pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 11:58:14.721218 master-0 kubenswrapper[8993]: I1204 11:58:14.721145 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/72c2307b-e2b0-4123-8a2f-3b2ef3dac740-var-lock\") pod \"installer-2-master-0\" (UID: \"72c2307b-e2b0-4123-8a2f-3b2ef3dac740\") " pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 11:58:14.721469 master-0 kubenswrapper[8993]: I1204 11:58:14.721251 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72c2307b-e2b0-4123-8a2f-3b2ef3dac740-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"72c2307b-e2b0-4123-8a2f-3b2ef3dac740\") " pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 11:58:14.721469 master-0 kubenswrapper[8993]: I1204 11:58:14.721296 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/72c2307b-e2b0-4123-8a2f-3b2ef3dac740-kube-api-access\") pod \"installer-2-master-0\" (UID: \"72c2307b-e2b0-4123-8a2f-3b2ef3dac740\") " pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 11:58:14.721469 master-0 kubenswrapper[8993]: I1204 11:58:14.721419 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72c2307b-e2b0-4123-8a2f-3b2ef3dac740-kubelet-dir\") pod \"installer-2-master-0\" (UID: \"72c2307b-e2b0-4123-8a2f-3b2ef3dac740\") " pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 11:58:14.721656 master-0 kubenswrapper[8993]: I1204 11:58:14.721633 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/72c2307b-e2b0-4123-8a2f-3b2ef3dac740-var-lock\") pod \"installer-2-master-0\" (UID: \"72c2307b-e2b0-4123-8a2f-3b2ef3dac740\") " pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 11:58:14.737607 master-0 kubenswrapper[8993]: I1204 11:58:14.737539 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/72c2307b-e2b0-4123-8a2f-3b2ef3dac740-kube-api-access\") pod \"installer-2-master-0\" (UID: \"72c2307b-e2b0-4123-8a2f-3b2ef3dac740\") " pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 11:58:14.815542 master-0 kubenswrapper[8993]: I1204 11:58:14.815467 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 11:58:15.252116 master-0 kubenswrapper[8993]: I1204 11:58:15.251443 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-2-master-0"] Dec 04 11:58:15.798394 master-0 kubenswrapper[8993]: I1204 11:58:15.798337 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:58:15.798930 master-0 kubenswrapper[8993]: E1204 11:58:15.798550 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:58:16.175692 master-0 kubenswrapper[8993]: I1204 11:58:16.175612 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-2-master-0" event={"ID":"72c2307b-e2b0-4123-8a2f-3b2ef3dac740","Type":"ContainerStarted","Data":"f8d2db8c47588ae190f31321aeac6542d5c1f614933353df6db7fadac1d05e2c"} Dec 04 11:58:16.175692 master-0 kubenswrapper[8993]: I1204 11:58:16.175668 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-2-master-0" event={"ID":"72c2307b-e2b0-4123-8a2f-3b2ef3dac740","Type":"ContainerStarted","Data":"8427e0257c34d0faa5738f008217a794edfa8fc6a67f6fb51a64db60825bb771"} Dec 04 11:58:16.274055 master-0 kubenswrapper[8993]: I1204 11:58:16.273950 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/installer-2-master-0" podStartSLOduration=2.273926217 podStartE2EDuration="2.273926217s" podCreationTimestamp="2025-12-04 11:58:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:58:16.272660704 +0000 UTC m=+1230.663602137" watchObservedRunningTime="2025-12-04 11:58:16.273926217 +0000 UTC m=+1230.664867650" Dec 04 11:58:26.795125 master-0 kubenswrapper[8993]: I1204 11:58:26.794993 8993 scope.go:117] "RemoveContainer" containerID="6b81ee1ae28f16389ded7b634a062f62bd333e247fbc631f5edd514e5d0827da" Dec 04 11:58:26.795696 master-0 kubenswrapper[8993]: E1204 11:58:26.795276 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=ingress-operator pod=ingress-operator-8649c48786-cx2b2_openshift-ingress-operator(b011b1f1-3235-4e20-825b-ce711c052407)\"" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" podUID="b011b1f1-3235-4e20-825b-ce711c052407" Dec 04 11:58:29.516305 master-0 kubenswrapper[8993]: I1204 11:58:29.516200 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-apiserver/installer-2-master-0"] Dec 04 11:58:29.518129 master-0 kubenswrapper[8993]: I1204 11:58:29.516521 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/installer-2-master-0" podUID="72c2307b-e2b0-4123-8a2f-3b2ef3dac740" containerName="installer" containerID="cri-o://f8d2db8c47588ae190f31321aeac6542d5c1f614933353df6db7fadac1d05e2c" gracePeriod=30 Dec 04 11:58:29.921700 master-0 kubenswrapper[8993]: I1204 11:58:29.921616 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-2-master-0_72c2307b-e2b0-4123-8a2f-3b2ef3dac740/installer/0.log" Dec 04 11:58:29.921700 master-0 kubenswrapper[8993]: I1204 11:58:29.921720 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 11:58:30.035182 master-0 kubenswrapper[8993]: I1204 11:58:30.035053 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/72c2307b-e2b0-4123-8a2f-3b2ef3dac740-var-lock\") pod \"72c2307b-e2b0-4123-8a2f-3b2ef3dac740\" (UID: \"72c2307b-e2b0-4123-8a2f-3b2ef3dac740\") " Dec 04 11:58:30.035182 master-0 kubenswrapper[8993]: I1204 11:58:30.035183 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72c2307b-e2b0-4123-8a2f-3b2ef3dac740-kubelet-dir\") pod \"72c2307b-e2b0-4123-8a2f-3b2ef3dac740\" (UID: \"72c2307b-e2b0-4123-8a2f-3b2ef3dac740\") " Dec 04 11:58:30.035519 master-0 kubenswrapper[8993]: I1204 11:58:30.035293 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/72c2307b-e2b0-4123-8a2f-3b2ef3dac740-kube-api-access\") pod \"72c2307b-e2b0-4123-8a2f-3b2ef3dac740\" (UID: \"72c2307b-e2b0-4123-8a2f-3b2ef3dac740\") " Dec 04 11:58:30.035628 master-0 kubenswrapper[8993]: I1204 11:58:30.035285 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/72c2307b-e2b0-4123-8a2f-3b2ef3dac740-var-lock" (OuterVolumeSpecName: "var-lock") pod "72c2307b-e2b0-4123-8a2f-3b2ef3dac740" (UID: "72c2307b-e2b0-4123-8a2f-3b2ef3dac740"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:58:30.035628 master-0 kubenswrapper[8993]: I1204 11:58:30.035314 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/72c2307b-e2b0-4123-8a2f-3b2ef3dac740-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "72c2307b-e2b0-4123-8a2f-3b2ef3dac740" (UID: "72c2307b-e2b0-4123-8a2f-3b2ef3dac740"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:58:30.038279 master-0 kubenswrapper[8993]: I1204 11:58:30.038224 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72c2307b-e2b0-4123-8a2f-3b2ef3dac740-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "72c2307b-e2b0-4123-8a2f-3b2ef3dac740" (UID: "72c2307b-e2b0-4123-8a2f-3b2ef3dac740"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:58:30.137056 master-0 kubenswrapper[8993]: I1204 11:58:30.136933 8993 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/72c2307b-e2b0-4123-8a2f-3b2ef3dac740-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 11:58:30.137284 master-0 kubenswrapper[8993]: I1204 11:58:30.137268 8993 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72c2307b-e2b0-4123-8a2f-3b2ef3dac740-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:58:30.137351 master-0 kubenswrapper[8993]: I1204 11:58:30.137341 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/72c2307b-e2b0-4123-8a2f-3b2ef3dac740-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 11:58:30.262983 master-0 kubenswrapper[8993]: I1204 11:58:30.262946 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-2-master-0_72c2307b-e2b0-4123-8a2f-3b2ef3dac740/installer/0.log" Dec 04 11:58:30.263396 master-0 kubenswrapper[8993]: I1204 11:58:30.263371 8993 generic.go:334] "Generic (PLEG): container finished" podID="72c2307b-e2b0-4123-8a2f-3b2ef3dac740" containerID="f8d2db8c47588ae190f31321aeac6542d5c1f614933353df6db7fadac1d05e2c" exitCode=1 Dec 04 11:58:30.263522 master-0 kubenswrapper[8993]: I1204 11:58:30.263484 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-2-master-0" Dec 04 11:58:30.263674 master-0 kubenswrapper[8993]: I1204 11:58:30.263489 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-2-master-0" event={"ID":"72c2307b-e2b0-4123-8a2f-3b2ef3dac740","Type":"ContainerDied","Data":"f8d2db8c47588ae190f31321aeac6542d5c1f614933353df6db7fadac1d05e2c"} Dec 04 11:58:30.263729 master-0 kubenswrapper[8993]: I1204 11:58:30.263708 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-2-master-0" event={"ID":"72c2307b-e2b0-4123-8a2f-3b2ef3dac740","Type":"ContainerDied","Data":"8427e0257c34d0faa5738f008217a794edfa8fc6a67f6fb51a64db60825bb771"} Dec 04 11:58:30.263774 master-0 kubenswrapper[8993]: I1204 11:58:30.263743 8993 scope.go:117] "RemoveContainer" containerID="f8d2db8c47588ae190f31321aeac6542d5c1f614933353df6db7fadac1d05e2c" Dec 04 11:58:30.279372 master-0 kubenswrapper[8993]: I1204 11:58:30.279340 8993 scope.go:117] "RemoveContainer" containerID="f8d2db8c47588ae190f31321aeac6542d5c1f614933353df6db7fadac1d05e2c" Dec 04 11:58:30.279962 master-0 kubenswrapper[8993]: E1204 11:58:30.279917 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8d2db8c47588ae190f31321aeac6542d5c1f614933353df6db7fadac1d05e2c\": container with ID starting with f8d2db8c47588ae190f31321aeac6542d5c1f614933353df6db7fadac1d05e2c not found: ID does not exist" containerID="f8d2db8c47588ae190f31321aeac6542d5c1f614933353df6db7fadac1d05e2c" Dec 04 11:58:30.280029 master-0 kubenswrapper[8993]: I1204 11:58:30.279976 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8d2db8c47588ae190f31321aeac6542d5c1f614933353df6db7fadac1d05e2c"} err="failed to get container status \"f8d2db8c47588ae190f31321aeac6542d5c1f614933353df6db7fadac1d05e2c\": rpc error: code = NotFound desc = could not find container \"f8d2db8c47588ae190f31321aeac6542d5c1f614933353df6db7fadac1d05e2c\": container with ID starting with f8d2db8c47588ae190f31321aeac6542d5c1f614933353df6db7fadac1d05e2c not found: ID does not exist" Dec 04 11:58:30.308719 master-0 kubenswrapper[8993]: I1204 11:58:30.308665 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-apiserver/installer-2-master-0"] Dec 04 11:58:30.314481 master-0 kubenswrapper[8993]: I1204 11:58:30.314414 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-apiserver/installer-2-master-0"] Dec 04 11:58:30.795503 master-0 kubenswrapper[8993]: I1204 11:58:30.795464 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:58:30.796339 master-0 kubenswrapper[8993]: E1204 11:58:30.796315 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:58:31.802635 master-0 kubenswrapper[8993]: I1204 11:58:31.802575 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72c2307b-e2b0-4123-8a2f-3b2ef3dac740" path="/var/lib/kubelet/pods/72c2307b-e2b0-4123-8a2f-3b2ef3dac740/volumes" Dec 04 11:58:33.503363 master-0 kubenswrapper[8993]: I1204 11:58:33.502720 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/installer-3-master-0"] Dec 04 11:58:33.503363 master-0 kubenswrapper[8993]: E1204 11:58:33.503117 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="72c2307b-e2b0-4123-8a2f-3b2ef3dac740" containerName="installer" Dec 04 11:58:33.503363 master-0 kubenswrapper[8993]: I1204 11:58:33.503136 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="72c2307b-e2b0-4123-8a2f-3b2ef3dac740" containerName="installer" Dec 04 11:58:33.503363 master-0 kubenswrapper[8993]: I1204 11:58:33.503323 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="72c2307b-e2b0-4123-8a2f-3b2ef3dac740" containerName="installer" Dec 04 11:58:33.505360 master-0 kubenswrapper[8993]: I1204 11:58:33.503978 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 11:58:33.524240 master-0 kubenswrapper[8993]: I1204 11:58:33.524127 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-3-master-0"] Dec 04 11:58:33.688949 master-0 kubenswrapper[8993]: I1204 11:58:33.688859 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/0fad065c-94c9-4a38-ab76-cf0266bdc04b-var-lock\") pod \"installer-3-master-0\" (UID: \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 11:58:33.688949 master-0 kubenswrapper[8993]: I1204 11:58:33.688919 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/0fad065c-94c9-4a38-ab76-cf0266bdc04b-kube-api-access\") pod \"installer-3-master-0\" (UID: \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 11:58:33.688949 master-0 kubenswrapper[8993]: I1204 11:58:33.688950 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0fad065c-94c9-4a38-ab76-cf0266bdc04b-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 11:58:33.791600 master-0 kubenswrapper[8993]: I1204 11:58:33.791418 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/0fad065c-94c9-4a38-ab76-cf0266bdc04b-var-lock\") pod \"installer-3-master-0\" (UID: \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 11:58:33.791600 master-0 kubenswrapper[8993]: I1204 11:58:33.791515 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/0fad065c-94c9-4a38-ab76-cf0266bdc04b-kube-api-access\") pod \"installer-3-master-0\" (UID: \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 11:58:33.791600 master-0 kubenswrapper[8993]: I1204 11:58:33.791558 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0fad065c-94c9-4a38-ab76-cf0266bdc04b-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 11:58:33.791600 master-0 kubenswrapper[8993]: I1204 11:58:33.791555 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/0fad065c-94c9-4a38-ab76-cf0266bdc04b-var-lock\") pod \"installer-3-master-0\" (UID: \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 11:58:33.791973 master-0 kubenswrapper[8993]: I1204 11:58:33.791781 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0fad065c-94c9-4a38-ab76-cf0266bdc04b-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 11:58:33.810958 master-0 kubenswrapper[8993]: I1204 11:58:33.810872 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/0fad065c-94c9-4a38-ab76-cf0266bdc04b-kube-api-access\") pod \"installer-3-master-0\" (UID: \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 11:58:33.828924 master-0 kubenswrapper[8993]: I1204 11:58:33.828173 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 11:58:34.247596 master-0 kubenswrapper[8993]: I1204 11:58:34.247524 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-3-master-0"] Dec 04 11:58:34.291838 master-0 kubenswrapper[8993]: I1204 11:58:34.291769 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-3-master-0" event={"ID":"0fad065c-94c9-4a38-ab76-cf0266bdc04b","Type":"ContainerStarted","Data":"067d2ebf7cd71320983357660c7bfa56d36312a860021a8819604e4142c7331b"} Dec 04 11:58:35.303429 master-0 kubenswrapper[8993]: I1204 11:58:35.303344 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-1-retry-1-master-0_4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491/installer/0.log" Dec 04 11:58:35.303429 master-0 kubenswrapper[8993]: I1204 11:58:35.303424 8993 generic.go:334] "Generic (PLEG): container finished" podID="4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491" containerID="56f66e86a303f06a82ff82c486a75d82a740c9bc6ff35f2853c6086d774366c6" exitCode=1 Dec 04 11:58:35.304219 master-0 kubenswrapper[8993]: I1204 11:58:35.303521 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-1-retry-1-master-0" event={"ID":"4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491","Type":"ContainerDied","Data":"56f66e86a303f06a82ff82c486a75d82a740c9bc6ff35f2853c6086d774366c6"} Dec 04 11:58:35.304219 master-0 kubenswrapper[8993]: I1204 11:58:35.303561 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-1-retry-1-master-0" event={"ID":"4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491","Type":"ContainerDied","Data":"94e218e8d16edaeda65a04226930569ea4a5556ecc735d8f29bd11d61ca1a830"} Dec 04 11:58:35.304219 master-0 kubenswrapper[8993]: I1204 11:58:35.303577 8993 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94e218e8d16edaeda65a04226930569ea4a5556ecc735d8f29bd11d61ca1a830" Dec 04 11:58:35.306212 master-0 kubenswrapper[8993]: I1204 11:58:35.306153 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-3-master-0" event={"ID":"0fad065c-94c9-4a38-ab76-cf0266bdc04b","Type":"ContainerStarted","Data":"25421a99ea678b2107e40949ffdaa62c5f5165b3a02aa309382f3c9da4a11384"} Dec 04 11:58:35.340160 master-0 kubenswrapper[8993]: I1204 11:58:35.340102 8993 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-1-retry-1-master-0_4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491/installer/0.log" Dec 04 11:58:35.340377 master-0 kubenswrapper[8993]: I1204 11:58:35.340237 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-1-retry-1-master-0" Dec 04 11:58:35.360779 master-0 kubenswrapper[8993]: I1204 11:58:35.360582 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/installer-3-master-0" podStartSLOduration=2.360561202 podStartE2EDuration="2.360561202s" podCreationTimestamp="2025-12-04 11:58:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:58:35.331280808 +0000 UTC m=+1249.722222251" watchObservedRunningTime="2025-12-04 11:58:35.360561202 +0000 UTC m=+1249.751502635" Dec 04 11:58:35.521541 master-0 kubenswrapper[8993]: I1204 11:58:35.521444 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491-kube-api-access\") pod \"4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491\" (UID: \"4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491\") " Dec 04 11:58:35.522002 master-0 kubenswrapper[8993]: I1204 11:58:35.521598 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491-kubelet-dir\") pod \"4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491\" (UID: \"4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491\") " Dec 04 11:58:35.522002 master-0 kubenswrapper[8993]: I1204 11:58:35.521676 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491-var-lock\") pod \"4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491\" (UID: \"4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491\") " Dec 04 11:58:35.522002 master-0 kubenswrapper[8993]: I1204 11:58:35.521976 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491" (UID: "4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:58:35.522136 master-0 kubenswrapper[8993]: I1204 11:58:35.522097 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491-var-lock" (OuterVolumeSpecName: "var-lock") pod "4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491" (UID: "4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:58:35.522609 master-0 kubenswrapper[8993]: I1204 11:58:35.522577 8993 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 11:58:35.522609 master-0 kubenswrapper[8993]: I1204 11:58:35.522598 8993 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:58:35.524908 master-0 kubenswrapper[8993]: I1204 11:58:35.524866 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491" (UID: "4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:58:35.628314 master-0 kubenswrapper[8993]: I1204 11:58:35.628241 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 11:58:36.311329 master-0 kubenswrapper[8993]: I1204 11:58:36.311280 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-1-retry-1-master-0" Dec 04 11:58:36.394783 master-0 kubenswrapper[8993]: I1204 11:58:36.394719 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-apiserver/installer-1-retry-1-master-0"] Dec 04 11:58:36.469904 master-0 kubenswrapper[8993]: I1204 11:58:36.469832 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-apiserver/installer-1-retry-1-master-0"] Dec 04 11:58:37.801727 master-0 kubenswrapper[8993]: I1204 11:58:37.801670 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491" path="/var/lib/kubelet/pods/4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491/volumes" Dec 04 11:58:40.794992 master-0 kubenswrapper[8993]: I1204 11:58:40.794945 8993 scope.go:117] "RemoveContainer" containerID="6b81ee1ae28f16389ded7b634a062f62bd333e247fbc631f5edd514e5d0827da" Dec 04 11:58:40.795484 master-0 kubenswrapper[8993]: E1204 11:58:40.795225 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=ingress-operator pod=ingress-operator-8649c48786-cx2b2_openshift-ingress-operator(b011b1f1-3235-4e20-825b-ce711c052407)\"" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" podUID="b011b1f1-3235-4e20-825b-ce711c052407" Dec 04 11:58:45.798088 master-0 kubenswrapper[8993]: I1204 11:58:45.797932 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:58:45.800187 master-0 kubenswrapper[8993]: E1204 11:58:45.799515 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:58:50.615443 master-0 kubenswrapper[8993]: I1204 11:58:50.615355 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-v4tlj"] Dec 04 11:58:50.616119 master-0 kubenswrapper[8993]: E1204 11:58:50.615829 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491" containerName="installer" Dec 04 11:58:50.616119 master-0 kubenswrapper[8993]: I1204 11:58:50.615849 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491" containerName="installer" Dec 04 11:58:50.616119 master-0 kubenswrapper[8993]: I1204 11:58:50.616014 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491" containerName="installer" Dec 04 11:58:50.617222 master-0 kubenswrapper[8993]: I1204 11:58:50.617180 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-v4tlj" Dec 04 11:58:50.623034 master-0 kubenswrapper[8993]: I1204 11:58:50.620274 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-dr5sc"] Dec 04 11:58:50.623034 master-0 kubenswrapper[8993]: I1204 11:58:50.621972 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-dr5sc" Dec 04 11:58:50.624932 master-0 kubenswrapper[8993]: I1204 11:58:50.624865 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-xsdsw"] Dec 04 11:58:50.625949 master-0 kubenswrapper[8993]: I1204 11:58:50.625895 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-xsdsw" Dec 04 11:58:50.629233 master-0 kubenswrapper[8993]: I1204 11:58:50.629143 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-fvf4r"] Dec 04 11:58:50.631018 master-0 kubenswrapper[8993]: I1204 11:58:50.630966 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-fvf4r" Dec 04 11:58:50.646123 master-0 kubenswrapper[8993]: I1204 11:58:50.646061 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-v4tlj"] Dec 04 11:58:50.665280 master-0 kubenswrapper[8993]: I1204 11:58:50.665190 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-fvf4r"] Dec 04 11:58:50.668496 master-0 kubenswrapper[8993]: I1204 11:58:50.668429 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-xsdsw"] Dec 04 11:58:50.671201 master-0 kubenswrapper[8993]: I1204 11:58:50.671134 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-dr5sc"] Dec 04 11:58:50.714946 master-0 kubenswrapper[8993]: I1204 11:58:50.714830 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2ee42f3c-353c-459c-aa6e-8f85eadbfb84-utilities\") pod \"certified-operators-dr5sc\" (UID: \"2ee42f3c-353c-459c-aa6e-8f85eadbfb84\") " pod="openshift-marketplace/certified-operators-dr5sc" Dec 04 11:58:50.714946 master-0 kubenswrapper[8993]: I1204 11:58:50.714903 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb77r\" (UniqueName: \"kubernetes.io/projected/fcf0787c-2d77-4bbe-ad3c-70e03169c96f-kube-api-access-mb77r\") pod \"community-operators-fvf4r\" (UID: \"fcf0787c-2d77-4bbe-ad3c-70e03169c96f\") " pod="openshift-marketplace/community-operators-fvf4r" Dec 04 11:58:50.714946 master-0 kubenswrapper[8993]: I1204 11:58:50.714964 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/677a41b8-0c6a-4c96-ac98-65bc54985bb7-catalog-content\") pod \"redhat-marketplace-xsdsw\" (UID: \"677a41b8-0c6a-4c96-ac98-65bc54985bb7\") " pod="openshift-marketplace/redhat-marketplace-xsdsw" Dec 04 11:58:50.715491 master-0 kubenswrapper[8993]: I1204 11:58:50.715001 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7sgq\" (UniqueName: \"kubernetes.io/projected/2ee42f3c-353c-459c-aa6e-8f85eadbfb84-kube-api-access-b7sgq\") pod \"certified-operators-dr5sc\" (UID: \"2ee42f3c-353c-459c-aa6e-8f85eadbfb84\") " pod="openshift-marketplace/certified-operators-dr5sc" Dec 04 11:58:50.715491 master-0 kubenswrapper[8993]: I1204 11:58:50.715036 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/677a41b8-0c6a-4c96-ac98-65bc54985bb7-utilities\") pod \"redhat-marketplace-xsdsw\" (UID: \"677a41b8-0c6a-4c96-ac98-65bc54985bb7\") " pod="openshift-marketplace/redhat-marketplace-xsdsw" Dec 04 11:58:50.715491 master-0 kubenswrapper[8993]: I1204 11:58:50.715073 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/727fd5bf-d896-41b6-9b4f-0c811ccca13a-catalog-content\") pod \"redhat-operators-v4tlj\" (UID: \"727fd5bf-d896-41b6-9b4f-0c811ccca13a\") " pod="openshift-marketplace/redhat-operators-v4tlj" Dec 04 11:58:50.715491 master-0 kubenswrapper[8993]: I1204 11:58:50.715110 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2ee42f3c-353c-459c-aa6e-8f85eadbfb84-catalog-content\") pod \"certified-operators-dr5sc\" (UID: \"2ee42f3c-353c-459c-aa6e-8f85eadbfb84\") " pod="openshift-marketplace/certified-operators-dr5sc" Dec 04 11:58:50.715491 master-0 kubenswrapper[8993]: I1204 11:58:50.715148 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/727fd5bf-d896-41b6-9b4f-0c811ccca13a-utilities\") pod \"redhat-operators-v4tlj\" (UID: \"727fd5bf-d896-41b6-9b4f-0c811ccca13a\") " pod="openshift-marketplace/redhat-operators-v4tlj" Dec 04 11:58:50.715491 master-0 kubenswrapper[8993]: I1204 11:58:50.715330 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqvgz\" (UniqueName: \"kubernetes.io/projected/727fd5bf-d896-41b6-9b4f-0c811ccca13a-kube-api-access-nqvgz\") pod \"redhat-operators-v4tlj\" (UID: \"727fd5bf-d896-41b6-9b4f-0c811ccca13a\") " pod="openshift-marketplace/redhat-operators-v4tlj" Dec 04 11:58:50.715491 master-0 kubenswrapper[8993]: I1204 11:58:50.715362 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fcf0787c-2d77-4bbe-ad3c-70e03169c96f-utilities\") pod \"community-operators-fvf4r\" (UID: \"fcf0787c-2d77-4bbe-ad3c-70e03169c96f\") " pod="openshift-marketplace/community-operators-fvf4r" Dec 04 11:58:50.715491 master-0 kubenswrapper[8993]: I1204 11:58:50.715386 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fcf0787c-2d77-4bbe-ad3c-70e03169c96f-catalog-content\") pod \"community-operators-fvf4r\" (UID: \"fcf0787c-2d77-4bbe-ad3c-70e03169c96f\") " pod="openshift-marketplace/community-operators-fvf4r" Dec 04 11:58:50.715491 master-0 kubenswrapper[8993]: I1204 11:58:50.715414 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4qj8\" (UniqueName: \"kubernetes.io/projected/677a41b8-0c6a-4c96-ac98-65bc54985bb7-kube-api-access-g4qj8\") pod \"redhat-marketplace-xsdsw\" (UID: \"677a41b8-0c6a-4c96-ac98-65bc54985bb7\") " pod="openshift-marketplace/redhat-marketplace-xsdsw" Dec 04 11:58:50.819069 master-0 kubenswrapper[8993]: I1204 11:58:50.819015 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fcf0787c-2d77-4bbe-ad3c-70e03169c96f-utilities\") pod \"community-operators-fvf4r\" (UID: \"fcf0787c-2d77-4bbe-ad3c-70e03169c96f\") " pod="openshift-marketplace/community-operators-fvf4r" Dec 04 11:58:50.819349 master-0 kubenswrapper[8993]: I1204 11:58:50.819329 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fcf0787c-2d77-4bbe-ad3c-70e03169c96f-catalog-content\") pod \"community-operators-fvf4r\" (UID: \"fcf0787c-2d77-4bbe-ad3c-70e03169c96f\") " pod="openshift-marketplace/community-operators-fvf4r" Dec 04 11:58:50.819443 master-0 kubenswrapper[8993]: I1204 11:58:50.819430 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-g4qj8\" (UniqueName: \"kubernetes.io/projected/677a41b8-0c6a-4c96-ac98-65bc54985bb7-kube-api-access-g4qj8\") pod \"redhat-marketplace-xsdsw\" (UID: \"677a41b8-0c6a-4c96-ac98-65bc54985bb7\") " pod="openshift-marketplace/redhat-marketplace-xsdsw" Dec 04 11:58:50.819549 master-0 kubenswrapper[8993]: I1204 11:58:50.819525 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fcf0787c-2d77-4bbe-ad3c-70e03169c96f-utilities\") pod \"community-operators-fvf4r\" (UID: \"fcf0787c-2d77-4bbe-ad3c-70e03169c96f\") " pod="openshift-marketplace/community-operators-fvf4r" Dec 04 11:58:50.819549 master-0 kubenswrapper[8993]: I1204 11:58:50.819532 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2ee42f3c-353c-459c-aa6e-8f85eadbfb84-utilities\") pod \"certified-operators-dr5sc\" (UID: \"2ee42f3c-353c-459c-aa6e-8f85eadbfb84\") " pod="openshift-marketplace/certified-operators-dr5sc" Dec 04 11:58:50.819775 master-0 kubenswrapper[8993]: I1204 11:58:50.819753 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mb77r\" (UniqueName: \"kubernetes.io/projected/fcf0787c-2d77-4bbe-ad3c-70e03169c96f-kube-api-access-mb77r\") pod \"community-operators-fvf4r\" (UID: \"fcf0787c-2d77-4bbe-ad3c-70e03169c96f\") " pod="openshift-marketplace/community-operators-fvf4r" Dec 04 11:58:50.819849 master-0 kubenswrapper[8993]: I1204 11:58:50.819800 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/677a41b8-0c6a-4c96-ac98-65bc54985bb7-catalog-content\") pod \"redhat-marketplace-xsdsw\" (UID: \"677a41b8-0c6a-4c96-ac98-65bc54985bb7\") " pod="openshift-marketplace/redhat-marketplace-xsdsw" Dec 04 11:58:50.819849 master-0 kubenswrapper[8993]: I1204 11:58:50.819844 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b7sgq\" (UniqueName: \"kubernetes.io/projected/2ee42f3c-353c-459c-aa6e-8f85eadbfb84-kube-api-access-b7sgq\") pod \"certified-operators-dr5sc\" (UID: \"2ee42f3c-353c-459c-aa6e-8f85eadbfb84\") " pod="openshift-marketplace/certified-operators-dr5sc" Dec 04 11:58:50.819909 master-0 kubenswrapper[8993]: I1204 11:58:50.819868 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/677a41b8-0c6a-4c96-ac98-65bc54985bb7-utilities\") pod \"redhat-marketplace-xsdsw\" (UID: \"677a41b8-0c6a-4c96-ac98-65bc54985bb7\") " pod="openshift-marketplace/redhat-marketplace-xsdsw" Dec 04 11:58:50.819909 master-0 kubenswrapper[8993]: I1204 11:58:50.819898 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/727fd5bf-d896-41b6-9b4f-0c811ccca13a-catalog-content\") pod \"redhat-operators-v4tlj\" (UID: \"727fd5bf-d896-41b6-9b4f-0c811ccca13a\") " pod="openshift-marketplace/redhat-operators-v4tlj" Dec 04 11:58:50.820224 master-0 kubenswrapper[8993]: I1204 11:58:50.820204 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2ee42f3c-353c-459c-aa6e-8f85eadbfb84-utilities\") pod \"certified-operators-dr5sc\" (UID: \"2ee42f3c-353c-459c-aa6e-8f85eadbfb84\") " pod="openshift-marketplace/certified-operators-dr5sc" Dec 04 11:58:50.820484 master-0 kubenswrapper[8993]: I1204 11:58:50.820449 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/677a41b8-0c6a-4c96-ac98-65bc54985bb7-utilities\") pod \"redhat-marketplace-xsdsw\" (UID: \"677a41b8-0c6a-4c96-ac98-65bc54985bb7\") " pod="openshift-marketplace/redhat-marketplace-xsdsw" Dec 04 11:58:50.820613 master-0 kubenswrapper[8993]: I1204 11:58:50.820563 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/677a41b8-0c6a-4c96-ac98-65bc54985bb7-catalog-content\") pod \"redhat-marketplace-xsdsw\" (UID: \"677a41b8-0c6a-4c96-ac98-65bc54985bb7\") " pod="openshift-marketplace/redhat-marketplace-xsdsw" Dec 04 11:58:50.820832 master-0 kubenswrapper[8993]: I1204 11:58:50.820779 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/727fd5bf-d896-41b6-9b4f-0c811ccca13a-catalog-content\") pod \"redhat-operators-v4tlj\" (UID: \"727fd5bf-d896-41b6-9b4f-0c811ccca13a\") " pod="openshift-marketplace/redhat-operators-v4tlj" Dec 04 11:58:50.820897 master-0 kubenswrapper[8993]: I1204 11:58:50.820858 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2ee42f3c-353c-459c-aa6e-8f85eadbfb84-catalog-content\") pod \"certified-operators-dr5sc\" (UID: \"2ee42f3c-353c-459c-aa6e-8f85eadbfb84\") " pod="openshift-marketplace/certified-operators-dr5sc" Dec 04 11:58:50.820897 master-0 kubenswrapper[8993]: I1204 11:58:50.820890 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/727fd5bf-d896-41b6-9b4f-0c811ccca13a-utilities\") pod \"redhat-operators-v4tlj\" (UID: \"727fd5bf-d896-41b6-9b4f-0c811ccca13a\") " pod="openshift-marketplace/redhat-operators-v4tlj" Dec 04 11:58:50.820985 master-0 kubenswrapper[8993]: I1204 11:58:50.820922 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fcf0787c-2d77-4bbe-ad3c-70e03169c96f-catalog-content\") pod \"community-operators-fvf4r\" (UID: \"fcf0787c-2d77-4bbe-ad3c-70e03169c96f\") " pod="openshift-marketplace/community-operators-fvf4r" Dec 04 11:58:50.820985 master-0 kubenswrapper[8993]: I1204 11:58:50.820942 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nqvgz\" (UniqueName: \"kubernetes.io/projected/727fd5bf-d896-41b6-9b4f-0c811ccca13a-kube-api-access-nqvgz\") pod \"redhat-operators-v4tlj\" (UID: \"727fd5bf-d896-41b6-9b4f-0c811ccca13a\") " pod="openshift-marketplace/redhat-operators-v4tlj" Dec 04 11:58:50.821575 master-0 kubenswrapper[8993]: I1204 11:58:50.821429 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2ee42f3c-353c-459c-aa6e-8f85eadbfb84-catalog-content\") pod \"certified-operators-dr5sc\" (UID: \"2ee42f3c-353c-459c-aa6e-8f85eadbfb84\") " pod="openshift-marketplace/certified-operators-dr5sc" Dec 04 11:58:50.821815 master-0 kubenswrapper[8993]: I1204 11:58:50.821748 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/727fd5bf-d896-41b6-9b4f-0c811ccca13a-utilities\") pod \"redhat-operators-v4tlj\" (UID: \"727fd5bf-d896-41b6-9b4f-0c811ccca13a\") " pod="openshift-marketplace/redhat-operators-v4tlj" Dec 04 11:58:50.840654 master-0 kubenswrapper[8993]: I1204 11:58:50.840564 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqvgz\" (UniqueName: \"kubernetes.io/projected/727fd5bf-d896-41b6-9b4f-0c811ccca13a-kube-api-access-nqvgz\") pod \"redhat-operators-v4tlj\" (UID: \"727fd5bf-d896-41b6-9b4f-0c811ccca13a\") " pod="openshift-marketplace/redhat-operators-v4tlj" Dec 04 11:58:50.841259 master-0 kubenswrapper[8993]: I1204 11:58:50.841194 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb77r\" (UniqueName: \"kubernetes.io/projected/fcf0787c-2d77-4bbe-ad3c-70e03169c96f-kube-api-access-mb77r\") pod \"community-operators-fvf4r\" (UID: \"fcf0787c-2d77-4bbe-ad3c-70e03169c96f\") " pod="openshift-marketplace/community-operators-fvf4r" Dec 04 11:58:50.845254 master-0 kubenswrapper[8993]: I1204 11:58:50.845198 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7sgq\" (UniqueName: \"kubernetes.io/projected/2ee42f3c-353c-459c-aa6e-8f85eadbfb84-kube-api-access-b7sgq\") pod \"certified-operators-dr5sc\" (UID: \"2ee42f3c-353c-459c-aa6e-8f85eadbfb84\") " pod="openshift-marketplace/certified-operators-dr5sc" Dec 04 11:58:50.845617 master-0 kubenswrapper[8993]: I1204 11:58:50.845495 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4qj8\" (UniqueName: \"kubernetes.io/projected/677a41b8-0c6a-4c96-ac98-65bc54985bb7-kube-api-access-g4qj8\") pod \"redhat-marketplace-xsdsw\" (UID: \"677a41b8-0c6a-4c96-ac98-65bc54985bb7\") " pod="openshift-marketplace/redhat-marketplace-xsdsw" Dec 04 11:58:50.955794 master-0 kubenswrapper[8993]: I1204 11:58:50.955634 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-v4tlj" Dec 04 11:58:50.980641 master-0 kubenswrapper[8993]: I1204 11:58:50.980566 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-dr5sc" Dec 04 11:58:51.003198 master-0 kubenswrapper[8993]: I1204 11:58:51.003083 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-xsdsw" Dec 04 11:58:51.024963 master-0 kubenswrapper[8993]: I1204 11:58:51.024901 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-fvf4r" Dec 04 11:58:52.077002 master-0 kubenswrapper[8993]: I1204 11:58:52.076943 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-v4tlj"] Dec 04 11:58:52.089632 master-0 kubenswrapper[8993]: W1204 11:58:52.089558 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod727fd5bf_d896_41b6_9b4f_0c811ccca13a.slice/crio-316c5e4ee364a2a13dc43f614dbb4819fb55d19d157fabc9948456d96702381e WatchSource:0}: Error finding container 316c5e4ee364a2a13dc43f614dbb4819fb55d19d157fabc9948456d96702381e: Status 404 returned error can't find the container with id 316c5e4ee364a2a13dc43f614dbb4819fb55d19d157fabc9948456d96702381e Dec 04 11:58:52.323239 master-0 kubenswrapper[8993]: I1204 11:58:52.323156 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-fvf4r"] Dec 04 11:58:52.330844 master-0 kubenswrapper[8993]: W1204 11:58:52.330770 8993 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ee42f3c_353c_459c_aa6e_8f85eadbfb84.slice/crio-c8ecd2cfee02b8b0f20361982f32303ea3b58c79b0022fe1274942794128ec50 WatchSource:0}: Error finding container c8ecd2cfee02b8b0f20361982f32303ea3b58c79b0022fe1274942794128ec50: Status 404 returned error can't find the container with id c8ecd2cfee02b8b0f20361982f32303ea3b58c79b0022fe1274942794128ec50 Dec 04 11:58:52.330844 master-0 kubenswrapper[8993]: I1204 11:58:52.330792 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-xsdsw"] Dec 04 11:58:52.337364 master-0 kubenswrapper[8993]: I1204 11:58:52.337307 8993 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-dr5sc"] Dec 04 11:58:52.434761 master-0 kubenswrapper[8993]: I1204 11:58:52.434687 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v4tlj" event={"ID":"727fd5bf-d896-41b6-9b4f-0c811ccca13a","Type":"ContainerStarted","Data":"098bc8c841048a18d1e4b2af60b621df0d30ed746bf64b41dce3f3e9557403b1"} Dec 04 11:58:52.434761 master-0 kubenswrapper[8993]: I1204 11:58:52.434744 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v4tlj" event={"ID":"727fd5bf-d896-41b6-9b4f-0c811ccca13a","Type":"ContainerStarted","Data":"316c5e4ee364a2a13dc43f614dbb4819fb55d19d157fabc9948456d96702381e"} Dec 04 11:58:52.435728 master-0 kubenswrapper[8993]: I1204 11:58:52.435687 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-dr5sc" event={"ID":"2ee42f3c-353c-459c-aa6e-8f85eadbfb84","Type":"ContainerStarted","Data":"c8ecd2cfee02b8b0f20361982f32303ea3b58c79b0022fe1274942794128ec50"} Dec 04 11:58:52.436531 master-0 kubenswrapper[8993]: I1204 11:58:52.436495 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-fvf4r" event={"ID":"fcf0787c-2d77-4bbe-ad3c-70e03169c96f","Type":"ContainerStarted","Data":"0d4beb2f0b38b3d4aa0fa8f563ff00704337802d5948c53adb4467f6318ead67"} Dec 04 11:58:52.437276 master-0 kubenswrapper[8993]: I1204 11:58:52.437252 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-xsdsw" event={"ID":"677a41b8-0c6a-4c96-ac98-65bc54985bb7","Type":"ContainerStarted","Data":"00813d6015185c762c89a6e20123d5d07121f53829d1dd63e0143457b80b8cb5"} Dec 04 11:58:53.445692 master-0 kubenswrapper[8993]: I1204 11:58:53.445552 8993 generic.go:334] "Generic (PLEG): container finished" podID="727fd5bf-d896-41b6-9b4f-0c811ccca13a" containerID="098bc8c841048a18d1e4b2af60b621df0d30ed746bf64b41dce3f3e9557403b1" exitCode=0 Dec 04 11:58:53.446508 master-0 kubenswrapper[8993]: I1204 11:58:53.446140 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v4tlj" event={"ID":"727fd5bf-d896-41b6-9b4f-0c811ccca13a","Type":"ContainerDied","Data":"098bc8c841048a18d1e4b2af60b621df0d30ed746bf64b41dce3f3e9557403b1"} Dec 04 11:58:53.447886 master-0 kubenswrapper[8993]: I1204 11:58:53.447618 8993 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Dec 04 11:58:53.449397 master-0 kubenswrapper[8993]: I1204 11:58:53.449331 8993 generic.go:334] "Generic (PLEG): container finished" podID="2ee42f3c-353c-459c-aa6e-8f85eadbfb84" containerID="0fe42e9c7f6ba7c1efc48eedb982958ff827ba9f4d69c10198448b77c9f8fbae" exitCode=0 Dec 04 11:58:53.449536 master-0 kubenswrapper[8993]: I1204 11:58:53.449427 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-dr5sc" event={"ID":"2ee42f3c-353c-459c-aa6e-8f85eadbfb84","Type":"ContainerDied","Data":"0fe42e9c7f6ba7c1efc48eedb982958ff827ba9f4d69c10198448b77c9f8fbae"} Dec 04 11:58:53.453184 master-0 kubenswrapper[8993]: I1204 11:58:53.452519 8993 generic.go:334] "Generic (PLEG): container finished" podID="fcf0787c-2d77-4bbe-ad3c-70e03169c96f" containerID="fe89545fefcc372bb180649c66c4600486eb9afe6cd9af0e69e7127c2b238b22" exitCode=0 Dec 04 11:58:53.453433 master-0 kubenswrapper[8993]: I1204 11:58:53.453333 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-fvf4r" event={"ID":"fcf0787c-2d77-4bbe-ad3c-70e03169c96f","Type":"ContainerDied","Data":"fe89545fefcc372bb180649c66c4600486eb9afe6cd9af0e69e7127c2b238b22"} Dec 04 11:58:53.455932 master-0 kubenswrapper[8993]: I1204 11:58:53.455894 8993 generic.go:334] "Generic (PLEG): container finished" podID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerID="1088ace64761e3c007911c989818e39a17d1b9944859d157200f13ef28d4942e" exitCode=0 Dec 04 11:58:53.455984 master-0 kubenswrapper[8993]: I1204 11:58:53.455936 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-xsdsw" event={"ID":"677a41b8-0c6a-4c96-ac98-65bc54985bb7","Type":"ContainerDied","Data":"1088ace64761e3c007911c989818e39a17d1b9944859d157200f13ef28d4942e"} Dec 04 11:58:55.477202 master-0 kubenswrapper[8993]: I1204 11:58:55.476866 8993 generic.go:334] "Generic (PLEG): container finished" podID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerID="33431b10151447abe91f891b95bb44699da99e3035e0d5ffbd8c1b04917becde" exitCode=0 Dec 04 11:58:55.477202 master-0 kubenswrapper[8993]: I1204 11:58:55.476961 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-xsdsw" event={"ID":"677a41b8-0c6a-4c96-ac98-65bc54985bb7","Type":"ContainerDied","Data":"33431b10151447abe91f891b95bb44699da99e3035e0d5ffbd8c1b04917becde"} Dec 04 11:58:55.482535 master-0 kubenswrapper[8993]: I1204 11:58:55.482451 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v4tlj" event={"ID":"727fd5bf-d896-41b6-9b4f-0c811ccca13a","Type":"ContainerStarted","Data":"c1b51641ace925348e5c891149252de656ab100166398a3be772a67ef5e1a748"} Dec 04 11:58:55.486232 master-0 kubenswrapper[8993]: I1204 11:58:55.485908 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-dr5sc" event={"ID":"2ee42f3c-353c-459c-aa6e-8f85eadbfb84","Type":"ContainerStarted","Data":"a58c2de1ed2c4ed848e045ab1ff320baaeb55d32facd1e0ed3fa909c7d06b7fa"} Dec 04 11:58:55.501025 master-0 kubenswrapper[8993]: I1204 11:58:55.500924 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-fvf4r" event={"ID":"fcf0787c-2d77-4bbe-ad3c-70e03169c96f","Type":"ContainerStarted","Data":"ef42190301295969ac96852314b794aa38c9dc8d108bd32140faecfb943392c3"} Dec 04 11:58:55.800701 master-0 kubenswrapper[8993]: I1204 11:58:55.800567 8993 scope.go:117] "RemoveContainer" containerID="6b81ee1ae28f16389ded7b634a062f62bd333e247fbc631f5edd514e5d0827da" Dec 04 11:58:55.803740 master-0 kubenswrapper[8993]: E1204 11:58:55.803689 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=ingress-operator pod=ingress-operator-8649c48786-cx2b2_openshift-ingress-operator(b011b1f1-3235-4e20-825b-ce711c052407)\"" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" podUID="b011b1f1-3235-4e20-825b-ce711c052407" Dec 04 11:58:56.517088 master-0 kubenswrapper[8993]: I1204 11:58:56.517009 8993 generic.go:334] "Generic (PLEG): container finished" podID="fcf0787c-2d77-4bbe-ad3c-70e03169c96f" containerID="ef42190301295969ac96852314b794aa38c9dc8d108bd32140faecfb943392c3" exitCode=0 Dec 04 11:58:56.517088 master-0 kubenswrapper[8993]: I1204 11:58:56.517081 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-fvf4r" event={"ID":"fcf0787c-2d77-4bbe-ad3c-70e03169c96f","Type":"ContainerDied","Data":"ef42190301295969ac96852314b794aa38c9dc8d108bd32140faecfb943392c3"} Dec 04 11:58:56.525618 master-0 kubenswrapper[8993]: I1204 11:58:56.525542 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-xsdsw" event={"ID":"677a41b8-0c6a-4c96-ac98-65bc54985bb7","Type":"ContainerStarted","Data":"093d2c6afc84903316f06d61c2011b5876f2371e9251cd94a18d8c28080caa20"} Dec 04 11:58:56.530064 master-0 kubenswrapper[8993]: I1204 11:58:56.529839 8993 generic.go:334] "Generic (PLEG): container finished" podID="2ee42f3c-353c-459c-aa6e-8f85eadbfb84" containerID="a58c2de1ed2c4ed848e045ab1ff320baaeb55d32facd1e0ed3fa909c7d06b7fa" exitCode=0 Dec 04 11:58:56.531294 master-0 kubenswrapper[8993]: I1204 11:58:56.531198 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-dr5sc" event={"ID":"2ee42f3c-353c-459c-aa6e-8f85eadbfb84","Type":"ContainerDied","Data":"a58c2de1ed2c4ed848e045ab1ff320baaeb55d32facd1e0ed3fa909c7d06b7fa"} Dec 04 11:58:57.541435 master-0 kubenswrapper[8993]: I1204 11:58:57.541348 8993 generic.go:334] "Generic (PLEG): container finished" podID="727fd5bf-d896-41b6-9b4f-0c811ccca13a" containerID="c1b51641ace925348e5c891149252de656ab100166398a3be772a67ef5e1a748" exitCode=0 Dec 04 11:58:57.557211 master-0 kubenswrapper[8993]: I1204 11:58:57.541430 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v4tlj" event={"ID":"727fd5bf-d896-41b6-9b4f-0c811ccca13a","Type":"ContainerDied","Data":"c1b51641ace925348e5c891149252de656ab100166398a3be772a67ef5e1a748"} Dec 04 11:58:57.557211 master-0 kubenswrapper[8993]: I1204 11:58:57.544293 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-fvf4r" event={"ID":"fcf0787c-2d77-4bbe-ad3c-70e03169c96f","Type":"ContainerStarted","Data":"7fe131a850eec1f47b386d547621b97eb4f33f5907413e4c8d6e48072308e69c"} Dec 04 11:58:57.569555 master-0 kubenswrapper[8993]: I1204 11:58:57.569473 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-xsdsw" podStartSLOduration=164.155182423 podStartE2EDuration="2m46.56944865s" podCreationTimestamp="2025-12-04 11:56:11 +0000 UTC" firstStartedPulling="2025-12-04 11:58:53.457270277 +0000 UTC m=+1267.848211710" lastFinishedPulling="2025-12-04 11:58:55.871536504 +0000 UTC m=+1270.262477937" observedRunningTime="2025-12-04 11:58:56.593594045 +0000 UTC m=+1270.984535488" watchObservedRunningTime="2025-12-04 11:58:57.56944865 +0000 UTC m=+1271.960390083" Dec 04 11:58:57.583656 master-0 kubenswrapper[8993]: I1204 11:58:57.583583 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-fvf4r" podStartSLOduration=176.668520837 podStartE2EDuration="3m0.583547775s" podCreationTimestamp="2025-12-04 11:55:57 +0000 UTC" firstStartedPulling="2025-12-04 11:58:53.454129427 +0000 UTC m=+1267.845070860" lastFinishedPulling="2025-12-04 11:58:57.369156365 +0000 UTC m=+1271.760097798" observedRunningTime="2025-12-04 11:58:57.583143803 +0000 UTC m=+1271.974085246" watchObservedRunningTime="2025-12-04 11:58:57.583547775 +0000 UTC m=+1271.974489208" Dec 04 11:58:58.554568 master-0 kubenswrapper[8993]: I1204 11:58:58.554506 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-dr5sc" event={"ID":"2ee42f3c-353c-459c-aa6e-8f85eadbfb84","Type":"ContainerStarted","Data":"d2be921f51b9c78590406d65a1332aa47eede0ac449797bb0b94c4f5aacecac4"} Dec 04 11:58:58.557739 master-0 kubenswrapper[8993]: I1204 11:58:58.557667 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v4tlj" event={"ID":"727fd5bf-d896-41b6-9b4f-0c811ccca13a","Type":"ContainerStarted","Data":"a10fba784ba4f6fe76e9cb9557079b3070aad6c04b2971fd697515ca839ca19c"} Dec 04 11:58:58.583314 master-0 kubenswrapper[8993]: I1204 11:58:58.583231 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-dr5sc" podStartSLOduration=163.559927746 podStartE2EDuration="2m47.583210112s" podCreationTimestamp="2025-12-04 11:56:11 +0000 UTC" firstStartedPulling="2025-12-04 11:58:53.451147273 +0000 UTC m=+1267.842088706" lastFinishedPulling="2025-12-04 11:58:57.474429639 +0000 UTC m=+1271.865371072" observedRunningTime="2025-12-04 11:58:58.582432488 +0000 UTC m=+1272.973373931" watchObservedRunningTime="2025-12-04 11:58:58.583210112 +0000 UTC m=+1272.974151545" Dec 04 11:58:58.607726 master-0 kubenswrapper[8993]: I1204 11:58:58.607620 8993 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-v4tlj" podStartSLOduration=177.070679218 podStartE2EDuration="3m1.607599493s" podCreationTimestamp="2025-12-04 11:55:57 +0000 UTC" firstStartedPulling="2025-12-04 11:58:53.447569111 +0000 UTC m=+1267.838510544" lastFinishedPulling="2025-12-04 11:58:57.984489386 +0000 UTC m=+1272.375430819" observedRunningTime="2025-12-04 11:58:58.603960088 +0000 UTC m=+1272.994901521" watchObservedRunningTime="2025-12-04 11:58:58.607599493 +0000 UTC m=+1272.998540926" Dec 04 11:59:00.794822 master-0 kubenswrapper[8993]: I1204 11:59:00.794764 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:59:00.795315 master-0 kubenswrapper[8993]: E1204 11:59:00.795052 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:59:00.956233 master-0 kubenswrapper[8993]: I1204 11:59:00.956115 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-v4tlj" Dec 04 11:59:00.956233 master-0 kubenswrapper[8993]: I1204 11:59:00.956214 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-v4tlj" Dec 04 11:59:00.982507 master-0 kubenswrapper[8993]: I1204 11:59:00.982434 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-dr5sc" Dec 04 11:59:00.982507 master-0 kubenswrapper[8993]: I1204 11:59:00.982500 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-dr5sc" Dec 04 11:59:01.004946 master-0 kubenswrapper[8993]: I1204 11:59:01.004749 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-xsdsw" Dec 04 11:59:01.004946 master-0 kubenswrapper[8993]: I1204 11:59:01.004862 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-xsdsw" Dec 04 11:59:01.028644 master-0 kubenswrapper[8993]: I1204 11:59:01.028541 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-fvf4r" Dec 04 11:59:01.028644 master-0 kubenswrapper[8993]: I1204 11:59:01.028630 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-fvf4r" Dec 04 11:59:01.037542 master-0 kubenswrapper[8993]: I1204 11:59:01.037441 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-dr5sc" Dec 04 11:59:01.057299 master-0 kubenswrapper[8993]: I1204 11:59:01.054265 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-xsdsw" Dec 04 11:59:01.074876 master-0 kubenswrapper[8993]: I1204 11:59:01.074796 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-fvf4r" Dec 04 11:59:01.618498 master-0 kubenswrapper[8993]: I1204 11:59:01.618431 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-xsdsw" Dec 04 11:59:01.996385 master-0 kubenswrapper[8993]: I1204 11:59:01.996253 8993 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-v4tlj" podUID="727fd5bf-d896-41b6-9b4f-0c811ccca13a" containerName="registry-server" probeResult="failure" output=< Dec 04 11:59:01.996385 master-0 kubenswrapper[8993]: timeout: failed to connect service ":50051" within 1s Dec 04 11:59:01.996385 master-0 kubenswrapper[8993]: > Dec 04 11:59:05.225548 master-0 kubenswrapper[8993]: I1204 11:59:05.225463 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-xsdsw"] Dec 04 11:59:05.226162 master-0 kubenswrapper[8993]: I1204 11:59:05.225735 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-xsdsw" podUID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerName="registry-server" containerID="cri-o://093d2c6afc84903316f06d61c2011b5876f2371e9251cd94a18d8c28080caa20" gracePeriod=2 Dec 04 11:59:05.608192 master-0 kubenswrapper[8993]: I1204 11:59:05.608109 8993 generic.go:334] "Generic (PLEG): container finished" podID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerID="093d2c6afc84903316f06d61c2011b5876f2371e9251cd94a18d8c28080caa20" exitCode=0 Dec 04 11:59:05.608192 master-0 kubenswrapper[8993]: I1204 11:59:05.608188 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-xsdsw" event={"ID":"677a41b8-0c6a-4c96-ac98-65bc54985bb7","Type":"ContainerDied","Data":"093d2c6afc84903316f06d61c2011b5876f2371e9251cd94a18d8c28080caa20"} Dec 04 11:59:05.608466 master-0 kubenswrapper[8993]: I1204 11:59:05.608226 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-xsdsw" event={"ID":"677a41b8-0c6a-4c96-ac98-65bc54985bb7","Type":"ContainerDied","Data":"00813d6015185c762c89a6e20123d5d07121f53829d1dd63e0143457b80b8cb5"} Dec 04 11:59:05.608466 master-0 kubenswrapper[8993]: I1204 11:59:05.608242 8993 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00813d6015185c762c89a6e20123d5d07121f53829d1dd63e0143457b80b8cb5" Dec 04 11:59:05.639493 master-0 kubenswrapper[8993]: I1204 11:59:05.639406 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-xsdsw" Dec 04 11:59:05.745446 master-0 kubenswrapper[8993]: I1204 11:59:05.745034 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/677a41b8-0c6a-4c96-ac98-65bc54985bb7-catalog-content\") pod \"677a41b8-0c6a-4c96-ac98-65bc54985bb7\" (UID: \"677a41b8-0c6a-4c96-ac98-65bc54985bb7\") " Dec 04 11:59:05.745446 master-0 kubenswrapper[8993]: I1204 11:59:05.745306 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4qj8\" (UniqueName: \"kubernetes.io/projected/677a41b8-0c6a-4c96-ac98-65bc54985bb7-kube-api-access-g4qj8\") pod \"677a41b8-0c6a-4c96-ac98-65bc54985bb7\" (UID: \"677a41b8-0c6a-4c96-ac98-65bc54985bb7\") " Dec 04 11:59:05.745446 master-0 kubenswrapper[8993]: I1204 11:59:05.745352 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/677a41b8-0c6a-4c96-ac98-65bc54985bb7-utilities\") pod \"677a41b8-0c6a-4c96-ac98-65bc54985bb7\" (UID: \"677a41b8-0c6a-4c96-ac98-65bc54985bb7\") " Dec 04 11:59:05.746768 master-0 kubenswrapper[8993]: I1204 11:59:05.746635 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/677a41b8-0c6a-4c96-ac98-65bc54985bb7-utilities" (OuterVolumeSpecName: "utilities") pod "677a41b8-0c6a-4c96-ac98-65bc54985bb7" (UID: "677a41b8-0c6a-4c96-ac98-65bc54985bb7"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 11:59:05.748603 master-0 kubenswrapper[8993]: I1204 11:59:05.748362 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/677a41b8-0c6a-4c96-ac98-65bc54985bb7-kube-api-access-g4qj8" (OuterVolumeSpecName: "kube-api-access-g4qj8") pod "677a41b8-0c6a-4c96-ac98-65bc54985bb7" (UID: "677a41b8-0c6a-4c96-ac98-65bc54985bb7"). InnerVolumeSpecName "kube-api-access-g4qj8". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:59:05.850557 master-0 kubenswrapper[8993]: I1204 11:59:05.850399 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-g4qj8\" (UniqueName: \"kubernetes.io/projected/677a41b8-0c6a-4c96-ac98-65bc54985bb7-kube-api-access-g4qj8\") on node \"master-0\" DevicePath \"\"" Dec 04 11:59:05.850557 master-0 kubenswrapper[8993]: I1204 11:59:05.850450 8993 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/677a41b8-0c6a-4c96-ac98-65bc54985bb7-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 11:59:06.613697 master-0 kubenswrapper[8993]: I1204 11:59:06.613639 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-xsdsw" Dec 04 11:59:06.963630 master-0 kubenswrapper[8993]: I1204 11:59:06.963529 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/677a41b8-0c6a-4c96-ac98-65bc54985bb7-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "677a41b8-0c6a-4c96-ac98-65bc54985bb7" (UID: "677a41b8-0c6a-4c96-ac98-65bc54985bb7"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 11:59:06.969377 master-0 kubenswrapper[8993]: I1204 11:59:06.969300 8993 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/677a41b8-0c6a-4c96-ac98-65bc54985bb7-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 11:59:09.794964 master-0 kubenswrapper[8993]: I1204 11:59:09.794906 8993 scope.go:117] "RemoveContainer" containerID="6b81ee1ae28f16389ded7b634a062f62bd333e247fbc631f5edd514e5d0827da" Dec 04 11:59:09.795537 master-0 kubenswrapper[8993]: E1204 11:59:09.795152 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ingress-operator\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=ingress-operator pod=ingress-operator-8649c48786-cx2b2_openshift-ingress-operator(b011b1f1-3235-4e20-825b-ce711c052407)\"" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" podUID="b011b1f1-3235-4e20-825b-ce711c052407" Dec 04 11:59:10.098241 master-0 kubenswrapper[8993]: I1204 11:59:10.098179 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-xsdsw"] Dec 04 11:59:10.105651 master-0 kubenswrapper[8993]: I1204 11:59:10.105566 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-xsdsw"] Dec 04 11:59:11.004297 master-0 kubenswrapper[8993]: I1204 11:59:11.004234 8993 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-v4tlj" Dec 04 11:59:11.035881 master-0 kubenswrapper[8993]: I1204 11:59:11.035821 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-dr5sc" Dec 04 11:59:11.052901 master-0 kubenswrapper[8993]: I1204 11:59:11.052851 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-v4tlj" Dec 04 11:59:11.069943 master-0 kubenswrapper[8993]: I1204 11:59:11.069902 8993 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-fvf4r" Dec 04 11:59:11.794279 master-0 kubenswrapper[8993]: I1204 11:59:11.794196 8993 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:59:11.794554 master-0 kubenswrapper[8993]: E1204 11:59:11.794442 8993 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 11:59:11.800674 master-0 kubenswrapper[8993]: I1204 11:59:11.800621 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" path="/var/lib/kubelet/pods/677a41b8-0c6a-4c96-ac98-65bc54985bb7/volumes" Dec 04 11:59:12.102178 master-0 kubenswrapper[8993]: I1204 11:59:12.102077 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-v4tlj"] Dec 04 11:59:12.652826 master-0 kubenswrapper[8993]: I1204 11:59:12.652728 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-v4tlj" podUID="727fd5bf-d896-41b6-9b4f-0c811ccca13a" containerName="registry-server" containerID="cri-o://a10fba784ba4f6fe76e9cb9557079b3070aad6c04b2971fd697515ca839ca19c" gracePeriod=2 Dec 04 11:59:13.057696 master-0 kubenswrapper[8993]: I1204 11:59:13.057616 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-v4tlj" Dec 04 11:59:13.158329 master-0 kubenswrapper[8993]: I1204 11:59:13.158258 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/727fd5bf-d896-41b6-9b4f-0c811ccca13a-catalog-content\") pod \"727fd5bf-d896-41b6-9b4f-0c811ccca13a\" (UID: \"727fd5bf-d896-41b6-9b4f-0c811ccca13a\") " Dec 04 11:59:13.158928 master-0 kubenswrapper[8993]: I1204 11:59:13.158376 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/727fd5bf-d896-41b6-9b4f-0c811ccca13a-utilities\") pod \"727fd5bf-d896-41b6-9b4f-0c811ccca13a\" (UID: \"727fd5bf-d896-41b6-9b4f-0c811ccca13a\") " Dec 04 11:59:13.158928 master-0 kubenswrapper[8993]: I1204 11:59:13.158563 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqvgz\" (UniqueName: \"kubernetes.io/projected/727fd5bf-d896-41b6-9b4f-0c811ccca13a-kube-api-access-nqvgz\") pod \"727fd5bf-d896-41b6-9b4f-0c811ccca13a\" (UID: \"727fd5bf-d896-41b6-9b4f-0c811ccca13a\") " Dec 04 11:59:13.159312 master-0 kubenswrapper[8993]: I1204 11:59:13.159233 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/727fd5bf-d896-41b6-9b4f-0c811ccca13a-utilities" (OuterVolumeSpecName: "utilities") pod "727fd5bf-d896-41b6-9b4f-0c811ccca13a" (UID: "727fd5bf-d896-41b6-9b4f-0c811ccca13a"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 11:59:13.161116 master-0 kubenswrapper[8993]: I1204 11:59:13.161082 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/727fd5bf-d896-41b6-9b4f-0c811ccca13a-kube-api-access-nqvgz" (OuterVolumeSpecName: "kube-api-access-nqvgz") pod "727fd5bf-d896-41b6-9b4f-0c811ccca13a" (UID: "727fd5bf-d896-41b6-9b4f-0c811ccca13a"). InnerVolumeSpecName "kube-api-access-nqvgz". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:59:13.260829 master-0 kubenswrapper[8993]: I1204 11:59:13.260725 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nqvgz\" (UniqueName: \"kubernetes.io/projected/727fd5bf-d896-41b6-9b4f-0c811ccca13a-kube-api-access-nqvgz\") on node \"master-0\" DevicePath \"\"" Dec 04 11:59:13.260829 master-0 kubenswrapper[8993]: I1204 11:59:13.260791 8993 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/727fd5bf-d896-41b6-9b4f-0c811ccca13a-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 11:59:13.262320 master-0 kubenswrapper[8993]: I1204 11:59:13.262266 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/727fd5bf-d896-41b6-9b4f-0c811ccca13a-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "727fd5bf-d896-41b6-9b4f-0c811ccca13a" (UID: "727fd5bf-d896-41b6-9b4f-0c811ccca13a"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 11:59:13.362321 master-0 kubenswrapper[8993]: I1204 11:59:13.362170 8993 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/727fd5bf-d896-41b6-9b4f-0c811ccca13a-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 11:59:13.532029 master-0 kubenswrapper[8993]: I1204 11:59:13.531937 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-dr5sc"] Dec 04 11:59:13.532289 master-0 kubenswrapper[8993]: I1204 11:59:13.532217 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-dr5sc" podUID="2ee42f3c-353c-459c-aa6e-8f85eadbfb84" containerName="registry-server" containerID="cri-o://d2be921f51b9c78590406d65a1332aa47eede0ac449797bb0b94c4f5aacecac4" gracePeriod=2 Dec 04 11:59:13.665645 master-0 kubenswrapper[8993]: I1204 11:59:13.665558 8993 generic.go:334] "Generic (PLEG): container finished" podID="727fd5bf-d896-41b6-9b4f-0c811ccca13a" containerID="a10fba784ba4f6fe76e9cb9557079b3070aad6c04b2971fd697515ca839ca19c" exitCode=0 Dec 04 11:59:13.666005 master-0 kubenswrapper[8993]: I1204 11:59:13.665703 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-v4tlj" Dec 04 11:59:13.666005 master-0 kubenswrapper[8993]: I1204 11:59:13.665698 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v4tlj" event={"ID":"727fd5bf-d896-41b6-9b4f-0c811ccca13a","Type":"ContainerDied","Data":"a10fba784ba4f6fe76e9cb9557079b3070aad6c04b2971fd697515ca839ca19c"} Dec 04 11:59:13.666005 master-0 kubenswrapper[8993]: I1204 11:59:13.665894 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v4tlj" event={"ID":"727fd5bf-d896-41b6-9b4f-0c811ccca13a","Type":"ContainerDied","Data":"316c5e4ee364a2a13dc43f614dbb4819fb55d19d157fabc9948456d96702381e"} Dec 04 11:59:13.666005 master-0 kubenswrapper[8993]: I1204 11:59:13.665927 8993 scope.go:117] "RemoveContainer" containerID="a10fba784ba4f6fe76e9cb9557079b3070aad6c04b2971fd697515ca839ca19c" Dec 04 11:59:13.670592 master-0 kubenswrapper[8993]: I1204 11:59:13.670081 8993 generic.go:334] "Generic (PLEG): container finished" podID="2ee42f3c-353c-459c-aa6e-8f85eadbfb84" containerID="d2be921f51b9c78590406d65a1332aa47eede0ac449797bb0b94c4f5aacecac4" exitCode=0 Dec 04 11:59:13.670592 master-0 kubenswrapper[8993]: I1204 11:59:13.670146 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-dr5sc" event={"ID":"2ee42f3c-353c-459c-aa6e-8f85eadbfb84","Type":"ContainerDied","Data":"d2be921f51b9c78590406d65a1332aa47eede0ac449797bb0b94c4f5aacecac4"} Dec 04 11:59:13.710365 master-0 kubenswrapper[8993]: I1204 11:59:13.710299 8993 scope.go:117] "RemoveContainer" containerID="c1b51641ace925348e5c891149252de656ab100166398a3be772a67ef5e1a748" Dec 04 11:59:13.740388 master-0 kubenswrapper[8993]: I1204 11:59:13.740226 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-v4tlj"] Dec 04 11:59:13.747514 master-0 kubenswrapper[8993]: I1204 11:59:13.747466 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-v4tlj"] Dec 04 11:59:13.759551 master-0 kubenswrapper[8993]: I1204 11:59:13.759508 8993 scope.go:117] "RemoveContainer" containerID="098bc8c841048a18d1e4b2af60b621df0d30ed746bf64b41dce3f3e9557403b1" Dec 04 11:59:13.793310 master-0 kubenswrapper[8993]: I1204 11:59:13.793252 8993 scope.go:117] "RemoveContainer" containerID="a10fba784ba4f6fe76e9cb9557079b3070aad6c04b2971fd697515ca839ca19c" Dec 04 11:59:13.795279 master-0 kubenswrapper[8993]: E1204 11:59:13.795226 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a10fba784ba4f6fe76e9cb9557079b3070aad6c04b2971fd697515ca839ca19c\": container with ID starting with a10fba784ba4f6fe76e9cb9557079b3070aad6c04b2971fd697515ca839ca19c not found: ID does not exist" containerID="a10fba784ba4f6fe76e9cb9557079b3070aad6c04b2971fd697515ca839ca19c" Dec 04 11:59:13.795354 master-0 kubenswrapper[8993]: I1204 11:59:13.795283 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a10fba784ba4f6fe76e9cb9557079b3070aad6c04b2971fd697515ca839ca19c"} err="failed to get container status \"a10fba784ba4f6fe76e9cb9557079b3070aad6c04b2971fd697515ca839ca19c\": rpc error: code = NotFound desc = could not find container \"a10fba784ba4f6fe76e9cb9557079b3070aad6c04b2971fd697515ca839ca19c\": container with ID starting with a10fba784ba4f6fe76e9cb9557079b3070aad6c04b2971fd697515ca839ca19c not found: ID does not exist" Dec 04 11:59:13.795354 master-0 kubenswrapper[8993]: I1204 11:59:13.795315 8993 scope.go:117] "RemoveContainer" containerID="c1b51641ace925348e5c891149252de656ab100166398a3be772a67ef5e1a748" Dec 04 11:59:13.796873 master-0 kubenswrapper[8993]: E1204 11:59:13.796704 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1b51641ace925348e5c891149252de656ab100166398a3be772a67ef5e1a748\": container with ID starting with c1b51641ace925348e5c891149252de656ab100166398a3be772a67ef5e1a748 not found: ID does not exist" containerID="c1b51641ace925348e5c891149252de656ab100166398a3be772a67ef5e1a748" Dec 04 11:59:13.796873 master-0 kubenswrapper[8993]: I1204 11:59:13.796780 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1b51641ace925348e5c891149252de656ab100166398a3be772a67ef5e1a748"} err="failed to get container status \"c1b51641ace925348e5c891149252de656ab100166398a3be772a67ef5e1a748\": rpc error: code = NotFound desc = could not find container \"c1b51641ace925348e5c891149252de656ab100166398a3be772a67ef5e1a748\": container with ID starting with c1b51641ace925348e5c891149252de656ab100166398a3be772a67ef5e1a748 not found: ID does not exist" Dec 04 11:59:13.796873 master-0 kubenswrapper[8993]: I1204 11:59:13.796844 8993 scope.go:117] "RemoveContainer" containerID="098bc8c841048a18d1e4b2af60b621df0d30ed746bf64b41dce3f3e9557403b1" Dec 04 11:59:13.797395 master-0 kubenswrapper[8993]: E1204 11:59:13.797351 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"098bc8c841048a18d1e4b2af60b621df0d30ed746bf64b41dce3f3e9557403b1\": container with ID starting with 098bc8c841048a18d1e4b2af60b621df0d30ed746bf64b41dce3f3e9557403b1 not found: ID does not exist" containerID="098bc8c841048a18d1e4b2af60b621df0d30ed746bf64b41dce3f3e9557403b1" Dec 04 11:59:13.797444 master-0 kubenswrapper[8993]: I1204 11:59:13.797409 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"098bc8c841048a18d1e4b2af60b621df0d30ed746bf64b41dce3f3e9557403b1"} err="failed to get container status \"098bc8c841048a18d1e4b2af60b621df0d30ed746bf64b41dce3f3e9557403b1\": rpc error: code = NotFound desc = could not find container \"098bc8c841048a18d1e4b2af60b621df0d30ed746bf64b41dce3f3e9557403b1\": container with ID starting with 098bc8c841048a18d1e4b2af60b621df0d30ed746bf64b41dce3f3e9557403b1 not found: ID does not exist" Dec 04 11:59:13.800442 master-0 kubenswrapper[8993]: I1204 11:59:13.800414 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="727fd5bf-d896-41b6-9b4f-0c811ccca13a" path="/var/lib/kubelet/pods/727fd5bf-d896-41b6-9b4f-0c811ccca13a/volumes" Dec 04 11:59:13.977318 master-0 kubenswrapper[8993]: I1204 11:59:13.977269 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-dr5sc" Dec 04 11:59:14.072947 master-0 kubenswrapper[8993]: I1204 11:59:14.072888 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2ee42f3c-353c-459c-aa6e-8f85eadbfb84-catalog-content\") pod \"2ee42f3c-353c-459c-aa6e-8f85eadbfb84\" (UID: \"2ee42f3c-353c-459c-aa6e-8f85eadbfb84\") " Dec 04 11:59:14.073275 master-0 kubenswrapper[8993]: I1204 11:59:14.073257 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7sgq\" (UniqueName: \"kubernetes.io/projected/2ee42f3c-353c-459c-aa6e-8f85eadbfb84-kube-api-access-b7sgq\") pod \"2ee42f3c-353c-459c-aa6e-8f85eadbfb84\" (UID: \"2ee42f3c-353c-459c-aa6e-8f85eadbfb84\") " Dec 04 11:59:14.073513 master-0 kubenswrapper[8993]: I1204 11:59:14.073500 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2ee42f3c-353c-459c-aa6e-8f85eadbfb84-utilities\") pod \"2ee42f3c-353c-459c-aa6e-8f85eadbfb84\" (UID: \"2ee42f3c-353c-459c-aa6e-8f85eadbfb84\") " Dec 04 11:59:14.074453 master-0 kubenswrapper[8993]: I1204 11:59:14.074376 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ee42f3c-353c-459c-aa6e-8f85eadbfb84-utilities" (OuterVolumeSpecName: "utilities") pod "2ee42f3c-353c-459c-aa6e-8f85eadbfb84" (UID: "2ee42f3c-353c-459c-aa6e-8f85eadbfb84"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 11:59:14.076705 master-0 kubenswrapper[8993]: I1204 11:59:14.076666 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ee42f3c-353c-459c-aa6e-8f85eadbfb84-kube-api-access-b7sgq" (OuterVolumeSpecName: "kube-api-access-b7sgq") pod "2ee42f3c-353c-459c-aa6e-8f85eadbfb84" (UID: "2ee42f3c-353c-459c-aa6e-8f85eadbfb84"). InnerVolumeSpecName "kube-api-access-b7sgq". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:59:14.120340 master-0 kubenswrapper[8993]: I1204 11:59:14.120277 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ee42f3c-353c-459c-aa6e-8f85eadbfb84-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "2ee42f3c-353c-459c-aa6e-8f85eadbfb84" (UID: "2ee42f3c-353c-459c-aa6e-8f85eadbfb84"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 11:59:14.174794 master-0 kubenswrapper[8993]: I1204 11:59:14.174695 8993 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2ee42f3c-353c-459c-aa6e-8f85eadbfb84-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 11:59:14.174794 master-0 kubenswrapper[8993]: I1204 11:59:14.174761 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-b7sgq\" (UniqueName: \"kubernetes.io/projected/2ee42f3c-353c-459c-aa6e-8f85eadbfb84-kube-api-access-b7sgq\") on node \"master-0\" DevicePath \"\"" Dec 04 11:59:14.174794 master-0 kubenswrapper[8993]: I1204 11:59:14.174779 8993 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2ee42f3c-353c-459c-aa6e-8f85eadbfb84-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 11:59:14.184402 master-0 kubenswrapper[8993]: I1204 11:59:14.184362 8993 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 11:59:14.184610 master-0 kubenswrapper[8993]: E1204 11:59:14.184592 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="727fd5bf-d896-41b6-9b4f-0c811ccca13a" containerName="extract-content" Dec 04 11:59:14.184610 master-0 kubenswrapper[8993]: I1204 11:59:14.184608 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="727fd5bf-d896-41b6-9b4f-0c811ccca13a" containerName="extract-content" Dec 04 11:59:14.184686 master-0 kubenswrapper[8993]: E1204 11:59:14.184625 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="727fd5bf-d896-41b6-9b4f-0c811ccca13a" containerName="registry-server" Dec 04 11:59:14.184686 master-0 kubenswrapper[8993]: I1204 11:59:14.184632 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="727fd5bf-d896-41b6-9b4f-0c811ccca13a" containerName="registry-server" Dec 04 11:59:14.184686 master-0 kubenswrapper[8993]: E1204 11:59:14.184654 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerName="registry-server" Dec 04 11:59:14.184686 master-0 kubenswrapper[8993]: I1204 11:59:14.184660 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerName="registry-server" Dec 04 11:59:14.184686 master-0 kubenswrapper[8993]: E1204 11:59:14.184670 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerName="extract-utilities" Dec 04 11:59:14.184686 master-0 kubenswrapper[8993]: I1204 11:59:14.184676 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerName="extract-utilities" Dec 04 11:59:14.184686 master-0 kubenswrapper[8993]: E1204 11:59:14.184683 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerName="extract-content" Dec 04 11:59:14.184686 master-0 kubenswrapper[8993]: I1204 11:59:14.184689 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerName="extract-content" Dec 04 11:59:14.184939 master-0 kubenswrapper[8993]: E1204 11:59:14.184703 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2ee42f3c-353c-459c-aa6e-8f85eadbfb84" containerName="registry-server" Dec 04 11:59:14.184939 master-0 kubenswrapper[8993]: I1204 11:59:14.184711 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ee42f3c-353c-459c-aa6e-8f85eadbfb84" containerName="registry-server" Dec 04 11:59:14.184939 master-0 kubenswrapper[8993]: E1204 11:59:14.184720 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2ee42f3c-353c-459c-aa6e-8f85eadbfb84" containerName="extract-utilities" Dec 04 11:59:14.184939 master-0 kubenswrapper[8993]: I1204 11:59:14.184725 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ee42f3c-353c-459c-aa6e-8f85eadbfb84" containerName="extract-utilities" Dec 04 11:59:14.184939 master-0 kubenswrapper[8993]: E1204 11:59:14.184737 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2ee42f3c-353c-459c-aa6e-8f85eadbfb84" containerName="extract-content" Dec 04 11:59:14.184939 master-0 kubenswrapper[8993]: I1204 11:59:14.184742 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ee42f3c-353c-459c-aa6e-8f85eadbfb84" containerName="extract-content" Dec 04 11:59:14.184939 master-0 kubenswrapper[8993]: E1204 11:59:14.184756 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="727fd5bf-d896-41b6-9b4f-0c811ccca13a" containerName="extract-utilities" Dec 04 11:59:14.184939 master-0 kubenswrapper[8993]: I1204 11:59:14.184761 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="727fd5bf-d896-41b6-9b4f-0c811ccca13a" containerName="extract-utilities" Dec 04 11:59:14.184939 master-0 kubenswrapper[8993]: I1204 11:59:14.184899 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerName="registry-server" Dec 04 11:59:14.184939 master-0 kubenswrapper[8993]: I1204 11:59:14.184917 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="727fd5bf-d896-41b6-9b4f-0c811ccca13a" containerName="registry-server" Dec 04 11:59:14.184939 master-0 kubenswrapper[8993]: I1204 11:59:14.184938 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="2ee42f3c-353c-459c-aa6e-8f85eadbfb84" containerName="registry-server" Dec 04 11:59:14.185560 master-0 kubenswrapper[8993]: I1204 11:59:14.185327 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:14.187151 master-0 kubenswrapper[8993]: I1204 11:59:14.187085 8993 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-kube-apiserver/bootstrap-kube-apiserver-master-0"] Dec 04 11:59:14.187354 master-0 kubenswrapper[8993]: I1204 11:59:14.187310 8993 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Dec 04 11:59:14.187544 master-0 kubenswrapper[8993]: I1204 11:59:14.187517 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" podUID="d75143d9bc4a2dc15781dc51ccff632a" containerName="kube-apiserver" containerID="cri-o://14ac45f5991606821dff758d708720469710a75e4bb098390a3a5689b8ae0ee8" gracePeriod=15 Dec 04 11:59:14.187742 master-0 kubenswrapper[8993]: I1204 11:59:14.187726 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" podUID="d75143d9bc4a2dc15781dc51ccff632a" containerName="kube-apiserver-insecure-readyz" containerID="cri-o://cb6defb2f3057900b70ffad997ff544ea8c575bd9817b1a99621b2f9c63061e6" gracePeriod=15 Dec 04 11:59:14.188035 master-0 kubenswrapper[8993]: E1204 11:59:14.187972 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d75143d9bc4a2dc15781dc51ccff632a" containerName="kube-apiserver" Dec 04 11:59:14.188035 master-0 kubenswrapper[8993]: I1204 11:59:14.188013 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="d75143d9bc4a2dc15781dc51ccff632a" containerName="kube-apiserver" Dec 04 11:59:14.188117 master-0 kubenswrapper[8993]: E1204 11:59:14.188046 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d75143d9bc4a2dc15781dc51ccff632a" containerName="setup" Dec 04 11:59:14.188117 master-0 kubenswrapper[8993]: I1204 11:59:14.188056 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="d75143d9bc4a2dc15781dc51ccff632a" containerName="setup" Dec 04 11:59:14.188117 master-0 kubenswrapper[8993]: E1204 11:59:14.188080 8993 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d75143d9bc4a2dc15781dc51ccff632a" containerName="kube-apiserver-insecure-readyz" Dec 04 11:59:14.188117 master-0 kubenswrapper[8993]: I1204 11:59:14.188091 8993 state_mem.go:107] "Deleted CPUSet assignment" podUID="d75143d9bc4a2dc15781dc51ccff632a" containerName="kube-apiserver-insecure-readyz" Dec 04 11:59:14.188246 master-0 kubenswrapper[8993]: I1204 11:59:14.188225 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="d75143d9bc4a2dc15781dc51ccff632a" containerName="kube-apiserver-insecure-readyz" Dec 04 11:59:14.188246 master-0 kubenswrapper[8993]: I1204 11:59:14.188245 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="d75143d9bc4a2dc15781dc51ccff632a" containerName="setup" Dec 04 11:59:14.188312 master-0 kubenswrapper[8993]: I1204 11:59:14.188261 8993 memory_manager.go:354] "RemoveStaleState removing state" podUID="d75143d9bc4a2dc15781dc51ccff632a" containerName="kube-apiserver" Dec 04 11:59:14.190206 master-0 kubenswrapper[8993]: I1204 11:59:14.190179 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:14.276201 master-0 kubenswrapper[8993]: I1204 11:59:14.276140 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:14.276527 master-0 kubenswrapper[8993]: I1204 11:59:14.276508 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:14.276643 master-0 kubenswrapper[8993]: I1204 11:59:14.276626 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"b89698aa356a3bc32694e2b098f9a900\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:14.276731 master-0 kubenswrapper[8993]: I1204 11:59:14.276714 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"b89698aa356a3bc32694e2b098f9a900\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:14.276883 master-0 kubenswrapper[8993]: I1204 11:59:14.276867 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"b89698aa356a3bc32694e2b098f9a900\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:14.277006 master-0 kubenswrapper[8993]: I1204 11:59:14.276989 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:14.277122 master-0 kubenswrapper[8993]: I1204 11:59:14.277104 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:14.277231 master-0 kubenswrapper[8993]: I1204 11:59:14.277215 8993 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:14.379223 master-0 kubenswrapper[8993]: I1204 11:59:14.379122 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:14.379223 master-0 kubenswrapper[8993]: I1204 11:59:14.379193 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:14.379223 master-0 kubenswrapper[8993]: I1204 11:59:14.379228 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:14.379554 master-0 kubenswrapper[8993]: I1204 11:59:14.379273 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:14.379554 master-0 kubenswrapper[8993]: I1204 11:59:14.379300 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:14.379554 master-0 kubenswrapper[8993]: I1204 11:59:14.379325 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"b89698aa356a3bc32694e2b098f9a900\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:14.379554 master-0 kubenswrapper[8993]: I1204 11:59:14.379344 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"b89698aa356a3bc32694e2b098f9a900\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:14.379554 master-0 kubenswrapper[8993]: I1204 11:59:14.379384 8993 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"b89698aa356a3bc32694e2b098f9a900\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:14.379554 master-0 kubenswrapper[8993]: I1204 11:59:14.379473 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"b89698aa356a3bc32694e2b098f9a900\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:14.379554 master-0 kubenswrapper[8993]: I1204 11:59:14.379525 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:14.379554 master-0 kubenswrapper[8993]: I1204 11:59:14.379556 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:14.379872 master-0 kubenswrapper[8993]: I1204 11:59:14.379585 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:14.379872 master-0 kubenswrapper[8993]: I1204 11:59:14.379610 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:14.379872 master-0 kubenswrapper[8993]: I1204 11:59:14.379636 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:14.379872 master-0 kubenswrapper[8993]: I1204 11:59:14.379663 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"b89698aa356a3bc32694e2b098f9a900\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:14.379872 master-0 kubenswrapper[8993]: I1204 11:59:14.379706 8993 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"b89698aa356a3bc32694e2b098f9a900\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:14.679353 master-0 kubenswrapper[8993]: I1204 11:59:14.679289 8993 generic.go:334] "Generic (PLEG): container finished" podID="d75143d9bc4a2dc15781dc51ccff632a" containerID="cb6defb2f3057900b70ffad997ff544ea8c575bd9817b1a99621b2f9c63061e6" exitCode=0 Dec 04 11:59:14.683020 master-0 kubenswrapper[8993]: I1204 11:59:14.682971 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-dr5sc" event={"ID":"2ee42f3c-353c-459c-aa6e-8f85eadbfb84","Type":"ContainerDied","Data":"c8ecd2cfee02b8b0f20361982f32303ea3b58c79b0022fe1274942794128ec50"} Dec 04 11:59:14.683083 master-0 kubenswrapper[8993]: I1204 11:59:14.683030 8993 scope.go:117] "RemoveContainer" containerID="d2be921f51b9c78590406d65a1332aa47eede0ac449797bb0b94c4f5aacecac4" Dec 04 11:59:14.683168 master-0 kubenswrapper[8993]: I1204 11:59:14.683146 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-dr5sc" Dec 04 11:59:14.698595 master-0 kubenswrapper[8993]: I1204 11:59:14.698551 8993 scope.go:117] "RemoveContainer" containerID="a58c2de1ed2c4ed848e045ab1ff320baaeb55d32facd1e0ed3fa909c7d06b7fa" Dec 04 11:59:14.717382 master-0 kubenswrapper[8993]: I1204 11:59:14.717325 8993 scope.go:117] "RemoveContainer" containerID="0fe42e9c7f6ba7c1efc48eedb982958ff827ba9f4d69c10198448b77c9f8fbae" Dec 04 11:59:14.870530 master-0 kubenswrapper[8993]: I1204 11:59:14.859734 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:14.870530 master-0 kubenswrapper[8993]: I1204 11:59:14.860209 8993 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:14.870530 master-0 kubenswrapper[8993]: I1204 11:59:14.869026 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-fvf4r"] Dec 04 11:59:14.870530 master-0 kubenswrapper[8993]: I1204 11:59:14.869379 8993 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-fvf4r" podUID="fcf0787c-2d77-4bbe-ad3c-70e03169c96f" containerName="registry-server" containerID="cri-o://7fe131a850eec1f47b386d547621b97eb4f33f5907413e4c8d6e48072308e69c" gracePeriod=2 Dec 04 11:59:14.875212 master-0 kubenswrapper[8993]: I1204 11:59:14.874270 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 11:59:14.877753 master-0 kubenswrapper[8993]: I1204 11:59:14.877696 8993 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Dec 04 11:59:14.932673 master-0 kubenswrapper[8993]: I1204 11:59:14.932601 8993 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-dr5sc"] Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: I1204 11:59:15.013863 8993 patch_prober.go:28] interesting pod/bootstrap-kube-apiserver-master-0 container/kube-apiserver namespace/openshift-kube-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]log ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]api-openshift-apiserver-available ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]api-openshift-oauth-apiserver-available ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]informer-sync ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/openshift.io-api-request-count-filter ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/openshift.io-startkubeinformers ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/openshift.io-openshift-apiserver-reachable ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/openshift.io-oauth-apiserver-reachable ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/start-apiserver-admission-initializer ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/generic-apiserver-start-informers ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/priority-and-fairness-config-consumer ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/priority-and-fairness-filter ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/storage-object-count-tracker-hook ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/start-apiextensions-informers ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/start-apiextensions-controllers ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/crd-informer-synced ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/start-system-namespaces-controller ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/start-cluster-authentication-info-controller ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/start-kube-apiserver-identity-lease-controller ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/start-legacy-token-tracking-controller ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/start-service-ip-repair-controllers ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/rbac/bootstrap-roles ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/scheduling/bootstrap-system-priority-classes ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/priority-and-fairness-config-producer ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/bootstrap-controller ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/aggregator-reload-proxy-client-cert ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/start-kube-aggregator-informers ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/apiservice-status-local-available-controller ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/apiservice-status-remote-available-controller ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/apiservice-registration-controller ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/apiservice-wait-for-first-sync ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/apiservice-discovery-controller ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/kube-apiserver-autoregistration ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]autoregister-completion ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/apiservice-openapi-controller ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [+]poststarthook/apiservice-openapiv3-controller ok Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: [-]shutdown failed: reason withheld Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: readyz check failed Dec 04 11:59:15.013943 master-0 kubenswrapper[8993]: I1204 11:59:15.013945 8993 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" podUID="d75143d9bc4a2dc15781dc51ccff632a" containerName="kube-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 11:59:15.281949 master-0 kubenswrapper[8993]: I1204 11:59:15.280353 8993 status_manager.go:851] "Failed to get status for pod" podUID="a906debd0c35952850935aee2d607cce" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.281949 master-0 kubenswrapper[8993]: I1204 11:59:15.281125 8993 status_manager.go:851] "Failed to get status for pod" podUID="b89698aa356a3bc32694e2b098f9a900" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.281949 master-0 kubenswrapper[8993]: I1204 11:59:15.281481 8993 status_manager.go:851] "Failed to get status for pod" podUID="fcf0787c-2d77-4bbe-ad3c-70e03169c96f" pod="openshift-marketplace/community-operators-fvf4r" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-fvf4r\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.283237 master-0 kubenswrapper[8993]: I1204 11:59:15.282560 8993 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-dr5sc"] Dec 04 11:59:15.523062 master-0 kubenswrapper[8993]: I1204 11:59:15.523012 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-fvf4r" Dec 04 11:59:15.524272 master-0 kubenswrapper[8993]: I1204 11:59:15.524191 8993 status_manager.go:851] "Failed to get status for pod" podUID="a906debd0c35952850935aee2d607cce" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.524850 master-0 kubenswrapper[8993]: I1204 11:59:15.524779 8993 status_manager.go:851] "Failed to get status for pod" podUID="b89698aa356a3bc32694e2b098f9a900" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.525386 master-0 kubenswrapper[8993]: I1204 11:59:15.525351 8993 status_manager.go:851] "Failed to get status for pod" podUID="fcf0787c-2d77-4bbe-ad3c-70e03169c96f" pod="openshift-marketplace/community-operators-fvf4r" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-fvf4r\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.597442 master-0 kubenswrapper[8993]: I1204 11:59:15.597355 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fcf0787c-2d77-4bbe-ad3c-70e03169c96f-catalog-content\") pod \"fcf0787c-2d77-4bbe-ad3c-70e03169c96f\" (UID: \"fcf0787c-2d77-4bbe-ad3c-70e03169c96f\") " Dec 04 11:59:15.598037 master-0 kubenswrapper[8993]: I1204 11:59:15.597848 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb77r\" (UniqueName: \"kubernetes.io/projected/fcf0787c-2d77-4bbe-ad3c-70e03169c96f-kube-api-access-mb77r\") pod \"fcf0787c-2d77-4bbe-ad3c-70e03169c96f\" (UID: \"fcf0787c-2d77-4bbe-ad3c-70e03169c96f\") " Dec 04 11:59:15.598037 master-0 kubenswrapper[8993]: I1204 11:59:15.597909 8993 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fcf0787c-2d77-4bbe-ad3c-70e03169c96f-utilities\") pod \"fcf0787c-2d77-4bbe-ad3c-70e03169c96f\" (UID: \"fcf0787c-2d77-4bbe-ad3c-70e03169c96f\") " Dec 04 11:59:15.599487 master-0 kubenswrapper[8993]: I1204 11:59:15.599414 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcf0787c-2d77-4bbe-ad3c-70e03169c96f-utilities" (OuterVolumeSpecName: "utilities") pod "fcf0787c-2d77-4bbe-ad3c-70e03169c96f" (UID: "fcf0787c-2d77-4bbe-ad3c-70e03169c96f"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 11:59:15.601169 master-0 kubenswrapper[8993]: I1204 11:59:15.601071 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcf0787c-2d77-4bbe-ad3c-70e03169c96f-kube-api-access-mb77r" (OuterVolumeSpecName: "kube-api-access-mb77r") pod "fcf0787c-2d77-4bbe-ad3c-70e03169c96f" (UID: "fcf0787c-2d77-4bbe-ad3c-70e03169c96f"). InnerVolumeSpecName "kube-api-access-mb77r". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:59:15.649496 master-0 kubenswrapper[8993]: I1204 11:59:15.648848 8993 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcf0787c-2d77-4bbe-ad3c-70e03169c96f-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "fcf0787c-2d77-4bbe-ad3c-70e03169c96f" (UID: "fcf0787c-2d77-4bbe-ad3c-70e03169c96f"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 11:59:15.693901 master-0 kubenswrapper[8993]: I1204 11:59:15.693782 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" event={"ID":"a906debd0c35952850935aee2d607cce","Type":"ContainerStarted","Data":"b02fad9634552ca9f9ab767de0ddd976a9b715f9ba49fca68b0847641cd92467"} Dec 04 11:59:15.693901 master-0 kubenswrapper[8993]: I1204 11:59:15.693882 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" event={"ID":"a906debd0c35952850935aee2d607cce","Type":"ContainerStarted","Data":"354afa270a03f605fb9c3a24836a29639ae548ebb6cbeb7266228ae3871f1cba"} Dec 04 11:59:15.696353 master-0 kubenswrapper[8993]: I1204 11:59:15.695901 8993 status_manager.go:851] "Failed to get status for pod" podUID="a906debd0c35952850935aee2d607cce" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.697026 master-0 kubenswrapper[8993]: I1204 11:59:15.696975 8993 status_manager.go:851] "Failed to get status for pod" podUID="b89698aa356a3bc32694e2b098f9a900" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.697569 master-0 kubenswrapper[8993]: I1204 11:59:15.697520 8993 status_manager.go:851] "Failed to get status for pod" podUID="fcf0787c-2d77-4bbe-ad3c-70e03169c96f" pod="openshift-marketplace/community-operators-fvf4r" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-fvf4r\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.698446 master-0 kubenswrapper[8993]: I1204 11:59:15.698406 8993 generic.go:334] "Generic (PLEG): container finished" podID="b89698aa356a3bc32694e2b098f9a900" containerID="2262a85240071337933265fef7bf64975af04b3a2ac5a2ff5f0770a8bb6a3e3b" exitCode=0 Dec 04 11:59:15.698565 master-0 kubenswrapper[8993]: I1204 11:59:15.698471 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"b89698aa356a3bc32694e2b098f9a900","Type":"ContainerDied","Data":"2262a85240071337933265fef7bf64975af04b3a2ac5a2ff5f0770a8bb6a3e3b"} Dec 04 11:59:15.698565 master-0 kubenswrapper[8993]: I1204 11:59:15.698502 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"b89698aa356a3bc32694e2b098f9a900","Type":"ContainerStarted","Data":"ba0de6266360c15b4570569e0e059ef77c45c81e15ccf07f9601d54c2d9635c0"} Dec 04 11:59:15.699206 master-0 kubenswrapper[8993]: I1204 11:59:15.699172 8993 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mb77r\" (UniqueName: \"kubernetes.io/projected/fcf0787c-2d77-4bbe-ad3c-70e03169c96f-kube-api-access-mb77r\") on node \"master-0\" DevicePath \"\"" Dec 04 11:59:15.699289 master-0 kubenswrapper[8993]: I1204 11:59:15.699221 8993 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fcf0787c-2d77-4bbe-ad3c-70e03169c96f-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 11:59:15.699289 master-0 kubenswrapper[8993]: I1204 11:59:15.699235 8993 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fcf0787c-2d77-4bbe-ad3c-70e03169c96f-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 11:59:15.699773 master-0 kubenswrapper[8993]: I1204 11:59:15.699436 8993 status_manager.go:851] "Failed to get status for pod" podUID="a906debd0c35952850935aee2d607cce" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.700140 master-0 kubenswrapper[8993]: I1204 11:59:15.700093 8993 status_manager.go:851] "Failed to get status for pod" podUID="b89698aa356a3bc32694e2b098f9a900" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.700536 master-0 kubenswrapper[8993]: I1204 11:59:15.700497 8993 status_manager.go:851] "Failed to get status for pod" podUID="fcf0787c-2d77-4bbe-ad3c-70e03169c96f" pod="openshift-marketplace/community-operators-fvf4r" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-fvf4r\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.702147 master-0 kubenswrapper[8993]: I1204 11:59:15.702097 8993 generic.go:334] "Generic (PLEG): container finished" podID="fcf0787c-2d77-4bbe-ad3c-70e03169c96f" containerID="7fe131a850eec1f47b386d547621b97eb4f33f5907413e4c8d6e48072308e69c" exitCode=0 Dec 04 11:59:15.702214 master-0 kubenswrapper[8993]: I1204 11:59:15.702152 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-fvf4r" event={"ID":"fcf0787c-2d77-4bbe-ad3c-70e03169c96f","Type":"ContainerDied","Data":"7fe131a850eec1f47b386d547621b97eb4f33f5907413e4c8d6e48072308e69c"} Dec 04 11:59:15.702249 master-0 kubenswrapper[8993]: I1204 11:59:15.702212 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-fvf4r" event={"ID":"fcf0787c-2d77-4bbe-ad3c-70e03169c96f","Type":"ContainerDied","Data":"0d4beb2f0b38b3d4aa0fa8f563ff00704337802d5948c53adb4467f6318ead67"} Dec 04 11:59:15.702249 master-0 kubenswrapper[8993]: I1204 11:59:15.702218 8993 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-fvf4r" Dec 04 11:59:15.702351 master-0 kubenswrapper[8993]: I1204 11:59:15.702258 8993 scope.go:117] "RemoveContainer" containerID="7fe131a850eec1f47b386d547621b97eb4f33f5907413e4c8d6e48072308e69c" Dec 04 11:59:15.703194 master-0 kubenswrapper[8993]: I1204 11:59:15.703145 8993 status_manager.go:851] "Failed to get status for pod" podUID="a906debd0c35952850935aee2d607cce" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.703768 master-0 kubenswrapper[8993]: I1204 11:59:15.703717 8993 status_manager.go:851] "Failed to get status for pod" podUID="b89698aa356a3bc32694e2b098f9a900" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.704323 master-0 kubenswrapper[8993]: I1204 11:59:15.704270 8993 generic.go:334] "Generic (PLEG): container finished" podID="0fad065c-94c9-4a38-ab76-cf0266bdc04b" containerID="25421a99ea678b2107e40949ffdaa62c5f5165b3a02aa309382f3c9da4a11384" exitCode=0 Dec 04 11:59:15.704323 master-0 kubenswrapper[8993]: I1204 11:59:15.704305 8993 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-3-master-0" event={"ID":"0fad065c-94c9-4a38-ab76-cf0266bdc04b","Type":"ContainerDied","Data":"25421a99ea678b2107e40949ffdaa62c5f5165b3a02aa309382f3c9da4a11384"} Dec 04 11:59:15.704506 master-0 kubenswrapper[8993]: I1204 11:59:15.704311 8993 status_manager.go:851] "Failed to get status for pod" podUID="fcf0787c-2d77-4bbe-ad3c-70e03169c96f" pod="openshift-marketplace/community-operators-fvf4r" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-fvf4r\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.705024 master-0 kubenswrapper[8993]: I1204 11:59:15.704986 8993 status_manager.go:851] "Failed to get status for pod" podUID="0fad065c-94c9-4a38-ab76-cf0266bdc04b" pod="openshift-kube-apiserver/installer-3-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-3-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.705471 master-0 kubenswrapper[8993]: I1204 11:59:15.705405 8993 status_manager.go:851] "Failed to get status for pod" podUID="fcf0787c-2d77-4bbe-ad3c-70e03169c96f" pod="openshift-marketplace/community-operators-fvf4r" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-fvf4r\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.705942 master-0 kubenswrapper[8993]: I1204 11:59:15.705905 8993 status_manager.go:851] "Failed to get status for pod" podUID="a906debd0c35952850935aee2d607cce" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.706691 master-0 kubenswrapper[8993]: I1204 11:59:15.706631 8993 status_manager.go:851] "Failed to get status for pod" podUID="b89698aa356a3bc32694e2b098f9a900" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.719711 master-0 kubenswrapper[8993]: I1204 11:59:15.719634 8993 status_manager.go:851] "Failed to get status for pod" podUID="a906debd0c35952850935aee2d607cce" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.720394 master-0 kubenswrapper[8993]: I1204 11:59:15.720283 8993 status_manager.go:851] "Failed to get status for pod" podUID="b89698aa356a3bc32694e2b098f9a900" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.721558 master-0 kubenswrapper[8993]: I1204 11:59:15.720978 8993 status_manager.go:851] "Failed to get status for pod" podUID="0fad065c-94c9-4a38-ab76-cf0266bdc04b" pod="openshift-kube-apiserver/installer-3-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-3-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.722211 master-0 kubenswrapper[8993]: I1204 11:59:15.722169 8993 scope.go:117] "RemoveContainer" containerID="ef42190301295969ac96852314b794aa38c9dc8d108bd32140faecfb943392c3" Dec 04 11:59:15.722490 master-0 kubenswrapper[8993]: I1204 11:59:15.722415 8993 status_manager.go:851] "Failed to get status for pod" podUID="fcf0787c-2d77-4bbe-ad3c-70e03169c96f" pod="openshift-marketplace/community-operators-fvf4r" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-fvf4r\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.769424 master-0 kubenswrapper[8993]: I1204 11:59:15.769378 8993 scope.go:117] "RemoveContainer" containerID="fe89545fefcc372bb180649c66c4600486eb9afe6cd9af0e69e7127c2b238b22" Dec 04 11:59:15.789216 master-0 kubenswrapper[8993]: I1204 11:59:15.789167 8993 scope.go:117] "RemoveContainer" containerID="7fe131a850eec1f47b386d547621b97eb4f33f5907413e4c8d6e48072308e69c" Dec 04 11:59:15.789753 master-0 kubenswrapper[8993]: E1204 11:59:15.789715 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fe131a850eec1f47b386d547621b97eb4f33f5907413e4c8d6e48072308e69c\": container with ID starting with 7fe131a850eec1f47b386d547621b97eb4f33f5907413e4c8d6e48072308e69c not found: ID does not exist" containerID="7fe131a850eec1f47b386d547621b97eb4f33f5907413e4c8d6e48072308e69c" Dec 04 11:59:15.790040 master-0 kubenswrapper[8993]: I1204 11:59:15.789784 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fe131a850eec1f47b386d547621b97eb4f33f5907413e4c8d6e48072308e69c"} err="failed to get container status \"7fe131a850eec1f47b386d547621b97eb4f33f5907413e4c8d6e48072308e69c\": rpc error: code = NotFound desc = could not find container \"7fe131a850eec1f47b386d547621b97eb4f33f5907413e4c8d6e48072308e69c\": container with ID starting with 7fe131a850eec1f47b386d547621b97eb4f33f5907413e4c8d6e48072308e69c not found: ID does not exist" Dec 04 11:59:15.790090 master-0 kubenswrapper[8993]: I1204 11:59:15.790042 8993 scope.go:117] "RemoveContainer" containerID="ef42190301295969ac96852314b794aa38c9dc8d108bd32140faecfb943392c3" Dec 04 11:59:15.790513 master-0 kubenswrapper[8993]: E1204 11:59:15.790468 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef42190301295969ac96852314b794aa38c9dc8d108bd32140faecfb943392c3\": container with ID starting with ef42190301295969ac96852314b794aa38c9dc8d108bd32140faecfb943392c3 not found: ID does not exist" containerID="ef42190301295969ac96852314b794aa38c9dc8d108bd32140faecfb943392c3" Dec 04 11:59:15.790564 master-0 kubenswrapper[8993]: I1204 11:59:15.790511 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef42190301295969ac96852314b794aa38c9dc8d108bd32140faecfb943392c3"} err="failed to get container status \"ef42190301295969ac96852314b794aa38c9dc8d108bd32140faecfb943392c3\": rpc error: code = NotFound desc = could not find container \"ef42190301295969ac96852314b794aa38c9dc8d108bd32140faecfb943392c3\": container with ID starting with ef42190301295969ac96852314b794aa38c9dc8d108bd32140faecfb943392c3 not found: ID does not exist" Dec 04 11:59:15.790564 master-0 kubenswrapper[8993]: I1204 11:59:15.790537 8993 scope.go:117] "RemoveContainer" containerID="fe89545fefcc372bb180649c66c4600486eb9afe6cd9af0e69e7127c2b238b22" Dec 04 11:59:15.790963 master-0 kubenswrapper[8993]: E1204 11:59:15.790923 8993 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe89545fefcc372bb180649c66c4600486eb9afe6cd9af0e69e7127c2b238b22\": container with ID starting with fe89545fefcc372bb180649c66c4600486eb9afe6cd9af0e69e7127c2b238b22 not found: ID does not exist" containerID="fe89545fefcc372bb180649c66c4600486eb9afe6cd9af0e69e7127c2b238b22" Dec 04 11:59:15.791120 master-0 kubenswrapper[8993]: I1204 11:59:15.790960 8993 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe89545fefcc372bb180649c66c4600486eb9afe6cd9af0e69e7127c2b238b22"} err="failed to get container status \"fe89545fefcc372bb180649c66c4600486eb9afe6cd9af0e69e7127c2b238b22\": rpc error: code = NotFound desc = could not find container \"fe89545fefcc372bb180649c66c4600486eb9afe6cd9af0e69e7127c2b238b22\": container with ID starting with fe89545fefcc372bb180649c66c4600486eb9afe6cd9af0e69e7127c2b238b22 not found: ID does not exist" Dec 04 11:59:15.798470 master-0 kubenswrapper[8993]: I1204 11:59:15.798394 8993 status_manager.go:851] "Failed to get status for pod" podUID="b89698aa356a3bc32694e2b098f9a900" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.799477 master-0 kubenswrapper[8993]: I1204 11:59:15.799394 8993 status_manager.go:851] "Failed to get status for pod" podUID="0fad065c-94c9-4a38-ab76-cf0266bdc04b" pod="openshift-kube-apiserver/installer-3-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-3-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.800124 master-0 kubenswrapper[8993]: I1204 11:59:15.800075 8993 status_manager.go:851] "Failed to get status for pod" podUID="fcf0787c-2d77-4bbe-ad3c-70e03169c96f" pod="openshift-marketplace/community-operators-fvf4r" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-marketplace/pods/community-operators-fvf4r\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.801031 master-0 kubenswrapper[8993]: I1204 11:59:15.800946 8993 status_manager.go:851] "Failed to get status for pod" podUID="a906debd0c35952850935aee2d607cce" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 11:59:15.801741 master-0 kubenswrapper[8993]: I1204 11:59:15.801705 8993 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ee42f3c-353c-459c-aa6e-8f85eadbfb84" path="/var/lib/kubelet/pods/2ee42f3c-353c-459c-aa6e-8f85eadbfb84/volumes" Dec 04 11:59:16.441970 master-0 systemd[1]: Stopping Kubernetes Kubelet... Dec 04 11:59:16.467256 master-0 systemd[1]: kubelet.service: Deactivated successfully. Dec 04 11:59:16.467609 master-0 systemd[1]: Stopped Kubernetes Kubelet. Dec 04 11:59:16.470933 master-0 systemd[1]: kubelet.service: Consumed 2min 43.653s CPU time. Dec 04 11:59:16.506163 master-0 systemd[1]: Starting Kubernetes Kubelet... Dec 04 11:59:16.602782 master-0 kubenswrapper[35367]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 11:59:16.602782 master-0 kubenswrapper[35367]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Dec 04 11:59:16.602782 master-0 kubenswrapper[35367]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 11:59:16.602782 master-0 kubenswrapper[35367]: Flag --register-with-taints has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 11:59:16.603721 master-0 kubenswrapper[35367]: Flag --pod-infra-container-image has been deprecated, will be removed in a future release. Image garbage collector will get sandbox image information from CRI. Dec 04 11:59:16.603721 master-0 kubenswrapper[35367]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Dec 04 11:59:16.603721 master-0 kubenswrapper[35367]: I1204 11:59:16.602959 35367 server.go:211] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Dec 04 11:59:16.605961 master-0 kubenswrapper[35367]: W1204 11:59:16.605915 35367 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 11:59:16.605961 master-0 kubenswrapper[35367]: W1204 11:59:16.605944 35367 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 11:59:16.605961 master-0 kubenswrapper[35367]: W1204 11:59:16.605953 35367 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 11:59:16.605961 master-0 kubenswrapper[35367]: W1204 11:59:16.605960 35367 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 11:59:16.605961 master-0 kubenswrapper[35367]: W1204 11:59:16.605966 35367 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 11:59:16.605961 master-0 kubenswrapper[35367]: W1204 11:59:16.605971 35367 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 11:59:16.605961 master-0 kubenswrapper[35367]: W1204 11:59:16.605978 35367 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 11:59:16.606313 master-0 kubenswrapper[35367]: W1204 11:59:16.605984 35367 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 11:59:16.606313 master-0 kubenswrapper[35367]: W1204 11:59:16.605990 35367 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 11:59:16.606313 master-0 kubenswrapper[35367]: W1204 11:59:16.605995 35367 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 11:59:16.606313 master-0 kubenswrapper[35367]: W1204 11:59:16.606001 35367 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 11:59:16.606313 master-0 kubenswrapper[35367]: W1204 11:59:16.606007 35367 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 11:59:16.606313 master-0 kubenswrapper[35367]: W1204 11:59:16.606012 35367 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 11:59:16.606313 master-0 kubenswrapper[35367]: W1204 11:59:16.606017 35367 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 11:59:16.606313 master-0 kubenswrapper[35367]: W1204 11:59:16.606023 35367 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 11:59:16.606313 master-0 kubenswrapper[35367]: W1204 11:59:16.606028 35367 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 11:59:16.606313 master-0 kubenswrapper[35367]: W1204 11:59:16.606033 35367 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 11:59:16.606313 master-0 kubenswrapper[35367]: W1204 11:59:16.606039 35367 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 11:59:16.606313 master-0 kubenswrapper[35367]: W1204 11:59:16.606046 35367 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 11:59:16.606313 master-0 kubenswrapper[35367]: W1204 11:59:16.606053 35367 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 11:59:16.606313 master-0 kubenswrapper[35367]: W1204 11:59:16.606076 35367 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 11:59:16.606313 master-0 kubenswrapper[35367]: W1204 11:59:16.606084 35367 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 11:59:16.606313 master-0 kubenswrapper[35367]: W1204 11:59:16.606095 35367 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 11:59:16.606313 master-0 kubenswrapper[35367]: W1204 11:59:16.606100 35367 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 11:59:16.606313 master-0 kubenswrapper[35367]: W1204 11:59:16.606104 35367 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 11:59:16.606313 master-0 kubenswrapper[35367]: W1204 11:59:16.606108 35367 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 11:59:16.607040 master-0 kubenswrapper[35367]: W1204 11:59:16.606113 35367 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 11:59:16.607040 master-0 kubenswrapper[35367]: W1204 11:59:16.606119 35367 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 11:59:16.607040 master-0 kubenswrapper[35367]: W1204 11:59:16.606125 35367 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 11:59:16.607040 master-0 kubenswrapper[35367]: W1204 11:59:16.606129 35367 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 11:59:16.607040 master-0 kubenswrapper[35367]: W1204 11:59:16.606134 35367 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 11:59:16.607040 master-0 kubenswrapper[35367]: W1204 11:59:16.606138 35367 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 11:59:16.607040 master-0 kubenswrapper[35367]: W1204 11:59:16.606142 35367 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 11:59:16.607040 master-0 kubenswrapper[35367]: W1204 11:59:16.606148 35367 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 11:59:16.607040 master-0 kubenswrapper[35367]: W1204 11:59:16.606152 35367 feature_gate.go:330] unrecognized feature gate: Example Dec 04 11:59:16.607040 master-0 kubenswrapper[35367]: W1204 11:59:16.606156 35367 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 11:59:16.607040 master-0 kubenswrapper[35367]: W1204 11:59:16.606160 35367 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 11:59:16.607040 master-0 kubenswrapper[35367]: W1204 11:59:16.606165 35367 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 11:59:16.607040 master-0 kubenswrapper[35367]: W1204 11:59:16.606169 35367 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 11:59:16.607040 master-0 kubenswrapper[35367]: W1204 11:59:16.606174 35367 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 11:59:16.607040 master-0 kubenswrapper[35367]: W1204 11:59:16.606181 35367 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 11:59:16.607040 master-0 kubenswrapper[35367]: W1204 11:59:16.606186 35367 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 11:59:16.607040 master-0 kubenswrapper[35367]: W1204 11:59:16.606191 35367 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 11:59:16.607040 master-0 kubenswrapper[35367]: W1204 11:59:16.606196 35367 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 11:59:16.607040 master-0 kubenswrapper[35367]: W1204 11:59:16.606201 35367 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 11:59:16.607040 master-0 kubenswrapper[35367]: W1204 11:59:16.606206 35367 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 11:59:16.607871 master-0 kubenswrapper[35367]: W1204 11:59:16.606210 35367 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 11:59:16.607871 master-0 kubenswrapper[35367]: W1204 11:59:16.606214 35367 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 11:59:16.607871 master-0 kubenswrapper[35367]: W1204 11:59:16.606219 35367 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 11:59:16.607871 master-0 kubenswrapper[35367]: W1204 11:59:16.606223 35367 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 11:59:16.607871 master-0 kubenswrapper[35367]: W1204 11:59:16.606228 35367 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 11:59:16.607871 master-0 kubenswrapper[35367]: W1204 11:59:16.606232 35367 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 11:59:16.607871 master-0 kubenswrapper[35367]: W1204 11:59:16.606236 35367 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 11:59:16.607871 master-0 kubenswrapper[35367]: W1204 11:59:16.606261 35367 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 11:59:16.607871 master-0 kubenswrapper[35367]: W1204 11:59:16.606266 35367 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 11:59:16.607871 master-0 kubenswrapper[35367]: W1204 11:59:16.606270 35367 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 11:59:16.607871 master-0 kubenswrapper[35367]: W1204 11:59:16.606288 35367 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 11:59:16.607871 master-0 kubenswrapper[35367]: W1204 11:59:16.606292 35367 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 11:59:16.607871 master-0 kubenswrapper[35367]: W1204 11:59:16.606297 35367 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 11:59:16.607871 master-0 kubenswrapper[35367]: W1204 11:59:16.606301 35367 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 11:59:16.607871 master-0 kubenswrapper[35367]: W1204 11:59:16.606305 35367 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 11:59:16.607871 master-0 kubenswrapper[35367]: W1204 11:59:16.606309 35367 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 11:59:16.607871 master-0 kubenswrapper[35367]: W1204 11:59:16.606313 35367 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 11:59:16.607871 master-0 kubenswrapper[35367]: W1204 11:59:16.606318 35367 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 11:59:16.607871 master-0 kubenswrapper[35367]: W1204 11:59:16.606324 35367 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 11:59:16.607871 master-0 kubenswrapper[35367]: W1204 11:59:16.606330 35367 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: W1204 11:59:16.606335 35367 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: W1204 11:59:16.606342 35367 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: W1204 11:59:16.606349 35367 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: W1204 11:59:16.606356 35367 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: W1204 11:59:16.606361 35367 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: W1204 11:59:16.606367 35367 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: I1204 11:59:16.606510 35367 flags.go:64] FLAG: --address="0.0.0.0" Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: I1204 11:59:16.606522 35367 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: I1204 11:59:16.606537 35367 flags.go:64] FLAG: --anonymous-auth="true" Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: I1204 11:59:16.606545 35367 flags.go:64] FLAG: --application-metrics-count-limit="100" Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: I1204 11:59:16.606552 35367 flags.go:64] FLAG: --authentication-token-webhook="false" Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: I1204 11:59:16.606557 35367 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: I1204 11:59:16.606564 35367 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: I1204 11:59:16.606571 35367 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: I1204 11:59:16.606576 35367 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: I1204 11:59:16.606582 35367 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: I1204 11:59:16.606588 35367 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: I1204 11:59:16.606593 35367 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: I1204 11:59:16.606599 35367 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: I1204 11:59:16.606604 35367 flags.go:64] FLAG: --cgroup-root="" Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: I1204 11:59:16.606609 35367 flags.go:64] FLAG: --cgroups-per-qos="true" Dec 04 11:59:16.609306 master-0 kubenswrapper[35367]: I1204 11:59:16.606613 35367 flags.go:64] FLAG: --client-ca-file="" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606619 35367 flags.go:64] FLAG: --cloud-config="" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606623 35367 flags.go:64] FLAG: --cloud-provider="" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606629 35367 flags.go:64] FLAG: --cluster-dns="[]" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606639 35367 flags.go:64] FLAG: --cluster-domain="" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606652 35367 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606657 35367 flags.go:64] FLAG: --config-dir="" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606662 35367 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606668 35367 flags.go:64] FLAG: --container-log-max-files="5" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606675 35367 flags.go:64] FLAG: --container-log-max-size="10Mi" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606681 35367 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606686 35367 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606692 35367 flags.go:64] FLAG: --containerd-namespace="k8s.io" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606697 35367 flags.go:64] FLAG: --contention-profiling="false" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606703 35367 flags.go:64] FLAG: --cpu-cfs-quota="true" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606708 35367 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606720 35367 flags.go:64] FLAG: --cpu-manager-policy="none" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606724 35367 flags.go:64] FLAG: --cpu-manager-policy-options="" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606732 35367 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606737 35367 flags.go:64] FLAG: --enable-controller-attach-detach="true" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606747 35367 flags.go:64] FLAG: --enable-debugging-handlers="true" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606753 35367 flags.go:64] FLAG: --enable-load-reader="false" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606758 35367 flags.go:64] FLAG: --enable-server="true" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606763 35367 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606781 35367 flags.go:64] FLAG: --event-burst="100" Dec 04 11:59:16.610115 master-0 kubenswrapper[35367]: I1204 11:59:16.606787 35367 flags.go:64] FLAG: --event-qps="50" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606792 35367 flags.go:64] FLAG: --event-storage-age-limit="default=0" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606797 35367 flags.go:64] FLAG: --event-storage-event-limit="default=0" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606825 35367 flags.go:64] FLAG: --eviction-hard="" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606833 35367 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606838 35367 flags.go:64] FLAG: --eviction-minimum-reclaim="" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606843 35367 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606848 35367 flags.go:64] FLAG: --eviction-soft="" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606854 35367 flags.go:64] FLAG: --eviction-soft-grace-period="" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606858 35367 flags.go:64] FLAG: --exit-on-lock-contention="false" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606864 35367 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606869 35367 flags.go:64] FLAG: --experimental-mounter-path="" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606874 35367 flags.go:64] FLAG: --fail-cgroupv1="false" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606879 35367 flags.go:64] FLAG: --fail-swap-on="true" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606884 35367 flags.go:64] FLAG: --feature-gates="" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606891 35367 flags.go:64] FLAG: --file-check-frequency="20s" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606909 35367 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606916 35367 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606921 35367 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606927 35367 flags.go:64] FLAG: --healthz-port="10248" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606933 35367 flags.go:64] FLAG: --help="false" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606938 35367 flags.go:64] FLAG: --hostname-override="" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606943 35367 flags.go:64] FLAG: --housekeeping-interval="10s" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606951 35367 flags.go:64] FLAG: --http-check-frequency="20s" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606957 35367 flags.go:64] FLAG: --image-credential-provider-bin-dir="" Dec 04 11:59:16.611020 master-0 kubenswrapper[35367]: I1204 11:59:16.606963 35367 flags.go:64] FLAG: --image-credential-provider-config="" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.606968 35367 flags.go:64] FLAG: --image-gc-high-threshold="85" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.606973 35367 flags.go:64] FLAG: --image-gc-low-threshold="80" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.606979 35367 flags.go:64] FLAG: --image-service-endpoint="" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.606983 35367 flags.go:64] FLAG: --kernel-memcg-notification="false" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.606989 35367 flags.go:64] FLAG: --kube-api-burst="100" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.606994 35367 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.607000 35367 flags.go:64] FLAG: --kube-api-qps="50" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.607005 35367 flags.go:64] FLAG: --kube-reserved="" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.607011 35367 flags.go:64] FLAG: --kube-reserved-cgroup="" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.607016 35367 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.607022 35367 flags.go:64] FLAG: --kubelet-cgroups="" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.607027 35367 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.607032 35367 flags.go:64] FLAG: --lock-file="" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.607037 35367 flags.go:64] FLAG: --log-cadvisor-usage="false" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.607044 35367 flags.go:64] FLAG: --log-flush-frequency="5s" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.607050 35367 flags.go:64] FLAG: --log-json-info-buffer-size="0" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.607059 35367 flags.go:64] FLAG: --log-json-split-stream="false" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.607065 35367 flags.go:64] FLAG: --log-text-info-buffer-size="0" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.607070 35367 flags.go:64] FLAG: --log-text-split-stream="false" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.607076 35367 flags.go:64] FLAG: --logging-format="text" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.607082 35367 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.607089 35367 flags.go:64] FLAG: --make-iptables-util-chains="true" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.607096 35367 flags.go:64] FLAG: --manifest-url="" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.607101 35367 flags.go:64] FLAG: --manifest-url-header="" Dec 04 11:59:16.611976 master-0 kubenswrapper[35367]: I1204 11:59:16.607109 35367 flags.go:64] FLAG: --max-housekeeping-interval="15s" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607114 35367 flags.go:64] FLAG: --max-open-files="1000000" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607131 35367 flags.go:64] FLAG: --max-pods="110" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607137 35367 flags.go:64] FLAG: --maximum-dead-containers="-1" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607142 35367 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607149 35367 flags.go:64] FLAG: --memory-manager-policy="None" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607155 35367 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607161 35367 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607167 35367 flags.go:64] FLAG: --node-ip="192.168.32.10" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607172 35367 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/control-plane=,node-role.kubernetes.io/master=,node.openshift.io/os_id=rhcos" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607186 35367 flags.go:64] FLAG: --node-status-max-images="50" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607193 35367 flags.go:64] FLAG: --node-status-update-frequency="10s" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607199 35367 flags.go:64] FLAG: --oom-score-adj="-999" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607205 35367 flags.go:64] FLAG: --pod-cidr="" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607210 35367 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a70b2a95140d1e90978f36cc9889013ae34bd232662c5424002274385669ed9" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607219 35367 flags.go:64] FLAG: --pod-manifest-path="" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607224 35367 flags.go:64] FLAG: --pod-max-pids="-1" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607229 35367 flags.go:64] FLAG: --pods-per-core="0" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607234 35367 flags.go:64] FLAG: --port="10250" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607240 35367 flags.go:64] FLAG: --protect-kernel-defaults="false" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607244 35367 flags.go:64] FLAG: --provider-id="" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607250 35367 flags.go:64] FLAG: --qos-reserved="" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607255 35367 flags.go:64] FLAG: --read-only-port="10255" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607261 35367 flags.go:64] FLAG: --register-node="true" Dec 04 11:59:16.612838 master-0 kubenswrapper[35367]: I1204 11:59:16.607266 35367 flags.go:64] FLAG: --register-schedulable="true" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607272 35367 flags.go:64] FLAG: --register-with-taints="node-role.kubernetes.io/master=:NoSchedule" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607281 35367 flags.go:64] FLAG: --registry-burst="10" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607288 35367 flags.go:64] FLAG: --registry-qps="5" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607293 35367 flags.go:64] FLAG: --reserved-cpus="" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607298 35367 flags.go:64] FLAG: --reserved-memory="" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607305 35367 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607310 35367 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607315 35367 flags.go:64] FLAG: --rotate-certificates="false" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607320 35367 flags.go:64] FLAG: --rotate-server-certificates="false" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607325 35367 flags.go:64] FLAG: --runonce="false" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607330 35367 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607335 35367 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607341 35367 flags.go:64] FLAG: --seccomp-default="false" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607352 35367 flags.go:64] FLAG: --serialize-image-pulls="true" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607357 35367 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607362 35367 flags.go:64] FLAG: --storage-driver-db="cadvisor" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607368 35367 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607373 35367 flags.go:64] FLAG: --storage-driver-password="root" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607379 35367 flags.go:64] FLAG: --storage-driver-secure="false" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607385 35367 flags.go:64] FLAG: --storage-driver-table="stats" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607391 35367 flags.go:64] FLAG: --storage-driver-user="root" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607397 35367 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607402 35367 flags.go:64] FLAG: --sync-frequency="1m0s" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607408 35367 flags.go:64] FLAG: --system-cgroups="" Dec 04 11:59:16.613855 master-0 kubenswrapper[35367]: I1204 11:59:16.607413 35367 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: I1204 11:59:16.607422 35367 flags.go:64] FLAG: --system-reserved-cgroup="" Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: I1204 11:59:16.607427 35367 flags.go:64] FLAG: --tls-cert-file="" Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: I1204 11:59:16.607432 35367 flags.go:64] FLAG: --tls-cipher-suites="[]" Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: I1204 11:59:16.607446 35367 flags.go:64] FLAG: --tls-min-version="" Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: I1204 11:59:16.607451 35367 flags.go:64] FLAG: --tls-private-key-file="" Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: I1204 11:59:16.607456 35367 flags.go:64] FLAG: --topology-manager-policy="none" Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: I1204 11:59:16.607462 35367 flags.go:64] FLAG: --topology-manager-policy-options="" Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: I1204 11:59:16.607467 35367 flags.go:64] FLAG: --topology-manager-scope="container" Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: I1204 11:59:16.607473 35367 flags.go:64] FLAG: --v="2" Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: I1204 11:59:16.607488 35367 flags.go:64] FLAG: --version="false" Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: I1204 11:59:16.607495 35367 flags.go:64] FLAG: --vmodule="" Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: I1204 11:59:16.607502 35367 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: I1204 11:59:16.607508 35367 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: W1204 11:59:16.607668 35367 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: W1204 11:59:16.607676 35367 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: W1204 11:59:16.607682 35367 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: W1204 11:59:16.607687 35367 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: W1204 11:59:16.607692 35367 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: W1204 11:59:16.607699 35367 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: W1204 11:59:16.607705 35367 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: W1204 11:59:16.607711 35367 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 11:59:16.615344 master-0 kubenswrapper[35367]: W1204 11:59:16.607717 35367 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 11:59:16.616175 master-0 kubenswrapper[35367]: W1204 11:59:16.607723 35367 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 11:59:16.616175 master-0 kubenswrapper[35367]: W1204 11:59:16.607728 35367 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 11:59:16.616175 master-0 kubenswrapper[35367]: W1204 11:59:16.607735 35367 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 11:59:16.616175 master-0 kubenswrapper[35367]: W1204 11:59:16.607739 35367 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 11:59:16.616175 master-0 kubenswrapper[35367]: W1204 11:59:16.607745 35367 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 11:59:16.616175 master-0 kubenswrapper[35367]: W1204 11:59:16.607750 35367 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 11:59:16.616175 master-0 kubenswrapper[35367]: W1204 11:59:16.607755 35367 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 11:59:16.616175 master-0 kubenswrapper[35367]: W1204 11:59:16.607760 35367 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 11:59:16.616175 master-0 kubenswrapper[35367]: W1204 11:59:16.607766 35367 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 11:59:16.616175 master-0 kubenswrapper[35367]: W1204 11:59:16.607771 35367 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 11:59:16.616175 master-0 kubenswrapper[35367]: W1204 11:59:16.607776 35367 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 11:59:16.616175 master-0 kubenswrapper[35367]: W1204 11:59:16.607781 35367 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 11:59:16.616175 master-0 kubenswrapper[35367]: W1204 11:59:16.607786 35367 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 11:59:16.616175 master-0 kubenswrapper[35367]: W1204 11:59:16.607791 35367 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 11:59:16.616175 master-0 kubenswrapper[35367]: W1204 11:59:16.607796 35367 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 11:59:16.616175 master-0 kubenswrapper[35367]: W1204 11:59:16.607826 35367 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 11:59:16.616175 master-0 kubenswrapper[35367]: W1204 11:59:16.607832 35367 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 11:59:16.616175 master-0 kubenswrapper[35367]: W1204 11:59:16.607837 35367 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 11:59:16.616175 master-0 kubenswrapper[35367]: W1204 11:59:16.607843 35367 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 11:59:16.616175 master-0 kubenswrapper[35367]: W1204 11:59:16.607849 35367 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 11:59:16.616898 master-0 kubenswrapper[35367]: W1204 11:59:16.607854 35367 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 11:59:16.616898 master-0 kubenswrapper[35367]: W1204 11:59:16.607859 35367 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 11:59:16.616898 master-0 kubenswrapper[35367]: W1204 11:59:16.607864 35367 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 11:59:16.616898 master-0 kubenswrapper[35367]: W1204 11:59:16.607868 35367 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 11:59:16.616898 master-0 kubenswrapper[35367]: W1204 11:59:16.607874 35367 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 11:59:16.616898 master-0 kubenswrapper[35367]: W1204 11:59:16.607880 35367 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 11:59:16.616898 master-0 kubenswrapper[35367]: W1204 11:59:16.607887 35367 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 11:59:16.616898 master-0 kubenswrapper[35367]: W1204 11:59:16.607893 35367 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 11:59:16.616898 master-0 kubenswrapper[35367]: W1204 11:59:16.607899 35367 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 11:59:16.616898 master-0 kubenswrapper[35367]: W1204 11:59:16.607905 35367 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 11:59:16.616898 master-0 kubenswrapper[35367]: W1204 11:59:16.607913 35367 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 11:59:16.616898 master-0 kubenswrapper[35367]: W1204 11:59:16.607920 35367 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 11:59:16.616898 master-0 kubenswrapper[35367]: W1204 11:59:16.607925 35367 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 11:59:16.616898 master-0 kubenswrapper[35367]: W1204 11:59:16.607931 35367 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 11:59:16.616898 master-0 kubenswrapper[35367]: W1204 11:59:16.607936 35367 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 11:59:16.616898 master-0 kubenswrapper[35367]: W1204 11:59:16.607941 35367 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 11:59:16.616898 master-0 kubenswrapper[35367]: W1204 11:59:16.607946 35367 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 11:59:16.616898 master-0 kubenswrapper[35367]: W1204 11:59:16.607952 35367 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 11:59:16.616898 master-0 kubenswrapper[35367]: W1204 11:59:16.607959 35367 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 11:59:16.617606 master-0 kubenswrapper[35367]: W1204 11:59:16.607964 35367 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 11:59:16.617606 master-0 kubenswrapper[35367]: W1204 11:59:16.607969 35367 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 11:59:16.617606 master-0 kubenswrapper[35367]: W1204 11:59:16.607974 35367 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 11:59:16.617606 master-0 kubenswrapper[35367]: W1204 11:59:16.607979 35367 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 11:59:16.617606 master-0 kubenswrapper[35367]: W1204 11:59:16.607983 35367 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 11:59:16.617606 master-0 kubenswrapper[35367]: W1204 11:59:16.607988 35367 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 11:59:16.617606 master-0 kubenswrapper[35367]: W1204 11:59:16.607993 35367 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 11:59:16.617606 master-0 kubenswrapper[35367]: W1204 11:59:16.607998 35367 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 11:59:16.617606 master-0 kubenswrapper[35367]: W1204 11:59:16.608003 35367 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 11:59:16.617606 master-0 kubenswrapper[35367]: W1204 11:59:16.608008 35367 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 11:59:16.617606 master-0 kubenswrapper[35367]: W1204 11:59:16.608013 35367 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 11:59:16.617606 master-0 kubenswrapper[35367]: W1204 11:59:16.608018 35367 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 11:59:16.617606 master-0 kubenswrapper[35367]: W1204 11:59:16.608028 35367 feature_gate.go:330] unrecognized feature gate: Example Dec 04 11:59:16.617606 master-0 kubenswrapper[35367]: W1204 11:59:16.608033 35367 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 11:59:16.617606 master-0 kubenswrapper[35367]: W1204 11:59:16.608038 35367 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 11:59:16.617606 master-0 kubenswrapper[35367]: W1204 11:59:16.608043 35367 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 11:59:16.617606 master-0 kubenswrapper[35367]: W1204 11:59:16.608047 35367 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 11:59:16.617606 master-0 kubenswrapper[35367]: W1204 11:59:16.608052 35367 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 11:59:16.617606 master-0 kubenswrapper[35367]: W1204 11:59:16.608057 35367 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 11:59:16.617606 master-0 kubenswrapper[35367]: W1204 11:59:16.608061 35367 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 11:59:16.617606 master-0 kubenswrapper[35367]: W1204 11:59:16.608066 35367 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 11:59:16.618371 master-0 kubenswrapper[35367]: W1204 11:59:16.608070 35367 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 11:59:16.618371 master-0 kubenswrapper[35367]: W1204 11:59:16.608075 35367 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 11:59:16.618371 master-0 kubenswrapper[35367]: W1204 11:59:16.608079 35367 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 11:59:16.618371 master-0 kubenswrapper[35367]: I1204 11:59:16.608096 35367 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false StreamingCollectionEncodingToJSON:false StreamingCollectionEncodingToProtobuf:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Dec 04 11:59:16.618371 master-0 kubenswrapper[35367]: I1204 11:59:16.614830 35367 server.go:491] "Kubelet version" kubeletVersion="v1.31.13" Dec 04 11:59:16.618371 master-0 kubenswrapper[35367]: I1204 11:59:16.614889 35367 server.go:493] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Dec 04 11:59:16.618371 master-0 kubenswrapper[35367]: W1204 11:59:16.615020 35367 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 11:59:16.618371 master-0 kubenswrapper[35367]: W1204 11:59:16.615033 35367 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 11:59:16.618371 master-0 kubenswrapper[35367]: W1204 11:59:16.615039 35367 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 11:59:16.618371 master-0 kubenswrapper[35367]: W1204 11:59:16.615045 35367 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 11:59:16.618371 master-0 kubenswrapper[35367]: W1204 11:59:16.615049 35367 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 11:59:16.618371 master-0 kubenswrapper[35367]: W1204 11:59:16.615055 35367 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 11:59:16.618371 master-0 kubenswrapper[35367]: W1204 11:59:16.615060 35367 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 11:59:16.618371 master-0 kubenswrapper[35367]: W1204 11:59:16.615065 35367 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 11:59:16.618371 master-0 kubenswrapper[35367]: W1204 11:59:16.615072 35367 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 11:59:16.618920 master-0 kubenswrapper[35367]: W1204 11:59:16.615078 35367 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 11:59:16.618920 master-0 kubenswrapper[35367]: W1204 11:59:16.615084 35367 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 11:59:16.618920 master-0 kubenswrapper[35367]: W1204 11:59:16.615090 35367 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 11:59:16.618920 master-0 kubenswrapper[35367]: W1204 11:59:16.615096 35367 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 11:59:16.618920 master-0 kubenswrapper[35367]: W1204 11:59:16.615101 35367 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 11:59:16.618920 master-0 kubenswrapper[35367]: W1204 11:59:16.615106 35367 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 11:59:16.618920 master-0 kubenswrapper[35367]: W1204 11:59:16.615113 35367 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 11:59:16.618920 master-0 kubenswrapper[35367]: W1204 11:59:16.615118 35367 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 11:59:16.618920 master-0 kubenswrapper[35367]: W1204 11:59:16.615124 35367 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 11:59:16.618920 master-0 kubenswrapper[35367]: W1204 11:59:16.615129 35367 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 11:59:16.618920 master-0 kubenswrapper[35367]: W1204 11:59:16.615134 35367 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 11:59:16.618920 master-0 kubenswrapper[35367]: W1204 11:59:16.615139 35367 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 11:59:16.618920 master-0 kubenswrapper[35367]: W1204 11:59:16.615145 35367 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 11:59:16.618920 master-0 kubenswrapper[35367]: W1204 11:59:16.615150 35367 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 11:59:16.618920 master-0 kubenswrapper[35367]: W1204 11:59:16.615155 35367 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 11:59:16.618920 master-0 kubenswrapper[35367]: W1204 11:59:16.615159 35367 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 11:59:16.618920 master-0 kubenswrapper[35367]: W1204 11:59:16.615163 35367 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 11:59:16.618920 master-0 kubenswrapper[35367]: W1204 11:59:16.615168 35367 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 11:59:16.618920 master-0 kubenswrapper[35367]: W1204 11:59:16.615176 35367 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 11:59:16.619874 master-0 kubenswrapper[35367]: W1204 11:59:16.615181 35367 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 11:59:16.619874 master-0 kubenswrapper[35367]: W1204 11:59:16.615187 35367 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 11:59:16.619874 master-0 kubenswrapper[35367]: W1204 11:59:16.615195 35367 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 11:59:16.619874 master-0 kubenswrapper[35367]: W1204 11:59:16.615205 35367 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 11:59:16.619874 master-0 kubenswrapper[35367]: W1204 11:59:16.615211 35367 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 11:59:16.619874 master-0 kubenswrapper[35367]: W1204 11:59:16.615216 35367 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 11:59:16.619874 master-0 kubenswrapper[35367]: W1204 11:59:16.615222 35367 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 11:59:16.619874 master-0 kubenswrapper[35367]: W1204 11:59:16.615227 35367 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 11:59:16.619874 master-0 kubenswrapper[35367]: W1204 11:59:16.615233 35367 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 11:59:16.619874 master-0 kubenswrapper[35367]: W1204 11:59:16.615238 35367 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 11:59:16.619874 master-0 kubenswrapper[35367]: W1204 11:59:16.615243 35367 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 11:59:16.619874 master-0 kubenswrapper[35367]: W1204 11:59:16.615249 35367 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 11:59:16.619874 master-0 kubenswrapper[35367]: W1204 11:59:16.615254 35367 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 11:59:16.619874 master-0 kubenswrapper[35367]: W1204 11:59:16.615259 35367 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 11:59:16.619874 master-0 kubenswrapper[35367]: W1204 11:59:16.615265 35367 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 11:59:16.619874 master-0 kubenswrapper[35367]: W1204 11:59:16.615270 35367 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 11:59:16.619874 master-0 kubenswrapper[35367]: W1204 11:59:16.615275 35367 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 11:59:16.619874 master-0 kubenswrapper[35367]: W1204 11:59:16.615281 35367 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 11:59:16.619874 master-0 kubenswrapper[35367]: W1204 11:59:16.615287 35367 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 11:59:16.620985 master-0 kubenswrapper[35367]: W1204 11:59:16.615292 35367 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 11:59:16.620985 master-0 kubenswrapper[35367]: W1204 11:59:16.615298 35367 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 11:59:16.620985 master-0 kubenswrapper[35367]: W1204 11:59:16.615304 35367 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 11:59:16.620985 master-0 kubenswrapper[35367]: W1204 11:59:16.615309 35367 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 11:59:16.620985 master-0 kubenswrapper[35367]: W1204 11:59:16.615316 35367 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 11:59:16.620985 master-0 kubenswrapper[35367]: W1204 11:59:16.615322 35367 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 11:59:16.620985 master-0 kubenswrapper[35367]: W1204 11:59:16.615329 35367 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 11:59:16.620985 master-0 kubenswrapper[35367]: W1204 11:59:16.615334 35367 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 11:59:16.620985 master-0 kubenswrapper[35367]: W1204 11:59:16.615340 35367 feature_gate.go:330] unrecognized feature gate: Example Dec 04 11:59:16.620985 master-0 kubenswrapper[35367]: W1204 11:59:16.615345 35367 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 11:59:16.620985 master-0 kubenswrapper[35367]: W1204 11:59:16.615353 35367 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 11:59:16.620985 master-0 kubenswrapper[35367]: W1204 11:59:16.615359 35367 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 11:59:16.620985 master-0 kubenswrapper[35367]: W1204 11:59:16.615366 35367 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 11:59:16.620985 master-0 kubenswrapper[35367]: W1204 11:59:16.615373 35367 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 11:59:16.620985 master-0 kubenswrapper[35367]: W1204 11:59:16.615379 35367 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 11:59:16.620985 master-0 kubenswrapper[35367]: W1204 11:59:16.615385 35367 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 11:59:16.620985 master-0 kubenswrapper[35367]: W1204 11:59:16.615392 35367 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 11:59:16.620985 master-0 kubenswrapper[35367]: W1204 11:59:16.615397 35367 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 11:59:16.620985 master-0 kubenswrapper[35367]: W1204 11:59:16.615403 35367 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 11:59:16.620985 master-0 kubenswrapper[35367]: W1204 11:59:16.615409 35367 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 11:59:16.621725 master-0 kubenswrapper[35367]: W1204 11:59:16.615415 35367 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 11:59:16.621725 master-0 kubenswrapper[35367]: W1204 11:59:16.615420 35367 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 11:59:16.621725 master-0 kubenswrapper[35367]: W1204 11:59:16.615425 35367 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 11:59:16.621725 master-0 kubenswrapper[35367]: W1204 11:59:16.615430 35367 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 11:59:16.621725 master-0 kubenswrapper[35367]: W1204 11:59:16.615435 35367 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 11:59:16.621725 master-0 kubenswrapper[35367]: I1204 11:59:16.615444 35367 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false StreamingCollectionEncodingToJSON:false StreamingCollectionEncodingToProtobuf:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Dec 04 11:59:16.621725 master-0 kubenswrapper[35367]: W1204 11:59:16.615608 35367 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Dec 04 11:59:16.621725 master-0 kubenswrapper[35367]: W1204 11:59:16.615621 35367 feature_gate.go:330] unrecognized feature gate: InsightsConfig Dec 04 11:59:16.621725 master-0 kubenswrapper[35367]: W1204 11:59:16.615628 35367 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Dec 04 11:59:16.621725 master-0 kubenswrapper[35367]: W1204 11:59:16.615634 35367 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Dec 04 11:59:16.621725 master-0 kubenswrapper[35367]: W1204 11:59:16.615640 35367 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Dec 04 11:59:16.621725 master-0 kubenswrapper[35367]: W1204 11:59:16.615645 35367 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Dec 04 11:59:16.621725 master-0 kubenswrapper[35367]: W1204 11:59:16.615651 35367 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Dec 04 11:59:16.621725 master-0 kubenswrapper[35367]: W1204 11:59:16.615702 35367 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Dec 04 11:59:16.621725 master-0 kubenswrapper[35367]: W1204 11:59:16.615709 35367 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Dec 04 11:59:16.622309 master-0 kubenswrapper[35367]: W1204 11:59:16.615714 35367 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Dec 04 11:59:16.622309 master-0 kubenswrapper[35367]: W1204 11:59:16.615719 35367 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Dec 04 11:59:16.622309 master-0 kubenswrapper[35367]: W1204 11:59:16.615725 35367 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Dec 04 11:59:16.622309 master-0 kubenswrapper[35367]: W1204 11:59:16.615730 35367 feature_gate.go:330] unrecognized feature gate: GatewayAPI Dec 04 11:59:16.622309 master-0 kubenswrapper[35367]: W1204 11:59:16.615735 35367 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Dec 04 11:59:16.622309 master-0 kubenswrapper[35367]: W1204 11:59:16.615740 35367 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Dec 04 11:59:16.622309 master-0 kubenswrapper[35367]: W1204 11:59:16.615746 35367 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Dec 04 11:59:16.622309 master-0 kubenswrapper[35367]: W1204 11:59:16.615751 35367 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Dec 04 11:59:16.622309 master-0 kubenswrapper[35367]: W1204 11:59:16.615756 35367 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Dec 04 11:59:16.622309 master-0 kubenswrapper[35367]: W1204 11:59:16.615763 35367 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Dec 04 11:59:16.622309 master-0 kubenswrapper[35367]: W1204 11:59:16.615779 35367 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Dec 04 11:59:16.622309 master-0 kubenswrapper[35367]: W1204 11:59:16.615786 35367 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Dec 04 11:59:16.622309 master-0 kubenswrapper[35367]: W1204 11:59:16.615792 35367 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Dec 04 11:59:16.622309 master-0 kubenswrapper[35367]: W1204 11:59:16.615797 35367 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Dec 04 11:59:16.622309 master-0 kubenswrapper[35367]: W1204 11:59:16.615824 35367 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Dec 04 11:59:16.622309 master-0 kubenswrapper[35367]: W1204 11:59:16.615830 35367 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Dec 04 11:59:16.622309 master-0 kubenswrapper[35367]: W1204 11:59:16.615836 35367 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Dec 04 11:59:16.622309 master-0 kubenswrapper[35367]: W1204 11:59:16.615843 35367 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Dec 04 11:59:16.622309 master-0 kubenswrapper[35367]: W1204 11:59:16.615852 35367 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Dec 04 11:59:16.622980 master-0 kubenswrapper[35367]: W1204 11:59:16.615859 35367 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Dec 04 11:59:16.622980 master-0 kubenswrapper[35367]: W1204 11:59:16.615867 35367 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Dec 04 11:59:16.622980 master-0 kubenswrapper[35367]: W1204 11:59:16.615873 35367 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Dec 04 11:59:16.622980 master-0 kubenswrapper[35367]: W1204 11:59:16.615879 35367 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Dec 04 11:59:16.622980 master-0 kubenswrapper[35367]: W1204 11:59:16.615885 35367 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Dec 04 11:59:16.622980 master-0 kubenswrapper[35367]: W1204 11:59:16.615890 35367 feature_gate.go:330] unrecognized feature gate: Example Dec 04 11:59:16.622980 master-0 kubenswrapper[35367]: W1204 11:59:16.615895 35367 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Dec 04 11:59:16.622980 master-0 kubenswrapper[35367]: W1204 11:59:16.615901 35367 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Dec 04 11:59:16.622980 master-0 kubenswrapper[35367]: W1204 11:59:16.615906 35367 feature_gate.go:330] unrecognized feature gate: SignatureStores Dec 04 11:59:16.622980 master-0 kubenswrapper[35367]: W1204 11:59:16.615912 35367 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Dec 04 11:59:16.622980 master-0 kubenswrapper[35367]: W1204 11:59:16.615927 35367 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Dec 04 11:59:16.622980 master-0 kubenswrapper[35367]: W1204 11:59:16.615934 35367 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Dec 04 11:59:16.622980 master-0 kubenswrapper[35367]: W1204 11:59:16.615941 35367 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Dec 04 11:59:16.622980 master-0 kubenswrapper[35367]: W1204 11:59:16.615947 35367 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Dec 04 11:59:16.622980 master-0 kubenswrapper[35367]: W1204 11:59:16.615952 35367 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Dec 04 11:59:16.622980 master-0 kubenswrapper[35367]: W1204 11:59:16.615956 35367 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Dec 04 11:59:16.622980 master-0 kubenswrapper[35367]: W1204 11:59:16.615962 35367 feature_gate.go:330] unrecognized feature gate: NewOLM Dec 04 11:59:16.622980 master-0 kubenswrapper[35367]: W1204 11:59:16.615967 35367 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Dec 04 11:59:16.622980 master-0 kubenswrapper[35367]: W1204 11:59:16.615972 35367 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Dec 04 11:59:16.625080 master-0 kubenswrapper[35367]: W1204 11:59:16.615977 35367 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Dec 04 11:59:16.625080 master-0 kubenswrapper[35367]: W1204 11:59:16.615982 35367 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Dec 04 11:59:16.625080 master-0 kubenswrapper[35367]: W1204 11:59:16.615988 35367 feature_gate.go:330] unrecognized feature gate: PlatformOperators Dec 04 11:59:16.625080 master-0 kubenswrapper[35367]: W1204 11:59:16.615994 35367 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Dec 04 11:59:16.625080 master-0 kubenswrapper[35367]: W1204 11:59:16.615999 35367 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Dec 04 11:59:16.625080 master-0 kubenswrapper[35367]: W1204 11:59:16.616004 35367 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Dec 04 11:59:16.625080 master-0 kubenswrapper[35367]: W1204 11:59:16.616009 35367 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Dec 04 11:59:16.625080 master-0 kubenswrapper[35367]: W1204 11:59:16.616014 35367 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Dec 04 11:59:16.625080 master-0 kubenswrapper[35367]: W1204 11:59:16.616020 35367 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Dec 04 11:59:16.625080 master-0 kubenswrapper[35367]: W1204 11:59:16.616025 35367 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Dec 04 11:59:16.625080 master-0 kubenswrapper[35367]: W1204 11:59:16.616030 35367 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Dec 04 11:59:16.625080 master-0 kubenswrapper[35367]: W1204 11:59:16.616035 35367 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Dec 04 11:59:16.625080 master-0 kubenswrapper[35367]: W1204 11:59:16.616041 35367 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Dec 04 11:59:16.625080 master-0 kubenswrapper[35367]: W1204 11:59:16.616047 35367 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Dec 04 11:59:16.625080 master-0 kubenswrapper[35367]: W1204 11:59:16.616053 35367 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Dec 04 11:59:16.625080 master-0 kubenswrapper[35367]: W1204 11:59:16.616058 35367 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Dec 04 11:59:16.625080 master-0 kubenswrapper[35367]: W1204 11:59:16.616064 35367 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Dec 04 11:59:16.625080 master-0 kubenswrapper[35367]: W1204 11:59:16.616070 35367 feature_gate.go:330] unrecognized feature gate: PinnedImages Dec 04 11:59:16.625080 master-0 kubenswrapper[35367]: W1204 11:59:16.616075 35367 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Dec 04 11:59:16.625080 master-0 kubenswrapper[35367]: W1204 11:59:16.616080 35367 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Dec 04 11:59:16.625760 master-0 kubenswrapper[35367]: W1204 11:59:16.616085 35367 feature_gate.go:330] unrecognized feature gate: OVNObservability Dec 04 11:59:16.625760 master-0 kubenswrapper[35367]: W1204 11:59:16.616090 35367 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Dec 04 11:59:16.625760 master-0 kubenswrapper[35367]: W1204 11:59:16.616095 35367 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Dec 04 11:59:16.625760 master-0 kubenswrapper[35367]: W1204 11:59:16.616100 35367 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Dec 04 11:59:16.625760 master-0 kubenswrapper[35367]: W1204 11:59:16.616105 35367 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Dec 04 11:59:16.625760 master-0 kubenswrapper[35367]: I1204 11:59:16.616113 35367 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false StreamingCollectionEncodingToJSON:false StreamingCollectionEncodingToProtobuf:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Dec 04 11:59:16.625760 master-0 kubenswrapper[35367]: I1204 11:59:16.616363 35367 server.go:940] "Client rotation is on, will bootstrap in background" Dec 04 11:59:16.625760 master-0 kubenswrapper[35367]: I1204 11:59:16.618232 35367 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Dec 04 11:59:16.625760 master-0 kubenswrapper[35367]: I1204 11:59:16.618363 35367 certificate_store.go:130] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-client-current.pem". Dec 04 11:59:16.625760 master-0 kubenswrapper[35367]: I1204 11:59:16.618573 35367 server.go:997] "Starting client certificate rotation" Dec 04 11:59:16.625760 master-0 kubenswrapper[35367]: I1204 11:59:16.618584 35367 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Certificate rotation is enabled Dec 04 11:59:16.625760 master-0 kubenswrapper[35367]: I1204 11:59:16.618873 35367 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Certificate expiration is 2025-12-05 11:26:53 +0000 UTC, rotation deadline is 2025-12-05 04:35:37.704717594 +0000 UTC Dec 04 11:59:16.625760 master-0 kubenswrapper[35367]: I1204 11:59:16.619078 35367 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Waiting 16h36m21.085646071s for next certificate rotation Dec 04 11:59:16.626420 master-0 kubenswrapper[35367]: I1204 11:59:16.619234 35367 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Dec 04 11:59:16.626420 master-0 kubenswrapper[35367]: I1204 11:59:16.620801 35367 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Dec 04 11:59:16.626420 master-0 kubenswrapper[35367]: I1204 11:59:16.623583 35367 log.go:25] "Validated CRI v1 runtime API" Dec 04 11:59:16.627845 master-0 kubenswrapper[35367]: I1204 11:59:16.627779 35367 log.go:25] "Validated CRI v1 image API" Dec 04 11:59:16.628867 master-0 kubenswrapper[35367]: I1204 11:59:16.628823 35367 server.go:1437] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Dec 04 11:59:16.641916 master-0 kubenswrapper[35367]: I1204 11:59:16.641854 35367 fs.go:135] Filesystem UUIDs: map[1a7dfbc4-59c8-49fb-a376-2f3ae5e5e818:/dev/vda3 7B77-95E7:/dev/vda2 910678ff-f77e-4a7d-8d53-86f2ac47a823:/dev/vda4] Dec 04 11:59:16.643838 master-0 kubenswrapper[35367]: I1204 11:59:16.641897 35367 fs.go:136] Filesystem partitions: map[/dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /dev/vda3:{mountpoint:/boot major:252 minor:3 fsType:ext4 blockSize:0} /dev/vda4:{mountpoint:/var major:252 minor:4 fsType:xfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/067d2ebf7cd71320983357660c7bfa56d36312a860021a8819604e4142c7331b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/067d2ebf7cd71320983357660c7bfa56d36312a860021a8819604e4142c7331b/userdata/shm major:0 minor:1398 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0d019de7666ab420398ef1b6b5ac581f64802cb56fe4c2b360c11b041de71dc5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0d019de7666ab420398ef1b6b5ac581f64802cb56fe4c2b360c11b041de71dc5/userdata/shm major:0 minor:344 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1de82f0d2145eda0963037fc5194d3ed0ef6f28ba0425692586ec1b2d5c1a8d7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1de82f0d2145eda0963037fc5194d3ed0ef6f28ba0425692586ec1b2d5c1a8d7/userdata/shm major:0 minor:53 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1f986c9fd7cca35aea4ff3881bdd60a51656018288bec2bb4cbd1618b75a974f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1f986c9fd7cca35aea4ff3881bdd60a51656018288bec2bb4cbd1618b75a974f/userdata/shm major:0 minor:764 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2258f6af8e03d9e9b2176864d007811f1c2157002d410c1abd99bd0f7a698646/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2258f6af8e03d9e9b2176864d007811f1c2157002d410c1abd99bd0f7a698646/userdata/shm major:0 minor:1326 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/25835b8cd52c0d1fb7ed133702ef424c403a978f32d5722b14d0bf7744915891/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/25835b8cd52c0d1fb7ed133702ef424c403a978f32d5722b14d0bf7744915891/userdata/shm major:0 minor:132 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3015234670ad18f7c398b493ca22ed29544c1a67b53fd16b0177b13130626f13/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3015234670ad18f7c398b493ca22ed29544c1a67b53fd16b0177b13130626f13/userdata/shm major:0 minor:884 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/34d78076625efac7bdb2340b596443baa5d08eac7ab61fe519fdb353374c6f2a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/34d78076625efac7bdb2340b596443baa5d08eac7ab61fe519fdb353374c6f2a/userdata/shm major:0 minor:331 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/354afa270a03f605fb9c3a24836a29639ae548ebb6cbeb7266228ae3871f1cba/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/354afa270a03f605fb9c3a24836a29639ae548ebb6cbeb7266228ae3871f1cba/userdata/shm major:0 minor:106 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3683b10cf07d6921c3832ff5c3c42262028823e5717156ccd7dd27d6a44a9b03/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3683b10cf07d6921c3832ff5c3c42262028823e5717156ccd7dd27d6a44a9b03/userdata/shm major:0 minor:786 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/38aff0440f5b265ce52ca882bf70fe892cd569736c1a9aa92adc7ee8587a099b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/38aff0440f5b265ce52ca882bf70fe892cd569736c1a9aa92adc7ee8587a099b/userdata/shm major:0 minor:92 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/40749160ea3271ba79ddd289ecc16ddea5467363a62ec473910d1a7a9d5f865a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/40749160ea3271ba79ddd289ecc16ddea5467363a62ec473910d1a7a9d5f865a/userdata/shm major:0 minor:1014 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/43dcc9c0ef931e3436340e17ac24b9225ef01b32e75d1a2065a16822407e5048/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/43dcc9c0ef931e3436340e17ac24b9225ef01b32e75d1a2065a16822407e5048/userdata/shm major:0 minor:562 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/474d4f9ffe7ccdfc7a57a90c2911a6db821fd6fb44f99e0d486e566260e1bcfb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/474d4f9ffe7ccdfc7a57a90c2911a6db821fd6fb44f99e0d486e566260e1bcfb/userdata/shm major:0 minor:813 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4c6405b67db7763561b4f0f867c268ed82b2dcb8dc4a31ac8bd955b23c489a04/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4c6405b67db7763561b4f0f867c268ed82b2dcb8dc4a31ac8bd955b23c489a04/userdata/shm major:0 minor:342 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4e4d27e585843021cf1d4ebb05e041bc6724b400e88a89f330496e3b5cadf825/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4e4d27e585843021cf1d4ebb05e041bc6724b400e88a89f330496e3b5cadf825/userdata/shm major:0 minor:1092 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/52fc4812931b1d912474af968926c8a3a29e2b1cbdfed78532122ce1dc286a99/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/52fc4812931b1d912474af968926c8a3a29e2b1cbdfed78532122ce1dc286a99/userdata/shm major:0 minor:334 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/59191695c89f8cecbba881756b5ffc5e4c892fd02facf20cc198ade1bf4ec267/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/59191695c89f8cecbba881756b5ffc5e4c892fd02facf20cc198ade1bf4ec267/userdata/shm major:0 minor:46 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/597a9e4435c6089676e0fa68a7916eee6043cc3e40b07033c316c40839d7d999/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/597a9e4435c6089676e0fa68a7916eee6043cc3e40b07033c316c40839d7d999/userdata/shm major:0 minor:583 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5a1b18048a411d2d744b17951526af70eccaa227a92df3b43814bef05c92e2a1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5a1b18048a411d2d744b17951526af70eccaa227a92df3b43814bef05c92e2a1/userdata/shm major:0 minor:51 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5b961ab6b54b9feb8cf7fe5efab6be134bcc809fa3be066db38163dd3c1044fc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5b961ab6b54b9feb8cf7fe5efab6be134bcc809fa3be066db38163dd3c1044fc/userdata/shm major:0 minor:1076 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5c0e8a1ff66497ba460c926920322631645b0bfd118367bdd87314c14c19d316/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5c0e8a1ff66497ba460c926920322631645b0bfd118367bdd87314c14c19d316/userdata/shm major:0 minor:476 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5f6e465bf3a100d7d2886ee1f7e11272f1efa1a5de4bd0fed903545e3f9d07c9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5f6e465bf3a100d7d2886ee1f7e11272f1efa1a5de4bd0fed903545e3f9d07c9/userdata/shm major:0 minor:1057 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/612a0c5312df7f19a5e3a086b42a22b55f539c232badbe0a03979b12eb756461/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/612a0c5312df7f19a5e3a086b42a22b55f539c232badbe0a03979b12eb756461/userdata/shm major:0 minor:343 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/633c1d5f3a3bae71b1e74d7bb8c0b438d99900f59c81ad94f6fad5a2189395ea/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/633c1d5f3a3bae71b1e74d7bb8c0b438d99900f59c81ad94f6fad5a2189395ea/userdata/shm major:0 minor:680 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6cab7196e003292e61274a565af49a44adbe51e465702618783576ef89e2744f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6cab7196e003292e61274a565af49a44adbe51e465702618783576ef89e2744f/userdata/shm major:0 minor:330 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/73c1f951bd9264b3f0b9e21c0ff82a20649a61998f0c539575a5fc18eabd1838/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/73c1f951bd9264b3f0b9e21c0ff82a20649a61998f0c539575a5fc18eabd1838/userdata/shm major:0 minor:614 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7458153a023b91d017eed71d76df09c0bc8fa59fa08b1c40a9a1e8366760b372/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7458153a023b91d017eed71d76df09c0bc8fa59fa08b1c40a9a1e8366760b372/userdata/shm major:0 minor:666 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/773244d15d95d1008b0937319bf6aba15eff590b74992c80e3033356005709af/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/773244d15d95d1008b0937319bf6aba15eff590b74992c80e3033356005709af/userdata/shm major:0 minor:618 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/786de756c2bbfc0e0c7e3711833e432deb88e55c1e571e200028809dee015dd2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/786de756c2bbfc0e0c7e3711833e432deb88e55c1e571e200028809dee015dd2/userdata/shm major:0 minor:486 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7e5d9f59cc52a039bc3101dea9d52f4d7e3ff569f7c4b78565cd401fa0991a31/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7e5d9f59cc52a039bc3101dea9d52f4d7e3ff569f7c4b78565cd401fa0991a31/userdata/shm major:0 minor:567 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/80b7010f11c99ac14cabd3f2b1f486b53fdcc69d5c12f6e72980c019a365f3ae/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/80b7010f11c99ac14cabd3f2b1f486b53fdcc69d5c12f6e72980c019a365f3ae/userdata/shm major:0 minor:1078 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/853c784d56688f268e88966f202d566476596a385a8e279f2c38cf8e7278c8d9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/853c784d56688f268e88966f202d566476596a385a8e279f2c38cf8e7278c8d9/userdata/shm major:0 minor:161 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/86e405dadeb983de0c61fd791085ee3cc704ca6463b209f2814b958275b8c70d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/86e405dadeb983de0c61fd791085ee3cc704ca6463b209f2814b958275b8c70d/userdata/shm major:0 minor:484 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/870c232b93a5ee37a81fedb1347de97a51e51c964baa741a79bf8da03ca09932/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/870c232b93a5ee37a81fedb1347de97a51e51c964baa741a79bf8da03ca09932/userdata/shm major:0 minor:54 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9209d07e9d452425b2d2ddf357828c438f519980e0dbf9221a16c945f07adb72/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9209d07e9d452425b2d2ddf357828c438f519980e0dbf9221a16c945f07adb72/userdata/shm major:0 minor:650 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/941cfa04ddc49a585fc727a1dbdeb69c47e5f5f598b3a6ea4a0075889e24c1b1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/941cfa04ddc49a585fc727a1dbdeb69c47e5f5f598b3a6ea4a0075889e24c1b1/userdata/shm major:0 minor:409 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/97556f365f16c1ec11f0ae822f90781c5b826eb96ebe11fadb15589661eb05b6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/97556f365f16c1ec11f0ae822f90781c5b826eb96ebe11fadb15589661eb05b6/userdata/shm major:0 minor:584 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9b1319524752363a937b5af4a730963d2a56573bdd16e93cbb4db707f16a3fba/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9b1319524752363a937b5af4a730963d2a56573bdd16e93cbb4db707f16a3fba/userdata/shm major:0 minor:126 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9f0c60cb6b9dab33f815706515da2ff65774b603ef38e904976aabef8f51a1be/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9f0c60cb6b9dab33f815706515da2ff65774b603ef38e904976aabef8f51a1be/userdata/shm major:0 minor:660 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/adbbc7afd8e54e79f29b174cb989cf3e7455023359f413af406ae4a4afbf2ab4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/adbbc7afd8e54e79f29b174cb989cf3e7455023359f413af406ae4a4afbf2ab4/userdata/shm major:0 minor:147 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b05c03ee7421430935dd045065b562c6c4243474d783822f7feef789f201d335/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b05c03ee7421430935dd045065b562c6c4243474d783822f7feef789f201d335/userdata/shm major:0 minor:160 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b19546f46eaddad7163bb8c25c987ab9b0d1e6ccae50bd40bb5bd44e80ea64cb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b19546f46eaddad7163bb8c25c987ab9b0d1e6ccae50bd40bb5bd44e80ea64cb/userdata/shm major:0 minor:188 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ba0de6266360c15b4570569e0e059ef77c45c81e15ccf07f9601d54c2d9635c0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ba0de6266360c15b4570569e0e059ef77c45c81e15ccf07f9601d54c2d9635c0/userdata/shm major:0 minor:107 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bae7cb91a4042c94b674a12af151b5562dfcde35982f682375aba774df863de4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bae7cb91a4042c94b674a12af151b5562dfcde35982f682375aba774df863de4/userdata/shm major:0 minor:471 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/be595cb0f6bc539259ae33f4c798872444db87c19b714237c536b92a4a7a1a6c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/be595cb0f6bc539259ae33f4c798872444db87c19b714237c536b92a4a7a1a6c/userdata/shm major:0 minor:1328 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c13740ec53fb9299b45efbd89f500b5ff1c2e8c4723ff4ec44bf1b5ff490925a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c13740ec53fb9299b45efbd89f500b5ff1c2e8c4723ff4ec44bf1b5ff490925a/userdata/shm major:0 minor:615 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c2c98fa5f1fd4720ca08ff4b851c5b1972a6185dbb2f13863dd011c50de56bb2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c2c98fa5f1fd4720ca08ff4b851c5b1972a6185dbb2f13863dd011c50de56bb2/userdata/shm major:0 minor:1066 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c2e0a5f7188ebd1ad7d4edbad094215c2f60dd9e9a0830dce848050e834e809c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c2e0a5f7188ebd1ad7d4edbad094215c2f60dd9e9a0830dce848050e834e809c/userdata/shm major:0 minor:136 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c2ef6f4b038048608a7de8078d0bbb7a0ab65dee8ba06d90a8c50f1331efa7b2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c2ef6f4b038048608a7de8078d0bbb7a0ab65dee8ba06d90a8c50f1331efa7b2/userdata/shm major:0 minor:1080 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c76231902c039c32af3a18ebabd11c0b9524870e040b7e0b95b175ee636d58b0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c76231902c039c32af3a18ebabd11c0b9524870e040b7e0b95b175ee636d58b0/userdata/shm major:0 minor:671 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ca886b4e0bb939f02a59e692a7e818915eb829261d10e2563a1a2a60bb3e4c87/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ca886b4e0bb939f02a59e692a7e818915eb829261d10e2563a1a2a60bb3e4c87/userdata/shm major:0 minor:349 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cbad8f519fca5622e25075665c609020a4c168f05797a0e7395559b78b81984d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cbad8f519fca5622e25075665c609020a4c168f05797a0e7395559b78b81984d/userdata/shm major:0 minor:338 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cd9dab7f7f5afa841cd8a4ded039df1dd1c65380acd9d3f01a8545a60b7ba60d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cd9dab7f7f5afa841cd8a4ded039df1dd1c65380acd9d3f01a8545a60b7ba60d/userdata/shm major:0 minor:128 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d1fbec2f91180eb6330203120902a7c2d9e5600f6e157a2c0cffd49f47e5d173/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d1fbec2f91180eb6330203120902a7c2d9e5600f6e157a2c0cffd49f47e5d173/userdata/shm major:0 minor:670 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d2441e00fc894bfa5cbf2617e8f186e2a83b2ef94e0fc84c991a8adba8c891ea/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d2441e00fc894bfa5cbf2617e8f186e2a83b2ef94e0fc84c991a8adba8c891ea/userdata/shm major:0 minor:586 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d87bd21afe82e9e2b6c4d808bf699abec2e43c9e57cadeb786171c447db8bbfe/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d87bd21afe82e9e2b6c4d808bf699abec2e43c9e57cadeb786171c447db8bbfe/userdata/shm major:0 minor:662 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d9d667bd2c388cdba21d0d98e8c8985f6bb62287cc7f32d5b257b5a3ca9351a1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d9d667bd2c388cdba21d0d98e8c8985f6bb62287cc7f32d5b257b5a3ca9351a1/userdata/shm major:0 minor:336 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/da23ebdcd7c632c968f1dcc14625f7875764a703fd10b23106235b76064c9498/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/da23ebdcd7c632c968f1dcc14625f7875764a703fd10b23106235b76064c9498/userdata/shm major:0 minor:328 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/dc99390b4f6b05b78c6da98b65609309d92ed4065939c3774e5b8b38d407bec6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/dc99390b4f6b05b78c6da98b65609309d92ed4065939c3774e5b8b38d407bec6/userdata/shm major:0 minor:674 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e64b7e965ab85bcd41866acdf04d1346eef2d43597395fb0ad995548a3c03068/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e64b7e965ab85bcd41866acdf04d1346eef2d43597395fb0ad995548a3c03068/userdata/shm major:0 minor:326 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ea46e001e83a6c3de3d0e1b94f621607bbf3b37c1d2ff600eca3937d30803913/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ea46e001e83a6c3de3d0e1b94f621607bbf3b37c1d2ff600eca3937d30803913/userdata/shm major:0 minor:790 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/eadb6c5599ab1a4ae90f8ecda2c7a886a86c701b1c6361b22d8aa8fc4c814262/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/eadb6c5599ab1a4ae90f8ecda2c7a886a86c701b1c6361b22d8aa8fc4c814262/userdata/shm major:0 minor:306 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f406e5ed7d285ce7a027888d7e8f01827254b6187dd34070ea866b782bc7fc5c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f406e5ed7d285ce7a027888d7e8f01827254b6187dd34070ea866b782bc7fc5c/userdata/shm major:0 minor:1099 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f79899a7403dcd84a3d96a78d16e1cbb4b992d570d19008637079be293ab8381/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f79899a7403dcd84a3d96a78d16e1cbb4b992d570d19008637079be293ab8381/userdata/shm major:0 minor:815 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f98dcde4da5cf1328576b051bbce37ad312e157073b4d2dd8315e3085ebb6ec4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f98dcde4da5cf1328576b051bbce37ad312e157073b4d2dd8315e3085ebb6ec4/userdata/shm major:0 minor:1053 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fa255b4fd328cf99db08eb2b43e9c35a73e8f688d9352d1ab6ed516f93712d61/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fa255b4fd328cf99db08eb2b43e9c35a73e8f688d9352d1ab6ed516f93712d61/userdata/shm major:0 minor:340 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:30 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/00601c1a-efd4-4366-bdc9-d768afa252b0/volumes/kubernetes.io~projected/kube-api-access-2g7bh:{mountpoint:/var/lib/kubelet/pods/00601c1a-efd4-4366-bdc9-d768afa252b0/volumes/kubernetes.io~projected/kube-api-access-2g7bh major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/00601c1a-efd4-4366-bdc9-d768afa252b0/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/00601c1a-efd4-4366-bdc9-d768afa252b0/volumes/kubernetes.io~secret/serving-cert major:0 minor:299 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0158c2f3-20e5-43f4-875d-c5ad8f6112df/volumes/kubernetes.io~projected/kube-api-access-8cxbd:{mountpoint:/var/lib/kubelet/pods/0158c2f3-20e5-43f4-875d-c5ad8f6112df/volumes/kubernetes.io~projected/kube-api-access-8cxbd major:0 minor:317 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0158c2f3-20e5-43f4-875d-c5ad8f6112df/volumes/kubernetes.io~secret/cluster-olm-operator-serving-cert:{mountpoint:/var/lib/kubelet/pods/0158c2f3-20e5-43f4-875d-c5ad8f6112df/volumes/kubernetes.io~secret/cluster-olm-operator-serving-cert major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/018e9ad3-c071-45c6-bfa6-e53dda20c757/volumes/kubernetes.io~projected/kube-api-access-bsvvf:{mountpoint:/var/lib/kubelet/pods/018e9ad3-c071-45c6-bfa6-e53dda20c757/volumes/kubernetes.io~projected/kube-api-access-bsvvf major:0 minor:1073 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/031d300e-24b4-481c-8b82-fe8cdb3fcef7/volumes/kubernetes.io~projected/kube-api-access-k7bhn:{mountpoint:/var/lib/kubelet/pods/031d300e-24b4-481c-8b82-fe8cdb3fcef7/volumes/kubernetes.io~projected/kube-api-access-k7bhn major:0 minor:320 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/08550069-c1a1-475e-84a2-e56905f1ed38/volumes/kubernetes.io~projected/kube-api-access-8cffn:{mountpoint:/var/lib/kubelet/pods/08550069-c1a1-475e-84a2-e56905f1ed38/volumes/kubernetes.io~projected/kube-api-access-8cffn major:0 minor:301 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/08550069-c1a1-475e-84a2-e56905f1ed38/volumes/kubernetes.io~secret/webhook-certs:{mountpoint:/var/lib/kubelet/pods/08550069-c1a1-475e-84a2-e56905f1ed38/volumes/kubernetes.io~secret/webhook-certs major:0 minor:647 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae/volumes/kubernetes.io~projected/kube-api-access-tltk9:{mountpoint:/var/lib/kubelet/pods/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae/volumes/kubernetes.io~projected/kube-api-access-tltk9 major:0 minor:783 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae/volumes/kubernetes.io~secret/metrics-tls major:0 minor:806 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0fad065c-94c9-4a38-ab76-cf0266bdc04b/volumes/kubernetes.io~projected/kube-api-access:{mountpoint:/var/lib/kubelet/pods/0fad065c-94c9-4a38-ab76-cf0266bdc04b/volumes/kubernetes.io~projected/kube-api-access major:0 minor:1397 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1243d581-fa11-4db1-a01a-0cf64eb3ef74/volumes/kubernetes.io~projected/kube-api-access-9q8d8:{mountpoint:/var/lib/kubelet/pods/1243d581-fa11-4db1-a01a-0cf64eb3ef74/volumes/kubernetes.io~projected/kube-api-access-9q8d8 major:0 minor:479 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1243d581-fa11-4db1-a01a-0cf64eb3ef74/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/1243d581-fa11-4db1-a01a-0cf64eb3ef74/volumes/kubernetes.io~secret/signing-key major:0 minor:478 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/14bd3485-aa02-4984-b4a3-59f360b1b327/volumes/kubernetes.io~projected/kube-api-access-nfspg:{mountpoint:/var/lib/kubelet/pods/14bd3485-aa02-4984-b4a3-59f360b1b327/volumes/kubernetes.io~projected/kube-api-access-nfspg major:0 minor:948 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/14bd3485-aa02-4984-b4a3-59f360b1b327/volumes/kubernetes.io~secret/control-plane-machine-set-operator-tls:{mountpoint:/var/lib/kubelet/pods/14bd3485-aa02-4984-b4a3-59f360b1b327/volumes/kubernetes.io~secret/control-plane-machine-set-operator-tls major:0 minor:848 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/157eab0c-0d8d-486b-a349-c2e466e18e0c/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/157eab0c-0d8d-486b-a349-c2e466e18e0c/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:24 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/157eab0c-0d8d-486b-a349-c2e466e18e0c/volumes/kubernetes.io~projected/kube-api-access-p2mhg:{mountpoint:/var/lib/kubelet/pods/157eab0c-0d8d-486b-a349-c2e466e18e0c/volumes/kubernetes.io~projected/kube-api-access-p2mhg major:0 minor:158 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/157eab0c-0d8d-486b-a349-c2e466e18e0c/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/157eab0c-0d8d-486b-a349-c2e466e18e0c/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:157 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/16057f9c-b1f8-4915-acc3-2d4532af4963/volumes/kubernetes.io~projected/kube-api-access-lxnbc:{mountpoint:/var/lib/kubelet/pods/16057f9c-b1f8-4915-acc3-2d4532af4963/volumes/kubernetes.io~projected/kube-api-access-lxnbc major:0 minor:468 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1897bad8-3875-4bd6-b877-b1abe1fe76c7/volumes/kubernetes.io~projected/ca-certs:{mountpoint:/var/lib/kubelet/pods/1897bad8-3875-4bd6-b877-b1abe1fe76c7/volumes/kubernetes.io~projected/ca-certs major:0 minor:581 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1897bad8-3875-4bd6-b877-b1abe1fe76c7/volumes/kubernetes.io~projected/kube-api-access-dkqp2:{mountpoint:/var/lib/kubelet/pods/1897bad8-3875-4bd6-b877-b1abe1fe76c7/volumes/kubernetes.io~projected/kube-api-access-dkqp2 major:0 minor:675 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ade9186-b262-4b5e-9c6f-ba89f0130fb6/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/1ade9186-b262-4b5e-9c6f-ba89f0130fb6/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:321 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ade9186-b262-4b5e-9c6f-ba89f0130fb6/volumes/kubernetes.io~projected/kube-api-access-t46k7:{mountpoint:/var/lib/kubelet/pods/1ade9186-b262-4b5e-9c6f-ba89f0130fb6/volumes/kubernetes.io~projected/kube-api-access-t46k7 major:0 minor:323 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ade9186-b262-4b5e-9c6f-ba89f0130fb6/volumes/kubernetes.io~secret/image-registry-operator-tls:{mountpoint:/var/lib/kubelet/pods/1ade9186-b262-4b5e-9c6f-ba89f0130fb6/volumes/kubernetes.io~secret/image-registry-operator-tls major:0 minor:612 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/24506aa4-ab78-49df-bb58-59093498f13d/volumes/kubernetes.io~projected/kube-api-access-w2qnk:{mountpoint:/var/lib/kubelet/pods/24506aa4-ab78-49df-bb58-59093498f13d/volumes/kubernetes.io~projected/kube-api-access-w2qnk major:0 minor:635 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/24506aa4-ab78-49df-bb58-59093498f13d/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/24506aa4-ab78-49df-bb58-59093498f13d/volumes/kubernetes.io~secret/serving-cert major:0 minor:558 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/27576028-d64a-47cd-b76b-d524e41efe37/volumes/kubernetes.io~projected/kube-api-access:{mountpoint:/var/lib/kubelet/pods/27576028-d64a-47cd-b76b-d524e41efe37/volumes/kubernetes.io~projected/kube-api-access major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/27576028-d64a-47cd-b76b-d524e41efe37/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/27576028-d64a-47cd-b76b-d524e41efe37/volumes/kubernetes.io~secret/serving-cert major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/287fba2d-f56d-4ec0-b796-7849a68fb411/volumes/kubernetes.io~projected/kube-api-access-gmdvf:{mountpoint:/var/lib/kubelet/pods/287fba2d-f56d-4ec0-b796-7849a68fb411/volumes/kubernetes.io~projected/kube-api-access-gmdvf major:0 minor:159 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/287fba2d-f56d-4ec0-b796-7849a68fb411/volumes/kubernetes.io~secret/ovn-control-plane-metrics-cert:{mountpoint:/var/lib/kubelet/pods/287fba2d-f56d-4ec0-b796-7849a68fb411/volumes/kubernetes.io~secret/ovn-control-plane-metrics-cert major:0 minor:156 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ab26ae5-0607-4dfd-840e-531d204b5030/volumes/kubernetes.io~projected/kube-api-access-mvzrc:{mountpoint:/var/lib/kubelet/pods/2ab26ae5-0607-4dfd-840e-531d204b5030/volumes/kubernetes.io~projected/kube-api-access-mvzrc major:0 minor:303 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ab26ae5-0607-4dfd-840e-531d204b5030/volumes/kubernetes.io~secret/cluster-monitoring-operator-tls:{mountpoint:/var/lib/kubelet/pods/2ab26ae5-0607-4dfd-840e-531d204b5030/volumes/kubernetes.io~secret/cluster-monitoring-operator-tls major:0 minor:641 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/330553d2-40ea-4496-8346-2e5bf680669b/volumes/kubernetes.io~projected/kube-api-access-59pbp:{mountpoint:/var/lib/kubelet/pods/330553d2-40ea-4496-8346-2e5bf680669b/volumes/kubernetes.io~projected/kube-api-access-59pbp major:0 minor:348 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3322cc5a-f1f7-4522-b423-19fb7f38cd43/volumes/kubernetes.io~projected/kube-api-access-k449s:{mountpoint:/var/lib/kubelet/pods/3322cc5a-f1f7-4522-b423-19fb7f38cd43/volumes/kubernetes.io~projected/kube-api-access-k449s major:0 minor:315 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3322cc5a-f1f7-4522-b423-19fb7f38cd43/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/3322cc5a-f1f7-4522-b423-19fb7f38cd43/volumes/kubernetes.io~secret/serving-cert major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/volumes/kubernetes.io~projected/kube-api-access-l5r7w:{mountpoint:/var/lib/kubelet/pods/38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/volumes/kubernetes.io~projected/kube-api-access-l5r7w major:0 minor:467 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/42b3be0f-1d82-4a64-abb4-0118a6960efd/volumes/kubernetes.io~projected/kube-api-access-c7xwd:{mountpoint:/var/lib/kubelet/pods/42b3be0f-1d82-4a64-abb4-0118a6960efd/volumes/kubernetes.io~projected/kube-api-access-c7xwd major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/42b3be0f-1d82-4a64-abb4-0118a6960efd/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/42b3be0f-1d82-4a64-abb4-0118a6960efd/volumes/kubernetes.io~secret/serving-cert major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/434ed9b9-715b-455b-867c-775b256df40f/volumes/kubernetes.io~projected/kube-api-access-ggzfm:{mountpoint:/var/lib/kubelet/pods/434ed9b9-715b-455b-867c-775b256df40f/volumes/kubernetes.io~projected/kube-api-access-ggzfm major:0 minor:304 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/434ed9b9-715b-455b-867c-775b256df40f/volumes/kubernetes.io~secret/profile-collector-cert:{mountpoint:/var/lib/kubelet/pods/434ed9b9-715b-455b-867c-775b256df40f/volumes/kubernetes.io~secret/profile-collector-cert major:0 minor:297 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/434ed9b9-715b-455b-867c-775b256df40f/volumes/kubernetes.io~secret/srv-cert:{mountpoint:/var/lib/kubelet/pods/434ed9b9-715b-455b-867c-775b256df40f/volumes/kubernetes.io~secret/srv-cert major:0 minor:645 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ae25dd5-dfdb-42f6-97d0-14ad17743c95/volumes/kubernetes.io~projected/kube-api-access-l22ps:{mountpoint:/var/lib/kubelet/pods/5ae25dd5-dfdb-42f6-97d0-14ad17743c95/volumes/kubernetes.io~projected/kube-api-access-l22ps major:0 minor:1112 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/64d30b80-2336-49c2-a2c2-1e0694036a84/volumes/kubernetes.io~projected/kube-api-access-vgdmn:{mountpoint:/var/lib/kubelet/pods/64d30b80-2336-49c2-a2c2-1e0694036a84/volumes/kubernetes.io~projected/kube-api-access-vgdmn major:0 minor:1051 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/64d30b80-2336-49c2-a2c2-1e0694036a84/volumes/kubernetes.io~secret/cloud-credential-operator-serving-cert:{mountpoint:/var/lib/kubelet/pods/64d30b80-2336-49c2-a2c2-1e0694036a84/volumes/kubernetes.io~secret/cloud-credential-operator-serving-cert major:0 minor:1050 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6f15dcdb-c968-429c-9d1d-63c2becad337/volumes/kubernetes.io~projected/kube-api-access-kkjzz:{mountpoint:/var/lib/kubelet/pods/6f15dcdb-c968-429c-9d1d-63c2becad337/volumes/kubernetes.io~projected/kube-api-access-kkjzz major:0 minor:322 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6f15dcdb-c968-429c-9d1d-63c2becad337/volumes/kubernetes.io~secret/apiservice-cert:{mountpoint:/var/lib/kubelet/pods/6f15dcdb-c968-429c-9d1d-63c2becad337/volumes/kubernetes.io~secret/apiservice-cert major:0 minor:559 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6f15dcdb-c968-429c-9d1d-63c2becad337/volumes/kubernetes.io~secret/node-tuning-operator-tls:{mountpoint:/var/lib/kubelet/pods/6f15dcdb-c968-429c-9d1d-63c2becad337/volumes/kubernetes.io~secret/node-tuning-operator-tls major:0 minor:561 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7203ec93-6572-4032-825c-140029a86058/volumes/kubernetes.io~projected/kube-api-access-gkcj4:{mountpoint:/var/lib/kubelet/pods/7203ec93-6572-4032-825c-140029a86058/volumes/kubernetes.io~projected/kube-api-access-gkcj4 major:0 minor:185 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7203ec93-6572-4032-825c-140029a86058/volumes/kubernetes.io~secret/webhook-cert:{mountpoint:/var/lib/kubelet/pods/7203ec93-6572-4032-825c-140029a86058/volumes/kubernetes.io~secret/webhook-cert major:0 minor:194 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46/volumes/kubernetes.io~projected/kube-api-access-ckwnn:{mountpoint:/var/lib/kubelet/pods/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46/volumes/kubernetes.io~projected/kube-api-access-ckwnn major:0 minor:313 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46/volumes/kubernetes.io~secret/package-server-manager-serving-cert:{mountpoint:/var/lib/kubelet/pods/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46/volumes/kubernetes.io~secret/package-server-manager-serving-cert major:0 minor:649 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7/volumes/kubernetes.io~projected/kube-api-access-mmm9t:{mountpoint:/var/lib/kubelet/pods/7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7/volumes/kubernetes.io~projected/kube-api-access-mmm9t major:0 minor:808 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7bf67a51-9759-4e2a-a2ae-ef7416cad43f/volumes/kubernetes.io~projected/kube-api-access-zr454:{mountpoint:/var/lib/kubelet/pods/7bf67a51-9759-4e2a-a2ae-ef7416cad43f/volumes/kubernetes.io~projected/kube-api-access-zr454 major:0 minor:319 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7bf67a51-9759-4e2a-a2ae-ef7416cad43f/volumes/kubernetes.io~secret/profile-collector-cert:{mountpoint:/var/lib/kubelet/pods/7bf67a51-9759-4e2a-a2ae-ef7416cad43f/volumes/kubernetes.io~secret/profile-collector-cert major:0 minor:294 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7bf67a51-9759-4e2a-a2ae-ef7416cad43f/volumes/kubernetes.io~secret/srv-cert:{mountpoint:/var/lib/kubelet/pods/7bf67a51-9759-4e2a-a2ae-ef7416cad43f/volumes/kubernetes.io~secret/srv-cert major:0 minor:648 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7c017c69-b24e-4a7a-b888-133bed34c174/volumes/kubernetes.io~projected/kube-api-access-tlr76:{mountpoint:/var/lib/kubelet/pods/7c017c69-b24e-4a7a-b888-133bed34c174/volumes/kubernetes.io~projected/kube-api-access-tlr76 major:0 minor:302 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7c017c69-b24e-4a7a-b888-133bed34c174/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/7c017c69-b24e-4a7a-b888-133bed34c174/volumes/kubernetes.io~secret/metrics-tls major:0 minor:611 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e3160a9-11d1-4845-ba30-1a49ae7339a9/volumes/kubernetes.io~projected/kube-api-access-fksx7:{mountpoint:/var/lib/kubelet/pods/7e3160a9-11d1-4845-ba30-1a49ae7339a9/volumes/kubernetes.io~projected/kube-api-access-fksx7 major:0 minor:954 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e3160a9-11d1-4845-ba30-1a49ae7339a9/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/7e3160a9-11d1-4845-ba30-1a49ae7339a9/volumes/kubernetes.io~secret/cert major:0 minor:946 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e3160a9-11d1-4845-ba30-1a49ae7339a9/volumes/kubernetes.io~secret/cluster-baremetal-operator-tls:{mountpoint:/var/lib/kubelet/pods/7e3160a9-11d1-4845-ba30-1a49ae7339a9/volumes/kubernetes.io~secret/cluster-baremetal-operator-tls major:0 minor:947 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7ec61be5-32f9-4aac-815f-41d173213107/volumes/kubernetes.io~projected/kube-api-access-p2bpn:{mountpoint:/var/lib/kubelet/pods/7ec61be5-32f9-4aac-815f-41d173213107/volumes/kubernetes.io~projected/kube-api-access-p2bpn major:0 minor:784 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7ec61be5-32f9-4aac-815f-41d173213107/volumes/kubernetes.io~secret/encryption-config:{mountpoint:/var/lib/kubelet/pods/7ec61be5-32f9-4aac-815f-41d173213107/volumes/kubernetes.io~secret/encryption-config major:0 minor:780 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7ec61be5-32f9-4aac-815f-41d173213107/volumes/kubernetes.io~secret/etcd-client:{mountpoint:/var/lib/kubelet/pods/7ec61be5-32f9-4aac-815f-41d173213107/volumes/kubernetes.io~secret/etcd-client major:0 minor:772 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7ec61be5-32f9-4aac-815f-41d173213107/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/7ec61be5-32f9-4aac-815f-41d173213107/volumes/kubernetes.io~secret/serving-cert major:0 minor:771 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/855d7874-16b1-47d0-82f6-d2b0c89b9a84/volumes/kubernetes.io~projected/kube-api-access-5vv7k:{mountpoint:/var/lib/kubelet/pods/855d7874-16b1-47d0-82f6-d2b0c89b9a84/volumes/kubernetes.io~projected/kube-api-access-5vv7k major:0 minor:1110 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/855d7874-16b1-47d0-82f6-d2b0c89b9a84/volumes/kubernetes.io~secret/apiservice-cert:{mountpoint:/var/lib/kubelet/pods/855d7874-16b1-47d0-82f6-d2b0c89b9a84/volumes/kubernetes.io~secret/apiservice-cert major:0 minor:1108 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/855d7874-16b1-47d0-82f6-d2b0c89b9a84/volumes/kubernetes.io~secret/webhook-cert:{mountpoint:/var/lib/kubelet/pods/855d7874-16b1-47d0-82f6-d2b0c89b9a84/volumes/kubernetes.io~secret/webhook-cert major:0 minor:1109 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8/volumes/kubernetes.io~projected/kube-api-access-n6bhm:{mountpoint:/var/lib/kubelet/pods/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8/volumes/kubernetes.io~projected/kube-api-access-n6bhm major:0 minor:312 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8/volumes/kubernetes.io~secret/serving-cert major:0 minor:289 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a3558de2-46f8-48b5-a961-95decb7805cf/volumes/kubernetes.io~projected/kube-api-access-tbt5w:{mountpoint:/var/lib/kubelet/pods/a3558de2-46f8-48b5-a961-95decb7805cf/volumes/kubernetes.io~projected/kube-api-access-tbt5w major:0 minor:472 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a399a87b-8153-4045-a8d3-63fd88ae280f/volumes/kubernetes.io~projected/kube-api-access:{mountpoint:/var/lib/kubelet/pods/a399a87b-8153-4045-a8d3-63fd88ae280f/volumes/kubernetes.io~projected/kube-api-access major:0 minor:785 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a399a87b-8153-4045-a8d3-63fd88ae280f/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/a399a87b-8153-4045-a8d3-63fd88ae280f/volumes/kubernetes.io~secret/serving-cert major:0 minor:776 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a5b826c3-8638-4cf5-b974-b24e4282ce00/volumes/kubernetes.io~projected/kube-api-access-rhmlm:{mountpoint:/var/lib/kubelet/pods/a5b826c3-8638-4cf5-b974-b24e4282ce00/volumes/kubernetes.io~projected/kube-api-access-rhmlm major:0 minor:325 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a5b826c3-8638-4cf5-b974-b24e4282ce00/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/a5b826c3-8638-4cf5-b974-b24e4282ce00/volumes/kubernetes.io~secret/serving-cert major:0 minor:286 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b011b1f1-3235-4e20-825b-ce711c052407/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/b011b1f1-3235-4e20-825b-ce711c052407/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:300 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b011b1f1-3235-4e20-825b-ce711c052407/volumes/kubernetes.io~projected/kube-api-access-jq49f:{mountpoint:/var/lib/kubelet/pods/b011b1f1-3235-4e20-825b-ce711c052407/volumes/kubernetes.io~projected/kube-api-access-jq49f major:0 minor:309 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b011b1f1-3235-4e20-825b-ce711c052407/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/b011b1f1-3235-4e20-825b-ce711c052407/volumes/kubernetes.io~secret/metrics-tls major:0 minor:613 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c/volumes/kubernetes.io~projected/kube-api-access-v6z8r:{mountpoint:/var/lib/kubelet/pods/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c/volumes/kubernetes.io~projected/kube-api-access-v6z8r major:0 minor:989 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b668f740-dbc3-48e0-9ebc-83bae3a43c83/volumes/kubernetes.io~projected/kube-api-access-xttdn:{mountpoint:/var/lib/kubelet/pods/b668f740-dbc3-48e0-9ebc-83bae3a43c83/volumes/kubernetes.io~projected/kube-api-access-xttdn major:0 minor:1075 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b668f740-dbc3-48e0-9ebc-83bae3a43c83/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/b668f740-dbc3-48e0-9ebc-83bae3a43c83/volumes/kubernetes.io~secret/serving-cert major:0 minor:1074 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bac00ac5-0371-48fd-b1cc-60438f08ae94/volumes/kubernetes.io~projected/kube-api-access:{mountpoint:/var/lib/kubelet/pods/bac00ac5-0371-48fd-b1cc-60438f08ae94/volumes/kubernetes.io~projected/kube-api-access major:0 minor:311 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bac00ac5-0371-48fd-b1cc-60438f08ae94/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/bac00ac5-0371-48fd-b1cc-60438f08ae94/volumes/kubernetes.io~secret/serving-cert major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bdfcb644-24ef-4a33-93ae-a855e872d29a/volumes/kubernetes.io~projected/kube-api-access-f4w2j:{mountpoint:/var/lib/kubelet/pods/bdfcb644-24ef-4a33-93ae-a855e872d29a/volumes/kubernetes.io~projected/kube-api-access-f4w2j major:0 minor:146 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c50317d3-f7cd-4133-845e-44add57ac378/volumes/kubernetes.io~projected/kube-api-access-s2jw8:{mountpoint:/var/lib/kubelet/pods/c50317d3-f7cd-4133-845e-44add57ac378/volumes/kubernetes.io~projected/kube-api-access-s2jw8 major:0 minor:988 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c50317d3-f7cd-4133-845e-44add57ac378/volumes/kubernetes.io~secret/machine-api-operator-tls:{mountpoint:/var/lib/kubelet/pods/c50317d3-f7cd-4133-845e-44add57ac378/volumes/kubernetes.io~secret/machine-api-operator-tls major:0 minor:987 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c6e9271a-44ea-4612-ab60-4a9d489ed062/volumes/kubernetes.io~projected/kube-api-access-cdsq5:{mountpoint:/var/lib/kubelet/pods/c6e9271a-44ea-4612-ab60-4a9d489ed062/volumes/kubernetes.io~projected/kube-api-access-cdsq5 major:0 minor:324 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c6e9271a-44ea-4612-ab60-4a9d489ed062/volumes/kubernetes.io~secret/etcd-client:{mountpoint:/var/lib/kubelet/pods/c6e9271a-44ea-4612-ab60-4a9d489ed062/volumes/kubernetes.io~secret/etcd-client major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c6e9271a-44ea-4612-ab60-4a9d489ed062/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/c6e9271a-44ea-4612-ab60-4a9d489ed062/volumes/kubernetes.io~secret/serving-cert major:0 minor:298 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c790c174-dc60-4f34-8818-3b367fbe3a5f/volumes/kubernetes.io~projected/kube-api-access-6lxhl:{mountpoint:/var/lib/kubelet/pods/c790c174-dc60-4f34-8818-3b367fbe3a5f/volumes/kubernetes.io~projected/kube-api-access-6lxhl major:0 minor:125 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c835660f-5a79-4679-b9be-8543ca6ef5a1/volumes/kubernetes.io~projected/kube-api-access-nxbts:{mountpoint:/var/lib/kubelet/pods/c835660f-5a79-4679-b9be-8543ca6ef5a1/volumes/kubernetes.io~projected/kube-api-access-nxbts major:0 minor:1011 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c835660f-5a79-4679-b9be-8543ca6ef5a1/volumes/kubernetes.io~secret/machine-approver-tls:{mountpoint:/var/lib/kubelet/pods/c835660f-5a79-4679-b9be-8543ca6ef5a1/volumes/kubernetes.io~secret/machine-approver-tls major:0 minor:1010 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c91e6234-52c5-41c0-a1ff-6a92932b83cd/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/c91e6234-52c5-41c0-a1ff-6a92932b83cd/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:601 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c91e6234-52c5-41c0-a1ff-6a92932b83cd/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/c91e6234-52c5-41c0-a1ff-6a92932b83cd/volumes/kubernetes.io~empty-dir/tmp major:0 minor:602 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c91e6234-52c5-41c0-a1ff-6a92932b83cd/volumes/kubernetes.io~projected/kube-api-access-rc244:{mountpoint:/var/lib/kubelet/pods/c91e6234-52c5-41c0-a1ff-6a92932b83cd/volumes/kubernetes.io~projected/kube-api-access-rc244 major:0 minor:603 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ccf1cb9e-8885-4224-92d5-d1b116bc0090/volumes/kubernetes.io~projected/kube-api-access-8w6kv:{mountpoint:/var/lib/kubelet/pods/ccf1cb9e-8885-4224-92d5-d1b116bc0090/volumes/kubernetes.io~projected/kube-api-access-8w6kv major:0 minor:1052 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ccf1cb9e-8885-4224-92d5-d1b116bc0090/volumes/kubernetes.io~secret/samples-operator-tls:{mountpoint:/var/lib/kubelet/pods/ccf1cb9e-8885-4224-92d5-d1b116bc0090/volumes/kubernetes.io~secret/samples-operator-tls major:0 minor:1055 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ccf81538-4d5a-4c26-8e54-fe39331a625d/volumes/kubernetes.io~projected/kube-api-access:{mountpoint:/var/lib/kubelet/pods/ccf81538-4d5a-4c26-8e54-fe39331a625d/volumes/kubernetes.io~projected/kube-api-access major:0 minor:318 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ccf81538-4d5a-4c26-8e54-fe39331a625d/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/ccf81538-4d5a-4c26-8e54-fe39331a625d/volumes/kubernetes.io~secret/serving-cert major:0 minor:292 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9/volumes/kubernetes.io~projected/kube-api-access-lg7hr:{mountpoint:/var/lib/kubelet/pods/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9/volumes/kubernetes.io~projected/kube-api-access-lg7hr major:0 minor:665 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9/volumes/kubernetes.io~secret/encryption-config:{mountpoint:/var/lib/kubelet/pods/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9/volumes/kubernetes.io~secret/encryption-config major:0 minor:656 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9/volumes/kubernetes.io~secret/etcd-client:{mountpoint:/var/lib/kubelet/pods/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9/volumes/kubernetes.io~secret/etcd-client major:0 minor:654 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9/volumes/kubernetes.io~secret/serving-cert major:0 minor:655 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cdb50850-779d-4179-ba1d-65ffeb4bb2e9/volumes/kubernetes.io~projected/kube-api-access-nhvdc:{mountpoint:/var/lib/kubelet/pods/cdb50850-779d-4179-ba1d-65ffeb4bb2e9/volumes/kubernetes.io~projected/kube-api-access-nhvdc major:0 minor:1083 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cdb50850-779d-4179-ba1d-65ffeb4bb2e9/volumes/kubernetes.io~secret/proxy-tls:{mountpoint:/var/lib/kubelet/pods/cdb50850-779d-4179-ba1d-65ffeb4bb2e9/volumes/kubernetes.io~secret/proxy-tls major:0 minor:1082 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d8fca733-45c8-45b8-8653-ac204e7c6098/volumes/kubernetes.io~projected/kube-api-access-2ncf9:{mountpoint:/var/lib/kubelet/pods/d8fca733-45c8-45b8-8653-ac204e7c6098/volumes/kubernetes.io~projected/kube-api-access-2ncf9 major:0 minor:150 fsType:tmpfs blockSize:0} /va Dec 04 11:59:16.644141 master-0 kubenswrapper[35367]: r/lib/kubelet/pods/d8fca733-45c8-45b8-8653-ac204e7c6098/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/d8fca733-45c8-45b8-8653-ac204e7c6098/volumes/kubernetes.io~secret/metrics-certs major:0 minor:646 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e4d7939a-5961-4608-b910-73e71aa55bf6/volumes/kubernetes.io~projected/kube-api-access-d77m8:{mountpoint:/var/lib/kubelet/pods/e4d7939a-5961-4608-b910-73e71aa55bf6/volumes/kubernetes.io~projected/kube-api-access-d77m8 major:0 minor:636 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e4d7939a-5961-4608-b910-73e71aa55bf6/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/e4d7939a-5961-4608-b910-73e71aa55bf6/volumes/kubernetes.io~secret/serving-cert major:0 minor:543 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639/volumes/kubernetes.io~projected/kube-api-access-2pqsl:{mountpoint:/var/lib/kubelet/pods/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639/volumes/kubernetes.io~projected/kube-api-access-2pqsl major:0 minor:1072 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639/volumes/kubernetes.io~secret/cert major:0 minor:1071 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ee9a47b1-cdd9-43bc-8115-8851f29106e6/volumes/kubernetes.io~projected/ca-certs:{mountpoint:/var/lib/kubelet/pods/ee9a47b1-cdd9-43bc-8115-8851f29106e6/volumes/kubernetes.io~projected/ca-certs major:0 minor:659 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ee9a47b1-cdd9-43bc-8115-8851f29106e6/volumes/kubernetes.io~projected/kube-api-access-rnfmb:{mountpoint:/var/lib/kubelet/pods/ee9a47b1-cdd9-43bc-8115-8851f29106e6/volumes/kubernetes.io~projected/kube-api-access-rnfmb major:0 minor:667 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ee9a47b1-cdd9-43bc-8115-8851f29106e6/volumes/kubernetes.io~secret/catalogserver-certs:{mountpoint:/var/lib/kubelet/pods/ee9a47b1-cdd9-43bc-8115-8851f29106e6/volumes/kubernetes.io~secret/catalogserver-certs major:0 minor:658 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f797ab14-0eb5-48b4-b914-f434f67c4c49/volumes/kubernetes.io~projected/kube-api-access-zjkck:{mountpoint:/var/lib/kubelet/pods/f797ab14-0eb5-48b4-b914-f434f67c4c49/volumes/kubernetes.io~projected/kube-api-access-zjkck major:0 minor:1087 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f797ab14-0eb5-48b4-b914-f434f67c4c49/volumes/kubernetes.io~secret/cluster-storage-operator-serving-cert:{mountpoint:/var/lib/kubelet/pods/f797ab14-0eb5-48b4-b914-f434f67c4c49/volumes/kubernetes.io~secret/cluster-storage-operator-serving-cert major:0 minor:1086 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48/volumes/kubernetes.io~projected/kube-api-access-6fssw:{mountpoint:/var/lib/kubelet/pods/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48/volumes/kubernetes.io~projected/kube-api-access-6fssw major:0 minor:1113 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48/volumes/kubernetes.io~secret/cloud-controller-manager-operator-tls:{mountpoint:/var/lib/kubelet/pods/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48/volumes/kubernetes.io~secret/cloud-controller-manager-operator-tls major:0 minor:1111 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f925fe60-b5b7-4a5a-9800-3546334da725/volumes/kubernetes.io~projected/kube-api-access-2mzvm:{mountpoint:/var/lib/kubelet/pods/f925fe60-b5b7-4a5a-9800-3546334da725/volumes/kubernetes.io~projected/kube-api-access-2mzvm major:0 minor:640 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fd4c4c6f-380a-4cda-9a21-352b55ec2d98/volumes/kubernetes.io~projected/kube-api-access-rj4dt:{mountpoint:/var/lib/kubelet/pods/fd4c4c6f-380a-4cda-9a21-352b55ec2d98/volumes/kubernetes.io~projected/kube-api-access-rj4dt major:0 minor:308 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fd4c4c6f-380a-4cda-9a21-352b55ec2d98/volumes/kubernetes.io~secret/marketplace-operator-metrics:{mountpoint:/var/lib/kubelet/pods/fd4c4c6f-380a-4cda-9a21-352b55ec2d98/volumes/kubernetes.io~secret/marketplace-operator-metrics major:0 minor:644 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fd9f8671-8066-4990-b45d-8b619aa5d9ec/volumes/kubernetes.io~projected/kube-api-access-llscb:{mountpoint:/var/lib/kubelet/pods/fd9f8671-8066-4990-b45d-8b619aa5d9ec/volumes/kubernetes.io~projected/kube-api-access-llscb major:0 minor:305 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fd9f8671-8066-4990-b45d-8b619aa5d9ec/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/fd9f8671-8066-4990-b45d-8b619aa5d9ec/volumes/kubernetes.io~secret/serving-cert major:0 minor:291 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ffaf95be-586c-40fa-b15f-1beaffe7ff1c/volumes/kubernetes.io~projected/kube-api-access-t6bkg:{mountpoint:/var/lib/kubelet/pods/ffaf95be-586c-40fa-b15f-1beaffe7ff1c/volumes/kubernetes.io~projected/kube-api-access-t6bkg major:0 minor:127 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ffaf95be-586c-40fa-b15f-1beaffe7ff1c/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/ffaf95be-586c-40fa-b15f-1beaffe7ff1c/volumes/kubernetes.io~secret/metrics-tls major:0 minor:124 fsType:tmpfs blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/949d4654aa51f49ed7aeb330fad12ca73250723b6af9bf2bc443d0e7f5d052e7/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-1002:{mountpoint:/var/lib/containers/storage/overlay/3ec586f113f786099fa0f68eb3b59f20d82761529c634e597232b671bc2fa290/merged major:0 minor:1002 fsType:overlay blockSize:0} overlay_0-1003:{mountpoint:/var/lib/containers/storage/overlay/b9195b47290cec305c5794556193548b7092197dcae4b3554e1236516c49cdea/merged major:0 minor:1003 fsType:overlay blockSize:0} overlay_0-1009:{mountpoint:/var/lib/containers/storage/overlay/d4d464b7a34a74ef3082cd6483c93aa96742cd7d2975a59d75d6913207edddf2/merged major:0 minor:1009 fsType:overlay blockSize:0} overlay_0-1018:{mountpoint:/var/lib/containers/storage/overlay/2e6aa7acaf7e71870bfd407d8c2db2e5fa278eef5950aa96132b6734da67a0e2/merged major:0 minor:1018 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/627648a91deaf6bcdee236dd5ec148db606daeae2592429864b9535cbc0003eb/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-1023:{mountpoint:/var/lib/containers/storage/overlay/5f717bc712092ab55a73decd1cd903cccc9613987b065f211cba708803ac1db8/merged major:0 minor:1023 fsType:overlay blockSize:0} overlay_0-1024:{mountpoint:/var/lib/containers/storage/overlay/8aabcd991f202e637d75570f8f5056fe5cdf40765b1fb32a026120a494fb4f63/merged major:0 minor:1024 fsType:overlay blockSize:0} overlay_0-1027:{mountpoint:/var/lib/containers/storage/overlay/7d7f2b597eddaeae8983960b6192b2d513e6fbe677978325f6b575d2d2de0a64/merged major:0 minor:1027 fsType:overlay blockSize:0} overlay_0-1029:{mountpoint:/var/lib/containers/storage/overlay/087ae2c947fd80baa2ff538c65c443acc7adb3d25f3f6bbc13ec28635b125dc2/merged major:0 minor:1029 fsType:overlay blockSize:0} overlay_0-1037:{mountpoint:/var/lib/containers/storage/overlay/0705d69eeef58f587ac9e56a6b64e936b2c47c50c749e0589a61a93e1c6d678e/merged major:0 minor:1037 fsType:overlay blockSize:0} overlay_0-1039:{mountpoint:/var/lib/containers/storage/overlay/61d56147ba74dc61ad25256334d742dd956d2062b76e6f0f4e9f6814fe78e685/merged major:0 minor:1039 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/fbafc6e7ba8bb91ed1a442ceb2ad6814936452476839aadfb586e01dd404080d/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-1084:{mountpoint:/var/lib/containers/storage/overlay/8082eafcd95bb83bd4cd03d8a1423ba29dd9681c8cdc5dab37ad404f23fe60b5/merged major:0 minor:1084 fsType:overlay blockSize:0} overlay_0-1088:{mountpoint:/var/lib/containers/storage/overlay/ae8291e1c37cb098767fb7d2d346a7705fe31a7a1eb084b9b24b776c024edbd2/merged major:0 minor:1088 fsType:overlay blockSize:0} overlay_0-1090:{mountpoint:/var/lib/containers/storage/overlay/6255e130782c48f6e5694efc02ada3bf2851d55db3b250d2a565c48b85f9c7ca/merged major:0 minor:1090 fsType:overlay blockSize:0} overlay_0-1094:{mountpoint:/var/lib/containers/storage/overlay/d854ee002eea2dee0e4e1e2fc08bc5910e66a464dedcb851dd66c50605b2f69d/merged major:0 minor:1094 fsType:overlay blockSize:0} overlay_0-1105:{mountpoint:/var/lib/containers/storage/overlay/f99d561c275f57e48c3e13e25f148c48b917459137fc9a608b2d57e08974e597/merged major:0 minor:1105 fsType:overlay blockSize:0} overlay_0-112:{mountpoint:/var/lib/containers/storage/overlay/1125d5e1fd1f82ffb920911620cb2abf18da080169745a0515c91660f8bb0c37/merged major:0 minor:112 fsType:overlay blockSize:0} overlay_0-1126:{mountpoint:/var/lib/containers/storage/overlay/31ffed60f97941737a6c884345058414ad91de9b1c44810db81c0d08b99244a4/merged major:0 minor:1126 fsType:overlay blockSize:0} overlay_0-1137:{mountpoint:/var/lib/containers/storage/overlay/c55dd6917400d1af81e49d01469c1cf84006f5da2cfd33fb2b01a04c1e6c79c9/merged major:0 minor:1137 fsType:overlay blockSize:0} overlay_0-1144:{mountpoint:/var/lib/containers/storage/overlay/0924a1c4c09da8991913b1fd64607a226ea0e8cef1424c9c8e842f3fd297941a/merged major:0 minor:1144 fsType:overlay blockSize:0} overlay_0-1145:{mountpoint:/var/lib/containers/storage/overlay/663e3a205e63263f21d2353872b93b9a34ffd3042b8fd1b2b5c7620383e69455/merged major:0 minor:1145 fsType:overlay blockSize:0} overlay_0-115:{mountpoint:/var/lib/containers/storage/overlay/08e40e1ec9187264f8940c54233aeffac157f5b5e3728893695c989ee4bf433f/merged major:0 minor:115 fsType:overlay blockSize:0} overlay_0-1160:{mountpoint:/var/lib/containers/storage/overlay/73df5963ec2e98f353c83b96b699a4eb210d520425f894a000b597245f90bfaf/merged major:0 minor:1160 fsType:overlay blockSize:0} overlay_0-1168:{mountpoint:/var/lib/containers/storage/overlay/7e984e6707a30d39df9136b8eb8612c4557e11c1641bd7843880d4d8c47a6c7c/merged major:0 minor:1168 fsType:overlay blockSize:0} overlay_0-1170:{mountpoint:/var/lib/containers/storage/overlay/1510fdbf8d918f579a18f78cd5d42aeac3ddcdf5d610f144530f6b7ac9f524f8/merged major:0 minor:1170 fsType:overlay blockSize:0} overlay_0-118:{mountpoint:/var/lib/containers/storage/overlay/4e42cbd8c344c83b9c92f9e58f8a90aaae1c76aff10a28ab49c61e5f120e6aa8/merged major:0 minor:118 fsType:overlay blockSize:0} overlay_0-1182:{mountpoint:/var/lib/containers/storage/overlay/79ea95d93fc73e9a17f7c6f54f4f7d6bc12a2eb9e6d8f985ccbcf3055f76ecb5/merged major:0 minor:1182 fsType:overlay blockSize:0} overlay_0-1185:{mountpoint:/var/lib/containers/storage/overlay/b2fb4d6a6524bbaa16118bc38db7548e5e6b8784f6ae1dcdf413ea0caa411e6b/merged major:0 minor:1185 fsType:overlay blockSize:0} overlay_0-1199:{mountpoint:/var/lib/containers/storage/overlay/03718868f183c247f26cf79b7cd89c7ac8d7068527d77cb344d810f20f3c83ab/merged major:0 minor:1199 fsType:overlay blockSize:0} overlay_0-120:{mountpoint:/var/lib/containers/storage/overlay/c602ad66546d3d8165509b41d1b9a16d28eaec5af26feb1b71ad2daff6258282/merged major:0 minor:120 fsType:overlay blockSize:0} overlay_0-1217:{mountpoint:/var/lib/containers/storage/overlay/60c5bc96c8383df5f448a5a29a408ab4a2b82b8ac52951740286fb6de223096c/merged major:0 minor:1217 fsType:overlay blockSize:0} overlay_0-1221:{mountpoint:/var/lib/containers/storage/overlay/8cc6f7f3f6b5f6034f2553b9d948d644f56e2ef7a0e7db1e2ca01eb6d9d1fec7/merged major:0 minor:1221 fsType:overlay blockSize:0} overlay_0-1231:{mountpoint:/var/lib/containers/storage/overlay/4ba1444858ff13d7a2a26d9a6c027cdb2a16a4b481d9aab68c4193635cb04f74/merged major:0 minor:1231 fsType:overlay blockSize:0} overlay_0-1248:{mountpoint:/var/lib/containers/storage/overlay/8f522528fe5f5291634d015e8f8f7f2815552d1145c379cafaf02c3e1796f784/merged major:0 minor:1248 fsType:overlay blockSize:0} overlay_0-1252:{mountpoint:/var/lib/containers/storage/overlay/71540540d7b1a49f621401f1ed45b0448ef376fde7a98d0745f50986b5bf3201/merged major:0 minor:1252 fsType:overlay blockSize:0} overlay_0-1254:{mountpoint:/var/lib/containers/storage/overlay/bd3f17f9b75abe69fc992095a44efd07078368e99e9ff43f30a594bb912ce54f/merged major:0 minor:1254 fsType:overlay blockSize:0} overlay_0-1256:{mountpoint:/var/lib/containers/storage/overlay/8c9da69fd43905873a163a3897470fe2f1ecac2e6e3b952a103900a81003bf16/merged major:0 minor:1256 fsType:overlay blockSize:0} overlay_0-1258:{mountpoint:/var/lib/containers/storage/overlay/fb3be37291701e1ccd65d70f17f28e488fcc4a48ec712ae67693f90ffb71e293/merged major:0 minor:1258 fsType:overlay blockSize:0} overlay_0-1260:{mountpoint:/var/lib/containers/storage/overlay/7e25464b094efc0a155cfeeb26e0afe61a25e01349e1c0aeda054bf4fecc344c/merged major:0 minor:1260 fsType:overlay blockSize:0} overlay_0-1262:{mountpoint:/var/lib/containers/storage/overlay/451cc77cbb1ef785ea0e76b6d7831320b615ce4cfda3225dd1e0d2942c62763f/merged major:0 minor:1262 fsType:overlay blockSize:0} overlay_0-1269:{mountpoint:/var/lib/containers/storage/overlay/c8112378c724783fd8f6b956bbd5295a9cc0b44019efb913de8ffc23f91cdd73/merged major:0 minor:1269 fsType:overlay blockSize:0} overlay_0-1274:{mountpoint:/var/lib/containers/storage/overlay/94e5ee27af537828d0e2567e9313092865aa07cf7742b4386408b3e69bdaa90e/merged major:0 minor:1274 fsType:overlay blockSize:0} overlay_0-1280:{mountpoint:/var/lib/containers/storage/overlay/530968d1d0f2166f6fa73789b05f1f9b6d6c86aa108dcf57bf42f7590f83d882/merged major:0 minor:1280 fsType:overlay blockSize:0} overlay_0-130:{mountpoint:/var/lib/containers/storage/overlay/87b6749669c1952dd271f9eb514332e2d1545dbafbfaa711f2be94eeaa29a1e2/merged major:0 minor:130 fsType:overlay blockSize:0} overlay_0-1309:{mountpoint:/var/lib/containers/storage/overlay/51a3daf1e7737fb965058b91f3cf25da5697c4881149a6e59820c08faaefa18a/merged major:0 minor:1309 fsType:overlay blockSize:0} overlay_0-1318:{mountpoint:/var/lib/containers/storage/overlay/b4b20bbf2f23dd5d78d5b44adc7afb105353aacf644a52c22f2582331dfc1599/merged major:0 minor:1318 fsType:overlay blockSize:0} overlay_0-1320:{mountpoint:/var/lib/containers/storage/overlay/beba6a64df7e61c5f648c1ac47ef8a27a4441788830225f38eb9fb91f5c601b0/merged major:0 minor:1320 fsType:overlay blockSize:0} overlay_0-1322:{mountpoint:/var/lib/containers/storage/overlay/6f097377d82f8fdf16897b7eabf6d82ef23a37e82e48b61b6652a8170ead84dc/merged major:0 minor:1322 fsType:overlay blockSize:0} overlay_0-1324:{mountpoint:/var/lib/containers/storage/overlay/03391841d187ab2a44b6372d416cd67788fc0e8126cf9a2681cf6425245e1dbd/merged major:0 minor:1324 fsType:overlay blockSize:0} overlay_0-1329:{mountpoint:/var/lib/containers/storage/overlay/4c3211a8594981e80001599cc58848b5d2ca2280ef0e52ddb37c3fb3064cd6c6/merged major:0 minor:1329 fsType:overlay blockSize:0} overlay_0-1331:{mountpoint:/var/lib/containers/storage/overlay/eadf781761b9a34c5a165b2852ff966b2dce4ec79884fee79414846cb1739845/merged major:0 minor:1331 fsType:overlay blockSize:0} overlay_0-1333:{mountpoint:/var/lib/containers/storage/overlay/4c1de1af978640b923a4c80e85bc91b412f207b678333868af4c0e11f08c1045/merged major:0 minor:1333 fsType:overlay blockSize:0} overlay_0-1336:{mountpoint:/var/lib/containers/storage/overlay/13db68ea9e9b9593c8b192954b94cb45ee5440a16b9c396b745a2e5b4af2e7ce/merged major:0 minor:1336 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/2d0dc08a43bb32025b0061ee29076466f9daa20e069d14c0b5fd7502b10657c4/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-1354:{mountpoint:/var/lib/containers/storage/overlay/f73c5297334845dc1b1ab7d13d9ac8c14b6d646e253d5b4fa057c97c09e6547a/merged major:0 minor:1354 fsType:overlay blockSize:0} overlay_0-1360:{mountpoint:/var/lib/containers/storage/overlay/35cc561b072cddcaa928e0423322a7bb383675457145ad1acfcf9813f2032f0b/merged major:0 minor:1360 fsType:overlay blockSize:0} overlay_0-1372:{mountpoint:/var/lib/containers/storage/overlay/3f3bb7138b6621557c05a7d911df86048d53027e10d4eb78c997e005561e1f81/merged major:0 minor:1372 fsType:overlay blockSize:0} overlay_0-1377:{mountpoint:/var/lib/containers/storage/overlay/c3d4baffb7aedd40e558b2904ce6f6be1f19d3202176ff101321c4da1679b8b5/merged major:0 minor:1377 fsType:overlay blockSize:0} overlay_0-1378:{mountpoint:/var/lib/containers/storage/overlay/203ebe277401b36ed57189ab83428bcb165fc954e7cdf4b673a6593ee51afa8b/merged major:0 minor:1378 fsType:overlay blockSize:0} overlay_0-138:{mountpoint:/var/lib/containers/storage/overlay/dd49bc570e318bd3d399a7a7dd223d65ba881301e05199594ca6c8f84c5b75e3/merged major:0 minor:138 fsType:overlay blockSize:0} overlay_0-1384:{mountpoint:/var/lib/containers/storage/overlay/8cfbb7bc417a732c299e3aefaaf6006c74c9b9908754661e07eef2abb602208a/merged major:0 minor:1384 fsType:overlay blockSize:0} overlay_0-1385:{mountpoint:/var/lib/containers/storage/overlay/202653dc84b4e67b6b3bd7e31d1904df4545765ea045a56c00960e642e9a0c35/merged major:0 minor:1385 fsType:overlay blockSize:0} overlay_0-1386:{mountpoint:/var/lib/containers/storage/overlay/4b36c483ba2545f6c1fb3e2b2d03b42bed644feea2a971361d897a4e60d84c06/merged major:0 minor:1386 fsType:overlay blockSize:0} overlay_0-1389:{mountpoint:/var/lib/containers/storage/overlay/32a97ded94814a0f4c658774e4660e359e51de50734532a6f686e31af4e19554/merged major:0 minor:1389 fsType:overlay blockSize:0} overlay_0-140:{mountpoint:/var/lib/containers/storage/overlay/06aa2b63c9983d874fa2faab3aa7abc88232f0cc7aade5d3a55b6b5e3e3aa438/merged major:0 minor:140 fsType:overlay blockSize:0} overlay_0-1400:{mountpoint:/var/lib/containers/storage/overlay/35e8c376c38860eb8b295c0bc9a4c7d1c896dad42d036825286fe71c733bcfe8/merged major:0 minor:1400 fsType:overlay blockSize:0} overlay_0-1402:{mountpoint:/var/lib/containers/storage/overlay/50ef62ae314afbf94f3802ee3b5c1745b2fbb1a41d60b618333d3ccfcab86526/merged major:0 minor:1402 fsType:overlay blockSize:0} overlay_0-1417:{mountpoint:/var/lib/containers/storage/overlay/4b25a047d05ae4114e5548c74c74bb729e45e5b9cd26a064a69108036853b46a/merged major:0 minor:1417 fsType:overlay blockSize:0} overlay_0-1426:{mountpoint:/var/lib/containers/storage/overlay/eff721008afe08c78800678953c777df947dce1e167f1a864e0c39e10fff7143/merged major:0 minor:1426 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/68a0f26a80cf1a155a104e07900bad11008c3b260b660d9f9269655714ba3bc7/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-149:{mountpoint:/var/lib/containers/storage/overlay/8d7c5ea1af347f955f42d83bc23d1c93daa74faf40831b43f3cd00bccadf1dd5/merged major:0 minor:149 fsType:overlay blockSize:0} overlay_0-151:{mountpoint:/var/lib/containers/storage/overlay/b6e0fe376520506d7f3bbb0e7cd53f35973112bc7ec7f4b9563c39ddfec493f6/merged major:0 minor:151 fsType:overlay blockSize:0} overlay_0-154:{mountpoint:/var/lib/containers/storage/overlay/a8355b6c4ff90fd82cb236214fd8afb1a6857eb26488a17362a494dbcd9d474b/merged major:0 minor:154 fsType:overlay blockSize:0} overlay_0-163:{mountpoint:/var/lib/containers/storage/overlay/d18584c7896077384ca17519f407ff36ca131167dea88d142e19f672e7cc7e2a/merged major:0 minor:163 fsType:overlay blockSize:0} overlay_0-166:{mountpoint:/var/lib/containers/storage/overlay/cb35f0e0fd339b9d745ff19c886654a14cec5ef606ac434da077b60dff6ce383/merged major:0 minor:166 fsType:overlay blockSize:0} overlay_0-168:{mountpoint:/var/lib/containers/storage/overlay/af571619b30f7a85a5d48725f3cab6fc666e21fd4e601d25af17ccd979fdfc44/merged major:0 minor:168 fsType:overlay blockSize:0} overlay_0-170:{mountpoint:/var/lib/containers/storage/overlay/713e6e51904a92457fa7811693aeabcd9bcbb2b1c9c397abfc8bfaed62505447/merged major:0 minor:170 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/bb655df9a945a6cebde4ed6c17944f55fae789812c9ae552367004aab98b5330/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-183:{mountpoint:/var/lib/containers/storage/overlay/376f8ccf39959b706a8b18b5ffc909220fe318cc3cf20cebae2a33079d4cfabf/merged major:0 minor:183 fsType:overlay blockSize:0} overlay_0-186:{mountpoint:/var/lib/containers/storage/overlay/75612eb2ae55a16fbac12aaf2fc12a3dece9873fabe84b17fdd548bc5af0f413/merged major:0 minor:186 fsType:overlay blockSize:0} overlay_0-190:{mountpoint:/var/lib/containers/storage/overlay/68b0f8d7cd88babfc4f5211a8b1a479d02ee43ff682909ab842c3bd495917060/merged major:0 minor:190 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/f07d7f464e24c1b4a66a60953d3dcd8593214b86bf0b5a2f5f432929afb85a41/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-197:{mountpoint:/var/lib/containers/storage/overlay/a78ebbe16e36278b072e58be3938515a12adfbf9d237b72f69f316cf24c3ce71/merged major:0 minor:197 fsType:overlay blockSize:0} overlay_0-199:{mountpoint:/var/lib/containers/storage/overlay/4b9fa727362b942b2a13e0dd160c8881bba2c5f006288a156bfae80c5d295343/merged major:0 minor:199 fsType:overlay blockSize:0} overlay_0-203:{mountpoint:/var/lib/containers/storage/overlay/f430abc3f0137d8c5f71dc99cbedd8a2be8fde458b0b5cd8c9368ab73ccbd5b1/merged major:0 minor:203 fsType:overlay blockSize:0} overlay_0-205:{mountpoint:/var/lib/containers/storage/overlay/a1264d01c87fa7b7fed62397a3f6f1b34788507e3798fe0e5016556b8bf883bc/merged major:0 minor:205 fsType:overlay blockSize:0} overlay_0-207:{mountpoint:/var/lib/containers/storage/overlay/1f96e4e9883da5bf4c60cdd8bd43ba0946ea079261f6aa112000beef7c0f138e/merged major:0 minor:207 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/52661ba716f5e90cf00f2e4d0561b04fd7dd5ffb83e35caef549d32571db5fd4/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/d4ad7524c6be8f6b0bacafdfccecd10452df86eb32dcc10b20971e020a1376ef/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-221:{mountpoint:/var/lib/containers/storage/overlay/e0ca48f4841c44751320b6d2c9eed59eddb8f7378f83d5b3e1d59b647d41d1a8/merged major:0 minor:221 fsType:overlay blockSize:0} overlay_0-223:{mountpoint:/var/lib/containers/storage/overlay/6b0b8b5c7e3e6120e57b44cc905c6d79b95480e7385c76317c6fde97cf1d9c52/merged major:0 minor:223 fsType:overlay blockSize:0} overlay_0-228:{mountpoint:/var/lib/containers/storage/overlay/6497b09f2c1e50abd4afc1061a62c7d1625c59fb5e5b6fe61caf23bda8a62767/merged major:0 minor:228 fsType:overlay blockSize:0} overlay_0-236:{mountpoint:/var/lib/containers/storage/overlay/f5a4f16c5d3401e320fc0762986356129dd35b749584185a873373c3a9a0179b/merged major:0 minor:236 fsType:overlay blockSize:0} overlay_0-244:{mountpoint:/var/lib/containers/storage/overlay/6b53f21630ac0e4187f70f8eda4eca4fce5e0883c77be80442c96b8f8e9ecb2a/merged major:0 minor:244 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/733a61054c9dcae266ecfd333724b99773cd62de3b3d9a3b74276ed89b1e9b87/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/4162baef2a6af0b5520b5777d89115ceefa9c3e7b8aa643b68c09a415818297d/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/430a13f3b358cf15eaf22b1eb8ce308e64c548779462a981cb27ec23373c692e/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-273:{mountpoint:/var/lib/containers/storage/overlay/281aea3861e8dc7c5eb56aad94971baa6a987484c81fb30b4a89a6e499ef8ec8/merged major:0 minor:273 fsType:overlay blockSize:0} overlay_0-281:{mountpoint:/var/lib/containers/storage/overlay/5e564d4fb56bbffe62e4f758cb9f135bf08c410d8da96518c0c001b06ab49ddb/merged major:0 minor:281 fsType:overlay blockSize:0} overlay_0-351:{mountpoint:/var/lib/containers/storage/overlay/a3c0419a6693553babda8f7a1f05307818a14d1f8ba78ebdf2cbf50a9687f0e6/merged major:0 minor:351 fsType:overlay blockSize:0} overlay_0-353:{mountpoint:/var/lib/containers/storage/overlay/578da8593720dcb87588e10c5f96d79559e77f27341ee3747d7fb6ae309c0d62/merged major:0 minor:353 fsType:overlay blockSize:0} overlay_0-355:{mountpoint:/var/lib/containers/storage/overlay/c18aaf89e4f262aa5d1436836967bc60720ee3661187d12477f1fba54e71f9ac/merged major:0 minor:355 fsType:overlay blockSize:0} overlay_0-357:{mountpoint:/var/lib/containers/storage/overlay/32db868f5abf4e053fa3a2cd0844056b24a6ab037d74af229c8fd45609e4136d/merged major:0 minor:357 fsType:overlay blockSize:0} overlay_0-359:{mountpoint:/var/lib/containers/storage/overlay/3419d54820709407c6d5ac339b6331b27b0a0676ebd157684f4ef9bd3831c293/merged major:0 minor:359 fsType:overlay blockSize:0} overlay_0-361:{mountpoint:/var/lib/containers/storage/overlay/32dfd864702b981e7d8c8542c1ff24b01c843d5078dfb0744c3328134d33f154/merged major:0 minor:361 fsType:overlay blockSize:0} overlay_0-363:{mountpoint:/var/lib/containers/storage/overlay/08b7d03388d6e8c0d9f6567ee4cad61acbccd92e72bfb2071d585f2216413c33/merged major:0 minor:363 fsType:overlay blockSize:0} overlay_0-365:{mountpoint:/var/lib/containers/storage/overlay/918edd02a61866a930ee42839a5d128d5ea34a6c263f505cce01b95c162697f9/merged major:0 minor:365 fsType:overlay blockSize:0} overlay_0-367:{mountpoint:/var/lib/containers/storage/overlay/038caab34a67d3e3af7c623df04ad3b6feba3e3ca8b51055bd02c5270390a8ca/merged major:0 minor:367 fsType:overlay blockSize:0} overlay_0-369:{mountpoint:/var/lib/containers/storage/overlay/0e4499f02678be1dd7ff7a85a011395f5019bdd2d63f206da05e555ccac78c51/merged major:0 minor:369 fsType:overlay blockSize:0} overlay_0-371:{mountpoint:/var/lib/containers/storage/overlay/ee574fa103eb8d84949a4f4f5744d8197da4b9408af900c7d6eb1dec3fb57d09/merged major:0 minor:371 fsType:overlay blockSize:0} overlay_0-373:{mountpoint:/var/lib/containers/storage/overlay/8d43da7be802e713fd7048776309e1fff2cb94b1554f9a5275c12400eb06eaaf/merged major:0 minor:373 fsType:overlay blockSize:0} overlay_0-375:{mountpoint:/var/lib/containers/storage/overlay/fbe66fc443d5da17aa6a2bd36e0bdf4d5406ec8e08abe195a12cfaa7d19acf27/merged major:0 minor:375 fsType:overlay blockSize:0} overlay_0-377:{mountpoint:/var/lib/containers/storage/overlay/9bd6cf083e10cf7bcb2e14782154fbac249b574e219d4b2993179a89ba83c327/merged major:0 minor:377 fsType:overlay blockSize:0} overlay_0-381:{mountpoint:/var/lib/containers/storage/overlay/672733c7fc087e0aeb059a2026c92c0a1b61fc8b223d3afb43660af5929f7023/merged major:0 minor:381 fsType:overlay blockSize:0} overlay_0-383:{mountpoint:/var/lib/containers/storage/overlay/06b3e315e47f69c28f4793dd1a08f0773a1cd8a6e2cd2d3bd4a43fb39d5ba367/merged major:0 minor:383 fsType:overlay blockSize:0} overlay_0-385:{mountpoint:/var/lib/containers/storage/overlay/034e84d7f69259f75b694e5aa45f2529b1848679f57ed893032b7c23273f1abe/merged major:0 minor:385 fsType:overlay blockSize:0} overlay_0-386:{mountpoint:/var/lib/containers/storage/overlay/dc7ca0b40872627c8b192286834815acdb11b2d1aea592ef45e534ee20617c28/merged major:0 minor:386 fsType:overlay blockSize:0} overlay_0-388:{mountpoint:/var/lib/containers/storage/overlay/76f6c04862bf66a7a185c758d4606beaec873df7512ab4809b41882e6e7437ca/merged major:0 minor:388 fsType:overlay blockSize:0} overlay_0-390:{mountpoint:/var/lib/containers/storage/overlay/bf3696557459aec2ccf7384e34232e90709d3365ea321cd48a8b47135bc94daf/merged major:0 minor:390 fsType:overlay blockSize:0} overlay_0-392:{mountpoint:/var/lib/containers/storage/overlay/b5a6bc8baa869ffda5d0f628b6b7a3e278b9fc5b7b81c5dcf1e880af817156c5/merged major:0 minor:392 fsType:overlay blockSize:0} overlay_0-393:{mountpoint:/var/lib/containers/storage/overlay/aa37356f0b01d0cea10bb616dc05c80874fcf0623636256099b12fa45580bf3e/merged major:0 minor:393 fsType:overlay blockSize:0} overlay_0-407:{mountpoint:/var/lib/containers/storage/overlay/6fde15b875ee8d9205d9de12bf8d00de5f4bdf9133d958b78239a5f494bbc8ac/merged major:0 minor:407 fsType:overlay blockSize:0} overlay_0-411:{mountpoint:/var/lib/containers/storage/overlay/31971040390a2400277715ba59aa92e7c059d0c5ec31d4545f6d9c90c0fa0955/merged major:0 minor:411 fsType:overlay blockSize:0} overlay_0-413:{mountpoint:/var/lib/containers/storage/overlay/6d0087406b99bb24c9260f41d328480e578feba5ee43bf5ad573c4a6c1e1462a/merged major:0 minor:413 fsType:overlay blockSize:0} overlay_0-419:{mountpoint:/var/lib/containers/storage/overlay/b7a8ddac1344960b9a903dec747d97afd96409bb1a32576d17eb1351c52d29e0/merged major:0 minor:419 fsType:overlay blockSize:0} overlay_0-424:{mountpoint:/var/lib/containers/storage/overlay/18ba106543532559c26c6768a92084dda960a2c6b24bbda966ee9465fde8e14d/merged major:0 minor:424 fsType:overlay blockSize:0} overlay_0-425:{mountpoint:/var/lib/containers/storage/overlay/63a954e1169475fbb077c0572f6f905fc2c4255313d97794da69f4c5b9b982b3/merged major:0 minor:425 fsType:overlay blockSize:0} overlay_0-427:{mountpoint:/var/lib/containers/storage/overlay/15d02e96137ba947b6c35a394a6d23fbe3c4bd403fdcd36edc868dc0b5312218/merged major:0 minor:427 fsType:overlay blockSize:0} overlay_0-43:{mountpoint:/var/lib/containers/storage/overlay/a272af30b862cfca9a161b4eb00b80feca9f0acd8d141941f8213a56c90ba8fc/merged major:0 minor:43 fsType:overlay blockSize:0} overlay_0-430:{mountpoint:/var/lib/containers/storage/overlay/f99b8f1b544d29a6b27f4b2767aa3301662c23ec912eb324f998e391f42d0bf9/merged major:0 minor:430 fsType:overlay blockSize:0} overlay_0-431:{mountpoint:/var/lib/containers/storage/overlay/c87a06890ce1f9e742a61737d76cebc7649c90678e9e560e84d7b608e9660980/merged major:0 minor:431 fsType:overlay blockSize:0} overlay_0-434:{mountpoint:/var/lib/containers/storage/overlay/2927932d28ad840c0f61ba4661569cc842eed53c9fbc3832b531a837bfed2341/merged major:0 minor:434 fsType:overlay blockSize:0} overlay_0-436:{mountpoint:/var/lib/containers/storage/overlay/ceb15e90a615d7b04e299df0011292b40cd86c68033a3712a4bd6ec6ecbe38ce/merged major:0 minor:436 fsType:overlay blockSize:0} overlay_0-439:{mountpoint:/var/lib/containers/storage/overlay/8dd3b3bca8207e319f823b7423ae726e091bcc9bac85658652bf772370b17994/merged major:0 minor:439 fsType:overlay blockSize:0} overlay_0-440:{mountpoint:/var/lib/containers/storage/overlay/df614b119d5e6f54e35e781e8657f3de013ccb80d8e476affe838ec33842e978/merged major:0 minor:440 fsType:overlay blockSize:0} overlay_0-442:{mountpoint:/var/lib/containers/storage/overlay/28ff8669658b0b4b573ae05de89b1b9306fcc7aa4a0cb6f45e4e76b9d7d20b34/merged major:0 minor:442 fsType:overlay blockSize:0} overlay_0-449:{mountpoint:/var/lib/containers/storage/overlay/4f03224731d65c4dc40c5b9e6f421242dbf9640bd9e9ba28849bba03959356d3/merged major:0 minor:449 fsType:overlay blockSize:0} overlay_0-451:{mountpoint:/var/lib/containers/storage/overlay/ee2d1a78c4b13578dd22cc7e8ece4faf58de8cc7d5f31cdc170dafbf8a22908a/merged major:0 minor:451 fsType:overlay blockSize:0} overlay_0-458:{mountpoint:/var/lib/containers/storage/overlay/d380e0d2b67775d9afb6636154344b750ccdc51acf01ae7d63fc591d7a1dab00/merged major:0 minor:458 fsType:overlay blockSize:0} overlay_0-469:{mountpoint:/var/lib/containers/storage/overlay/1c9db440c5a105524521828eaa2f2025668a2cab234e1de6e747629a7a361904/merged major:0 minor:469 fsType:overlay blockSize:0} overlay_0-48:{mountpoint:/var/lib/containers/storage/overlay/36d391bd085551aa6c3f317c8f71b5f5c89b5ed4010e20ea13d29fcf1135bf1a/merged major:0 minor:48 fsType:overlay blockSize:0} overlay_0-480:{mountpoint:/var/lib/containers/storage/overlay/a34dc314d1adefdf89b99a52d0acb9c90abf3bfbbd23296bd341127ad8709fed/merged major:0 minor:480 fsType:overlay blockSize:0} overlay_0-482:{mountpoint:/var/lib/containers/storage/overlay/373f592f865280b848313f90c92a73afb51e3b4a9d1ad81a91da4e476d0ec161/merged major:0 minor:482 fsType:overlay blockSize:0} overlay_0-488:{mountpoint:/var/lib/containers/storage/overlay/34a5e24196fdb0ff984e9afe12a289df190e9418cd1b447b580e890ccf7cc936/merged major:0 minor:488 fsType:overlay blockSize:0} overlay_0-490:{mountpoint:/var/lib/containers/storage/overlay/06e957bf0b9d7e6e1060ea1d6abd7b70ac225a30365575925fd874ffc1ba1bfe/merged major:0 minor:490 fsType:overlay blockSize:0} overlay_0-499:{mountpoint:/var/lib/containers/storage/overlay/f427468e0d7f2535e3c0b9796ffc4fdd212f6403987363e47724b844d4f64220/merged major:0 minor:499 fsType:overlay blockSize:0} overlay_0-50:{mountpoint:/var/lib/containers/storage/overlay/8d644baf863cf983891b0ab5c8c0fd6f2992822d4a6df80c76dd549d501d04a8/merged major:0 minor:50 fsType:overlay blockSize:0} overlay_0-503:{mountpoint:/var/lib/containers/storage/overlay/a90663d8cb22f62766704d6b32b0d1acca3e717916d74e12d2f11091d672d36b/merged major:0 minor:503 fsType:overlay blockSize:0} overlay_0-505:{mountpoint:/var/lib/containers/storage/overlay/f91122b6a6f5fdfe0479ea0356b319cf7d7a91e2961a559a10b66daa247e7c88/merged major:0 minor:505 fsType:overlay blockSize:0} overlay_0-507:{mountpoint:/var/lib/containers/storage/overlay/9250308c86d4fc8e82d44b8cce9ab148b26afe519887169d02567520aac931f9/merged major:0 minor:507 fsType:overlay blockSize:0} overlay_0-511:{mountpoint:/var/lib/containers/storage/overlay/f2088a45e1caf9789a8f9e66d403e8e51b2f49d7d2c165534d769474cf89754b/merged major:0 minor:511 fsType:overlay blockSize:0} overlay_0-514:{mountpoint:/var/lib/containers/storage/overlay/4410b80c9edaac0f49cde9136972fbed7eed717d1eb648d3ba4f561e2ad0e25c/merged major:0 minor:514 fsType:overlay blockSize:0} overlay_0-523:{mountpoint:/var/lib/containers/storage/overlay/080dc5361c280c095cde01dd39519c664253ab201d9f554d6b6d88e87d180f46/merged major:0 minor:523 fsType:overlay blockSize:0} overlay_0-544:{mountpoint:/var/lib/containers/storage/overlay/7374cab3ba53df340cb1c88d91d2d85150ae053b8485fcb35b8d30b879d5c1fe/merged major:0 minor:544 fsType:overlay blockSize:0} overlay_0-546:{mountpoint:/var/lib/containers/storage/overlay/2728ef4cf0309f0a125235d5b6d161001f79f944e3ebff1e94ba9686d8f39c8f/merged major:0 minor:546 fsType:overlay blockSize:0} overlay_0-547:{mountpoint:/var/lib/containers/storage/overlay/3bd750fbc63a82718ac5344b0e4198e3e2b7b0a35ce0efc37c133dceb11ec6ad/merged major:0 minor:547 fsType:overlay blockSize:0} overlay_0-556:{mountpoint:/var/lib/containers/storage/overlay/c2fe451a85bc461b61d79ac4435ea9c390c18582d2fd8f674119f4010406f096/merged major:0 minor:556 fsType:overlay blockSize:0} overlay_0-56:{mountpoint:/var/lib/containers/storage/overlay/c28907486d9e6f59fa06733c0290be8fa1460181e4146300a27d2cac51971cf4/merged major:0 minor:56 fsType:overlay blockSize:0} overlay_0-566:{mountpoint:/var/lib/containers/storage/overlay/64ee989e6a58f59ad044568a3566dcf61f742a946a8ad06dd6f45f6d280935e7/merged major:0 minor:566 fsType:overlay blockSize:0} overlay_0-568:{mountpoint:/var/lib/containers/storage/overlay/8ad44eb35f55bee54752e7937f3b6c4c000d9d10474ccdc61ca81cc0ccc82180/merged major:0 minor:568 fsType:overlay blockSize:0} overlay_0-572:{mountpoint:/var/lib/containers/storage/overlay/77357487bca51a97ff153db8f269b57f1f86f38cf93dcdb4c03237f951e40355/merged major:0 minor:572 fsType:overlay blockSize:0} overlay_0-575:{mountpoint:/var/lib/containers/storage/overlay/46bbbc8c2e051d5edde98f4963b4ea61ed780d1532f39b16dcbdb8ad716a14da/merged major:0 minor:575 fsType:overlay blockSize:0} overlay_0-587:{mountpoint:/var/lib/containers/storage/overlay/19047dd18ef8e49959fee16f2abe2353a1077aaea114472abdc2c89a8892836d/merged major:0 minor:587 fsType:overlay blockSize:0} overlay_0-59:{mountpoint:/var/lib/containers/storage/overlay/775d4d50505b149f528eccd56cc41beb11e9dbe0b5c350bc7d9ead566ef801b9/merged major:0 minor:59 fsType:overlay blockSize:0} overlay_0-594:{mountpoint:/var/lib/containers/storage/overlay/c92cce39672e92f575526c48dd6d6d1ae55057d4384eba772eaa01b33259586d/merged major:0 minor:594 fsType:overlay blockSize:0} overlay_0-596:{mountpoint:/var/lib/containers/storage/overlay/38e1ed6a7b4d4b7bc7f54c078d90595c8d25b4851b84769ff3cca87ec35e697d/merged major:0 minor:596 fsType:overlay blockSize:0} overlay_0-604:{mountpoint:/var/lib/containers/storage/overlay/b7b386ad3ade57aa895685bebc4b66ef5aac75afc11685653cd8ff3ae7eefa02/merged major:0 minor:604 fsType:overlay blockSize:0} overlay_0-606:{mountpoint:/var/lib/containers/storage/overlay/5bfa73bc6aea5d76d5f31055a969bb1f69214950b57111f948d551b2825974a5/merged major:0 minor:606 fsType:overlay blockSize:0} overlay_0-61:{mountpoint:/var/lib/containers/storage/overlay/ae19020c15efbcdb734a82f205ece230179caf1d3dad1a86101a2da2cedb2a76/merged major:0 minor:61 fsType:overlay blockSize:0} overlay_0-62:{mountpoint:/var/lib/containers/storage/overlay/74b4de9fa3281f0d51cf3730835f3892a5e68ce54e5a92ac53ce5414acf45865/merged major:0 minor:62 fsType:overlay blockSize:0} overlay_0-620:{mountpoint:/var/lib/containers/storage/overlay/c7f4ff5613e6b1e3c57c275b2e4a0d118d74b48e8c1e17040222683d459fe3ce/merged major:0 minor:620 fsType:overlay blockSize:0} overlay_0-622:{mountpoint:/var/lib/containers/storage/overlay/3fde376b79cc5bd93ef2b296365e7971720ee7b16b8a98a2bb26bedd4732c6fe/merged major:0 minor:622 fsType:overlay blockSize:0} overlay_0-624:{mountpoint:/var/lib/containers/storage/overlay/ee9dbd99f903e31f615c3c3f2c175c89185aecc1bb0181ca0f33e646af04c55c/merged major:0 minor:624 fsType:overlay blockSize:0} overlay_0-627:{mountpoint:/var/lib/containers/storage/overlay/2ee815348db31bcee4b1e4361298c1ba7ba988f37b06afc520af083fa86ca82f/merged major:0 minor:627 fsType:overlay blockSize:0} overlay_0-632:{mountpoint:/var/lib/containers/storage/overlay/fc7bfd1144ca1fb77d0f98a3d9e1caf7eaec39f9d262acdb7ec0ac043c08b259/merged major:0 minor:632 fsType:overlay blockSize:0} overlay_0-634:{mountpoint:/var/lib/containers/storage/overlay/edf1fa2df3ef888f0eb2f860212a2633f88310b4a362729ff49a362911af65f5/merged major:0 minor:634 fsType:overlay blockSize:0} overlay_0-637:{mountpoint:/var/lib/containers/storage/overlay/eae128fac52b6f6a38e51e30094ffc78da3b717df2b52565216bf21ca49294d5/merged major:0 minor:637 fsType:overlay blockSize:0} overlay_0-65:{mountpoint:/var/lib/containers/storage/overlay/1c6f8f3f24030818a09a38cea3ddeb3eecc087ae055cdb3caed1d690eefe04e4/merged major:0 minor:65 fsType:overlay blockSize:0} overlay_0-652:{mountpoint:/var/lib/containers/storage/overlay/bdef34fd1c56c38dc38943bc992631a9d3e524a8f35cbfb79e244f062db485c6/merged major:0 minor:652 fsType:overlay blockSize:0} overlay_0-657:{mountpoint:/var/lib/containers/storage/overlay/a162fb87ebb0a200de40307d809f1cb3a1d214b8b6f2e7dcf224442b6b1e974e/merged major:0 minor:657 fsType:overlay blockSize:0} overlay_0-66:{mountpoint:/var/lib/containers/storage/overlay/b9bd36403ee3a611d27babedd0d030dabca54837160449de7d4fc7f07e086b19/merged major:0 minor:66 fsType:overlay blockSize:0} overlay_0-678:{mountpoint:/var/lib/containers/storage/overlay/fdb04bf8456ef3d38ddec7aabc5cd5ff48a3c69620157ce5f693252484b5ab48/merged major:0 minor:678 fsType:overlay blockSize:0} overlay_0-68:{mountpoint:/var/lib/containers/storage/overlay/d2697fc2b1e3215b8075194629801c4c0a543c0836af10c5eebcf1fba5f80a63/merged major:0 minor:68 fsType:overlay blockSize:0} overlay_0-681:{mountpoint:/var/lib/containers/storage/overlay/3c6da81a21ff1d41d6ce48b33dca7a54c0b27028b710effb8fa28bab28e502b7/merged major:0 minor:681 fsType:overlay blockSize:0} overlay_0-686:{mountpoint:/var/lib/containers/storage/overlay/1702b2ec1e44d6c9c4630818ed9b498d95c39b21d89c54351efdfab79da3401a/merged major:0 minor:686 fsType:overlay blockSize:0} overlay_0-689:{mountpoint:/var/lib/containers/storage/overlay/944935387a69a6789fb64e62e99fb4071242a6ecc311de3f7b78c0d0c5e2aead/merged major:0 minor:689 fsType:overlay blockSize:0} overlay_0-692:{mountpoint:/var/lib/containers/storage/overlay/1c6886d77b82e7ebb5a2b51da60f9bbe8f98ddeb926ad36334ec0203f53dd86f/merged major:0 minor:692 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/97edc429248cc6d624fbf5320c19fb0367e2df72586cf858defeea9ce8df0439/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-700:{mountpoint:/var/lib/containers/storage/overlay/282ddbd695c200a03b402b777021f9deb89f28e82a257e7901859090598ebe26/merged major:0 minor:700 fsType:overlay blockSize:0} overlay_0-702:{mountpoint:/var/lib/containers/storage/overlay/bd08f29c296906b2de5669fb62c9693f5d29c15d3cb07afb88bd89c4ab41b4ff/merged major:0 minor:702 fsType:overlay blockSize:0} overlay_0-704:{mountpoint:/var/lib/containers/storage/overlay/ac85e48c729b090b96485fff10ddf06dec07761f9f0190dea9ee30b65e3ed2df/merged major:0 minor:704 fsType:overlay blockSize:0} overlay_0-716:{mountpoint:/var/lib/containers/storage/overlay/24c721753e8c1bd121e120a303581dc35eaa57575263b45b33621a64be9e0ae6/merged major:0 minor:716 fsType:overlay blockSize:0} overlay_0-720:{mountpoint:/var/lib/containers/storage/overlay/e64608b953a7a6d1dc765158f13f8ab654ebe5b0a35d6035f5fdd636dfb75879/merged major:0 minor:720 fsType:overlay blockSize:0} overlay_0-722:{mountpoint:/var/lib/containers/storage/overlay/3a9342a98cb370d82617d0146d8b8f7e092425def80b79b0478dac8945660c1e/merged major:0 minor:722 fsType:overlay blockSize:0} overlay_0-724:{mountpoint:/var/lib/containers/storage/overlay/8275f508802e9967de5d78d1f952a3664415c9912a6f2fda9df3ad9e4b8db399/merged major:0 minor:724 fsType:overlay blockSize:0} overlay_0-726:{mountpoint:/var/lib/containers/storage/overlay/2e026535caa0f024b59684ace437ce1e77423eefaff444d9e022c7a8900b9e74/merged major:0 minor:726 fsType:overlay blockSize:0} overlay_0-728:{mountpoint:/var/lib/containers/storage/overlay/790b5325a642c0545dee1ed7ace58161762ec90b38efdf85b6f4da647e512528/merged major:0 minor:728 fsType:overlay blockSize:0} overlay_0-736:{mountpoint:/var/lib/containers/storage/overlay/ae5de5a097b8b4c2f1ec3e07d16af5429bc1f6c728989ad54019439f446cd658/merged major:0 minor:736 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/cff137d45c9b95644ccc67a482fa60629fee2f6afd136ac2658720a1b887304b/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-745:{mountpoint:/var/lib/containers/storage/overlay/ffba7c0ab967a992dc96c1e220f9e0cbc7b32dfa4945ec9bfa5518beb55b56c8/merged major:0 minor:745 fsType:overlay blockSize:0} overlay_0-749:{mountpoint:/var/lib/containers/storage/overlay/b85b63e04081c8fb84c3648211c01e1d395fba41e9af4bcfb6b917aa541ef84e/merged major:0 minor:749 fsType:overlay blockSize:0} overlay_0-753:{mountpoint:/var/lib/containers/storage/overlay/624a06bd63c385335aa3c8fe5533f899b38370e0012604c4f8804605f2a8db3a/merged major:0 minor:753 fsType:overlay blockSize:0} overlay_0-773:{mountpoint:/var/lib/containers/storage/overlay/582c76c452950303b0e7ddbd9fbb0da242ae2ba9c08ef5ecb1d10cb8e4abc011/merged major:0 minor:773 fsType:overlay blockSize:0} overlay_0-775:{mountpoint:/var/lib/containers/storage/overlay/e11d741e3646c39989538188765368d0d39ed9fc06663e31a5bdd648701fcb68/merged major:0 minor:775 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/9e4e46d5e9e3667ca98fcb81a21f685f9712de6b3fcb74f6b6d8b53009d7a789/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-781:{mountpoint:/var/lib/containers/storage/overlay/19240c21f4c3d37e749d5d6a33fa2029203da38665049f592c2b2ebf3fa232c1/merged major:0 minor:781 fsType:overlay blockSize:0} overlay_0-788:{mountpoint:/var/lib/containers/storage/overlay/95f733f58c040d4af9d2d4096d22031c63592ffc1089c410a1a7fc668ffbb310/merged major:0 minor:788 fsType:overlay blockSize:0} overlay_0-805:{mountpoint:/var/lib/containers/storage/overlay/6d622813632c25e9905f3ed095e9d2b609cf38c4bd728cc65fdbe6f2022f5a9e/merged major:0 minor:805 fsType:overlay blockSize:0} overlay_0-81:{mountpoint:/var/lib/containers/storage/overlay/8a5f8e0a961a39aea3b36a24ead9b66caaaab013236d9dfb4f153dc360f9b8fa/merged major:0 minor:81 fsType:overlay blockSize:0} overlay_0-811:{mountpoint:/var/lib/containers/storage/overlay/9d6fc62f8139c52e6cf6ce3097070ca2243a3da4a83ba355e735a2cc3a032fac/merged major:0 minor:811 fsType:overlay blockSize:0} overlay_0-816:{mountpoint:/var/lib/containers/storage/overlay/31c5dcb904f97987cc1a9733e0418b18c9eb70aee6c08362ffe84cb9f5fe6d36/merged major:0 minor:816 fsType:overlay blockSize:0} overlay_0-819:{mountpoint:/var/lib/containers/storage/overlay/ef6c082ec37e5cfef605f4e0fc197c42b8c744376a3058ec0e600340cb3a7f71/merged major:0 minor:819 fsType:overlay blockSize:0} overlay_0-822:{mountpoint:/var/lib/containers/storage/overlay/47d113680efaf5074f41b72fe6d57e014aee67145cf4a8c99bcbedabd8e954b5/merged major:0 minor:822 fsType:overlay blockSize:0} overlay_0-825:{mountpoint:/var/lib/containers/storage/overlay/6b89cf6337f0235fa1d8686cb48430449a293cf5886ab876ff881b4db531ed2e/merged major:0 minor:825 fsType:overlay blockSize:0} overlay_0-829:{mountpoint:/var/lib/containers/storage/overlay/e9526fad5be4d58e625b1f7dbcb0db93133e7b26951aab1db990218b2593b161/merged major:0 minor:829 fsType:overlay blockSize:0} overlay_0-83:{mountpoint:/var/lib/containers/storage/overlay/a7c5f0074bf51f5c2fadca72fd4e590d1305fbca2f203f705730c808e1ae6c38/merged major:0 minor:83 fsType:overlay blockSize:0} overlay_0-831:{mountpoint:/var/lib/containers/storage/overlay/47224550d838bb0ef4c5a847b05d9254cf889f76b2d6ac885efa03b2eaf9f859/merged major:0 minor:831 fsType:overlay blockSize:0} overlay_0-832:{mountpoint:/var/lib/containers/storage/overlay/7feed64275682aa289aa4ddfc8f5691c4eea1b1443e24058d1408295bdf6ea28/merged major:0 minor:832 fsType:overlay blockSize:0} overlay_0-835:{mountpoint:/var/lib/containers/storage/overlay/361617840dd5c0f015641f1e3f701f59ca4f0ecee20b48322db8b86aeca041a5/merged major:0 minor:835 fsType:overlay blockSize:0} overlay_0-836:{mountpoint:/var/lib/containers/storage/overlay/01c4b9d530edad1bf2526d286b4443522840f708da0d8d8e43259d1aca15b472/merged major:0 minor:836 fsType:overlay blockSize:0} overlay_0-838:{mountpoint:/var/lib/containers/storage/overlay/3a4468c5ca6fc5a9f5fd9e6a531493172b3ec6b5991cd9e8b63c5af7d051ca1e/merged major:0 minor:838 fsType:overlay blockSize:0} overlay_0-840:{mountpoint:/var/lib/containers/storage/overlay/4991d2edec4028253a06362ca2856aba05414ec240372299b969b70856dc3d00/merged major:0 minor:840 fsType:overlay blockSize:0} overlay_0-844:{mountpoint:/var/lib/containers/storage/overlay/875e20383c5abba4c588adb17b55d1fa5f0549aa077b9f423c47fac9d22ac417/merged major:0 minor:844 fsType:overlay blockSize:0} overlay_0-849:{mountpoint:/var/lib/containers/storage/overlay/5ee6451b56e245e4564642ea600d7a2ddb75353d7d194e9a2a49f3f5634b77ec/merged major:0 minor:849 fsType:overlay blockSize:0} overlay_0-850:{mountpoint:/var/lib/containers/storage/overlay/02d8e288ebb8422574eadd30531ae88879283c1214ab91eb01cf8c14f54b0cc9/merged major:0 minor:850 fsType:overlay blockSize:0} overlay_0-859:{mountpoint:/var/lib/containers/storage/overlay/396a250ccfa43f6d7b3908630eb724299afba7edf3e825c5a641239c858dd9bb/merged major:0 minor:859 fsType:overlay blockSize:0} overlay_0-861:{mountpoint:/var/lib/containers/storage/overlay/f6e92de9cb8380a796d96558073ac57d857a70305051541f3b4193cff448f296/merged major:0 minor:861 fsType:overlay blockSize:0} overlay_0-863:{mountpoint:/var/lib/containers/storage/overlay/cab2563d547e79c009f130cfff76cf3db98a6581183e418c9ddc29de322d6eaf/merged major:0 minor:863 fsType:overlay blockSize:0} overlay_0-871:{mountpoint:/var/lib/containers/storage/overlay/3e8c9d156bd3acfd4009689acd67b34aa7f0a514dc498d759f53ed4ef091e317/merged major:0 minor:871 fsType:overlay blockSize:0} overlay_0-872:{mountpoint:/var/lib/containers/storage/overlay/161c81b14b6df19395e9d5fe1d023c54541d74073121053755e3faab0b6d4410/merged major:0 minor:872 fsType:overlay blockSize:0} overlay_0-887:{mountpoint:/var/lib/containers/storage/overlay/15980818d9e5cddec6a8b0e238ca8741839a5fdcfed81caf74b34e5640982d9b/merged major:0 minor:887 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/40de78741cb4670032aa1550620135c0a1561433f59ea512551e40b8f22d63c5/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-901:{mountpoint:/var/lib/containers/storage/overlay/8a88ae80cf76bf11bc8cef4d9a63d8ef6d5c7557dcf2cf4231344f8a88ae0c64/merged major:0 minor:901 fsType:overlay blockSize:0} overlay_0-916:{mountpoint:/var/lib/containers/storage/overlay/f338e247f52f18bb25fa67f1077cbac478425b4b2cb2dc29745467cfa9cf8881/merged major:0 minor:916 fsType:overlay blockSize:0} overlay_0-93:{mountpoint:/var/lib/containers/storage/overlay/ca0696c27724737581df166daa056cb7aaf2f854e0c5c6a9a2730bd2a61e9642/merged major:0 minor:93 fsType:overlay blockSize:0} overlay_0-934:{mountpoint:/var/lib/containers/storage/overlay/05c7dd4f293e742b530400c3b94daae353c85d7503fc72f27dfba21731ebcec0/merged major:0 minor:934 fsType:overlay blockSize:0} overlay_0-942:{mountpoint:/var/lib/containers/storage/overlay/3776dec84c48a29f556ea57eaa48fd9463030db6a2c3776932756721c7d2726e/merged major:0 minor:942 fsType:overlay blockSize:0} overlay_0-95:{mountpoint:/var/lib/containers/storage/overlay/19ba8ab90f804f73356561569fcbc7d77d530aa100b420f723dd560f037e2c01/merged major:0 minor:95 fsType:overlay blockSize:0} overlay_0-952:{mountpoint:/var/lib/containers/storage/overlay/7adee8fafcc1747ff0d1451417acd7b39d60289065161181dac51b35b8d35506/merged major:0 minor:952 fsType:overlay blockSize:0} overlay_0-955:{mountpoint:/var/lib/containers/storage/overlay/2ef0f25ef346d62d5d07eb98bca21296735017fdd71fa8ec4396dd997e111d1e/merged major:0 minor:955 fsType:overlay blockSize:0} overlay_0-981:{mountpoint:/var/lib/containers/storage/overlay/b4d3424b88186ecfe265a6fb85702b274bfb16cd6c2e19a3a3551c65ac13ab05/merged major:0 minor:981 fsType:overlay blockSize:0} overlay_0-983:{mountpoint:/var/lib/containers/storage/overlay/43d9aedcb0f5ace41 Dec 04 11:59:16.644455 master-0 kubenswrapper[35367]: c97c31ba3beeb32ffb516360ae6b80f34ab4dc7392ff7e7/merged major:0 minor:983 fsType:overlay blockSize:0} overlay_0-995:{mountpoint:/var/lib/containers/storage/overlay/9d622434933e38fc01ad6959144f24af434cf7e075f6cce852c998ad566364b9/merged major:0 minor:995 fsType:overlay blockSize:0} overlay_0-997:{mountpoint:/var/lib/containers/storage/overlay/8595b95911a4c7d5bbf34f8fabbe26582e23aeedb53ca434d3fbd32ccf7b82d0/merged major:0 minor:997 fsType:overlay blockSize:0} overlay_0-998:{mountpoint:/var/lib/containers/storage/overlay/87b628cf973729d3b57147027c5b575a6da5bbe61b434b223cbcd236751b16b4/merged major:0 minor:998 fsType:overlay blockSize:0}] Dec 04 11:59:16.681787 master-0 kubenswrapper[35367]: I1204 11:59:16.680040 35367 manager.go:217] Machine: {Timestamp:2025-12-04 11:59:16.679012752 +0000 UTC m=+0.117074030 CPUVendorID:AuthenticAMD NumCores:16 NumPhysicalCores:1 NumSockets:16 CpuFrequency:2800000 MemoryCapacity:50514153472 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:27b5ee8bfd7d412e99796c008843ed23 SystemUUID:27b5ee8b-fd7d-412e-9979-6c008843ed23 BootID:8fe75f05-5c88-4c1f-b39c-b984078f0689 Filesystems:[{Device:overlay_0-203 DeviceMajor:0 DeviceMinor:203 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/16057f9c-b1f8-4915-acc3-2d4532af4963/volumes/kubernetes.io~projected/kube-api-access-lxnbc DeviceMajor:0 DeviceMinor:468 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c2ef6f4b038048608a7de8078d0bbb7a0ab65dee8ba06d90a8c50f1331efa7b2/userdata/shm DeviceMajor:0 DeviceMinor:1080 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-652 DeviceMajor:0 DeviceMinor:652 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-458 DeviceMajor:0 DeviceMinor:458 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-745 DeviceMajor:0 DeviceMinor:745 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-190 DeviceMajor:0 DeviceMinor:190 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/1897bad8-3875-4bd6-b877-b1abe1fe76c7/volumes/kubernetes.io~projected/kube-api-access-dkqp2 DeviceMajor:0 DeviceMinor:675 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-546 DeviceMajor:0 DeviceMinor:546 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/34d78076625efac7bdb2340b596443baa5d08eac7ab61fe519fdb353374c6f2a/userdata/shm DeviceMajor:0 DeviceMinor:331 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-624 DeviceMajor:0 DeviceMinor:624 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/ee9a47b1-cdd9-43bc-8115-8851f29106e6/volumes/kubernetes.io~projected/ca-certs DeviceMajor:0 DeviceMinor:659 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/1ade9186-b262-4b5e-9c6f-ba89f0130fb6/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:321 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/cdb50850-779d-4179-ba1d-65ffeb4bb2e9/volumes/kubernetes.io~projected/kube-api-access-nhvdc DeviceMajor:0 DeviceMinor:1083 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-168 DeviceMajor:0 DeviceMinor:168 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c13740ec53fb9299b45efbd89f500b5ff1c2e8c4723ff4ec44bf1b5ff490925a/userdata/shm DeviceMajor:0 DeviceMinor:615 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-469 DeviceMajor:0 DeviceMinor:469 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:289 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/773244d15d95d1008b0937319bf6aba15eff590b74992c80e3033356005709af/userdata/shm DeviceMajor:0 DeviceMinor:618 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-702 DeviceMajor:0 DeviceMinor:702 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/7e3160a9-11d1-4845-ba30-1a49ae7339a9/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:946 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1029 DeviceMajor:0 DeviceMinor:1029 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1318 DeviceMajor:0 DeviceMinor:1318 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-149 DeviceMajor:0 DeviceMinor:149 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-838 DeviceMajor:0 DeviceMinor:838 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-596 DeviceMajor:0 DeviceMinor:596 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/bac00ac5-0371-48fd-b1cc-60438f08ae94/volumes/kubernetes.io~projected/kube-api-access DeviceMajor:0 DeviceMinor:311 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1377 DeviceMajor:0 DeviceMinor:1377 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1037 DeviceMajor:0 DeviceMinor:1037 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-722 DeviceMajor:0 DeviceMinor:722 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-773 DeviceMajor:0 DeviceMinor:773 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-392 DeviceMajor:0 DeviceMinor:392 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/c6e9271a-44ea-4612-ab60-4a9d489ed062/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:298 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-955 DeviceMajor:0 DeviceMinor:955 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-547 DeviceMajor:0 DeviceMinor:547 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1252 DeviceMajor:0 DeviceMinor:1252 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1023 DeviceMajor:0 DeviceMinor:1023 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-859 DeviceMajor:0 DeviceMinor:859 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/1897bad8-3875-4bd6-b877-b1abe1fe76c7/volumes/kubernetes.io~projected/ca-certs DeviceMajor:0 DeviceMinor:581 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-482 DeviceMajor:0 DeviceMinor:482 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-499 DeviceMajor:0 DeviceMinor:499 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48/volumes/kubernetes.io~secret/cloud-controller-manager-operator-tls DeviceMajor:0 DeviceMinor:1111 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/24506aa4-ab78-49df-bb58-59093498f13d/volumes/kubernetes.io~projected/kube-api-access-w2qnk DeviceMajor:0 DeviceMinor:635 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-419 DeviceMajor:0 DeviceMinor:419 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-68 DeviceMajor:0 DeviceMinor:68 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1385 DeviceMajor:0 DeviceMinor:1385 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-351 DeviceMajor:0 DeviceMinor:351 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-431 DeviceMajor:0 DeviceMinor:431 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-413 DeviceMajor:0 DeviceMinor:413 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1322 DeviceMajor:0 DeviceMinor:1322 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-952 DeviceMajor:0 DeviceMinor:952 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/52fc4812931b1d912474af968926c8a3a29e2b1cbdfed78532122ce1dc286a99/userdata/shm DeviceMajor:0 DeviceMinor:334 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/c6e9271a-44ea-4612-ab60-4a9d489ed062/volumes/kubernetes.io~projected/kube-api-access-cdsq5 DeviceMajor:0 DeviceMinor:324 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/1243d581-fa11-4db1-a01a-0cf64eb3ef74/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:478 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1024 DeviceMajor:0 DeviceMinor:1024 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1386 DeviceMajor:0 DeviceMinor:1386 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fa255b4fd328cf99db08eb2b43e9c35a73e8f688d9352d1ab6ed516f93712d61/userdata/shm DeviceMajor:0 DeviceMinor:340 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/c91e6234-52c5-41c0-a1ff-6a92932b83cd/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:602 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/7ec61be5-32f9-4aac-815f-41d173213107/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:771 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/7e3160a9-11d1-4845-ba30-1a49ae7339a9/volumes/kubernetes.io~projected/kube-api-access-fksx7 DeviceMajor:0 DeviceMinor:954 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1400 DeviceMajor:0 DeviceMinor:1400 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:10102833152 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-704 DeviceMajor:0 DeviceMinor:704 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1f986c9fd7cca35aea4ff3881bdd60a51656018288bec2bb4cbd1618b75a974f/userdata/shm DeviceMajor:0 DeviceMinor:764 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1372 DeviceMajor:0 DeviceMinor:1372 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/1ade9186-b262-4b5e-9c6f-ba89f0130fb6/volumes/kubernetes.io~secret/image-registry-operator-tls DeviceMajor:0 DeviceMinor:612 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/1243d581-fa11-4db1-a01a-0cf64eb3ef74/volumes/kubernetes.io~projected/kube-api-access-9q8d8 DeviceMajor:0 DeviceMinor:479 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-439 DeviceMajor:0 DeviceMinor:439 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1320 DeviceMajor:0 DeviceMinor:1320 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1003 DeviceMajor:0 DeviceMinor:1003 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-503 DeviceMajor:0 DeviceMinor:503 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/a5b826c3-8638-4cf5-b974-b24e4282ce00/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:286 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-488 DeviceMajor:0 DeviceMinor:488 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3683b10cf07d6921c3832ff5c3c42262028823e5717156ccd7dd27d6a44a9b03/userdata/shm DeviceMajor:0 DeviceMinor:786 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1231 DeviceMajor:0 DeviceMinor:1231 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0d019de7666ab420398ef1b6b5ac581f64802cb56fe4c2b360c11b041de71dc5/userdata/shm DeviceMajor:0 DeviceMinor:344 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/7c017c69-b24e-4a7a-b888-133bed34c174/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:611 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1168 DeviceMajor:0 DeviceMinor:1168 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/d8fca733-45c8-45b8-8653-ac204e7c6098/volumes/kubernetes.io~projected/kube-api-access-2ncf9 DeviceMajor:0 DeviceMinor:150 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/474d4f9ffe7ccdfc7a57a90c2911a6db821fd6fb44f99e0d486e566260e1bcfb/userdata/shm DeviceMajor:0 DeviceMinor:813 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/14bd3485-aa02-4984-b4a3-59f360b1b327/volumes/kubernetes.io~projected/kube-api-access-nfspg DeviceMajor:0 DeviceMinor:948 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c2e0a5f7188ebd1ad7d4edbad094215c2f60dd9e9a0830dce848050e834e809c/userdata/shm DeviceMajor:0 DeviceMinor:136 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1274 DeviceMajor:0 DeviceMinor:1274 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/7ec61be5-32f9-4aac-815f-41d173213107/volumes/kubernetes.io~secret/encryption-config DeviceMajor:0 DeviceMinor:780 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/e4d7939a-5961-4608-b910-73e71aa55bf6/volumes/kubernetes.io~projected/kube-api-access-d77m8 DeviceMajor:0 DeviceMinor:636 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-140 DeviceMajor:0 DeviceMinor:140 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-819 DeviceMajor:0 DeviceMinor:819 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/38aff0440f5b265ce52ca882bf70fe892cd569736c1a9aa92adc7ee8587a099b/userdata/shm DeviceMajor:0 DeviceMinor:92 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1182 DeviceMajor:0 DeviceMinor:1182 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-689 DeviceMajor:0 DeviceMinor:689 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-56 DeviceMajor:0 DeviceMinor:56 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/ccf81538-4d5a-4c26-8e54-fe39331a625d/volumes/kubernetes.io~projected/kube-api-access DeviceMajor:0 DeviceMinor:318 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:30 Capacity:25257078784 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-736 DeviceMajor:0 DeviceMinor:736 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/855d7874-16b1-47d0-82f6-d2b0c89b9a84/volumes/kubernetes.io~secret/apiservice-cert DeviceMajor:0 DeviceMinor:1108 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/dev/vda4 DeviceMajor:252 DeviceMinor:4 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-186 DeviceMajor:0 DeviceMinor:186 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-365 DeviceMajor:0 DeviceMinor:365 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/2ab26ae5-0607-4dfd-840e-531d204b5030/volumes/kubernetes.io~secret/cluster-monitoring-operator-tls DeviceMajor:0 DeviceMinor:641 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4e4d27e585843021cf1d4ebb05e041bc6724b400e88a89f330496e3b5cadf825/userdata/shm DeviceMajor:0 DeviceMinor:1092 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-375 DeviceMajor:0 DeviceMinor:375 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/a3558de2-46f8-48b5-a961-95decb7805cf/volumes/kubernetes.io~projected/kube-api-access-tbt5w DeviceMajor:0 DeviceMinor:472 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/adbbc7afd8e54e79f29b174cb989cf3e7455023359f413af406ae4a4afbf2ab4/userdata/shm DeviceMajor:0 DeviceMinor:147 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c76231902c039c32af3a18ebabd11c0b9524870e040b7e0b95b175ee636d58b0/userdata/shm DeviceMajor:0 DeviceMinor:671 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/64d30b80-2336-49c2-a2c2-1e0694036a84/volumes/kubernetes.io~projected/kube-api-access-vgdmn DeviceMajor:0 DeviceMinor:1051 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f98dcde4da5cf1328576b051bbce37ad312e157073b4d2dd8315e3085ebb6ec4/userdata/shm DeviceMajor:0 DeviceMinor:1053 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-983 DeviceMajor:0 DeviceMinor:983 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-355 DeviceMajor:0 DeviceMinor:355 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/ee9a47b1-cdd9-43bc-8115-8851f29106e6/volumes/kubernetes.io~secret/catalogserver-certs DeviceMajor:0 DeviceMinor:658 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-887 DeviceMajor:0 DeviceMinor:887 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/da23ebdcd7c632c968f1dcc14625f7875764a703fd10b23106235b76064c9498/userdata/shm DeviceMajor:0 DeviceMinor:328 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/c91e6234-52c5-41c0-a1ff-6a92932b83cd/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:601 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-700 DeviceMajor:0 DeviceMinor:700 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-863 DeviceMajor:0 DeviceMinor:863 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-998 DeviceMajor:0 DeviceMinor:998 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-383 DeviceMajor:0 DeviceMinor:383 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1217 DeviceMajor:0 DeviceMinor:1217 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/157eab0c-0d8d-486b-a349-c2e466e18e0c/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:157 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-511 DeviceMajor:0 DeviceMinor:511 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-825 DeviceMajor:0 DeviceMinor:825 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-436 DeviceMajor:0 DeviceMinor:436 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-427 DeviceMajor:0 DeviceMinor:427 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/7203ec93-6572-4032-825c-140029a86058/volumes/kubernetes.io~projected/kube-api-access-gkcj4 DeviceMajor:0 DeviceMinor:185 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/ee9a47b1-cdd9-43bc-8115-8851f29106e6/volumes/kubernetes.io~projected/kube-api-access-rnfmb DeviceMajor:0 DeviceMinor:667 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f79899a7403dcd84a3d96a78d16e1cbb4b992d570d19008637079be293ab8381/userdata/shm DeviceMajor:0 DeviceMinor:815 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1105 DeviceMajor:0 DeviceMinor:1105 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-507 DeviceMajor:0 DeviceMinor:507 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1221 DeviceMajor:0 DeviceMinor:1221 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-434 DeviceMajor:0 DeviceMinor:434 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1426 DeviceMajor:0 DeviceMinor:1426 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/3322cc5a-f1f7-4522-b423-19fb7f38cd43/volumes/kubernetes.io~projected/kube-api-access-k449s DeviceMajor:0 DeviceMinor:315 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d9d667bd2c388cdba21d0d98e8c8985f6bb62287cc7f32d5b257b5a3ca9351a1/userdata/shm DeviceMajor:0 DeviceMinor:336 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:655 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7e5d9f59cc52a039bc3101dea9d52f4d7e3ff569f7c4b78565cd401fa0991a31/userdata/shm DeviceMajor:0 DeviceMinor:567 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1256 DeviceMajor:0 DeviceMinor:1256 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-170 DeviceMajor:0 DeviceMinor:170 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5f6e465bf3a100d7d2886ee1f7e11272f1efa1a5de4bd0fed903545e3f9d07c9/userdata/shm DeviceMajor:0 DeviceMinor:1057 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-424 DeviceMajor:0 DeviceMinor:424 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-594 DeviceMajor:0 DeviceMinor:594 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/a399a87b-8153-4045-a8d3-63fd88ae280f/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:776 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/7c017c69-b24e-4a7a-b888-133bed34c174/volumes/kubernetes.io~projected/kube-api-access-tlr76 DeviceMajor:0 DeviceMinor:302 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1094 DeviceMajor:0 DeviceMinor:1094 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/be595cb0f6bc539259ae33f4c798872444db87c19b714237c536b92a4a7a1a6c/userdata/shm DeviceMajor:0 DeviceMinor:1328 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-872 DeviceMajor:0 DeviceMinor:872 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-566 DeviceMajor:0 DeviceMinor:566 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:25257074688 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/00601c1a-efd4-4366-bdc9-d768afa252b0/volumes/kubernetes.io~projected/kube-api-access-2g7bh DeviceMajor:0 DeviceMinor:316 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/a399a87b-8153-4045-a8d3-63fd88ae280f/volumes/kubernetes.io~projected/kube-api-access DeviceMajor:0 DeviceMinor:785 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/b668f740-dbc3-48e0-9ebc-83bae3a43c83/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:1074 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/434ed9b9-715b-455b-867c-775b256df40f/volumes/kubernetes.io~projected/kube-api-access-ggzfm DeviceMajor:0 DeviceMinor:304 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/fd4c4c6f-380a-4cda-9a21-352b55ec2d98/volumes/kubernetes.io~secret/marketplace-operator-metrics DeviceMajor:0 DeviceMinor:644 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-726 DeviceMajor:0 DeviceMinor:726 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-835 DeviceMajor:0 DeviceMinor:835 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/855d7874-16b1-47d0-82f6-d2b0c89b9a84/volumes/kubernetes.io~secret/webhook-cert DeviceMajor:0 DeviceMinor:1109 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1258 DeviceMajor:0 DeviceMinor:1258 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-523 DeviceMajor:0 DeviceMinor:523 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-228 DeviceMajor:0 DeviceMinor:228 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1084 DeviceMajor:0 DeviceMinor:1084 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/855d7874-16b1-47d0-82f6-d2b0c89b9a84/volumes/kubernetes.io~projected/kube-api-access-5vv7k DeviceMajor:0 DeviceMinor:1110 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/7203ec93-6572-4032-825c-140029a86058/volumes/kubernetes.io~secret/webhook-cert DeviceMajor:0 DeviceMinor:194 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/08550069-c1a1-475e-84a2-e56905f1ed38/volumes/kubernetes.io~secret/webhook-certs DeviceMajor:0 DeviceMinor:647 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-871 DeviceMajor:0 DeviceMinor:871 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-120 DeviceMajor:0 DeviceMinor:120 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1324 DeviceMajor:0 DeviceMinor:1324 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-575 DeviceMajor:0 DeviceMinor:575 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/853c784d56688f268e88966f202d566476596a385a8e279f2c38cf8e7278c8d9/userdata/shm DeviceMajor:0 DeviceMinor:161 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/7bf67a51-9759-4e2a-a2ae-ef7416cad43f/volumes/kubernetes.io~projected/kube-api-access-zr454 DeviceMajor:0 DeviceMinor:319 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/volumes/kubernetes.io~projected/kube-api-access-l5r7w DeviceMajor:0 DeviceMinor:467 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/fd9f8671-8066-4990-b45d-8b619aa5d9ec/volumes/kubernetes.io~projected/kube-api-access-llscb DeviceMajor:0 DeviceMinor:305 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-411 DeviceMajor:0 DeviceMinor:411 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/fd9f8671-8066-4990-b45d-8b619aa5d9ec/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:291 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-369 DeviceMajor:0 DeviceMinor:369 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/14bd3485-aa02-4984-b4a3-59f360b1b327/volumes/kubernetes.io~secret/control-plane-machine-set-operator-tls DeviceMajor:0 DeviceMinor:848 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/018e9ad3-c071-45c6-bfa6-e53dda20c757/volumes/kubernetes.io~projected/kube-api-access-bsvvf DeviceMajor:0 DeviceMinor:1073 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/287fba2d-f56d-4ec0-b796-7849a68fb411/volumes/kubernetes.io~secret/ovn-control-plane-metrics-cert DeviceMajor:0 DeviceMinor:156 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1260 DeviceMajor:0 DeviceMinor:1260 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/b011b1f1-3235-4e20-825b-ce711c052407/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:613 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/7ec61be5-32f9-4aac-815f-41d173213107/volumes/kubernetes.io~projected/kube-api-access-p2bpn DeviceMajor:0 DeviceMinor:784 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-112 DeviceMajor:0 DeviceMinor:112 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1402 DeviceMajor:0 DeviceMinor:1402 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-281 DeviceMajor:0 DeviceMinor:281 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9/volumes/kubernetes.io~secret/encryption-config DeviceMajor:0 DeviceMinor:656 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1248 DeviceMajor:0 DeviceMinor:1248 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/031d300e-24b4-481c-8b82-fe8cdb3fcef7/volumes/kubernetes.io~projected/kube-api-access-k7bhn DeviceMajor:0 DeviceMinor:320 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/6f15dcdb-c968-429c-9d1d-63c2becad337/volumes/kubernetes.io~projected/kube-api-access-kkjzz DeviceMajor:0 DeviceMinor:322 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-622 DeviceMajor:0 DeviceMinor:622 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-61 DeviceMajor:0 DeviceMinor:61 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/27576028-d64a-47cd-b76b-d524e41efe37/volumes/kubernetes.io~projected/kube-api-access DeviceMajor:0 DeviceMinor:314 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1333 DeviceMajor:0 DeviceMinor:1333 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-59 DeviceMajor:0 DeviceMinor:59 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-634 DeviceMajor:0 DeviceMinor:634 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1009 DeviceMajor:0 DeviceMinor:1009 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/24506aa4-ab78-49df-bb58-59093498f13d/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:558 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4c6405b67db7763561b4f0f867c268ed82b2dcb8dc4a31ac8bd955b23c489a04/userdata/shm DeviceMajor:0 DeviceMinor:342 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-811 DeviceMajor:0 DeviceMinor:811 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/40749160ea3271ba79ddd289ecc16ddea5467363a62ec473910d1a7a9d5f865a/userdata/shm DeviceMajor:0 DeviceMinor:1014 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1018 DeviceMajor:0 DeviceMinor:1018 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/e4d7939a-5961-4608-b910-73e71aa55bf6/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:543 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1262 DeviceMajor:0 DeviceMinor:1262 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/ccf81538-4d5a-4c26-8e54-fe39331a625d/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:292 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-353 DeviceMajor:0 DeviceMinor:353 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/ccf1cb9e-8885-4224-92d5-d1b116bc0090/volumes/kubernetes.io~projected/kube-api-access-8w6kv DeviceMajor:0 DeviceMinor:1052 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-449 DeviceMajor:0 DeviceMinor:449 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8/volumes/kubernetes.io~projected/kube-api-access-n6bhm DeviceMajor:0 DeviceMinor:312 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-118 DeviceMajor:0 DeviceMinor:118 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/bdfcb644-24ef-4a33-93ae-a855e872d29a/volumes/kubernetes.io~projected/kube-api-access-f4w2j DeviceMajor:0 DeviceMinor:146 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cd9dab7f7f5afa841cd8a4ded039df1dd1c65380acd9d3f01a8545a60b7ba60d/userdata/shm DeviceMajor:0 DeviceMinor:128 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-829 DeviceMajor:0 DeviceMinor:829 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/59191695c89f8cecbba881756b5ffc5e4c892fd02facf20cc198ade1bf4ec267/userdata/shm DeviceMajor:0 DeviceMinor:46 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/c6e9271a-44ea-4612-ab60-4a9d489ed062/volumes/kubernetes.io~secret/etcd-client DeviceMajor:0 DeviceMinor:296 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46/volumes/kubernetes.io~projected/kube-api-access-ckwnn DeviceMajor:0 DeviceMinor:313 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1090 DeviceMajor:0 DeviceMinor:1090 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/941cfa04ddc49a585fc727a1dbdeb69c47e5f5f598b3a6ea4a0075889e24c1b1/userdata/shm DeviceMajor:0 DeviceMinor:409 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1384 DeviceMajor:0 DeviceMinor:1384 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/25835b8cd52c0d1fb7ed133702ef424c403a978f32d5722b14d0bf7744915891/userdata/shm DeviceMajor:0 DeviceMinor:132 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-386 DeviceMajor:0 DeviceMinor:386 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-207 DeviceMajor:0 DeviceMinor:207 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/00601c1a-efd4-4366-bdc9-d768afa252b0/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:299 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-244 DeviceMajor:0 DeviceMinor:244 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/b668f740-dbc3-48e0-9ebc-83bae3a43c83/volumes/kubernetes.io~projected/kube-api-access-xttdn DeviceMajor:0 DeviceMinor:1075 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/c50317d3-f7cd-4133-845e-44add57ac378/volumes/kubernetes.io~secret/machine-api-operator-tls DeviceMajor:0 DeviceMinor:987 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-632 DeviceMajor:0 DeviceMinor:632 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/ffaf95be-586c-40fa-b15f-1beaffe7ff1c/volumes/kubernetes.io~projected/kube-api-access-t6bkg DeviceMajor:0 DeviceMinor:127 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7458153a023b91d017eed71d76df09c0bc8fa59fa08b1c40a9a1e8366760b372/userdata/shm DeviceMajor:0 DeviceMinor:666 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-861 DeviceMajor:0 DeviceMinor:861 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-587 DeviceMajor:0 DeviceMinor:587 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/f797ab14-0eb5-48b4-b914-f434f67c4c49/volumes/kubernetes.io~projected/kube-api-access-zjkck DeviceMajor:0 DeviceMinor:1087 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-816 DeviceMajor:0 DeviceMinor:816 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-836 DeviceMajor:0 DeviceMinor:836 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/c835660f-5a79-4679-b9be-8543ca6ef5a1/volumes/kubernetes.io~secret/machine-approver-tls DeviceMajor:0 DeviceMinor:1010 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-407 DeviceMajor:0 DeviceMinor:407 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1360 DeviceMajor:0 DeviceMinor:1360 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-166 DeviceMajor:0 DeviceMinor:166 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-154 DeviceMajor:0 DeviceMinor:154 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d1fbec2f91180eb6330203120902a7c2d9e5600f6e157a2c0cffd49f47e5d173/userdata/shm DeviceMajor:0 DeviceMinor:670 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-43 DeviceMajor:0 DeviceMinor:43 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/bac00ac5-0371-48fd-b1cc-60438f08ae94/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:295 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c2c98fa5f1fd4720ca08ff4b851c5b1972a6185dbb2f13863dd011c50de56bb2/userdata/shm DeviceMajor:0 DeviceMinor:1066 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-997 DeviceMajor:0 DeviceMinor:997 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-223 DeviceMajor:0 DeviceMinor:223 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/7e3160a9-11d1-4845-ba30-1a49ae7339a9/volumes/kubernetes.io~secret/cluster-baremetal-operator-tls DeviceMajor:0 DeviceMinor:947 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1269 DeviceMajor:0 DeviceMinor:1269 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-724 DeviceMajor:0 DeviceMinor:724 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/a5b826c3-8638-4cf5-b974-b24e4282ce00/volumes/kubernetes.io~projected/kube-api-access-rhmlm DeviceMajor:0 DeviceMinor:325 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1145 DeviceMajor:0 DeviceMinor:1145 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-775 DeviceMajor:0 DeviceMinor:775 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/0158c2f3-20e5-43f4-875d-c5ad8f6112df/volumes/kubernetes.io~secret/cluster-olm-operator-serving-cert DeviceMajor:0 DeviceMinor:287 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-849 DeviceMajor:0 DeviceMinor:849 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/cdb50850-779d-4179-ba1d-65ffeb4bb2e9/volumes/kubernetes.io~secret/proxy-tls DeviceMajor:0 DeviceMinor:1082 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/c50317d3-f7cd-4133-845e-44add57ac378/volumes/kubernetes.io~projected/kube-api-access-s2jw8 DeviceMajor:0 DeviceMinor:988 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1280 DeviceMajor:0 DeviceMinor:1280 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/7ec61be5-32f9-4aac-815f-41d173213107/volumes/kubernetes.io~secret/etcd-client DeviceMajor:0 DeviceMinor:772 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48/volumes/kubernetes.io~projected/kube-api-access-6fssw DeviceMajor:0 DeviceMinor:1113 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1144 DeviceMajor:0 DeviceMinor:1144 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5b961ab6b54b9feb8cf7fe5efab6be134bcc809fa3be066db38163dd3c1044fc/userdata/shm DeviceMajor:0 DeviceMinor:1076 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/7bf67a51-9759-4e2a-a2ae-ef7416cad43f/volumes/kubernetes.io~secret/srv-cert DeviceMajor:0 DeviceMinor:648 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-901 DeviceMajor:0 DeviceMinor:901 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/97556f365f16c1ec11f0ae822f90781c5b826eb96ebe11fadb15589661eb05b6/userdata/shm DeviceMajor:0 DeviceMinor:584 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/067d2ebf7cd71320983357660c7bfa56d36312a860021a8819604e4142c7331b/userdata/shm DeviceMajor:0 DeviceMinor:1398 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ca886b4e0bb939f02a59e692a7e818915eb829261d10e2563a1a2a60bb3e4c87/userdata/shm DeviceMajor:0 DeviceMinor:349 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9/volumes/kubernetes.io~projected/kube-api-access-lg7hr DeviceMajor:0 DeviceMinor:665 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1329 DeviceMajor:0 DeviceMinor:1329 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/42b3be0f-1d82-4a64-abb4-0118a6960efd/volumes/kubernetes.io~projected/kube-api-access-c7xwd DeviceMajor:0 DeviceMinor:310 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-359 DeviceMajor:0 DeviceMinor:359 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/6f15dcdb-c968-429c-9d1d-63c2becad337/volumes/kubernetes.io~secret/node-tuning-operator-tls DeviceMajor:0 DeviceMinor:561 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-572 DeviceMajor:0 DeviceMinor:572 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-381 DeviceMajor:0 DeviceMinor:381 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-822 DeviceMajor:0 DeviceMinor:822 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-273 DeviceMajor:0 DeviceMinor:273 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-183 DeviceMajor:0 DeviceMinor:183 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/157eab0c-0d8d-486b-a349-c2e466e18e0c/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:24 Capacity:10102833152 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-163 DeviceMajor:0 DeviceMinor:163 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-50 DeviceMajor:0 DeviceMinor:50 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-385 DeviceMajor:0 DeviceMinor:385 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/434ed9b9-715b-455b-867c-775b256df40f/volumes/kubernetes.io~secret/profile-collector-cert DeviceMajor:0 DeviceMinor:297 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9b1319524752363a937b5af4a730963d2a56573bdd16e93cbb4db707f16a3fba/userdata/shm DeviceMajor:0 DeviceMinor:126 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b05c03ee7421430935dd045065b562c6c4243474d783822f7feef789f201d335/userdata/shm DeviceMajor:0 DeviceMinor:160 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-678 DeviceMajor:0 DeviceMinor:678 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1309 DeviceMajor:0 DeviceMinor:1309 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/dc99390b4f6b05b78c6da98b65609309d92ed4065939c3774e5b8b38d407bec6/userdata/shm DeviceMajor:0 DeviceMinor:674 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-942 DeviceMajor:0 DeviceMinor:942 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/5ae25dd5-dfdb-42f6-97d0-14ad17743c95/volumes/kubernetes.io~projected/kube-api-access-l22ps DeviceMajor:0 DeviceMinor:1112 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1254 DeviceMajor:0 DeviceMinor:1254 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-83 DeviceMajor:0 DeviceMinor:83 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/b011b1f1-3235-4e20-825b-ce711c052407/volumes/kubernetes.io~projected/kube-api-access-jq49f DeviceMajor:0 DeviceMinor:309 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/0fad065c-94c9-4a38-ab76-cf0266bdc04b/volumes/kubernetes.io~projected/kube-api-access DeviceMajor:0 DeviceMinor:1397 Capacity:200003584 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1199 DeviceMajor:0 DeviceMinor:1199 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-606 DeviceMajor:0 DeviceMinor:606 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-388 DeviceMajor:0 DeviceMinor:388 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-840 DeviceMajor:0 DeviceMinor:840 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/fd4c4c6f-380a-4cda-9a21-352b55ec2d98/volumes/kubernetes.io~projected/kube-api-access-rj4dt DeviceMajor:0 DeviceMinor:308 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/2ab26ae5-0607-4dfd-840e-531d204b5030/volumes/kubernetes.io~projected/kube-api-access-mvzrc DeviceMajor:0 DeviceMinor:303 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-657 DeviceMajor:0 DeviceMinor:657 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/42b3be0f-1d82-4a64-abb4-0118a6960efd/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:293 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cbad8f519fca5622e25075665c609020a4c168f05797a0e7395559b78b81984d/userdata/shm DeviceMajor:0 DeviceMinor:338 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-65 DeviceMajor:0 DeviceMinor:65 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/b011b1f1-3235-4 Dec 04 11:59:16.682739 master-0 kubenswrapper[35367]: e20-825b-ce711c052407/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:300 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7/volumes/kubernetes.io~projected/kube-api-access-mmm9t DeviceMajor:0 DeviceMinor:808 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c/volumes/kubernetes.io~projected/kube-api-access-v6z8r DeviceMajor:0 DeviceMinor:989 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1027 DeviceMajor:0 DeviceMinor:1027 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-686 DeviceMajor:0 DeviceMinor:686 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-620 DeviceMajor:0 DeviceMinor:620 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/6f15dcdb-c968-429c-9d1d-63c2becad337/volumes/kubernetes.io~secret/apiservice-cert DeviceMajor:0 DeviceMinor:559 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/f797ab14-0eb5-48b4-b914-f434f67c4c49/volumes/kubernetes.io~secret/cluster-storage-operator-serving-cert DeviceMajor:0 DeviceMinor:1086 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/434ed9b9-715b-455b-867c-775b256df40f/volumes/kubernetes.io~secret/srv-cert DeviceMajor:0 DeviceMinor:645 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/c835660f-5a79-4679-b9be-8543ca6ef5a1/volumes/kubernetes.io~projected/kube-api-access-nxbts DeviceMajor:0 DeviceMinor:1011 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1160 DeviceMajor:0 DeviceMinor:1160 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6cab7196e003292e61274a565af49a44adbe51e465702618783576ef89e2744f/userdata/shm DeviceMajor:0 DeviceMinor:330 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/354afa270a03f605fb9c3a24836a29639ae548ebb6cbeb7266228ae3871f1cba/userdata/shm DeviceMajor:0 DeviceMinor:106 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-130 DeviceMajor:0 DeviceMinor:130 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-390 DeviceMajor:0 DeviceMinor:390 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-832 DeviceMajor:0 DeviceMinor:832 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1354 DeviceMajor:0 DeviceMinor:1354 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-197 DeviceMajor:0 DeviceMinor:197 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/73c1f951bd9264b3f0b9e21c0ff82a20649a61998f0c539575a5fc18eabd1838/userdata/shm DeviceMajor:0 DeviceMinor:614 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-981 DeviceMajor:0 DeviceMinor:981 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-48 DeviceMajor:0 DeviceMinor:48 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1170 DeviceMajor:0 DeviceMinor:1170 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-430 DeviceMajor:0 DeviceMinor:430 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1185 DeviceMajor:0 DeviceMinor:1185 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-637 DeviceMajor:0 DeviceMinor:637 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/287fba2d-f56d-4ec0-b796-7849a68fb411/volumes/kubernetes.io~projected/kube-api-access-gmdvf DeviceMajor:0 DeviceMinor:159 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-236 DeviceMajor:0 DeviceMinor:236 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-753 DeviceMajor:0 DeviceMinor:753 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-781 DeviceMajor:0 DeviceMinor:781 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:806 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d2441e00fc894bfa5cbf2617e8f186e2a83b2ef94e0fc84c991a8adba8c891ea/userdata/shm DeviceMajor:0 DeviceMinor:586 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-556 DeviceMajor:0 DeviceMinor:556 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/dev/vda3 DeviceMajor:252 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-93 DeviceMajor:0 DeviceMinor:93 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-480 DeviceMajor:0 DeviceMinor:480 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9/volumes/kubernetes.io~secret/etcd-client DeviceMajor:0 DeviceMinor:654 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-850 DeviceMajor:0 DeviceMinor:850 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1137 DeviceMajor:0 DeviceMinor:1137 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-138 DeviceMajor:0 DeviceMinor:138 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-151 DeviceMajor:0 DeviceMinor:151 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/0158c2f3-20e5-43f4-875d-c5ad8f6112df/volumes/kubernetes.io~projected/kube-api-access-8cxbd DeviceMajor:0 DeviceMinor:317 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-451 DeviceMajor:0 DeviceMinor:451 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-604 DeviceMajor:0 DeviceMinor:604 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/330553d2-40ea-4496-8346-2e5bf680669b/volumes/kubernetes.io~projected/kube-api-access-59pbp DeviceMajor:0 DeviceMinor:348 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3015234670ad18f7c398b493ca22ed29544c1a67b53fd16b0177b13130626f13/userdata/shm DeviceMajor:0 DeviceMinor:884 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ba0de6266360c15b4570569e0e059ef77c45c81e15ccf07f9601d54c2d9635c0/userdata/shm DeviceMajor:0 DeviceMinor:107 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/c790c174-dc60-4f34-8818-3b367fbe3a5f/volumes/kubernetes.io~projected/kube-api-access-6lxhl DeviceMajor:0 DeviceMinor:125 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/3322cc5a-f1f7-4522-b423-19fb7f38cd43/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:290 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-788 DeviceMajor:0 DeviceMinor:788 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-442 DeviceMajor:0 DeviceMinor:442 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-221 DeviceMajor:0 DeviceMinor:221 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-544 DeviceMajor:0 DeviceMinor:544 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-728 DeviceMajor:0 DeviceMinor:728 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/157eab0c-0d8d-486b-a349-c2e466e18e0c/volumes/kubernetes.io~projected/kube-api-access-p2mhg DeviceMajor:0 DeviceMinor:158 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae/volumes/kubernetes.io~projected/kube-api-access-tltk9 DeviceMajor:0 DeviceMinor:783 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1002 DeviceMajor:0 DeviceMinor:1002 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9209d07e9d452425b2d2ddf357828c438f519980e0dbf9221a16c945f07adb72/userdata/shm DeviceMajor:0 DeviceMinor:650 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/27576028-d64a-47cd-b76b-d524e41efe37/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:288 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/eadb6c5599ab1a4ae90f8ecda2c7a886a86c701b1c6361b22d8aa8fc4c814262/userdata/shm DeviceMajor:0 DeviceMinor:306 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:1071 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639/volumes/kubernetes.io~projected/kube-api-access-2pqsl DeviceMajor:0 DeviceMinor:1072 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1039 DeviceMajor:0 DeviceMinor:1039 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-514 DeviceMajor:0 DeviceMinor:514 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/870c232b93a5ee37a81fedb1347de97a51e51c964baa741a79bf8da03ca09932/userdata/shm DeviceMajor:0 DeviceMinor:54 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-199 DeviceMajor:0 DeviceMinor:199 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-367 DeviceMajor:0 DeviceMinor:367 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-716 DeviceMajor:0 DeviceMinor:716 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/597a9e4435c6089676e0fa68a7916eee6043cc3e40b07033c316c40839d7d999/userdata/shm DeviceMajor:0 DeviceMinor:583 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-377 DeviceMajor:0 DeviceMinor:377 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-805 DeviceMajor:0 DeviceMinor:805 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/ffaf95be-586c-40fa-b15f-1beaffe7ff1c/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:124 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-95 DeviceMajor:0 DeviceMinor:95 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-393 DeviceMajor:0 DeviceMinor:393 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-692 DeviceMajor:0 DeviceMinor:692 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-627 DeviceMajor:0 DeviceMinor:627 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/64d30b80-2336-49c2-a2c2-1e0694036a84/volumes/kubernetes.io~secret/cloud-credential-operator-serving-cert DeviceMajor:0 DeviceMinor:1050 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-357 DeviceMajor:0 DeviceMinor:357 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1126 DeviceMajor:0 DeviceMinor:1126 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/ccf1cb9e-8885-4224-92d5-d1b116bc0090/volumes/kubernetes.io~secret/samples-operator-tls DeviceMajor:0 DeviceMinor:1055 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e64b7e965ab85bcd41866acdf04d1346eef2d43597395fb0ad995548a3c03068/userdata/shm DeviceMajor:0 DeviceMinor:326 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/43dcc9c0ef931e3436340e17ac24b9225ef01b32e75d1a2065a16822407e5048/userdata/shm DeviceMajor:0 DeviceMinor:562 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/c91e6234-52c5-41c0-a1ff-6a92932b83cd/volumes/kubernetes.io~projected/kube-api-access-rc244 DeviceMajor:0 DeviceMinor:603 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-81 DeviceMajor:0 DeviceMinor:81 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-205 DeviceMajor:0 DeviceMinor:205 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/1ade9186-b262-4b5e-9c6f-ba89f0130fb6/volumes/kubernetes.io~projected/kube-api-access-t46k7 DeviceMajor:0 DeviceMinor:323 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46/volumes/kubernetes.io~secret/package-server-manager-serving-cert DeviceMajor:0 DeviceMinor:649 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ea46e001e83a6c3de3d0e1b94f621607bbf3b37c1d2ff600eca3937d30803913/userdata/shm DeviceMajor:0 DeviceMinor:790 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/f925fe60-b5b7-4a5a-9800-3546334da725/volumes/kubernetes.io~projected/kube-api-access-2mzvm DeviceMajor:0 DeviceMinor:640 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/var/lib/kubelet/pods/08550069-c1a1-475e-84a2-e56905f1ed38/volumes/kubernetes.io~projected/kube-api-access-8cffn DeviceMajor:0 DeviceMinor:301 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-844 DeviceMajor:0 DeviceMinor:844 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-681 DeviceMajor:0 DeviceMinor:681 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1de82f0d2145eda0963037fc5194d3ed0ef6f28ba0425692586ec1b2d5c1a8d7/userdata/shm DeviceMajor:0 DeviceMinor:53 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-66 DeviceMajor:0 DeviceMinor:66 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1088 DeviceMajor:0 DeviceMinor:1088 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1331 DeviceMajor:0 DeviceMinor:1331 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/612a0c5312df7f19a5e3a086b42a22b55f539c232badbe0a03979b12eb756461/userdata/shm DeviceMajor:0 DeviceMinor:343 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-371 DeviceMajor:0 DeviceMinor:371 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/d8fca733-45c8-45b8-8653-ac204e7c6098/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:646 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-425 DeviceMajor:0 DeviceMinor:425 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b19546f46eaddad7163bb8c25c987ab9b0d1e6ccae50bd40bb5bd44e80ea64cb/userdata/shm DeviceMajor:0 DeviceMinor:188 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-720 DeviceMajor:0 DeviceMinor:720 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bae7cb91a4042c94b674a12af151b5562dfcde35982f682375aba774df863de4/userdata/shm DeviceMajor:0 DeviceMinor:471 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-440 DeviceMajor:0 DeviceMinor:440 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2258f6af8e03d9e9b2176864d007811f1c2157002d410c1abd99bd0f7a698646/userdata/shm DeviceMajor:0 DeviceMinor:1326 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1417 DeviceMajor:0 DeviceMinor:1417 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-568 DeviceMajor:0 DeviceMinor:568 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-373 DeviceMajor:0 DeviceMinor:373 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/786de756c2bbfc0e0c7e3711833e432deb88e55c1e571e200028809dee015dd2/userdata/shm DeviceMajor:0 DeviceMinor:486 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-831 DeviceMajor:0 DeviceMinor:831 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f406e5ed7d285ce7a027888d7e8f01827254b6187dd34070ea866b782bc7fc5c/userdata/shm DeviceMajor:0 DeviceMinor:1099 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1389 DeviceMajor:0 DeviceMinor:1389 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-1336 DeviceMajor:0 DeviceMinor:1336 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-490 DeviceMajor:0 DeviceMinor:490 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9f0c60cb6b9dab33f815706515da2ff65774b603ef38e904976aabef8f51a1be/userdata/shm DeviceMajor:0 DeviceMinor:660 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d87bd21afe82e9e2b6c4d808bf699abec2e43c9e57cadeb786171c447db8bbfe/userdata/shm DeviceMajor:0 DeviceMinor:662 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-1378 DeviceMajor:0 DeviceMinor:1378 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-916 DeviceMajor:0 DeviceMinor:916 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-363 DeviceMajor:0 DeviceMinor:363 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/633c1d5f3a3bae71b1e74d7bb8c0b438d99900f59c81ad94f6fad5a2189395ea/userdata/shm DeviceMajor:0 DeviceMinor:680 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-62 DeviceMajor:0 DeviceMinor:62 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-361 DeviceMajor:0 DeviceMinor:361 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5c0e8a1ff66497ba460c926920322631645b0bfd118367bdd87314c14c19d316/userdata/shm DeviceMajor:0 DeviceMinor:476 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-934 DeviceMajor:0 DeviceMinor:934 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/80b7010f11c99ac14cabd3f2b1f486b53fdcc69d5c12f6e72980c019a365f3ae/userdata/shm DeviceMajor:0 DeviceMinor:1078 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-995 DeviceMajor:0 DeviceMinor:995 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/var/lib/kubelet/pods/7bf67a51-9759-4e2a-a2ae-ef7416cad43f/volumes/kubernetes.io~secret/profile-collector-cert DeviceMajor:0 DeviceMinor:294 Capacity:49335554048 Type:vfs Inodes:6166278 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5a1b18048a411d2d744b17951526af70eccaa227a92df3b43814bef05c92e2a1/userdata/shm DeviceMajor:0 DeviceMinor:51 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true} {Device:overlay_0-505 DeviceMajor:0 DeviceMinor:505 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-749 DeviceMajor:0 DeviceMinor:749 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:overlay_0-115 DeviceMajor:0 DeviceMinor:115 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true} {Device:/run/containers/storage/overlay-containers/86e405dadeb983de0c61fd791085ee3cc704ca6463b209f2814b958275b8c70d/userdata/shm DeviceMajor:0 DeviceMinor:484 Capacity:67108864 Type:vfs Inodes:6166278 HasInodes:true}] DiskMap:map[252:0:{Name:vda Major:252 Minor:0 Size:214748364800 Scheduler:none} 252:16:{Name:vdb Major:252 Minor:16 Size:21474836480 Scheduler:none} 252:32:{Name:vdc Major:252 Minor:32 Size:21474836480 Scheduler:none} 252:48:{Name:vdd Major:252 Minor:48 Size:21474836480 Scheduler:none} 252:64:{Name:vde Major:252 Minor:64 Size:21474836480 Scheduler:none}] NetworkDevices:[{Name:067d2ebf7cd7132 MacAddress:92:db:fd:ef:d1:c9 Speed:10000 Mtu:8900} {Name:0d019de7666ab42 MacAddress:d6:7e:6a:ac:ae:19 Speed:10000 Mtu:8900} {Name:1de82f0d2145eda MacAddress:12:aa:95:14:f0:87 Speed:10000 Mtu:8900} {Name:1f986c9fd7cca35 MacAddress:ae:ef:e3:a0:ce:09 Speed:10000 Mtu:8900} {Name:2258f6af8e03d9e MacAddress:56:91:a3:a2:89:4b Speed:10000 Mtu:8900} {Name:3015234670ad18f MacAddress:1e:f6:37:38:df:2c Speed:10000 Mtu:8900} {Name:34d78076625efac MacAddress:ca:4e:d8:50:10:97 Speed:10000 Mtu:8900} {Name:43dcc9c0ef931e3 MacAddress:76:2b:ad:ad:f4:95 Speed:10000 Mtu:8900} {Name:4c6405b67db7763 MacAddress:d2:61:54:c3:4b:da Speed:10000 Mtu:8900} {Name:4e4d27e58584302 MacAddress:da:e6:84:23:c2:14 Speed:10000 Mtu:8900} {Name:52fc4812931b1d9 MacAddress:e6:87:23:bb:42:64 Speed:10000 Mtu:8900} {Name:597a9e4435c6089 MacAddress:ca:76:05:ba:16:22 Speed:10000 Mtu:8900} {Name:5b961ab6b54b9fe MacAddress:a2:75:06:f0:59:3e Speed:10000 Mtu:8900} {Name:5c0e8a1ff66497b MacAddress:6a:28:7a:0a:51:e9 Speed:10000 Mtu:8900} {Name:5f6e465bf3a100d MacAddress:22:ed:5e:d8:08:32 Speed:10000 Mtu:8900} {Name:612a0c5312df7f1 MacAddress:16:a5:9c:1f:89:b4 Speed:10000 Mtu:8900} {Name:633c1d5f3a3bae7 MacAddress:8e:e9:60:6d:79:7a Speed:10000 Mtu:8900} {Name:6cab7196e003292 MacAddress:8e:4a:9f:53:4e:42 Speed:10000 Mtu:8900} {Name:73c1f951bd9264b MacAddress:06:cf:1f:99:74:cc Speed:10000 Mtu:8900} {Name:7458153a023b91d MacAddress:aa:0c:d9:9d:cb:c0 Speed:10000 Mtu:8900} {Name:773244d15d95d10 MacAddress:42:ae:a1:e0:b0:42 Speed:10000 Mtu:8900} {Name:786de756c2bbfc0 MacAddress:ca:6a:02:f5:ab:6f Speed:10000 Mtu:8900} {Name:7e5d9f59cc52a03 MacAddress:ba:8a:66:3a:84:18 Speed:10000 Mtu:8900} {Name:80b7010f11c99ac MacAddress:3a:2e:d8:a0:0b:b9 Speed:10000 Mtu:8900} {Name:86e405dadeb983d MacAddress:92:31:5a:78:bd:d4 Speed:10000 Mtu:8900} {Name:9209d07e9d45242 MacAddress:ba:ce:f9:b7:25:0c Speed:10000 Mtu:8900} {Name:97556f365f16c1e MacAddress:32:3a:e9:db:64:2c Speed:10000 Mtu:8900} {Name:9b1319524752363 MacAddress:82:de:d0:97:91:4c Speed:10000 Mtu:8900} {Name:9f0c60cb6b9dab3 MacAddress:ba:b9:c5:29:1c:e4 Speed:10000 Mtu:8900} {Name:bae7cb91a4042c9 MacAddress:76:94:a7:f5:a1:fc Speed:10000 Mtu:8900} {Name:be595cb0f6bc539 MacAddress:0e:e1:87:f4:9c:cf Speed:10000 Mtu:8900} {Name:br-ex MacAddress:fa:16:9e:81:f6:10 Speed:0 Mtu:9000} {Name:br-int MacAddress:52:4c:8d:e7:50:61 Speed:0 Mtu:8900} {Name:c13740ec53fb929 MacAddress:82:37:8e:42:f9:26 Speed:10000 Mtu:8900} {Name:c2c98fa5f1fd472 MacAddress:da:0f:f0:25:73:38 Speed:10000 Mtu:8900} {Name:c2ef6f4b0380486 MacAddress:3a:9e:96:e6:b0:9b Speed:10000 Mtu:8900} {Name:c76231902c039c3 MacAddress:a6:da:3f:7d:e7:b9 Speed:10000 Mtu:8900} {Name:cbad8f519fca562 MacAddress:66:18:be:bb:53:4a Speed:10000 Mtu:8900} {Name:d1fbec2f91180eb MacAddress:1a:11:2b:b0:84:a8 Speed:10000 Mtu:8900} {Name:d2441e00fc894bf MacAddress:7e:ad:fc:fa:fd:41 Speed:10000 Mtu:8900} {Name:d87bd21afe82e9e MacAddress:fe:71:a6:c6:97:9d Speed:10000 Mtu:8900} {Name:d9d667bd2c388cd MacAddress:ca:9a:63:c1:17:78 Speed:10000 Mtu:8900} {Name:da23ebdcd7c632c MacAddress:3e:40:b1:34:3d:d1 Speed:10000 Mtu:8900} {Name:dc99390b4f6b05b MacAddress:8e:1d:3d:46:ae:a8 Speed:10000 Mtu:8900} {Name:e64b7e965ab85bc MacAddress:42:68:d6:3c:57:af Speed:10000 Mtu:8900} {Name:ea46e001e83a6c3 MacAddress:e2:e7:9e:e1:16:ae Speed:10000 Mtu:8900} {Name:eadb6c5599ab1a4 MacAddress:86:f3:a8:7d:a4:d1 Speed:10000 Mtu:8900} {Name:eth0 MacAddress:fa:16:9e:81:f6:10 Speed:-1 Mtu:9000} {Name:eth1 MacAddress:fa:16:3e:d8:74:65 Speed:-1 Mtu:9000} {Name:eth2 MacAddress:fa:16:3e:d4:99:db Speed:-1 Mtu:9000} {Name:f406e5ed7d285ce MacAddress:d2:d5:24:9d:ed:55 Speed:10000 Mtu:8900} {Name:f79899a7403dcd8 MacAddress:f6:f2:24:d9:46:e4 Speed:10000 Mtu:8900} {Name:f98dcde4da5cf13 MacAddress:be:e4:41:93:b9:09 Speed:10000 Mtu:8900} {Name:fa255b4fd328cf9 MacAddress:1e:d9:18:42:e2:e9 Speed:10000 Mtu:8900} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:80:00:02 Speed:0 Mtu:8900} {Name:ovs-system MacAddress:ce:07:4b:8f:0c:d7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:50514153472 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:0 Size:16777216 Type:Unified Level:3}] SocketID:0 BookID: DrawerID:} {Id:0 Threads:[1] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:1 Size:16777216 Type:Unified Level:3}] SocketID:1 BookID: DrawerID:} {Id:0 Threads:[10] Caches:[{Id:10 Size:32768 Type:Data Level:1} {Id:10 Size:32768 Type:Instruction Level:1} {Id:10 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:10 Size:16777216 Type:Unified Level:3}] SocketID:10 BookID: DrawerID:} {Id:0 Threads:[11] Caches:[{Id:11 Size:32768 Type:Data Level:1} {Id:11 Size:32768 Type:Instruction Level:1} {Id:11 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:11 Size:16777216 Type:Unified Level:3}] SocketID:11 BookID: DrawerID:} {Id:0 Threads:[12] Caches:[{Id:12 Size:32768 Type:Data Level:1} {Id:12 Size:32768 Type:Instruction Level:1} {Id:12 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:12 Size:16777216 Type:Unified Level:3}] SocketID:12 BookID: DrawerID:} {Id:0 Threads:[13] Caches:[{Id:13 Size:32768 Type:Data Level:1} {Id:13 Size:32768 Type:Instruction Level:1} {Id:13 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:13 Size:16777216 Type:Unified Level:3}] SocketID:13 BookID: DrawerID:} {Id:0 Threads:[14] Caches:[{Id:14 Size:32768 Type:Data Level:1} {Id:14 Size:32768 Type:Instruction Level:1} {Id:14 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:14 Size:16777216 Type:Unified Level:3}] SocketID:14 BookID: DrawerID:} {Id:0 Threads:[15] Caches:[{Id:15 Size:32768 Type:Data Level:1} {Id:15 Size:32768 Type:Instruction Level:1} {Id:15 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:15 Size:16777216 Type:Unified Level:3}] SocketID:15 BookID: DrawerID:} {Id:0 Threads:[2] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:2 Size:16777216 Type:Unified Level:3}] SocketID:2 BookID: DrawerID:} {Id:0 Threads:[3] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:3 Size:16777216 Type:Unified Level:3}] SocketID:3 BookID: DrawerID:} {Id:0 Threads:[4] Caches:[{Id:4 Size:32768 Type:Data Level:1} {Id:4 Size:32768 Type:Instruction Level:1} {Id:4 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:4 Size:16777216 Type:Unified Level:3}] SocketID:4 BookID: DrawerID:} {Id:0 Threads:[5] Caches:[{Id:5 Size:32768 Type:Data Level:1} {Id:5 Size:32768 Type:Instruction Level:1} {Id:5 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:5 Size:16777216 Type:Unified Level:3}] SocketID:5 BookID: DrawerID:} {Id:0 Threads:[6] Caches:[{Id:6 Size:32768 Type:Data Level:1} {Id:6 Size:32768 Type:Instruction Level:1} {Id:6 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:6 Size:16777216 Type:Unified Level:3}] SocketID:6 BookID: DrawerID:} {Id:0 Threads:[7] Caches:[{Id:7 Size:32768 Type:Data Level:1} {Id:7 Size:32768 Type:Instruction Level:1} {Id:7 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:7 Size:16777216 Type:Unified Level:3}] SocketID:7 BookID: DrawerID:} {Id:0 Threads:[8] Caches:[{Id:8 Size:32768 Type:Data Level:1} {Id:8 Size:32768 Type:Instruction Level:1} {Id:8 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:8 Size:16777216 Type:Unified Level:3}] SocketID:8 BookID: DrawerID:} {Id:0 Threads:[9] Caches:[{Id:9 Size:32768 Type:Data Level:1} {Id:9 Size:32768 Type:Instruction Level:1} {Id:9 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:9 Size:16777216 Type:Unified Level:3}] SocketID:9 BookID: DrawerID:}] Caches:[] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Dec 04 11:59:16.682739 master-0 kubenswrapper[35367]: I1204 11:59:16.681574 35367 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Dec 04 11:59:16.682739 master-0 kubenswrapper[35367]: I1204 11:59:16.681762 35367 manager.go:233] Version: {KernelVersion:5.14.0-427.100.1.el9_4.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 418.94.202511170715-0 DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Dec 04 11:59:16.682739 master-0 kubenswrapper[35367]: I1204 11:59:16.682112 35367 swap_util.go:113] "Swap is on" /proc/swaps contents="Filename\t\t\t\tType\t\tSize\t\tUsed\t\tPriority" Dec 04 11:59:16.682739 master-0 kubenswrapper[35367]: I1204 11:59:16.682316 35367 container_manager_linux.go:267] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Dec 04 11:59:16.682739 master-0 kubenswrapper[35367]: I1204 11:59:16.682349 35367 container_manager_linux.go:272] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"master-0","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"ExperimentalMemoryManagerPolicy":"None","ExperimentalMemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Dec 04 11:59:16.682739 master-0 kubenswrapper[35367]: I1204 11:59:16.682569 35367 topology_manager.go:138] "Creating topology manager with none policy" Dec 04 11:59:16.682739 master-0 kubenswrapper[35367]: I1204 11:59:16.682581 35367 container_manager_linux.go:303] "Creating device plugin manager" Dec 04 11:59:16.682739 master-0 kubenswrapper[35367]: I1204 11:59:16.682591 35367 manager.go:142] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Dec 04 11:59:16.682739 master-0 kubenswrapper[35367]: I1204 11:59:16.682617 35367 server.go:66] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Dec 04 11:59:16.682739 master-0 kubenswrapper[35367]: I1204 11:59:16.682655 35367 state_mem.go:36] "Initialized new in-memory state store" Dec 04 11:59:16.682739 master-0 kubenswrapper[35367]: I1204 11:59:16.682752 35367 server.go:1245] "Using root directory" path="/var/lib/kubelet" Dec 04 11:59:16.684030 master-0 kubenswrapper[35367]: I1204 11:59:16.682830 35367 kubelet.go:418] "Attempting to sync node with API server" Dec 04 11:59:16.684030 master-0 kubenswrapper[35367]: I1204 11:59:16.682845 35367 kubelet.go:313] "Adding static pod path" path="/etc/kubernetes/manifests" Dec 04 11:59:16.684030 master-0 kubenswrapper[35367]: I1204 11:59:16.682859 35367 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Dec 04 11:59:16.684030 master-0 kubenswrapper[35367]: I1204 11:59:16.682871 35367 kubelet.go:324] "Adding apiserver pod source" Dec 04 11:59:16.684030 master-0 kubenswrapper[35367]: I1204 11:59:16.682887 35367 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Dec 04 11:59:16.684928 master-0 kubenswrapper[35367]: I1204 11:59:16.684862 35367 kuberuntime_manager.go:262] "Container runtime initialized" containerRuntime="cri-o" version="1.31.13-2.rhaos4.18.git15789b8.el9" apiVersion="v1" Dec 04 11:59:16.685197 master-0 kubenswrapper[35367]: I1204 11:59:16.685141 35367 certificate_store.go:130] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-server-current.pem". Dec 04 11:59:16.685551 master-0 kubenswrapper[35367]: I1204 11:59:16.685459 35367 kubelet.go:854] "Not starting ClusterTrustBundle informer because we are in static kubelet mode" Dec 04 11:59:16.685722 master-0 kubenswrapper[35367]: I1204 11:59:16.685689 35367 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Dec 04 11:59:16.685722 master-0 kubenswrapper[35367]: I1204 11:59:16.685717 35367 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Dec 04 11:59:16.685722 master-0 kubenswrapper[35367]: I1204 11:59:16.685728 35367 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Dec 04 11:59:16.686063 master-0 kubenswrapper[35367]: I1204 11:59:16.685736 35367 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Dec 04 11:59:16.686063 master-0 kubenswrapper[35367]: I1204 11:59:16.685745 35367 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Dec 04 11:59:16.686063 master-0 kubenswrapper[35367]: I1204 11:59:16.685761 35367 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/secret" Dec 04 11:59:16.686063 master-0 kubenswrapper[35367]: I1204 11:59:16.685770 35367 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Dec 04 11:59:16.686063 master-0 kubenswrapper[35367]: I1204 11:59:16.685777 35367 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Dec 04 11:59:16.686063 master-0 kubenswrapper[35367]: I1204 11:59:16.685787 35367 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/fc" Dec 04 11:59:16.686063 master-0 kubenswrapper[35367]: I1204 11:59:16.685796 35367 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Dec 04 11:59:16.686063 master-0 kubenswrapper[35367]: I1204 11:59:16.685822 35367 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/projected" Dec 04 11:59:16.686063 master-0 kubenswrapper[35367]: I1204 11:59:16.685836 35367 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Dec 04 11:59:16.686063 master-0 kubenswrapper[35367]: I1204 11:59:16.685980 35367 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/csi" Dec 04 11:59:16.687145 master-0 kubenswrapper[35367]: W1204 11:59:16.686638 35367 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://api-int.sno.openstack.lab:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:59:16.687145 master-0 kubenswrapper[35367]: E1204 11:59:16.686729 35367 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get \"https://api-int.sno.openstack.lab:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:59:16.687145 master-0 kubenswrapper[35367]: W1204 11:59:16.686748 35367 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://api-int.sno.openstack.lab:6443/api/v1/nodes?fieldSelector=metadata.name%3Dmaster-0&limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:59:16.687145 master-0 kubenswrapper[35367]: E1204 11:59:16.686852 35367 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes?fieldSelector=metadata.name%3Dmaster-0&limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:59:16.687379 master-0 kubenswrapper[35367]: I1204 11:59:16.687292 35367 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:59:16.687786 master-0 kubenswrapper[35367]: I1204 11:59:16.687737 35367 server.go:1280] "Started kubelet" Dec 04 11:59:16.688159 master-0 kubenswrapper[35367]: I1204 11:59:16.688085 35367 server.go:163] "Starting to listen" address="0.0.0.0" port=10250 Dec 04 11:59:16.688260 master-0 kubenswrapper[35367]: I1204 11:59:16.688080 35367 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Dec 04 11:59:16.688260 master-0 kubenswrapper[35367]: I1204 11:59:16.688234 35367 server_v1.go:47] "podresources" method="list" useActivePods=true Dec 04 11:59:16.688984 master-0 kubenswrapper[35367]: I1204 11:59:16.688933 35367 server.go:236] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Dec 04 11:59:16.689188 master-0 kubenswrapper[35367]: E1204 11:59:16.689017 35367 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/default/events\": dial tcp 192.168.32.10:6443: connect: connection refused" event="&Event{ObjectMeta:{master-0.187e01523c60686c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 11:59:16.687710316 +0000 UTC m=+0.125771564,LastTimestamp:2025-12-04 11:59:16.687710316 +0000 UTC m=+0.125771564,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 11:59:16.689532 master-0 kubenswrapper[35367]: I1204 11:59:16.689492 35367 server.go:449] "Adding debug handlers to kubelet server" Dec 04 11:59:16.693652 master-0 systemd[1]: Started Kubernetes Kubelet. Dec 04 11:59:16.702943 master-0 kubenswrapper[35367]: E1204 11:59:16.702881 35367 kubelet.go:1495] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Dec 04 11:59:16.705315 master-0 kubenswrapper[35367]: I1204 11:59:16.705240 35367 certificate_manager.go:356] kubernetes.io/kubelet-serving: Certificate rotation is enabled Dec 04 11:59:16.705315 master-0 kubenswrapper[35367]: I1204 11:59:16.705315 35367 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Dec 04 11:59:16.705456 master-0 kubenswrapper[35367]: I1204 11:59:16.705374 35367 certificate_manager.go:356] kubernetes.io/kubelet-serving: Certificate expiration is 2025-12-05 11:26:53 +0000 UTC, rotation deadline is 2025-12-05 08:43:55.789843247 +0000 UTC Dec 04 11:59:16.705456 master-0 kubenswrapper[35367]: I1204 11:59:16.705430 35367 certificate_manager.go:356] kubernetes.io/kubelet-serving: Waiting 20h44m39.084415709s for next certificate rotation Dec 04 11:59:16.705541 master-0 kubenswrapper[35367]: I1204 11:59:16.705448 35367 volume_manager.go:287] "The desired_state_of_world populator starts" Dec 04 11:59:16.705541 master-0 kubenswrapper[35367]: I1204 11:59:16.705509 35367 volume_manager.go:289] "Starting Kubelet Volume Manager" Dec 04 11:59:16.705541 master-0 kubenswrapper[35367]: I1204 11:59:16.705532 35367 desired_state_of_world_populator.go:147] "Desired state populator starts to run" Dec 04 11:59:16.705635 master-0 kubenswrapper[35367]: E1204 11:59:16.705464 35367 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:59:16.706781 master-0 kubenswrapper[35367]: E1204 11:59:16.706575 35367 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="200ms" Dec 04 11:59:16.706781 master-0 kubenswrapper[35367]: W1204 11:59:16.706590 35367 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:59:16.706781 master-0 kubenswrapper[35367]: I1204 11:59:16.706661 35367 factory.go:219] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Dec 04 11:59:16.706781 master-0 kubenswrapper[35367]: I1204 11:59:16.706677 35367 factory.go:55] Registering systemd factory Dec 04 11:59:16.706781 master-0 kubenswrapper[35367]: I1204 11:59:16.706686 35367 factory.go:221] Registration of the systemd container factory successfully Dec 04 11:59:16.706781 master-0 kubenswrapper[35367]: E1204 11:59:16.706670 35367 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get \"https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:59:16.707008 master-0 kubenswrapper[35367]: I1204 11:59:16.706996 35367 factory.go:153] Registering CRI-O factory Dec 04 11:59:16.707048 master-0 kubenswrapper[35367]: I1204 11:59:16.707016 35367 factory.go:221] Registration of the crio container factory successfully Dec 04 11:59:16.707048 master-0 kubenswrapper[35367]: I1204 11:59:16.707045 35367 factory.go:103] Registering Raw factory Dec 04 11:59:16.707166 master-0 kubenswrapper[35367]: I1204 11:59:16.707061 35367 manager.go:1196] Started watching for new ooms in manager Dec 04 11:59:16.707663 master-0 kubenswrapper[35367]: I1204 11:59:16.707628 35367 manager.go:319] Starting recovery of all containers Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.715669 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="24506aa4-ab78-49df-bb58-59093498f13d" volumeName="kubernetes.io/secret/24506aa4-ab78-49df-bb58-59093498f13d-serving-cert" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.715767 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="287fba2d-f56d-4ec0-b796-7849a68fb411" volumeName="kubernetes.io/configmap/287fba2d-f56d-4ec0-b796-7849a68fb411-ovnkube-config" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.715793 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e3160a9-11d1-4845-ba30-1a49ae7339a9" volumeName="kubernetes.io/configmap/7e3160a9-11d1-4845-ba30-1a49ae7339a9-config" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.715833 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8e5e33b0-4e2e-464c-ba5b-cbd2048004f8" volumeName="kubernetes.io/configmap/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-config" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.715854 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6e9271a-44ea-4612-ab60-4a9d489ed062" volumeName="kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-service-ca" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.715873 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" volumeName="kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-auth-proxy-config" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.715891 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ffaf95be-586c-40fa-b15f-1beaffe7ff1c" volumeName="kubernetes.io/projected/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-kube-api-access-t6bkg" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.715912 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0158c2f3-20e5-43f4-875d-c5ad8f6112df" volumeName="kubernetes.io/projected/0158c2f3-20e5-43f4-875d-c5ad8f6112df-kube-api-access-8cxbd" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.715934 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ab26ae5-0607-4dfd-840e-531d204b5030" volumeName="kubernetes.io/projected/2ab26ae5-0607-4dfd-840e-531d204b5030-kube-api-access-mvzrc" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.715952 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="287fba2d-f56d-4ec0-b796-7849a68fb411" volumeName="kubernetes.io/projected/287fba2d-f56d-4ec0-b796-7849a68fb411-kube-api-access-gmdvf" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716347 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="330553d2-40ea-4496-8346-2e5bf680669b" volumeName="kubernetes.io/projected/330553d2-40ea-4496-8346-2e5bf680669b-kube-api-access-59pbp" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716366 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="42b3be0f-1d82-4a64-abb4-0118a6960efd" volumeName="kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-config" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716383 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7bf67a51-9759-4e2a-a2ae-ef7416cad43f" volumeName="kubernetes.io/projected/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-kube-api-access-zr454" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716407 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" volumeName="kubernetes.io/empty-dir/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c-utilities" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716425 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cdb50850-779d-4179-ba1d-65ffeb4bb2e9" volumeName="kubernetes.io/configmap/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-auth-proxy-config" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716444 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cdb50850-779d-4179-ba1d-65ffeb4bb2e9" volumeName="kubernetes.io/secret/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-proxy-tls" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716464 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="287fba2d-f56d-4ec0-b796-7849a68fb411" volumeName="kubernetes.io/configmap/287fba2d-f56d-4ec0-b796-7849a68fb411-env-overrides" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716483 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd4c4c6f-380a-4cda-9a21-352b55ec2d98" volumeName="kubernetes.io/configmap/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-trusted-ca" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716503 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1243d581-fa11-4db1-a01a-0cf64eb3ef74" volumeName="kubernetes.io/configmap/1243d581-fa11-4db1-a01a-0cf64eb3ef74-signing-cabundle" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716523 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" volumeName="kubernetes.io/projected/38fc8086-a00c-4a2a-8a0e-c57e9d9d0103-kube-api-access-l5r7w" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716542 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c790c174-dc60-4f34-8818-3b367fbe3a5f" volumeName="kubernetes.io/projected/c790c174-dc60-4f34-8818-3b367fbe3a5f-kube-api-access-6lxhl" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716561 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="08550069-c1a1-475e-84a2-e56905f1ed38" volumeName="kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716582 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" volumeName="kubernetes.io/empty-dir/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c-catalog-content" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716602 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bac00ac5-0371-48fd-b1cc-60438f08ae94" volumeName="kubernetes.io/configmap/bac00ac5-0371-48fd-b1cc-60438f08ae94-config" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716620 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ccf81538-4d5a-4c26-8e54-fe39331a625d" volumeName="kubernetes.io/secret/ccf81538-4d5a-4c26-8e54-fe39331a625d-serving-cert" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716642 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ec61be5-32f9-4aac-815f-41d173213107" volumeName="kubernetes.io/secret/7ec61be5-32f9-4aac-815f-41d173213107-etcd-client" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716664 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="157eab0c-0d8d-486b-a349-c2e466e18e0c" volumeName="kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-env-overrides" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716701 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7c017c69-b24e-4a7a-b888-133bed34c174" volumeName="kubernetes.io/projected/7c017c69-b24e-4a7a-b888-133bed34c174-kube-api-access-tlr76" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716734 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ec61be5-32f9-4aac-815f-41d173213107" volumeName="kubernetes.io/projected/7ec61be5-32f9-4aac-815f-41d173213107-kube-api-access-p2bpn" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716752 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5b826c3-8638-4cf5-b974-b24e4282ce00" volumeName="kubernetes.io/configmap/a5b826c3-8638-4cf5-b974-b24e4282ce00-config" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716768 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b011b1f1-3235-4e20-825b-ce711c052407" volumeName="kubernetes.io/configmap/b011b1f1-3235-4e20-825b-ce711c052407-trusted-ca" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716785 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bdfcb644-24ef-4a33-93ae-a855e872d29a" volumeName="kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-cni-binary-copy" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716802 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6e9271a-44ea-4612-ab60-4a9d489ed062" volumeName="kubernetes.io/secret/c6e9271a-44ea-4612-ab60-4a9d489ed062-serving-cert" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716848 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0c092f5d-bd33-4d91-9206-ce9c0b9e1aae" volumeName="kubernetes.io/configmap/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae-config-volume" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716867 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9" volumeName="kubernetes.io/secret/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-encryption-config" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716885 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1897bad8-3875-4bd6-b877-b1abe1fe76c7" volumeName="kubernetes.io/empty-dir/1897bad8-3875-4bd6-b877-b1abe1fe76c7-cache" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716902 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="27576028-d64a-47cd-b76b-d524e41efe37" volumeName="kubernetes.io/configmap/27576028-d64a-47cd-b76b-d524e41efe37-config" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716920 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="434ed9b9-715b-455b-867c-775b256df40f" volumeName="kubernetes.io/projected/434ed9b9-715b-455b-867c-775b256df40f-kube-api-access-ggzfm" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716939 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6f15dcdb-c968-429c-9d1d-63c2becad337" volumeName="kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716956 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e3160a9-11d1-4845-ba30-1a49ae7339a9" volumeName="kubernetes.io/secret/7e3160a9-11d1-4845-ba30-1a49ae7339a9-cert" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716974 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ec61be5-32f9-4aac-815f-41d173213107" volumeName="kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-etcd-serving-ca" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.716994 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a3558de2-46f8-48b5-a961-95decb7805cf" volumeName="kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717015 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0c092f5d-bd33-4d91-9206-ce9c0b9e1aae" volumeName="kubernetes.io/secret/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae-metrics-tls" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717033 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ccf1cb9e-8885-4224-92d5-d1b116bc0090" volumeName="kubernetes.io/secret/ccf1cb9e-8885-4224-92d5-d1b116bc0090-samples-operator-tls" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717051 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ccf81538-4d5a-4c26-8e54-fe39331a625d" volumeName="kubernetes.io/configmap/ccf81538-4d5a-4c26-8e54-fe39331a625d-config" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717070 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd9f8671-8066-4990-b45d-8b619aa5d9ec" volumeName="kubernetes.io/configmap/fd9f8671-8066-4990-b45d-8b619aa5d9ec-config" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717089 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd9f8671-8066-4990-b45d-8b619aa5d9ec" volumeName="kubernetes.io/projected/fd9f8671-8066-4990-b45d-8b619aa5d9ec-kube-api-access-llscb" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717107 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c91e6234-52c5-41c0-a1ff-6a92932b83cd" volumeName="kubernetes.io/empty-dir/c91e6234-52c5-41c0-a1ff-6a92932b83cd-tmp" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717126 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ade9186-b262-4b5e-9c6f-ba89f0130fb6" volumeName="kubernetes.io/projected/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-bound-sa-token" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717146 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e3160a9-11d1-4845-ba30-1a49ae7339a9" volumeName="kubernetes.io/secret/7e3160a9-11d1-4845-ba30-1a49ae7339a9-cluster-baremetal-operator-tls" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717164 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bdfcb644-24ef-4a33-93ae-a855e872d29a" volumeName="kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-whereabouts-configmap" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717183 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="031d300e-24b4-481c-8b82-fe8cdb3fcef7" volumeName="kubernetes.io/projected/031d300e-24b4-481c-8b82-fe8cdb3fcef7-kube-api-access-k7bhn" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717207 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ab26ae5-0607-4dfd-840e-531d204b5030" volumeName="kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717228 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7203ec93-6572-4032-825c-140029a86058" volumeName="kubernetes.io/configmap/7203ec93-6572-4032-825c-140029a86058-ovnkube-identity-cm" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717253 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bdfcb644-24ef-4a33-93ae-a855e872d29a" volumeName="kubernetes.io/projected/bdfcb644-24ef-4a33-93ae-a855e872d29a-kube-api-access-f4w2j" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717275 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="018e9ad3-c071-45c6-bfa6-e53dda20c757" volumeName="kubernetes.io/projected/018e9ad3-c071-45c6-bfa6-e53dda20c757-kube-api-access-bsvvf" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717298 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ade9186-b262-4b5e-9c6f-ba89f0130fb6" volumeName="kubernetes.io/configmap/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-trusted-ca" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717317 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ec61be5-32f9-4aac-815f-41d173213107" volumeName="kubernetes.io/secret/7ec61be5-32f9-4aac-815f-41d173213107-encryption-config" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717337 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5b826c3-8638-4cf5-b974-b24e4282ce00" volumeName="kubernetes.io/projected/a5b826c3-8638-4cf5-b974-b24e4282ce00-kube-api-access-rhmlm" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717356 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bac00ac5-0371-48fd-b1cc-60438f08ae94" volumeName="kubernetes.io/secret/bac00ac5-0371-48fd-b1cc-60438f08ae94-serving-cert" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717376 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f925fe60-b5b7-4a5a-9800-3546334da725" volumeName="kubernetes.io/empty-dir/f925fe60-b5b7-4a5a-9800-3546334da725-utilities" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717393 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd4c4c6f-380a-4cda-9a21-352b55ec2d98" volumeName="kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717412 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="08550069-c1a1-475e-84a2-e56905f1ed38" volumeName="kubernetes.io/projected/08550069-c1a1-475e-84a2-e56905f1ed38-kube-api-access-8cffn" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717431 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6f15dcdb-c968-429c-9d1d-63c2becad337" volumeName="kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717450 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6e9271a-44ea-4612-ab60-4a9d489ed062" volumeName="kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-ca" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717470 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c790c174-dc60-4f34-8818-3b367fbe3a5f" volumeName="kubernetes.io/configmap/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-daemon-config" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717488 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9" volumeName="kubernetes.io/configmap/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-etcd-serving-ca" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717519 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4d7939a-5961-4608-b910-73e71aa55bf6" volumeName="kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-config" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717536 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0fad065c-94c9-4a38-ab76-cf0266bdc04b" volumeName="kubernetes.io/projected/0fad065c-94c9-4a38-ab76-cf0266bdc04b-kube-api-access" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717553 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0158c2f3-20e5-43f4-875d-c5ad8f6112df" volumeName="kubernetes.io/empty-dir/0158c2f3-20e5-43f4-875d-c5ad8f6112df-operand-assets" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717572 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0158c2f3-20e5-43f4-875d-c5ad8f6112df" volumeName="kubernetes.io/secret/0158c2f3-20e5-43f4-875d-c5ad8f6112df-cluster-olm-operator-serving-cert" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717588 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0c092f5d-bd33-4d91-9206-ce9c0b9e1aae" volumeName="kubernetes.io/projected/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae-kube-api-access-tltk9" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717605 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="157eab0c-0d8d-486b-a349-c2e466e18e0c" volumeName="kubernetes.io/projected/157eab0c-0d8d-486b-a349-c2e466e18e0c-kube-api-access-p2mhg" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717623 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="72faf6d6-e8ca-43d1-b93e-67c11f8d3b46" volumeName="kubernetes.io/projected/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-kube-api-access-ckwnn" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717639 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b668f740-dbc3-48e0-9ebc-83bae3a43c83" volumeName="kubernetes.io/configmap/b668f740-dbc3-48e0-9ebc-83bae3a43c83-trusted-ca-bundle" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717657 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6e9271a-44ea-4612-ab60-4a9d489ed062" volumeName="kubernetes.io/secret/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-client" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717675 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="00601c1a-efd4-4366-bdc9-d768afa252b0" volumeName="kubernetes.io/empty-dir/00601c1a-efd4-4366-bdc9-d768afa252b0-available-featuregates" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717693 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c835660f-5a79-4679-b9be-8543ca6ef5a1" volumeName="kubernetes.io/configmap/c835660f-5a79-4679-b9be-8543ca6ef5a1-auth-proxy-config" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717711 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3322cc5a-f1f7-4522-b423-19fb7f38cd43" volumeName="kubernetes.io/projected/3322cc5a-f1f7-4522-b423-19fb7f38cd43-kube-api-access-k449s" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717728 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bdfcb644-24ef-4a33-93ae-a855e872d29a" volumeName="kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-cni-sysctl-allowlist" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717747 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ab26ae5-0607-4dfd-840e-531d204b5030" volumeName="kubernetes.io/configmap/2ab26ae5-0607-4dfd-840e-531d204b5030-telemetry-config" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717779 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c50317d3-f7cd-4133-845e-44add57ac378" volumeName="kubernetes.io/projected/c50317d3-f7cd-4133-845e-44add57ac378-kube-api-access-s2jw8" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717797 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" volumeName="kubernetes.io/secret/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-cloud-controller-manager-operator-tls" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717843 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1243d581-fa11-4db1-a01a-0cf64eb3ef74" volumeName="kubernetes.io/projected/1243d581-fa11-4db1-a01a-0cf64eb3ef74-kube-api-access-9q8d8" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717862 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b011b1f1-3235-4e20-825b-ce711c052407" volumeName="kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717879 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" volumeName="kubernetes.io/projected/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c-kube-api-access-v6z8r" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717899 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c835660f-5a79-4679-b9be-8543ca6ef5a1" volumeName="kubernetes.io/configmap/c835660f-5a79-4679-b9be-8543ca6ef5a1-config" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717915 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ccf1cb9e-8885-4224-92d5-d1b116bc0090" volumeName="kubernetes.io/projected/ccf1cb9e-8885-4224-92d5-d1b116bc0090-kube-api-access-8w6kv" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717933 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e3160a9-11d1-4845-ba30-1a49ae7339a9" volumeName="kubernetes.io/configmap/7e3160a9-11d1-4845-ba30-1a49ae7339a9-images" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717950 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5b826c3-8638-4cf5-b974-b24e4282ce00" volumeName="kubernetes.io/secret/a5b826c3-8638-4cf5-b974-b24e4282ce00-serving-cert" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717968 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b011b1f1-3235-4e20-825b-ce711c052407" volumeName="kubernetes.io/projected/b011b1f1-3235-4e20-825b-ce711c052407-kube-api-access-jq49f" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.717987 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6e9271a-44ea-4612-ab60-4a9d489ed062" volumeName="kubernetes.io/projected/c6e9271a-44ea-4612-ab60-4a9d489ed062-kube-api-access-cdsq5" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718006 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7203ec93-6572-4032-825c-140029a86058" volumeName="kubernetes.io/secret/7203ec93-6572-4032-825c-140029a86058-webhook-cert" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718035 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="157eab0c-0d8d-486b-a349-c2e466e18e0c" volumeName="kubernetes.io/secret/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovn-node-metrics-cert" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718051 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="42b3be0f-1d82-4a64-abb4-0118a6960efd" volumeName="kubernetes.io/secret/42b3be0f-1d82-4a64-abb4-0118a6960efd-serving-cert" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718077 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="64d30b80-2336-49c2-a2c2-1e0694036a84" volumeName="kubernetes.io/projected/64d30b80-2336-49c2-a2c2-1e0694036a84-kube-api-access-vgdmn" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718096 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6f15dcdb-c968-429c-9d1d-63c2becad337" volumeName="kubernetes.io/configmap/6f15dcdb-c968-429c-9d1d-63c2becad337-trusted-ca" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718116 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e3160a9-11d1-4845-ba30-1a49ae7339a9" volumeName="kubernetes.io/projected/7e3160a9-11d1-4845-ba30-1a49ae7339a9-kube-api-access-fksx7" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718134 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ec61be5-32f9-4aac-815f-41d173213107" volumeName="kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-trusted-ca-bundle" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718151 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ec61be5-32f9-4aac-815f-41d173213107" volumeName="kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-audit" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718171 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1243d581-fa11-4db1-a01a-0cf64eb3ef74" volumeName="kubernetes.io/secret/1243d581-fa11-4db1-a01a-0cf64eb3ef74-signing-key" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718190 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4d7939a-5961-4608-b910-73e71aa55bf6" volumeName="kubernetes.io/secret/e4d7939a-5961-4608-b910-73e71aa55bf6-serving-cert" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718208 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f925fe60-b5b7-4a5a-9800-3546334da725" volumeName="kubernetes.io/projected/f925fe60-b5b7-4a5a-9800-3546334da725-kube-api-access-2mzvm" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718225 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ccf81538-4d5a-4c26-8e54-fe39331a625d" volumeName="kubernetes.io/projected/ccf81538-4d5a-4c26-8e54-fe39331a625d-kube-api-access" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718277 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" volumeName="kubernetes.io/empty-dir/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-utilities" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718301 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="855d7874-16b1-47d0-82f6-d2b0c89b9a84" volumeName="kubernetes.io/secret/855d7874-16b1-47d0-82f6-d2b0c89b9a84-apiservice-cert" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718321 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f925fe60-b5b7-4a5a-9800-3546334da725" volumeName="kubernetes.io/empty-dir/f925fe60-b5b7-4a5a-9800-3546334da725-catalog-content" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718354 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="16057f9c-b1f8-4915-acc3-2d4532af4963" volumeName="kubernetes.io/projected/16057f9c-b1f8-4915-acc3-2d4532af4963-kube-api-access-lxnbc" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718377 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ade9186-b262-4b5e-9c6f-ba89f0130fb6" volumeName="kubernetes.io/projected/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-kube-api-access-t46k7" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718401 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="27576028-d64a-47cd-b76b-d524e41efe37" volumeName="kubernetes.io/secret/27576028-d64a-47cd-b76b-d524e41efe37-serving-cert" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718421 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="64d30b80-2336-49c2-a2c2-1e0694036a84" volumeName="kubernetes.io/configmap/64d30b80-2336-49c2-a2c2-1e0694036a84-cco-trusted-ca" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718442 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7bf67a51-9759-4e2a-a2ae-ef7416cad43f" volumeName="kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718459 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8e5e33b0-4e2e-464c-ba5b-cbd2048004f8" volumeName="kubernetes.io/secret/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-serving-cert" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718481 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b668f740-dbc3-48e0-9ebc-83bae3a43c83" volumeName="kubernetes.io/secret/b668f740-dbc3-48e0-9ebc-83bae3a43c83-serving-cert" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718499 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d8fca733-45c8-45b8-8653-ac204e7c6098" volumeName="kubernetes.io/projected/d8fca733-45c8-45b8-8653-ac204e7c6098-kube-api-access-2ncf9" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718519 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1897bad8-3875-4bd6-b877-b1abe1fe76c7" volumeName="kubernetes.io/projected/1897bad8-3875-4bd6-b877-b1abe1fe76c7-ca-certs" seLinuxMountContext="" Dec 04 11:59:16.718319 master-0 kubenswrapper[35367]: I1204 11:59:16.718538 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bac00ac5-0371-48fd-b1cc-60438f08ae94" volumeName="kubernetes.io/projected/bac00ac5-0371-48fd-b1cc-60438f08ae94-kube-api-access" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.718558 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c50317d3-f7cd-4133-845e-44add57ac378" volumeName="kubernetes.io/secret/c50317d3-f7cd-4133-845e-44add57ac378-machine-api-operator-tls" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.718581 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e7fc7c16-5bca-49e5-aff0-7a8f80c6b639" volumeName="kubernetes.io/secret/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-cert" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.718599 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="42b3be0f-1d82-4a64-abb4-0118a6960efd" volumeName="kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-service-ca-bundle" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.718689 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3322cc5a-f1f7-4522-b423-19fb7f38cd43" volumeName="kubernetes.io/secret/3322cc5a-f1f7-4522-b423-19fb7f38cd43-serving-cert" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.718707 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" volumeName="kubernetes.io/empty-dir/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-catalog-content" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.718727 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="855d7874-16b1-47d0-82f6-d2b0c89b9a84" volumeName="kubernetes.io/projected/855d7874-16b1-47d0-82f6-d2b0c89b9a84-kube-api-access-5vv7k" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.718749 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6e9271a-44ea-4612-ab60-4a9d489ed062" volumeName="kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-config" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.718768 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c835660f-5a79-4679-b9be-8543ca6ef5a1" volumeName="kubernetes.io/secret/c835660f-5a79-4679-b9be-8543ca6ef5a1-machine-approver-tls" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.718786 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c91e6234-52c5-41c0-a1ff-6a92932b83cd" volumeName="kubernetes.io/empty-dir/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-tuned" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.718909 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ade9186-b262-4b5e-9c6f-ba89f0130fb6" volumeName="kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.718933 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7203ec93-6572-4032-825c-140029a86058" volumeName="kubernetes.io/projected/7203ec93-6572-4032-825c-140029a86058-kube-api-access-gkcj4" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.718954 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="24506aa4-ab78-49df-bb58-59093498f13d" volumeName="kubernetes.io/projected/24506aa4-ab78-49df-bb58-59093498f13d-kube-api-access-w2qnk" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.718979 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="27576028-d64a-47cd-b76b-d524e41efe37" volumeName="kubernetes.io/projected/27576028-d64a-47cd-b76b-d524e41efe37-kube-api-access" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.718999 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="330553d2-40ea-4496-8346-2e5bf680669b" volumeName="kubernetes.io/configmap/330553d2-40ea-4496-8346-2e5bf680669b-iptables-alerter-script" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719017 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7c017c69-b24e-4a7a-b888-133bed34c174" volumeName="kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719037 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ec61be5-32f9-4aac-815f-41d173213107" volumeName="kubernetes.io/secret/7ec61be5-32f9-4aac-815f-41d173213107-serving-cert" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719054 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a399a87b-8153-4045-a8d3-63fd88ae280f" volumeName="kubernetes.io/secret/a399a87b-8153-4045-a8d3-63fd88ae280f-serving-cert" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719073 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b011b1f1-3235-4e20-825b-ce711c052407" volumeName="kubernetes.io/projected/b011b1f1-3235-4e20-825b-ce711c052407-bound-sa-token" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719092 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="00601c1a-efd4-4366-bdc9-d768afa252b0" volumeName="kubernetes.io/secret/00601c1a-efd4-4366-bdc9-d768afa252b0-serving-cert" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719109 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4d7939a-5961-4608-b910-73e71aa55bf6" volumeName="kubernetes.io/projected/e4d7939a-5961-4608-b910-73e71aa55bf6-kube-api-access-d77m8" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719138 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" volumeName="kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-images" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719155 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" volumeName="kubernetes.io/projected/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-kube-api-access-6fssw" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719174 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ffaf95be-586c-40fa-b15f-1beaffe7ff1c" volumeName="kubernetes.io/secret/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-metrics-tls" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719192 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9" volumeName="kubernetes.io/secret/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-serving-cert" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719211 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="157eab0c-0d8d-486b-a349-c2e466e18e0c" volumeName="kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovnkube-script-lib" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719229 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6f15dcdb-c968-429c-9d1d-63c2becad337" volumeName="kubernetes.io/projected/6f15dcdb-c968-429c-9d1d-63c2becad337-kube-api-access-kkjzz" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719247 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ec61be5-32f9-4aac-815f-41d173213107" volumeName="kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-config" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719274 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a399a87b-8153-4045-a8d3-63fd88ae280f" volumeName="kubernetes.io/configmap/a399a87b-8153-4045-a8d3-63fd88ae280f-service-ca" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719294 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d8fca733-45c8-45b8-8653-ac204e7c6098" volumeName="kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719314 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd9f8671-8066-4990-b45d-8b619aa5d9ec" volumeName="kubernetes.io/secret/fd9f8671-8066-4990-b45d-8b619aa5d9ec-serving-cert" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719333 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="14bd3485-aa02-4984-b4a3-59f360b1b327" volumeName="kubernetes.io/secret/14bd3485-aa02-4984-b4a3-59f360b1b327-control-plane-machine-set-operator-tls" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719351 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="434ed9b9-715b-455b-867c-775b256df40f" volumeName="kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-profile-collector-cert" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719368 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b668f740-dbc3-48e0-9ebc-83bae3a43c83" volumeName="kubernetes.io/configmap/b668f740-dbc3-48e0-9ebc-83bae3a43c83-service-ca-bundle" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719391 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9" volumeName="kubernetes.io/configmap/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-trusted-ca-bundle" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719411 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9" volumeName="kubernetes.io/projected/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-kube-api-access-lg7hr" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719429 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cdb50850-779d-4179-ba1d-65ffeb4bb2e9" volumeName="kubernetes.io/configmap/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-images" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719446 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="00601c1a-efd4-4366-bdc9-d768afa252b0" volumeName="kubernetes.io/projected/00601c1a-efd4-4366-bdc9-d768afa252b0-kube-api-access-2g7bh" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719464 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="855d7874-16b1-47d0-82f6-d2b0c89b9a84" volumeName="kubernetes.io/secret/855d7874-16b1-47d0-82f6-d2b0c89b9a84-webhook-cert" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719490 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a399a87b-8153-4045-a8d3-63fd88ae280f" volumeName="kubernetes.io/projected/a399a87b-8153-4045-a8d3-63fd88ae280f-kube-api-access" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719508 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee9a47b1-cdd9-43bc-8115-8851f29106e6" volumeName="kubernetes.io/projected/ee9a47b1-cdd9-43bc-8115-8851f29106e6-kube-api-access-rnfmb" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719527 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd4c4c6f-380a-4cda-9a21-352b55ec2d98" volumeName="kubernetes.io/projected/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-kube-api-access-rj4dt" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719544 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7203ec93-6572-4032-825c-140029a86058" volumeName="kubernetes.io/configmap/7203ec93-6572-4032-825c-140029a86058-env-overrides" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719560 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="42b3be0f-1d82-4a64-abb4-0118a6960efd" volumeName="kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-trusted-ca-bundle" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719577 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8e5e33b0-4e2e-464c-ba5b-cbd2048004f8" volumeName="kubernetes.io/projected/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-kube-api-access-n6bhm" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719595 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c50317d3-f7cd-4133-845e-44add57ac378" volumeName="kubernetes.io/configmap/c50317d3-f7cd-4133-845e-44add57ac378-images" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719611 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c50317d3-f7cd-4133-845e-44add57ac378" volumeName="kubernetes.io/configmap/c50317d3-f7cd-4133-845e-44add57ac378-config" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719628 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9" volumeName="kubernetes.io/secret/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-etcd-client" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719646 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cdb50850-779d-4179-ba1d-65ffeb4bb2e9" volumeName="kubernetes.io/projected/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-kube-api-access-nhvdc" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719667 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee9a47b1-cdd9-43bc-8115-8851f29106e6" volumeName="kubernetes.io/secret/ee9a47b1-cdd9-43bc-8115-8851f29106e6-catalogserver-certs" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719688 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="018e9ad3-c071-45c6-bfa6-e53dda20c757" volumeName="kubernetes.io/empty-dir/018e9ad3-c071-45c6-bfa6-e53dda20c757-utilities" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719708 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1897bad8-3875-4bd6-b877-b1abe1fe76c7" volumeName="kubernetes.io/projected/1897bad8-3875-4bd6-b877-b1abe1fe76c7-kube-api-access-dkqp2" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719727 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee9a47b1-cdd9-43bc-8115-8851f29106e6" volumeName="kubernetes.io/empty-dir/ee9a47b1-cdd9-43bc-8115-8851f29106e6-cache" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719745 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee9a47b1-cdd9-43bc-8115-8851f29106e6" volumeName="kubernetes.io/projected/ee9a47b1-cdd9-43bc-8115-8851f29106e6-ca-certs" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719765 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="14bd3485-aa02-4984-b4a3-59f360b1b327" volumeName="kubernetes.io/projected/14bd3485-aa02-4984-b4a3-59f360b1b327-kube-api-access-nfspg" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719784 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="72faf6d6-e8ca-43d1-b93e-67c11f8d3b46" volumeName="kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719833 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b668f740-dbc3-48e0-9ebc-83bae3a43c83" volumeName="kubernetes.io/empty-dir/b668f740-dbc3-48e0-9ebc-83bae3a43c83-snapshots" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719856 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4d7939a-5961-4608-b910-73e71aa55bf6" volumeName="kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-client-ca" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719881 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="287fba2d-f56d-4ec0-b796-7849a68fb411" volumeName="kubernetes.io/secret/287fba2d-f56d-4ec0-b796-7849a68fb411-ovn-control-plane-metrics-cert" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719905 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="24506aa4-ab78-49df-bb58-59093498f13d" volumeName="kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-config" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719924 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7" volumeName="kubernetes.io/projected/7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7-kube-api-access-mmm9t" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719947 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="855d7874-16b1-47d0-82f6-d2b0c89b9a84" volumeName="kubernetes.io/empty-dir/855d7874-16b1-47d0-82f6-d2b0c89b9a84-tmpfs" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719967 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c835660f-5a79-4679-b9be-8543ca6ef5a1" volumeName="kubernetes.io/projected/c835660f-5a79-4679-b9be-8543ca6ef5a1-kube-api-access-nxbts" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.719985 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9" volumeName="kubernetes.io/configmap/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-audit-policies" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.720007 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="018e9ad3-c071-45c6-bfa6-e53dda20c757" volumeName="kubernetes.io/empty-dir/018e9ad3-c071-45c6-bfa6-e53dda20c757-catalog-content" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.720027 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="42b3be0f-1d82-4a64-abb4-0118a6960efd" volumeName="kubernetes.io/projected/42b3be0f-1d82-4a64-abb4-0118a6960efd-kube-api-access-c7xwd" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.720059 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="434ed9b9-715b-455b-867c-775b256df40f" volumeName="kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.720078 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="64d30b80-2336-49c2-a2c2-1e0694036a84" volumeName="kubernetes.io/secret/64d30b80-2336-49c2-a2c2-1e0694036a84-cloud-credential-operator-serving-cert" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.720098 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c91e6234-52c5-41c0-a1ff-6a92932b83cd" volumeName="kubernetes.io/projected/c91e6234-52c5-41c0-a1ff-6a92932b83cd-kube-api-access-rc244" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.720120 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="157eab0c-0d8d-486b-a349-c2e466e18e0c" volumeName="kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovnkube-config" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.720144 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="24506aa4-ab78-49df-bb58-59093498f13d" volumeName="kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-proxy-ca-bundles" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.720165 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3322cc5a-f1f7-4522-b423-19fb7f38cd43" volumeName="kubernetes.io/configmap/3322cc5a-f1f7-4522-b423-19fb7f38cd43-config" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.720185 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" volumeName="kubernetes.io/projected/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-kube-api-access-l22ps" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.720206 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7bf67a51-9759-4e2a-a2ae-ef7416cad43f" volumeName="kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-profile-collector-cert" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.720225 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ec61be5-32f9-4aac-815f-41d173213107" volumeName="kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-image-import-ca" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.720245 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b668f740-dbc3-48e0-9ebc-83bae3a43c83" volumeName="kubernetes.io/projected/b668f740-dbc3-48e0-9ebc-83bae3a43c83-kube-api-access-xttdn" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.720265 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c790c174-dc60-4f34-8818-3b367fbe3a5f" volumeName="kubernetes.io/configmap/c790c174-dc60-4f34-8818-3b367fbe3a5f-cni-binary-copy" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.720289 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="24506aa4-ab78-49df-bb58-59093498f13d" volumeName="kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-client-ca" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.720307 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e7fc7c16-5bca-49e5-aff0-7a8f80c6b639" volumeName="kubernetes.io/projected/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-kube-api-access-2pqsl" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.720390 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f797ab14-0eb5-48b4-b914-f434f67c4c49" volumeName="kubernetes.io/projected/f797ab14-0eb5-48b4-b914-f434f67c4c49-kube-api-access-zjkck" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.720413 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f797ab14-0eb5-48b4-b914-f434f67c4c49" volumeName="kubernetes.io/secret/f797ab14-0eb5-48b4-b914-f434f67c4c49-cluster-storage-operator-serving-cert" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.720435 35367 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e7fc7c16-5bca-49e5-aff0-7a8f80c6b639" volumeName="kubernetes.io/configmap/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-auth-proxy-config" seLinuxMountContext="" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.720453 35367 reconstruct.go:97] "Volume reconstruction finished" Dec 04 11:59:16.722379 master-0 kubenswrapper[35367]: I1204 11:59:16.720465 35367 reconciler.go:26] "Reconciler: start to sync state" Dec 04 11:59:16.744090 master-0 kubenswrapper[35367]: I1204 11:59:16.743918 35367 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv4" Dec 04 11:59:16.746409 master-0 kubenswrapper[35367]: I1204 11:59:16.746023 35367 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv6" Dec 04 11:59:16.746409 master-0 kubenswrapper[35367]: I1204 11:59:16.746108 35367 status_manager.go:217] "Starting to sync pod status with apiserver" Dec 04 11:59:16.746409 master-0 kubenswrapper[35367]: I1204 11:59:16.746164 35367 kubelet.go:2335] "Starting kubelet main sync loop" Dec 04 11:59:16.746409 master-0 kubenswrapper[35367]: E1204 11:59:16.746275 35367 kubelet.go:2359] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Dec 04 11:59:16.747488 master-0 kubenswrapper[35367]: W1204 11:59:16.747384 35367 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: Get "https://api-int.sno.openstack.lab:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:59:16.747488 master-0 kubenswrapper[35367]: E1204 11:59:16.747481 35367 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get \"https://api-int.sno.openstack.lab:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:59:16.756672 master-0 kubenswrapper[35367]: I1204 11:59:16.756600 35367 generic.go:334] "Generic (PLEG): container finished" podID="b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" containerID="72b6ea20a14f1d37ebf32d8152e62c089293a4e895690df2e1e95cac0e8c0aa1" exitCode=0 Dec 04 11:59:16.756672 master-0 kubenswrapper[35367]: I1204 11:59:16.756650 35367 generic.go:334] "Generic (PLEG): container finished" podID="b620f29d-dcde-4f98-9fb6-dd479dcdcf7c" containerID="45c8fa1ff0262056ef5a835c1716884b40d7aada299e2327b7d384d12656f5f4" exitCode=0 Dec 04 11:59:16.760798 master-0 kubenswrapper[35367]: I1204 11:59:16.760749 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-1-master-0_0a3dbe2b-a659-46c2-93e8-19bd30ee2260/installer/0.log" Dec 04 11:59:16.763931 master-0 kubenswrapper[35367]: I1204 11:59:16.763845 35367 generic.go:334] "Generic (PLEG): container finished" podID="0a3dbe2b-a659-46c2-93e8-19bd30ee2260" containerID="1374a96ed1ca6171abfb891d570b17cfc8290599387bccafe504b9debca481e3" exitCode=1 Dec 04 11:59:16.767183 master-0 kubenswrapper[35367]: I1204 11:59:16.767148 35367 generic.go:334] "Generic (PLEG): container finished" podID="f797ab14-0eb5-48b4-b914-f434f67c4c49" containerID="a7c9e295ef31ee529de35de69419b7f4fb1bbde8ad44813a8db193a07a67f946" exitCode=0 Dec 04 11:59:16.769160 master-0 kubenswrapper[35367]: I1204 11:59:16.769132 35367 generic.go:334] "Generic (PLEG): container finished" podID="fd4c4c6f-380a-4cda-9a21-352b55ec2d98" containerID="44b8506d6a819dafeb21c5a4e661b7d718d0df7d433b1764865e76d91ef84eca" exitCode=0 Dec 04 11:59:16.772435 master-0 kubenswrapper[35367]: I1204 11:59:16.772390 35367 generic.go:334] "Generic (PLEG): container finished" podID="7ec61be5-32f9-4aac-815f-41d173213107" containerID="2457f1970947a8a4cfd57936a0c4c7d3fd936e7b3d7af8b436e2c40036dd0011" exitCode=0 Dec 04 11:59:16.774099 master-0 kubenswrapper[35367]: I1204 11:59:16.774035 35367 generic.go:334] "Generic (PLEG): container finished" podID="3322cc5a-f1f7-4522-b423-19fb7f38cd43" containerID="a39ca33d8356cc3dbacc15a33d88f7f3eadcf0d16af1ac588f4e782ea1463d52" exitCode=0 Dec 04 11:59:16.775625 master-0 kubenswrapper[35367]: I1204 11:59:16.775580 35367 generic.go:334] "Generic (PLEG): container finished" podID="780ea907-dec5-426e-9de2-158f59c09f71" containerID="8e2bcd64158b0463f9bafc73ea2efd8e5f7562257e1c40b5ab47bc4fcd4b79db" exitCode=0 Dec 04 11:59:16.779068 master-0 kubenswrapper[35367]: I1204 11:59:16.779037 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-controller_operator-controller-controller-manager-7cbd59c7f8-qcz9t_1897bad8-3875-4bd6-b877-b1abe1fe76c7/manager/1.log" Dec 04 11:59:16.779553 master-0 kubenswrapper[35367]: I1204 11:59:16.779480 35367 generic.go:334] "Generic (PLEG): container finished" podID="1897bad8-3875-4bd6-b877-b1abe1fe76c7" containerID="87d19ac7ca9a3b1f2ae18249fc9bca976ae2df5c1da057ed782ff5452aa064ed" exitCode=1 Dec 04 11:59:16.781032 master-0 kubenswrapper[35367]: I1204 11:59:16.780968 35367 generic.go:334] "Generic (PLEG): container finished" podID="b89698aa356a3bc32694e2b098f9a900" containerID="2262a85240071337933265fef7bf64975af04b3a2ac5a2ff5f0770a8bb6a3e3b" exitCode=0 Dec 04 11:59:16.784178 master-0 kubenswrapper[35367]: I1204 11:59:16.784121 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-78f758c7b9-zgkh5_7e3160a9-11d1-4845-ba30-1a49ae7339a9/cluster-baremetal-operator/3.log" Dec 04 11:59:16.784593 master-0 kubenswrapper[35367]: I1204 11:59:16.784553 35367 generic.go:334] "Generic (PLEG): container finished" podID="7e3160a9-11d1-4845-ba30-1a49ae7339a9" containerID="fb9fc7d90e1a7f1b9941af4021fef36a6cf8ea28ed08b7fb03d0f413775fbd30" exitCode=1 Dec 04 11:59:16.789639 master-0 kubenswrapper[35367]: I1204 11:59:16.789577 35367 generic.go:334] "Generic (PLEG): container finished" podID="a399a87b-8153-4045-a8d3-63fd88ae280f" containerID="8203c30c9d158150398a01d336c4969a20aab618396e7ab3bc78d00c326809cc" exitCode=0 Dec 04 11:59:16.792123 master-0 kubenswrapper[35367]: I1204 11:59:16.792052 35367 generic.go:334] "Generic (PLEG): container finished" podID="cdb50850-779d-4179-ba1d-65ffeb4bb2e9" containerID="3bcbd231509913c4a508bf39ec4788d7227ea3b5ad2a02de0790fac547297cf4" exitCode=0 Dec 04 11:59:16.793588 master-0 kubenswrapper[35367]: I1204 11:59:16.793552 35367 generic.go:334] "Generic (PLEG): container finished" podID="031d300e-24b4-481c-8b82-fe8cdb3fcef7" containerID="53618e2881e7531a20171c8c77886b4e3ff73637b9908af667c0ecd3f6bd4f2a" exitCode=0 Dec 04 11:59:16.796379 master-0 kubenswrapper[35367]: I1204 11:59:16.796335 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_control-plane-machine-set-operator-7df95c79b5-7w5lm_14bd3485-aa02-4984-b4a3-59f360b1b327/control-plane-machine-set-operator/1.log" Dec 04 11:59:16.796468 master-0 kubenswrapper[35367]: I1204 11:59:16.796388 35367 generic.go:334] "Generic (PLEG): container finished" podID="14bd3485-aa02-4984-b4a3-59f360b1b327" containerID="41aa69685919e7f8f8af95aebbe0bc4d44d4ceec0966f5cc37e23c82ff7f99c8" exitCode=1 Dec 04 11:59:16.798936 master-0 kubenswrapper[35367]: I1204 11:59:16.798879 35367 generic.go:334] "Generic (PLEG): container finished" podID="27576028-d64a-47cd-b76b-d524e41efe37" containerID="5bd81ae6aaed1722c0d3f93b82b95663992c61dfa9898968bad69d44a6b4c6ca" exitCode=0 Dec 04 11:59:16.801552 master-0 kubenswrapper[35367]: I1204 11:59:16.801503 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-74f484689c-jmfn2_f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48/config-sync-controllers/0.log" Dec 04 11:59:16.802136 master-0 kubenswrapper[35367]: I1204 11:59:16.802101 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-74f484689c-jmfn2_f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48/cluster-cloud-controller-manager/0.log" Dec 04 11:59:16.802189 master-0 kubenswrapper[35367]: I1204 11:59:16.802149 35367 generic.go:334] "Generic (PLEG): container finished" podID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerID="7169aa966534042a209dbc77d82db08548c2b38ca834a1a1b58302b3c9862901" exitCode=1 Dec 04 11:59:16.802189 master-0 kubenswrapper[35367]: I1204 11:59:16.802168 35367 generic.go:334] "Generic (PLEG): container finished" podID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerID="a88d1f0e1d80ac478f7ad73d99091a69eb94f507aee6c58fd48df49c97a44d8d" exitCode=1 Dec 04 11:59:16.806447 master-0 kubenswrapper[35367]: E1204 11:59:16.806404 35367 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:59:16.813094 master-0 kubenswrapper[35367]: I1204 11:59:16.813021 35367 generic.go:334] "Generic (PLEG): container finished" podID="58d12e893528ad53a994f10901a644ea" containerID="d1e0ff4c34bb2478448af3eb31ad0b50e5dd734dc0f6051803b3b18d3de656bf" exitCode=0 Dec 04 11:59:16.813094 master-0 kubenswrapper[35367]: I1204 11:59:16.813084 35367 generic.go:334] "Generic (PLEG): container finished" podID="58d12e893528ad53a994f10901a644ea" containerID="13b777a669c375f8fa5fb7dc16e22e01b0b37ff83c9fc781534d7ca1c75d6dcd" exitCode=0 Dec 04 11:59:16.813094 master-0 kubenswrapper[35367]: I1204 11:59:16.813095 35367 generic.go:334] "Generic (PLEG): container finished" podID="58d12e893528ad53a994f10901a644ea" containerID="27595dd7e9f331fc7dddae56f41801fd05186c63f10ec084212462612cf2ce37" exitCode=0 Dec 04 11:59:16.816577 master-0 kubenswrapper[35367]: I1204 11:59:16.816513 35367 generic.go:334] "Generic (PLEG): container finished" podID="8e5e33b0-4e2e-464c-ba5b-cbd2048004f8" containerID="8feda6d58ce3528bf1cb14bff418f320e1e6dc261d75dd615a2c1773dacee750" exitCode=0 Dec 04 11:59:16.818884 master-0 kubenswrapper[35367]: I1204 11:59:16.818850 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-lifecycle-manager_package-server-manager-67477646d4-7hndf_72faf6d6-e8ca-43d1-b93e-67c11f8d3b46/package-server-manager/1.log" Dec 04 11:59:16.820122 master-0 kubenswrapper[35367]: I1204 11:59:16.820012 35367 generic.go:334] "Generic (PLEG): container finished" podID="72faf6d6-e8ca-43d1-b93e-67c11f8d3b46" containerID="d9c0a6f2319e382b7fe02ed5c5fa7e0a89c76eff9a028d94eddc90a3aa1de179" exitCode=1 Dec 04 11:59:16.823371 master-0 kubenswrapper[35367]: I1204 11:59:16.823332 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver-operator_kube-apiserver-operator-765d9ff747-gr68k_ccf81538-4d5a-4c26-8e54-fe39331a625d/kube-apiserver-operator/1.log" Dec 04 11:59:16.823465 master-0 kubenswrapper[35367]: I1204 11:59:16.823388 35367 generic.go:334] "Generic (PLEG): container finished" podID="ccf81538-4d5a-4c26-8e54-fe39331a625d" containerID="6740e091e7513192b7c4fc2e37bc11133fd10dfdaf1d0800e4f08d8808fea4fc" exitCode=255 Dec 04 11:59:16.826262 master-0 kubenswrapper[35367]: I1204 11:59:16.826205 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_machine-api-operator-88d48b57d-9fjtd_c50317d3-f7cd-4133-845e-44add57ac378/machine-api-operator/0.log" Dec 04 11:59:16.826659 master-0 kubenswrapper[35367]: I1204 11:59:16.826612 35367 generic.go:334] "Generic (PLEG): container finished" podID="c50317d3-f7cd-4133-845e-44add57ac378" containerID="bf5e3c44e8b979c1b2a2791e8de129301f2196277f040ae6c9ab59c2dfb23a10" exitCode=255 Dec 04 11:59:16.828985 master-0 kubenswrapper[35367]: I1204 11:59:16.828937 35367 generic.go:334] "Generic (PLEG): container finished" podID="bac00ac5-0371-48fd-b1cc-60438f08ae94" containerID="e0fdeac9876b7627a8946145261c72d16f488a3fb3a2e313379790f4879d5017" exitCode=0 Dec 04 11:59:16.836738 master-0 kubenswrapper[35367]: I1204 11:59:16.836346 35367 generic.go:334] "Generic (PLEG): container finished" podID="1ade9186-b262-4b5e-9c6f-ba89f0130fb6" containerID="c1818ca43db2765bb639a6e97b3c2f8506a31edb0b1a76aecba6684bf041bcbf" exitCode=0 Dec 04 11:59:16.840116 master-0 kubenswrapper[35367]: I1204 11:59:16.840073 35367 generic.go:334] "Generic (PLEG): container finished" podID="ffaf95be-586c-40fa-b15f-1beaffe7ff1c" containerID="f9e507455e646a26023961f555cf20cd9c754df7c6eb7c8d6f74aa6bd2bece6c" exitCode=0 Dec 04 11:59:16.846444 master-0 kubenswrapper[35367]: E1204 11:59:16.846382 35367 kubelet.go:2359] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Dec 04 11:59:16.848205 master-0 kubenswrapper[35367]: I1204 11:59:16.848107 35367 generic.go:334] "Generic (PLEG): container finished" podID="3e64e99a-b3b9-4db7-aec4-8e61d1370e7e" containerID="db84ab590d59181aff119f26f2f6597b685567de9008996795746da92ab70ad5" exitCode=0 Dec 04 11:59:16.856883 master-0 kubenswrapper[35367]: I1204 11:59:16.856693 35367 generic.go:334] "Generic (PLEG): container finished" podID="f925fe60-b5b7-4a5a-9800-3546334da725" containerID="c2a6d218b69395e0dc6ee485bd5a6692aa5d9c907c1da87b18a5c7791ac08730" exitCode=0 Dec 04 11:59:16.856883 master-0 kubenswrapper[35367]: I1204 11:59:16.856739 35367 generic.go:334] "Generic (PLEG): container finished" podID="f925fe60-b5b7-4a5a-9800-3546334da725" containerID="df513947d42fcfc7e28c368c7b0fd21d796bd49821548340d2c09133a5199f62" exitCode=0 Dec 04 11:59:16.860495 master-0 kubenswrapper[35367]: I1204 11:59:16.860466 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-catalogd_catalogd-controller-manager-7cc89f4c4c-fd9pv_ee9a47b1-cdd9-43bc-8115-8851f29106e6/manager/1.log" Dec 04 11:59:16.860933 master-0 kubenswrapper[35367]: I1204 11:59:16.860899 35367 generic.go:334] "Generic (PLEG): container finished" podID="ee9a47b1-cdd9-43bc-8115-8851f29106e6" containerID="51591cda8f462b13281f43dbc0b6afc384282884d691dc6e5a5e8196ffa850e4" exitCode=1 Dec 04 11:59:16.863564 master-0 kubenswrapper[35367]: I1204 11:59:16.863536 35367 generic.go:334] "Generic (PLEG): container finished" podID="24506aa4-ab78-49df-bb58-59093498f13d" containerID="89ac9be46243609bde604f4ef89b49eac3ee3ceca2042c8efeae7607ac835469" exitCode=0 Dec 04 11:59:16.865821 master-0 kubenswrapper[35367]: I1204 11:59:16.865723 35367 generic.go:334] "Generic (PLEG): container finished" podID="287fba2d-f56d-4ec0-b796-7849a68fb411" containerID="de49dc04e865afee596ae644e0ffa161db1e2290ebe2db9cc519ab9cf67d5aa9" exitCode=0 Dec 04 11:59:16.868519 master-0 kubenswrapper[35367]: I1204 11:59:16.868475 35367 generic.go:334] "Generic (PLEG): container finished" podID="018e9ad3-c071-45c6-bfa6-e53dda20c757" containerID="36c3fd8199ca96cb8487d893a32aa639b7c393be6ed6496e16f59c0791abf527" exitCode=0 Dec 04 11:59:16.868519 master-0 kubenswrapper[35367]: I1204 11:59:16.868511 35367 generic.go:334] "Generic (PLEG): container finished" podID="018e9ad3-c071-45c6-bfa6-e53dda20c757" containerID="a596093d397577de9c313d7ade0099442be9e40a6f7cf814a9802e189eb3738e" exitCode=0 Dec 04 11:59:16.874641 master-0 kubenswrapper[35367]: I1204 11:59:16.874550 35367 generic.go:334] "Generic (PLEG): container finished" podID="cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9" containerID="44d18c5f308aeaf2b863c2401d4f75bd82232506412ba0188b0eb8f15063089d" exitCode=0 Dec 04 11:59:16.877142 master-0 kubenswrapper[35367]: I1204 11:59:16.877111 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/7.log" Dec 04 11:59:16.878172 master-0 kubenswrapper[35367]: I1204 11:59:16.878140 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-cert-syncer/0.log" Dec 04 11:59:16.878899 master-0 kubenswrapper[35367]: I1204 11:59:16.878863 35367 generic.go:334] "Generic (PLEG): container finished" podID="e6b437c60bb18680f4492b00b294e872" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" exitCode=255 Dec 04 11:59:16.878899 master-0 kubenswrapper[35367]: I1204 11:59:16.878893 35367 generic.go:334] "Generic (PLEG): container finished" podID="e6b437c60bb18680f4492b00b294e872" containerID="11e29c5651a5425702af55ec3b8ee473df3972ab82e099ae3490c6b27969c94a" exitCode=1 Dec 04 11:59:16.884410 master-0 kubenswrapper[35367]: I1204 11:59:16.884330 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-node-identity_network-node-identity-f8hvq_7203ec93-6572-4032-825c-140029a86058/approver/1.log" Dec 04 11:59:16.885668 master-0 kubenswrapper[35367]: I1204 11:59:16.885620 35367 generic.go:334] "Generic (PLEG): container finished" podID="7203ec93-6572-4032-825c-140029a86058" containerID="6ee863793f57b0f18fae063e87f584d73fae0eb1eb8a1275618f4008ffa23d64" exitCode=1 Dec 04 11:59:16.903380 master-0 kubenswrapper[35367]: I1204 11:59:16.903271 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_cluster-node-tuning-operator-85cff47f46-4gv5j_6f15dcdb-c968-429c-9d1d-63c2becad337/cluster-node-tuning-operator/1.log" Dec 04 11:59:16.903380 master-0 kubenswrapper[35367]: I1204 11:59:16.903356 35367 generic.go:334] "Generic (PLEG): container finished" podID="6f15dcdb-c968-429c-9d1d-63c2becad337" containerID="a2ccae65671ed8e1587834a54d81391f1b1881f39ee38aa28b193fa6cecc39da" exitCode=1 Dec 04 11:59:16.906862 master-0 kubenswrapper[35367]: I1204 11:59:16.906463 35367 generic.go:334] "Generic (PLEG): container finished" podID="38e7be62-e4f5-42ba-89f0-83aca874a092" containerID="5a3415efa00f234c75a3ef12f121cd45062cac0bc8779f480bd4cc3b20b6aea6" exitCode=0 Dec 04 11:59:16.906862 master-0 kubenswrapper[35367]: E1204 11:59:16.906606 35367 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:59:16.912166 master-0 kubenswrapper[35367]: E1204 11:59:16.912084 35367 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="400ms" Dec 04 11:59:16.914838 master-0 kubenswrapper[35367]: I1204 11:59:16.914776 35367 generic.go:334] "Generic (PLEG): container finished" podID="d75143d9bc4a2dc15781dc51ccff632a" containerID="cb6defb2f3057900b70ffad997ff544ea8c575bd9817b1a99621b2f9c63061e6" exitCode=0 Dec 04 11:59:16.914838 master-0 kubenswrapper[35367]: I1204 11:59:16.914836 35367 generic.go:334] "Generic (PLEG): container finished" podID="d75143d9bc4a2dc15781dc51ccff632a" containerID="9c7529c8ca2d0c98a54eee2915f7d9cb961fdd0ba295047dca3baa0a51ae6a4b" exitCode=0 Dec 04 11:59:16.917016 master-0 kubenswrapper[35367]: I1204 11:59:16.916971 35367 generic.go:334] "Generic (PLEG): container finished" podID="0fad065c-94c9-4a38-ab76-cf0266bdc04b" containerID="25421a99ea678b2107e40949ffdaa62c5f5165b3a02aa309382f3c9da4a11384" exitCode=0 Dec 04 11:59:16.920394 master-0 kubenswrapper[35367]: I1204 11:59:16.920361 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/5.log" Dec 04 11:59:16.920477 master-0 kubenswrapper[35367]: I1204 11:59:16.920403 35367 generic.go:334] "Generic (PLEG): container finished" podID="38fc8086-a00c-4a2a-8a0e-c57e9d9d0103" containerID="c3d6e3ec1c2075f0d2c2e41480f7486576efc2d0e3c1b8e7a0df0f84b64a6eb3" exitCode=1 Dec 04 11:59:16.925114 master-0 kubenswrapper[35367]: I1204 11:59:16.925063 35367 generic.go:334] "Generic (PLEG): container finished" podID="0158c2f3-20e5-43f4-875d-c5ad8f6112df" containerID="db80abb8e4c0e90fdd2ce38c6760862b2f66436f0df8b6e38dd7af704d246cce" exitCode=0 Dec 04 11:59:16.925114 master-0 kubenswrapper[35367]: I1204 11:59:16.925094 35367 generic.go:334] "Generic (PLEG): container finished" podID="0158c2f3-20e5-43f4-875d-c5ad8f6112df" containerID="e06ff9d9a723c08c69bb4e160a236454da183658ecde2bd72b8d90a106d9f21e" exitCode=0 Dec 04 11:59:16.925114 master-0 kubenswrapper[35367]: I1204 11:59:16.925104 35367 generic.go:334] "Generic (PLEG): container finished" podID="0158c2f3-20e5-43f4-875d-c5ad8f6112df" containerID="5f323ae636217996144f9c95442c8e52f9bd99e4069e42ddad8761df1ef87b48" exitCode=0 Dec 04 11:59:16.930945 master-0 kubenswrapper[35367]: I1204 11:59:16.930891 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk_e4d7939a-5961-4608-b910-73e71aa55bf6/route-controller-manager/1.log" Dec 04 11:59:16.931151 master-0 kubenswrapper[35367]: I1204 11:59:16.931005 35367 generic.go:334] "Generic (PLEG): container finished" podID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerID="b63dc777741930897797e6adb1b664297a0f1967d2d18f8fbd61bd116fd98669" exitCode=255 Dec 04 11:59:16.934462 master-0 kubenswrapper[35367]: I1204 11:59:16.934397 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_installer-3-master-0_27c4e782-11b4-43a3-9ffd-34bf4e40bbc4/installer/0.log" Dec 04 11:59:16.934626 master-0 kubenswrapper[35367]: I1204 11:59:16.934594 35367 generic.go:334] "Generic (PLEG): container finished" podID="27c4e782-11b4-43a3-9ffd-34bf4e40bbc4" containerID="b78e17b7306f7adda3e6d7075255514653aaae6ce42d92ca0bc99707e1589503" exitCode=1 Dec 04 11:59:16.936850 master-0 kubenswrapper[35367]: I1204 11:59:16.936830 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication-operator_authentication-operator-6c968fdfdf-nrrfw_42b3be0f-1d82-4a64-abb4-0118a6960efd/authentication-operator/2.log" Dec 04 11:59:16.937051 master-0 kubenswrapper[35367]: I1204 11:59:16.937006 35367 generic.go:334] "Generic (PLEG): container finished" podID="42b3be0f-1d82-4a64-abb4-0118a6960efd" containerID="a6d14a522051fb2206df06257821a6c013ab79cc060f6af18a92935eb6c12df9" exitCode=255 Dec 04 11:59:16.939412 master-0 kubenswrapper[35367]: I1204 11:59:16.939376 35367 generic.go:334] "Generic (PLEG): container finished" podID="1243d581-fa11-4db1-a01a-0cf64eb3ef74" containerID="450c33434fcc742db8779a3f1f1227abf6b374f6577a9ed078feb154828442af" exitCode=0 Dec 04 11:59:16.945697 master-0 kubenswrapper[35367]: I1204 11:59:16.945603 35367 generic.go:334] "Generic (PLEG): container finished" podID="bdfcb644-24ef-4a33-93ae-a855e872d29a" containerID="1d5a311d3baeca56657213d2436c5cd5a6f19236b17d29ba3c96c8778083bdb3" exitCode=0 Dec 04 11:59:16.945697 master-0 kubenswrapper[35367]: I1204 11:59:16.945675 35367 generic.go:334] "Generic (PLEG): container finished" podID="bdfcb644-24ef-4a33-93ae-a855e872d29a" containerID="7d222cce1ac64b8e7a610b554b283ef4b4d0fcbf566ec67f8a7637ab6af91dcb" exitCode=0 Dec 04 11:59:16.945697 master-0 kubenswrapper[35367]: I1204 11:59:16.945688 35367 generic.go:334] "Generic (PLEG): container finished" podID="bdfcb644-24ef-4a33-93ae-a855e872d29a" containerID="c09e207d8873c7c6bd85b10d3d0b68a6f4de01726a36fb157635378662fe6ac7" exitCode=0 Dec 04 11:59:16.945697 master-0 kubenswrapper[35367]: I1204 11:59:16.945702 35367 generic.go:334] "Generic (PLEG): container finished" podID="bdfcb644-24ef-4a33-93ae-a855e872d29a" containerID="180c9014500168f2c0f5e0532e1a0a716b6e343af71b25614526bc3a4db81fe9" exitCode=0 Dec 04 11:59:16.946060 master-0 kubenswrapper[35367]: I1204 11:59:16.945715 35367 generic.go:334] "Generic (PLEG): container finished" podID="bdfcb644-24ef-4a33-93ae-a855e872d29a" containerID="eadce23f3de74bb3fa383956febe6a31a7bf48f1c04ed7c5a031f480449f38e8" exitCode=0 Dec 04 11:59:16.946060 master-0 kubenswrapper[35367]: I1204 11:59:16.945725 35367 generic.go:334] "Generic (PLEG): container finished" podID="bdfcb644-24ef-4a33-93ae-a855e872d29a" containerID="4f5e35a41648fd33f62ab41661b91852c5163f0f30c4978159e0c3c22f526438" exitCode=0 Dec 04 11:59:16.947633 master-0 kubenswrapper[35367]: I1204 11:59:16.947606 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-machine-approver_machine-approver-f797d8546-qvgbq_c835660f-5a79-4679-b9be-8543ca6ef5a1/machine-approver-controller/0.log" Dec 04 11:59:16.948141 master-0 kubenswrapper[35367]: I1204 11:59:16.948097 35367 generic.go:334] "Generic (PLEG): container finished" podID="c835660f-5a79-4679-b9be-8543ca6ef5a1" containerID="749b44ec9e8d4f00f1e655c70a503d3b1ce1085e0a7eecca2e01f8fe90a6e0c2" exitCode=255 Dec 04 11:59:16.953991 master-0 kubenswrapper[35367]: I1204 11:59:16.953951 35367 generic.go:334] "Generic (PLEG): container finished" podID="157eab0c-0d8d-486b-a349-c2e466e18e0c" containerID="aa46a13fdd928fc26792c9ef2cde5780818c25c59ca4872fc97dad5a0d213287" exitCode=0 Dec 04 11:59:16.955876 master-0 kubenswrapper[35367]: I1204 11:59:16.955851 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/5.log" Dec 04 11:59:16.956150 master-0 kubenswrapper[35367]: I1204 11:59:16.956124 35367 generic.go:334] "Generic (PLEG): container finished" podID="b011b1f1-3235-4e20-825b-ce711c052407" containerID="6b81ee1ae28f16389ded7b634a062f62bd333e247fbc631f5edd514e5d0827da" exitCode=1 Dec 04 11:59:16.957855 master-0 kubenswrapper[35367]: I1204 11:59:16.957838 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-1-retry-1-master-0_4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491/installer/0.log" Dec 04 11:59:16.957954 master-0 kubenswrapper[35367]: I1204 11:59:16.957940 35367 generic.go:334] "Generic (PLEG): container finished" podID="4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491" containerID="56f66e86a303f06a82ff82c486a75d82a740c9bc6ff35f2853c6086d774366c6" exitCode=1 Dec 04 11:59:16.960271 master-0 kubenswrapper[35367]: I1204 11:59:16.960217 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-autoscaler-operator-5f49d774cd-894dk_e7fc7c16-5bca-49e5-aff0-7a8f80c6b639/cluster-autoscaler-operator/2.log" Dec 04 11:59:16.960830 master-0 kubenswrapper[35367]: I1204 11:59:16.960769 35367 generic.go:334] "Generic (PLEG): container finished" podID="e7fc7c16-5bca-49e5-aff0-7a8f80c6b639" containerID="f06d1731c63d1c3b95fb1ded6be8b346f6f343eb1c39fb1931d998db924768a0" exitCode=255 Dec 04 11:59:16.963666 master-0 kubenswrapper[35367]: I1204 11:59:16.963642 35367 generic.go:334] "Generic (PLEG): container finished" podID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerID="456f267c13077df8fde873615eb32f2c8011d7876410ffb6709899a5fdee25ce" exitCode=0 Dec 04 11:59:16.963666 master-0 kubenswrapper[35367]: I1204 11:59:16.963665 35367 generic.go:334] "Generic (PLEG): container finished" podID="00601c1a-efd4-4366-bdc9-d768afa252b0" containerID="8b2e6952b1e04c91242f448af7e8c754dbdec6df62ea2d8c6f318ad45c211983" exitCode=0 Dec 04 11:59:16.965908 master-0 kubenswrapper[35367]: I1204 11:59:16.965880 35367 generic.go:334] "Generic (PLEG): container finished" podID="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" containerID="b831427379e3db6806a6998a0a6732a8a35135454ae340aeb1971b3048c51a2b" exitCode=0 Dec 04 11:59:16.965994 master-0 kubenswrapper[35367]: I1204 11:59:16.965908 35367 generic.go:334] "Generic (PLEG): container finished" podID="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" containerID="fbb615d6c9d1ef25aa2db62084390ffbce46178d8659706ad341ef8739a6266d" exitCode=0 Dec 04 11:59:16.968529 master-0 kubenswrapper[35367]: I1204 11:59:16.968504 35367 generic.go:334] "Generic (PLEG): container finished" podID="c6e9271a-44ea-4612-ab60-4a9d489ed062" containerID="c917a114b6504bcd9d7c8dd2abb103105fc2fc1c7c60d8e3237ba96133b8d6ed" exitCode=0 Dec 04 11:59:16.971000 master-0 kubenswrapper[35367]: I1204 11:59:16.970965 35367 generic.go:334] "Generic (PLEG): container finished" podID="f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3" containerID="20848d27653bd7e506c71f074203dfd9a4dbef438e1f6edd38d28115690cb4d7" exitCode=0 Dec 04 11:59:16.981968 master-0 kubenswrapper[35367]: I1204 11:59:16.981731 35367 generic.go:334] "Generic (PLEG): container finished" podID="b668f740-dbc3-48e0-9ebc-83bae3a43c83" containerID="48b19d28904c411ce854b75b8b7b3d47463402f85314112ea64f27cc79cc6747" exitCode=0 Dec 04 11:59:16.991291 master-0 kubenswrapper[35367]: I1204 11:59:16.991247 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_3169f44496ed8a28c6d6a15511ab0eec/kube-rbac-proxy-crio/2.log" Dec 04 11:59:16.991697 master-0 kubenswrapper[35367]: I1204 11:59:16.991650 35367 generic.go:334] "Generic (PLEG): container finished" podID="3169f44496ed8a28c6d6a15511ab0eec" containerID="3ed798c104f2e301f0961443f8ab6df6e17ec4caae5f1436b2b93d415a28f796" exitCode=1 Dec 04 11:59:16.991769 master-0 kubenswrapper[35367]: I1204 11:59:16.991746 35367 generic.go:334] "Generic (PLEG): container finished" podID="3169f44496ed8a28c6d6a15511ab0eec" containerID="fe978e3c9349858cb4986d59a0d297668af47052f5667b090a002d76ebcd619e" exitCode=0 Dec 04 11:59:16.994309 master-0 kubenswrapper[35367]: I1204 11:59:16.994268 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-b9c5dfc78-dcxkw_fd9f8671-8066-4990-b45d-8b619aa5d9ec/kube-storage-version-migrator-operator/2.log" Dec 04 11:59:16.994403 master-0 kubenswrapper[35367]: I1204 11:59:16.994328 35367 generic.go:334] "Generic (PLEG): container finished" podID="fd9f8671-8066-4990-b45d-8b619aa5d9ec" containerID="313a5a3e45bfc56240a41a6b2d15c82ca825cd210b3e33c0eb74e4e915c86d54" exitCode=255 Dec 04 11:59:16.997473 master-0 kubenswrapper[35367]: I1204 11:59:16.997429 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_bdd20c68f1ccfd1240fb273af0638d01/kube-scheduler-cert-syncer/0.log" Dec 04 11:59:16.998267 master-0 kubenswrapper[35367]: I1204 11:59:16.998195 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_bdd20c68f1ccfd1240fb273af0638d01/kube-scheduler/0.log" Dec 04 11:59:16.998741 master-0 kubenswrapper[35367]: I1204 11:59:16.998704 35367 generic.go:334] "Generic (PLEG): container finished" podID="bdd20c68f1ccfd1240fb273af0638d01" containerID="83e55c475e3dc5500479af8907cda3d13a24a31c8ee5c2278bdd8d400f5e7292" exitCode=1 Dec 04 11:59:16.998741 master-0 kubenswrapper[35367]: I1204 11:59:16.998733 35367 generic.go:334] "Generic (PLEG): container finished" podID="bdd20c68f1ccfd1240fb273af0638d01" containerID="e892e4a03cb775cc984461c05f66ebb315e6e3256740bfe4765f9efa5a82a35d" exitCode=1 Dec 04 11:59:16.998741 master-0 kubenswrapper[35367]: I1204 11:59:16.998740 35367 generic.go:334] "Generic (PLEG): container finished" podID="bdd20c68f1ccfd1240fb273af0638d01" containerID="f22a84f6fb348e29fba57d1a09fc02c20059513a38fe36937800076d569de9eb" exitCode=0 Dec 04 11:59:17.000978 master-0 kubenswrapper[35367]: I1204 11:59:17.000926 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-apiserver-operator_openshift-apiserver-operator-7bf7f6b755-sh6qf_a5b826c3-8638-4cf5-b974-b24e4282ce00/openshift-apiserver-operator/1.log" Dec 04 11:59:17.000978 master-0 kubenswrapper[35367]: I1204 11:59:17.000958 35367 generic.go:334] "Generic (PLEG): container finished" podID="a5b826c3-8638-4cf5-b974-b24e4282ce00" containerID="bc1d5c88553d9975dfd695327c0f71abfbae1a4a9e554283b59af5847061176e" exitCode=255 Dec 04 11:59:17.003891 master-0 kubenswrapper[35367]: I1204 11:59:17.003832 35367 generic.go:334] "Generic (PLEG): container finished" podID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerID="093d2c6afc84903316f06d61c2011b5876f2371e9251cd94a18d8c28080caa20" exitCode=0 Dec 04 11:59:17.003891 master-0 kubenswrapper[35367]: I1204 11:59:17.003881 35367 generic.go:334] "Generic (PLEG): container finished" podID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerID="33431b10151447abe91f891b95bb44699da99e3035e0d5ffbd8c1b04917becde" exitCode=0 Dec 04 11:59:17.003891 master-0 kubenswrapper[35367]: I1204 11:59:17.003893 35367 generic.go:334] "Generic (PLEG): container finished" podID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerID="1088ace64761e3c007911c989818e39a17d1b9944859d157200f13ef28d4942e" exitCode=0 Dec 04 11:59:17.005702 master-0 kubenswrapper[35367]: I1204 11:59:17.005671 35367 generic.go:334] "Generic (PLEG): container finished" podID="c6335f99-eb41-4b1d-93df-4a24f0ce23bc" containerID="66b953a48576619ad5ef1fc4d68b6166f875d5145d22f93448f049810d8b1236" exitCode=0 Dec 04 11:59:17.006786 master-0 kubenswrapper[35367]: E1204 11:59:17.006750 35367 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:59:17.046936 master-0 kubenswrapper[35367]: E1204 11:59:17.046799 35367 kubelet.go:2359] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Dec 04 11:59:17.107642 master-0 kubenswrapper[35367]: E1204 11:59:17.107544 35367 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:59:17.208512 master-0 kubenswrapper[35367]: E1204 11:59:17.208365 35367 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:59:17.312779 master-0 kubenswrapper[35367]: E1204 11:59:17.312717 35367 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:59:17.329351 master-0 kubenswrapper[35367]: E1204 11:59:17.328278 35367 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="800ms" Dec 04 11:59:17.413477 master-0 kubenswrapper[35367]: E1204 11:59:17.413373 35367 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:59:17.447929 master-0 kubenswrapper[35367]: E1204 11:59:17.447866 35367 kubelet.go:2359] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Dec 04 11:59:17.504395 master-0 kubenswrapper[35367]: W1204 11:59:17.504345 35367 container.go:586] Failed to update stats for container "/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd75143d9bc4a2dc15781dc51ccff632a.slice/crio-59191695c89f8cecbba881756b5ffc5e4c892fd02facf20cc198ade1bf4ec267": error while statting cgroup v2: [unable to parse /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd75143d9bc4a2dc15781dc51ccff632a.slice/crio-59191695c89f8cecbba881756b5ffc5e4c892fd02facf20cc198ade1bf4ec267/memory.stat: read /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd75143d9bc4a2dc15781dc51ccff632a.slice/crio-59191695c89f8cecbba881756b5ffc5e4c892fd02facf20cc198ade1bf4ec267/memory.stat: no such device], continuing to push stats Dec 04 11:59:17.513570 master-0 kubenswrapper[35367]: E1204 11:59:17.513507 35367 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:59:17.613699 master-0 kubenswrapper[35367]: E1204 11:59:17.613639 35367 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:59:17.645017 master-0 kubenswrapper[35367]: I1204 11:59:17.644965 35367 manager.go:324] Recovery completed Dec 04 11:59:17.689277 master-0 kubenswrapper[35367]: I1204 11:59:17.689164 35367 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:59:17.714018 master-0 kubenswrapper[35367]: E1204 11:59:17.713842 35367 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Dec 04 11:59:17.722381 master-0 kubenswrapper[35367]: I1204 11:59:17.722331 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:17.725241 master-0 kubenswrapper[35367]: I1204 11:59:17.725154 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:17.725338 master-0 kubenswrapper[35367]: I1204 11:59:17.725247 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:17.725338 master-0 kubenswrapper[35367]: I1204 11:59:17.725265 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:17.730723 master-0 kubenswrapper[35367]: I1204 11:59:17.730669 35367 cpu_manager.go:225] "Starting CPU manager" policy="none" Dec 04 11:59:17.730998 master-0 kubenswrapper[35367]: I1204 11:59:17.730982 35367 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" Dec 04 11:59:17.731085 master-0 kubenswrapper[35367]: I1204 11:59:17.731076 35367 state_mem.go:36] "Initialized new in-memory state store" Dec 04 11:59:17.731334 master-0 kubenswrapper[35367]: I1204 11:59:17.731319 35367 state_mem.go:88] "Updated default CPUSet" cpuSet="" Dec 04 11:59:17.731438 master-0 kubenswrapper[35367]: I1204 11:59:17.731413 35367 state_mem.go:96] "Updated CPUSet assignments" assignments={} Dec 04 11:59:17.731492 master-0 kubenswrapper[35367]: I1204 11:59:17.731484 35367 state_checkpoint.go:136] "State checkpoint: restored state from checkpoint" Dec 04 11:59:17.731647 master-0 kubenswrapper[35367]: I1204 11:59:17.731633 35367 state_checkpoint.go:137] "State checkpoint: defaultCPUSet" defaultCpuSet="" Dec 04 11:59:17.731714 master-0 kubenswrapper[35367]: I1204 11:59:17.731705 35367 policy_none.go:49] "None policy: Start" Dec 04 11:59:17.736147 master-0 kubenswrapper[35367]: I1204 11:59:17.736120 35367 memory_manager.go:170] "Starting memorymanager" policy="None" Dec 04 11:59:17.736227 master-0 kubenswrapper[35367]: I1204 11:59:17.736154 35367 state_mem.go:35] "Initializing new in-memory state store" Dec 04 11:59:17.736357 master-0 kubenswrapper[35367]: I1204 11:59:17.736324 35367 state_mem.go:75] "Updated machine memory state" Dec 04 11:59:17.736357 master-0 kubenswrapper[35367]: I1204 11:59:17.736337 35367 state_checkpoint.go:82] "State checkpoint: restored state from checkpoint" Dec 04 11:59:17.754045 master-0 kubenswrapper[35367]: I1204 11:59:17.753997 35367 manager.go:334] "Starting Device Plugin manager" Dec 04 11:59:17.754313 master-0 kubenswrapper[35367]: I1204 11:59:17.754060 35367 manager.go:513] "Failed to read data from checkpoint" checkpoint="kubelet_internal_checkpoint" err="checkpoint is not found" Dec 04 11:59:17.754313 master-0 kubenswrapper[35367]: I1204 11:59:17.754075 35367 server.go:79] "Starting device plugin registration server" Dec 04 11:59:17.754632 master-0 kubenswrapper[35367]: I1204 11:59:17.754602 35367 eviction_manager.go:189] "Eviction manager: starting control loop" Dec 04 11:59:17.754688 master-0 kubenswrapper[35367]: I1204 11:59:17.754621 35367 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Dec 04 11:59:17.754789 master-0 kubenswrapper[35367]: I1204 11:59:17.754763 35367 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Dec 04 11:59:17.754898 master-0 kubenswrapper[35367]: I1204 11:59:17.754873 35367 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Dec 04 11:59:17.754898 master-0 kubenswrapper[35367]: I1204 11:59:17.754887 35367 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Dec 04 11:59:17.762520 master-0 kubenswrapper[35367]: E1204 11:59:17.762463 35367 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"master-0\" not found" Dec 04 11:59:17.854984 master-0 kubenswrapper[35367]: I1204 11:59:17.854926 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:17.856150 master-0 kubenswrapper[35367]: W1204 11:59:17.856052 35367 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://api-int.sno.openstack.lab:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:59:17.856201 master-0 kubenswrapper[35367]: E1204 11:59:17.856169 35367 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get \"https://api-int.sno.openstack.lab:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:59:17.857651 master-0 kubenswrapper[35367]: I1204 11:59:17.857606 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:17.857706 master-0 kubenswrapper[35367]: I1204 11:59:17.857656 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:17.857706 master-0 kubenswrapper[35367]: I1204 11:59:17.857666 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:17.857706 master-0 kubenswrapper[35367]: I1204 11:59:17.857693 35367 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 11:59:17.858410 master-0 kubenswrapper[35367]: E1204 11:59:17.858367 35367 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/nodes\": dial tcp 192.168.32.10:6443: connect: connection refused" node="master-0" Dec 04 11:59:18.008597 master-0 kubenswrapper[35367]: W1204 11:59:18.008293 35367 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://api-int.sno.openstack.lab:6443/api/v1/nodes?fieldSelector=metadata.name%3Dmaster-0&limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:59:18.008597 master-0 kubenswrapper[35367]: E1204 11:59:18.008461 35367 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get \"https://api-int.sno.openstack.lab:6443/api/v1/nodes?fieldSelector=metadata.name%3Dmaster-0&limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:59:18.019072 master-0 kubenswrapper[35367]: I1204 11:59:18.018979 35367 generic.go:334] "Generic (PLEG): container finished" podID="d75143d9bc4a2dc15781dc51ccff632a" containerID="14ac45f5991606821dff758d708720469710a75e4bb098390a3a5689b8ae0ee8" exitCode=0 Dec 04 11:59:18.058712 master-0 kubenswrapper[35367]: I1204 11:59:18.058616 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:18.061566 master-0 kubenswrapper[35367]: I1204 11:59:18.061529 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:18.061680 master-0 kubenswrapper[35367]: I1204 11:59:18.061573 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:18.061680 master-0 kubenswrapper[35367]: I1204 11:59:18.061587 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:18.061680 master-0 kubenswrapper[35367]: I1204 11:59:18.061613 35367 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 11:59:18.063043 master-0 kubenswrapper[35367]: E1204 11:59:18.062949 35367 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/nodes\": dial tcp 192.168.32.10:6443: connect: connection refused" node="master-0" Dec 04 11:59:18.130633 master-0 kubenswrapper[35367]: E1204 11:59:18.130546 35367 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="1.6s" Dec 04 11:59:18.224170 master-0 kubenswrapper[35367]: W1204 11:59:18.224067 35367 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: Get "https://api-int.sno.openstack.lab:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:59:18.224170 master-0 kubenswrapper[35367]: E1204 11:59:18.224159 35367 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get \"https://api-int.sno.openstack.lab:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:59:18.237748 master-0 kubenswrapper[35367]: W1204 11:59:18.237652 35367 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:59:18.237879 master-0 kubenswrapper[35367]: E1204 11:59:18.237749 35367 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get \"https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 192.168.32.10:6443: connect: connection refused" logger="UnhandledError" Dec 04 11:59:18.248169 master-0 kubenswrapper[35367]: I1204 11:59:18.248078 35367 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0","openshift-kube-controller-manager/kube-controller-manager-master-0","openshift-kube-scheduler/openshift-kube-scheduler-master-0","openshift-machine-config-operator/kube-rbac-proxy-crio-master-0","openshift-etcd/etcd-master-0","openshift-kube-apiserver/kube-apiserver-master-0"] Dec 04 11:59:18.248717 master-0 kubenswrapper[35367]: I1204 11:59:18.248671 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:18.251756 master-0 kubenswrapper[35367]: I1204 11:59:18.251685 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:18.251756 master-0 kubenswrapper[35367]: I1204 11:59:18.251753 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:18.251756 master-0 kubenswrapper[35367]: I1204 11:59:18.251763 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:18.251940 master-0 kubenswrapper[35367]: I1204 11:59:18.251890 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:18.252210 master-0 kubenswrapper[35367]: I1204 11:59:18.252154 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:18.255190 master-0 kubenswrapper[35367]: I1204 11:59:18.255093 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:18.255190 master-0 kubenswrapper[35367]: I1204 11:59:18.255187 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:18.255190 master-0 kubenswrapper[35367]: I1204 11:59:18.255205 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:18.255773 master-0 kubenswrapper[35367]: I1204 11:59:18.255425 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:18.255773 master-0 kubenswrapper[35367]: I1204 11:59:18.255670 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:18.255773 master-0 kubenswrapper[35367]: I1204 11:59:18.255738 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:18.255773 master-0 kubenswrapper[35367]: I1204 11:59:18.255778 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:18.256056 master-0 kubenswrapper[35367]: I1204 11:59:18.255790 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:18.259714 master-0 kubenswrapper[35367]: I1204 11:59:18.259549 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:18.259714 master-0 kubenswrapper[35367]: I1204 11:59:18.259609 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:18.259714 master-0 kubenswrapper[35367]: I1204 11:59:18.259624 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:18.259714 master-0 kubenswrapper[35367]: I1204 11:59:18.259561 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:18.259714 master-0 kubenswrapper[35367]: I1204 11:59:18.259697 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:18.259714 master-0 kubenswrapper[35367]: I1204 11:59:18.259709 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:18.260091 master-0 kubenswrapper[35367]: I1204 11:59:18.259863 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:18.260140 master-0 kubenswrapper[35367]: I1204 11:59:18.260087 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:18.267980 master-0 kubenswrapper[35367]: I1204 11:59:18.267932 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:18.268487 master-0 kubenswrapper[35367]: I1204 11:59:18.268012 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:18.268487 master-0 kubenswrapper[35367]: I1204 11:59:18.268026 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:18.268487 master-0 kubenswrapper[35367]: I1204 11:59:18.268336 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:18.269348 master-0 kubenswrapper[35367]: I1204 11:59:18.269266 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:18.269394 master-0 kubenswrapper[35367]: I1204 11:59:18.269370 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:18.269394 master-0 kubenswrapper[35367]: I1204 11:59:18.269389 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:18.271100 master-0 kubenswrapper[35367]: I1204 11:59:18.270335 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:18.273288 master-0 kubenswrapper[35367]: I1204 11:59:18.273224 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:18.273360 master-0 kubenswrapper[35367]: I1204 11:59:18.273305 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:18.273360 master-0 kubenswrapper[35367]: I1204 11:59:18.273318 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:18.273859 master-0 kubenswrapper[35367]: I1204 11:59:18.273579 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:18.274028 master-0 kubenswrapper[35367]: I1204 11:59:18.273998 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:18.274827 master-0 kubenswrapper[35367]: I1204 11:59:18.274746 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:18.274938 master-0 kubenswrapper[35367]: I1204 11:59:18.274869 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:18.274938 master-0 kubenswrapper[35367]: I1204 11:59:18.274928 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:18.278048 master-0 kubenswrapper[35367]: I1204 11:59:18.278004 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:18.278098 master-0 kubenswrapper[35367]: I1204 11:59:18.278059 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:18.278098 master-0 kubenswrapper[35367]: I1204 11:59:18.278021 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:18.278193 master-0 kubenswrapper[35367]: I1204 11:59:18.278103 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:18.278193 master-0 kubenswrapper[35367]: I1204 11:59:18.278146 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:18.278193 master-0 kubenswrapper[35367]: I1204 11:59:18.278073 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:18.278713 master-0 kubenswrapper[35367]: I1204 11:59:18.278364 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="931fd825327f937f17576e7f8284d2682a80b19af4b1c302c89fce2514617dec" Dec 04 11:59:18.278713 master-0 kubenswrapper[35367]: I1204 11:59:18.278394 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8427e0257c34d0faa5738f008217a794edfa8fc6a67f6fb51a64db60825bb771" Dec 04 11:59:18.278713 master-0 kubenswrapper[35367]: I1204 11:59:18.278525 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f4cb521a519dffc9145fbbff972ea7e9fae270d474192cc7dc2e095425a0edd" Dec 04 11:59:18.278713 master-0 kubenswrapper[35367]: I1204 11:59:18.278544 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:18.278713 master-0 kubenswrapper[35367]: I1204 11:59:18.278562 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" event={"ID":"a906debd0c35952850935aee2d607cce","Type":"ContainerStarted","Data":"b02fad9634552ca9f9ab767de0ddd976a9b715f9ba49fca68b0847641cd92467"} Dec 04 11:59:18.278877 master-0 kubenswrapper[35367]: I1204 11:59:18.278746 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" event={"ID":"a906debd0c35952850935aee2d607cce","Type":"ContainerStarted","Data":"354afa270a03f605fb9c3a24836a29639ae548ebb6cbeb7266228ae3871f1cba"} Dec 04 11:59:18.278877 master-0 kubenswrapper[35367]: I1204 11:59:18.278785 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"b89698aa356a3bc32694e2b098f9a900","Type":"ContainerDied","Data":"2262a85240071337933265fef7bf64975af04b3a2ac5a2ff5f0770a8bb6a3e3b"} Dec 04 11:59:18.278877 master-0 kubenswrapper[35367]: I1204 11:59:18.278822 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"b89698aa356a3bc32694e2b098f9a900","Type":"ContainerStarted","Data":"ba0de6266360c15b4570569e0e059ef77c45c81e15ccf07f9601d54c2d9635c0"} Dec 04 11:59:18.278970 master-0 kubenswrapper[35367]: I1204 11:59:18.278889 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"58d12e893528ad53a994f10901a644ea","Type":"ContainerStarted","Data":"88e1b2d27a0f75d0a4982d20bbe0ee0c9b6226aa4f25a9f4cb53e21dbc639d31"} Dec 04 11:59:18.278970 master-0 kubenswrapper[35367]: I1204 11:59:18.278908 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"58d12e893528ad53a994f10901a644ea","Type":"ContainerStarted","Data":"c3a7a8927a39103ec57f601056e2745862d11cbfef434599fc257cad09fa75c7"} Dec 04 11:59:18.278970 master-0 kubenswrapper[35367]: I1204 11:59:18.278919 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"58d12e893528ad53a994f10901a644ea","Type":"ContainerStarted","Data":"4d147a6535bb34c902004843cd295f21c14adf8a53e3d2475a55e6a0fc4042b8"} Dec 04 11:59:18.278970 master-0 kubenswrapper[35367]: I1204 11:59:18.278930 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"58d12e893528ad53a994f10901a644ea","Type":"ContainerStarted","Data":"99afa32d2f9e3268c6724b0a1688288ba191e2e74f21c5c1858581b217615c5e"} Dec 04 11:59:18.278970 master-0 kubenswrapper[35367]: I1204 11:59:18.278940 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"58d12e893528ad53a994f10901a644ea","Type":"ContainerStarted","Data":"0e12e517b20bdc3b625c6c718dd1d388d2f2851647216efdfc0047fcce7e1020"} Dec 04 11:59:18.278970 master-0 kubenswrapper[35367]: I1204 11:59:18.278951 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"58d12e893528ad53a994f10901a644ea","Type":"ContainerDied","Data":"d1e0ff4c34bb2478448af3eb31ad0b50e5dd734dc0f6051803b3b18d3de656bf"} Dec 04 11:59:18.278970 master-0 kubenswrapper[35367]: I1204 11:59:18.278963 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"58d12e893528ad53a994f10901a644ea","Type":"ContainerDied","Data":"13b777a669c375f8fa5fb7dc16e22e01b0b37ff83c9fc781534d7ca1c75d6dcd"} Dec 04 11:59:18.278970 master-0 kubenswrapper[35367]: I1204 11:59:18.278974 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"58d12e893528ad53a994f10901a644ea","Type":"ContainerDied","Data":"27595dd7e9f331fc7dddae56f41801fd05186c63f10ec084212462612cf2ce37"} Dec 04 11:59:18.279271 master-0 kubenswrapper[35367]: I1204 11:59:18.278987 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"58d12e893528ad53a994f10901a644ea","Type":"ContainerStarted","Data":"941cfa04ddc49a585fc727a1dbdeb69c47e5f5f598b3a6ea4a0075889e24c1b1"} Dec 04 11:59:18.279271 master-0 kubenswrapper[35367]: I1204 11:59:18.279055 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8ecd2cfee02b8b0f20361982f32303ea3b58c79b0022fe1274942794128ec50" Dec 04 11:59:18.279271 master-0 kubenswrapper[35367]: I1204 11:59:18.279070 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e53241da78dfcc827440e729a29c6a711ab284ebcb1ae27338b43e1937314aa2" Dec 04 11:59:18.279271 master-0 kubenswrapper[35367]: I1204 11:59:18.279135 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d4beb2f0b38b3d4aa0fa8f563ff00704337802d5948c53adb4467f6318ead67" Dec 04 11:59:18.279271 master-0 kubenswrapper[35367]: I1204 11:59:18.279152 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"c7daeda85ec183c8d113e00834a6cc8eb19542aa3278f40e44cf98acd7483141"} Dec 04 11:59:18.279271 master-0 kubenswrapper[35367]: I1204 11:59:18.279165 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerDied","Data":"f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce"} Dec 04 11:59:18.279271 master-0 kubenswrapper[35367]: I1204 11:59:18.279177 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"a4300d8490d9cbb0f00793e382d3ed2318a1bd59a39a4b37b7e8bc4be83371b7"} Dec 04 11:59:18.279271 master-0 kubenswrapper[35367]: I1204 11:59:18.279188 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerDied","Data":"11e29c5651a5425702af55ec3b8ee473df3972ab82e099ae3490c6b27969c94a"} Dec 04 11:59:18.279271 master-0 kubenswrapper[35367]: I1204 11:59:18.279202 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"f78a7d287972772a3c979bede114291f869074b909122bce68dcbdb34f2d707c"} Dec 04 11:59:18.279271 master-0 kubenswrapper[35367]: I1204 11:59:18.279220 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"c2e0a5f7188ebd1ad7d4edbad094215c2f60dd9e9a0830dce848050e834e809c"} Dec 04 11:59:18.279271 master-0 kubenswrapper[35367]: I1204 11:59:18.279259 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f6c1368ad9227af2c52859d3ca6113c4596b01abb133cabab18d8effbf3af73" Dec 04 11:59:18.279558 master-0 kubenswrapper[35367]: I1204 11:59:18.279309 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f10cd46382bef7256c0fac8a54a8e2e84ada2a13006e11bf8f929bfbffd0d8f6" Dec 04 11:59:18.279558 master-0 kubenswrapper[35367]: I1204 11:59:18.279374 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94e218e8d16edaeda65a04226930569ea4a5556ecc735d8f29bd11d61ca1a830" Dec 04 11:59:18.279558 master-0 kubenswrapper[35367]: I1204 11:59:18.279412 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85449a546194f1b7d82572b88b05b009dbf13dc608b9793959a5abd709bf99f0" Dec 04 11:59:18.279558 master-0 kubenswrapper[35367]: I1204 11:59:18.279426 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="316c5e4ee364a2a13dc43f614dbb4819fb55d19d157fabc9948456d96702381e" Dec 04 11:59:18.279558 master-0 kubenswrapper[35367]: I1204 11:59:18.279448 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"3169f44496ed8a28c6d6a15511ab0eec","Type":"ContainerStarted","Data":"cdc388259d8085154ae8e01bcad3dcfe7d469aa6e6aee3f021b6d2209453f2f4"} Dec 04 11:59:18.279558 master-0 kubenswrapper[35367]: I1204 11:59:18.279461 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"3169f44496ed8a28c6d6a15511ab0eec","Type":"ContainerDied","Data":"3ed798c104f2e301f0961443f8ab6df6e17ec4caae5f1436b2b93d415a28f796"} Dec 04 11:59:18.279558 master-0 kubenswrapper[35367]: I1204 11:59:18.279473 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"3169f44496ed8a28c6d6a15511ab0eec","Type":"ContainerDied","Data":"fe978e3c9349858cb4986d59a0d297668af47052f5667b090a002d76ebcd619e"} Dec 04 11:59:18.279558 master-0 kubenswrapper[35367]: I1204 11:59:18.279485 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"3169f44496ed8a28c6d6a15511ab0eec","Type":"ContainerStarted","Data":"870c232b93a5ee37a81fedb1347de97a51e51c964baa741a79bf8da03ca09932"} Dec 04 11:59:18.279558 master-0 kubenswrapper[35367]: I1204 11:59:18.279502 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"bdd20c68f1ccfd1240fb273af0638d01","Type":"ContainerStarted","Data":"9e6711a29e80dd1a67221ee7d3cb99dca0b39d86d535ebc251bf63200ef5ce12"} Dec 04 11:59:18.279558 master-0 kubenswrapper[35367]: I1204 11:59:18.279515 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"bdd20c68f1ccfd1240fb273af0638d01","Type":"ContainerStarted","Data":"e2713a2b9adf8ac2cd64c11a8cc47639892df9751d3f6828f4bd8b7f6c344a80"} Dec 04 11:59:18.279558 master-0 kubenswrapper[35367]: I1204 11:59:18.279526 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"bdd20c68f1ccfd1240fb273af0638d01","Type":"ContainerStarted","Data":"1dd3e9bec426604298540a62160aa04995ba35e82eac44c41bf666b47786e5c9"} Dec 04 11:59:18.279558 master-0 kubenswrapper[35367]: I1204 11:59:18.279537 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"bdd20c68f1ccfd1240fb273af0638d01","Type":"ContainerDied","Data":"83e55c475e3dc5500479af8907cda3d13a24a31c8ee5c2278bdd8d400f5e7292"} Dec 04 11:59:18.279558 master-0 kubenswrapper[35367]: I1204 11:59:18.279549 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"bdd20c68f1ccfd1240fb273af0638d01","Type":"ContainerDied","Data":"e892e4a03cb775cc984461c05f66ebb315e6e3256740bfe4765f9efa5a82a35d"} Dec 04 11:59:18.279558 master-0 kubenswrapper[35367]: I1204 11:59:18.279559 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"bdd20c68f1ccfd1240fb273af0638d01","Type":"ContainerDied","Data":"f22a84f6fb348e29fba57d1a09fc02c20059513a38fe36937800076d569de9eb"} Dec 04 11:59:18.279558 master-0 kubenswrapper[35367]: I1204 11:59:18.279572 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"bdd20c68f1ccfd1240fb273af0638d01","Type":"ContainerStarted","Data":"5a1b18048a411d2d744b17951526af70eccaa227a92df3b43814bef05c92e2a1"} Dec 04 11:59:18.279998 master-0 kubenswrapper[35367]: I1204 11:59:18.279599 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00813d6015185c762c89a6e20123d5d07121f53829d1dd63e0143457b80b8cb5" Dec 04 11:59:18.279998 master-0 kubenswrapper[35367]: I1204 11:59:18.279614 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e526280d34ec437bd97a8b63aabde2fa2c77527089e55d85797209e690ed274b" Dec 04 11:59:18.280863 master-0 kubenswrapper[35367]: I1204 11:59:18.280828 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:18.280932 master-0 kubenswrapper[35367]: I1204 11:59:18.280880 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:18.280932 master-0 kubenswrapper[35367]: I1204 11:59:18.280901 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:18.349292 master-0 kubenswrapper[35367]: I1204 11:59:18.349204 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:18.349647 master-0 kubenswrapper[35367]: I1204 11:59:18.349304 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/e6b437c60bb18680f4492b00b294e872-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"e6b437c60bb18680f4492b00b294e872\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:59:18.349647 master-0 kubenswrapper[35367]: I1204 11:59:18.349342 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/bdd20c68f1ccfd1240fb273af0638d01-resource-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"bdd20c68f1ccfd1240fb273af0638d01\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 11:59:18.349647 master-0 kubenswrapper[35367]: I1204 11:59:18.349372 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3169f44496ed8a28c6d6a15511ab0eec-etc-kube\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"3169f44496ed8a28c6d6a15511ab0eec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 11:59:18.349647 master-0 kubenswrapper[35367]: I1204 11:59:18.349395 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-static-pod-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:59:18.349647 master-0 kubenswrapper[35367]: I1204 11:59:18.349420 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"b89698aa356a3bc32694e2b098f9a900\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:18.349647 master-0 kubenswrapper[35367]: I1204 11:59:18.349445 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/bdd20c68f1ccfd1240fb273af0638d01-cert-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"bdd20c68f1ccfd1240fb273af0638d01\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 11:59:18.349647 master-0 kubenswrapper[35367]: I1204 11:59:18.349470 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-resource-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:59:18.349647 master-0 kubenswrapper[35367]: I1204 11:59:18.349495 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"b89698aa356a3bc32694e2b098f9a900\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:18.349647 master-0 kubenswrapper[35367]: I1204 11:59:18.349515 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:18.349647 master-0 kubenswrapper[35367]: I1204 11:59:18.349537 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:18.349647 master-0 kubenswrapper[35367]: I1204 11:59:18.349564 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/e6b437c60bb18680f4492b00b294e872-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"e6b437c60bb18680f4492b00b294e872\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:59:18.349647 master-0 kubenswrapper[35367]: I1204 11:59:18.349591 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3169f44496ed8a28c6d6a15511ab0eec-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"3169f44496ed8a28c6d6a15511ab0eec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 11:59:18.349647 master-0 kubenswrapper[35367]: I1204 11:59:18.349620 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-cert-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:59:18.350259 master-0 kubenswrapper[35367]: I1204 11:59:18.349735 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-usr-local-bin\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:59:18.350259 master-0 kubenswrapper[35367]: I1204 11:59:18.349835 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-log-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:59:18.350259 master-0 kubenswrapper[35367]: I1204 11:59:18.349869 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"b89698aa356a3bc32694e2b098f9a900\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:18.350259 master-0 kubenswrapper[35367]: I1204 11:59:18.349892 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:18.350259 master-0 kubenswrapper[35367]: I1204 11:59:18.349916 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:18.350259 master-0 kubenswrapper[35367]: I1204 11:59:18.349932 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-data-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:59:18.451673 master-0 kubenswrapper[35367]: I1204 11:59:18.451587 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"b89698aa356a3bc32694e2b098f9a900\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:18.451673 master-0 kubenswrapper[35367]: I1204 11:59:18.451671 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/bdd20c68f1ccfd1240fb273af0638d01-cert-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"bdd20c68f1ccfd1240fb273af0638d01\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 11:59:18.452017 master-0 kubenswrapper[35367]: I1204 11:59:18.451762 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"b89698aa356a3bc32694e2b098f9a900\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:18.452017 master-0 kubenswrapper[35367]: I1204 11:59:18.451901 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-resource-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:59:18.452196 master-0 kubenswrapper[35367]: I1204 11:59:18.452159 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/e6b437c60bb18680f4492b00b294e872-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"e6b437c60bb18680f4492b00b294e872\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:59:18.452196 master-0 kubenswrapper[35367]: I1204 11:59:18.452187 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-resource-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:59:18.452509 master-0 kubenswrapper[35367]: I1204 11:59:18.452198 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3169f44496ed8a28c6d6a15511ab0eec-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"3169f44496ed8a28c6d6a15511ab0eec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 11:59:18.452509 master-0 kubenswrapper[35367]: I1204 11:59:18.452227 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-cert-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:59:18.452509 master-0 kubenswrapper[35367]: I1204 11:59:18.452224 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/e6b437c60bb18680f4492b00b294e872-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"e6b437c60bb18680f4492b00b294e872\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:59:18.452509 master-0 kubenswrapper[35367]: I1204 11:59:18.452245 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-usr-local-bin\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:59:18.452509 master-0 kubenswrapper[35367]: I1204 11:59:18.452265 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3169f44496ed8a28c6d6a15511ab0eec-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"3169f44496ed8a28c6d6a15511ab0eec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 11:59:18.452509 master-0 kubenswrapper[35367]: I1204 11:59:18.452267 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-log-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:59:18.452509 master-0 kubenswrapper[35367]: I1204 11:59:18.452017 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/bdd20c68f1ccfd1240fb273af0638d01-cert-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"bdd20c68f1ccfd1240fb273af0638d01\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 11:59:18.452509 master-0 kubenswrapper[35367]: I1204 11:59:18.452393 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-cert-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:59:18.452509 master-0 kubenswrapper[35367]: I1204 11:59:18.452466 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-usr-local-bin\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:59:18.452930 master-0 kubenswrapper[35367]: I1204 11:59:18.452528 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"b89698aa356a3bc32694e2b098f9a900\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:18.452930 master-0 kubenswrapper[35367]: I1204 11:59:18.452565 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:18.452930 master-0 kubenswrapper[35367]: I1204 11:59:18.452572 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-log-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:59:18.452930 master-0 kubenswrapper[35367]: I1204 11:59:18.452586 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:18.452930 master-0 kubenswrapper[35367]: I1204 11:59:18.452629 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:18.452930 master-0 kubenswrapper[35367]: I1204 11:59:18.452660 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"b89698aa356a3bc32694e2b098f9a900\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:18.452930 master-0 kubenswrapper[35367]: I1204 11:59:18.452704 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:18.452930 master-0 kubenswrapper[35367]: I1204 11:59:18.452732 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-data-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:59:18.452930 master-0 kubenswrapper[35367]: I1204 11:59:18.452756 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"b89698aa356a3bc32694e2b098f9a900\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:18.452930 master-0 kubenswrapper[35367]: I1204 11:59:18.452776 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:18.452930 master-0 kubenswrapper[35367]: I1204 11:59:18.452777 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-data-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:59:18.452930 master-0 kubenswrapper[35367]: I1204 11:59:18.452801 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:18.452930 master-0 kubenswrapper[35367]: I1204 11:59:18.452881 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"b89698aa356a3bc32694e2b098f9a900\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:18.452930 master-0 kubenswrapper[35367]: I1204 11:59:18.452927 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:18.453305 master-0 kubenswrapper[35367]: I1204 11:59:18.452963 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:18.453305 master-0 kubenswrapper[35367]: I1204 11:59:18.452996 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3169f44496ed8a28c6d6a15511ab0eec-etc-kube\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"3169f44496ed8a28c6d6a15511ab0eec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 11:59:18.453305 master-0 kubenswrapper[35367]: I1204 11:59:18.453023 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-static-pod-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:59:18.453305 master-0 kubenswrapper[35367]: I1204 11:59:18.453085 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3169f44496ed8a28c6d6a15511ab0eec-etc-kube\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"3169f44496ed8a28c6d6a15511ab0eec\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Dec 04 11:59:18.453305 master-0 kubenswrapper[35367]: I1204 11:59:18.453156 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:18.453509 master-0 kubenswrapper[35367]: I1204 11:59:18.453467 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/58d12e893528ad53a994f10901a644ea-static-pod-dir\") pod \"etcd-master-0\" (UID: \"58d12e893528ad53a994f10901a644ea\") " pod="openshift-etcd/etcd-master-0" Dec 04 11:59:18.453556 master-0 kubenswrapper[35367]: I1204 11:59:18.453521 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/e6b437c60bb18680f4492b00b294e872-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"e6b437c60bb18680f4492b00b294e872\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:59:18.453556 master-0 kubenswrapper[35367]: I1204 11:59:18.453551 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/bdd20c68f1ccfd1240fb273af0638d01-resource-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"bdd20c68f1ccfd1240fb273af0638d01\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 11:59:18.453643 master-0 kubenswrapper[35367]: I1204 11:59:18.453592 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"a906debd0c35952850935aee2d607cce\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:18.453643 master-0 kubenswrapper[35367]: I1204 11:59:18.453616 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/e6b437c60bb18680f4492b00b294e872-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"e6b437c60bb18680f4492b00b294e872\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:59:18.453736 master-0 kubenswrapper[35367]: I1204 11:59:18.453707 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/bdd20c68f1ccfd1240fb273af0638d01-resource-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"bdd20c68f1ccfd1240fb273af0638d01\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 11:59:18.463885 master-0 kubenswrapper[35367]: I1204 11:59:18.463788 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:18.468310 master-0 kubenswrapper[35367]: I1204 11:59:18.468249 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:18.468310 master-0 kubenswrapper[35367]: I1204 11:59:18.468315 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:18.468310 master-0 kubenswrapper[35367]: I1204 11:59:18.468328 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:18.468657 master-0 kubenswrapper[35367]: I1204 11:59:18.468360 35367 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 11:59:18.470635 master-0 kubenswrapper[35367]: E1204 11:59:18.470552 35367 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/nodes\": dial tcp 192.168.32.10:6443: connect: connection refused" node="master-0" Dec 04 11:59:18.560414 master-0 kubenswrapper[35367]: I1204 11:59:18.560327 35367 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:59:18.584278 master-0 kubenswrapper[35367]: I1204 11:59:18.584200 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:18.586286 master-0 kubenswrapper[35367]: I1204 11:59:18.586262 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:18.586365 master-0 kubenswrapper[35367]: I1204 11:59:18.586292 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:18.586365 master-0 kubenswrapper[35367]: I1204 11:59:18.586303 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:18.689986 master-0 kubenswrapper[35367]: I1204 11:59:18.689912 35367 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.sno.openstack.lab:6443/apis/storage.k8s.io/v1/csinodes/master-0?resourceVersion=0": dial tcp 192.168.32.10:6443: connect: connection refused Dec 04 11:59:18.722266 master-0 kubenswrapper[35367]: I1204 11:59:18.722204 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-etcd/etcd-master-0" Dec 04 11:59:19.026704 master-0 kubenswrapper[35367]: I1204 11:59:19.026012 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:19.026704 master-0 kubenswrapper[35367]: I1204 11:59:19.026172 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:19.026704 master-0 kubenswrapper[35367]: I1204 11:59:19.026371 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:19.027077 master-0 kubenswrapper[35367]: I1204 11:59:19.026662 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:19.036595 master-0 kubenswrapper[35367]: I1204 11:59:19.036537 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:19.036595 master-0 kubenswrapper[35367]: I1204 11:59:19.036581 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:19.036595 master-0 kubenswrapper[35367]: I1204 11:59:19.036592 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:19.036595 master-0 kubenswrapper[35367]: I1204 11:59:19.036585 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:19.036994 master-0 kubenswrapper[35367]: I1204 11:59:19.036629 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:19.036994 master-0 kubenswrapper[35367]: I1204 11:59:19.036640 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:19.036994 master-0 kubenswrapper[35367]: I1204 11:59:19.036690 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:19.036994 master-0 kubenswrapper[35367]: I1204 11:59:19.036752 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:19.036994 master-0 kubenswrapper[35367]: I1204 11:59:19.036766 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:19.037147 master-0 kubenswrapper[35367]: I1204 11:59:19.037026 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:19.037147 master-0 kubenswrapper[35367]: I1204 11:59:19.037082 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:19.037147 master-0 kubenswrapper[35367]: I1204 11:59:19.037093 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:19.270988 master-0 kubenswrapper[35367]: I1204 11:59:19.270928 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:19.273649 master-0 kubenswrapper[35367]: I1204 11:59:19.273602 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:19.273746 master-0 kubenswrapper[35367]: I1204 11:59:19.273667 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:19.273746 master-0 kubenswrapper[35367]: I1204 11:59:19.273679 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:19.273746 master-0 kubenswrapper[35367]: I1204 11:59:19.273710 35367 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 11:59:19.274508 master-0 kubenswrapper[35367]: E1204 11:59:19.274464 35367 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/nodes\": dial tcp 192.168.32.10:6443: connect: connection refused" node="master-0" Dec 04 11:59:20.033529 master-0 kubenswrapper[35367]: I1204 11:59:20.033464 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"b89698aa356a3bc32694e2b098f9a900","Type":"ContainerStarted","Data":"cdff2554bec5109c6fb56d02b89ce91b7e5ae9149be4dbc32f66ecd6e906fb18"} Dec 04 11:59:20.036388 master-0 kubenswrapper[35367]: I1204 11:59:20.036343 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/7.log" Dec 04 11:59:20.037394 master-0 kubenswrapper[35367]: I1204 11:59:20.037351 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-cert-syncer/0.log" Dec 04 11:59:20.037870 master-0 kubenswrapper[35367]: I1204 11:59:20.037779 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"75c0b00a72249ad8e40bfad00297d89e0a781c353f7f4ed419a2d838ec6cf264"} Dec 04 11:59:20.037980 master-0 kubenswrapper[35367]: I1204 11:59:20.037962 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:20.039981 master-0 kubenswrapper[35367]: I1204 11:59:20.039937 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:20.039981 master-0 kubenswrapper[35367]: I1204 11:59:20.039976 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:20.039981 master-0 kubenswrapper[35367]: I1204 11:59:20.039985 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:20.450247 master-0 kubenswrapper[35367]: I1204 11:59:20.450183 35367 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:59:20.877842 master-0 kubenswrapper[35367]: I1204 11:59:20.875340 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:20.896840 master-0 kubenswrapper[35367]: I1204 11:59:20.885719 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:20.896840 master-0 kubenswrapper[35367]: I1204 11:59:20.885786 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:20.896840 master-0 kubenswrapper[35367]: I1204 11:59:20.885795 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:20.896840 master-0 kubenswrapper[35367]: I1204 11:59:20.893966 35367 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 11:59:21.049491 master-0 kubenswrapper[35367]: I1204 11:59:21.049427 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"b89698aa356a3bc32694e2b098f9a900","Type":"ContainerStarted","Data":"11babe89d63cf1e9f5609a7705e10a3f5d41e4c224bf41a34d7138b1b1315a56"} Dec 04 11:59:21.050051 master-0 kubenswrapper[35367]: I1204 11:59:21.049510 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:21.051717 master-0 kubenswrapper[35367]: I1204 11:59:21.051685 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:21.051780 master-0 kubenswrapper[35367]: I1204 11:59:21.051723 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:21.051780 master-0 kubenswrapper[35367]: I1204 11:59:21.051736 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:21.398474 master-0 kubenswrapper[35367]: I1204 11:59:21.398428 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-etcd/etcd-master-0" Dec 04 11:59:21.398625 master-0 kubenswrapper[35367]: I1204 11:59:21.398608 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:21.401093 master-0 kubenswrapper[35367]: I1204 11:59:21.401031 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:21.401093 master-0 kubenswrapper[35367]: I1204 11:59:21.401076 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:21.401093 master-0 kubenswrapper[35367]: I1204 11:59:21.401088 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:21.641637 master-0 kubenswrapper[35367]: I1204 11:59:21.641487 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:59:22.057819 master-0 kubenswrapper[35367]: I1204 11:59:22.057752 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"b89698aa356a3bc32694e2b098f9a900","Type":"ContainerStarted","Data":"86fe179fd7e6d66c7c6aee7210b73a29502acdb4489f86e0446e1630fe925649"} Dec 04 11:59:22.058451 master-0 kubenswrapper[35367]: I1204 11:59:22.057874 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:22.058451 master-0 kubenswrapper[35367]: I1204 11:59:22.057834 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"b89698aa356a3bc32694e2b098f9a900","Type":"ContainerStarted","Data":"50751e477a1990bac29d99e1e1e13b9e92fd951957f425d40e2f3df08333c017"} Dec 04 11:59:22.058451 master-0 kubenswrapper[35367]: I1204 11:59:22.057955 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"b89698aa356a3bc32694e2b098f9a900","Type":"ContainerStarted","Data":"4bb909346b84f8be0c2c2a7012f593866426dab17ad6ccaa6a7d46aff42bc3a1"} Dec 04 11:59:22.058451 master-0 kubenswrapper[35367]: I1204 11:59:22.057935 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:22.063758 master-0 kubenswrapper[35367]: I1204 11:59:22.063701 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:22.063758 master-0 kubenswrapper[35367]: I1204 11:59:22.063748 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:22.063758 master-0 kubenswrapper[35367]: I1204 11:59:22.063760 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:22.064326 master-0 kubenswrapper[35367]: I1204 11:59:22.064277 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:22.064381 master-0 kubenswrapper[35367]: I1204 11:59:22.064327 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:22.064381 master-0 kubenswrapper[35367]: I1204 11:59:22.064339 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:22.866217 master-0 kubenswrapper[35367]: I1204 11:59:22.866126 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 11:59:22.866460 master-0 kubenswrapper[35367]: I1204 11:59:22.866320 35367 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 11:59:22.866460 master-0 kubenswrapper[35367]: I1204 11:59:22.866370 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:22.869179 master-0 kubenswrapper[35367]: I1204 11:59:22.869130 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:22.869274 master-0 kubenswrapper[35367]: I1204 11:59:22.869187 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:22.869274 master-0 kubenswrapper[35367]: I1204 11:59:22.869200 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:22.871231 master-0 kubenswrapper[35367]: I1204 11:59:22.871171 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 11:59:23.064258 master-0 kubenswrapper[35367]: I1204 11:59:23.064186 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:23.064258 master-0 kubenswrapper[35367]: I1204 11:59:23.064235 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:23.064895 master-0 kubenswrapper[35367]: I1204 11:59:23.064186 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:23.064895 master-0 kubenswrapper[35367]: I1204 11:59:23.064528 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:23.067778 master-0 kubenswrapper[35367]: I1204 11:59:23.067727 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:23.067778 master-0 kubenswrapper[35367]: I1204 11:59:23.067772 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:23.067932 master-0 kubenswrapper[35367]: I1204 11:59:23.067790 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:23.067932 master-0 kubenswrapper[35367]: I1204 11:59:23.067727 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:23.067932 master-0 kubenswrapper[35367]: I1204 11:59:23.067925 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:23.068019 master-0 kubenswrapper[35367]: I1204 11:59:23.067727 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:23.068019 master-0 kubenswrapper[35367]: I1204 11:59:23.067941 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:23.068019 master-0 kubenswrapper[35367]: I1204 11:59:23.067965 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:23.068019 master-0 kubenswrapper[35367]: I1204 11:59:23.067981 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:24.027300 master-0 kubenswrapper[35367]: I1204 11:59:24.027235 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:24.032773 master-0 kubenswrapper[35367]: I1204 11:59:24.032720 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:24.069771 master-0 kubenswrapper[35367]: I1204 11:59:24.069722 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:24.071779 master-0 kubenswrapper[35367]: I1204 11:59:24.071732 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:24.071950 master-0 kubenswrapper[35367]: I1204 11:59:24.071923 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:24.072007 master-0 kubenswrapper[35367]: I1204 11:59:24.071955 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:24.072007 master-0 kubenswrapper[35367]: I1204 11:59:24.071967 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:24.075598 master-0 kubenswrapper[35367]: I1204 11:59:24.075558 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:24.642537 master-0 kubenswrapper[35367]: I1204 11:59:24.642430 35367 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:59:24.642898 master-0 kubenswrapper[35367]: I1204 11:59:24.642577 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Dec 04 11:59:24.680793 master-0 kubenswrapper[35367]: I1204 11:59:24.680658 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:59:24.681112 master-0 kubenswrapper[35367]: I1204 11:59:24.680934 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:24.683877 master-0 kubenswrapper[35367]: I1204 11:59:24.683782 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:24.683877 master-0 kubenswrapper[35367]: I1204 11:59:24.683877 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:24.684033 master-0 kubenswrapper[35367]: I1204 11:59:24.683887 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:25.076467 master-0 kubenswrapper[35367]: I1204 11:59:25.076384 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:25.079077 master-0 kubenswrapper[35367]: I1204 11:59:25.079034 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:25.079157 master-0 kubenswrapper[35367]: I1204 11:59:25.079083 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:25.079157 master-0 kubenswrapper[35367]: I1204 11:59:25.079100 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:25.908074 master-0 kubenswrapper[35367]: I1204 11:59:25.907990 35367 reflector.go:368] Caches populated for *v1.CSIDriver from k8s.io/client-go/informers/factory.go:160 Dec 04 11:59:25.911543 master-0 kubenswrapper[35367]: I1204 11:59:25.911464 35367 reflector.go:368] Caches populated for *v1.Service from k8s.io/client-go/informers/factory.go:160 Dec 04 11:59:25.912526 master-0 kubenswrapper[35367]: E1204 11:59:25.912447 35367 kubelet_node_status.go:99] "Unable to register node with API server" err="nodes \"master-0\" is forbidden: autoscaling.openshift.io/ManagedNode infra config cache not synchronized" node="master-0" Dec 04 11:59:25.916106 master-0 kubenswrapper[35367]: I1204 11:59:25.916049 35367 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Dec 04 11:59:26.084909 master-0 kubenswrapper[35367]: I1204 11:59:26.084374 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:26.087409 master-0 kubenswrapper[35367]: I1204 11:59:26.087361 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:26.087510 master-0 kubenswrapper[35367]: I1204 11:59:26.087416 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:26.087510 master-0 kubenswrapper[35367]: I1204 11:59:26.087428 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:26.115997 master-0 kubenswrapper[35367]: I1204 11:59:26.115932 35367 reflector.go:368] Caches populated for *v1.Node from k8s.io/client-go/informers/factory.go:160 Dec 04 11:59:26.305032 master-0 kubenswrapper[35367]: I1204 11:59:26.304898 35367 reflector.go:368] Caches populated for *v1.RuntimeClass from k8s.io/client-go/informers/factory.go:160 Dec 04 11:59:26.687600 master-0 kubenswrapper[35367]: I1204 11:59:26.687527 35367 apiserver.go:52] "Watching apiserver" Dec 04 11:59:26.704858 master-0 kubenswrapper[35367]: I1204 11:59:26.704777 35367 reflector.go:368] Caches populated for *v1.Pod from pkg/kubelet/config/apiserver.go:66 Dec 04 11:59:26.709938 master-0 kubenswrapper[35367]: I1204 11:59:26.708316 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0","openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv","openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn","openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq","openshift-network-operator/network-operator-79767b7ff9-5bgzx","openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr","openshift-etcd/installer-2-master-0","openshift-ingress-operator/ingress-operator-8649c48786-cx2b2","openshift-kube-apiserver/installer-3-master-0","openshift-kube-apiserver/kube-apiserver-master-0","openshift-kube-scheduler/installer-4-master-0","openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5","openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0","openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn","openshift-kube-scheduler/openshift-kube-scheduler-master-0","openshift-marketplace/certified-operators-8qs8v","openshift-marketplace/marketplace-operator-f797b99b6-hjjrk","openshift-multus/multus-admission-controller-7dfc5b745f-258xq","openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t","openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2","openshift-dns/node-resolver-qq64m","openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw","openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk","openshift-dns-operator/dns-operator-7c56cf9b74-xz27r","openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw","openshift-etcd/etcd-master-0","openshift-machine-config-operator/kube-rbac-proxy-crio-master-0","openshift-marketplace/redhat-marketplace-svhl4","openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5","openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm","openshift-network-node-identity/network-node-identity-f8hvq","openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q","openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll","openshift-cluster-storage-operator/csi-snapshot-controller-operator-6bc8656fdc-2q7f5","openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx","openshift-controller-manager/controller-manager-6686654b8d-rrndk","openshift-dns/dns-default-xg7vh","openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg","openshift-multus/multus-additional-cni-plugins-6pk59","openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g","openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn","openshift-multus/network-metrics-daemon-gp57t","openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf","openshift-cluster-samples-operator/cluster-samples-operator-797cfd8b47-8wqgp","openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr","openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k","openshift-kube-controller-manager/installer-2-master-0","openshift-machine-api/machine-api-operator-88d48b57d-9fjtd","openshift-marketplace/community-operators-fvf4r","openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2","openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn","openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j","openshift-marketplace/community-operators-rxhpq","openshift-network-diagnostics/network-check-target-w2lss","openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq","openshift-kube-apiserver/bootstrap-kube-apiserver-master-0","openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk","openshift-apiserver/apiserver-6cbcc775d9-jrlx4","openshift-cluster-node-tuning-operator/tuned-dp5s8","openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd","openshift-kube-apiserver/installer-1-master-0","openshift-kube-controller-manager/installer-3-master-0","openshift-multus/multus-twxbl","openshift-ovn-kubernetes/ovnkube-node-z4qvm","openshift-service-ca/service-ca-77c99c46b8-6cntk","assisted-installer/assisted-installer-controller-lj5rn","openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv","openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948","openshift-etcd/installer-1-master-0","openshift-network-operator/iptables-alerter-bkmlp","openshift-kube-storage-version-migrator/migrator-74b7b57c65-d6v67","openshift-marketplace/redhat-operators-wksdw","openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq","openshift-insights/insights-operator-55965856b6-skbmb","openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf"] Dec 04 11:59:26.709938 master-0 kubenswrapper[35367]: I1204 11:59:26.709108 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="assisted-installer/assisted-installer-controller-lj5rn" Dec 04 11:59:26.719734 master-0 kubenswrapper[35367]: I1204 11:59:26.719672 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-serving-cert" Dec 04 11:59:26.719961 master-0 kubenswrapper[35367]: I1204 11:59:26.719839 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"openshift-service-ca.crt" Dec 04 11:59:26.720003 master-0 kubenswrapper[35367]: I1204 11:59:26.719689 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"service-ca-operator-config" Dec 04 11:59:26.720068 master-0 kubenswrapper[35367]: I1204 11:59:26.720026 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-root-ca.crt" Dec 04 11:59:26.721427 master-0 kubenswrapper[35367]: I1204 11:59:26.721386 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"kube-root-ca.crt" Dec 04 11:59:26.721638 master-0 kubenswrapper[35367]: I1204 11:59:26.721604 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-storage-operator"/"kube-root-ca.crt" Dec 04 11:59:26.721891 master-0 kubenswrapper[35367]: I1204 11:59:26.721843 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-service-ca.crt" Dec 04 11:59:26.722146 master-0 kubenswrapper[35367]: I1204 11:59:26.722102 35367 kubelet.go:2566] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" mirrorPodUID="ab32df92-dc58-4528-8f31-434280957642" Dec 04 11:59:26.723106 master-0 kubenswrapper[35367]: I1204 11:59:26.723074 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-config" Dec 04 11:59:26.723191 master-0 kubenswrapper[35367]: I1204 11:59:26.723179 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-storage-operator"/"openshift-service-ca.crt" Dec 04 11:59:26.723261 master-0 kubenswrapper[35367]: I1204 11:59:26.723193 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"node-tuning-operator-tls" Dec 04 11:59:26.723301 master-0 kubenswrapper[35367]: I1204 11:59:26.723272 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"kube-root-ca.crt" Dec 04 11:59:26.723340 master-0 kubenswrapper[35367]: I1204 11:59:26.723326 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-olm-operator"/"openshift-service-ca.crt" Dec 04 11:59:26.723394 master-0 kubenswrapper[35367]: I1204 11:59:26.723348 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"openshift-service-ca.crt" Dec 04 11:59:26.723435 master-0 kubenswrapper[35367]: I1204 11:59:26.723409 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-config" Dec 04 11:59:26.723470 master-0 kubenswrapper[35367]: I1204 11:59:26.723456 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"kube-root-ca.crt" Dec 04 11:59:26.723525 master-0 kubenswrapper[35367]: I1204 11:59:26.723497 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-olm-operator"/"cluster-olm-operator-serving-cert" Dec 04 11:59:26.723575 master-0 kubenswrapper[35367]: I1204 11:59:26.723420 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca-operator"/"serving-cert" Dec 04 11:59:26.723616 master-0 kubenswrapper[35367]: I1204 11:59:26.723586 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"kube-root-ca.crt" Dec 04 11:59:26.723660 master-0 kubenswrapper[35367]: I1204 11:59:26.723613 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"kube-root-ca.crt" Dec 04 11:59:26.723660 master-0 kubenswrapper[35367]: I1204 11:59:26.723626 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"openshift-service-ca.crt" Dec 04 11:59:26.723737 master-0 kubenswrapper[35367]: I1204 11:59:26.723710 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-olm-operator"/"kube-root-ca.crt" Dec 04 11:59:26.723737 master-0 kubenswrapper[35367]: I1204 11:59:26.723713 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"performance-addon-operator-webhook-cert" Dec 04 11:59:26.724258 master-0 kubenswrapper[35367]: I1204 11:59:26.724229 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns-operator"/"metrics-tls" Dec 04 11:59:26.725427 master-0 kubenswrapper[35367]: I1204 11:59:26.724729 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"openshift-kube-scheduler-operator-config" Dec 04 11:59:26.725427 master-0 kubenswrapper[35367]: I1204 11:59:26.724847 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"kube-root-ca.crt" Dec 04 11:59:26.725770 master-0 kubenswrapper[35367]: I1204 11:59:26.725733 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-service-ca.crt" Dec 04 11:59:26.725975 master-0 kubenswrapper[35367]: I1204 11:59:26.725945 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-scheduler-operator"/"kube-scheduler-operator-serving-cert" Dec 04 11:59:26.726189 master-0 kubenswrapper[35367]: I1204 11:59:26.726079 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-serving-cert" Dec 04 11:59:26.726372 master-0 kubenswrapper[35367]: I1204 11:59:26.726109 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-config" Dec 04 11:59:26.729896 master-0 kubenswrapper[35367]: I1204 11:59:26.727302 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-serving-cert" Dec 04 11:59:26.729896 master-0 kubenswrapper[35367]: I1204 11:59:26.727447 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"openshift-service-ca.crt" Dec 04 11:59:26.729896 master-0 kubenswrapper[35367]: I1204 11:59:26.727989 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"kube-root-ca.crt" Dec 04 11:59:26.729896 master-0 kubenswrapper[35367]: I1204 11:59:26.728364 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-1-master-0" Dec 04 11:59:26.730682 master-0 kubenswrapper[35367]: I1204 11:59:26.730530 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"kube-root-ca.crt" Dec 04 11:59:26.733552 master-0 kubenswrapper[35367]: I1204 11:59:26.730893 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"config" Dec 04 11:59:26.733552 master-0 kubenswrapper[35367]: I1204 11:59:26.731141 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"openshift-service-ca.crt" Dec 04 11:59:26.733552 master-0 kubenswrapper[35367]: I1204 11:59:26.731996 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"kube-root-ca.crt" Dec 04 11:59:26.733552 master-0 kubenswrapper[35367]: I1204 11:59:26.732464 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-serving-cert" Dec 04 11:59:26.733552 master-0 kubenswrapper[35367]: I1204 11:59:26.733126 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"image-registry-operator-tls" Dec 04 11:59:26.733797 master-0 kubenswrapper[35367]: I1204 11:59:26.733707 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"authentication-operator-config" Dec 04 11:59:26.733797 master-0 kubenswrapper[35367]: I1204 11:59:26.733763 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-operator"/"metrics-tls" Dec 04 11:59:26.734744 master-0 kubenswrapper[35367]: I1204 11:59:26.733894 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"openshift-service-ca.crt" Dec 04 11:59:26.738197 master-0 kubenswrapper[35367]: I1204 11:59:26.735762 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"trusted-ca" Dec 04 11:59:26.738197 master-0 kubenswrapper[35367]: I1204 11:59:26.737010 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-root-ca.crt" Dec 04 11:59:26.738197 master-0 kubenswrapper[35367]: I1204 11:59:26.737126 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"openshift-service-ca.crt" Dec 04 11:59:26.738197 master-0 kubenswrapper[35367]: I1204 11:59:26.737246 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-storage-version-migrator-operator"/"serving-cert" Dec 04 11:59:26.738197 master-0 kubenswrapper[35367]: I1204 11:59:26.737465 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-config" Dec 04 11:59:26.738197 master-0 kubenswrapper[35367]: I1204 11:59:26.737478 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"kube-root-ca.crt" Dec 04 11:59:26.738626 master-0 kubenswrapper[35367]: I1204 11:59:26.737610 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-ca-bundle" Dec 04 11:59:26.738626 master-0 kubenswrapper[35367]: I1204 11:59:26.737696 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-operator-config" Dec 04 11:59:26.738626 master-0 kubenswrapper[35367]: I1204 11:59:26.737726 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"openshift-service-ca.crt" Dec 04 11:59:26.738626 master-0 kubenswrapper[35367]: I1204 11:59:26.737817 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-operator-serving-cert" Dec 04 11:59:26.738626 master-0 kubenswrapper[35367]: I1204 11:59:26.737851 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-client" Dec 04 11:59:26.738626 master-0 kubenswrapper[35367]: I1204 11:59:26.737938 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"openshift-service-ca.crt" Dec 04 11:59:26.739040 master-0 kubenswrapper[35367]: I1204 11:59:26.738033 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"openshift-service-ca.crt" Dec 04 11:59:26.739040 master-0 kubenswrapper[35367]: I1204 11:59:26.738047 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"cluster-monitoring-operator-tls" Dec 04 11:59:26.740383 master-0 kubenswrapper[35367]: I1204 11:59:26.740297 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-service-ca-bundle" Dec 04 11:59:26.741042 master-0 kubenswrapper[35367]: I1204 11:59:26.741001 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"openshift-service-ca.crt" Dec 04 11:59:26.741345 master-0 kubenswrapper[35367]: I1204 11:59:26.741297 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"kube-root-ca.crt" Dec 04 11:59:26.741575 master-0 kubenswrapper[35367]: I1204 11:59:26.741429 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"service-ca-bundle" Dec 04 11:59:26.741575 master-0 kubenswrapper[35367]: I1204 11:59:26.741479 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"openshift-service-ca.crt" Dec 04 11:59:26.743544 master-0 kubenswrapper[35367]: I1204 11:59:26.743494 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-config-operator"/"config-operator-serving-cert" Dec 04 11:59:26.743638 master-0 kubenswrapper[35367]: I1204 11:59:26.743572 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"marketplace-operator-metrics" Dec 04 11:59:26.744991 master-0 kubenswrapper[35367]: I1204 11:59:26.744957 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"pprof-cert" Dec 04 11:59:26.745265 master-0 kubenswrapper[35367]: I1204 11:59:26.745221 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"cni-copy-resources" Dec 04 11:59:26.745446 master-0 kubenswrapper[35367]: I1204 11:59:26.745413 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"multus-daemon-config" Dec 04 11:59:26.745778 master-0 kubenswrapper[35367]: I1204 11:59:26.745744 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"openshift-service-ca.crt" Dec 04 11:59:26.745997 master-0 kubenswrapper[35367]: I1204 11:59:26.745963 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"env-overrides" Dec 04 11:59:26.746194 master-0 kubenswrapper[35367]: I1204 11:59:26.746165 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"catalog-operator-serving-cert" Dec 04 11:59:26.746399 master-0 kubenswrapper[35367]: I1204 11:59:26.746364 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"ovnkube-identity-cm" Dec 04 11:59:26.747438 master-0 kubenswrapper[35367]: I1204 11:59:26.747388 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"telemetry-config" Dec 04 11:59:26.749499 master-0 kubenswrapper[35367]: I1204 11:59:26.749387 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"env-overrides" Dec 04 11:59:26.749950 master-0 kubenswrapper[35367]: I1204 11:59:26.749892 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"metrics-daemon-secret" Dec 04 11:59:26.750024 master-0 kubenswrapper[35367]: I1204 11:59:26.749952 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"kube-root-ca.crt" Dec 04 11:59:26.750024 master-0 kubenswrapper[35367]: I1204 11:59:26.749983 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-operator"/"metrics-tls" Dec 04 11:59:26.750214 master-0 kubenswrapper[35367]: I1204 11:59:26.750181 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"kube-root-ca.crt" Dec 04 11:59:26.750468 master-0 kubenswrapper[35367]: I1204 11:59:26.750438 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kube-root-ca.crt" Dec 04 11:59:26.750578 master-0 kubenswrapper[35367]: I1204 11:59:26.750525 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"openshift-service-ca.crt" Dec 04 11:59:26.750643 master-0 kubenswrapper[35367]: I1204 11:59:26.750617 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"kube-root-ca.crt" Dec 04 11:59:26.750689 master-0 kubenswrapper[35367]: I1204 11:59:26.750663 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"openshift-service-ca.crt" Dec 04 11:59:26.750885 master-0 kubenswrapper[35367]: I1204 11:59:26.750848 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"whereabouts-config" Dec 04 11:59:26.750980 master-0 kubenswrapper[35367]: I1204 11:59:26.750957 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"openshift-service-ca.crt" Dec 04 11:59:26.751032 master-0 kubenswrapper[35367]: I1204 11:59:26.751015 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"openshift-service-ca.crt" Dec 04 11:59:26.751092 master-0 kubenswrapper[35367]: I1204 11:59:26.751063 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"kube-root-ca.crt" Dec 04 11:59:26.751205 master-0 kubenswrapper[35367]: I1204 11:59:26.751184 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"kube-root-ca.crt" Dec 04 11:59:26.751258 master-0 kubenswrapper[35367]: I1204 11:59:26.751209 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"default-cni-sysctl-allowlist" Dec 04 11:59:26.751316 master-0 kubenswrapper[35367]: I1204 11:59:26.751295 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"olm-operator-serving-cert" Dec 04 11:59:26.751377 master-0 kubenswrapper[35367]: I1204 11:59:26.751351 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication-operator"/"serving-cert" Dec 04 11:59:26.751482 master-0 kubenswrapper[35367]: I1204 11:59:26.751456 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-node-identity"/"network-node-identity-cert" Dec 04 11:59:26.751531 master-0 kubenswrapper[35367]: I1204 11:59:26.751475 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-config" Dec 04 11:59:26.751531 master-0 kubenswrapper[35367]: I1204 11:59:26.751492 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-control-plane-metrics-cert" Dec 04 11:59:26.751614 master-0 kubenswrapper[35367]: I1204 11:59:26.751546 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"multus-admission-controller-secret" Dec 04 11:59:26.751655 master-0 kubenswrapper[35367]: I1204 11:59:26.751466 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-1-master-0" Dec 04 11:59:26.751710 master-0 kubenswrapper[35367]: I1204 11:59:26.751692 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"kube-root-ca.crt" Dec 04 11:59:26.751743 master-0 kubenswrapper[35367]: I1204 11:59:26.751719 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"kube-root-ca.crt" Dec 04 11:59:26.757222 master-0 kubenswrapper[35367]: I1204 11:59:26.757164 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"package-server-manager-serving-cert" Dec 04 11:59:26.757420 master-0 kubenswrapper[35367]: I1204 11:59:26.757378 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-4-master-0" Dec 04 11:59:26.758707 master-0 kubenswrapper[35367]: I1204 11:59:26.758674 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"iptables-alerter-script" Dec 04 11:59:26.759153 master-0 kubenswrapper[35367]: I1204 11:59:26.759127 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"kube-root-ca.crt" Dec 04 11:59:26.762199 master-0 kubenswrapper[35367]: I1204 11:59:26.762115 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-2-master-0" Dec 04 11:59:26.762915 master-0 kubenswrapper[35367]: I1204 11:59:26.762865 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-fvf4r" Dec 04 11:59:26.763257 master-0 kubenswrapper[35367]: I1204 11:59:26.763202 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-3-master-0" Dec 04 11:59:26.764973 master-0 kubenswrapper[35367]: I1204 11:59:26.764780 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-node-metrics-cert" Dec 04 11:59:26.766149 master-0 kubenswrapper[35367]: I1204 11:59:26.766106 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-2-master-0" Dec 04 11:59:26.769017 master-0 kubenswrapper[35367]: I1204 11:59:26.768987 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"trusted-ca" Dec 04 11:59:26.770169 master-0 kubenswrapper[35367]: I1204 11:59:26.770146 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"trusted-ca" Dec 04 11:59:26.771184 master-0 kubenswrapper[35367]: I1204 11:59:26.771152 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"trusted-ca-bundle" Dec 04 11:59:26.773902 master-0 kubenswrapper[35367]: I1204 11:59:26.773836 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-script-lib" Dec 04 11:59:26.774675 master-0 kubenswrapper[35367]: I1204 11:59:26.774643 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"marketplace-trusted-ca" Dec 04 11:59:26.776002 master-0 kubenswrapper[35367]: I1204 11:59:26.775923 35367 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" podUID="" Dec 04 11:59:26.776907 master-0 kubenswrapper[35367]: I1204 11:59:26.776883 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-fvf4r" Dec 04 11:59:26.792197 master-0 kubenswrapper[35367]: I1204 11:59:26.792130 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca"/"signing-key" Dec 04 11:59:26.810228 master-0 kubenswrapper[35367]: I1204 11:59:26.810164 35367 desired_state_of_world_populator.go:155] "Finished populating initial desired state of world" Dec 04 11:59:26.812221 master-0 kubenswrapper[35367]: I1204 11:59:26.812174 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator"/"kube-root-ca.crt" Dec 04 11:59:26.820884 master-0 kubenswrapper[35367]: I1204 11:59:26.820781 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-images\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:59:26.820884 master-0 kubenswrapper[35367]: I1204 11:59:26.820884 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8cxbd\" (UniqueName: \"kubernetes.io/projected/0158c2f3-20e5-43f4-875d-c5ad8f6112df-kube-api-access-8cxbd\") pod \"cluster-olm-operator-56fcb6cc5f-4xwp2\" (UID: \"0158c2f3-20e5-43f4-875d-c5ad8f6112df\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:59:26.821153 master-0 kubenswrapper[35367]: I1204 11:59:26.820919 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/ee9a47b1-cdd9-43bc-8115-8851f29106e6-etc-docker\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:59:26.821153 master-0 kubenswrapper[35367]: I1204 11:59:26.820942 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f925fe60-b5b7-4a5a-9800-3546334da725-utilities\") pod \"redhat-marketplace-svhl4\" (UID: \"f925fe60-b5b7-4a5a-9800-3546334da725\") " pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:59:26.821153 master-0 kubenswrapper[35367]: I1204 11:59:26.820965 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/0fad065c-94c9-4a38-ab76-cf0266bdc04b-kube-api-access\") pod \"installer-3-master-0\" (UID: \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 11:59:26.821153 master-0 kubenswrapper[35367]: I1204 11:59:26.820989 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-client-ca\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:59:26.821153 master-0 kubenswrapper[35367]: I1204 11:59:26.821010 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42b3be0f-1d82-4a64-abb4-0118a6960efd-serving-cert\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:59:26.821321 master-0 kubenswrapper[35367]: I1204 11:59:26.821212 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-cni-bin\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.821321 master-0 kubenswrapper[35367]: I1204 11:59:26.821287 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f925fe60-b5b7-4a5a-9800-3546334da725-utilities\") pod \"redhat-marketplace-svhl4\" (UID: \"f925fe60-b5b7-4a5a-9800-3546334da725\") " pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:59:26.821380 master-0 kubenswrapper[35367]: I1204 11:59:26.821274 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7203ec93-6572-4032-825c-140029a86058-webhook-cert\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:59:26.821380 master-0 kubenswrapper[35367]: I1204 11:59:26.821352 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fksx7\" (UniqueName: \"kubernetes.io/projected/7e3160a9-11d1-4845-ba30-1a49ae7339a9-kube-api-access-fksx7\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:59:26.821435 master-0 kubenswrapper[35367]: I1204 11:59:26.821379 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-trusted-ca-bundle\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:26.821435 master-0 kubenswrapper[35367]: I1204 11:59:26.821408 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-metrics-tls\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:59:26.821435 master-0 kubenswrapper[35367]: I1204 11:59:26.821427 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cloud-credential-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/64d30b80-2336-49c2-a2c2-1e0694036a84-cloud-credential-operator-serving-cert\") pod \"cloud-credential-operator-698c598cfc-95jdn\" (UID: \"64d30b80-2336-49c2-a2c2-1e0694036a84\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" Dec 04 11:59:26.821565 master-0 kubenswrapper[35367]: I1204 11:59:26.821450 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4d7939a-5961-4608-b910-73e71aa55bf6-serving-cert\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:59:26.821565 master-0 kubenswrapper[35367]: I1204 11:59:26.821471 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t46k7\" (UniqueName: \"kubernetes.io/projected/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-kube-api-access-t46k7\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:59:26.821565 master-0 kubenswrapper[35367]: I1204 11:59:26.821493 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-auth-proxy-config\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:59:26.821565 master-0 kubenswrapper[35367]: I1204 11:59:26.821534 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-kubelet\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.821565 master-0 kubenswrapper[35367]: I1204 11:59:26.821554 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/287fba2d-f56d-4ec0-b796-7849a68fb411-ovnkube-config\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:59:26.821699 master-0 kubenswrapper[35367]: I1204 11:59:26.821574 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27576028-d64a-47cd-b76b-d524e41efe37-serving-cert\") pod \"openshift-kube-scheduler-operator-5f85974995-g4rwv\" (UID: \"27576028-d64a-47cd-b76b-d524e41efe37\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:59:26.821699 master-0 kubenswrapper[35367]: I1204 11:59:26.821595 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-profile-collector-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:59:26.821699 master-0 kubenswrapper[35367]: I1204 11:59:26.821616 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovnkube-script-lib\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.821699 master-0 kubenswrapper[35367]: I1204 11:59:26.821644 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/1897bad8-3875-4bd6-b877-b1abe1fe76c7-etc-containers\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:59:26.821834 master-0 kubenswrapper[35367]: I1204 11:59:26.821694 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7203ec93-6572-4032-825c-140029a86058-webhook-cert\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:59:26.821834 master-0 kubenswrapper[35367]: I1204 11:59:26.821742 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8w6kv\" (UniqueName: \"kubernetes.io/projected/ccf1cb9e-8885-4224-92d5-d1b116bc0090-kube-api-access-8w6kv\") pod \"cluster-samples-operator-797cfd8b47-8wqgp\" (UID: \"ccf1cb9e-8885-4224-92d5-d1b116bc0090\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-797cfd8b47-8wqgp" Dec 04 11:59:26.821834 master-0 kubenswrapper[35367]: I1204 11:59:26.821773 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n6bhm\" (UniqueName: \"kubernetes.io/projected/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-kube-api-access-n6bhm\") pod \"service-ca-operator-77758bc754-8smqn\" (UID: \"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8\") " pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:59:26.822155 master-0 kubenswrapper[35367]: I1204 11:59:26.822085 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovnkube-script-lib\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.822222 master-0 kubenswrapper[35367]: I1204 11:59:26.822159 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27576028-d64a-47cd-b76b-d524e41efe37-serving-cert\") pod \"openshift-kube-scheduler-operator-5f85974995-g4rwv\" (UID: \"27576028-d64a-47cd-b76b-d524e41efe37\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:59:26.822222 master-0 kubenswrapper[35367]: I1204 11:59:26.822190 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-olm-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/0158c2f3-20e5-43f4-875d-c5ad8f6112df-cluster-olm-operator-serving-cert\") pod \"cluster-olm-operator-56fcb6cc5f-4xwp2\" (UID: \"0158c2f3-20e5-43f4-875d-c5ad8f6112df\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:59:26.822352 master-0 kubenswrapper[35367]: I1204 11:59:26.822205 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/287fba2d-f56d-4ec0-b796-7849a68fb411-ovnkube-config\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:59:26.822352 master-0 kubenswrapper[35367]: I1204 11:59:26.822264 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/7ec61be5-32f9-4aac-815f-41d173213107-encryption-config\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:26.822352 master-0 kubenswrapper[35367]: I1204 11:59:26.822317 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2ab26ae5-0607-4dfd-840e-531d204b5030-telemetry-config\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:59:26.822352 master-0 kubenswrapper[35367]: I1204 11:59:26.822347 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b668f740-dbc3-48e0-9ebc-83bae3a43c83-snapshots\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:59:26.822538 master-0 kubenswrapper[35367]: I1204 11:59:26.822277 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-profile-collector-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:59:26.822538 master-0 kubenswrapper[35367]: I1204 11:59:26.822373 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rhmlm\" (UniqueName: \"kubernetes.io/projected/a5b826c3-8638-4cf5-b974-b24e4282ce00-kube-api-access-rhmlm\") pod \"openshift-apiserver-operator-7bf7f6b755-sh6qf\" (UID: \"a5b826c3-8638-4cf5-b974-b24e4282ce00\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:59:26.822538 master-0 kubenswrapper[35367]: I1204 11:59:26.822424 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42b3be0f-1d82-4a64-abb4-0118a6960efd-serving-cert\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:59:26.822538 master-0 kubenswrapper[35367]: I1204 11:59:26.822420 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-metrics-tls\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:59:26.822538 master-0 kubenswrapper[35367]: I1204 11:59:26.822458 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b668f740-dbc3-48e0-9ebc-83bae3a43c83-snapshots\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:59:26.822538 master-0 kubenswrapper[35367]: I1204 11:59:26.822476 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cluster-olm-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/0158c2f3-20e5-43f4-875d-c5ad8f6112df-cluster-olm-operator-serving-cert\") pod \"cluster-olm-operator-56fcb6cc5f-4xwp2\" (UID: \"0158c2f3-20e5-43f4-875d-c5ad8f6112df\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:59:26.822538 master-0 kubenswrapper[35367]: I1204 11:59:26.822479 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/1897bad8-3875-4bd6-b877-b1abe1fe76c7-ca-certs\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:59:26.822538 master-0 kubenswrapper[35367]: I1204 11:59:26.822531 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fd9f8671-8066-4990-b45d-8b619aa5d9ec-config\") pod \"kube-storage-version-migrator-operator-b9c5dfc78-dcxkw\" (UID: \"fd9f8671-8066-4990-b45d-8b619aa5d9ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:59:26.822966 master-0 kubenswrapper[35367]: I1204 11:59:26.822566 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-run\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.822966 master-0 kubenswrapper[35367]: I1204 11:59:26.822598 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-cnibin\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.822966 master-0 kubenswrapper[35367]: I1204 11:59:26.822622 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-proxy-tls\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:59:26.822966 master-0 kubenswrapper[35367]: I1204 11:59:26.822636 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2ab26ae5-0607-4dfd-840e-531d204b5030-telemetry-config\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:59:26.822966 master-0 kubenswrapper[35367]: I1204 11:59:26.822645 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gmdvf\" (UniqueName: \"kubernetes.io/projected/287fba2d-f56d-4ec0-b796-7849a68fb411-kube-api-access-gmdvf\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:59:26.822966 master-0 kubenswrapper[35367]: I1204 11:59:26.822696 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalogserver-certs\" (UniqueName: \"kubernetes.io/secret/ee9a47b1-cdd9-43bc-8115-8851f29106e6-catalogserver-certs\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:59:26.822966 master-0 kubenswrapper[35367]: I1204 11:59:26.822726 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2ncf9\" (UniqueName: \"kubernetes.io/projected/d8fca733-45c8-45b8-8653-ac204e7c6098-kube-api-access-2ncf9\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:59:26.822966 master-0 kubenswrapper[35367]: I1204 11:59:26.822730 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fd9f8671-8066-4990-b45d-8b619aa5d9ec-config\") pod \"kube-storage-version-migrator-operator-b9c5dfc78-dcxkw\" (UID: \"fd9f8671-8066-4990-b45d-8b619aa5d9ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:59:26.822966 master-0 kubenswrapper[35367]: I1204 11:59:26.822858 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f925fe60-b5b7-4a5a-9800-3546334da725-catalog-content\") pod \"redhat-marketplace-svhl4\" (UID: \"f925fe60-b5b7-4a5a-9800-3546334da725\") " pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:59:26.822966 master-0 kubenswrapper[35367]: I1204 11:59:26.822897 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l5r7w\" (UniqueName: \"kubernetes.io/projected/38fc8086-a00c-4a2a-8a0e-c57e9d9d0103-kube-api-access-l5r7w\") pod \"csi-snapshot-controller-6b958b6f94-w74zr\" (UID: \"38fc8086-a00c-4a2a-8a0e-c57e9d9d0103\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" Dec 04 11:59:26.822966 master-0 kubenswrapper[35367]: I1204 11:59:26.822921 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7203ec93-6572-4032-825c-140029a86058-env-overrides\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:59:26.822966 master-0 kubenswrapper[35367]: I1204 11:59:26.822942 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f925fe60-b5b7-4a5a-9800-3546334da725-catalog-content\") pod \"redhat-marketplace-svhl4\" (UID: \"f925fe60-b5b7-4a5a-9800-3546334da725\") " pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:59:26.822966 master-0 kubenswrapper[35367]: I1204 11:59:26.822944 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5b826c3-8638-4cf5-b974-b24e4282ce00-serving-cert\") pod \"openshift-apiserver-operator-7bf7f6b755-sh6qf\" (UID: \"a5b826c3-8638-4cf5-b974-b24e4282ce00\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.822995 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-etcd-client\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823032 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f15dcdb-c968-429c-9d1d-63c2becad337-trusted-ca\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823053 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k7bhn\" (UniqueName: \"kubernetes.io/projected/031d300e-24b4-481c-8b82-fe8cdb3fcef7-kube-api-access-k7bhn\") pod \"csi-snapshot-controller-operator-6bc8656fdc-2q7f5\" (UID: \"031d300e-24b4-481c-8b82-fe8cdb3fcef7\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-6bc8656fdc-2q7f5" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823081 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-trusted-ca-bundle\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823108 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/1897bad8-3875-4bd6-b877-b1abe1fe76c7-etc-docker\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823131 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-audit-policies\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823151 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovnkube-config\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823165 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5b826c3-8638-4cf5-b974-b24e4282ce00-serving-cert\") pod \"openshift-apiserver-operator-7bf7f6b755-sh6qf\" (UID: \"a5b826c3-8638-4cf5-b974-b24e4282ce00\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823176 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae-metrics-tls\") pod \"dns-default-xg7vh\" (UID: \"0c092f5d-bd33-4d91-9206-ce9c0b9e1aae\") " pod="openshift-dns/dns-default-xg7vh" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823207 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c-catalog-content\") pod \"certified-operators-8qs8v\" (UID: \"b620f29d-dcde-4f98-9fb6-dd479dcdcf7c\") " pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823231 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/ee9a47b1-cdd9-43bc-8115-8851f29106e6-ca-certs\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823253 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-auth-proxy-config\") pod \"cluster-autoscaler-operator-5f49d774cd-894dk\" (UID: \"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639\") " pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823276 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operand-assets\" (UniqueName: \"kubernetes.io/empty-dir/0158c2f3-20e5-43f4-875d-c5ad8f6112df-operand-assets\") pod \"cluster-olm-operator-56fcb6cc5f-4xwp2\" (UID: \"0158c2f3-20e5-43f4-875d-c5ad8f6112df\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823300 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-host-etc-kube\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823324 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b668f740-dbc3-48e0-9ebc-83bae3a43c83-serving-cert\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823345 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-system-cni-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823366 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-modprobe-d\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823390 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xttdn\" (UniqueName: \"kubernetes.io/projected/b668f740-dbc3-48e0-9ebc-83bae3a43c83-kube-api-access-xttdn\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823412 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5vv7k\" (UniqueName: \"kubernetes.io/projected/855d7874-16b1-47d0-82f6-d2b0c89b9a84-kube-api-access-5vv7k\") pod \"packageserver-675f5c767c-mtdrq\" (UID: \"855d7874-16b1-47d0-82f6-d2b0c89b9a84\") " pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823432 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6e9271a-44ea-4612-ab60-4a9d489ed062-serving-cert\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823456 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-kubernetes\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823477 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-log-socket\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.823492 master-0 kubenswrapper[35367]: I1204 11:59:26.823501 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/c835660f-5a79-4679-b9be-8543ca6ef5a1-machine-approver-tls\") pod \"machine-approver-f797d8546-qvgbq\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:59:26.824246 master-0 kubenswrapper[35367]: I1204 11:59:26.823526 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-cni-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.824246 master-0 kubenswrapper[35367]: I1204 11:59:26.823896 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f15dcdb-c968-429c-9d1d-63c2becad337-trusted-ca\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:59:26.825198 master-0 kubenswrapper[35367]: I1204 11:59:26.825114 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b011b1f1-3235-4e20-825b-ce711c052407-trusted-ca\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:59:26.825255 master-0 kubenswrapper[35367]: I1204 11:59:26.825229 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-systemd\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.825776 master-0 kubenswrapper[35367]: I1204 11:59:26.825272 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cdsq5\" (UniqueName: \"kubernetes.io/projected/c6e9271a-44ea-4612-ab60-4a9d489ed062-kube-api-access-cdsq5\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:59:26.825863 master-0 kubenswrapper[35367]: I1204 11:59:26.825791 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-profile-collector-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:59:26.825863 master-0 kubenswrapper[35367]: I1204 11:59:26.825854 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:59:26.825946 master-0 kubenswrapper[35367]: I1204 11:59:26.825890 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l22ps\" (UniqueName: \"kubernetes.io/projected/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-kube-api-access-l22ps\") pod \"community-operators-rxhpq\" (UID: \"5ae25dd5-dfdb-42f6-97d0-14ad17743c95\") " pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:59:26.825946 master-0 kubenswrapper[35367]: I1204 11:59:26.825924 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ckwnn\" (UniqueName: \"kubernetes.io/projected/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-kube-api-access-ckwnn\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:59:26.826030 master-0 kubenswrapper[35367]: I1204 11:59:26.825950 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-utilities\") pod \"community-operators-rxhpq\" (UID: \"5ae25dd5-dfdb-42f6-97d0-14ad17743c95\") " pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:59:26.826030 master-0 kubenswrapper[35367]: I1204 11:59:26.825979 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-trusted-ca\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:59:26.826030 master-0 kubenswrapper[35367]: I1204 11:59:26.826009 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rj4dt\" (UniqueName: \"kubernetes.io/projected/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-kube-api-access-rj4dt\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:59:26.826119 master-0 kubenswrapper[35367]: I1204 11:59:26.826042 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/27576028-d64a-47cd-b76b-d524e41efe37-kube-api-access\") pod \"openshift-kube-scheduler-operator-5f85974995-g4rwv\" (UID: \"27576028-d64a-47cd-b76b-d524e41efe37\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:59:26.826340 master-0 kubenswrapper[35367]: I1204 11:59:26.826305 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-var-lib-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.826386 master-0 kubenswrapper[35367]: I1204 11:59:26.826371 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-node-log\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.826452 master-0 kubenswrapper[35367]: I1204 11:59:26.826407 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2mzvm\" (UniqueName: \"kubernetes.io/projected/f925fe60-b5b7-4a5a-9800-3546334da725-kube-api-access-2mzvm\") pod \"redhat-marketplace-svhl4\" (UID: \"f925fe60-b5b7-4a5a-9800-3546334da725\") " pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:59:26.826452 master-0 kubenswrapper[35367]: I1204 11:59:26.826439 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kkjzz\" (UniqueName: \"kubernetes.io/projected/6f15dcdb-c968-429c-9d1d-63c2becad337-kube-api-access-kkjzz\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:59:26.826524 master-0 kubenswrapper[35367]: I1204 11:59:26.826467 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-sysctl-d\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.826524 master-0 kubenswrapper[35367]: I1204 11:59:26.826495 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6fssw\" (UniqueName: \"kubernetes.io/projected/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-kube-api-access-6fssw\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:59:26.826581 master-0 kubenswrapper[35367]: I1204 11:59:26.826525 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c790c174-dc60-4f34-8818-3b367fbe3a5f-cni-binary-copy\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.826716 master-0 kubenswrapper[35367]: I1204 11:59:26.826684 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-multus-certs\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.826754 master-0 kubenswrapper[35367]: I1204 11:59:26.826733 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae-config-volume\") pod \"dns-default-xg7vh\" (UID: \"0c092f5d-bd33-4d91-9206-ce9c0b9e1aae\") " pod="openshift-dns/dns-default-xg7vh" Dec 04 11:59:26.826785 master-0 kubenswrapper[35367]: I1204 11:59:26.826759 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tltk9\" (UniqueName: \"kubernetes.io/projected/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae-kube-api-access-tltk9\") pod \"dns-default-xg7vh\" (UID: \"0c092f5d-bd33-4d91-9206-ce9c0b9e1aae\") " pod="openshift-dns/dns-default-xg7vh" Dec 04 11:59:26.826837 master-0 kubenswrapper[35367]: I1204 11:59:26.826789 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-cni-binary-copy\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:59:26.826871 master-0 kubenswrapper[35367]: I1204 11:59:26.826840 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lxnbc\" (UniqueName: \"kubernetes.io/projected/16057f9c-b1f8-4915-acc3-2d4532af4963-kube-api-access-lxnbc\") pod \"migrator-74b7b57c65-d6v67\" (UID: \"16057f9c-b1f8-4915-acc3-2d4532af4963\") " pod="openshift-kube-storage-version-migrator/migrator-74b7b57c65-d6v67" Dec 04 11:59:26.826906 master-0 kubenswrapper[35367]: I1204 11:59:26.826874 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/330553d2-40ea-4496-8346-2e5bf680669b-host-slash\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:59:26.827093 master-0 kubenswrapper[35367]: I1204 11:59:26.827057 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-client\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:59:26.827199 master-0 kubenswrapper[35367]: I1204 11:59:26.827102 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:59:26.829349 master-0 kubenswrapper[35367]: I1204 11:59:26.829284 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-trusted-ca-bundle\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:59:26.829829 master-0 kubenswrapper[35367]: I1204 11:59:26.829760 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-image-registry-operator-tls\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:59:26.830600 master-0 kubenswrapper[35367]: I1204 11:59:26.830517 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"whereabouts-configmap\" (UniqueName: \"kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-whereabouts-configmap\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:59:26.831317 master-0 kubenswrapper[35367]: I1204 11:59:26.831266 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-trusted-ca\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:59:26.833078 master-0 kubenswrapper[35367]: I1204 11:59:26.833022 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"whereabouts-configmap\" (UniqueName: \"kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-whereabouts-configmap\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:59:26.836117 master-0 kubenswrapper[35367]: I1204 11:59:26.836039 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovnkube-config\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.836322 master-0 kubenswrapper[35367]: I1204 11:59:26.836173 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c-catalog-content\") pod \"certified-operators-8qs8v\" (UID: \"b620f29d-dcde-4f98-9fb6-dd479dcdcf7c\") " pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:59:26.836497 master-0 kubenswrapper[35367]: I1204 11:59:26.836459 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operand-assets\" (UniqueName: \"kubernetes.io/empty-dir/0158c2f3-20e5-43f4-875d-c5ad8f6112df-operand-assets\") pod \"cluster-olm-operator-56fcb6cc5f-4xwp2\" (UID: \"0158c2f3-20e5-43f4-875d-c5ad8f6112df\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:59:26.836798 master-0 kubenswrapper[35367]: I1204 11:59:26.836724 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b011b1f1-3235-4e20-825b-ce711c052407-trusted-ca\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:59:26.836798 master-0 kubenswrapper[35367]: I1204 11:59:26.836731 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7203ec93-6572-4032-825c-140029a86058-env-overrides\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:59:26.837089 master-0 kubenswrapper[35367]: I1204 11:59:26.836942 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6e9271a-44ea-4612-ab60-4a9d489ed062-serving-cert\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:59:26.837680 master-0 kubenswrapper[35367]: I1204 11:59:26.837619 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-utilities\") pod \"community-operators-rxhpq\" (UID: \"5ae25dd5-dfdb-42f6-97d0-14ad17743c95\") " pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:59:26.838009 master-0 kubenswrapper[35367]: I1204 11:59:26.837956 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-client\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:59:26.838074 master-0 kubenswrapper[35367]: I1204 11:59:26.838021 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:59:26.838125 master-0 kubenswrapper[35367]: I1204 11:59:26.838087 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bdfcb644-24ef-4a33-93ae-a855e872d29a-cni-binary-copy\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:59:26.839397 master-0 kubenswrapper[35367]: I1204 11:59:26.839342 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-profile-collector-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:59:26.839523 master-0 kubenswrapper[35367]: I1204 11:59:26.839465 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c790c174-dc60-4f34-8818-3b367fbe3a5f-cni-binary-copy\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.839584 master-0 kubenswrapper[35367]: I1204 11:59:26.839529 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nfspg\" (UniqueName: \"kubernetes.io/projected/14bd3485-aa02-4984-b4a3-59f360b1b327-kube-api-access-nfspg\") pod \"control-plane-machine-set-operator-7df95c79b5-7w5lm\" (UID: \"14bd3485-aa02-4984-b4a3-59f360b1b327\") " pod="openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm" Dec 04 11:59:26.839665 master-0 kubenswrapper[35367]: I1204 11:59:26.839626 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zjkck\" (UniqueName: \"kubernetes.io/projected/f797ab14-0eb5-48b4-b914-f434f67c4c49-kube-api-access-zjkck\") pod \"cluster-storage-operator-dcf7fc84b-fncfd\" (UID: \"f797ab14-0eb5-48b4-b914-f434f67c4c49\") " pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" Dec 04 11:59:26.839718 master-0 kubenswrapper[35367]: I1204 11:59:26.839675 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/00601c1a-efd4-4366-bdc9-d768afa252b0-available-featuregates\") pod \"openshift-config-operator-68758cbcdb-zh8g5\" (UID: \"00601c1a-efd4-4366-bdc9-d768afa252b0\") " pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:59:26.839770 master-0 kubenswrapper[35367]: I1204 11:59:26.839740 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:59:26.839825 master-0 kubenswrapper[35367]: I1204 11:59:26.839788 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-trusted-ca\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:59:26.839873 master-0 kubenswrapper[35367]: I1204 11:59:26.839841 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-59pbp\" (UniqueName: \"kubernetes.io/projected/330553d2-40ea-4496-8346-2e5bf680669b-kube-api-access-59pbp\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:59:26.839930 master-0 kubenswrapper[35367]: I1204 11:59:26.839881 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/00601c1a-efd4-4366-bdc9-d768afa252b0-available-featuregates\") pod \"openshift-config-operator-68758cbcdb-zh8g5\" (UID: \"00601c1a-efd4-4366-bdc9-d768afa252b0\") " pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:59:26.839971 master-0 kubenswrapper[35367]: I1204 11:59:26.839945 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-audit-dir\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:59:26.840030 master-0 kubenswrapper[35367]: I1204 11:59:26.839988 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-conf-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.840080 master-0 kubenswrapper[35367]: I1204 11:59:26.840034 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dkqp2\" (UniqueName: \"kubernetes.io/projected/1897bad8-3875-4bd6-b877-b1abe1fe76c7-kube-api-access-dkqp2\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:59:26.840080 master-0 kubenswrapper[35367]: I1204 11:59:26.840066 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7-hosts-file\") pod \"node-resolver-qq64m\" (UID: \"7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7\") " pod="openshift-dns/node-resolver-qq64m" Dec 04 11:59:26.840142 master-0 kubenswrapper[35367]: I1204 11:59:26.840080 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fca733-45c8-45b8-8653-ac204e7c6098-metrics-certs\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:59:26.840142 master-0 kubenswrapper[35367]: I1204 11:59:26.840123 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3322cc5a-f1f7-4522-b423-19fb7f38cd43-serving-cert\") pod \"openshift-controller-manager-operator-6c8676f99d-7z948\" (UID: \"3322cc5a-f1f7-4522-b423-19fb7f38cd43\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:59:26.840202 master-0 kubenswrapper[35367]: I1204 11:59:26.840158 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bac00ac5-0371-48fd-b1cc-60438f08ae94-serving-cert\") pod \"kube-controller-manager-operator-848f645654-7hmhg\" (UID: \"bac00ac5-0371-48fd-b1cc-60438f08ae94\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:59:26.840297 master-0 kubenswrapper[35367]: I1204 11:59:26.840255 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-trusted-ca\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:59:26.840363 master-0 kubenswrapper[35367]: I1204 11:59:26.840332 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vgdmn\" (UniqueName: \"kubernetes.io/projected/64d30b80-2336-49c2-a2c2-1e0694036a84-kube-api-access-vgdmn\") pod \"cloud-credential-operator-698c598cfc-95jdn\" (UID: \"64d30b80-2336-49c2-a2c2-1e0694036a84\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" Dec 04 11:59:26.840404 master-0 kubenswrapper[35367]: I1204 11:59:26.840365 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ccf81538-4d5a-4c26-8e54-fe39331a625d-serving-cert\") pod \"kube-apiserver-operator-765d9ff747-gr68k\" (UID: \"ccf81538-4d5a-4c26-8e54-fe39331a625d\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:59:26.840404 master-0 kubenswrapper[35367]: I1204 11:59:26.840392 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:59:26.840488 master-0 kubenswrapper[35367]: I1204 11:59:26.840457 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e3160a9-11d1-4845-ba30-1a49ae7339a9-cert\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:59:26.840531 master-0 kubenswrapper[35367]: I1204 11:59:26.840511 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e3160a9-11d1-4845-ba30-1a49ae7339a9-config\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:59:26.840567 master-0 kubenswrapper[35367]: I1204 11:59:26.840542 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0fad065c-94c9-4a38-ab76-cf0266bdc04b-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 11:59:26.840567 master-0 kubenswrapper[35367]: I1204 11:59:26.840543 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bac00ac5-0371-48fd-b1cc-60438f08ae94-serving-cert\") pod \"kube-controller-manager-operator-848f645654-7hmhg\" (UID: \"bac00ac5-0371-48fd-b1cc-60438f08ae94\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:59:26.840628 master-0 kubenswrapper[35367]: I1204 11:59:26.840564 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/7203ec93-6572-4032-825c-140029a86058-ovnkube-identity-cm\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:59:26.840628 master-0 kubenswrapper[35367]: I1204 11:59:26.840468 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3322cc5a-f1f7-4522-b423-19fb7f38cd43-serving-cert\") pod \"openshift-controller-manager-operator-6c8676f99d-7z948\" (UID: \"3322cc5a-f1f7-4522-b423-19fb7f38cd43\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:59:26.840628 master-0 kubenswrapper[35367]: I1204 11:59:26.840587 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bac00ac5-0371-48fd-b1cc-60438f08ae94-config\") pod \"kube-controller-manager-operator-848f645654-7hmhg\" (UID: \"bac00ac5-0371-48fd-b1cc-60438f08ae94\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:59:26.840628 master-0 kubenswrapper[35367]: I1204 11:59:26.840609 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-service-ca\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:59:26.840744 master-0 kubenswrapper[35367]: I1204 11:59:26.840633 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-config\") pod \"service-ca-operator-77758bc754-8smqn\" (UID: \"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8\") " pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:59:26.840744 master-0 kubenswrapper[35367]: I1204 11:59:26.840655 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t6bkg\" (UniqueName: \"kubernetes.io/projected/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-kube-api-access-t6bkg\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:59:26.840744 master-0 kubenswrapper[35367]: I1204 11:59:26.840680 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-cnibin\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:59:26.840744 master-0 kubenswrapper[35367]: I1204 11:59:26.840688 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-marketplace-operator-metrics\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:59:26.840744 master-0 kubenswrapper[35367]: I1204 11:59:26.840698 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:59:26.840744 master-0 kubenswrapper[35367]: I1204 11:59:26.840717 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-systemd-units\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.840744 master-0 kubenswrapper[35367]: I1204 11:59:26.840726 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ccf81538-4d5a-4c26-8e54-fe39331a625d-serving-cert\") pod \"kube-apiserver-operator-765d9ff747-gr68k\" (UID: \"ccf81538-4d5a-4c26-8e54-fe39331a625d\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:59:26.840992 master-0 kubenswrapper[35367]: I1204 11:59:26.840738 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-auth-proxy-config\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:59:26.840992 master-0 kubenswrapper[35367]: I1204 11:59:26.840829 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1243d581-fa11-4db1-a01a-0cf64eb3ef74-signing-cabundle\") pod \"service-ca-77c99c46b8-6cntk\" (UID: \"1243d581-fa11-4db1-a01a-0cf64eb3ef74\") " pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" Dec 04 11:59:26.840992 master-0 kubenswrapper[35367]: I1204 11:59:26.840872 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f4w2j\" (UniqueName: \"kubernetes.io/projected/bdfcb644-24ef-4a33-93ae-a855e872d29a-kube-api-access-f4w2j\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:59:26.840992 master-0 kubenswrapper[35367]: I1204 11:59:26.840894 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/7203ec93-6572-4032-825c-140029a86058-ovnkube-identity-cm\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:59:26.840992 master-0 kubenswrapper[35367]: I1204 11:59:26.840955 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gkcj4\" (UniqueName: \"kubernetes.io/projected/7203ec93-6572-4032-825c-140029a86058-kube-api-access-gkcj4\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:59:26.841192 master-0 kubenswrapper[35367]: I1204 11:59:26.841097 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-lib-modules\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.841192 master-0 kubenswrapper[35367]: I1204 11:59:26.841148 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bac00ac5-0371-48fd-b1cc-60438f08ae94-config\") pod \"kube-controller-manager-operator-848f645654-7hmhg\" (UID: \"bac00ac5-0371-48fd-b1cc-60438f08ae94\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:59:26.841192 master-0 kubenswrapper[35367]: I1204 11:59:26.841152 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-config\") pod \"service-ca-operator-77758bc754-8smqn\" (UID: \"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8\") " pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:59:26.841302 master-0 kubenswrapper[35367]: I1204 11:59:26.841214 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-service-ca\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:59:26.841302 master-0 kubenswrapper[35367]: I1204 11:59:26.841224 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-env-overrides\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.841302 master-0 kubenswrapper[35367]: I1204 11:59:26.841263 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5b826c3-8638-4cf5-b974-b24e4282ce00-config\") pod \"openshift-apiserver-operator-7bf7f6b755-sh6qf\" (UID: \"a5b826c3-8638-4cf5-b974-b24e4282ce00\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:59:26.841409 master-0 kubenswrapper[35367]: I1204 11:59:26.841344 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/018e9ad3-c071-45c6-bfa6-e53dda20c757-utilities\") pod \"redhat-operators-wksdw\" (UID: \"018e9ad3-c071-45c6-bfa6-e53dda20c757\") " pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:59:26.841446 master-0 kubenswrapper[35367]: I1204 11:59:26.841410 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tbt5w\" (UniqueName: \"kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w\") pod \"network-check-target-w2lss\" (UID: \"a3558de2-46f8-48b5-a961-95decb7805cf\") " pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:59:26.841446 master-0 kubenswrapper[35367]: I1204 11:59:26.841439 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-images\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:59:26.841541 master-0 kubenswrapper[35367]: I1204 11:59:26.841465 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/157eab0c-0d8d-486b-a349-c2e466e18e0c-env-overrides\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.841541 master-0 kubenswrapper[35367]: I1204 11:59:26.841525 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5b826c3-8638-4cf5-b974-b24e4282ce00-config\") pod \"openshift-apiserver-operator-7bf7f6b755-sh6qf\" (UID: \"a5b826c3-8638-4cf5-b974-b24e4282ce00\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:59:26.841648 master-0 kubenswrapper[35367]: I1204 11:59:26.841619 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/018e9ad3-c071-45c6-bfa6-e53dda20c757-utilities\") pod \"redhat-operators-wksdw\" (UID: \"018e9ad3-c071-45c6-bfa6-e53dda20c757\") " pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:59:26.841694 master-0 kubenswrapper[35367]: I1204 11:59:26.841626 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k449s\" (UniqueName: \"kubernetes.io/projected/3322cc5a-f1f7-4522-b423-19fb7f38cd43-kube-api-access-k449s\") pod \"openshift-controller-manager-operator-6c8676f99d-7z948\" (UID: \"3322cc5a-f1f7-4522-b423-19fb7f38cd43\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:59:26.841749 master-0 kubenswrapper[35367]: I1204 11:59:26.841705 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cco-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64d30b80-2336-49c2-a2c2-1e0694036a84-cco-trusted-ca\") pod \"cloud-credential-operator-698c598cfc-95jdn\" (UID: \"64d30b80-2336-49c2-a2c2-1e0694036a84\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" Dec 04 11:59:26.841749 master-0 kubenswrapper[35367]: I1204 11:59:26.841733 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nxbts\" (UniqueName: \"kubernetes.io/projected/c835660f-5a79-4679-b9be-8543ca6ef5a1-kube-api-access-nxbts\") pod \"machine-approver-f797d8546-qvgbq\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:59:26.841908 master-0 kubenswrapper[35367]: I1204 11:59:26.841756 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3322cc5a-f1f7-4522-b423-19fb7f38cd43-config\") pod \"openshift-controller-manager-operator-6c8676f99d-7z948\" (UID: \"3322cc5a-f1f7-4522-b423-19fb7f38cd43\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:59:26.841908 master-0 kubenswrapper[35367]: I1204 11:59:26.841777 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-trusted-ca-bundle\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:59:26.841908 master-0 kubenswrapper[35367]: I1204 11:59:26.841828 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8cffn\" (UniqueName: \"kubernetes.io/projected/08550069-c1a1-475e-84a2-e56905f1ed38-kube-api-access-8cffn\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:59:26.841908 master-0 kubenswrapper[35367]: I1204 11:59:26.841856 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-systemd\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.841908 master-0 kubenswrapper[35367]: I1204 11:59:26.841887 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b668f740-dbc3-48e0-9ebc-83bae3a43c83-trusted-ca-bundle\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:59:26.842126 master-0 kubenswrapper[35367]: I1204 11:59:26.841929 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-daemon-config\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.842126 master-0 kubenswrapper[35367]: I1204 11:59:26.841980 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2g7bh\" (UniqueName: \"kubernetes.io/projected/00601c1a-efd4-4366-bdc9-d768afa252b0-kube-api-access-2g7bh\") pod \"openshift-config-operator-68758cbcdb-zh8g5\" (UID: \"00601c1a-efd4-4366-bdc9-d768afa252b0\") " pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:59:26.842126 master-0 kubenswrapper[35367]: I1204 11:59:26.842011 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/ee9a47b1-cdd9-43bc-8115-8851f29106e6-cache\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:59:26.842126 master-0 kubenswrapper[35367]: I1204 11:59:26.841983 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3322cc5a-f1f7-4522-b423-19fb7f38cd43-config\") pod \"openshift-controller-manager-operator-6c8676f99d-7z948\" (UID: \"3322cc5a-f1f7-4522-b423-19fb7f38cd43\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:59:26.842126 master-0 kubenswrapper[35367]: I1204 11:59:26.842101 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/ee9a47b1-cdd9-43bc-8115-8851f29106e6-cache\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:59:26.842334 master-0 kubenswrapper[35367]: I1204 11:59:26.842164 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-etcd-serving-ca\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:59:26.842334 master-0 kubenswrapper[35367]: I1204 11:59:26.842209 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-sysctl-conf\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.842334 master-0 kubenswrapper[35367]: I1204 11:59:26.842245 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mvzrc\" (UniqueName: \"kubernetes.io/projected/2ab26ae5-0607-4dfd-840e-531d204b5030-kube-api-access-mvzrc\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:59:26.842334 master-0 kubenswrapper[35367]: I1204 11:59:26.842273 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c91e6234-52c5-41c0-a1ff-6a92932b83cd-tmp\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.842477 master-0 kubenswrapper[35367]: I1204 11:59:26.842355 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-service-ca-bundle\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:59:26.842477 master-0 kubenswrapper[35367]: I1204 11:59:26.842355 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-daemon-config\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.842649 master-0 kubenswrapper[35367]: I1204 11:59:26.842612 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c91e6234-52c5-41c0-a1ff-6a92932b83cd-tmp\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.842649 master-0 kubenswrapper[35367]: I1204 11:59:26.842627 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/855d7874-16b1-47d0-82f6-d2b0c89b9a84-webhook-cert\") pod \"packageserver-675f5c767c-mtdrq\" (UID: \"855d7874-16b1-47d0-82f6-d2b0c89b9a84\") " pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:59:26.842718 master-0 kubenswrapper[35367]: I1204 11:59:26.842673 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a399a87b-8153-4045-a8d3-63fd88ae280f-serving-cert\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:59:26.842862 master-0 kubenswrapper[35367]: I1204 11:59:26.842842 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-sys\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.842912 master-0 kubenswrapper[35367]: I1204 11:59:26.842875 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fd9f8671-8066-4990-b45d-8b619aa5d9ec-serving-cert\") pod \"kube-storage-version-migrator-operator-b9c5dfc78-dcxkw\" (UID: \"fd9f8671-8066-4990-b45d-8b619aa5d9ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:59:26.842912 master-0 kubenswrapper[35367]: I1204 11:59:26.842898 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a399a87b-8153-4045-a8d3-63fd88ae280f-kube-api-access\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:59:26.842976 master-0 kubenswrapper[35367]: I1204 11:59:26.842918 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-cloud-controller-manager-operator-tls\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:59:26.842976 master-0 kubenswrapper[35367]: I1204 11:59:26.842941 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-cert\") pod \"cluster-autoscaler-operator-5f49d774cd-894dk\" (UID: \"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639\") " pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" Dec 04 11:59:26.843087 master-0 kubenswrapper[35367]: I1204 11:59:26.843048 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-storage-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/f797ab14-0eb5-48b4-b914-f434f67c4c49-cluster-storage-operator-serving-cert\") pod \"cluster-storage-operator-dcf7fc84b-fncfd\" (UID: \"f797ab14-0eb5-48b4-b914-f434f67c4c49\") " pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" Dec 04 11:59:26.843138 master-0 kubenswrapper[35367]: I1204 11:59:26.843111 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-client-ca\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:59:26.843169 master-0 kubenswrapper[35367]: I1204 11:59:26.843149 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-cni-netd\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.843202 master-0 kubenswrapper[35367]: I1204 11:59:26.843167 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.843238 master-0 kubenswrapper[35367]: I1204 11:59:26.843159 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-service-ca-bundle\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:59:26.843238 master-0 kubenswrapper[35367]: I1204 11:59:26.843221 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fd9f8671-8066-4990-b45d-8b619aa5d9ec-serving-cert\") pod \"kube-storage-version-migrator-operator-b9c5dfc78-dcxkw\" (UID: \"fd9f8671-8066-4990-b45d-8b619aa5d9ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:59:26.843372 master-0 kubenswrapper[35367]: I1204 11:59:26.843196 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b668f740-dbc3-48e0-9ebc-83bae3a43c83-service-ca-bundle\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:59:26.843372 master-0 kubenswrapper[35367]: I1204 11:59:26.843301 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccf1cb9e-8885-4224-92d5-d1b116bc0090-samples-operator-tls\") pod \"cluster-samples-operator-797cfd8b47-8wqgp\" (UID: \"ccf1cb9e-8885-4224-92d5-d1b116bc0090\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-797cfd8b47-8wqgp" Dec 04 11:59:26.843372 master-0 kubenswrapper[35367]: I1204 11:59:26.843331 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccf81538-4d5a-4c26-8e54-fe39331a625d-config\") pod \"kube-apiserver-operator-765d9ff747-gr68k\" (UID: \"ccf81538-4d5a-4c26-8e54-fe39331a625d\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:59:26.843372 master-0 kubenswrapper[35367]: I1204 11:59:26.843355 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:59:26.843485 master-0 kubenswrapper[35367]: I1204 11:59:26.843385 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ggzfm\" (UniqueName: \"kubernetes.io/projected/434ed9b9-715b-455b-867c-775b256df40f-kube-api-access-ggzfm\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:59:26.843485 master-0 kubenswrapper[35367]: I1204 11:59:26.843468 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/a399a87b-8153-4045-a8d3-63fd88ae280f-etc-ssl-certs\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:59:26.843568 master-0 kubenswrapper[35367]: I1204 11:59:26.843545 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccf81538-4d5a-4c26-8e54-fe39331a625d-config\") pod \"kube-apiserver-operator-765d9ff747-gr68k\" (UID: \"ccf81538-4d5a-4c26-8e54-fe39331a625d\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:59:26.843632 master-0 kubenswrapper[35367]: I1204 11:59:26.843568 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rc244\" (UniqueName: \"kubernetes.io/projected/c91e6234-52c5-41c0-a1ff-6a92932b83cd-kube-api-access-rc244\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.843632 master-0 kubenswrapper[35367]: I1204 11:59:26.843598 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-config\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:59:26.843709 master-0 kubenswrapper[35367]: I1204 11:59:26.843650 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/1897bad8-3875-4bd6-b877-b1abe1fe76c7-cache\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:59:26.843709 master-0 kubenswrapper[35367]: I1204 11:59:26.843662 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-apiservice-cert\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:59:26.843709 master-0 kubenswrapper[35367]: I1204 11:59:26.843670 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mmm9t\" (UniqueName: \"kubernetes.io/projected/7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7-kube-api-access-mmm9t\") pod \"node-resolver-qq64m\" (UID: \"7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7\") " pod="openshift-dns/node-resolver-qq64m" Dec 04 11:59:26.843709 master-0 kubenswrapper[35367]: I1204 11:59:26.843706 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-host-etc-kube\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:59:26.843857 master-0 kubenswrapper[35367]: I1204 11:59:26.843738 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/1897bad8-3875-4bd6-b877-b1abe1fe76c7-cache\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:59:26.843857 master-0 kubenswrapper[35367]: I1204 11:59:26.843742 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-catalog-content\") pod \"community-operators-rxhpq\" (UID: \"5ae25dd5-dfdb-42f6-97d0-14ad17743c95\") " pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:59:26.843857 master-0 kubenswrapper[35367]: I1204 11:59:26.843799 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:59:26.843857 master-0 kubenswrapper[35367]: I1204 11:59:26.843839 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-catalog-content\") pod \"community-operators-rxhpq\" (UID: \"5ae25dd5-dfdb-42f6-97d0-14ad17743c95\") " pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:59:26.844058 master-0 kubenswrapper[35367]: I1204 11:59:26.843864 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-llscb\" (UniqueName: \"kubernetes.io/projected/fd9f8671-8066-4990-b45d-8b619aa5d9ec-kube-api-access-llscb\") pod \"kube-storage-version-migrator-operator-b9c5dfc78-dcxkw\" (UID: \"fd9f8671-8066-4990-b45d-8b619aa5d9ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:59:26.844058 master-0 kubenswrapper[35367]: I1204 11:59:26.843898 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:59:26.844058 master-0 kubenswrapper[35367]: I1204 11:59:26.843899 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42b3be0f-1d82-4a64-abb4-0118a6960efd-config\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:59:26.844058 master-0 kubenswrapper[35367]: I1204 11:59:26.843917 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-system-cni-dir\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:59:26.844058 master-0 kubenswrapper[35367]: I1204 11:59:26.844020 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-bound-sa-token\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:59:26.844058 master-0 kubenswrapper[35367]: I1204 11:59:26.844058 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ab26ae5-0607-4dfd-840e-531d204b5030-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:59:26.844298 master-0 kubenswrapper[35367]: I1204 11:59:26.844198 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-etc-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.844298 master-0 kubenswrapper[35367]: I1204 11:59:26.844258 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/434ed9b9-715b-455b-867c-775b256df40f-srv-cert\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:59:26.844358 master-0 kubenswrapper[35367]: I1204 11:59:26.844326 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovn-node-metrics-cert\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.844388 master-0 kubenswrapper[35367]: I1204 11:59:26.844365 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-k8s-cni-cncf-io\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.844433 master-0 kubenswrapper[35367]: I1204 11:59:26.844397 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/018e9ad3-c071-45c6-bfa6-e53dda20c757-catalog-content\") pod \"redhat-operators-wksdw\" (UID: \"018e9ad3-c071-45c6-bfa6-e53dda20c757\") " pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:59:26.844492 master-0 kubenswrapper[35367]: I1204 11:59:26.844433 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-proxy-ca-bundles\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:59:26.844559 master-0 kubenswrapper[35367]: I1204 11:59:26.844534 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/018e9ad3-c071-45c6-bfa6-e53dda20c757-catalog-content\") pod \"redhat-operators-wksdw\" (UID: \"018e9ad3-c071-45c6-bfa6-e53dda20c757\") " pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:59:26.844602 master-0 kubenswrapper[35367]: I1204 11:59:26.844588 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a399a87b-8153-4045-a8d3-63fd88ae280f-service-ca\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:59:26.844641 master-0 kubenswrapper[35367]: I1204 11:59:26.844622 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/7ec61be5-32f9-4aac-815f-41d173213107-audit-dir\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:26.844692 master-0 kubenswrapper[35367]: I1204 11:59:26.844666 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/157eab0c-0d8d-486b-a349-c2e466e18e0c-ovn-node-metrics-cert\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.844751 master-0 kubenswrapper[35367]: I1204 11:59:26.844711 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:59:26.844791 master-0 kubenswrapper[35367]: I1204 11:59:26.844754 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/855d7874-16b1-47d0-82f6-d2b0c89b9a84-tmpfs\") pod \"packageserver-675f5c767c-mtdrq\" (UID: \"855d7874-16b1-47d0-82f6-d2b0c89b9a84\") " pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:59:26.844791 master-0 kubenswrapper[35367]: I1204 11:59:26.844783 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/a399a87b-8153-4045-a8d3-63fd88ae280f-etc-cvo-updatepayloads\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:59:26.844885 master-0 kubenswrapper[35367]: I1204 11:59:26.844845 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/855d7874-16b1-47d0-82f6-d2b0c89b9a84-tmpfs\") pod \"packageserver-675f5c767c-mtdrq\" (UID: \"855d7874-16b1-47d0-82f6-d2b0c89b9a84\") " pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:59:26.844885 master-0 kubenswrapper[35367]: I1204 11:59:26.844851 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/c835660f-5a79-4679-b9be-8543ca6ef5a1-auth-proxy-config\") pod \"machine-approver-f797d8546-qvgbq\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:59:26.844967 master-0 kubenswrapper[35367]: I1204 11:59:26.844898 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/7e3160a9-11d1-4845-ba30-1a49ae7339a9-images\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:59:26.844967 master-0 kubenswrapper[35367]: I1204 11:59:26.844923 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-encryption-config\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:59:26.844967 master-0 kubenswrapper[35367]: I1204 11:59:26.844949 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/bac00ac5-0371-48fd-b1cc-60438f08ae94-kube-api-access\") pod \"kube-controller-manager-operator-848f645654-7hmhg\" (UID: \"bac00ac5-0371-48fd-b1cc-60438f08ae94\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:59:26.845082 master-0 kubenswrapper[35367]: I1204 11:59:26.844979 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b011b1f1-3235-4e20-825b-ce711c052407-metrics-tls\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:59:26.845142 master-0 kubenswrapper[35367]: I1204 11:59:26.845083 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-tuned\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.845142 master-0 kubenswrapper[35367]: I1204 11:59:26.845117 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-serving-cert\") pod \"service-ca-operator-77758bc754-8smqn\" (UID: \"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8\") " pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:59:26.845216 master-0 kubenswrapper[35367]: I1204 11:59:26.845151 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/0fad065c-94c9-4a38-ab76-cf0266bdc04b-var-lock\") pod \"installer-3-master-0\" (UID: \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 11:59:26.845216 master-0 kubenswrapper[35367]: I1204 11:59:26.845172 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-tuned\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.845216 master-0 kubenswrapper[35367]: I1204 11:59:26.845181 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-os-release\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:59:26.845216 master-0 kubenswrapper[35367]: I1204 11:59:26.845212 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-var-lib-kubelet\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.845372 master-0 kubenswrapper[35367]: I1204 11:59:26.845248 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:59:26.845372 master-0 kubenswrapper[35367]: I1204 11:59:26.845280 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2pqsl\" (UniqueName: \"kubernetes.io/projected/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-kube-api-access-2pqsl\") pod \"cluster-autoscaler-operator-5f49d774cd-894dk\" (UID: \"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639\") " pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" Dec 04 11:59:26.845372 master-0 kubenswrapper[35367]: I1204 11:59:26.845332 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-serving-cert\") pod \"service-ca-operator-77758bc754-8smqn\" (UID: \"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8\") " pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:59:26.845483 master-0 kubenswrapper[35367]: I1204 11:59:26.845456 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-image-import-ca\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:26.845578 master-0 kubenswrapper[35367]: I1204 11:59:26.845487 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-hostroot\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.845578 master-0 kubenswrapper[35367]: I1204 11:59:26.845545 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6lxhl\" (UniqueName: \"kubernetes.io/projected/c790c174-dc60-4f34-8818-3b367fbe3a5f-kube-api-access-6lxhl\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.845578 master-0 kubenswrapper[35367]: I1204 11:59:26.845570 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/c50317d3-f7cd-4133-845e-44add57ac378-machine-api-operator-tls\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:59:26.845697 master-0 kubenswrapper[35367]: I1204 11:59:26.845592 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-baremetal-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e3160a9-11d1-4845-ba30-1a49ae7339a9-cluster-baremetal-operator-tls\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:59:26.845697 master-0 kubenswrapper[35367]: I1204 11:59:26.845620 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-config\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:59:26.845697 master-0 kubenswrapper[35367]: I1204 11:59:26.845646 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-config\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:59:26.845697 master-0 kubenswrapper[35367]: I1204 11:59:26.845669 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/287fba2d-f56d-4ec0-b796-7849a68fb411-env-overrides\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:59:26.845697 master-0 kubenswrapper[35367]: I1204 11:59:26.845692 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9q8d8\" (UniqueName: \"kubernetes.io/projected/1243d581-fa11-4db1-a01a-0cf64eb3ef74-kube-api-access-9q8d8\") pod \"service-ca-77c99c46b8-6cntk\" (UID: \"1243d581-fa11-4db1-a01a-0cf64eb3ef74\") " pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" Dec 04 11:59:26.845916 master-0 kubenswrapper[35367]: I1204 11:59:26.845715 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-netns\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.845916 master-0 kubenswrapper[35367]: I1204 11:59:26.845762 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-srv-cert\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:59:26.845916 master-0 kubenswrapper[35367]: I1204 11:59:26.845788 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nhvdc\" (UniqueName: \"kubernetes.io/projected/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-kube-api-access-nhvdc\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:59:26.845916 master-0 kubenswrapper[35367]: I1204 11:59:26.845827 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c-utilities\") pod \"certified-operators-8qs8v\" (UID: \"b620f29d-dcde-4f98-9fb6-dd479dcdcf7c\") " pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:59:26.845916 master-0 kubenswrapper[35367]: I1204 11:59:26.845848 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ec61be5-32f9-4aac-815f-41d173213107-serving-cert\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:26.845916 master-0 kubenswrapper[35367]: I1204 11:59:26.845871 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/14bd3485-aa02-4984-b4a3-59f360b1b327-control-plane-machine-set-operator-tls\") pod \"control-plane-machine-set-operator-7df95c79b5-7w5lm\" (UID: \"14bd3485-aa02-4984-b4a3-59f360b1b327\") " pod="openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm" Dec 04 11:59:26.845916 master-0 kubenswrapper[35367]: I1204 11:59:26.845892 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-audit\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:26.845916 master-0 kubenswrapper[35367]: I1204 11:59:26.845916 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00601c1a-efd4-4366-bdc9-d768afa252b0-serving-cert\") pod \"openshift-config-operator-68758cbcdb-zh8g5\" (UID: \"00601c1a-efd4-4366-bdc9-d768afa252b0\") " pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:59:26.846209 master-0 kubenswrapper[35367]: I1204 11:59:26.845936 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:59:26.846209 master-0 kubenswrapper[35367]: I1204 11:59:26.846099 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/287fba2d-f56d-4ec0-b796-7849a68fb411-env-overrides\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:59:26.846439 master-0 kubenswrapper[35367]: I1204 11:59:26.846401 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-config\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:59:26.846754 master-0 kubenswrapper[35367]: I1204 11:59:26.846714 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d77m8\" (UniqueName: \"kubernetes.io/projected/e4d7939a-5961-4608-b910-73e71aa55bf6-kube-api-access-d77m8\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:59:26.846838 master-0 kubenswrapper[35367]: I1204 11:59:26.846763 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-run-netns\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.846838 master-0 kubenswrapper[35367]: I1204 11:59:26.846798 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c835660f-5a79-4679-b9be-8543ca6ef5a1-config\") pod \"machine-approver-f797d8546-qvgbq\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:59:26.846902 master-0 kubenswrapper[35367]: I1204 11:59:26.846863 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/287fba2d-f56d-4ec0-b796-7849a68fb411-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:59:26.846902 master-0 kubenswrapper[35367]: I1204 11:59:26.846851 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c-utilities\") pod \"certified-operators-8qs8v\" (UID: \"b620f29d-dcde-4f98-9fb6-dd479dcdcf7c\") " pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:59:26.846963 master-0 kubenswrapper[35367]: I1204 11:59:26.846890 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27576028-d64a-47cd-b76b-d524e41efe37-config\") pod \"openshift-kube-scheduler-operator-5f85974995-g4rwv\" (UID: \"27576028-d64a-47cd-b76b-d524e41efe37\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:59:26.846992 master-0 kubenswrapper[35367]: I1204 11:59:26.846973 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-ca\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:59:26.847055 master-0 kubenswrapper[35367]: I1204 11:59:26.847022 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-cni-bin\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.847088 master-0 kubenswrapper[35367]: I1204 11:59:26.847061 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27576028-d64a-47cd-b76b-d524e41efe37-config\") pod \"openshift-kube-scheduler-operator-5f85974995-g4rwv\" (UID: \"27576028-d64a-47cd-b76b-d524e41efe37\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:59:26.847088 master-0 kubenswrapper[35367]: I1204 11:59:26.847066 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-etc-kubernetes\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.847156 master-0 kubenswrapper[35367]: I1204 11:59:26.847108 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b011b1f1-3235-4e20-825b-ce711c052407-bound-sa-token\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:59:26.847566 master-0 kubenswrapper[35367]: I1204 11:59:26.847528 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:59:26.847640 master-0 kubenswrapper[35367]: I1204 11:59:26.847615 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1243d581-fa11-4db1-a01a-0cf64eb3ef74-signing-key\") pod \"service-ca-77c99c46b8-6cntk\" (UID: \"1243d581-fa11-4db1-a01a-0cf64eb3ef74\") " pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" Dec 04 11:59:26.847675 master-0 kubenswrapper[35367]: I1204 11:59:26.847645 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/855d7874-16b1-47d0-82f6-d2b0c89b9a84-apiservice-cert\") pod \"packageserver-675f5c767c-mtdrq\" (UID: \"855d7874-16b1-47d0-82f6-d2b0c89b9a84\") " pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:59:26.847712 master-0 kubenswrapper[35367]: I1204 11:59:26.847672 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-socket-dir-parent\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.847712 master-0 kubenswrapper[35367]: I1204 11:59:26.847693 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-cni-multus\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.847771 master-0 kubenswrapper[35367]: I1204 11:59:26.847715 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/ee9a47b1-cdd9-43bc-8115-8851f29106e6-etc-containers\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:59:26.847828 master-0 kubenswrapper[35367]: I1204 11:59:26.847785 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c7xwd\" (UniqueName: \"kubernetes.io/projected/42b3be0f-1d82-4a64-abb4-0118a6960efd-kube-api-access-c7xwd\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:59:26.847911 master-0 kubenswrapper[35367]: I1204 11:59:26.847835 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-run-ovn-kubernetes\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.847911 master-0 kubenswrapper[35367]: I1204 11:59:26.847873 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p2mhg\" (UniqueName: \"kubernetes.io/projected/157eab0c-0d8d-486b-a349-c2e466e18e0c-kube-api-access-p2mhg\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.847911 master-0 kubenswrapper[35367]: I1204 11:59:26.847905 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/c50317d3-f7cd-4133-845e-44add57ac378-images\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:59:26.848060 master-0 kubenswrapper[35367]: I1204 11:59:26.847930 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-host\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.848060 master-0 kubenswrapper[35367]: I1204 11:59:26.847955 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zr454\" (UniqueName: \"kubernetes.io/projected/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-kube-api-access-zr454\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:59:26.848060 master-0 kubenswrapper[35367]: I1204 11:59:26.847975 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/ccf81538-4d5a-4c26-8e54-fe39331a625d-kube-api-access\") pod \"kube-apiserver-operator-765d9ff747-gr68k\" (UID: \"ccf81538-4d5a-4c26-8e54-fe39331a625d\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:59:26.848514 master-0 kubenswrapper[35367]: I1204 11:59:26.848148 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jq49f\" (UniqueName: \"kubernetes.io/projected/b011b1f1-3235-4e20-825b-ce711c052407-kube-api-access-jq49f\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:59:26.848514 master-0 kubenswrapper[35367]: I1204 11:59:26.848400 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00601c1a-efd4-4366-bdc9-d768afa252b0-serving-cert\") pod \"openshift-config-operator-68758cbcdb-zh8g5\" (UID: \"00601c1a-efd4-4366-bdc9-d768afa252b0\") " pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:59:26.848514 master-0 kubenswrapper[35367]: I1204 11:59:26.848444 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/c6e9271a-44ea-4612-ab60-4a9d489ed062-etcd-ca\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:59:26.848659 master-0 kubenswrapper[35367]: I1204 11:59:26.848532 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bsvvf\" (UniqueName: \"kubernetes.io/projected/018e9ad3-c071-45c6-bfa6-e53dda20c757-kube-api-access-bsvvf\") pod \"redhat-operators-wksdw\" (UID: \"018e9ad3-c071-45c6-bfa6-e53dda20c757\") " pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:59:26.848711 master-0 kubenswrapper[35367]: I1204 11:59:26.848659 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:59:26.848711 master-0 kubenswrapper[35367]: I1204 11:59:26.848686 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1243d581-fa11-4db1-a01a-0cf64eb3ef74-signing-key\") pod \"service-ca-77c99c46b8-6cntk\" (UID: \"1243d581-fa11-4db1-a01a-0cf64eb3ef74\") " pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" Dec 04 11:59:26.848833 master-0 kubenswrapper[35367]: I1204 11:59:26.848781 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-slash\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.848883 master-0 kubenswrapper[35367]: I1204 11:59:26.848863 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-etcd-serving-ca\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:26.848974 master-0 kubenswrapper[35367]: I1204 11:59:26.848916 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tlr76\" (UniqueName: \"kubernetes.io/projected/7c017c69-b24e-4a7a-b888-133bed34c174-kube-api-access-tlr76\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:59:26.848974 master-0 kubenswrapper[35367]: I1204 11:59:26.848954 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-serving-cert\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:59:26.849058 master-0 kubenswrapper[35367]: I1204 11:59:26.849040 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-tuning-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f15dcdb-c968-429c-9d1d-63c2becad337-node-tuning-operator-tls\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:59:26.849110 master-0 kubenswrapper[35367]: I1204 11:59:26.849083 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/287fba2d-f56d-4ec0-b796-7849a68fb411-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:59:26.849159 master-0 kubenswrapper[35367]: I1204 11:59:26.849093 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p2bpn\" (UniqueName: \"kubernetes.io/projected/7ec61be5-32f9-4aac-815f-41d173213107-kube-api-access-p2bpn\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:26.849206 master-0 kubenswrapper[35367]: I1204 11:59:26.849157 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-sysconfig\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.849206 master-0 kubenswrapper[35367]: I1204 11:59:26.849190 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-kubelet\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.849278 master-0 kubenswrapper[35367]: I1204 11:59:26.849210 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-ovn\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.849278 master-0 kubenswrapper[35367]: I1204 11:59:26.849243 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/330553d2-40ea-4496-8346-2e5bf680669b-iptables-alerter-script\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:59:26.849278 master-0 kubenswrapper[35367]: I1204 11:59:26.849267 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:59:26.849408 master-0 kubenswrapper[35367]: I1204 11:59:26.849303 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w2qnk\" (UniqueName: \"kubernetes.io/projected/24506aa4-ab78-49df-bb58-59093498f13d-kube-api-access-w2qnk\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:59:26.849620 master-0 kubenswrapper[35367]: I1204 11:59:26.849581 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-package-server-manager-serving-cert\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:59:26.849719 master-0 kubenswrapper[35367]: I1204 11:59:26.849694 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/330553d2-40ea-4496-8346-2e5bf680669b-iptables-alerter-script\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:59:26.850972 master-0 kubenswrapper[35367]: I1204 11:59:26.850937 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v6z8r\" (UniqueName: \"kubernetes.io/projected/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c-kube-api-access-v6z8r\") pod \"certified-operators-8qs8v\" (UID: \"b620f29d-dcde-4f98-9fb6-dd479dcdcf7c\") " pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:59:26.851018 master-0 kubenswrapper[35367]: I1204 11:59:26.850981 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c50317d3-f7cd-4133-845e-44add57ac378-config\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:59:26.851018 master-0 kubenswrapper[35367]: I1204 11:59:26.851002 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-config\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:26.851086 master-0 kubenswrapper[35367]: I1204 11:59:26.851071 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/7ec61be5-32f9-4aac-815f-41d173213107-etcd-client\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:26.851119 master-0 kubenswrapper[35367]: I1204 11:59:26.851099 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:59:26.851150 master-0 kubenswrapper[35367]: I1204 11:59:26.851123 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.851226 master-0 kubenswrapper[35367]: I1204 11:59:26.851184 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24506aa4-ab78-49df-bb58-59093498f13d-serving-cert\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:59:26.851271 master-0 kubenswrapper[35367]: I1204 11:59:26.851235 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-os-release\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.851313 master-0 kubenswrapper[35367]: I1204 11:59:26.851273 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rnfmb\" (UniqueName: \"kubernetes.io/projected/ee9a47b1-cdd9-43bc-8115-8851f29106e6-kube-api-access-rnfmb\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:59:26.851313 master-0 kubenswrapper[35367]: I1204 11:59:26.851298 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s2jw8\" (UniqueName: \"kubernetes.io/projected/c50317d3-f7cd-4133-845e-44add57ac378-kube-api-access-s2jw8\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:59:26.851395 master-0 kubenswrapper[35367]: I1204 11:59:26.851344 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c017c69-b24e-4a7a-b888-133bed34c174-metrics-tls\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:59:26.851443 master-0 kubenswrapper[35367]: I1204 11:59:26.851348 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lg7hr\" (UniqueName: \"kubernetes.io/projected/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-kube-api-access-lg7hr\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:59:26.851499 master-0 kubenswrapper[35367]: I1204 11:59:26.851474 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/7ec61be5-32f9-4aac-815f-41d173213107-node-pullsecrets\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:26.851548 master-0 kubenswrapper[35367]: I1204 11:59:26.851519 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-config\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:59:26.851883 master-0 kubenswrapper[35367]: I1204 11:59:26.851855 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"signing-cabundle" Dec 04 11:59:26.861284 master-0 kubenswrapper[35367]: I1204 11:59:26.861224 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1243d581-fa11-4db1-a01a-0cf64eb3ef74-signing-cabundle\") pod \"service-ca-77c99c46b8-6cntk\" (UID: \"1243d581-fa11-4db1-a01a-0cf64eb3ef74\") " pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" Dec 04 11:59:26.872405 master-0 kubenswrapper[35367]: I1204 11:59:26.872310 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator"/"openshift-service-ca.crt" Dec 04 11:59:26.892796 master-0 kubenswrapper[35367]: I1204 11:59:26.892650 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"kube-root-ca.crt" Dec 04 11:59:26.912227 master-0 kubenswrapper[35367]: I1204 11:59:26.912121 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"openshift-service-ca.crt" Dec 04 11:59:26.933770 master-0 kubenswrapper[35367]: I1204 11:59:26.932637 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"openshift-service-ca.crt" Dec 04 11:59:26.952474 master-0 kubenswrapper[35367]: I1204 11:59:26.952346 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"kube-root-ca.crt" Dec 04 11:59:26.952686 master-0 kubenswrapper[35367]: I1204 11:59:26.952576 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-cni-bin\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.952686 master-0 kubenswrapper[35367]: I1204 11:59:26.952671 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-cni-bin\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.952786 master-0 kubenswrapper[35367]: I1204 11:59:26.952751 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-kubelet\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.952840 master-0 kubenswrapper[35367]: I1204 11:59:26.952795 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/1897bad8-3875-4bd6-b877-b1abe1fe76c7-etc-containers\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:59:26.952974 master-0 kubenswrapper[35367]: I1204 11:59:26.952924 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-kubelet\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.953027 master-0 kubenswrapper[35367]: I1204 11:59:26.953008 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-run\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.953064 master-0 kubenswrapper[35367]: I1204 11:59:26.953036 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-cnibin\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.953112 master-0 kubenswrapper[35367]: I1204 11:59:26.953085 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/1897bad8-3875-4bd6-b877-b1abe1fe76c7-etc-containers\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:59:26.953145 master-0 kubenswrapper[35367]: I1204 11:59:26.953099 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/1897bad8-3875-4bd6-b877-b1abe1fe76c7-etc-docker\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:59:26.953179 master-0 kubenswrapper[35367]: I1204 11:59:26.953143 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/1897bad8-3875-4bd6-b877-b1abe1fe76c7-etc-docker\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:59:26.953209 master-0 kubenswrapper[35367]: I1204 11:59:26.953194 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-run\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.953260 master-0 kubenswrapper[35367]: I1204 11:59:26.953244 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-cnibin\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.953292 master-0 kubenswrapper[35367]: I1204 11:59:26.953273 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-host-etc-kube\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:59:26.953435 master-0 kubenswrapper[35367]: I1204 11:59:26.953367 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-system-cni-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.953702 master-0 kubenswrapper[35367]: I1204 11:59:26.953447 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-modprobe-d\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.953702 master-0 kubenswrapper[35367]: I1204 11:59:26.953372 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-host-etc-kube\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:59:26.953702 master-0 kubenswrapper[35367]: I1204 11:59:26.953561 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-kubernetes\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.953702 master-0 kubenswrapper[35367]: I1204 11:59:26.953617 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-log-socket\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.953702 master-0 kubenswrapper[35367]: I1204 11:59:26.953664 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-modprobe-d\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.953702 master-0 kubenswrapper[35367]: I1204 11:59:26.953408 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-system-cni-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.954057 master-0 kubenswrapper[35367]: I1204 11:59:26.953730 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-kubernetes\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.954057 master-0 kubenswrapper[35367]: I1204 11:59:26.953745 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-log-socket\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.954057 master-0 kubenswrapper[35367]: I1204 11:59:26.953761 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-cni-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.954057 master-0 kubenswrapper[35367]: I1204 11:59:26.953784 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-systemd\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.954057 master-0 kubenswrapper[35367]: I1204 11:59:26.953839 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-systemd\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.954057 master-0 kubenswrapper[35367]: I1204 11:59:26.953871 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-cni-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.954057 master-0 kubenswrapper[35367]: I1204 11:59:26.953904 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-var-lib-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.954057 master-0 kubenswrapper[35367]: I1204 11:59:26.953927 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-node-log\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.954057 master-0 kubenswrapper[35367]: I1204 11:59:26.953978 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-sysctl-d\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.954399 master-0 kubenswrapper[35367]: I1204 11:59:26.954060 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-var-lib-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.954399 master-0 kubenswrapper[35367]: I1204 11:59:26.954135 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-multus-certs\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.954399 master-0 kubenswrapper[35367]: I1204 11:59:26.954220 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-sysctl-d\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.954399 master-0 kubenswrapper[35367]: I1204 11:59:26.954228 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-multus-certs\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.954399 master-0 kubenswrapper[35367]: I1204 11:59:26.954250 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-node-log\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.954399 master-0 kubenswrapper[35367]: I1204 11:59:26.954284 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/330553d2-40ea-4496-8346-2e5bf680669b-host-slash\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:59:26.954399 master-0 kubenswrapper[35367]: I1204 11:59:26.954329 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/330553d2-40ea-4496-8346-2e5bf680669b-host-slash\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:59:26.954399 master-0 kubenswrapper[35367]: I1204 11:59:26.954359 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-audit-dir\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:59:26.954399 master-0 kubenswrapper[35367]: I1204 11:59:26.954395 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-conf-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.954960 master-0 kubenswrapper[35367]: I1204 11:59:26.954435 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7-hosts-file\") pod \"node-resolver-qq64m\" (UID: \"7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7\") " pod="openshift-dns/node-resolver-qq64m" Dec 04 11:59:26.954960 master-0 kubenswrapper[35367]: I1204 11:59:26.954398 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-audit-dir\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:59:26.954960 master-0 kubenswrapper[35367]: I1204 11:59:26.954510 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7-hosts-file\") pod \"node-resolver-qq64m\" (UID: \"7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7\") " pod="openshift-dns/node-resolver-qq64m" Dec 04 11:59:26.954960 master-0 kubenswrapper[35367]: I1204 11:59:26.954507 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-conf-dir\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.954960 master-0 kubenswrapper[35367]: I1204 11:59:26.954590 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0fad065c-94c9-4a38-ab76-cf0266bdc04b-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 11:59:26.954960 master-0 kubenswrapper[35367]: I1204 11:59:26.954630 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-cnibin\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:59:26.954960 master-0 kubenswrapper[35367]: I1204 11:59:26.954659 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:59:26.954960 master-0 kubenswrapper[35367]: I1204 11:59:26.954685 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-systemd-units\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.954960 master-0 kubenswrapper[35367]: I1204 11:59:26.954689 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-cnibin\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:59:26.954960 master-0 kubenswrapper[35367]: I1204 11:59:26.954656 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0fad065c-94c9-4a38-ab76-cf0266bdc04b-kubelet-dir\") pod \"installer-3-master-0\" (UID: \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 11:59:26.954960 master-0 kubenswrapper[35367]: I1204 11:59:26.954732 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:59:26.954960 master-0 kubenswrapper[35367]: I1204 11:59:26.954744 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-systemd-units\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.954960 master-0 kubenswrapper[35367]: I1204 11:59:26.954797 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-lib-modules\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.955567 master-0 kubenswrapper[35367]: I1204 11:59:26.954987 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-systemd\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.955567 master-0 kubenswrapper[35367]: I1204 11:59:26.955016 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-lib-modules\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.955567 master-0 kubenswrapper[35367]: I1204 11:59:26.955082 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-sysctl-conf\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.955567 master-0 kubenswrapper[35367]: I1204 11:59:26.955235 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-sys\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.955567 master-0 kubenswrapper[35367]: I1204 11:59:26.955278 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-sysctl-conf\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.955567 master-0 kubenswrapper[35367]: I1204 11:59:26.955302 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-cni-netd\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.955567 master-0 kubenswrapper[35367]: I1204 11:59:26.955318 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-systemd\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.955567 master-0 kubenswrapper[35367]: I1204 11:59:26.955334 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.955567 master-0 kubenswrapper[35367]: I1204 11:59:26.955359 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-sys\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.955567 master-0 kubenswrapper[35367]: I1204 11:59:26.955388 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-cni-netd\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.955567 master-0 kubenswrapper[35367]: I1204 11:59:26.955393 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/a399a87b-8153-4045-a8d3-63fd88ae280f-etc-ssl-certs\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:59:26.955567 master-0 kubenswrapper[35367]: I1204 11:59:26.955416 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.955567 master-0 kubenswrapper[35367]: I1204 11:59:26.955449 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-host-etc-kube\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:59:26.955567 master-0 kubenswrapper[35367]: I1204 11:59:26.955485 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-system-cni-dir\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:59:26.955567 master-0 kubenswrapper[35367]: I1204 11:59:26.955530 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-host-etc-kube\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:59:26.955567 master-0 kubenswrapper[35367]: I1204 11:59:26.955557 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/a399a87b-8153-4045-a8d3-63fd88ae280f-etc-ssl-certs\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:59:26.956218 master-0 kubenswrapper[35367]: I1204 11:59:26.955632 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-system-cni-dir\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:59:26.956218 master-0 kubenswrapper[35367]: I1204 11:59:26.955851 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-etc-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.956218 master-0 kubenswrapper[35367]: I1204 11:59:26.955883 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-k8s-cni-cncf-io\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.956218 master-0 kubenswrapper[35367]: I1204 11:59:26.955910 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-etc-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.956218 master-0 kubenswrapper[35367]: I1204 11:59:26.955933 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/7ec61be5-32f9-4aac-815f-41d173213107-audit-dir\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:26.956218 master-0 kubenswrapper[35367]: I1204 11:59:26.955967 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-k8s-cni-cncf-io\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.956218 master-0 kubenswrapper[35367]: I1204 11:59:26.955999 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/a399a87b-8153-4045-a8d3-63fd88ae280f-etc-cvo-updatepayloads\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:59:26.956218 master-0 kubenswrapper[35367]: I1204 11:59:26.956079 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/0fad065c-94c9-4a38-ab76-cf0266bdc04b-var-lock\") pod \"installer-3-master-0\" (UID: \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 11:59:26.956218 master-0 kubenswrapper[35367]: I1204 11:59:26.956105 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-os-release\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:59:26.956218 master-0 kubenswrapper[35367]: I1204 11:59:26.956128 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-var-lib-kubelet\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.956218 master-0 kubenswrapper[35367]: I1204 11:59:26.956153 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/a399a87b-8153-4045-a8d3-63fd88ae280f-etc-cvo-updatepayloads\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:59:26.956218 master-0 kubenswrapper[35367]: I1204 11:59:26.956198 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-hostroot\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.956660 master-0 kubenswrapper[35367]: I1204 11:59:26.956261 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bdfcb644-24ef-4a33-93ae-a855e872d29a-os-release\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:59:26.956660 master-0 kubenswrapper[35367]: I1204 11:59:26.956280 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/7ec61be5-32f9-4aac-815f-41d173213107-audit-dir\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:26.956660 master-0 kubenswrapper[35367]: I1204 11:59:26.956294 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/0fad065c-94c9-4a38-ab76-cf0266bdc04b-var-lock\") pod \"installer-3-master-0\" (UID: \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\") " pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 11:59:26.956660 master-0 kubenswrapper[35367]: I1204 11:59:26.956365 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-var-lib-kubelet\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.956660 master-0 kubenswrapper[35367]: I1204 11:59:26.956400 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-hostroot\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.956660 master-0 kubenswrapper[35367]: I1204 11:59:26.956414 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-netns\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.956660 master-0 kubenswrapper[35367]: I1204 11:59:26.956463 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-run-netns\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.956660 master-0 kubenswrapper[35367]: I1204 11:59:26.956562 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-run-netns\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.956660 master-0 kubenswrapper[35367]: I1204 11:59:26.956628 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-cni-bin\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.957000 master-0 kubenswrapper[35367]: I1204 11:59:26.956677 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-cni-bin\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.957000 master-0 kubenswrapper[35367]: I1204 11:59:26.956708 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-run-netns\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.957000 master-0 kubenswrapper[35367]: I1204 11:59:26.956733 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-etc-kubernetes\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.957000 master-0 kubenswrapper[35367]: I1204 11:59:26.956780 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-socket-dir-parent\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.957000 master-0 kubenswrapper[35367]: I1204 11:59:26.956822 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-cni-multus\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.957000 master-0 kubenswrapper[35367]: I1204 11:59:26.956850 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/ee9a47b1-cdd9-43bc-8115-8851f29106e6-etc-containers\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:59:26.957000 master-0 kubenswrapper[35367]: I1204 11:59:26.956897 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-multus-socket-dir-parent\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.957000 master-0 kubenswrapper[35367]: I1204 11:59:26.956896 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-host-var-lib-cni-multus\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.957000 master-0 kubenswrapper[35367]: I1204 11:59:26.956927 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-containers\" (UniqueName: \"kubernetes.io/host-path/ee9a47b1-cdd9-43bc-8115-8851f29106e6-etc-containers\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:59:26.957000 master-0 kubenswrapper[35367]: I1204 11:59:26.956939 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-etc-kubernetes\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.957000 master-0 kubenswrapper[35367]: I1204 11:59:26.956960 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-run-ovn-kubernetes\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.957000 master-0 kubenswrapper[35367]: I1204 11:59:26.956987 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-run-ovn-kubernetes\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.957000 master-0 kubenswrapper[35367]: I1204 11:59:26.957009 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-host\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.957471 master-0 kubenswrapper[35367]: I1204 11:59:26.957085 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-slash\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.957471 master-0 kubenswrapper[35367]: I1204 11:59:26.957115 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-host\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.957471 master-0 kubenswrapper[35367]: I1204 11:59:26.957142 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-sysconfig\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.957471 master-0 kubenswrapper[35367]: I1204 11:59:26.957175 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-slash\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.957471 master-0 kubenswrapper[35367]: I1204 11:59:26.957199 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c91e6234-52c5-41c0-a1ff-6a92932b83cd-etc-sysconfig\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:26.957471 master-0 kubenswrapper[35367]: I1204 11:59:26.957210 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-kubelet\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.957471 master-0 kubenswrapper[35367]: I1204 11:59:26.957243 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-ovn\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.957471 master-0 kubenswrapper[35367]: I1204 11:59:26.957305 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-host-kubelet\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.957471 master-0 kubenswrapper[35367]: I1204 11:59:26.957335 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.957471 master-0 kubenswrapper[35367]: I1204 11:59:26.957357 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-os-release\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.957471 master-0 kubenswrapper[35367]: I1204 11:59:26.957371 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-ovn\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.957471 master-0 kubenswrapper[35367]: I1204 11:59:26.957419 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/7ec61be5-32f9-4aac-815f-41d173213107-node-pullsecrets\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:26.957471 master-0 kubenswrapper[35367]: I1204 11:59:26.957437 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/157eab0c-0d8d-486b-a349-c2e466e18e0c-run-openvswitch\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:26.957471 master-0 kubenswrapper[35367]: I1204 11:59:26.957422 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c790c174-dc60-4f34-8818-3b367fbe3a5f-os-release\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:26.958030 master-0 kubenswrapper[35367]: I1204 11:59:26.957524 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/7ec61be5-32f9-4aac-815f-41d173213107-node-pullsecrets\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:26.958030 master-0 kubenswrapper[35367]: I1204 11:59:26.957539 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/ee9a47b1-cdd9-43bc-8115-8851f29106e6-etc-docker\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:59:26.958030 master-0 kubenswrapper[35367]: I1204 11:59:26.957581 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-docker\" (UniqueName: \"kubernetes.io/host-path/ee9a47b1-cdd9-43bc-8115-8851f29106e6-etc-docker\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:59:26.978514 master-0 kubenswrapper[35367]: I1204 11:59:26.978432 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"operator-controller-trusted-ca-bundle" Dec 04 11:59:26.983589 master-0 kubenswrapper[35367]: I1204 11:59:26.983539 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/1897bad8-3875-4bd6-b877-b1abe1fe76c7-ca-certs\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:59:26.997891 master-0 kubenswrapper[35367]: I1204 11:59:26.997834 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"catalogd-trusted-ca-bundle" Dec 04 11:59:27.011817 master-0 kubenswrapper[35367]: I1204 11:59:27.011724 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"kube-root-ca.crt" Dec 04 11:59:27.031713 master-0 kubenswrapper[35367]: I1204 11:59:27.031637 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"etcd-client" Dec 04 11:59:27.034159 master-0 kubenswrapper[35367]: I1204 11:59:27.034104 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-etcd-client\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:59:27.052265 master-0 kubenswrapper[35367]: I1204 11:59:27.052189 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-catalogd"/"catalogserver-cert" Dec 04 11:59:27.053827 master-0 kubenswrapper[35367]: I1204 11:59:27.053736 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalogserver-certs\" (UniqueName: \"kubernetes.io/secret/ee9a47b1-cdd9-43bc-8115-8851f29106e6-catalogserver-certs\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:59:27.071902 master-0 kubenswrapper[35367]: I1204 11:59:27.071661 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"openshift-service-ca.crt" Dec 04 11:59:27.078259 master-0 kubenswrapper[35367]: I1204 11:59:27.078180 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ca-certs\" (UniqueName: \"kubernetes.io/projected/ee9a47b1-cdd9-43bc-8115-8851f29106e6-ca-certs\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:59:27.091949 master-0 kubenswrapper[35367]: I1204 11:59:27.091874 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"encryption-config-1" Dec 04 11:59:27.092483 master-0 kubenswrapper[35367]: I1204 11:59:27.092367 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-fvf4r" Dec 04 11:59:27.095423 master-0 kubenswrapper[35367]: I1204 11:59:27.095372 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-encryption-config\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:59:27.111736 master-0 kubenswrapper[35367]: I1204 11:59:27.111674 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"trusted-ca-bundle" Dec 04 11:59:27.112198 master-0 kubenswrapper[35367]: I1204 11:59:27.112134 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-trusted-ca-bundle\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:59:27.132016 master-0 kubenswrapper[35367]: I1204 11:59:27.131938 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"kube-root-ca.crt" Dec 04 11:59:27.155325 master-0 kubenswrapper[35367]: I1204 11:59:27.155274 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"etcd-serving-ca" Dec 04 11:59:27.163174 master-0 kubenswrapper[35367]: I1204 11:59:27.163136 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-etcd-serving-ca\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:59:27.172315 master-0 kubenswrapper[35367]: I1204 11:59:27.172263 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"etcd-client" Dec 04 11:59:27.182039 master-0 kubenswrapper[35367]: I1204 11:59:27.181989 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/7ec61be5-32f9-4aac-815f-41d173213107-etcd-client\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:27.191323 master-0 kubenswrapper[35367]: I1204 11:59:27.191292 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"serving-cert" Dec 04 11:59:27.198603 master-0 kubenswrapper[35367]: I1204 11:59:27.198170 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ec61be5-32f9-4aac-815f-41d173213107-serving-cert\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:27.211904 master-0 kubenswrapper[35367]: I1204 11:59:27.211778 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"audit-1" Dec 04 11:59:27.219792 master-0 kubenswrapper[35367]: I1204 11:59:27.219751 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-audit-policies\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:59:27.232479 master-0 kubenswrapper[35367]: I1204 11:59:27.232424 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"kube-root-ca.crt" Dec 04 11:59:27.252596 master-0 kubenswrapper[35367]: I1204 11:59:27.252532 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"encryption-config-1" Dec 04 11:59:27.255665 master-0 kubenswrapper[35367]: I1204 11:59:27.255592 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/7ec61be5-32f9-4aac-815f-41d173213107-encryption-config\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:27.271444 master-0 kubenswrapper[35367]: I1204 11:59:27.271373 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"openshift-service-ca.crt" Dec 04 11:59:27.299472 master-0 kubenswrapper[35367]: I1204 11:59:27.299412 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"trusted-ca-bundle" Dec 04 11:59:27.303570 master-0 kubenswrapper[35367]: I1204 11:59:27.303520 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-trusted-ca-bundle\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:27.314108 master-0 kubenswrapper[35367]: I1204 11:59:27.314059 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"audit-1" Dec 04 11:59:27.318491 master-0 kubenswrapper[35367]: I1204 11:59:27.318437 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-audit\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:27.331634 master-0 kubenswrapper[35367]: I1204 11:59:27.331571 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"config" Dec 04 11:59:27.332983 master-0 kubenswrapper[35367]: I1204 11:59:27.332938 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-config\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:27.352235 master-0 kubenswrapper[35367]: I1204 11:59:27.352141 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"openshift-service-ca.crt" Dec 04 11:59:27.372423 master-0 kubenswrapper[35367]: I1204 11:59:27.372380 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"etcd-serving-ca" Dec 04 11:59:27.379349 master-0 kubenswrapper[35367]: I1204 11:59:27.379288 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-etcd-serving-ca\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:27.394037 master-0 kubenswrapper[35367]: I1204 11:59:27.393978 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"image-import-ca" Dec 04 11:59:27.396226 master-0 kubenswrapper[35367]: I1204 11:59:27.396172 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/7ec61be5-32f9-4aac-815f-41d173213107-image-import-ca\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:27.397524 master-0 kubenswrapper[35367]: I1204 11:59:27.397480 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 11:59:27.412191 master-0 kubenswrapper[35367]: I1204 11:59:27.412107 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"serving-cert" Dec 04 11:59:27.419579 master-0 kubenswrapper[35367]: I1204 11:59:27.419515 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-serving-cert\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:59:27.432443 master-0 kubenswrapper[35367]: I1204 11:59:27.432368 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"openshift-service-ca.crt" Dec 04 11:59:27.435665 master-0 kubenswrapper[35367]: I1204 11:59:27.435613 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a399a87b-8153-4045-a8d3-63fd88ae280f-service-ca\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:59:27.452296 master-0 kubenswrapper[35367]: I1204 11:59:27.452201 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"kube-root-ca.crt" Dec 04 11:59:27.467384 master-0 kubenswrapper[35367]: I1204 11:59:27.467198 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0fad065c-94c9-4a38-ab76-cf0266bdc04b-kubelet-dir\") pod \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\" (UID: \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\") " Dec 04 11:59:27.467384 master-0 kubenswrapper[35367]: I1204 11:59:27.467335 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/0fad065c-94c9-4a38-ab76-cf0266bdc04b-var-lock\") pod \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\" (UID: \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\") " Dec 04 11:59:27.467384 master-0 kubenswrapper[35367]: I1204 11:59:27.467341 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/0fad065c-94c9-4a38-ab76-cf0266bdc04b-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "0fad065c-94c9-4a38-ab76-cf0266bdc04b" (UID: "0fad065c-94c9-4a38-ab76-cf0266bdc04b"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:59:27.467697 master-0 kubenswrapper[35367]: I1204 11:59:27.467559 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/0fad065c-94c9-4a38-ab76-cf0266bdc04b-var-lock" (OuterVolumeSpecName: "var-lock") pod "0fad065c-94c9-4a38-ab76-cf0266bdc04b" (UID: "0fad065c-94c9-4a38-ab76-cf0266bdc04b"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:59:27.468609 master-0 kubenswrapper[35367]: I1204 11:59:27.468566 35367 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0fad065c-94c9-4a38-ab76-cf0266bdc04b-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:59:27.468609 master-0 kubenswrapper[35367]: I1204 11:59:27.468593 35367 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/0fad065c-94c9-4a38-ab76-cf0266bdc04b-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 11:59:27.472276 master-0 kubenswrapper[35367]: I1204 11:59:27.472240 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-version"/"cluster-version-operator-serving-cert" Dec 04 11:59:27.474225 master-0 kubenswrapper[35367]: I1204 11:59:27.474074 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a399a87b-8153-4045-a8d3-63fd88ae280f-serving-cert\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:59:27.492215 master-0 kubenswrapper[35367]: I1204 11:59:27.492145 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"openshift-service-ca.crt" Dec 04 11:59:27.511827 master-0 kubenswrapper[35367]: I1204 11:59:27.511760 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns"/"dns-default-metrics-tls" Dec 04 11:59:27.514513 master-0 kubenswrapper[35367]: I1204 11:59:27.514474 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae-metrics-tls\") pod \"dns-default-xg7vh\" (UID: \"0c092f5d-bd33-4d91-9206-ce9c0b9e1aae\") " pod="openshift-dns/dns-default-xg7vh" Dec 04 11:59:27.532513 master-0 kubenswrapper[35367]: I1204 11:59:27.532435 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"dns-default" Dec 04 11:59:27.538586 master-0 kubenswrapper[35367]: I1204 11:59:27.538541 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae-config-volume\") pod \"dns-default-xg7vh\" (UID: \"0c092f5d-bd33-4d91-9206-ce9c0b9e1aae\") " pod="openshift-dns/dns-default-xg7vh" Dec 04 11:59:27.552739 master-0 kubenswrapper[35367]: I1204 11:59:27.552666 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"kube-root-ca.crt" Dec 04 11:59:27.573052 master-0 kubenswrapper[35367]: I1204 11:59:27.572982 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"control-plane-machine-set-operator-tls" Dec 04 11:59:27.578291 master-0 kubenswrapper[35367]: I1204 11:59:27.578225 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/14bd3485-aa02-4984-b4a3-59f360b1b327-control-plane-machine-set-operator-tls\") pod \"control-plane-machine-set-operator-7df95c79b5-7w5lm\" (UID: \"14bd3485-aa02-4984-b4a3-59f360b1b327\") " pod="openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm" Dec 04 11:59:27.591977 master-0 kubenswrapper[35367]: I1204 11:59:27.591878 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-root-ca.crt" Dec 04 11:59:27.613025 master-0 kubenswrapper[35367]: I1204 11:59:27.612966 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"openshift-service-ca.crt" Dec 04 11:59:27.632487 master-0 kubenswrapper[35367]: I1204 11:59:27.632426 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-machine-approver"/"machine-approver-tls" Dec 04 11:59:27.637826 master-0 kubenswrapper[35367]: I1204 11:59:27.637763 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/c835660f-5a79-4679-b9be-8543ca6ef5a1-machine-approver-tls\") pod \"machine-approver-f797d8546-qvgbq\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:59:27.652107 master-0 kubenswrapper[35367]: I1204 11:59:27.652039 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-storage-operator"/"cluster-storage-operator-serving-cert" Dec 04 11:59:27.653421 master-0 kubenswrapper[35367]: I1204 11:59:27.653376 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cluster-storage-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/f797ab14-0eb5-48b4-b914-f434f67c4c49-cluster-storage-operator-serving-cert\") pod \"cluster-storage-operator-dcf7fc84b-fncfd\" (UID: \"f797ab14-0eb5-48b4-b914-f434f67c4c49\") " pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" Dec 04 11:59:27.674100 master-0 kubenswrapper[35367]: I1204 11:59:27.672725 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-rbac-proxy" Dec 04 11:59:27.676141 master-0 kubenswrapper[35367]: I1204 11:59:27.676043 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/c835660f-5a79-4679-b9be-8543ca6ef5a1-auth-proxy-config\") pod \"machine-approver-f797d8546-qvgbq\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:59:27.692329 master-0 kubenswrapper[35367]: I1204 11:59:27.692268 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-credential-operator"/"cloud-credential-operator-serving-cert" Dec 04 11:59:27.702600 master-0 kubenswrapper[35367]: I1204 11:59:27.702540 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cloud-credential-operator-serving-cert\" (UniqueName: \"kubernetes.io/secret/64d30b80-2336-49c2-a2c2-1e0694036a84-cloud-credential-operator-serving-cert\") pod \"cloud-credential-operator-698c598cfc-95jdn\" (UID: \"64d30b80-2336-49c2-a2c2-1e0694036a84\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" Dec 04 11:59:27.711454 master-0 kubenswrapper[35367]: I1204 11:59:27.711410 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"machine-approver-config" Dec 04 11:59:27.717938 master-0 kubenswrapper[35367]: I1204 11:59:27.717855 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c835660f-5a79-4679-b9be-8543ca6ef5a1-config\") pod \"machine-approver-f797d8546-qvgbq\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:59:27.732565 master-0 kubenswrapper[35367]: I1204 11:59:27.732515 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-root-ca.crt" Dec 04 11:59:27.752447 master-0 kubenswrapper[35367]: I1204 11:59:27.752366 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"openshift-service-ca.crt" Dec 04 11:59:27.769572 master-0 kubenswrapper[35367]: I1204 11:59:27.769512 35367 request.go:700] Waited for 1.011224196s due to client-side throttling, not priority and fairness, request: GET:https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-cluster-samples-operator/configmaps?fieldSelector=metadata.name%3Dopenshift-service-ca.crt&limit=500&resourceVersion=0 Dec 04 11:59:27.771757 master-0 kubenswrapper[35367]: I1204 11:59:27.771700 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-samples-operator"/"openshift-service-ca.crt" Dec 04 11:59:27.792868 master-0 kubenswrapper[35367]: I1204 11:59:27.792772 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-samples-operator"/"samples-operator-tls" Dec 04 11:59:27.793919 master-0 kubenswrapper[35367]: I1204 11:59:27.793738 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccf1cb9e-8885-4224-92d5-d1b116bc0090-samples-operator-tls\") pod \"cluster-samples-operator-797cfd8b47-8wqgp\" (UID: \"ccf1cb9e-8885-4224-92d5-d1b116bc0090\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-797cfd8b47-8wqgp" Dec 04 11:59:27.812393 master-0 kubenswrapper[35367]: I1204 11:59:27.812293 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"packageserver-service-cert" Dec 04 11:59:27.813252 master-0 kubenswrapper[35367]: I1204 11:59:27.813198 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/855d7874-16b1-47d0-82f6-d2b0c89b9a84-webhook-cert\") pod \"packageserver-675f5c767c-mtdrq\" (UID: \"855d7874-16b1-47d0-82f6-d2b0c89b9a84\") " pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:59:27.818634 master-0 kubenswrapper[35367]: I1204 11:59:27.818595 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/855d7874-16b1-47d0-82f6-d2b0c89b9a84-apiservice-cert\") pod \"packageserver-675f5c767c-mtdrq\" (UID: \"855d7874-16b1-47d0-82f6-d2b0c89b9a84\") " pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:59:27.821767 master-0 kubenswrapper[35367]: E1204 11:59:27.821159 35367 configmap.go:193] Couldn't get configMap openshift-machine-config-operator/machine-config-operator-images: failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.821767 master-0 kubenswrapper[35367]: E1204 11:59:27.821384 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-images podName:cdb50850-779d-4179-ba1d-65ffeb4bb2e9 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.321354179 +0000 UTC m=+11.759415427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "images" (UniqueName: "kubernetes.io/configmap/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-images") pod "machine-config-operator-dc5d7666f-p2cmn" (UID: "cdb50850-779d-4179-ba1d-65ffeb4bb2e9") : failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.821767 master-0 kubenswrapper[35367]: E1204 11:59:27.821590 35367 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/client-ca: failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.821767 master-0 kubenswrapper[35367]: E1204 11:59:27.821735 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-client-ca podName:e4d7939a-5961-4608-b910-73e71aa55bf6 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.32170485 +0000 UTC m=+11.759766108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-client-ca") pod "route-controller-manager-95cb5f987-46bsk" (UID: "e4d7939a-5961-4608-b910-73e71aa55bf6") : failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.823146 master-0 kubenswrapper[35367]: E1204 11:59:27.823086 35367 configmap.go:193] Couldn't get configMap openshift-cloud-controller-manager-operator/kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.823262 master-0 kubenswrapper[35367]: E1204 11:59:27.823238 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-auth-proxy-config podName:f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.323195888 +0000 UTC m=+11.761257146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "auth-proxy-config" (UniqueName: "kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-auth-proxy-config") pod "cluster-cloud-controller-manager-operator-74f484689c-jmfn2" (UID: "f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48") : failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.823464 master-0 kubenswrapper[35367]: E1204 11:59:27.822972 35367 secret.go:189] Couldn't get secret openshift-machine-config-operator/mco-proxy-tls: failed to sync secret cache: timed out waiting for the condition Dec 04 11:59:27.823594 master-0 kubenswrapper[35367]: E1204 11:59:27.823572 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-proxy-tls podName:cdb50850-779d-4179-ba1d-65ffeb4bb2e9 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.323553869 +0000 UTC m=+11.761615127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-proxy-tls") pod "machine-config-operator-dc5d7666f-p2cmn" (UID: "cdb50850-779d-4179-ba1d-65ffeb4bb2e9") : failed to sync secret cache: timed out waiting for the condition Dec 04 11:59:27.823653 master-0 kubenswrapper[35367]: E1204 11:59:27.823635 35367 secret.go:189] Couldn't get secret openshift-route-controller-manager/serving-cert: failed to sync secret cache: timed out waiting for the condition Dec 04 11:59:27.823724 master-0 kubenswrapper[35367]: E1204 11:59:27.823696 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4d7939a-5961-4608-b910-73e71aa55bf6-serving-cert podName:e4d7939a-5961-4608-b910-73e71aa55bf6 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.323669833 +0000 UTC m=+11.761731091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/e4d7939a-5961-4608-b910-73e71aa55bf6-serving-cert") pod "route-controller-manager-95cb5f987-46bsk" (UID: "e4d7939a-5961-4608-b910-73e71aa55bf6") : failed to sync secret cache: timed out waiting for the condition Dec 04 11:59:27.832170 master-0 kubenswrapper[35367]: I1204 11:59:27.832131 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-samples-operator"/"kube-root-ca.crt" Dec 04 11:59:27.836912 master-0 kubenswrapper[35367]: E1204 11:59:27.836800 35367 configmap.go:193] Couldn't get configMap openshift-machine-api/kube-rbac-proxy-cluster-autoscaler-operator: failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.837032 master-0 kubenswrapper[35367]: E1204 11:59:27.837020 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-auth-proxy-config podName:e7fc7c16-5bca-49e5-aff0-7a8f80c6b639 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.336982304 +0000 UTC m=+11.775043752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "auth-proxy-config" (UniqueName: "kubernetes.io/configmap/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-auth-proxy-config") pod "cluster-autoscaler-operator-5f49d774cd-894dk" (UID: "e7fc7c16-5bca-49e5-aff0-7a8f80c6b639") : failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.837487 master-0 kubenswrapper[35367]: E1204 11:59:27.837407 35367 secret.go:189] Couldn't get secret openshift-insights/openshift-insights-serving-cert: failed to sync secret cache: timed out waiting for the condition Dec 04 11:59:27.837546 master-0 kubenswrapper[35367]: E1204 11:59:27.837519 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b668f740-dbc3-48e0-9ebc-83bae3a43c83-serving-cert podName:b668f740-dbc3-48e0-9ebc-83bae3a43c83 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.337503391 +0000 UTC m=+11.775564649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/b668f740-dbc3-48e0-9ebc-83bae3a43c83-serving-cert") pod "insights-operator-55965856b6-skbmb" (UID: "b668f740-dbc3-48e0-9ebc-83bae3a43c83") : failed to sync secret cache: timed out waiting for the condition Dec 04 11:59:27.840778 master-0 kubenswrapper[35367]: E1204 11:59:27.840720 35367 secret.go:189] Couldn't get secret openshift-machine-api/cluster-baremetal-webhook-server-cert: failed to sync secret cache: timed out waiting for the condition Dec 04 11:59:27.840909 master-0 kubenswrapper[35367]: E1204 11:59:27.840883 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e3160a9-11d1-4845-ba30-1a49ae7339a9-cert podName:7e3160a9-11d1-4845-ba30-1a49ae7339a9 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.340850877 +0000 UTC m=+11.778912135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7e3160a9-11d1-4845-ba30-1a49ae7339a9-cert") pod "cluster-baremetal-operator-78f758c7b9-zgkh5" (UID: "7e3160a9-11d1-4845-ba30-1a49ae7339a9") : failed to sync secret cache: timed out waiting for the condition Dec 04 11:59:27.840993 master-0 kubenswrapper[35367]: E1204 11:59:27.840941 35367 configmap.go:193] Couldn't get configMap openshift-machine-config-operator/kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.841071 master-0 kubenswrapper[35367]: E1204 11:59:27.841048 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-auth-proxy-config podName:cdb50850-779d-4179-ba1d-65ffeb4bb2e9 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.341030552 +0000 UTC m=+11.779091810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "auth-proxy-config" (UniqueName: "kubernetes.io/configmap/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-auth-proxy-config") pod "machine-config-operator-dc5d7666f-p2cmn" (UID: "cdb50850-779d-4179-ba1d-65ffeb4bb2e9") : failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.841200 master-0 kubenswrapper[35367]: E1204 11:59:27.841177 35367 configmap.go:193] Couldn't get configMap openshift-machine-api/baremetal-kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.841320 master-0 kubenswrapper[35367]: E1204 11:59:27.841307 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e3160a9-11d1-4845-ba30-1a49ae7339a9-config podName:7e3160a9-11d1-4845-ba30-1a49ae7339a9 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.341296991 +0000 UTC m=+11.779358249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/7e3160a9-11d1-4845-ba30-1a49ae7339a9-config") pod "cluster-baremetal-operator-78f758c7b9-zgkh5" (UID: "7e3160a9-11d1-4845-ba30-1a49ae7339a9") : failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.841897 master-0 kubenswrapper[35367]: E1204 11:59:27.841878 35367 configmap.go:193] Couldn't get configMap openshift-cloud-credential-operator/cco-trusted-ca: failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.842055 master-0 kubenswrapper[35367]: E1204 11:59:27.841879 35367 configmap.go:193] Couldn't get configMap openshift-cloud-controller-manager-operator/cloud-controller-manager-images: failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.842055 master-0 kubenswrapper[35367]: E1204 11:59:27.842035 35367 configmap.go:193] Couldn't get configMap openshift-insights/trusted-ca-bundle: failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.842173 master-0 kubenswrapper[35367]: E1204 11:59:27.842011 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/64d30b80-2336-49c2-a2c2-1e0694036a84-cco-trusted-ca podName:64d30b80-2336-49c2-a2c2-1e0694036a84 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.341999863 +0000 UTC m=+11.780061311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cco-trusted-ca" (UniqueName: "kubernetes.io/configmap/64d30b80-2336-49c2-a2c2-1e0694036a84-cco-trusted-ca") pod "cloud-credential-operator-698c598cfc-95jdn" (UID: "64d30b80-2336-49c2-a2c2-1e0694036a84") : failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.842173 master-0 kubenswrapper[35367]: E1204 11:59:27.842144 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-images podName:f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.342119867 +0000 UTC m=+11.780181295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "images" (UniqueName: "kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-images") pod "cluster-cloud-controller-manager-operator-74f484689c-jmfn2" (UID: "f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48") : failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.842296 master-0 kubenswrapper[35367]: E1204 11:59:27.842176 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b668f740-dbc3-48e0-9ebc-83bae3a43c83-trusted-ca-bundle podName:b668f740-dbc3-48e0-9ebc-83bae3a43c83 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.342161788 +0000 UTC m=+11.780223276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/b668f740-dbc3-48e0-9ebc-83bae3a43c83-trusted-ca-bundle") pod "insights-operator-55965856b6-skbmb" (UID: "b668f740-dbc3-48e0-9ebc-83bae3a43c83") : failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.843430 master-0 kubenswrapper[35367]: E1204 11:59:27.843404 35367 configmap.go:193] Couldn't get configMap openshift-insights/service-ca-bundle: failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.843501 master-0 kubenswrapper[35367]: E1204 11:59:27.843456 35367 secret.go:189] Couldn't get secret openshift-machine-api/cluster-autoscaler-operator-cert: failed to sync secret cache: timed out waiting for the condition Dec 04 11:59:27.843548 master-0 kubenswrapper[35367]: E1204 11:59:27.843477 35367 secret.go:189] Couldn't get secret openshift-cloud-controller-manager-operator/cloud-controller-manager-operator-tls: failed to sync secret cache: timed out waiting for the condition Dec 04 11:59:27.843548 master-0 kubenswrapper[35367]: E1204 11:59:27.843461 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b668f740-dbc3-48e0-9ebc-83bae3a43c83-service-ca-bundle podName:b668f740-dbc3-48e0-9ebc-83bae3a43c83 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.343449449 +0000 UTC m=+11.781510877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b668f740-dbc3-48e0-9ebc-83bae3a43c83-service-ca-bundle") pod "insights-operator-55965856b6-skbmb" (UID: "b668f740-dbc3-48e0-9ebc-83bae3a43c83") : failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.843548 master-0 kubenswrapper[35367]: E1204 11:59:27.843538 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-cert podName:e7fc7c16-5bca-49e5-aff0-7a8f80c6b639 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.343524442 +0000 UTC m=+11.781585700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-cert") pod "cluster-autoscaler-operator-5f49d774cd-894dk" (UID: "e7fc7c16-5bca-49e5-aff0-7a8f80c6b639") : failed to sync secret cache: timed out waiting for the condition Dec 04 11:59:27.843672 master-0 kubenswrapper[35367]: E1204 11:59:27.843556 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-cloud-controller-manager-operator-tls podName:f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.343546933 +0000 UTC m=+11.781608191 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cloud-controller-manager-operator-tls" (UniqueName: "kubernetes.io/secret/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-cloud-controller-manager-operator-tls") pod "cluster-cloud-controller-manager-operator-74f484689c-jmfn2" (UID: "f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48") : failed to sync secret cache: timed out waiting for the condition Dec 04 11:59:27.843747 master-0 kubenswrapper[35367]: E1204 11:59:27.843727 35367 configmap.go:193] Couldn't get configMap openshift-controller-manager/client-ca: failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.843876 master-0 kubenswrapper[35367]: E1204 11:59:27.843862 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-client-ca podName:24506aa4-ab78-49df-bb58-59093498f13d nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.343849191 +0000 UTC m=+11.781910639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "client-ca" (UniqueName: "kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-client-ca") pod "controller-manager-6686654b8d-rrndk" (UID: "24506aa4-ab78-49df-bb58-59093498f13d") : failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.844669 master-0 kubenswrapper[35367]: E1204 11:59:27.844643 35367 configmap.go:193] Couldn't get configMap openshift-controller-manager/openshift-global-ca: failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.844743 master-0 kubenswrapper[35367]: E1204 11:59:27.844699 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-proxy-ca-bundles podName:24506aa4-ab78-49df-bb58-59093498f13d nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.344687858 +0000 UTC m=+11.782749116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-ca-bundles" (UniqueName: "kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-proxy-ca-bundles") pod "controller-manager-6686654b8d-rrndk" (UID: "24506aa4-ab78-49df-bb58-59093498f13d") : failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.845032 master-0 kubenswrapper[35367]: E1204 11:59:27.845016 35367 configmap.go:193] Couldn't get configMap openshift-machine-api/cluster-baremetal-operator-images: failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.845132 master-0 kubenswrapper[35367]: E1204 11:59:27.845120 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e3160a9-11d1-4845-ba30-1a49ae7339a9-images podName:7e3160a9-11d1-4845-ba30-1a49ae7339a9 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.345109982 +0000 UTC m=+11.783171240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "images" (UniqueName: "kubernetes.io/configmap/7e3160a9-11d1-4845-ba30-1a49ae7339a9-images") pod "cluster-baremetal-operator-78f758c7b9-zgkh5" (UID: "7e3160a9-11d1-4845-ba30-1a49ae7339a9") : failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.845745 master-0 kubenswrapper[35367]: E1204 11:59:27.845709 35367 secret.go:189] Couldn't get secret openshift-machine-api/machine-api-operator-tls: failed to sync secret cache: timed out waiting for the condition Dec 04 11:59:27.845868 master-0 kubenswrapper[35367]: E1204 11:59:27.845844 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c50317d3-f7cd-4133-845e-44add57ac378-machine-api-operator-tls podName:c50317d3-f7cd-4133-845e-44add57ac378 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.345790224 +0000 UTC m=+11.783851482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "machine-api-operator-tls" (UniqueName: "kubernetes.io/secret/c50317d3-f7cd-4133-845e-44add57ac378-machine-api-operator-tls") pod "machine-api-operator-88d48b57d-9fjtd" (UID: "c50317d3-f7cd-4133-845e-44add57ac378") : failed to sync secret cache: timed out waiting for the condition Dec 04 11:59:27.845942 master-0 kubenswrapper[35367]: E1204 11:59:27.845877 35367 secret.go:189] Couldn't get secret openshift-machine-api/cluster-baremetal-operator-tls: failed to sync secret cache: timed out waiting for the condition Dec 04 11:59:27.845942 master-0 kubenswrapper[35367]: E1204 11:59:27.845938 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e3160a9-11d1-4845-ba30-1a49ae7339a9-cluster-baremetal-operator-tls podName:7e3160a9-11d1-4845-ba30-1a49ae7339a9 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.345925718 +0000 UTC m=+11.783987156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-baremetal-operator-tls" (UniqueName: "kubernetes.io/secret/7e3160a9-11d1-4845-ba30-1a49ae7339a9-cluster-baremetal-operator-tls") pod "cluster-baremetal-operator-78f758c7b9-zgkh5" (UID: "7e3160a9-11d1-4845-ba30-1a49ae7339a9") : failed to sync secret cache: timed out waiting for the condition Dec 04 11:59:27.847842 master-0 kubenswrapper[35367]: E1204 11:59:27.846924 35367 configmap.go:193] Couldn't get configMap openshift-route-controller-manager/config: failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.847842 master-0 kubenswrapper[35367]: E1204 11:59:27.846996 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-config podName:e4d7939a-5961-4608-b910-73e71aa55bf6 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.346980931 +0000 UTC m=+11.785042359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-config") pod "route-controller-manager-95cb5f987-46bsk" (UID: "e4d7939a-5961-4608-b910-73e71aa55bf6") : failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.848940 master-0 kubenswrapper[35367]: E1204 11:59:27.848845 35367 configmap.go:193] Couldn't get configMap openshift-machine-api/machine-api-operator-images: failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.848940 master-0 kubenswrapper[35367]: E1204 11:59:27.848922 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c50317d3-f7cd-4133-845e-44add57ac378-images podName:c50317d3-f7cd-4133-845e-44add57ac378 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.348901922 +0000 UTC m=+11.786963180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "images" (UniqueName: "kubernetes.io/configmap/c50317d3-f7cd-4133-845e-44add57ac378-images") pod "machine-api-operator-88d48b57d-9fjtd" (UID: "c50317d3-f7cd-4133-845e-44add57ac378") : failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.851220 master-0 kubenswrapper[35367]: E1204 11:59:27.851194 35367 configmap.go:193] Couldn't get configMap openshift-machine-api/kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.851353 master-0 kubenswrapper[35367]: E1204 11:59:27.851256 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c50317d3-f7cd-4133-845e-44add57ac378-config podName:c50317d3-f7cd-4133-845e-44add57ac378 nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.351244966 +0000 UTC m=+11.789306224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/c50317d3-f7cd-4133-845e-44add57ac378-config") pod "machine-api-operator-88d48b57d-9fjtd" (UID: "c50317d3-f7cd-4133-845e-44add57ac378") : failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.851353 master-0 kubenswrapper[35367]: E1204 11:59:27.851294 35367 secret.go:189] Couldn't get secret openshift-controller-manager/serving-cert: failed to sync secret cache: timed out waiting for the condition Dec 04 11:59:27.851353 master-0 kubenswrapper[35367]: E1204 11:59:27.851326 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24506aa4-ab78-49df-bb58-59093498f13d-serving-cert podName:24506aa4-ab78-49df-bb58-59093498f13d nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.351320319 +0000 UTC m=+11.789381577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/24506aa4-ab78-49df-bb58-59093498f13d-serving-cert") pod "controller-manager-6686654b8d-rrndk" (UID: "24506aa4-ab78-49df-bb58-59093498f13d") : failed to sync secret cache: timed out waiting for the condition Dec 04 11:59:27.851656 master-0 kubenswrapper[35367]: I1204 11:59:27.851356 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"olm-operator-serviceaccount-dockercfg-8qwsb" Dec 04 11:59:27.851753 master-0 kubenswrapper[35367]: E1204 11:59:27.851726 35367 configmap.go:193] Couldn't get configMap openshift-controller-manager/config: failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.851797 master-0 kubenswrapper[35367]: E1204 11:59:27.851778 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-config podName:24506aa4-ab78-49df-bb58-59093498f13d nodeName:}" failed. No retries permitted until 2025-12-04 11:59:28.351768503 +0000 UTC m=+11.789829761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-config") pod "controller-manager-6686654b8d-rrndk" (UID: "24506aa4-ab78-49df-bb58-59093498f13d") : failed to sync configmap cache: timed out waiting for the condition Dec 04 11:59:27.871661 master-0 kubenswrapper[35367]: I1204 11:59:27.871600 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-operator-tls" Dec 04 11:59:27.891079 master-0 kubenswrapper[35367]: E1204 11:59:27.890196 35367 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd75143d9bc4a2dc15781dc51ccff632a.slice/crio-59191695c89f8cecbba881756b5ffc5e4c892fd02facf20cc198ade1bf4ec267\": RecentStats: unable to find data in memory cache]" Dec 04 11:59:27.891638 master-0 kubenswrapper[35367]: I1204 11:59:27.891578 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"openshift-service-ca.crt" Dec 04 11:59:27.911126 master-0 kubenswrapper[35367]: I1204 11:59:27.911051 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"baremetal-kube-rbac-proxy" Dec 04 11:59:27.932068 master-0 kubenswrapper[35367]: I1204 11:59:27.932003 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"cluster-baremetal-operator-images" Dec 04 11:59:27.952456 master-0 kubenswrapper[35367]: I1204 11:59:27.952360 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"redhat-operators-dockercfg-8t954" Dec 04 11:59:27.983767 master-0 kubenswrapper[35367]: I1204 11:59:27.983639 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"cco-trusted-ca" Dec 04 11:59:27.992597 master-0 kubenswrapper[35367]: I1204 11:59:27.992531 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-operator-dockercfg-l9v2g" Dec 04 11:59:28.012752 master-0 kubenswrapper[35367]: I1204 11:59:28.012692 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-operator-dockercfg-hkjv7" Dec 04 11:59:28.031708 master-0 kubenswrapper[35367]: I1204 11:59:28.031637 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"kube-root-ca.crt" Dec 04 11:59:28.051877 master-0 kubenswrapper[35367]: I1204 11:59:28.051779 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-webhook-server-cert" Dec 04 11:59:28.072442 master-0 kubenswrapper[35367]: I1204 11:59:28.072375 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"machine-config-operator-images" Dec 04 11:59:28.092503 master-0 kubenswrapper[35367]: I1204 11:59:28.092432 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"mco-proxy-tls" Dec 04 11:59:28.101476 master-0 kubenswrapper[35367]: I1204 11:59:28.101439 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-3-master-0" Dec 04 11:59:28.112420 master-0 kubenswrapper[35367]: I1204 11:59:28.112334 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"openshift-service-ca.crt" Dec 04 11:59:28.132977 master-0 kubenswrapper[35367]: I1204 11:59:28.132906 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"kube-rbac-proxy" Dec 04 11:59:28.151561 master-0 kubenswrapper[35367]: I1204 11:59:28.151497 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"kube-root-ca.crt" Dec 04 11:59:28.172986 master-0 kubenswrapper[35367]: I1204 11:59:28.172912 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-insights"/"operator-dockercfg-qxdwr" Dec 04 11:59:28.192052 master-0 kubenswrapper[35367]: I1204 11:59:28.192004 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"kube-root-ca.crt" Dec 04 11:59:28.212076 master-0 kubenswrapper[35367]: I1204 11:59:28.211958 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-insights"/"openshift-insights-serving-cert" Dec 04 11:59:28.231924 master-0 kubenswrapper[35367]: I1204 11:59:28.231858 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"service-ca-bundle" Dec 04 11:59:28.252044 master-0 kubenswrapper[35367]: I1204 11:59:28.251916 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-autoscaler-operator-dockercfg-zs454" Dec 04 11:59:28.271967 master-0 kubenswrapper[35367]: I1204 11:59:28.271907 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"openshift-service-ca.crt" Dec 04 11:59:28.292412 master-0 kubenswrapper[35367]: I1204 11:59:28.292204 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-autoscaler-operator-cert" Dec 04 11:59:28.312837 master-0 kubenswrapper[35367]: I1204 11:59:28.312754 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-rbac-proxy-cluster-autoscaler-operator" Dec 04 11:59:28.338276 master-0 kubenswrapper[35367]: I1204 11:59:28.338229 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"trusted-ca-bundle" Dec 04 11:59:28.353063 master-0 kubenswrapper[35367]: I1204 11:59:28.353009 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"community-operators-dockercfg-kww9g" Dec 04 11:59:28.372633 master-0 kubenswrapper[35367]: I1204 11:59:28.372565 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"config" Dec 04 11:59:28.390893 master-0 kubenswrapper[35367]: I1204 11:59:28.390778 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-client-ca\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:59:28.390893 master-0 kubenswrapper[35367]: I1204 11:59:28.390888 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4d7939a-5961-4608-b910-73e71aa55bf6-serving-cert\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:59:28.391160 master-0 kubenswrapper[35367]: I1204 11:59:28.390920 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-auth-proxy-config\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:59:28.391160 master-0 kubenswrapper[35367]: I1204 11:59:28.390968 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-proxy-tls\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:59:28.391160 master-0 kubenswrapper[35367]: I1204 11:59:28.391014 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-auth-proxy-config\") pod \"cluster-autoscaler-operator-5f49d774cd-894dk\" (UID: \"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639\") " pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" Dec 04 11:59:28.391160 master-0 kubenswrapper[35367]: I1204 11:59:28.391038 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b668f740-dbc3-48e0-9ebc-83bae3a43c83-serving-cert\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:59:28.391635 master-0 kubenswrapper[35367]: I1204 11:59:28.391567 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-proxy-tls\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:59:28.391635 master-0 kubenswrapper[35367]: I1204 11:59:28.391595 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e3160a9-11d1-4845-ba30-1a49ae7339a9-cert\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:59:28.391635 master-0 kubenswrapper[35367]: I1204 11:59:28.391602 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-auth-proxy-config\") pod \"cluster-autoscaler-operator-5f49d774cd-894dk\" (UID: \"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639\") " pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" Dec 04 11:59:28.391635 master-0 kubenswrapper[35367]: I1204 11:59:28.391631 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e3160a9-11d1-4845-ba30-1a49ae7339a9-config\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:59:28.391833 master-0 kubenswrapper[35367]: I1204 11:59:28.391644 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b668f740-dbc3-48e0-9ebc-83bae3a43c83-serving-cert\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:59:28.391833 master-0 kubenswrapper[35367]: I1204 11:59:28.391672 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-auth-proxy-config\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:59:28.391833 master-0 kubenswrapper[35367]: I1204 11:59:28.391733 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-images\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:59:28.391833 master-0 kubenswrapper[35367]: I1204 11:59:28.391777 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cco-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64d30b80-2336-49c2-a2c2-1e0694036a84-cco-trusted-ca\") pod \"cloud-credential-operator-698c598cfc-95jdn\" (UID: \"64d30b80-2336-49c2-a2c2-1e0694036a84\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" Dec 04 11:59:28.391973 master-0 kubenswrapper[35367]: I1204 11:59:28.391841 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b668f740-dbc3-48e0-9ebc-83bae3a43c83-trusted-ca-bundle\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:59:28.391973 master-0 kubenswrapper[35367]: I1204 11:59:28.391875 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e3160a9-11d1-4845-ba30-1a49ae7339a9-config\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:59:28.391973 master-0 kubenswrapper[35367]: I1204 11:59:28.391895 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-cloud-controller-manager-operator-tls\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:59:28.391973 master-0 kubenswrapper[35367]: I1204 11:59:28.391939 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e3160a9-11d1-4845-ba30-1a49ae7339a9-cert\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:59:28.392091 master-0 kubenswrapper[35367]: I1204 11:59:28.392052 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-cert\") pod \"cluster-autoscaler-operator-5f49d774cd-894dk\" (UID: \"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639\") " pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" Dec 04 11:59:28.392204 master-0 kubenswrapper[35367]: I1204 11:59:28.392109 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b668f740-dbc3-48e0-9ebc-83bae3a43c83-service-ca-bundle\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:59:28.392236 master-0 kubenswrapper[35367]: I1204 11:59:28.392215 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cco-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64d30b80-2336-49c2-a2c2-1e0694036a84-cco-trusted-ca\") pod \"cloud-credential-operator-698c598cfc-95jdn\" (UID: \"64d30b80-2336-49c2-a2c2-1e0694036a84\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" Dec 04 11:59:28.392264 master-0 kubenswrapper[35367]: I1204 11:59:28.392234 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b668f740-dbc3-48e0-9ebc-83bae3a43c83-trusted-ca-bundle\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:59:28.392264 master-0 kubenswrapper[35367]: I1204 11:59:28.392237 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-client-ca\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:59:28.392467 master-0 kubenswrapper[35367]: I1204 11:59:28.392438 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-proxy-ca-bundles\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:59:28.392551 master-0 kubenswrapper[35367]: I1204 11:59:28.392474 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b668f740-dbc3-48e0-9ebc-83bae3a43c83-service-ca-bundle\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:59:28.392551 master-0 kubenswrapper[35367]: I1204 11:59:28.392486 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/7e3160a9-11d1-4845-ba30-1a49ae7339a9-images\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:59:28.392646 master-0 kubenswrapper[35367]: I1204 11:59:28.392553 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/c50317d3-f7cd-4133-845e-44add57ac378-machine-api-operator-tls\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:59:28.392646 master-0 kubenswrapper[35367]: I1204 11:59:28.392587 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-baremetal-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e3160a9-11d1-4845-ba30-1a49ae7339a9-cluster-baremetal-operator-tls\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:59:28.392646 master-0 kubenswrapper[35367]: I1204 11:59:28.392619 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-config\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:59:28.392774 master-0 kubenswrapper[35367]: I1204 11:59:28.392630 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-cert\") pod \"cluster-autoscaler-operator-5f49d774cd-894dk\" (UID: \"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639\") " pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" Dec 04 11:59:28.392774 master-0 kubenswrapper[35367]: I1204 11:59:28.392715 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/c50317d3-f7cd-4133-845e-44add57ac378-images\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:59:28.392774 master-0 kubenswrapper[35367]: I1204 11:59:28.392752 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/7e3160a9-11d1-4845-ba30-1a49ae7339a9-images\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:59:28.392913 master-0 kubenswrapper[35367]: I1204 11:59:28.392890 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c50317d3-f7cd-4133-845e-44add57ac378-config\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:59:28.392959 master-0 kubenswrapper[35367]: I1204 11:59:28.392923 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cluster-baremetal-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e3160a9-11d1-4845-ba30-1a49ae7339a9-cluster-baremetal-operator-tls\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:59:28.393007 master-0 kubenswrapper[35367]: I1204 11:59:28.392982 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-config\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:59:28.393046 master-0 kubenswrapper[35367]: I1204 11:59:28.393029 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24506aa4-ab78-49df-bb58-59093498f13d-serving-cert\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:59:28.393074 master-0 kubenswrapper[35367]: I1204 11:59:28.393050 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-images\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:59:28.393106 master-0 kubenswrapper[35367]: I1204 11:59:28.393070 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-config\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:59:28.393344 master-0 kubenswrapper[35367]: I1204 11:59:28.393309 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-images\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:59:28.393425 master-0 kubenswrapper[35367]: I1204 11:59:28.393359 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-auth-proxy-config\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:59:28.393528 master-0 kubenswrapper[35367]: I1204 11:59:28.393495 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"client-ca" Dec 04 11:59:28.401794 master-0 kubenswrapper[35367]: I1204 11:59:28.401742 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-client-ca\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:59:28.412518 master-0 kubenswrapper[35367]: I1204 11:59:28.412473 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"route-controller-manager-sa-dockercfg-qzw27" Dec 04 11:59:28.431264 master-0 kubenswrapper[35367]: I1204 11:59:28.431140 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Dec 04 11:59:28.431493 master-0 kubenswrapper[35367]: I1204 11:59:28.431414 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4d7939a-5961-4608-b910-73e71aa55bf6-serving-cert\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:59:28.452026 master-0 kubenswrapper[35367]: I1204 11:59:28.451925 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"kube-root-ca.crt" Dec 04 11:59:28.472937 master-0 kubenswrapper[35367]: I1204 11:59:28.472872 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"openshift-service-ca.crt" Dec 04 11:59:28.493416 master-0 kubenswrapper[35367]: I1204 11:59:28.493347 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"client-ca" Dec 04 11:59:28.503298 master-0 kubenswrapper[35367]: I1204 11:59:28.503175 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-client-ca\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:59:28.512334 master-0 kubenswrapper[35367]: I1204 11:59:28.512293 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"serving-cert" Dec 04 11:59:28.513596 master-0 kubenswrapper[35367]: I1204 11:59:28.513566 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24506aa4-ab78-49df-bb58-59093498f13d-serving-cert\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:59:28.542098 master-0 kubenswrapper[35367]: I1204 11:59:28.542018 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-global-ca" Dec 04 11:59:28.543533 master-0 kubenswrapper[35367]: I1204 11:59:28.543498 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-proxy-ca-bundles\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:59:28.552067 master-0 kubenswrapper[35367]: I1204 11:59:28.552005 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"kube-root-ca.crt" Dec 04 11:59:28.571904 master-0 kubenswrapper[35367]: I1204 11:59:28.571796 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-service-ca.crt" Dec 04 11:59:28.591525 master-0 kubenswrapper[35367]: I1204 11:59:28.591449 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"config" Dec 04 11:59:28.594151 master-0 kubenswrapper[35367]: I1204 11:59:28.594108 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-config\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:59:28.612841 master-0 kubenswrapper[35367]: I1204 11:59:28.612752 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"machine-api-operator-images" Dec 04 11:59:28.613310 master-0 kubenswrapper[35367]: I1204 11:59:28.613268 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/c50317d3-f7cd-4133-845e-44add57ac378-images\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:59:28.642831 master-0 kubenswrapper[35367]: I1204 11:59:28.642616 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-controller-manager-operator"/"cloud-controller-manager-operator-tls" Dec 04 11:59:28.653254 master-0 kubenswrapper[35367]: I1204 11:59:28.653188 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-cloud-controller-manager-operator-tls\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:59:28.655491 master-0 kubenswrapper[35367]: I1204 11:59:28.655442 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"machine-api-operator-dockercfg-tpbt2" Dec 04 11:59:28.671561 master-0 kubenswrapper[35367]: I1204 11:59:28.671490 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"openshift-service-ca.crt" Dec 04 11:59:28.691222 master-0 kubenswrapper[35367]: I1204 11:59:28.691161 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"cloud-controller-manager-images" Dec 04 11:59:28.692405 master-0 kubenswrapper[35367]: I1204 11:59:28.692366 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-images\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:59:28.712293 master-0 kubenswrapper[35367]: I1204 11:59:28.712223 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"machine-api-operator-tls" Dec 04 11:59:28.713566 master-0 kubenswrapper[35367]: I1204 11:59:28.713503 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/c50317d3-f7cd-4133-845e-44add57ac378-machine-api-operator-tls\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:59:28.731531 master-0 kubenswrapper[35367]: I1204 11:59:28.731472 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"kube-rbac-proxy" Dec 04 11:59:28.742017 master-0 kubenswrapper[35367]: I1204 11:59:28.741959 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-auth-proxy-config\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:59:28.752576 master-0 kubenswrapper[35367]: I1204 11:59:28.752391 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"kube-root-ca.crt" Dec 04 11:59:28.770292 master-0 kubenswrapper[35367]: I1204 11:59:28.770146 35367 request.go:700] Waited for 2.00810116s due to client-side throttling, not priority and fairness, request: GET:https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-api/configmaps?fieldSelector=metadata.name%3Dkube-rbac-proxy&limit=500&resourceVersion=0 Dec 04 11:59:28.772336 master-0 kubenswrapper[35367]: I1204 11:59:28.772303 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-rbac-proxy" Dec 04 11:59:28.773662 master-0 kubenswrapper[35367]: I1204 11:59:28.773606 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c50317d3-f7cd-4133-845e-44add57ac378-config\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:59:28.792547 master-0 kubenswrapper[35367]: I1204 11:59:28.792474 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"certified-operators-dockercfg-x4zqf" Dec 04 11:59:28.811472 master-0 kubenswrapper[35367]: I1204 11:59:28.811387 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"redhat-marketplace-dockercfg-kpc5q" Dec 04 11:59:28.842372 master-0 kubenswrapper[35367]: I1204 11:59:28.842234 35367 kubelet_pods.go:1320] "Clean up containers for orphaned pod we had not seen before" podUID="d75143d9bc4a2dc15781dc51ccff632a" killPodOptions="" Dec 04 11:59:28.842566 master-0 kubenswrapper[35367]: E1204 11:59:28.842502 35367 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="2.08s" Dec 04 11:59:28.842566 master-0 kubenswrapper[35367]: I1204 11:59:28.842527 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:59:28.842566 master-0 kubenswrapper[35367]: I1204 11:59:28.842542 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:59:28.842566 master-0 kubenswrapper[35367]: I1204 11:59:28.842551 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-apiserver/bootstrap-kube-apiserver-master-0"] Dec 04 11:59:28.842566 master-0 kubenswrapper[35367]: I1204 11:59:28.842561 35367 kubelet.go:2649] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" mirrorPodUID="ab32df92-dc58-4528-8f31-434280957642" Dec 04 11:59:28.860911 master-0 kubenswrapper[35367]: I1204 11:59:28.860823 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d75143d9bc4a2dc15781dc51ccff632a" path="/var/lib/kubelet/pods/d75143d9bc4a2dc15781dc51ccff632a/volumes" Dec 04 11:59:28.861506 master-0 kubenswrapper[35367]: I1204 11:59:28.861461 35367 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" podUID="" Dec 04 11:59:28.870676 master-0 kubenswrapper[35367]: I1204 11:59:28.870613 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cxbd\" (UniqueName: \"kubernetes.io/projected/0158c2f3-20e5-43f4-875d-c5ad8f6112df-kube-api-access-8cxbd\") pod \"cluster-olm-operator-56fcb6cc5f-4xwp2\" (UID: \"0158c2f3-20e5-43f4-875d-c5ad8f6112df\") " pod="openshift-cluster-olm-operator/cluster-olm-operator-56fcb6cc5f-4xwp2" Dec 04 11:59:28.892147 master-0 kubenswrapper[35367]: E1204 11:59:28.892105 35367 projected.go:288] Couldn't get configMap openshift-kube-apiserver/kube-root-ca.crt: object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 11:59:28.892331 master-0 kubenswrapper[35367]: E1204 11:59:28.892318 35367 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-apiserver/installer-3-master-0: object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 11:59:28.892465 master-0 kubenswrapper[35367]: E1204 11:59:28.892454 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0fad065c-94c9-4a38-ab76-cf0266bdc04b-kube-api-access podName:0fad065c-94c9-4a38-ab76-cf0266bdc04b nodeName:}" failed. No retries permitted until 2025-12-04 11:59:29.392429702 +0000 UTC m=+12.830490960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/0fad065c-94c9-4a38-ab76-cf0266bdc04b-kube-api-access") pod "installer-3-master-0" (UID: "0fad065c-94c9-4a38-ab76-cf0266bdc04b") : object "openshift-kube-apiserver"/"kube-root-ca.crt" not registered Dec 04 11:59:28.901629 master-0 kubenswrapper[35367]: I1204 11:59:28.901511 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/0fad065c-94c9-4a38-ab76-cf0266bdc04b-kube-api-access\") pod \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\" (UID: \"0fad065c-94c9-4a38-ab76-cf0266bdc04b\") " Dec 04 11:59:28.905739 master-0 kubenswrapper[35367]: I1204 11:59:28.905668 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fad065c-94c9-4a38-ab76-cf0266bdc04b-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "0fad065c-94c9-4a38-ab76-cf0266bdc04b" (UID: "0fad065c-94c9-4a38-ab76-cf0266bdc04b"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 11:59:28.909518 master-0 kubenswrapper[35367]: I1204 11:59:28.909465 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t46k7\" (UniqueName: \"kubernetes.io/projected/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-kube-api-access-t46k7\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:59:28.923241 master-0 kubenswrapper[35367]: I1204 11:59:28.923183 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fksx7\" (UniqueName: \"kubernetes.io/projected/7e3160a9-11d1-4845-ba30-1a49ae7339a9-kube-api-access-fksx7\") pod \"cluster-baremetal-operator-78f758c7b9-zgkh5\" (UID: \"7e3160a9-11d1-4845-ba30-1a49ae7339a9\") " pod="openshift-machine-api/cluster-baremetal-operator-78f758c7b9-zgkh5" Dec 04 11:59:28.950625 master-0 kubenswrapper[35367]: I1204 11:59:28.950548 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w6kv\" (UniqueName: \"kubernetes.io/projected/ccf1cb9e-8885-4224-92d5-d1b116bc0090-kube-api-access-8w6kv\") pod \"cluster-samples-operator-797cfd8b47-8wqgp\" (UID: \"ccf1cb9e-8885-4224-92d5-d1b116bc0090\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-797cfd8b47-8wqgp" Dec 04 11:59:28.965660 master-0 kubenswrapper[35367]: I1204 11:59:28.965588 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6bhm\" (UniqueName: \"kubernetes.io/projected/8e5e33b0-4e2e-464c-ba5b-cbd2048004f8-kube-api-access-n6bhm\") pod \"service-ca-operator-77758bc754-8smqn\" (UID: \"8e5e33b0-4e2e-464c-ba5b-cbd2048004f8\") " pod="openshift-service-ca-operator/service-ca-operator-77758bc754-8smqn" Dec 04 11:59:28.984777 master-0 kubenswrapper[35367]: I1204 11:59:28.984705 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhmlm\" (UniqueName: \"kubernetes.io/projected/a5b826c3-8638-4cf5-b974-b24e4282ce00-kube-api-access-rhmlm\") pod \"openshift-apiserver-operator-7bf7f6b755-sh6qf\" (UID: \"a5b826c3-8638-4cf5-b974-b24e4282ce00\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-7bf7f6b755-sh6qf" Dec 04 11:59:29.004625 master-0 kubenswrapper[35367]: I1204 11:59:29.004558 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmdvf\" (UniqueName: \"kubernetes.io/projected/287fba2d-f56d-4ec0-b796-7849a68fb411-kube-api-access-gmdvf\") pod \"ovnkube-control-plane-5df5548d54-jjfhq\" (UID: \"287fba2d-f56d-4ec0-b796-7849a68fb411\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-5df5548d54-jjfhq" Dec 04 11:59:29.005542 master-0 kubenswrapper[35367]: I1204 11:59:29.005467 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/0fad065c-94c9-4a38-ab76-cf0266bdc04b-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 11:59:29.024391 master-0 kubenswrapper[35367]: I1204 11:59:29.024114 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ncf9\" (UniqueName: \"kubernetes.io/projected/d8fca733-45c8-45b8-8653-ac204e7c6098-kube-api-access-2ncf9\") pod \"network-metrics-daemon-gp57t\" (UID: \"d8fca733-45c8-45b8-8653-ac204e7c6098\") " pod="openshift-multus/network-metrics-daemon-gp57t" Dec 04 11:59:29.043308 master-0 kubenswrapper[35367]: I1204 11:59:29.043257 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7bhn\" (UniqueName: \"kubernetes.io/projected/031d300e-24b4-481c-8b82-fe8cdb3fcef7-kube-api-access-k7bhn\") pod \"csi-snapshot-controller-operator-6bc8656fdc-2q7f5\" (UID: \"031d300e-24b4-481c-8b82-fe8cdb3fcef7\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-operator-6bc8656fdc-2q7f5" Dec 04 11:59:29.063088 master-0 kubenswrapper[35367]: I1204 11:59:29.063035 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l22ps\" (UniqueName: \"kubernetes.io/projected/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-kube-api-access-l22ps\") pod \"community-operators-rxhpq\" (UID: \"5ae25dd5-dfdb-42f6-97d0-14ad17743c95\") " pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:59:29.084513 master-0 kubenswrapper[35367]: I1204 11:59:29.084451 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckwnn\" (UniqueName: \"kubernetes.io/projected/72faf6d6-e8ca-43d1-b93e-67c11f8d3b46-kube-api-access-ckwnn\") pod \"package-server-manager-67477646d4-7hndf\" (UID: \"72faf6d6-e8ca-43d1-b93e-67c11f8d3b46\") " pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:59:29.105024 master-0 kubenswrapper[35367]: I1204 11:59:29.104960 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vv7k\" (UniqueName: \"kubernetes.io/projected/855d7874-16b1-47d0-82f6-d2b0c89b9a84-kube-api-access-5vv7k\") pod \"packageserver-675f5c767c-mtdrq\" (UID: \"855d7874-16b1-47d0-82f6-d2b0c89b9a84\") " pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:59:29.113019 master-0 kubenswrapper[35367]: I1204 11:59:29.112965 35367 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Dec 04 11:59:29.115667 master-0 kubenswrapper[35367]: I1204 11:59:29.115629 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Dec 04 11:59:29.115667 master-0 kubenswrapper[35367]: I1204 11:59:29.115667 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Dec 04 11:59:29.115826 master-0 kubenswrapper[35367]: I1204 11:59:29.115680 35367 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Dec 04 11:59:29.116045 master-0 kubenswrapper[35367]: I1204 11:59:29.116011 35367 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Dec 04 11:59:29.124608 master-0 kubenswrapper[35367]: I1204 11:59:29.124554 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xttdn\" (UniqueName: \"kubernetes.io/projected/b668f740-dbc3-48e0-9ebc-83bae3a43c83-kube-api-access-xttdn\") pod \"insights-operator-55965856b6-skbmb\" (UID: \"b668f740-dbc3-48e0-9ebc-83bae3a43c83\") " pod="openshift-insights/insights-operator-55965856b6-skbmb" Dec 04 11:59:29.163834 master-0 kubenswrapper[35367]: I1204 11:59:29.163761 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdsq5\" (UniqueName: \"kubernetes.io/projected/c6e9271a-44ea-4612-ab60-4a9d489ed062-kube-api-access-cdsq5\") pod \"etcd-operator-5bf4d88c6f-2bpmr\" (UID: \"c6e9271a-44ea-4612-ab60-4a9d489ed062\") " pod="openshift-etcd-operator/etcd-operator-5bf4d88c6f-2bpmr" Dec 04 11:59:29.186465 master-0 kubenswrapper[35367]: I1204 11:59:29.186139 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/27576028-d64a-47cd-b76b-d524e41efe37-kube-api-access\") pod \"openshift-kube-scheduler-operator-5f85974995-g4rwv\" (UID: \"27576028-d64a-47cd-b76b-d524e41efe37\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5f85974995-g4rwv" Dec 04 11:59:29.206844 master-0 kubenswrapper[35367]: I1204 11:59:29.206741 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5r7w\" (UniqueName: \"kubernetes.io/projected/38fc8086-a00c-4a2a-8a0e-c57e9d9d0103-kube-api-access-l5r7w\") pod \"csi-snapshot-controller-6b958b6f94-w74zr\" (UID: \"38fc8086-a00c-4a2a-8a0e-c57e9d9d0103\") " pod="openshift-cluster-storage-operator/csi-snapshot-controller-6b958b6f94-w74zr" Dec 04 11:59:29.224708 master-0 kubenswrapper[35367]: I1204 11:59:29.224633 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxnbc\" (UniqueName: \"kubernetes.io/projected/16057f9c-b1f8-4915-acc3-2d4532af4963-kube-api-access-lxnbc\") pod \"migrator-74b7b57c65-d6v67\" (UID: \"16057f9c-b1f8-4915-acc3-2d4532af4963\") " pod="openshift-kube-storage-version-migrator/migrator-74b7b57c65-d6v67" Dec 04 11:59:29.246504 master-0 kubenswrapper[35367]: I1204 11:59:29.246457 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj4dt\" (UniqueName: \"kubernetes.io/projected/fd4c4c6f-380a-4cda-9a21-352b55ec2d98-kube-api-access-rj4dt\") pod \"marketplace-operator-f797b99b6-hjjrk\" (UID: \"fd4c4c6f-380a-4cda-9a21-352b55ec2d98\") " pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:59:29.262715 master-0 kubenswrapper[35367]: I1204 11:59:29.262664 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fssw\" (UniqueName: \"kubernetes.io/projected/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-kube-api-access-6fssw\") pod \"cluster-cloud-controller-manager-operator-74f484689c-jmfn2\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 11:59:29.284145 master-0 kubenswrapper[35367]: I1204 11:59:29.283976 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkjzz\" (UniqueName: \"kubernetes.io/projected/6f15dcdb-c968-429c-9d1d-63c2becad337-kube-api-access-kkjzz\") pod \"cluster-node-tuning-operator-85cff47f46-4gv5j\" (UID: \"6f15dcdb-c968-429c-9d1d-63c2becad337\") " pod="openshift-cluster-node-tuning-operator/cluster-node-tuning-operator-85cff47f46-4gv5j" Dec 04 11:59:29.305379 master-0 kubenswrapper[35367]: I1204 11:59:29.305273 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mzvm\" (UniqueName: \"kubernetes.io/projected/f925fe60-b5b7-4a5a-9800-3546334da725-kube-api-access-2mzvm\") pod \"redhat-marketplace-svhl4\" (UID: \"f925fe60-b5b7-4a5a-9800-3546334da725\") " pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:59:29.325031 master-0 kubenswrapper[35367]: I1204 11:59:29.324977 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tltk9\" (UniqueName: \"kubernetes.io/projected/0c092f5d-bd33-4d91-9206-ce9c0b9e1aae-kube-api-access-tltk9\") pod \"dns-default-xg7vh\" (UID: \"0c092f5d-bd33-4d91-9206-ce9c0b9e1aae\") " pod="openshift-dns/dns-default-xg7vh" Dec 04 11:59:29.345461 master-0 kubenswrapper[35367]: I1204 11:59:29.345407 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfspg\" (UniqueName: \"kubernetes.io/projected/14bd3485-aa02-4984-b4a3-59f360b1b327-kube-api-access-nfspg\") pod \"control-plane-machine-set-operator-7df95c79b5-7w5lm\" (UID: \"14bd3485-aa02-4984-b4a3-59f360b1b327\") " pod="openshift-machine-api/control-plane-machine-set-operator-7df95c79b5-7w5lm" Dec 04 11:59:29.363539 master-0 kubenswrapper[35367]: I1204 11:59:29.363490 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjkck\" (UniqueName: \"kubernetes.io/projected/f797ab14-0eb5-48b4-b914-f434f67c4c49-kube-api-access-zjkck\") pod \"cluster-storage-operator-dcf7fc84b-fncfd\" (UID: \"f797ab14-0eb5-48b4-b914-f434f67c4c49\") " pod="openshift-cluster-storage-operator/cluster-storage-operator-dcf7fc84b-fncfd" Dec 04 11:59:29.384520 master-0 kubenswrapper[35367]: I1204 11:59:29.384361 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-59pbp\" (UniqueName: \"kubernetes.io/projected/330553d2-40ea-4496-8346-2e5bf680669b-kube-api-access-59pbp\") pod \"iptables-alerter-bkmlp\" (UID: \"330553d2-40ea-4496-8346-2e5bf680669b\") " pod="openshift-network-operator/iptables-alerter-bkmlp" Dec 04 11:59:29.404068 master-0 kubenswrapper[35367]: I1204 11:59:29.404021 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkqp2\" (UniqueName: \"kubernetes.io/projected/1897bad8-3875-4bd6-b877-b1abe1fe76c7-kube-api-access-dkqp2\") pod \"operator-controller-controller-manager-7cbd59c7f8-qcz9t\" (UID: \"1897bad8-3875-4bd6-b877-b1abe1fe76c7\") " pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:59:29.425554 master-0 kubenswrapper[35367]: I1204 11:59:29.425501 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgdmn\" (UniqueName: \"kubernetes.io/projected/64d30b80-2336-49c2-a2c2-1e0694036a84-kube-api-access-vgdmn\") pod \"cloud-credential-operator-698c598cfc-95jdn\" (UID: \"64d30b80-2336-49c2-a2c2-1e0694036a84\") " pod="openshift-cloud-credential-operator/cloud-credential-operator-698c598cfc-95jdn" Dec 04 11:59:29.449923 master-0 kubenswrapper[35367]: I1204 11:59:29.449782 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6bkg\" (UniqueName: \"kubernetes.io/projected/ffaf95be-586c-40fa-b15f-1beaffe7ff1c-kube-api-access-t6bkg\") pod \"network-operator-79767b7ff9-5bgzx\" (UID: \"ffaf95be-586c-40fa-b15f-1beaffe7ff1c\") " pod="openshift-network-operator/network-operator-79767b7ff9-5bgzx" Dec 04 11:59:29.466486 master-0 kubenswrapper[35367]: I1204 11:59:29.465786 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4w2j\" (UniqueName: \"kubernetes.io/projected/bdfcb644-24ef-4a33-93ae-a855e872d29a-kube-api-access-f4w2j\") pod \"multus-additional-cni-plugins-6pk59\" (UID: \"bdfcb644-24ef-4a33-93ae-a855e872d29a\") " pod="openshift-multus/multus-additional-cni-plugins-6pk59" Dec 04 11:59:29.488937 master-0 kubenswrapper[35367]: I1204 11:59:29.488447 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkcj4\" (UniqueName: \"kubernetes.io/projected/7203ec93-6572-4032-825c-140029a86058-kube-api-access-gkcj4\") pod \"network-node-identity-f8hvq\" (UID: \"7203ec93-6572-4032-825c-140029a86058\") " pod="openshift-network-node-identity/network-node-identity-f8hvq" Dec 04 11:59:29.507351 master-0 kubenswrapper[35367]: I1204 11:59:29.507293 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbt5w\" (UniqueName: \"kubernetes.io/projected/a3558de2-46f8-48b5-a961-95decb7805cf-kube-api-access-tbt5w\") pod \"network-check-target-w2lss\" (UID: \"a3558de2-46f8-48b5-a961-95decb7805cf\") " pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:59:29.526833 master-0 kubenswrapper[35367]: I1204 11:59:29.526746 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k449s\" (UniqueName: \"kubernetes.io/projected/3322cc5a-f1f7-4522-b423-19fb7f38cd43-kube-api-access-k449s\") pod \"openshift-controller-manager-operator-6c8676f99d-7z948\" (UID: \"3322cc5a-f1f7-4522-b423-19fb7f38cd43\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-6c8676f99d-7z948" Dec 04 11:59:29.545715 master-0 kubenswrapper[35367]: I1204 11:59:29.545534 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxbts\" (UniqueName: \"kubernetes.io/projected/c835660f-5a79-4679-b9be-8543ca6ef5a1-kube-api-access-nxbts\") pod \"machine-approver-f797d8546-qvgbq\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 11:59:29.563653 master-0 kubenswrapper[35367]: I1204 11:59:29.563599 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cffn\" (UniqueName: \"kubernetes.io/projected/08550069-c1a1-475e-84a2-e56905f1ed38-kube-api-access-8cffn\") pod \"multus-admission-controller-7dfc5b745f-258xq\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 11:59:29.587834 master-0 kubenswrapper[35367]: I1204 11:59:29.587751 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g7bh\" (UniqueName: \"kubernetes.io/projected/00601c1a-efd4-4366-bdc9-d768afa252b0-kube-api-access-2g7bh\") pod \"openshift-config-operator-68758cbcdb-zh8g5\" (UID: \"00601c1a-efd4-4366-bdc9-d768afa252b0\") " pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:59:29.604792 master-0 kubenswrapper[35367]: I1204 11:59:29.604734 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvzrc\" (UniqueName: \"kubernetes.io/projected/2ab26ae5-0607-4dfd-840e-531d204b5030-kube-api-access-mvzrc\") pod \"cluster-monitoring-operator-7ff994598c-p82nn\" (UID: \"2ab26ae5-0607-4dfd-840e-531d204b5030\") " pod="openshift-monitoring/cluster-monitoring-operator-7ff994598c-p82nn" Dec 04 11:59:29.625123 master-0 kubenswrapper[35367]: I1204 11:59:29.625035 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a399a87b-8153-4045-a8d3-63fd88ae280f-kube-api-access\") pod \"cluster-version-operator-6d5d5dcc89-cw2hx\" (UID: \"a399a87b-8153-4045-a8d3-63fd88ae280f\") " pod="openshift-cluster-version/cluster-version-operator-6d5d5dcc89-cw2hx" Dec 04 11:59:29.647825 master-0 kubenswrapper[35367]: I1204 11:59:29.647753 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggzfm\" (UniqueName: \"kubernetes.io/projected/434ed9b9-715b-455b-867c-775b256df40f-kube-api-access-ggzfm\") pod \"catalog-operator-fbc6455c4-5m8ll\" (UID: \"434ed9b9-715b-455b-867c-775b256df40f\") " pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:59:29.667078 master-0 kubenswrapper[35367]: I1204 11:59:29.666832 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc244\" (UniqueName: \"kubernetes.io/projected/c91e6234-52c5-41c0-a1ff-6a92932b83cd-kube-api-access-rc244\") pod \"tuned-dp5s8\" (UID: \"c91e6234-52c5-41c0-a1ff-6a92932b83cd\") " pod="openshift-cluster-node-tuning-operator/tuned-dp5s8" Dec 04 11:59:29.689144 master-0 kubenswrapper[35367]: I1204 11:59:29.688957 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmm9t\" (UniqueName: \"kubernetes.io/projected/7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7-kube-api-access-mmm9t\") pod \"node-resolver-qq64m\" (UID: \"7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7\") " pod="openshift-dns/node-resolver-qq64m" Dec 04 11:59:29.708054 master-0 kubenswrapper[35367]: I1204 11:59:29.707969 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ade9186-b262-4b5e-9c6f-ba89f0130fb6-bound-sa-token\") pod \"cluster-image-registry-operator-6fb9f88b7-tgvfl\" (UID: \"1ade9186-b262-4b5e-9c6f-ba89f0130fb6\") " pod="openshift-image-registry/cluster-image-registry-operator-6fb9f88b7-tgvfl" Dec 04 11:59:29.725982 master-0 kubenswrapper[35367]: I1204 11:59:29.725914 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-llscb\" (UniqueName: \"kubernetes.io/projected/fd9f8671-8066-4990-b45d-8b619aa5d9ec-kube-api-access-llscb\") pod \"kube-storage-version-migrator-operator-b9c5dfc78-dcxkw\" (UID: \"fd9f8671-8066-4990-b45d-8b619aa5d9ec\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b9c5dfc78-dcxkw" Dec 04 11:59:29.745909 master-0 kubenswrapper[35367]: I1204 11:59:29.745785 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/bac00ac5-0371-48fd-b1cc-60438f08ae94-kube-api-access\") pod \"kube-controller-manager-operator-848f645654-7hmhg\" (UID: \"bac00ac5-0371-48fd-b1cc-60438f08ae94\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-848f645654-7hmhg" Dec 04 11:59:29.764213 master-0 kubenswrapper[35367]: I1204 11:59:29.764157 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pqsl\" (UniqueName: \"kubernetes.io/projected/e7fc7c16-5bca-49e5-aff0-7a8f80c6b639-kube-api-access-2pqsl\") pod \"cluster-autoscaler-operator-5f49d774cd-894dk\" (UID: \"e7fc7c16-5bca-49e5-aff0-7a8f80c6b639\") " pod="openshift-machine-api/cluster-autoscaler-operator-5f49d774cd-894dk" Dec 04 11:59:29.770397 master-0 kubenswrapper[35367]: I1204 11:59:29.770339 35367 request.go:700] Waited for 2.924650447s due to client-side throttling, not priority and fairness, request: POST:https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-multus/serviceaccounts/default/token Dec 04 11:59:29.785269 master-0 kubenswrapper[35367]: I1204 11:59:29.785207 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lxhl\" (UniqueName: \"kubernetes.io/projected/c790c174-dc60-4f34-8818-3b367fbe3a5f-kube-api-access-6lxhl\") pod \"multus-twxbl\" (UID: \"c790c174-dc60-4f34-8818-3b367fbe3a5f\") " pod="openshift-multus/multus-twxbl" Dec 04 11:59:29.804611 master-0 kubenswrapper[35367]: I1204 11:59:29.804452 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q8d8\" (UniqueName: \"kubernetes.io/projected/1243d581-fa11-4db1-a01a-0cf64eb3ef74-kube-api-access-9q8d8\") pod \"service-ca-77c99c46b8-6cntk\" (UID: \"1243d581-fa11-4db1-a01a-0cf64eb3ef74\") " pod="openshift-service-ca/service-ca-77c99c46b8-6cntk" Dec 04 11:59:29.827084 master-0 kubenswrapper[35367]: I1204 11:59:29.827038 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhvdc\" (UniqueName: \"kubernetes.io/projected/cdb50850-779d-4179-ba1d-65ffeb4bb2e9-kube-api-access-nhvdc\") pod \"machine-config-operator-dc5d7666f-p2cmn\" (UID: \"cdb50850-779d-4179-ba1d-65ffeb4bb2e9\") " pod="openshift-machine-config-operator/machine-config-operator-dc5d7666f-p2cmn" Dec 04 11:59:29.846385 master-0 kubenswrapper[35367]: I1204 11:59:29.846191 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d77m8\" (UniqueName: \"kubernetes.io/projected/e4d7939a-5961-4608-b910-73e71aa55bf6-kube-api-access-d77m8\") pod \"route-controller-manager-95cb5f987-46bsk\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:59:29.866406 master-0 kubenswrapper[35367]: I1204 11:59:29.866357 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b011b1f1-3235-4e20-825b-ce711c052407-bound-sa-token\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:59:29.885692 master-0 kubenswrapper[35367]: I1204 11:59:29.885612 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq49f\" (UniqueName: \"kubernetes.io/projected/b011b1f1-3235-4e20-825b-ce711c052407-kube-api-access-jq49f\") pod \"ingress-operator-8649c48786-cx2b2\" (UID: \"b011b1f1-3235-4e20-825b-ce711c052407\") " pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" Dec 04 11:59:29.906272 master-0 kubenswrapper[35367]: I1204 11:59:29.906201 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2mhg\" (UniqueName: \"kubernetes.io/projected/157eab0c-0d8d-486b-a349-c2e466e18e0c-kube-api-access-p2mhg\") pod \"ovnkube-node-z4qvm\" (UID: \"157eab0c-0d8d-486b-a349-c2e466e18e0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:29.925086 master-0 kubenswrapper[35367]: I1204 11:59:29.924755 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr454\" (UniqueName: \"kubernetes.io/projected/7bf67a51-9759-4e2a-a2ae-ef7416cad43f-kube-api-access-zr454\") pod \"olm-operator-7cd7dbb44c-vzj4q\" (UID: \"7bf67a51-9759-4e2a-a2ae-ef7416cad43f\") " pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:59:29.946190 master-0 kubenswrapper[35367]: I1204 11:59:29.946127 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7xwd\" (UniqueName: \"kubernetes.io/projected/42b3be0f-1d82-4a64-abb4-0118a6960efd-kube-api-access-c7xwd\") pod \"authentication-operator-6c968fdfdf-nrrfw\" (UID: \"42b3be0f-1d82-4a64-abb4-0118a6960efd\") " pod="openshift-authentication-operator/authentication-operator-6c968fdfdf-nrrfw" Dec 04 11:59:29.964662 master-0 kubenswrapper[35367]: I1204 11:59:29.964581 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/ccf81538-4d5a-4c26-8e54-fe39331a625d-kube-api-access\") pod \"kube-apiserver-operator-765d9ff747-gr68k\" (UID: \"ccf81538-4d5a-4c26-8e54-fe39331a625d\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-765d9ff747-gr68k" Dec 04 11:59:29.989971 master-0 kubenswrapper[35367]: I1204 11:59:29.986201 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsvvf\" (UniqueName: \"kubernetes.io/projected/018e9ad3-c071-45c6-bfa6-e53dda20c757-kube-api-access-bsvvf\") pod \"redhat-operators-wksdw\" (UID: \"018e9ad3-c071-45c6-bfa6-e53dda20c757\") " pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:59:30.005776 master-0 kubenswrapper[35367]: I1204 11:59:30.005725 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlr76\" (UniqueName: \"kubernetes.io/projected/7c017c69-b24e-4a7a-b888-133bed34c174-kube-api-access-tlr76\") pod \"dns-operator-7c56cf9b74-xz27r\" (UID: \"7c017c69-b24e-4a7a-b888-133bed34c174\") " pod="openshift-dns-operator/dns-operator-7c56cf9b74-xz27r" Dec 04 11:59:30.021706 master-0 kubenswrapper[35367]: I1204 11:59:30.021620 35367 scope.go:117] "RemoveContainer" containerID="6b81ee1ae28f16389ded7b634a062f62bd333e247fbc631f5edd514e5d0827da" Dec 04 11:59:30.026958 master-0 kubenswrapper[35367]: I1204 11:59:30.026877 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2bpn\" (UniqueName: \"kubernetes.io/projected/7ec61be5-32f9-4aac-815f-41d173213107-kube-api-access-p2bpn\") pod \"apiserver-6cbcc775d9-jrlx4\" (UID: \"7ec61be5-32f9-4aac-815f-41d173213107\") " pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:30.045821 master-0 kubenswrapper[35367]: I1204 11:59:30.045719 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2qnk\" (UniqueName: \"kubernetes.io/projected/24506aa4-ab78-49df-bb58-59093498f13d-kube-api-access-w2qnk\") pod \"controller-manager-6686654b8d-rrndk\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:59:30.066548 master-0 kubenswrapper[35367]: I1204 11:59:30.066504 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6z8r\" (UniqueName: \"kubernetes.io/projected/b620f29d-dcde-4f98-9fb6-dd479dcdcf7c-kube-api-access-v6z8r\") pod \"certified-operators-8qs8v\" (UID: \"b620f29d-dcde-4f98-9fb6-dd479dcdcf7c\") " pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:59:30.085002 master-0 kubenswrapper[35367]: I1204 11:59:30.084412 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2jw8\" (UniqueName: \"kubernetes.io/projected/c50317d3-f7cd-4133-845e-44add57ac378-kube-api-access-s2jw8\") pod \"machine-api-operator-88d48b57d-9fjtd\" (UID: \"c50317d3-f7cd-4133-845e-44add57ac378\") " pod="openshift-machine-api/machine-api-operator-88d48b57d-9fjtd" Dec 04 11:59:30.105229 master-0 kubenswrapper[35367]: I1204 11:59:30.105180 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnfmb\" (UniqueName: \"kubernetes.io/projected/ee9a47b1-cdd9-43bc-8115-8851f29106e6-kube-api-access-rnfmb\") pod \"catalogd-controller-manager-7cc89f4c4c-fd9pv\" (UID: \"ee9a47b1-cdd9-43bc-8115-8851f29106e6\") " pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:59:30.126557 master-0 kubenswrapper[35367]: I1204 11:59:30.126500 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg7hr\" (UniqueName: \"kubernetes.io/projected/cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9-kube-api-access-lg7hr\") pod \"apiserver-7467446c4b-dlj7g\" (UID: \"cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9\") " pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:59:30.133996 master-0 kubenswrapper[35367]: E1204 11:59:30.133952 35367 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.291s" Dec 04 11:59:30.134109 master-0 kubenswrapper[35367]: I1204 11:59:30.134035 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:59:30.134109 master-0 kubenswrapper[35367]: I1204 11:59:30.134078 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:59:30.134109 master-0 kubenswrapper[35367]: I1204 11:59:30.134092 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-apiserver/bootstrap-kube-apiserver-master-0"] Dec 04 11:59:30.134234 master-0 kubenswrapper[35367]: I1204 11:59:30.134106 35367 kubelet.go:2673] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-kube-apiserver/bootstrap-kube-apiserver-master-0" mirrorPodUID="ab32df92-dc58-4528-8f31-434280957642" Dec 04 11:59:30.134234 master-0 kubenswrapper[35367]: I1204 11:59:30.134128 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-3-master-0" event={"ID":"0fad065c-94c9-4a38-ab76-cf0266bdc04b","Type":"ContainerDied","Data":"067d2ebf7cd71320983357660c7bfa56d36312a860021a8819604e4142c7331b"} Dec 04 11:59:30.134234 master-0 kubenswrapper[35367]: I1204 11:59:30.134146 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="067d2ebf7cd71320983357660c7bfa56d36312a860021a8819604e4142c7331b" Dec 04 11:59:30.134234 master-0 kubenswrapper[35367]: I1204 11:59:30.134191 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:59:30.134337 master-0 kubenswrapper[35367]: I1204 11:59:30.134284 35367 scope.go:117] "RemoveContainer" containerID="cb6defb2f3057900b70ffad997ff544ea8c575bd9817b1a99621b2f9c63061e6" Dec 04 11:59:30.134570 master-0 kubenswrapper[35367]: I1204 11:59:30.134541 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/package-server-manager-67477646d4-7hndf" Dec 04 11:59:30.134895 master-0 kubenswrapper[35367]: I1204 11:59:30.134877 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-etcd/etcd-master-0" Dec 04 11:59:30.134955 master-0 kubenswrapper[35367]: I1204 11:59:30.134945 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:59:30.135011 master-0 kubenswrapper[35367]: I1204 11:59:30.135001 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:59:30.135161 master-0 kubenswrapper[35367]: I1204 11:59:30.135143 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:59:30.136039 master-0 kubenswrapper[35367]: I1204 11:59:30.135911 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:59:30.136039 master-0 kubenswrapper[35367]: I1204 11:59:30.135977 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/packageserver-675f5c767c-mtdrq" Dec 04 11:59:30.136191 master-0 kubenswrapper[35367]: I1204 11:59:30.136068 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:30.136191 master-0 kubenswrapper[35367]: I1204 11:59:30.136152 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:59:30.136285 master-0 kubenswrapper[35367]: I1204 11:59:30.136198 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:59:30.136285 master-0 kubenswrapper[35367]: I1204 11:59:30.136236 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:59:30.136561 master-0 kubenswrapper[35367]: I1204 11:59:30.136370 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 11:59:30.136615 master-0 kubenswrapper[35367]: I1204 11:59:30.136569 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:59:30.136663 master-0 kubenswrapper[35367]: I1204 11:59:30.136621 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-controller/operator-controller-controller-manager-7cbd59c7f8-qcz9t" Dec 04 11:59:30.136663 master-0 kubenswrapper[35367]: I1204 11:59:30.136655 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-dns/dns-default-xg7vh" Dec 04 11:59:30.137399 master-0 kubenswrapper[35367]: I1204 11:59:30.137236 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xg7vh" Dec 04 11:59:30.137399 master-0 kubenswrapper[35367]: I1204 11:59:30.137310 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:59:30.137399 master-0 kubenswrapper[35367]: I1204 11:59:30.137356 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:59:30.137785 master-0 kubenswrapper[35367]: I1204 11:59:30.137404 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:59:30.137785 master-0 kubenswrapper[35367]: I1204 11:59:30.137437 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:59:30.137785 master-0 kubenswrapper[35367]: I1204 11:59:30.137466 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:59:30.137785 master-0 kubenswrapper[35367]: I1204 11:59:30.137531 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/catalog-operator-fbc6455c4-5m8ll" Dec 04 11:59:30.137785 master-0 kubenswrapper[35367]: I1204 11:59:30.137637 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w2lss" Dec 04 11:59:30.137998 master-0 kubenswrapper[35367]: I1204 11:59:30.137886 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-config-operator/openshift-config-operator-68758cbcdb-zh8g5" Dec 04 11:59:30.138048 master-0 kubenswrapper[35367]: I1204 11:59:30.138036 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:59:30.138096 master-0 kubenswrapper[35367]: I1204 11:59:30.138085 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:30.138154 master-0 kubenswrapper[35367]: I1204 11:59:30.138133 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:30.138199 master-0 kubenswrapper[35367]: I1204 11:59:30.138184 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:30.138240 master-0 kubenswrapper[35367]: I1204 11:59:30.138211 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:59:30.138437 master-0 kubenswrapper[35367]: I1204 11:59:30.138369 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:59:30.138437 master-0 kubenswrapper[35367]: I1204 11:59:30.138406 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:59:30.138437 master-0 kubenswrapper[35367]: I1204 11:59:30.138420 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/olm-operator-7cd7dbb44c-vzj4q" Dec 04 11:59:30.142077 master-0 kubenswrapper[35367]: I1204 11:59:30.142051 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:30.142347 master-0 kubenswrapper[35367]: I1204 11:59:30.142265 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 11:59:30.144569 master-0 kubenswrapper[35367]: I1204 11:59:30.144522 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 11:59:30.156565 master-0 kubenswrapper[35367]: I1204 11:59:30.156520 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-etcd/etcd-master-0" Dec 04 11:59:30.159188 master-0 kubenswrapper[35367]: I1204 11:59:30.159146 35367 scope.go:117] "RemoveContainer" containerID="14ac45f5991606821dff758d708720469710a75e4bb098390a3a5689b8ae0ee8" Dec 04 11:59:30.164382 master-0 kubenswrapper[35367]: I1204 11:59:30.163853 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:30.166378 master-0 kubenswrapper[35367]: I1204 11:59:30.166194 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:30.178749 master-0 kubenswrapper[35367]: I1204 11:59:30.178446 35367 scope.go:117] "RemoveContainer" containerID="9c7529c8ca2d0c98a54eee2915f7d9cb961fdd0ba295047dca3baa0a51ae6a4b" Dec 04 11:59:30.185766 master-0 kubenswrapper[35367]: I1204 11:59:30.185718 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:59:30.193465 master-0 kubenswrapper[35367]: I1204 11:59:30.192910 35367 kubelet_node_status.go:115] "Node was previously registered" node="master-0" Dec 04 11:59:30.193465 master-0 kubenswrapper[35367]: I1204 11:59:30.193012 35367 kubelet_node_status.go:79] "Successfully registered node" node="master-0" Dec 04 11:59:30.349867 master-0 kubenswrapper[35367]: I1204 11:59:30.349519 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:59:30.349867 master-0 kubenswrapper[35367]: I1204 11:59:30.349771 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:59:30.349867 master-0 kubenswrapper[35367]: I1204 11:59:30.349865 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:59:30.352177 master-0 kubenswrapper[35367]: I1204 11:59:30.352150 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-catalogd/catalogd-controller-manager-7cc89f4c4c-fd9pv" Dec 04 11:59:30.363761 master-0 kubenswrapper[35367]: I1204 11:59:30.363719 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:59:30.363836 master-0 kubenswrapper[35367]: I1204 11:59:30.363787 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:59:31.126757 master-0 kubenswrapper[35367]: I1204 11:59:31.126712 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/5.log" Dec 04 11:59:31.127398 master-0 kubenswrapper[35367]: I1204 11:59:31.127167 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-8649c48786-cx2b2" event={"ID":"b011b1f1-3235-4e20-825b-ce711c052407","Type":"ContainerStarted","Data":"6e2b9bac78892a0ed4bd84f11f2eb0c1268bd4937b6948a7c059ed07470dce0e"} Dec 04 11:59:31.128693 master-0 kubenswrapper[35367]: I1204 11:59:31.128644 35367 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 11:59:31.560450 master-0 kubenswrapper[35367]: I1204 11:59:31.560323 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/kube-apiserver-master-0" podStartSLOduration=17.560288516 podStartE2EDuration="17.560288516s" podCreationTimestamp="2025-12-04 11:59:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:59:31.489601027 +0000 UTC m=+14.927662285" watchObservedRunningTime="2025-12-04 11:59:31.560288516 +0000 UTC m=+14.998349774" Dec 04 11:59:31.717638 master-0 kubenswrapper[35367]: I1204 11:59:31.717572 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 11:59:31.817326 master-0 kubenswrapper[35367]: I1204 11:59:31.817193 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" podStartSLOduration=17.81713716 podStartE2EDuration="17.81713716s" podCreationTimestamp="2025-12-04 11:59:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 11:59:31.816700816 +0000 UTC m=+15.254762084" watchObservedRunningTime="2025-12-04 11:59:31.81713716 +0000 UTC m=+15.255198418" Dec 04 11:59:32.147880 master-0 kubenswrapper[35367]: I1204 11:59:32.147573 35367 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 11:59:33.925831 master-0 kubenswrapper[35367]: I1204 11:59:33.925762 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-fvf4r"] Dec 04 11:59:33.939868 master-0 kubenswrapper[35367]: I1204 11:59:33.939781 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-fvf4r"] Dec 04 11:59:34.642610 master-0 kubenswrapper[35367]: I1204 11:59:34.642344 35367 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:59:34.642610 master-0 kubenswrapper[35367]: I1204 11:59:34.642441 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:59:34.756417 master-0 kubenswrapper[35367]: I1204 11:59:34.756346 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcf0787c-2d77-4bbe-ad3c-70e03169c96f" path="/var/lib/kubelet/pods/fcf0787c-2d77-4bbe-ad3c-70e03169c96f/volumes" Dec 04 11:59:35.057737 master-0 kubenswrapper[35367]: I1204 11:59:35.057669 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-apiserver/apiserver-6cbcc775d9-jrlx4" Dec 04 11:59:35.407522 master-0 kubenswrapper[35367]: I1204 11:59:35.407345 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:59:35.413036 master-0 kubenswrapper[35367]: I1204 11:59:35.412962 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-oauth-apiserver/apiserver-7467446c4b-dlj7g" Dec 04 11:59:36.195028 master-0 kubenswrapper[35367]: I1204 11:59:36.194971 35367 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 11:59:36.195596 master-0 kubenswrapper[35367]: I1204 11:59:36.195233 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" podUID="a906debd0c35952850935aee2d607cce" containerName="startup-monitor" containerID="cri-o://b02fad9634552ca9f9ab767de0ddd976a9b715f9ba49fca68b0847641cd92467" gracePeriod=5 Dec 04 11:59:39.200069 master-0 kubenswrapper[35367]: I1204 11:59:39.200010 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-rxhpq" Dec 04 11:59:39.510128 master-0 kubenswrapper[35367]: I1204 11:59:39.509984 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-svhl4" Dec 04 11:59:40.097531 master-0 kubenswrapper[35367]: I1204 11:59:40.097438 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-wksdw" Dec 04 11:59:40.402758 master-0 kubenswrapper[35367]: I1204 11:59:40.402522 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:59:40.447572 master-0 kubenswrapper[35367]: I1204 11:59:40.447527 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-8qs8v" Dec 04 11:59:41.782901 master-0 kubenswrapper[35367]: I1204 11:59:41.782839 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-startup-monitor-master-0_a906debd0c35952850935aee2d607cce/startup-monitor/0.log" Dec 04 11:59:41.783488 master-0 kubenswrapper[35367]: I1204 11:59:41.782962 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:41.889749 master-0 kubenswrapper[35367]: I1204 11:59:41.889654 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-pod-resource-dir\") pod \"a906debd0c35952850935aee2d607cce\" (UID: \"a906debd0c35952850935aee2d607cce\") " Dec 04 11:59:41.889749 master-0 kubenswrapper[35367]: I1204 11:59:41.889753 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-var-log\") pod \"a906debd0c35952850935aee2d607cce\" (UID: \"a906debd0c35952850935aee2d607cce\") " Dec 04 11:59:41.890087 master-0 kubenswrapper[35367]: I1204 11:59:41.889833 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-var-lock\") pod \"a906debd0c35952850935aee2d607cce\" (UID: \"a906debd0c35952850935aee2d607cce\") " Dec 04 11:59:41.890087 master-0 kubenswrapper[35367]: I1204 11:59:41.889865 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-manifests\") pod \"a906debd0c35952850935aee2d607cce\" (UID: \"a906debd0c35952850935aee2d607cce\") " Dec 04 11:59:41.890087 master-0 kubenswrapper[35367]: I1204 11:59:41.889890 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-resource-dir\") pod \"a906debd0c35952850935aee2d607cce\" (UID: \"a906debd0c35952850935aee2d607cce\") " Dec 04 11:59:41.890087 master-0 kubenswrapper[35367]: I1204 11:59:41.889975 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-var-log" (OuterVolumeSpecName: "var-log") pod "a906debd0c35952850935aee2d607cce" (UID: "a906debd0c35952850935aee2d607cce"). InnerVolumeSpecName "var-log". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:59:41.890087 master-0 kubenswrapper[35367]: I1204 11:59:41.890077 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-var-lock" (OuterVolumeSpecName: "var-lock") pod "a906debd0c35952850935aee2d607cce" (UID: "a906debd0c35952850935aee2d607cce"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:59:41.890267 master-0 kubenswrapper[35367]: I1204 11:59:41.890121 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-manifests" (OuterVolumeSpecName: "manifests") pod "a906debd0c35952850935aee2d607cce" (UID: "a906debd0c35952850935aee2d607cce"). InnerVolumeSpecName "manifests". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:59:41.890267 master-0 kubenswrapper[35367]: I1204 11:59:41.890225 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "a906debd0c35952850935aee2d607cce" (UID: "a906debd0c35952850935aee2d607cce"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:59:41.890267 master-0 kubenswrapper[35367]: I1204 11:59:41.890245 35367 reconciler_common.go:293] "Volume detached for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-var-log\") on node \"master-0\" DevicePath \"\"" Dec 04 11:59:41.890267 master-0 kubenswrapper[35367]: I1204 11:59:41.890264 35367 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 11:59:41.890267 master-0 kubenswrapper[35367]: I1204 11:59:41.890272 35367 reconciler_common.go:293] "Volume detached for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-manifests\") on node \"master-0\" DevicePath \"\"" Dec 04 11:59:41.895748 master-0 kubenswrapper[35367]: I1204 11:59:41.895626 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-pod-resource-dir" (OuterVolumeSpecName: "pod-resource-dir") pod "a906debd0c35952850935aee2d607cce" (UID: "a906debd0c35952850935aee2d607cce"). InnerVolumeSpecName "pod-resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 11:59:41.992670 master-0 kubenswrapper[35367]: I1204 11:59:41.992433 35367 reconciler_common.go:293] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:59:41.992670 master-0 kubenswrapper[35367]: I1204 11:59:41.992553 35367 reconciler_common.go:293] "Volume detached for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/a906debd0c35952850935aee2d607cce-pod-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 11:59:42.232267 master-0 kubenswrapper[35367]: I1204 11:59:42.232168 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-startup-monitor-master-0_a906debd0c35952850935aee2d607cce/startup-monitor/0.log" Dec 04 11:59:42.232267 master-0 kubenswrapper[35367]: I1204 11:59:42.232258 35367 generic.go:334] "Generic (PLEG): container finished" podID="a906debd0c35952850935aee2d607cce" containerID="b02fad9634552ca9f9ab767de0ddd976a9b715f9ba49fca68b0847641cd92467" exitCode=137 Dec 04 11:59:42.232655 master-0 kubenswrapper[35367]: I1204 11:59:42.232323 35367 scope.go:117] "RemoveContainer" containerID="b02fad9634552ca9f9ab767de0ddd976a9b715f9ba49fca68b0847641cd92467" Dec 04 11:59:42.232655 master-0 kubenswrapper[35367]: I1204 11:59:42.232435 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 11:59:42.257124 master-0 kubenswrapper[35367]: I1204 11:59:42.256099 35367 scope.go:117] "RemoveContainer" containerID="b02fad9634552ca9f9ab767de0ddd976a9b715f9ba49fca68b0847641cd92467" Dec 04 11:59:42.257124 master-0 kubenswrapper[35367]: E1204 11:59:42.256671 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b02fad9634552ca9f9ab767de0ddd976a9b715f9ba49fca68b0847641cd92467\": container with ID starting with b02fad9634552ca9f9ab767de0ddd976a9b715f9ba49fca68b0847641cd92467 not found: ID does not exist" containerID="b02fad9634552ca9f9ab767de0ddd976a9b715f9ba49fca68b0847641cd92467" Dec 04 11:59:42.257124 master-0 kubenswrapper[35367]: I1204 11:59:42.256749 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b02fad9634552ca9f9ab767de0ddd976a9b715f9ba49fca68b0847641cd92467"} err="failed to get container status \"b02fad9634552ca9f9ab767de0ddd976a9b715f9ba49fca68b0847641cd92467\": rpc error: code = NotFound desc = could not find container \"b02fad9634552ca9f9ab767de0ddd976a9b715f9ba49fca68b0847641cd92467\": container with ID starting with b02fad9634552ca9f9ab767de0ddd976a9b715f9ba49fca68b0847641cd92467 not found: ID does not exist" Dec 04 11:59:42.277209 master-0 kubenswrapper[35367]: I1204 11:59:42.277114 35367 kubelet.go:2706] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" mirrorPodUID="0b076706-487e-4bef-985f-a4199e82a533" Dec 04 11:59:42.755374 master-0 kubenswrapper[35367]: I1204 11:59:42.755295 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a906debd0c35952850935aee2d607cce" path="/var/lib/kubelet/pods/a906debd0c35952850935aee2d607cce/volumes" Dec 04 11:59:42.755672 master-0 kubenswrapper[35367]: I1204 11:59:42.755603 35367 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" podUID="" Dec 04 11:59:42.774767 master-0 kubenswrapper[35367]: I1204 11:59:42.774690 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 11:59:42.774767 master-0 kubenswrapper[35367]: I1204 11:59:42.774733 35367 kubelet.go:2649] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" mirrorPodUID="0b076706-487e-4bef-985f-a4199e82a533" Dec 04 11:59:42.776517 master-0 kubenswrapper[35367]: I1204 11:59:42.776467 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 11:59:42.776517 master-0 kubenswrapper[35367]: I1204 11:59:42.776493 35367 kubelet.go:2673] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" mirrorPodUID="0b076706-487e-4bef-985f-a4199e82a533" Dec 04 11:59:44.642203 master-0 kubenswrapper[35367]: I1204 11:59:44.642099 35367 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:59:44.642203 master-0 kubenswrapper[35367]: I1204 11:59:44.642201 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 11:59:44.642927 master-0 kubenswrapper[35367]: I1204 11:59:44.642276 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:59:44.642976 master-0 kubenswrapper[35367]: I1204 11:59:44.642946 35367 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="cluster-policy-controller" containerStatusID={"Type":"cri-o","ID":"75c0b00a72249ad8e40bfad00297d89e0a781c353f7f4ed419a2d838ec6cf264"} pod="openshift-kube-controller-manager/kube-controller-manager-master-0" containerMessage="Container cluster-policy-controller failed startup probe, will be restarted" Dec 04 11:59:44.643064 master-0 kubenswrapper[35367]: I1204 11:59:44.643030 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" containerID="cri-o://75c0b00a72249ad8e40bfad00297d89e0a781c353f7f4ed419a2d838ec6cf264" gracePeriod=30 Dec 04 11:59:45.256612 master-0 kubenswrapper[35367]: I1204 11:59:45.256467 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/8.log" Dec 04 11:59:45.257163 master-0 kubenswrapper[35367]: I1204 11:59:45.257127 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/7.log" Dec 04 11:59:45.258250 master-0 kubenswrapper[35367]: I1204 11:59:45.258219 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-cert-syncer/0.log" Dec 04 11:59:45.258737 master-0 kubenswrapper[35367]: I1204 11:59:45.258686 35367 generic.go:334] "Generic (PLEG): container finished" podID="e6b437c60bb18680f4492b00b294e872" containerID="75c0b00a72249ad8e40bfad00297d89e0a781c353f7f4ed419a2d838ec6cf264" exitCode=255 Dec 04 11:59:45.258825 master-0 kubenswrapper[35367]: I1204 11:59:45.258772 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerDied","Data":"75c0b00a72249ad8e40bfad00297d89e0a781c353f7f4ed419a2d838ec6cf264"} Dec 04 11:59:45.258894 master-0 kubenswrapper[35367]: I1204 11:59:45.258857 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"ac50e4f83a70cc9893c52ad9dcf0f66db2c264b4fb0a43c54b3ccd52ad6f996b"} Dec 04 11:59:45.258930 master-0 kubenswrapper[35367]: I1204 11:59:45.258919 35367 scope.go:117] "RemoveContainer" containerID="f55be9781f4c302a74c8d2de0e71ed8c7afae16f3b0c46bb13173e4794eabdce" Dec 04 11:59:46.273271 master-0 kubenswrapper[35367]: I1204 11:59:46.273234 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/8.log" Dec 04 11:59:46.275505 master-0 kubenswrapper[35367]: I1204 11:59:46.275455 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-cert-syncer/0.log" Dec 04 11:59:47.039018 master-0 kubenswrapper[35367]: I1204 11:59:47.038957 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:59:51.641860 master-0 kubenswrapper[35367]: I1204 11:59:51.641774 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 11:59:53.890429 master-0 kubenswrapper[35367]: I1204 11:59:53.890325 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:53.891399 master-0 kubenswrapper[35367]: I1204 11:59:53.890566 35367 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 11:59:53.909729 master-0 kubenswrapper[35367]: I1204 11:59:53.909630 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z4qvm" Dec 04 11:59:54.641970 master-0 kubenswrapper[35367]: I1204 11:59:54.641882 35367 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 11:59:54.642258 master-0 kubenswrapper[35367]: I1204 11:59:54.642006 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 12:00:04.643297 master-0 kubenswrapper[35367]: I1204 12:00:04.643209 35367 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 12:00:04.643914 master-0 kubenswrapper[35367]: I1204 12:00:04.643304 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 12:00:14.642278 master-0 kubenswrapper[35367]: I1204 12:00:14.642159 35367 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 12:00:14.643005 master-0 kubenswrapper[35367]: I1204 12:00:14.642298 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 12:00:14.643005 master-0 kubenswrapper[35367]: I1204 12:00:14.642375 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:00:14.643359 master-0 kubenswrapper[35367]: I1204 12:00:14.643315 35367 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="cluster-policy-controller" containerStatusID={"Type":"cri-o","ID":"ac50e4f83a70cc9893c52ad9dcf0f66db2c264b4fb0a43c54b3ccd52ad6f996b"} pod="openshift-kube-controller-manager/kube-controller-manager-master-0" containerMessage="Container cluster-policy-controller failed startup probe, will be restarted" Dec 04 12:00:14.643486 master-0 kubenswrapper[35367]: I1204 12:00:14.643427 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" containerID="cri-o://ac50e4f83a70cc9893c52ad9dcf0f66db2c264b4fb0a43c54b3ccd52ad6f996b" gracePeriod=30 Dec 04 12:00:15.467724 master-0 kubenswrapper[35367]: I1204 12:00:15.467655 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/9.log" Dec 04 12:00:15.468151 master-0 kubenswrapper[35367]: I1204 12:00:15.468124 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/8.log" Dec 04 12:00:15.470124 master-0 kubenswrapper[35367]: I1204 12:00:15.470068 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-cert-syncer/0.log" Dec 04 12:00:15.470598 master-0 kubenswrapper[35367]: I1204 12:00:15.470556 35367 generic.go:334] "Generic (PLEG): container finished" podID="e6b437c60bb18680f4492b00b294e872" containerID="ac50e4f83a70cc9893c52ad9dcf0f66db2c264b4fb0a43c54b3ccd52ad6f996b" exitCode=255 Dec 04 12:00:15.470679 master-0 kubenswrapper[35367]: I1204 12:00:15.470614 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerDied","Data":"ac50e4f83a70cc9893c52ad9dcf0f66db2c264b4fb0a43c54b3ccd52ad6f996b"} Dec 04 12:00:15.470679 master-0 kubenswrapper[35367]: I1204 12:00:15.470652 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"5abedda8127280f35abf1b569252c407012100c70e1ed1bccfe85f74974d9ac1"} Dec 04 12:00:15.470679 master-0 kubenswrapper[35367]: I1204 12:00:15.470677 35367 scope.go:117] "RemoveContainer" containerID="75c0b00a72249ad8e40bfad00297d89e0a781c353f7f4ed419a2d838ec6cf264" Dec 04 12:00:16.479999 master-0 kubenswrapper[35367]: I1204 12:00:16.479746 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/9.log" Dec 04 12:00:16.491578 master-0 kubenswrapper[35367]: I1204 12:00:16.481459 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-cert-syncer/0.log" Dec 04 12:00:17.039256 master-0 kubenswrapper[35367]: I1204 12:00:17.039089 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:00:21.642234 master-0 kubenswrapper[35367]: I1204 12:00:21.642139 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:00:24.642623 master-0 kubenswrapper[35367]: I1204 12:00:24.642488 35367 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 12:00:24.643524 master-0 kubenswrapper[35367]: I1204 12:00:24.643052 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Dec 04 12:00:34.642929 master-0 kubenswrapper[35367]: I1204 12:00:34.642790 35367 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 12:00:34.643711 master-0 kubenswrapper[35367]: I1204 12:00:34.642937 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 12:00:44.643174 master-0 kubenswrapper[35367]: I1204 12:00:44.643064 35367 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 12:00:44.643174 master-0 kubenswrapper[35367]: I1204 12:00:44.643151 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 12:00:44.644229 master-0 kubenswrapper[35367]: I1204 12:00:44.643220 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:00:44.644229 master-0 kubenswrapper[35367]: I1204 12:00:44.643828 35367 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="cluster-policy-controller" containerStatusID={"Type":"cri-o","ID":"5abedda8127280f35abf1b569252c407012100c70e1ed1bccfe85f74974d9ac1"} pod="openshift-kube-controller-manager/kube-controller-manager-master-0" containerMessage="Container cluster-policy-controller failed startup probe, will be restarted" Dec 04 12:00:44.644229 master-0 kubenswrapper[35367]: I1204 12:00:44.643926 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" containerID="cri-o://5abedda8127280f35abf1b569252c407012100c70e1ed1bccfe85f74974d9ac1" gracePeriod=30 Dec 04 12:00:44.801016 master-0 kubenswrapper[35367]: E1204 12:00:44.800948 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 12:00:45.696507 master-0 kubenswrapper[35367]: I1204 12:00:45.696455 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/10.log" Dec 04 12:00:45.697618 master-0 kubenswrapper[35367]: I1204 12:00:45.697536 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/9.log" Dec 04 12:00:45.699121 master-0 kubenswrapper[35367]: I1204 12:00:45.699091 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-cert-syncer/0.log" Dec 04 12:00:45.699532 master-0 kubenswrapper[35367]: I1204 12:00:45.699486 35367 generic.go:334] "Generic (PLEG): container finished" podID="e6b437c60bb18680f4492b00b294e872" containerID="5abedda8127280f35abf1b569252c407012100c70e1ed1bccfe85f74974d9ac1" exitCode=255 Dec 04 12:00:45.699585 master-0 kubenswrapper[35367]: I1204 12:00:45.699541 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerDied","Data":"5abedda8127280f35abf1b569252c407012100c70e1ed1bccfe85f74974d9ac1"} Dec 04 12:00:45.699619 master-0 kubenswrapper[35367]: I1204 12:00:45.699585 35367 scope.go:117] "RemoveContainer" containerID="ac50e4f83a70cc9893c52ad9dcf0f66db2c264b4fb0a43c54b3ccd52ad6f996b" Dec 04 12:00:45.700277 master-0 kubenswrapper[35367]: I1204 12:00:45.700253 35367 scope.go:117] "RemoveContainer" containerID="5abedda8127280f35abf1b569252c407012100c70e1ed1bccfe85f74974d9ac1" Dec 04 12:00:45.700555 master-0 kubenswrapper[35367]: E1204 12:00:45.700517 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 12:00:46.708514 master-0 kubenswrapper[35367]: I1204 12:00:46.708188 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/10.log" Dec 04 12:00:46.709835 master-0 kubenswrapper[35367]: I1204 12:00:46.709787 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-cert-syncer/0.log" Dec 04 12:00:50.451254 master-0 kubenswrapper[35367]: I1204 12:00:50.451173 35367 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:00:50.452030 master-0 kubenswrapper[35367]: I1204 12:00:50.451998 35367 scope.go:117] "RemoveContainer" containerID="5abedda8127280f35abf1b569252c407012100c70e1ed1bccfe85f74974d9ac1" Dec 04 12:00:50.452380 master-0 kubenswrapper[35367]: E1204 12:00:50.452343 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 12:00:58.794848 master-0 kubenswrapper[35367]: I1204 12:00:58.794781 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk_e4d7939a-5961-4608-b910-73e71aa55bf6/route-controller-manager/1.log" Dec 04 12:00:58.794848 master-0 kubenswrapper[35367]: I1204 12:00:58.794856 35367 generic.go:334] "Generic (PLEG): container finished" podID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerID="028cb113b8a4d0739d18a17371ebd3e1e120e22b132d20c18e57ba6391cc21d7" exitCode=0 Dec 04 12:00:58.795532 master-0 kubenswrapper[35367]: I1204 12:00:58.794887 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" event={"ID":"e4d7939a-5961-4608-b910-73e71aa55bf6","Type":"ContainerDied","Data":"028cb113b8a4d0739d18a17371ebd3e1e120e22b132d20c18e57ba6391cc21d7"} Dec 04 12:00:58.795532 master-0 kubenswrapper[35367]: I1204 12:00:58.794925 35367 scope.go:117] "RemoveContainer" containerID="b63dc777741930897797e6adb1b664297a0f1967d2d18f8fbd61bd116fd98669" Dec 04 12:00:58.795532 master-0 kubenswrapper[35367]: I1204 12:00:58.795349 35367 scope.go:117] "RemoveContainer" containerID="028cb113b8a4d0739d18a17371ebd3e1e120e22b132d20c18e57ba6391cc21d7" Dec 04 12:00:59.805711 master-0 kubenswrapper[35367]: I1204 12:00:59.805559 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" event={"ID":"e4d7939a-5961-4608-b910-73e71aa55bf6","Type":"ContainerStarted","Data":"388a36eac650c8c09011f149057b67b4396ceec6d06ae7dcaa9fd13f4018f169"} Dec 04 12:00:59.806214 master-0 kubenswrapper[35367]: I1204 12:00:59.806057 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 12:00:59.883696 master-0 kubenswrapper[35367]: I1204 12:00:59.883590 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 12:01:03.747387 master-0 kubenswrapper[35367]: I1204 12:01:03.747300 35367 scope.go:117] "RemoveContainer" containerID="5abedda8127280f35abf1b569252c407012100c70e1ed1bccfe85f74974d9ac1" Dec 04 12:01:03.748096 master-0 kubenswrapper[35367]: E1204 12:01:03.747588 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 12:01:16.751665 master-0 kubenswrapper[35367]: I1204 12:01:16.751615 35367 scope.go:117] "RemoveContainer" containerID="5abedda8127280f35abf1b569252c407012100c70e1ed1bccfe85f74974d9ac1" Dec 04 12:01:16.752336 master-0 kubenswrapper[35367]: E1204 12:01:16.751962 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 40s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 12:01:27.747158 master-0 kubenswrapper[35367]: I1204 12:01:27.747087 35367 scope.go:117] "RemoveContainer" containerID="5abedda8127280f35abf1b569252c407012100c70e1ed1bccfe85f74974d9ac1" Dec 04 12:01:29.000830 master-0 kubenswrapper[35367]: I1204 12:01:29.000769 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/10.log" Dec 04 12:01:29.003002 master-0 kubenswrapper[35367]: I1204 12:01:29.002953 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-cert-syncer/0.log" Dec 04 12:01:29.003987 master-0 kubenswrapper[35367]: I1204 12:01:29.003933 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"f4af8a14216534dca63f05d24b76a32e74c089da1cc06d3e232ed5d109ed4493"} Dec 04 12:01:31.642516 master-0 kubenswrapper[35367]: I1204 12:01:31.642375 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:01:34.643074 master-0 kubenswrapper[35367]: I1204 12:01:34.642970 35367 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 12:01:34.643720 master-0 kubenswrapper[35367]: I1204 12:01:34.643082 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 12:01:37.043569 master-0 kubenswrapper[35367]: I1204 12:01:37.043475 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:01:44.644343 master-0 kubenswrapper[35367]: I1204 12:01:44.643385 35367 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 12:01:44.644343 master-0 kubenswrapper[35367]: I1204 12:01:44.643498 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 12:01:54.643151 master-0 kubenswrapper[35367]: I1204 12:01:54.643056 35367 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 12:01:54.643151 master-0 kubenswrapper[35367]: I1204 12:01:54.643151 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 12:01:54.643911 master-0 kubenswrapper[35367]: I1204 12:01:54.643211 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:01:54.644114 master-0 kubenswrapper[35367]: I1204 12:01:54.643981 35367 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="cluster-policy-controller" containerStatusID={"Type":"cri-o","ID":"f4af8a14216534dca63f05d24b76a32e74c089da1cc06d3e232ed5d109ed4493"} pod="openshift-kube-controller-manager/kube-controller-manager-master-0" containerMessage="Container cluster-policy-controller failed startup probe, will be restarted" Dec 04 12:01:54.644114 master-0 kubenswrapper[35367]: I1204 12:01:54.644088 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" containerID="cri-o://f4af8a14216534dca63f05d24b76a32e74c089da1cc06d3e232ed5d109ed4493" gracePeriod=30 Dec 04 12:01:54.757653 master-0 kubenswrapper[35367]: E1204 12:01:54.757583 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 12:01:55.224447 master-0 kubenswrapper[35367]: I1204 12:01:55.224375 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/11.log" Dec 04 12:01:55.224988 master-0 kubenswrapper[35367]: I1204 12:01:55.224901 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/10.log" Dec 04 12:01:55.226902 master-0 kubenswrapper[35367]: I1204 12:01:55.226860 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-cert-syncer/0.log" Dec 04 12:01:55.227725 master-0 kubenswrapper[35367]: I1204 12:01:55.227664 35367 generic.go:334] "Generic (PLEG): container finished" podID="e6b437c60bb18680f4492b00b294e872" containerID="f4af8a14216534dca63f05d24b76a32e74c089da1cc06d3e232ed5d109ed4493" exitCode=255 Dec 04 12:01:55.227823 master-0 kubenswrapper[35367]: I1204 12:01:55.227729 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerDied","Data":"f4af8a14216534dca63f05d24b76a32e74c089da1cc06d3e232ed5d109ed4493"} Dec 04 12:01:55.227823 master-0 kubenswrapper[35367]: I1204 12:01:55.227776 35367 scope.go:117] "RemoveContainer" containerID="5abedda8127280f35abf1b569252c407012100c70e1ed1bccfe85f74974d9ac1" Dec 04 12:01:55.228562 master-0 kubenswrapper[35367]: I1204 12:01:55.228536 35367 scope.go:117] "RemoveContainer" containerID="f4af8a14216534dca63f05d24b76a32e74c089da1cc06d3e232ed5d109ed4493" Dec 04 12:01:55.228989 master-0 kubenswrapper[35367]: E1204 12:01:55.228948 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 12:01:56.235708 master-0 kubenswrapper[35367]: I1204 12:01:56.235659 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/11.log" Dec 04 12:01:56.237927 master-0 kubenswrapper[35367]: I1204 12:01:56.237880 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-cert-syncer/0.log" Dec 04 12:02:00.451921 master-0 kubenswrapper[35367]: I1204 12:02:00.450868 35367 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:02:00.451921 master-0 kubenswrapper[35367]: I1204 12:02:00.451635 35367 scope.go:117] "RemoveContainer" containerID="f4af8a14216534dca63f05d24b76a32e74c089da1cc06d3e232ed5d109ed4493" Dec 04 12:02:00.451921 master-0 kubenswrapper[35367]: E1204 12:02:00.451877 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 12:02:02.472668 master-0 kubenswrapper[35367]: I1204 12:02:02.472525 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication-operator_authentication-operator-6c968fdfdf-nrrfw_42b3be0f-1d82-4a64-abb4-0118a6960efd/authentication-operator/2.log" Dec 04 12:02:02.674365 master-0 kubenswrapper[35367]: I1204 12:02:02.674285 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication-operator_authentication-operator-6c968fdfdf-nrrfw_42b3be0f-1d82-4a64-abb4-0118a6960efd/authentication-operator/3.log" Dec 04 12:02:03.067860 master-0 kubenswrapper[35367]: I1204 12:02:03.067735 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-oauth-apiserver_apiserver-7467446c4b-dlj7g_cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9/fix-audit-permissions/0.log" Dec 04 12:02:03.272540 master-0 kubenswrapper[35367]: I1204 12:02:03.272489 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-oauth-apiserver_apiserver-7467446c4b-dlj7g_cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9/oauth-apiserver/0.log" Dec 04 12:02:03.473458 master-0 kubenswrapper[35367]: I1204 12:02:03.473192 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns-operator_dns-operator-7c56cf9b74-xz27r_7c017c69-b24e-4a7a-b888-133bed34c174/dns-operator/0.log" Dec 04 12:02:03.668336 master-0 kubenswrapper[35367]: I1204 12:02:03.668269 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns-operator_dns-operator-7c56cf9b74-xz27r_7c017c69-b24e-4a7a-b888-133bed34c174/kube-rbac-proxy/0.log" Dec 04 12:02:03.869987 master-0 kubenswrapper[35367]: I1204 12:02:03.869930 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xg7vh_0c092f5d-bd33-4d91-9206-ce9c0b9e1aae/dns/0.log" Dec 04 12:02:04.066674 master-0 kubenswrapper[35367]: I1204 12:02:04.066607 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xg7vh_0c092f5d-bd33-4d91-9206-ce9c0b9e1aae/kube-rbac-proxy/0.log" Dec 04 12:02:04.267221 master-0 kubenswrapper[35367]: I1204 12:02:04.267102 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qq64m_7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7/dns-node-resolver/0.log" Dec 04 12:02:04.472361 master-0 kubenswrapper[35367]: I1204 12:02:04.472287 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_cluster-image-registry-operator-6fb9f88b7-tgvfl_1ade9186-b262-4b5e-9c6f-ba89f0130fb6/cluster-image-registry-operator/1.log" Dec 04 12:02:04.672287 master-0 kubenswrapper[35367]: I1204 12:02:04.672249 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_cluster-image-registry-operator-6fb9f88b7-tgvfl_1ade9186-b262-4b5e-9c6f-ba89f0130fb6/cluster-image-registry-operator/2.log" Dec 04 12:02:04.873693 master-0 kubenswrapper[35367]: I1204 12:02:04.873642 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/5.log" Dec 04 12:02:05.273095 master-0 kubenswrapper[35367]: I1204 12:02:05.273021 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/6.log" Dec 04 12:02:05.467190 master-0 kubenswrapper[35367]: I1204 12:02:05.467145 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/kube-rbac-proxy/0.log" Dec 04 12:02:05.872532 master-0 kubenswrapper[35367]: I1204 12:02:05.872428 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_installer-2-master-0_38e7be62-e4f5-42ba-89f0-83aca874a092/installer/0.log" Dec 04 12:02:06.070049 master-0 kubenswrapper[35367]: I1204 12:02:06.069985 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_installer-3-master-0_27c4e782-11b4-43a3-9ffd-34bf4e40bbc4/installer/0.log" Dec 04 12:02:06.469225 master-0 kubenswrapper[35367]: I1204 12:02:06.469135 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/11.log" Dec 04 12:02:06.670514 master-0 kubenswrapper[35367]: I1204 12:02:06.670416 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-cert-syncer/0.log" Dec 04 12:02:07.074411 master-0 kubenswrapper[35367]: I1204 12:02:07.074072 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager/0.log" Dec 04 12:02:07.267281 master-0 kubenswrapper[35367]: I1204 12:02:07.267214 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/11.log" Dec 04 12:02:07.470241 master-0 kubenswrapper[35367]: I1204 12:02:07.470061 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-cert-syncer/1.log" Dec 04 12:02:07.671705 master-0 kubenswrapper[35367]: I1204 12:02:07.671639 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-recovery-controller/0.log" Dec 04 12:02:07.873159 master-0 kubenswrapper[35367]: I1204 12:02:07.873089 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager-operator_kube-controller-manager-operator-848f645654-7hmhg_bac00ac5-0371-48fd-b1cc-60438f08ae94/kube-controller-manager-operator/2.log" Dec 04 12:02:08.069129 master-0 kubenswrapper[35367]: I1204 12:02:08.069077 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager-operator_kube-controller-manager-operator-848f645654-7hmhg_bac00ac5-0371-48fd-b1cc-60438f08ae94/kube-controller-manager-operator/3.log" Dec 04 12:02:08.468792 master-0 kubenswrapper[35367]: I1204 12:02:08.468754 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_3169f44496ed8a28c6d6a15511ab0eec/kube-rbac-proxy-crio/2.log" Dec 04 12:02:08.668431 master-0 kubenswrapper[35367]: I1204 12:02:08.668294 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_3169f44496ed8a28c6d6a15511ab0eec/setup/0.log" Dec 04 12:02:08.868618 master-0 kubenswrapper[35367]: I1204 12:02:08.868576 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_3169f44496ed8a28c6d6a15511ab0eec/kube-rbac-proxy-crio/3.log" Dec 04 12:02:09.070541 master-0 kubenswrapper[35367]: I1204 12:02:09.070511 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_machine-config-operator-dc5d7666f-p2cmn_cdb50850-779d-4179-ba1d-65ffeb4bb2e9/machine-config-operator/0.log" Dec 04 12:02:09.470862 master-0 kubenswrapper[35367]: I1204 12:02:09.470742 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_machine-config-operator-dc5d7666f-p2cmn_cdb50850-779d-4179-ba1d-65ffeb4bb2e9/machine-config-operator/1.log" Dec 04 12:02:09.671924 master-0 kubenswrapper[35367]: I1204 12:02:09.671854 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_machine-config-operator-dc5d7666f-p2cmn_cdb50850-779d-4179-ba1d-65ffeb4bb2e9/kube-rbac-proxy/0.log" Dec 04 12:02:09.873974 master-0 kubenswrapper[35367]: I1204 12:02:09.873879 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-7ff994598c-p82nn_2ab26ae5-0607-4dfd-840e-531d204b5030/cluster-monitoring-operator/0.log" Dec 04 12:02:10.270294 master-0 kubenswrapper[35367]: I1204 12:02:10.270180 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-6c8676f99d-7z948_3322cc5a-f1f7-4522-b423-19fb7f38cd43/openshift-controller-manager-operator/3.log" Dec 04 12:02:10.474063 master-0 kubenswrapper[35367]: I1204 12:02:10.473998 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-6c8676f99d-7z948_3322cc5a-f1f7-4522-b423-19fb7f38cd43/openshift-controller-manager-operator/4.log" Dec 04 12:02:10.672437 master-0 kubenswrapper[35367]: I1204 12:02:10.672359 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager_controller-manager-6686654b8d-rrndk_24506aa4-ab78-49df-bb58-59093498f13d/controller-manager/0.log" Dec 04 12:02:10.871100 master-0 kubenswrapper[35367]: I1204 12:02:10.870969 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-controller-manager_controller-manager-6686654b8d-rrndk_24506aa4-ab78-49df-bb58-59093498f13d/controller-manager/1.log" Dec 04 12:02:11.072256 master-0 kubenswrapper[35367]: I1204 12:02:11.072161 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk_e4d7939a-5961-4608-b910-73e71aa55bf6/route-controller-manager/2.log" Dec 04 12:02:11.271913 master-0 kubenswrapper[35367]: I1204 12:02:11.271852 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-route-controller-manager_route-controller-manager-95cb5f987-46bsk_e4d7939a-5961-4608-b910-73e71aa55bf6/route-controller-manager/3.log" Dec 04 12:02:11.475321 master-0 kubenswrapper[35367]: I1204 12:02:11.475091 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-lifecycle-manager_catalog-operator-fbc6455c4-5m8ll_434ed9b9-715b-455b-867c-775b256df40f/catalog-operator/0.log" Dec 04 12:02:11.673225 master-0 kubenswrapper[35367]: I1204 12:02:11.673148 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-lifecycle-manager_olm-operator-7cd7dbb44c-vzj4q_7bf67a51-9759-4e2a-a2ae-ef7416cad43f/olm-operator/0.log" Dec 04 12:02:11.748274 master-0 kubenswrapper[35367]: I1204 12:02:11.748066 35367 scope.go:117] "RemoveContainer" containerID="f4af8a14216534dca63f05d24b76a32e74c089da1cc06d3e232ed5d109ed4493" Dec 04 12:02:11.748591 master-0 kubenswrapper[35367]: E1204 12:02:11.748366 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 12:02:12.106077 master-0 kubenswrapper[35367]: I1204 12:02:12.105973 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-lifecycle-manager_package-server-manager-67477646d4-7hndf_72faf6d6-e8ca-43d1-b93e-67c11f8d3b46/package-server-manager/1.log" Dec 04 12:02:12.267826 master-0 kubenswrapper[35367]: I1204 12:02:12.267690 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-lifecycle-manager_package-server-manager-67477646d4-7hndf_72faf6d6-e8ca-43d1-b93e-67c11f8d3b46/kube-rbac-proxy/0.log" Dec 04 12:02:12.475888 master-0 kubenswrapper[35367]: I1204 12:02:12.475742 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-lifecycle-manager_package-server-manager-67477646d4-7hndf_72faf6d6-e8ca-43d1-b93e-67c11f8d3b46/package-server-manager/2.log" Dec 04 12:02:12.689638 master-0 kubenswrapper[35367]: I1204 12:02:12.688839 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operator-lifecycle-manager_packageserver-675f5c767c-mtdrq_855d7874-16b1-47d0-82f6-d2b0c89b9a84/packageserver/0.log" Dec 04 12:02:25.747965 master-0 kubenswrapper[35367]: I1204 12:02:25.747881 35367 scope.go:117] "RemoveContainer" containerID="f4af8a14216534dca63f05d24b76a32e74c089da1cc06d3e232ed5d109ed4493" Dec 04 12:02:25.748650 master-0 kubenswrapper[35367]: E1204 12:02:25.748129 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 12:02:40.747972 master-0 kubenswrapper[35367]: I1204 12:02:40.747887 35367 scope.go:117] "RemoveContainer" containerID="f4af8a14216534dca63f05d24b76a32e74c089da1cc06d3e232ed5d109ed4493" Dec 04 12:02:40.748739 master-0 kubenswrapper[35367]: E1204 12:02:40.748264 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 12:02:54.747790 master-0 kubenswrapper[35367]: I1204 12:02:54.747709 35367 scope.go:117] "RemoveContainer" containerID="f4af8a14216534dca63f05d24b76a32e74c089da1cc06d3e232ed5d109ed4493" Dec 04 12:02:54.748540 master-0 kubenswrapper[35367]: E1204 12:02:54.748036 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 12:02:59.024192 master-0 kubenswrapper[35367]: I1204 12:02:59.024122 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/installer-3-retry-1-master-0"] Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: E1204 12:02:59.024386 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d75143d9bc4a2dc15781dc51ccff632a" containerName="setup" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024400 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="d75143d9bc4a2dc15781dc51ccff632a" containerName="setup" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: E1204 12:02:59.024409 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="38e7be62-e4f5-42ba-89f0-83aca874a092" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024417 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="38e7be62-e4f5-42ba-89f0-83aca874a092" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: E1204 12:02:59.024430 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a906debd0c35952850935aee2d607cce" containerName="startup-monitor" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024436 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="a906debd0c35952850935aee2d607cce" containerName="startup-monitor" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: E1204 12:02:59.024448 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0a3dbe2b-a659-46c2-93e8-19bd30ee2260" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024454 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a3dbe2b-a659-46c2-93e8-19bd30ee2260" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: E1204 12:02:59.024466 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0fad065c-94c9-4a38-ab76-cf0266bdc04b" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024472 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fad065c-94c9-4a38-ab76-cf0266bdc04b" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: E1204 12:02:59.024483 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerName="registry-server" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024489 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerName="registry-server" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: E1204 12:02:59.024499 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="780ea907-dec5-426e-9de2-158f59c09f71" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024508 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="780ea907-dec5-426e-9de2-158f59c09f71" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: E1204 12:02:59.024518 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerName="extract-utilities" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024524 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerName="extract-utilities" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: E1204 12:02:59.024532 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3e64e99a-b3b9-4db7-aec4-8e61d1370e7e" containerName="assisted-installer-controller" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024538 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e64e99a-b3b9-4db7-aec4-8e61d1370e7e" containerName="assisted-installer-controller" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: E1204 12:02:59.024549 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d75143d9bc4a2dc15781dc51ccff632a" containerName="kube-apiserver" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024555 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="d75143d9bc4a2dc15781dc51ccff632a" containerName="kube-apiserver" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: E1204 12:02:59.024563 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024570 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: E1204 12:02:59.024578 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c6335f99-eb41-4b1d-93df-4a24f0ce23bc" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024583 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6335f99-eb41-4b1d-93df-4a24f0ce23bc" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: E1204 12:02:59.024594 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="27c4e782-11b4-43a3-9ffd-34bf4e40bbc4" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024601 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="27c4e782-11b4-43a3-9ffd-34bf4e40bbc4" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: E1204 12:02:59.024609 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024614 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: E1204 12:02:59.024624 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerName="extract-content" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024630 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerName="extract-content" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: E1204 12:02:59.024639 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d75143d9bc4a2dc15781dc51ccff632a" containerName="kube-apiserver-insecure-readyz" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024645 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="d75143d9bc4a2dc15781dc51ccff632a" containerName="kube-apiserver-insecure-readyz" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024744 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="0fad065c-94c9-4a38-ab76-cf0266bdc04b" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024764 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="27c4e782-11b4-43a3-9ffd-34bf4e40bbc4" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024778 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="a906debd0c35952850935aee2d607cce" containerName="startup-monitor" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024787 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="4a004d1b-1f30-42c1-9ee3-0e4cbc3c4491" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024797 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="780ea907-dec5-426e-9de2-158f59c09f71" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024823 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="0a3dbe2b-a659-46c2-93e8-19bd30ee2260" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024832 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerName="extract-utilities" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024840 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="38e7be62-e4f5-42ba-89f0-83aca874a092" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024855 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024874 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="c6335f99-eb41-4b1d-93df-4a24f0ce23bc" containerName="installer" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024888 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="d75143d9bc4a2dc15781dc51ccff632a" containerName="kube-apiserver" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024898 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="d75143d9bc4a2dc15781dc51ccff632a" containerName="setup" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024910 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerName="registry-server" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024920 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="d75143d9bc4a2dc15781dc51ccff632a" containerName="kube-apiserver-insecure-readyz" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024929 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="677a41b8-0c6a-4c96-ac98-65bc54985bb7" containerName="extract-content" Dec 04 12:02:59.025045 master-0 kubenswrapper[35367]: I1204 12:02:59.024940 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="3e64e99a-b3b9-4db7-aec4-8e61d1370e7e" containerName="assisted-installer-controller" Dec 04 12:02:59.027042 master-0 kubenswrapper[35367]: I1204 12:02:59.026032 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-3-retry-1-master-0" Dec 04 12:02:59.028942 master-0 kubenswrapper[35367]: I1204 12:02:59.028681 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager"/"installer-sa-dockercfg-vn92f" Dec 04 12:02:59.028942 master-0 kubenswrapper[35367]: I1204 12:02:59.028892 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager"/"kube-root-ca.crt" Dec 04 12:02:59.042682 master-0 kubenswrapper[35367]: I1204 12:02:59.042624 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-3-retry-1-master-0"] Dec 04 12:02:59.107680 master-0 kubenswrapper[35367]: I1204 12:02:59.107606 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/36c6746c-03b9-4909-a4c4-a29260027ec6-kube-api-access\") pod \"installer-3-retry-1-master-0\" (UID: \"36c6746c-03b9-4909-a4c4-a29260027ec6\") " pod="openshift-kube-controller-manager/installer-3-retry-1-master-0" Dec 04 12:02:59.107680 master-0 kubenswrapper[35367]: I1204 12:02:59.107678 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/36c6746c-03b9-4909-a4c4-a29260027ec6-var-lock\") pod \"installer-3-retry-1-master-0\" (UID: \"36c6746c-03b9-4909-a4c4-a29260027ec6\") " pod="openshift-kube-controller-manager/installer-3-retry-1-master-0" Dec 04 12:02:59.107989 master-0 kubenswrapper[35367]: I1204 12:02:59.107703 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/36c6746c-03b9-4909-a4c4-a29260027ec6-kubelet-dir\") pod \"installer-3-retry-1-master-0\" (UID: \"36c6746c-03b9-4909-a4c4-a29260027ec6\") " pod="openshift-kube-controller-manager/installer-3-retry-1-master-0" Dec 04 12:02:59.209334 master-0 kubenswrapper[35367]: I1204 12:02:59.209123 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/36c6746c-03b9-4909-a4c4-a29260027ec6-var-lock\") pod \"installer-3-retry-1-master-0\" (UID: \"36c6746c-03b9-4909-a4c4-a29260027ec6\") " pod="openshift-kube-controller-manager/installer-3-retry-1-master-0" Dec 04 12:02:59.209334 master-0 kubenswrapper[35367]: I1204 12:02:59.209207 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/36c6746c-03b9-4909-a4c4-a29260027ec6-kubelet-dir\") pod \"installer-3-retry-1-master-0\" (UID: \"36c6746c-03b9-4909-a4c4-a29260027ec6\") " pod="openshift-kube-controller-manager/installer-3-retry-1-master-0" Dec 04 12:02:59.209334 master-0 kubenswrapper[35367]: I1204 12:02:59.209354 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/36c6746c-03b9-4909-a4c4-a29260027ec6-kubelet-dir\") pod \"installer-3-retry-1-master-0\" (UID: \"36c6746c-03b9-4909-a4c4-a29260027ec6\") " pod="openshift-kube-controller-manager/installer-3-retry-1-master-0" Dec 04 12:02:59.209674 master-0 kubenswrapper[35367]: I1204 12:02:59.209423 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/36c6746c-03b9-4909-a4c4-a29260027ec6-var-lock\") pod \"installer-3-retry-1-master-0\" (UID: \"36c6746c-03b9-4909-a4c4-a29260027ec6\") " pod="openshift-kube-controller-manager/installer-3-retry-1-master-0" Dec 04 12:02:59.209674 master-0 kubenswrapper[35367]: I1204 12:02:59.209478 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/36c6746c-03b9-4909-a4c4-a29260027ec6-kube-api-access\") pod \"installer-3-retry-1-master-0\" (UID: \"36c6746c-03b9-4909-a4c4-a29260027ec6\") " pod="openshift-kube-controller-manager/installer-3-retry-1-master-0" Dec 04 12:02:59.226386 master-0 kubenswrapper[35367]: I1204 12:02:59.226292 35367 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Dec 04 12:02:59.230174 master-0 kubenswrapper[35367]: I1204 12:02:59.230080 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/36c6746c-03b9-4909-a4c4-a29260027ec6-kube-api-access\") pod \"installer-3-retry-1-master-0\" (UID: \"36c6746c-03b9-4909-a4c4-a29260027ec6\") " pod="openshift-kube-controller-manager/installer-3-retry-1-master-0" Dec 04 12:02:59.350065 master-0 kubenswrapper[35367]: I1204 12:02:59.349689 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-3-retry-1-master-0" Dec 04 12:02:59.786546 master-0 kubenswrapper[35367]: I1204 12:02:59.786234 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-3-retry-1-master-0"] Dec 04 12:02:59.795411 master-0 kubenswrapper[35367]: W1204 12:02:59.795343 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod36c6746c_03b9_4909_a4c4_a29260027ec6.slice/crio-56a4ce00aa6f59348985f86f7b239e71b935b433f5c9d84ac2f4f94370dc477f WatchSource:0}: Error finding container 56a4ce00aa6f59348985f86f7b239e71b935b433f5c9d84ac2f4f94370dc477f: Status 404 returned error can't find the container with id 56a4ce00aa6f59348985f86f7b239e71b935b433f5c9d84ac2f4f94370dc477f Dec 04 12:03:00.683603 master-0 kubenswrapper[35367]: I1204 12:03:00.683519 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-3-retry-1-master-0" event={"ID":"36c6746c-03b9-4909-a4c4-a29260027ec6","Type":"ContainerStarted","Data":"eb19653d2e121680755e46da98832eed7e003b36b3e25ca530529fcbf7806494"} Dec 04 12:03:00.683603 master-0 kubenswrapper[35367]: I1204 12:03:00.683588 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-3-retry-1-master-0" event={"ID":"36c6746c-03b9-4909-a4c4-a29260027ec6","Type":"ContainerStarted","Data":"56a4ce00aa6f59348985f86f7b239e71b935b433f5c9d84ac2f4f94370dc477f"} Dec 04 12:03:00.784441 master-0 kubenswrapper[35367]: I1204 12:03:00.784288 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/installer-3-retry-1-master-0" podStartSLOduration=1.784255659 podStartE2EDuration="1.784255659s" podCreationTimestamp="2025-12-04 12:02:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:03:00.783630319 +0000 UTC m=+224.221691577" watchObservedRunningTime="2025-12-04 12:03:00.784255659 +0000 UTC m=+224.222316917" Dec 04 12:03:06.753169 master-0 kubenswrapper[35367]: I1204 12:03:06.753062 35367 scope.go:117] "RemoveContainer" containerID="f4af8a14216534dca63f05d24b76a32e74c089da1cc06d3e232ed5d109ed4493" Dec 04 12:03:06.754033 master-0 kubenswrapper[35367]: E1204 12:03:06.753539 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-policy-controller\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=cluster-policy-controller pod=kube-controller-manager-master-0_openshift-kube-controller-manager(e6b437c60bb18680f4492b00b294e872)\"" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" Dec 04 12:03:10.461014 master-0 kubenswrapper[35367]: I1204 12:03:10.460920 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/installer-4-master-0"] Dec 04 12:03:10.462099 master-0 kubenswrapper[35367]: I1204 12:03:10.462052 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 12:03:10.465400 master-0 kubenswrapper[35367]: I1204 12:03:10.465323 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver"/"installer-sa-dockercfg-79r7d" Dec 04 12:03:10.465850 master-0 kubenswrapper[35367]: I1204 12:03:10.465705 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver"/"kube-root-ca.crt" Dec 04 12:03:10.493377 master-0 kubenswrapper[35367]: I1204 12:03:10.493265 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-4-master-0"] Dec 04 12:03:10.569579 master-0 kubenswrapper[35367]: I1204 12:03:10.569487 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a58ec846-7add-4bef-8382-556bb578824d-kubelet-dir\") pod \"installer-4-master-0\" (UID: \"a58ec846-7add-4bef-8382-556bb578824d\") " pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 12:03:10.569579 master-0 kubenswrapper[35367]: I1204 12:03:10.569583 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a58ec846-7add-4bef-8382-556bb578824d-var-lock\") pod \"installer-4-master-0\" (UID: \"a58ec846-7add-4bef-8382-556bb578824d\") " pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 12:03:10.569579 master-0 kubenswrapper[35367]: I1204 12:03:10.569601 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a58ec846-7add-4bef-8382-556bb578824d-kube-api-access\") pod \"installer-4-master-0\" (UID: \"a58ec846-7add-4bef-8382-556bb578824d\") " pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 12:03:10.671835 master-0 kubenswrapper[35367]: I1204 12:03:10.671549 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a58ec846-7add-4bef-8382-556bb578824d-kubelet-dir\") pod \"installer-4-master-0\" (UID: \"a58ec846-7add-4bef-8382-556bb578824d\") " pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 12:03:10.671835 master-0 kubenswrapper[35367]: I1204 12:03:10.671631 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a58ec846-7add-4bef-8382-556bb578824d-var-lock\") pod \"installer-4-master-0\" (UID: \"a58ec846-7add-4bef-8382-556bb578824d\") " pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 12:03:10.671835 master-0 kubenswrapper[35367]: I1204 12:03:10.671654 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a58ec846-7add-4bef-8382-556bb578824d-kube-api-access\") pod \"installer-4-master-0\" (UID: \"a58ec846-7add-4bef-8382-556bb578824d\") " pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 12:03:10.672206 master-0 kubenswrapper[35367]: I1204 12:03:10.671849 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a58ec846-7add-4bef-8382-556bb578824d-var-lock\") pod \"installer-4-master-0\" (UID: \"a58ec846-7add-4bef-8382-556bb578824d\") " pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 12:03:10.672253 master-0 kubenswrapper[35367]: I1204 12:03:10.672168 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a58ec846-7add-4bef-8382-556bb578824d-kubelet-dir\") pod \"installer-4-master-0\" (UID: \"a58ec846-7add-4bef-8382-556bb578824d\") " pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 12:03:10.691728 master-0 kubenswrapper[35367]: I1204 12:03:10.691666 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a58ec846-7add-4bef-8382-556bb578824d-kube-api-access\") pod \"installer-4-master-0\" (UID: \"a58ec846-7add-4bef-8382-556bb578824d\") " pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 12:03:10.797480 master-0 kubenswrapper[35367]: I1204 12:03:10.797318 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 12:03:11.290501 master-0 kubenswrapper[35367]: I1204 12:03:11.290421 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-4-master-0"] Dec 04 12:03:11.298757 master-0 kubenswrapper[35367]: W1204 12:03:11.298677 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda58ec846_7add_4bef_8382_556bb578824d.slice/crio-32efa323e04316a3b7f28c1bbfcf874ac04dbe75aa84489de0fcbb85dbf621c5 WatchSource:0}: Error finding container 32efa323e04316a3b7f28c1bbfcf874ac04dbe75aa84489de0fcbb85dbf621c5: Status 404 returned error can't find the container with id 32efa323e04316a3b7f28c1bbfcf874ac04dbe75aa84489de0fcbb85dbf621c5 Dec 04 12:03:11.770557 master-0 kubenswrapper[35367]: I1204 12:03:11.770452 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-4-master-0" event={"ID":"a58ec846-7add-4bef-8382-556bb578824d","Type":"ContainerStarted","Data":"58b8d649f9c312a3fca75aef22916b7cdf46f90609213000bc0e75208f4e917c"} Dec 04 12:03:11.770557 master-0 kubenswrapper[35367]: I1204 12:03:11.770528 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-4-master-0" event={"ID":"a58ec846-7add-4bef-8382-556bb578824d","Type":"ContainerStarted","Data":"32efa323e04316a3b7f28c1bbfcf874ac04dbe75aa84489de0fcbb85dbf621c5"} Dec 04 12:03:11.797432 master-0 kubenswrapper[35367]: I1204 12:03:11.796710 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/installer-4-master-0" podStartSLOduration=1.796692789 podStartE2EDuration="1.796692789s" podCreationTimestamp="2025-12-04 12:03:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:03:11.796240685 +0000 UTC m=+235.234301963" watchObservedRunningTime="2025-12-04 12:03:11.796692789 +0000 UTC m=+235.234754047" Dec 04 12:03:19.748631 master-0 kubenswrapper[35367]: I1204 12:03:19.748554 35367 scope.go:117] "RemoveContainer" containerID="f4af8a14216534dca63f05d24b76a32e74c089da1cc06d3e232ed5d109ed4493" Dec 04 12:03:20.846941 master-0 kubenswrapper[35367]: I1204 12:03:20.846855 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/11.log" Dec 04 12:03:20.848837 master-0 kubenswrapper[35367]: I1204 12:03:20.848759 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-cert-syncer/0.log" Dec 04 12:03:20.849897 master-0 kubenswrapper[35367]: I1204 12:03:20.849712 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"e6b437c60bb18680f4492b00b294e872","Type":"ContainerStarted","Data":"554bccaedbf62f7d14d08c9beb5956972b9a7502f898d20afac03c599c432afe"} Dec 04 12:03:21.642558 master-0 kubenswrapper[35367]: I1204 12:03:21.642463 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:03:24.643346 master-0 kubenswrapper[35367]: I1204 12:03:24.643221 35367 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 12:03:24.643346 master-0 kubenswrapper[35367]: I1204 12:03:24.643335 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 12:03:27.039948 master-0 kubenswrapper[35367]: I1204 12:03:27.039868 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:03:32.907902 master-0 kubenswrapper[35367]: I1204 12:03:32.907856 35367 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 12:03:32.908771 master-0 kubenswrapper[35367]: I1204 12:03:32.908737 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="kube-controller-manager" containerID="cri-o://f78a7d287972772a3c979bede114291f869074b909122bce68dcbdb34f2d707c" gracePeriod=30 Dec 04 12:03:32.908979 master-0 kubenswrapper[35367]: I1204 12:03:32.908791 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="kube-controller-manager-cert-syncer" containerID="cri-o://c7daeda85ec183c8d113e00834a6cc8eb19542aa3278f40e44cf98acd7483141" gracePeriod=30 Dec 04 12:03:32.909036 master-0 kubenswrapper[35367]: I1204 12:03:32.908834 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="kube-controller-manager-recovery-controller" containerID="cri-o://a4300d8490d9cbb0f00793e382d3ed2318a1bd59a39a4b37b7e8bc4be83371b7" gracePeriod=30 Dec 04 12:03:32.909069 master-0 kubenswrapper[35367]: I1204 12:03:32.908883 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" containerID="cri-o://554bccaedbf62f7d14d08c9beb5956972b9a7502f898d20afac03c599c432afe" gracePeriod=30 Dec 04 12:03:32.911232 master-0 kubenswrapper[35367]: E1204 12:03:32.911105 35367 file.go:109] "Unable to process watch event" err="can't process config file \"/etc/kubernetes/manifests/kube-controller-manager-pod.yaml\": /etc/kubernetes/manifests/kube-controller-manager-pod.yaml: couldn't parse as pod(Object 'Kind' is missing in 'null'), please check config file" Dec 04 12:03:32.914175 master-0 kubenswrapper[35367]: I1204 12:03:32.914085 35367 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 12:03:32.916257 master-0 kubenswrapper[35367]: E1204 12:03:32.916207 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e6b437c60bb18680f4492b00b294e872" containerName="kube-controller-manager-cert-syncer" Dec 04 12:03:32.916340 master-0 kubenswrapper[35367]: I1204 12:03:32.916263 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6b437c60bb18680f4492b00b294e872" containerName="kube-controller-manager-cert-syncer" Dec 04 12:03:32.916340 master-0 kubenswrapper[35367]: E1204 12:03:32.916296 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" Dec 04 12:03:32.916340 master-0 kubenswrapper[35367]: I1204 12:03:32.916305 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" Dec 04 12:03:32.916340 master-0 kubenswrapper[35367]: E1204 12:03:32.916318 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e6b437c60bb18680f4492b00b294e872" containerName="kube-controller-manager" Dec 04 12:03:32.916340 master-0 kubenswrapper[35367]: I1204 12:03:32.916328 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6b437c60bb18680f4492b00b294e872" containerName="kube-controller-manager" Dec 04 12:03:32.916486 master-0 kubenswrapper[35367]: E1204 12:03:32.916347 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" Dec 04 12:03:32.916486 master-0 kubenswrapper[35367]: I1204 12:03:32.916356 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" Dec 04 12:03:32.916486 master-0 kubenswrapper[35367]: E1204 12:03:32.916366 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" Dec 04 12:03:32.916486 master-0 kubenswrapper[35367]: I1204 12:03:32.916374 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" Dec 04 12:03:32.916486 master-0 kubenswrapper[35367]: E1204 12:03:32.916388 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e6b437c60bb18680f4492b00b294e872" containerName="kube-controller-manager-cert-syncer" Dec 04 12:03:32.916486 master-0 kubenswrapper[35367]: I1204 12:03:32.916396 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6b437c60bb18680f4492b00b294e872" containerName="kube-controller-manager-cert-syncer" Dec 04 12:03:32.916486 master-0 kubenswrapper[35367]: E1204 12:03:32.916407 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" Dec 04 12:03:32.916486 master-0 kubenswrapper[35367]: I1204 12:03:32.916417 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" Dec 04 12:03:32.916486 master-0 kubenswrapper[35367]: E1204 12:03:32.916432 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e6b437c60bb18680f4492b00b294e872" containerName="kube-controller-manager-recovery-controller" Dec 04 12:03:32.916486 master-0 kubenswrapper[35367]: I1204 12:03:32.916439 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6b437c60bb18680f4492b00b294e872" containerName="kube-controller-manager-recovery-controller" Dec 04 12:03:32.916757 master-0 kubenswrapper[35367]: I1204 12:03:32.916568 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" Dec 04 12:03:32.916757 master-0 kubenswrapper[35367]: I1204 12:03:32.916582 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" Dec 04 12:03:32.916757 master-0 kubenswrapper[35367]: I1204 12:03:32.916593 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" Dec 04 12:03:32.916757 master-0 kubenswrapper[35367]: I1204 12:03:32.916610 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="e6b437c60bb18680f4492b00b294e872" containerName="kube-controller-manager" Dec 04 12:03:32.916757 master-0 kubenswrapper[35367]: I1204 12:03:32.916626 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="e6b437c60bb18680f4492b00b294e872" containerName="kube-controller-manager-recovery-controller" Dec 04 12:03:32.916757 master-0 kubenswrapper[35367]: I1204 12:03:32.916654 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="e6b437c60bb18680f4492b00b294e872" containerName="kube-controller-manager-cert-syncer" Dec 04 12:03:32.916757 master-0 kubenswrapper[35367]: I1204 12:03:32.916664 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="e6b437c60bb18680f4492b00b294e872" containerName="kube-controller-manager-cert-syncer" Dec 04 12:03:32.916993 master-0 kubenswrapper[35367]: E1204 12:03:32.916833 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" Dec 04 12:03:32.916993 master-0 kubenswrapper[35367]: I1204 12:03:32.916846 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" Dec 04 12:03:32.916993 master-0 kubenswrapper[35367]: E1204 12:03:32.916860 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" Dec 04 12:03:32.916993 master-0 kubenswrapper[35367]: I1204 12:03:32.916869 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" Dec 04 12:03:32.917137 master-0 kubenswrapper[35367]: I1204 12:03:32.917115 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" Dec 04 12:03:32.917188 master-0 kubenswrapper[35367]: I1204 12:03:32.917137 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" Dec 04 12:03:32.917188 master-0 kubenswrapper[35367]: I1204 12:03:32.917155 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" Dec 04 12:03:32.922888 master-0 kubenswrapper[35367]: I1204 12:03:32.922604 35367 patch_prober.go:28] interesting pod/kube-controller-manager-master-0 container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": read tcp 127.0.0.1:54058->127.0.0.1:10357: read: connection reset by peer" start-of-body= Dec 04 12:03:32.922888 master-0 kubenswrapper[35367]: I1204 12:03:32.922702 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="e6b437c60bb18680f4492b00b294e872" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": read tcp 127.0.0.1:54058->127.0.0.1:10357: read: connection reset by peer" Dec 04 12:03:32.987318 master-0 kubenswrapper[35367]: I1204 12:03:32.987217 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/095bb4823c284d8bb15baa1a87c3e43c-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"095bb4823c284d8bb15baa1a87c3e43c\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:03:32.987859 master-0 kubenswrapper[35367]: I1204 12:03:32.987751 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/095bb4823c284d8bb15baa1a87c3e43c-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"095bb4823c284d8bb15baa1a87c3e43c\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:03:33.089926 master-0 kubenswrapper[35367]: I1204 12:03:33.089825 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/095bb4823c284d8bb15baa1a87c3e43c-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"095bb4823c284d8bb15baa1a87c3e43c\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:03:33.090415 master-0 kubenswrapper[35367]: I1204 12:03:33.090393 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/095bb4823c284d8bb15baa1a87c3e43c-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"095bb4823c284d8bb15baa1a87c3e43c\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:03:33.090556 master-0 kubenswrapper[35367]: I1204 12:03:33.090497 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/095bb4823c284d8bb15baa1a87c3e43c-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"095bb4823c284d8bb15baa1a87c3e43c\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:03:33.090653 master-0 kubenswrapper[35367]: I1204 12:03:33.090045 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/095bb4823c284d8bb15baa1a87c3e43c-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"095bb4823c284d8bb15baa1a87c3e43c\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:03:33.181869 master-0 kubenswrapper[35367]: I1204 12:03:33.181797 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/12.log" Dec 04 12:03:33.183129 master-0 kubenswrapper[35367]: I1204 12:03:33.183082 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/11.log" Dec 04 12:03:33.184165 master-0 kubenswrapper[35367]: I1204 12:03:33.184132 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-cert-syncer/1.log" Dec 04 12:03:33.186195 master-0 kubenswrapper[35367]: I1204 12:03:33.186107 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-cert-syncer/0.log" Dec 04 12:03:33.186718 master-0 kubenswrapper[35367]: I1204 12:03:33.186688 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:03:33.204936 master-0 kubenswrapper[35367]: I1204 12:03:33.204788 35367 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" oldPodUID="e6b437c60bb18680f4492b00b294e872" podUID="095bb4823c284d8bb15baa1a87c3e43c" Dec 04 12:03:33.292783 master-0 kubenswrapper[35367]: I1204 12:03:33.292682 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/e6b437c60bb18680f4492b00b294e872-cert-dir\") pod \"e6b437c60bb18680f4492b00b294e872\" (UID: \"e6b437c60bb18680f4492b00b294e872\") " Dec 04 12:03:33.292783 master-0 kubenswrapper[35367]: I1204 12:03:33.292771 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/e6b437c60bb18680f4492b00b294e872-resource-dir\") pod \"e6b437c60bb18680f4492b00b294e872\" (UID: \"e6b437c60bb18680f4492b00b294e872\") " Dec 04 12:03:33.293154 master-0 kubenswrapper[35367]: I1204 12:03:33.292851 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e6b437c60bb18680f4492b00b294e872-cert-dir" (OuterVolumeSpecName: "cert-dir") pod "e6b437c60bb18680f4492b00b294e872" (UID: "e6b437c60bb18680f4492b00b294e872"). InnerVolumeSpecName "cert-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:03:33.293154 master-0 kubenswrapper[35367]: I1204 12:03:33.292920 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e6b437c60bb18680f4492b00b294e872-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "e6b437c60bb18680f4492b00b294e872" (UID: "e6b437c60bb18680f4492b00b294e872"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:03:33.293324 master-0 kubenswrapper[35367]: I1204 12:03:33.293250 35367 reconciler_common.go:293] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/e6b437c60bb18680f4492b00b294e872-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:03:33.293324 master-0 kubenswrapper[35367]: I1204 12:03:33.293267 35367 reconciler_common.go:293] "Volume detached for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/e6b437c60bb18680f4492b00b294e872-cert-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:03:33.934483 master-0 kubenswrapper[35367]: I1204 12:03:33.934436 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/12.log" Dec 04 12:03:33.935399 master-0 kubenswrapper[35367]: I1204 12:03:33.935381 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/11.log" Dec 04 12:03:33.936121 master-0 kubenswrapper[35367]: I1204 12:03:33.936077 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-cert-syncer/1.log" Dec 04 12:03:33.937315 master-0 kubenswrapper[35367]: I1204 12:03:33.937278 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-cert-syncer/0.log" Dec 04 12:03:33.937870 master-0 kubenswrapper[35367]: I1204 12:03:33.937841 35367 generic.go:334] "Generic (PLEG): container finished" podID="e6b437c60bb18680f4492b00b294e872" containerID="554bccaedbf62f7d14d08c9beb5956972b9a7502f898d20afac03c599c432afe" exitCode=255 Dec 04 12:03:33.937870 master-0 kubenswrapper[35367]: I1204 12:03:33.937868 35367 generic.go:334] "Generic (PLEG): container finished" podID="e6b437c60bb18680f4492b00b294e872" containerID="c7daeda85ec183c8d113e00834a6cc8eb19542aa3278f40e44cf98acd7483141" exitCode=2 Dec 04 12:03:33.937950 master-0 kubenswrapper[35367]: I1204 12:03:33.937879 35367 generic.go:334] "Generic (PLEG): container finished" podID="e6b437c60bb18680f4492b00b294e872" containerID="a4300d8490d9cbb0f00793e382d3ed2318a1bd59a39a4b37b7e8bc4be83371b7" exitCode=0 Dec 04 12:03:33.937950 master-0 kubenswrapper[35367]: I1204 12:03:33.937889 35367 generic.go:334] "Generic (PLEG): container finished" podID="e6b437c60bb18680f4492b00b294e872" containerID="f78a7d287972772a3c979bede114291f869074b909122bce68dcbdb34f2d707c" exitCode=0 Dec 04 12:03:33.938020 master-0 kubenswrapper[35367]: I1204 12:03:33.937973 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2e0a5f7188ebd1ad7d4edbad094215c2f60dd9e9a0830dce848050e834e809c" Dec 04 12:03:33.938020 master-0 kubenswrapper[35367]: I1204 12:03:33.937993 35367 scope.go:117] "RemoveContainer" containerID="f4af8a14216534dca63f05d24b76a32e74c089da1cc06d3e232ed5d109ed4493" Dec 04 12:03:33.938075 master-0 kubenswrapper[35367]: I1204 12:03:33.938010 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:03:33.940636 master-0 kubenswrapper[35367]: I1204 12:03:33.940592 35367 generic.go:334] "Generic (PLEG): container finished" podID="36c6746c-03b9-4909-a4c4-a29260027ec6" containerID="eb19653d2e121680755e46da98832eed7e003b36b3e25ca530529fcbf7806494" exitCode=0 Dec 04 12:03:33.940733 master-0 kubenswrapper[35367]: I1204 12:03:33.940679 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-3-retry-1-master-0" event={"ID":"36c6746c-03b9-4909-a4c4-a29260027ec6","Type":"ContainerDied","Data":"eb19653d2e121680755e46da98832eed7e003b36b3e25ca530529fcbf7806494"} Dec 04 12:03:33.942997 master-0 kubenswrapper[35367]: I1204 12:03:33.942953 35367 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" oldPodUID="e6b437c60bb18680f4492b00b294e872" podUID="095bb4823c284d8bb15baa1a87c3e43c" Dec 04 12:03:33.958829 master-0 kubenswrapper[35367]: I1204 12:03:33.958778 35367 scope.go:117] "RemoveContainer" containerID="11e29c5651a5425702af55ec3b8ee473df3972ab82e099ae3490c6b27969c94a" Dec 04 12:03:34.048835 master-0 kubenswrapper[35367]: I1204 12:03:34.043001 35367 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" oldPodUID="e6b437c60bb18680f4492b00b294e872" podUID="095bb4823c284d8bb15baa1a87c3e43c" Dec 04 12:03:34.756225 master-0 kubenswrapper[35367]: I1204 12:03:34.756144 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6b437c60bb18680f4492b00b294e872" path="/var/lib/kubelet/pods/e6b437c60bb18680f4492b00b294e872/volumes" Dec 04 12:03:34.949681 master-0 kubenswrapper[35367]: I1204 12:03:34.949405 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/cluster-policy-controller/12.log" Dec 04 12:03:34.951188 master-0 kubenswrapper[35367]: I1204 12:03:34.951136 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_e6b437c60bb18680f4492b00b294e872/kube-controller-manager-cert-syncer/1.log" Dec 04 12:03:35.252351 master-0 kubenswrapper[35367]: I1204 12:03:35.252262 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-3-retry-1-master-0" Dec 04 12:03:35.324403 master-0 kubenswrapper[35367]: I1204 12:03:35.324313 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/36c6746c-03b9-4909-a4c4-a29260027ec6-kube-api-access\") pod \"36c6746c-03b9-4909-a4c4-a29260027ec6\" (UID: \"36c6746c-03b9-4909-a4c4-a29260027ec6\") " Dec 04 12:03:35.324790 master-0 kubenswrapper[35367]: I1204 12:03:35.324455 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/36c6746c-03b9-4909-a4c4-a29260027ec6-kubelet-dir\") pod \"36c6746c-03b9-4909-a4c4-a29260027ec6\" (UID: \"36c6746c-03b9-4909-a4c4-a29260027ec6\") " Dec 04 12:03:35.324790 master-0 kubenswrapper[35367]: I1204 12:03:35.324595 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/36c6746c-03b9-4909-a4c4-a29260027ec6-var-lock\") pod \"36c6746c-03b9-4909-a4c4-a29260027ec6\" (UID: \"36c6746c-03b9-4909-a4c4-a29260027ec6\") " Dec 04 12:03:35.324790 master-0 kubenswrapper[35367]: I1204 12:03:35.324672 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/36c6746c-03b9-4909-a4c4-a29260027ec6-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "36c6746c-03b9-4909-a4c4-a29260027ec6" (UID: "36c6746c-03b9-4909-a4c4-a29260027ec6"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:03:35.324975 master-0 kubenswrapper[35367]: I1204 12:03:35.324755 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/36c6746c-03b9-4909-a4c4-a29260027ec6-var-lock" (OuterVolumeSpecName: "var-lock") pod "36c6746c-03b9-4909-a4c4-a29260027ec6" (UID: "36c6746c-03b9-4909-a4c4-a29260027ec6"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:03:35.324975 master-0 kubenswrapper[35367]: I1204 12:03:35.324951 35367 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/36c6746c-03b9-4909-a4c4-a29260027ec6-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:03:35.324975 master-0 kubenswrapper[35367]: I1204 12:03:35.324978 35367 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/36c6746c-03b9-4909-a4c4-a29260027ec6-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 12:03:35.335193 master-0 kubenswrapper[35367]: I1204 12:03:35.335063 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36c6746c-03b9-4909-a4c4-a29260027ec6-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "36c6746c-03b9-4909-a4c4-a29260027ec6" (UID: "36c6746c-03b9-4909-a4c4-a29260027ec6"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:03:35.426890 master-0 kubenswrapper[35367]: I1204 12:03:35.426726 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/36c6746c-03b9-4909-a4c4-a29260027ec6-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 12:03:35.963295 master-0 kubenswrapper[35367]: I1204 12:03:35.963206 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-3-retry-1-master-0" event={"ID":"36c6746c-03b9-4909-a4c4-a29260027ec6","Type":"ContainerDied","Data":"56a4ce00aa6f59348985f86f7b239e71b935b433f5c9d84ac2f4f94370dc477f"} Dec 04 12:03:35.963295 master-0 kubenswrapper[35367]: I1204 12:03:35.963260 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56a4ce00aa6f59348985f86f7b239e71b935b433f5c9d84ac2f4f94370dc477f" Dec 04 12:03:35.963917 master-0 kubenswrapper[35367]: I1204 12:03:35.963331 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-3-retry-1-master-0" Dec 04 12:03:44.747226 master-0 kubenswrapper[35367]: I1204 12:03:44.747158 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:03:44.775411 master-0 kubenswrapper[35367]: I1204 12:03:44.775334 35367 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="8ba27afc-bec9-4bfc-b4a6-197a0564e7ba" Dec 04 12:03:44.775411 master-0 kubenswrapper[35367]: I1204 12:03:44.775400 35367 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="8ba27afc-bec9-4bfc-b4a6-197a0564e7ba" Dec 04 12:03:44.961573 master-0 kubenswrapper[35367]: I1204 12:03:44.961504 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 12:03:45.025079 master-0 kubenswrapper[35367]: I1204 12:03:45.024958 35367 generic.go:334] "Generic (PLEG): container finished" podID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerID="388a36eac650c8c09011f149057b67b4396ceec6d06ae7dcaa9fd13f4018f169" exitCode=0 Dec 04 12:03:45.025332 master-0 kubenswrapper[35367]: I1204 12:03:45.025052 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" event={"ID":"e4d7939a-5961-4608-b910-73e71aa55bf6","Type":"ContainerDied","Data":"388a36eac650c8c09011f149057b67b4396ceec6d06ae7dcaa9fd13f4018f169"} Dec 04 12:03:45.025445 master-0 kubenswrapper[35367]: I1204 12:03:45.025425 35367 scope.go:117] "RemoveContainer" containerID="028cb113b8a4d0739d18a17371ebd3e1e120e22b132d20c18e57ba6391cc21d7" Dec 04 12:03:45.026087 master-0 kubenswrapper[35367]: I1204 12:03:45.025912 35367 scope.go:117] "RemoveContainer" containerID="388a36eac650c8c09011f149057b67b4396ceec6d06ae7dcaa9fd13f4018f169" Dec 04 12:03:45.026331 master-0 kubenswrapper[35367]: E1204 12:03:45.026149 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"route-controller-manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=route-controller-manager pod=route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager(e4d7939a-5961-4608-b910-73e71aa55bf6)\"" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" Dec 04 12:03:45.052454 master-0 kubenswrapper[35367]: I1204 12:03:45.052362 35367 kubelet.go:1914] "Deleted mirror pod because it is outdated" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:03:45.055733 master-0 kubenswrapper[35367]: I1204 12:03:45.055684 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 12:03:45.083775 master-0 kubenswrapper[35367]: I1204 12:03:45.079945 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:03:45.083775 master-0 kubenswrapper[35367]: I1204 12:03:45.081628 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 12:03:46.043191 master-0 kubenswrapper[35367]: I1204 12:03:46.043128 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"095bb4823c284d8bb15baa1a87c3e43c","Type":"ContainerStarted","Data":"6c19e584112eedeb13decc9df9666352919e150b045ee486fc000a978b305461"} Dec 04 12:03:46.043191 master-0 kubenswrapper[35367]: I1204 12:03:46.043181 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"095bb4823c284d8bb15baa1a87c3e43c","Type":"ContainerStarted","Data":"0c0be354baac322c2a33b711de6a55086e966119960fe151968eb12d634f84ad"} Dec 04 12:03:46.043191 master-0 kubenswrapper[35367]: I1204 12:03:46.043193 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"095bb4823c284d8bb15baa1a87c3e43c","Type":"ContainerStarted","Data":"8ac621c4c12061e0ed82467eb38b2f89e385670fbb2e07cc5ef1f3d7c7b14a36"} Dec 04 12:03:47.055256 master-0 kubenswrapper[35367]: I1204 12:03:47.055175 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"095bb4823c284d8bb15baa1a87c3e43c","Type":"ContainerStarted","Data":"53b4382d88729adf6a9704531b58a07011c633cdf64d8e147f628473c5513794"} Dec 04 12:03:47.055256 master-0 kubenswrapper[35367]: I1204 12:03:47.055225 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"095bb4823c284d8bb15baa1a87c3e43c","Type":"ContainerStarted","Data":"015e2371341f29f754ea5dcca5238131c27fb3ff324d2a98ccffc6fb90b665ef"} Dec 04 12:03:47.174506 master-0 kubenswrapper[35367]: I1204 12:03:47.174355 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podStartSLOduration=2.174325694 podStartE2EDuration="2.174325694s" podCreationTimestamp="2025-12-04 12:03:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:03:47.172216018 +0000 UTC m=+270.610277286" watchObservedRunningTime="2025-12-04 12:03:47.174325694 +0000 UTC m=+270.612386952" Dec 04 12:03:49.405132 master-0 kubenswrapper[35367]: I1204 12:03:49.404930 35367 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 12:03:49.405790 master-0 kubenswrapper[35367]: E1204 12:03:49.405268 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="36c6746c-03b9-4909-a4c4-a29260027ec6" containerName="installer" Dec 04 12:03:49.405790 master-0 kubenswrapper[35367]: I1204 12:03:49.405283 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="36c6746c-03b9-4909-a4c4-a29260027ec6" containerName="installer" Dec 04 12:03:49.405790 master-0 kubenswrapper[35367]: I1204 12:03:49.405429 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="36c6746c-03b9-4909-a4c4-a29260027ec6" containerName="installer" Dec 04 12:03:49.405790 master-0 kubenswrapper[35367]: I1204 12:03:49.405788 35367 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Dec 04 12:03:49.406136 master-0 kubenswrapper[35367]: I1204 12:03:49.406102 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:03:49.406210 master-0 kubenswrapper[35367]: I1204 12:03:49.406182 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="kube-apiserver-insecure-readyz" containerID="cri-o://50751e477a1990bac29d99e1e1e13b9e92fd951957f425d40e2f3df08333c017" gracePeriod=15 Dec 04 12:03:49.406329 master-0 kubenswrapper[35367]: I1204 12:03:49.406108 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="kube-apiserver-check-endpoints" containerID="cri-o://86fe179fd7e6d66c7c6aee7210b73a29502acdb4489f86e0446e1630fe925649" gracePeriod=15 Dec 04 12:03:49.406406 master-0 kubenswrapper[35367]: I1204 12:03:49.406165 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="kube-apiserver-cert-regeneration-controller" containerID="cri-o://4bb909346b84f8be0c2c2a7012f593866426dab17ad6ccaa6a7d46aff42bc3a1" gracePeriod=15 Dec 04 12:03:49.406406 master-0 kubenswrapper[35367]: I1204 12:03:49.406086 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="kube-apiserver" containerID="cri-o://cdff2554bec5109c6fb56d02b89ce91b7e5ae9149be4dbc32f66ecd6e906fb18" gracePeriod=15 Dec 04 12:03:49.406406 master-0 kubenswrapper[35367]: I1204 12:03:49.406327 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="kube-apiserver-cert-syncer" containerID="cri-o://11babe89d63cf1e9f5609a7705e10a3f5d41e4c224bf41a34d7138b1b1315a56" gracePeriod=15 Dec 04 12:03:49.407449 master-0 kubenswrapper[35367]: I1204 12:03:49.407020 35367 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Dec 04 12:03:49.407449 master-0 kubenswrapper[35367]: E1204 12:03:49.407248 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="kube-apiserver-cert-syncer" Dec 04 12:03:49.407449 master-0 kubenswrapper[35367]: I1204 12:03:49.407266 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="kube-apiserver-cert-syncer" Dec 04 12:03:49.407449 master-0 kubenswrapper[35367]: E1204 12:03:49.407286 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="kube-apiserver-insecure-readyz" Dec 04 12:03:49.407449 master-0 kubenswrapper[35367]: I1204 12:03:49.407293 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="kube-apiserver-insecure-readyz" Dec 04 12:03:49.407449 master-0 kubenswrapper[35367]: E1204 12:03:49.407319 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="kube-apiserver-cert-regeneration-controller" Dec 04 12:03:49.407449 master-0 kubenswrapper[35367]: I1204 12:03:49.407328 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="kube-apiserver-cert-regeneration-controller" Dec 04 12:03:49.407449 master-0 kubenswrapper[35367]: E1204 12:03:49.407342 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="kube-apiserver-check-endpoints" Dec 04 12:03:49.407449 master-0 kubenswrapper[35367]: I1204 12:03:49.407350 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="kube-apiserver-check-endpoints" Dec 04 12:03:49.407449 master-0 kubenswrapper[35367]: E1204 12:03:49.407366 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="kube-apiserver" Dec 04 12:03:49.407449 master-0 kubenswrapper[35367]: I1204 12:03:49.407375 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="kube-apiserver" Dec 04 12:03:49.407449 master-0 kubenswrapper[35367]: E1204 12:03:49.407389 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="setup" Dec 04 12:03:49.407449 master-0 kubenswrapper[35367]: I1204 12:03:49.407398 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="setup" Dec 04 12:03:49.407985 master-0 kubenswrapper[35367]: I1204 12:03:49.407533 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="kube-apiserver-insecure-readyz" Dec 04 12:03:49.407985 master-0 kubenswrapper[35367]: I1204 12:03:49.407557 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="kube-apiserver" Dec 04 12:03:49.407985 master-0 kubenswrapper[35367]: I1204 12:03:49.407568 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="kube-apiserver-cert-regeneration-controller" Dec 04 12:03:49.407985 master-0 kubenswrapper[35367]: I1204 12:03:49.407582 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="kube-apiserver-check-endpoints" Dec 04 12:03:49.407985 master-0 kubenswrapper[35367]: I1204 12:03:49.407606 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="kube-apiserver-cert-syncer" Dec 04 12:03:49.520316 master-0 kubenswrapper[35367]: I1204 12:03:49.520229 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"9b5fd88e9b399c73466d52c7a3c61e3f\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:03:49.520552 master-0 kubenswrapper[35367]: I1204 12:03:49.520441 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"9b5fd88e9b399c73466d52c7a3c61e3f\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:03:49.520552 master-0 kubenswrapper[35367]: I1204 12:03:49.520488 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/33faf0280764958ffeecc2dce44a9bfc-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"33faf0280764958ffeecc2dce44a9bfc\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:03:49.520552 master-0 kubenswrapper[35367]: I1204 12:03:49.520541 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"9b5fd88e9b399c73466d52c7a3c61e3f\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:03:49.520643 master-0 kubenswrapper[35367]: I1204 12:03:49.520576 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"9b5fd88e9b399c73466d52c7a3c61e3f\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:03:49.520680 master-0 kubenswrapper[35367]: I1204 12:03:49.520670 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"9b5fd88e9b399c73466d52c7a3c61e3f\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:03:49.520771 master-0 kubenswrapper[35367]: I1204 12:03:49.520733 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/33faf0280764958ffeecc2dce44a9bfc-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"33faf0280764958ffeecc2dce44a9bfc\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:03:49.520844 master-0 kubenswrapper[35367]: I1204 12:03:49.520785 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/33faf0280764958ffeecc2dce44a9bfc-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"33faf0280764958ffeecc2dce44a9bfc\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:03:49.622500 master-0 kubenswrapper[35367]: I1204 12:03:49.622409 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"9b5fd88e9b399c73466d52c7a3c61e3f\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:03:49.622500 master-0 kubenswrapper[35367]: I1204 12:03:49.622507 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/33faf0280764958ffeecc2dce44a9bfc-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"33faf0280764958ffeecc2dce44a9bfc\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:03:49.622975 master-0 kubenswrapper[35367]: I1204 12:03:49.622537 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/33faf0280764958ffeecc2dce44a9bfc-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"33faf0280764958ffeecc2dce44a9bfc\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:03:49.622975 master-0 kubenswrapper[35367]: I1204 12:03:49.622583 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"9b5fd88e9b399c73466d52c7a3c61e3f\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:03:49.622975 master-0 kubenswrapper[35367]: I1204 12:03:49.622634 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"9b5fd88e9b399c73466d52c7a3c61e3f\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:03:49.622975 master-0 kubenswrapper[35367]: I1204 12:03:49.622627 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/33faf0280764958ffeecc2dce44a9bfc-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"33faf0280764958ffeecc2dce44a9bfc\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:03:49.622975 master-0 kubenswrapper[35367]: I1204 12:03:49.622663 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"9b5fd88e9b399c73466d52c7a3c61e3f\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:03:49.622975 master-0 kubenswrapper[35367]: I1204 12:03:49.622708 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"9b5fd88e9b399c73466d52c7a3c61e3f\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:03:49.622975 master-0 kubenswrapper[35367]: I1204 12:03:49.622578 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"9b5fd88e9b399c73466d52c7a3c61e3f\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:03:49.622975 master-0 kubenswrapper[35367]: I1204 12:03:49.622739 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/33faf0280764958ffeecc2dce44a9bfc-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"33faf0280764958ffeecc2dce44a9bfc\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:03:49.622975 master-0 kubenswrapper[35367]: I1204 12:03:49.622762 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/33faf0280764958ffeecc2dce44a9bfc-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"33faf0280764958ffeecc2dce44a9bfc\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:03:49.622975 master-0 kubenswrapper[35367]: I1204 12:03:49.622826 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"9b5fd88e9b399c73466d52c7a3c61e3f\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:03:49.622975 master-0 kubenswrapper[35367]: I1204 12:03:49.622866 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"9b5fd88e9b399c73466d52c7a3c61e3f\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:03:49.622975 master-0 kubenswrapper[35367]: I1204 12:03:49.622913 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/33faf0280764958ffeecc2dce44a9bfc-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"33faf0280764958ffeecc2dce44a9bfc\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:03:49.623409 master-0 kubenswrapper[35367]: I1204 12:03:49.623008 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"9b5fd88e9b399c73466d52c7a3c61e3f\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:03:49.623409 master-0 kubenswrapper[35367]: I1204 12:03:49.623041 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"9b5fd88e9b399c73466d52c7a3c61e3f\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:03:49.656150 master-0 kubenswrapper[35367]: I1204 12:03:49.656004 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 12:03:49.657541 master-0 kubenswrapper[35367]: I1204 12:03:49.657464 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: I1204 12:03:49.853622 35367 patch_prober.go:28] interesting pod/kube-apiserver-master-0 container/kube-apiserver namespace/openshift-kube-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]log ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]api-openshift-apiserver-available ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]api-openshift-oauth-apiserver-available ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]informer-sync ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/start-apiserver-admission-initializer ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/openshift.io-api-request-count-filter ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/openshift.io-startkubeinformers ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/openshift.io-openshift-apiserver-reachable ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/openshift.io-oauth-apiserver-reachable ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/generic-apiserver-start-informers ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/priority-and-fairness-config-consumer ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/priority-and-fairness-filter ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/storage-object-count-tracker-hook ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/start-apiextensions-informers ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/start-apiextensions-controllers ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/crd-informer-synced ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/start-system-namespaces-controller ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/start-cluster-authentication-info-controller ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/start-kube-apiserver-identity-lease-controller ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/start-legacy-token-tracking-controller ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/start-service-ip-repair-controllers ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/rbac/bootstrap-roles ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/scheduling/bootstrap-system-priority-classes ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/priority-and-fairness-config-producer ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/bootstrap-controller ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/aggregator-reload-proxy-client-cert ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/start-kube-aggregator-informers ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/apiservice-status-local-available-controller ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/apiservice-status-remote-available-controller ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/apiservice-registration-controller ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/apiservice-wait-for-first-sync ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/apiservice-discovery-controller ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/kube-apiserver-autoregistration ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]autoregister-completion ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/apiservice-openapi-controller ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [+]poststarthook/apiservice-openapiv3-controller ok Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: [-]shutdown failed: reason withheld Dec 04 12:03:49.853685 master-0 kubenswrapper[35367]: readyz check failed Dec 04 12:03:49.854983 master-0 kubenswrapper[35367]: I1204 12:03:49.853698 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="b89698aa356a3bc32694e2b098f9a900" containerName="kube-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 12:03:50.009074 master-0 kubenswrapper[35367]: E1204 12:03:50.008830 35367 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/events\": dial tcp 192.168.32.10:6443: connect: connection refused" event="&Event{ObjectMeta:{kube-apiserver-startup-monitor-master-0.187e0191cecdff70 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-startup-monitor-master-0,UID:9b5fd88e9b399c73466d52c7a3c61e3f,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{startup-monitor},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0f43c31aa3359159d4557dad3cfaf812d8ce44db9cb9ae970e06d3479070b660\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 12:03:49.727305584 +0000 UTC m=+273.165366852,LastTimestamp:2025-12-04 12:03:49.727305584 +0000 UTC m=+273.165366852,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 12:03:50.061824 master-0 kubenswrapper[35367]: I1204 12:03:50.061730 35367 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 12:03:50.062073 master-0 kubenswrapper[35367]: I1204 12:03:50.061865 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 12:03:50.062894 master-0 kubenswrapper[35367]: I1204 12:03:50.062664 35367 scope.go:117] "RemoveContainer" containerID="388a36eac650c8c09011f149057b67b4396ceec6d06ae7dcaa9fd13f4018f169" Dec 04 12:03:50.063095 master-0 kubenswrapper[35367]: E1204 12:03:50.063049 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"route-controller-manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=route-controller-manager pod=route-controller-manager-95cb5f987-46bsk_openshift-route-controller-manager(e4d7939a-5961-4608-b910-73e71aa55bf6)\"" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" Dec 04 12:03:50.064349 master-0 kubenswrapper[35367]: I1204 12:03:50.064273 35367 status_manager.go:851] "Failed to get status for pod" podUID="b89698aa356a3bc32694e2b098f9a900" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:50.065293 master-0 kubenswrapper[35367]: I1204 12:03:50.065241 35367 status_manager.go:851] "Failed to get status for pod" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:50.068270 master-0 kubenswrapper[35367]: I1204 12:03:50.066411 35367 status_manager.go:851] "Failed to get status for pod" podUID="9b5fd88e9b399c73466d52c7a3c61e3f" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:50.076597 master-0 kubenswrapper[35367]: I1204 12:03:50.076513 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" event={"ID":"9b5fd88e9b399c73466d52c7a3c61e3f","Type":"ContainerStarted","Data":"26c2ca0b0c1dab49d0d3007fd11a1b3b60fa01f1ed7acd97cdf107198b219fe8"} Dec 04 12:03:50.076597 master-0 kubenswrapper[35367]: I1204 12:03:50.076585 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" event={"ID":"9b5fd88e9b399c73466d52c7a3c61e3f","Type":"ContainerStarted","Data":"3a2d3df0031e715de8b9696ebf7edeb2b5a61fd57028f27351ab1b58a1673dc2"} Dec 04 12:03:50.081722 master-0 kubenswrapper[35367]: I1204 12:03:50.081655 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_b89698aa356a3bc32694e2b098f9a900/kube-apiserver-cert-syncer/0.log" Dec 04 12:03:50.083959 master-0 kubenswrapper[35367]: I1204 12:03:50.083885 35367 generic.go:334] "Generic (PLEG): container finished" podID="b89698aa356a3bc32694e2b098f9a900" containerID="86fe179fd7e6d66c7c6aee7210b73a29502acdb4489f86e0446e1630fe925649" exitCode=0 Dec 04 12:03:50.083959 master-0 kubenswrapper[35367]: I1204 12:03:50.083946 35367 generic.go:334] "Generic (PLEG): container finished" podID="b89698aa356a3bc32694e2b098f9a900" containerID="50751e477a1990bac29d99e1e1e13b9e92fd951957f425d40e2f3df08333c017" exitCode=0 Dec 04 12:03:50.083959 master-0 kubenswrapper[35367]: I1204 12:03:50.083963 35367 generic.go:334] "Generic (PLEG): container finished" podID="b89698aa356a3bc32694e2b098f9a900" containerID="4bb909346b84f8be0c2c2a7012f593866426dab17ad6ccaa6a7d46aff42bc3a1" exitCode=0 Dec 04 12:03:50.084145 master-0 kubenswrapper[35367]: I1204 12:03:50.083978 35367 generic.go:334] "Generic (PLEG): container finished" podID="b89698aa356a3bc32694e2b098f9a900" containerID="11babe89d63cf1e9f5609a7705e10a3f5d41e4c224bf41a34d7138b1b1315a56" exitCode=2 Dec 04 12:03:50.086741 master-0 kubenswrapper[35367]: I1204 12:03:50.086666 35367 generic.go:334] "Generic (PLEG): container finished" podID="a58ec846-7add-4bef-8382-556bb578824d" containerID="58b8d649f9c312a3fca75aef22916b7cdf46f90609213000bc0e75208f4e917c" exitCode=0 Dec 04 12:03:50.086865 master-0 kubenswrapper[35367]: I1204 12:03:50.086734 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-4-master-0" event={"ID":"a58ec846-7add-4bef-8382-556bb578824d","Type":"ContainerDied","Data":"58b8d649f9c312a3fca75aef22916b7cdf46f90609213000bc0e75208f4e917c"} Dec 04 12:03:50.088566 master-0 kubenswrapper[35367]: I1204 12:03:50.088390 35367 status_manager.go:851] "Failed to get status for pod" podUID="a58ec846-7add-4bef-8382-556bb578824d" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:50.089609 master-0 kubenswrapper[35367]: I1204 12:03:50.089563 35367 status_manager.go:851] "Failed to get status for pod" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:50.090713 master-0 kubenswrapper[35367]: I1204 12:03:50.090625 35367 status_manager.go:851] "Failed to get status for pod" podUID="9b5fd88e9b399c73466d52c7a3c61e3f" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:50.091512 master-0 kubenswrapper[35367]: I1204 12:03:50.091441 35367 status_manager.go:851] "Failed to get status for pod" podUID="b89698aa356a3bc32694e2b098f9a900" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:51.093325 master-0 kubenswrapper[35367]: I1204 12:03:51.093141 35367 status_manager.go:851] "Failed to get status for pod" podUID="a58ec846-7add-4bef-8382-556bb578824d" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:51.093671 master-0 kubenswrapper[35367]: I1204 12:03:51.093472 35367 status_manager.go:851] "Failed to get status for pod" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:51.093947 master-0 kubenswrapper[35367]: I1204 12:03:51.093898 35367 status_manager.go:851] "Failed to get status for pod" podUID="9b5fd88e9b399c73466d52c7a3c61e3f" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:51.365004 master-0 kubenswrapper[35367]: I1204 12:03:51.364832 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 12:03:51.366440 master-0 kubenswrapper[35367]: I1204 12:03:51.366384 35367 status_manager.go:851] "Failed to get status for pod" podUID="a58ec846-7add-4bef-8382-556bb578824d" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:51.367230 master-0 kubenswrapper[35367]: I1204 12:03:51.367186 35367 status_manager.go:851] "Failed to get status for pod" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:51.367843 master-0 kubenswrapper[35367]: I1204 12:03:51.367673 35367 status_manager.go:851] "Failed to get status for pod" podUID="9b5fd88e9b399c73466d52c7a3c61e3f" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:51.449956 master-0 kubenswrapper[35367]: I1204 12:03:51.449781 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a58ec846-7add-4bef-8382-556bb578824d-var-lock\") pod \"a58ec846-7add-4bef-8382-556bb578824d\" (UID: \"a58ec846-7add-4bef-8382-556bb578824d\") " Dec 04 12:03:51.449956 master-0 kubenswrapper[35367]: I1204 12:03:51.449954 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a58ec846-7add-4bef-8382-556bb578824d-kubelet-dir\") pod \"a58ec846-7add-4bef-8382-556bb578824d\" (UID: \"a58ec846-7add-4bef-8382-556bb578824d\") " Dec 04 12:03:51.450235 master-0 kubenswrapper[35367]: I1204 12:03:51.450047 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a58ec846-7add-4bef-8382-556bb578824d-kube-api-access\") pod \"a58ec846-7add-4bef-8382-556bb578824d\" (UID: \"a58ec846-7add-4bef-8382-556bb578824d\") " Dec 04 12:03:51.450270 master-0 kubenswrapper[35367]: I1204 12:03:51.450186 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a58ec846-7add-4bef-8382-556bb578824d-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "a58ec846-7add-4bef-8382-556bb578824d" (UID: "a58ec846-7add-4bef-8382-556bb578824d"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:03:51.450397 master-0 kubenswrapper[35367]: I1204 12:03:51.450349 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a58ec846-7add-4bef-8382-556bb578824d-var-lock" (OuterVolumeSpecName: "var-lock") pod "a58ec846-7add-4bef-8382-556bb578824d" (UID: "a58ec846-7add-4bef-8382-556bb578824d"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:03:51.450738 master-0 kubenswrapper[35367]: I1204 12:03:51.450723 35367 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a58ec846-7add-4bef-8382-556bb578824d-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 12:03:51.450840 master-0 kubenswrapper[35367]: I1204 12:03:51.450796 35367 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a58ec846-7add-4bef-8382-556bb578824d-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:03:51.454992 master-0 kubenswrapper[35367]: I1204 12:03:51.454957 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a58ec846-7add-4bef-8382-556bb578824d-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "a58ec846-7add-4bef-8382-556bb578824d" (UID: "a58ec846-7add-4bef-8382-556bb578824d"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:03:51.552190 master-0 kubenswrapper[35367]: I1204 12:03:51.552056 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a58ec846-7add-4bef-8382-556bb578824d-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 12:03:51.894729 master-0 kubenswrapper[35367]: E1204 12:03:51.894566 35367 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/events\": dial tcp 192.168.32.10:6443: connect: connection refused" event="&Event{ObjectMeta:{kube-apiserver-startup-monitor-master-0.187e0191cecdff70 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-startup-monitor-master-0,UID:9b5fd88e9b399c73466d52c7a3c61e3f,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{startup-monitor},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0f43c31aa3359159d4557dad3cfaf812d8ce44db9cb9ae970e06d3479070b660\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 12:03:49.727305584 +0000 UTC m=+273.165366852,LastTimestamp:2025-12-04 12:03:49.727305584 +0000 UTC m=+273.165366852,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 12:03:52.168461 master-0 kubenswrapper[35367]: I1204 12:03:52.168064 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-4-master-0" event={"ID":"a58ec846-7add-4bef-8382-556bb578824d","Type":"ContainerDied","Data":"32efa323e04316a3b7f28c1bbfcf874ac04dbe75aa84489de0fcbb85dbf621c5"} Dec 04 12:03:52.168461 master-0 kubenswrapper[35367]: I1204 12:03:52.168116 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32efa323e04316a3b7f28c1bbfcf874ac04dbe75aa84489de0fcbb85dbf621c5" Dec 04 12:03:52.168461 master-0 kubenswrapper[35367]: I1204 12:03:52.168199 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-4-master-0" Dec 04 12:03:52.211766 master-0 kubenswrapper[35367]: I1204 12:03:52.209587 35367 status_manager.go:851] "Failed to get status for pod" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:52.211766 master-0 kubenswrapper[35367]: I1204 12:03:52.210650 35367 status_manager.go:851] "Failed to get status for pod" podUID="9b5fd88e9b399c73466d52c7a3c61e3f" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:52.212847 master-0 kubenswrapper[35367]: I1204 12:03:52.212625 35367 status_manager.go:851] "Failed to get status for pod" podUID="a58ec846-7add-4bef-8382-556bb578824d" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:52.443533 master-0 kubenswrapper[35367]: I1204 12:03:52.443456 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_b89698aa356a3bc32694e2b098f9a900/kube-apiserver-cert-syncer/0.log" Dec 04 12:03:52.444528 master-0 kubenswrapper[35367]: I1204 12:03:52.444476 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:03:52.445789 master-0 kubenswrapper[35367]: I1204 12:03:52.445717 35367 status_manager.go:851] "Failed to get status for pod" podUID="b89698aa356a3bc32694e2b098f9a900" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:52.446682 master-0 kubenswrapper[35367]: I1204 12:03:52.446635 35367 status_manager.go:851] "Failed to get status for pod" podUID="a58ec846-7add-4bef-8382-556bb578824d" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:52.447312 master-0 kubenswrapper[35367]: I1204 12:03:52.447258 35367 status_manager.go:851] "Failed to get status for pod" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:52.448234 master-0 kubenswrapper[35367]: I1204 12:03:52.448169 35367 status_manager.go:851] "Failed to get status for pod" podUID="9b5fd88e9b399c73466d52c7a3c61e3f" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:52.479628 master-0 kubenswrapper[35367]: E1204 12:03:52.479541 35367 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:52.480182 master-0 kubenswrapper[35367]: E1204 12:03:52.480126 35367 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:52.481430 master-0 kubenswrapper[35367]: E1204 12:03:52.481343 35367 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:52.482275 master-0 kubenswrapper[35367]: E1204 12:03:52.482210 35367 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:52.482823 master-0 kubenswrapper[35367]: E1204 12:03:52.482766 35367 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:52.482823 master-0 kubenswrapper[35367]: I1204 12:03:52.482821 35367 controller.go:115] "failed to update lease using latest lease, fallback to ensure lease" err="failed 5 attempts to update lease" Dec 04 12:03:52.483282 master-0 kubenswrapper[35367]: E1204 12:03:52.483238 35367 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="200ms" Dec 04 12:03:52.572183 master-0 kubenswrapper[35367]: I1204 12:03:52.572091 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-cert-dir\") pod \"b89698aa356a3bc32694e2b098f9a900\" (UID: \"b89698aa356a3bc32694e2b098f9a900\") " Dec 04 12:03:52.572444 master-0 kubenswrapper[35367]: I1204 12:03:52.572207 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-audit-dir\") pod \"b89698aa356a3bc32694e2b098f9a900\" (UID: \"b89698aa356a3bc32694e2b098f9a900\") " Dec 04 12:03:52.572444 master-0 kubenswrapper[35367]: I1204 12:03:52.572291 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-resource-dir\") pod \"b89698aa356a3bc32694e2b098f9a900\" (UID: \"b89698aa356a3bc32694e2b098f9a900\") " Dec 04 12:03:52.572561 master-0 kubenswrapper[35367]: I1204 12:03:52.572356 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-cert-dir" (OuterVolumeSpecName: "cert-dir") pod "b89698aa356a3bc32694e2b098f9a900" (UID: "b89698aa356a3bc32694e2b098f9a900"). InnerVolumeSpecName "cert-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:03:52.572561 master-0 kubenswrapper[35367]: I1204 12:03:52.572375 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-audit-dir" (OuterVolumeSpecName: "audit-dir") pod "b89698aa356a3bc32694e2b098f9a900" (UID: "b89698aa356a3bc32694e2b098f9a900"). InnerVolumeSpecName "audit-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:03:52.572987 master-0 kubenswrapper[35367]: I1204 12:03:52.572940 35367 reconciler_common.go:293] "Volume detached for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-cert-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:03:52.572987 master-0 kubenswrapper[35367]: I1204 12:03:52.572977 35367 reconciler_common.go:293] "Volume detached for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-audit-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:03:52.572987 master-0 kubenswrapper[35367]: I1204 12:03:52.572436 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "b89698aa356a3bc32694e2b098f9a900" (UID: "b89698aa356a3bc32694e2b098f9a900"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:03:52.674887 master-0 kubenswrapper[35367]: I1204 12:03:52.674738 35367 reconciler_common.go:293] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/b89698aa356a3bc32694e2b098f9a900-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:03:52.685309 master-0 kubenswrapper[35367]: E1204 12:03:52.685155 35367 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="400ms" Dec 04 12:03:52.754754 master-0 kubenswrapper[35367]: I1204 12:03:52.754678 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b89698aa356a3bc32694e2b098f9a900" path="/var/lib/kubelet/pods/b89698aa356a3bc32694e2b098f9a900/volumes" Dec 04 12:03:53.086333 master-0 kubenswrapper[35367]: E1204 12:03:53.086226 35367 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="800ms" Dec 04 12:03:53.178134 master-0 kubenswrapper[35367]: I1204 12:03:53.177976 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_b89698aa356a3bc32694e2b098f9a900/kube-apiserver-cert-syncer/0.log" Dec 04 12:03:53.179160 master-0 kubenswrapper[35367]: I1204 12:03:53.179111 35367 generic.go:334] "Generic (PLEG): container finished" podID="b89698aa356a3bc32694e2b098f9a900" containerID="cdff2554bec5109c6fb56d02b89ce91b7e5ae9149be4dbc32f66ecd6e906fb18" exitCode=0 Dec 04 12:03:53.179208 master-0 kubenswrapper[35367]: I1204 12:03:53.179193 35367 scope.go:117] "RemoveContainer" containerID="86fe179fd7e6d66c7c6aee7210b73a29502acdb4489f86e0446e1630fe925649" Dec 04 12:03:53.179445 master-0 kubenswrapper[35367]: I1204 12:03:53.179425 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:03:53.183251 master-0 kubenswrapper[35367]: I1204 12:03:53.183202 35367 status_manager.go:851] "Failed to get status for pod" podUID="b89698aa356a3bc32694e2b098f9a900" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:53.183746 master-0 kubenswrapper[35367]: I1204 12:03:53.183725 35367 status_manager.go:851] "Failed to get status for pod" podUID="a58ec846-7add-4bef-8382-556bb578824d" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:53.184414 master-0 kubenswrapper[35367]: I1204 12:03:53.184358 35367 status_manager.go:851] "Failed to get status for pod" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:53.186048 master-0 kubenswrapper[35367]: I1204 12:03:53.186013 35367 status_manager.go:851] "Failed to get status for pod" podUID="9b5fd88e9b399c73466d52c7a3c61e3f" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:53.186759 master-0 kubenswrapper[35367]: I1204 12:03:53.186728 35367 status_manager.go:851] "Failed to get status for pod" podUID="9b5fd88e9b399c73466d52c7a3c61e3f" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:53.188267 master-0 kubenswrapper[35367]: I1204 12:03:53.187778 35367 status_manager.go:851] "Failed to get status for pod" podUID="b89698aa356a3bc32694e2b098f9a900" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:53.188483 master-0 kubenswrapper[35367]: I1204 12:03:53.188448 35367 status_manager.go:851] "Failed to get status for pod" podUID="a58ec846-7add-4bef-8382-556bb578824d" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:53.189010 master-0 kubenswrapper[35367]: I1204 12:03:53.188970 35367 status_manager.go:851] "Failed to get status for pod" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:53.194064 master-0 kubenswrapper[35367]: I1204 12:03:53.194030 35367 scope.go:117] "RemoveContainer" containerID="50751e477a1990bac29d99e1e1e13b9e92fd951957f425d40e2f3df08333c017" Dec 04 12:03:53.215196 master-0 kubenswrapper[35367]: I1204 12:03:53.214490 35367 scope.go:117] "RemoveContainer" containerID="4bb909346b84f8be0c2c2a7012f593866426dab17ad6ccaa6a7d46aff42bc3a1" Dec 04 12:03:53.233378 master-0 kubenswrapper[35367]: I1204 12:03:53.233323 35367 scope.go:117] "RemoveContainer" containerID="11babe89d63cf1e9f5609a7705e10a3f5d41e4c224bf41a34d7138b1b1315a56" Dec 04 12:03:53.254493 master-0 kubenswrapper[35367]: I1204 12:03:53.254445 35367 scope.go:117] "RemoveContainer" containerID="cdff2554bec5109c6fb56d02b89ce91b7e5ae9149be4dbc32f66ecd6e906fb18" Dec 04 12:03:53.274218 master-0 kubenswrapper[35367]: I1204 12:03:53.274178 35367 scope.go:117] "RemoveContainer" containerID="2262a85240071337933265fef7bf64975af04b3a2ac5a2ff5f0770a8bb6a3e3b" Dec 04 12:03:53.302121 master-0 kubenswrapper[35367]: I1204 12:03:53.302061 35367 scope.go:117] "RemoveContainer" containerID="86fe179fd7e6d66c7c6aee7210b73a29502acdb4489f86e0446e1630fe925649" Dec 04 12:03:53.303067 master-0 kubenswrapper[35367]: E1204 12:03:53.303008 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86fe179fd7e6d66c7c6aee7210b73a29502acdb4489f86e0446e1630fe925649\": container with ID starting with 86fe179fd7e6d66c7c6aee7210b73a29502acdb4489f86e0446e1630fe925649 not found: ID does not exist" containerID="86fe179fd7e6d66c7c6aee7210b73a29502acdb4489f86e0446e1630fe925649" Dec 04 12:03:53.303146 master-0 kubenswrapper[35367]: I1204 12:03:53.303069 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86fe179fd7e6d66c7c6aee7210b73a29502acdb4489f86e0446e1630fe925649"} err="failed to get container status \"86fe179fd7e6d66c7c6aee7210b73a29502acdb4489f86e0446e1630fe925649\": rpc error: code = NotFound desc = could not find container \"86fe179fd7e6d66c7c6aee7210b73a29502acdb4489f86e0446e1630fe925649\": container with ID starting with 86fe179fd7e6d66c7c6aee7210b73a29502acdb4489f86e0446e1630fe925649 not found: ID does not exist" Dec 04 12:03:53.303146 master-0 kubenswrapper[35367]: I1204 12:03:53.303102 35367 scope.go:117] "RemoveContainer" containerID="50751e477a1990bac29d99e1e1e13b9e92fd951957f425d40e2f3df08333c017" Dec 04 12:03:53.303621 master-0 kubenswrapper[35367]: E1204 12:03:53.303561 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50751e477a1990bac29d99e1e1e13b9e92fd951957f425d40e2f3df08333c017\": container with ID starting with 50751e477a1990bac29d99e1e1e13b9e92fd951957f425d40e2f3df08333c017 not found: ID does not exist" containerID="50751e477a1990bac29d99e1e1e13b9e92fd951957f425d40e2f3df08333c017" Dec 04 12:03:53.303688 master-0 kubenswrapper[35367]: I1204 12:03:53.303628 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50751e477a1990bac29d99e1e1e13b9e92fd951957f425d40e2f3df08333c017"} err="failed to get container status \"50751e477a1990bac29d99e1e1e13b9e92fd951957f425d40e2f3df08333c017\": rpc error: code = NotFound desc = could not find container \"50751e477a1990bac29d99e1e1e13b9e92fd951957f425d40e2f3df08333c017\": container with ID starting with 50751e477a1990bac29d99e1e1e13b9e92fd951957f425d40e2f3df08333c017 not found: ID does not exist" Dec 04 12:03:53.303688 master-0 kubenswrapper[35367]: I1204 12:03:53.303666 35367 scope.go:117] "RemoveContainer" containerID="4bb909346b84f8be0c2c2a7012f593866426dab17ad6ccaa6a7d46aff42bc3a1" Dec 04 12:03:53.304158 master-0 kubenswrapper[35367]: E1204 12:03:53.304108 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bb909346b84f8be0c2c2a7012f593866426dab17ad6ccaa6a7d46aff42bc3a1\": container with ID starting with 4bb909346b84f8be0c2c2a7012f593866426dab17ad6ccaa6a7d46aff42bc3a1 not found: ID does not exist" containerID="4bb909346b84f8be0c2c2a7012f593866426dab17ad6ccaa6a7d46aff42bc3a1" Dec 04 12:03:53.304216 master-0 kubenswrapper[35367]: I1204 12:03:53.304161 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bb909346b84f8be0c2c2a7012f593866426dab17ad6ccaa6a7d46aff42bc3a1"} err="failed to get container status \"4bb909346b84f8be0c2c2a7012f593866426dab17ad6ccaa6a7d46aff42bc3a1\": rpc error: code = NotFound desc = could not find container \"4bb909346b84f8be0c2c2a7012f593866426dab17ad6ccaa6a7d46aff42bc3a1\": container with ID starting with 4bb909346b84f8be0c2c2a7012f593866426dab17ad6ccaa6a7d46aff42bc3a1 not found: ID does not exist" Dec 04 12:03:53.304216 master-0 kubenswrapper[35367]: I1204 12:03:53.304201 35367 scope.go:117] "RemoveContainer" containerID="11babe89d63cf1e9f5609a7705e10a3f5d41e4c224bf41a34d7138b1b1315a56" Dec 04 12:03:53.304680 master-0 kubenswrapper[35367]: E1204 12:03:53.304639 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11babe89d63cf1e9f5609a7705e10a3f5d41e4c224bf41a34d7138b1b1315a56\": container with ID starting with 11babe89d63cf1e9f5609a7705e10a3f5d41e4c224bf41a34d7138b1b1315a56 not found: ID does not exist" containerID="11babe89d63cf1e9f5609a7705e10a3f5d41e4c224bf41a34d7138b1b1315a56" Dec 04 12:03:53.304738 master-0 kubenswrapper[35367]: I1204 12:03:53.304675 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11babe89d63cf1e9f5609a7705e10a3f5d41e4c224bf41a34d7138b1b1315a56"} err="failed to get container status \"11babe89d63cf1e9f5609a7705e10a3f5d41e4c224bf41a34d7138b1b1315a56\": rpc error: code = NotFound desc = could not find container \"11babe89d63cf1e9f5609a7705e10a3f5d41e4c224bf41a34d7138b1b1315a56\": container with ID starting with 11babe89d63cf1e9f5609a7705e10a3f5d41e4c224bf41a34d7138b1b1315a56 not found: ID does not exist" Dec 04 12:03:53.304738 master-0 kubenswrapper[35367]: I1204 12:03:53.304716 35367 scope.go:117] "RemoveContainer" containerID="cdff2554bec5109c6fb56d02b89ce91b7e5ae9149be4dbc32f66ecd6e906fb18" Dec 04 12:03:53.305354 master-0 kubenswrapper[35367]: E1204 12:03:53.305265 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdff2554bec5109c6fb56d02b89ce91b7e5ae9149be4dbc32f66ecd6e906fb18\": container with ID starting with cdff2554bec5109c6fb56d02b89ce91b7e5ae9149be4dbc32f66ecd6e906fb18 not found: ID does not exist" containerID="cdff2554bec5109c6fb56d02b89ce91b7e5ae9149be4dbc32f66ecd6e906fb18" Dec 04 12:03:53.305354 master-0 kubenswrapper[35367]: I1204 12:03:53.305332 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdff2554bec5109c6fb56d02b89ce91b7e5ae9149be4dbc32f66ecd6e906fb18"} err="failed to get container status \"cdff2554bec5109c6fb56d02b89ce91b7e5ae9149be4dbc32f66ecd6e906fb18\": rpc error: code = NotFound desc = could not find container \"cdff2554bec5109c6fb56d02b89ce91b7e5ae9149be4dbc32f66ecd6e906fb18\": container with ID starting with cdff2554bec5109c6fb56d02b89ce91b7e5ae9149be4dbc32f66ecd6e906fb18 not found: ID does not exist" Dec 04 12:03:53.305354 master-0 kubenswrapper[35367]: I1204 12:03:53.305357 35367 scope.go:117] "RemoveContainer" containerID="2262a85240071337933265fef7bf64975af04b3a2ac5a2ff5f0770a8bb6a3e3b" Dec 04 12:03:53.306946 master-0 kubenswrapper[35367]: E1204 12:03:53.305914 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2262a85240071337933265fef7bf64975af04b3a2ac5a2ff5f0770a8bb6a3e3b\": container with ID starting with 2262a85240071337933265fef7bf64975af04b3a2ac5a2ff5f0770a8bb6a3e3b not found: ID does not exist" containerID="2262a85240071337933265fef7bf64975af04b3a2ac5a2ff5f0770a8bb6a3e3b" Dec 04 12:03:53.306946 master-0 kubenswrapper[35367]: I1204 12:03:53.305962 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2262a85240071337933265fef7bf64975af04b3a2ac5a2ff5f0770a8bb6a3e3b"} err="failed to get container status \"2262a85240071337933265fef7bf64975af04b3a2ac5a2ff5f0770a8bb6a3e3b\": rpc error: code = NotFound desc = could not find container \"2262a85240071337933265fef7bf64975af04b3a2ac5a2ff5f0770a8bb6a3e3b\": container with ID starting with 2262a85240071337933265fef7bf64975af04b3a2ac5a2ff5f0770a8bb6a3e3b not found: ID does not exist" Dec 04 12:03:53.888299 master-0 kubenswrapper[35367]: E1204 12:03:53.888214 35367 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="1.6s" Dec 04 12:03:55.081977 master-0 kubenswrapper[35367]: I1204 12:03:55.081928 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:03:55.082591 master-0 kubenswrapper[35367]: I1204 12:03:55.081990 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:03:55.082591 master-0 kubenswrapper[35367]: I1204 12:03:55.082001 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:03:55.082591 master-0 kubenswrapper[35367]: I1204 12:03:55.082010 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:03:55.086889 master-0 kubenswrapper[35367]: I1204 12:03:55.086788 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:03:55.087366 master-0 kubenswrapper[35367]: I1204 12:03:55.087332 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:03:55.087696 master-0 kubenswrapper[35367]: I1204 12:03:55.087640 35367 status_manager.go:851] "Failed to get status for pod" podUID="a58ec846-7add-4bef-8382-556bb578824d" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:55.088860 master-0 kubenswrapper[35367]: I1204 12:03:55.088722 35367 status_manager.go:851] "Failed to get status for pod" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:55.089554 master-0 kubenswrapper[35367]: I1204 12:03:55.089492 35367 status_manager.go:851] "Failed to get status for pod" podUID="095bb4823c284d8bb15baa1a87c3e43c" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:55.090245 master-0 kubenswrapper[35367]: I1204 12:03:55.090197 35367 status_manager.go:851] "Failed to get status for pod" podUID="9b5fd88e9b399c73466d52c7a3c61e3f" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:55.091115 master-0 kubenswrapper[35367]: I1204 12:03:55.091028 35367 status_manager.go:851] "Failed to get status for pod" podUID="a58ec846-7add-4bef-8382-556bb578824d" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:55.091864 master-0 kubenswrapper[35367]: I1204 12:03:55.091785 35367 status_manager.go:851] "Failed to get status for pod" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:55.092633 master-0 kubenswrapper[35367]: I1204 12:03:55.092554 35367 status_manager.go:851] "Failed to get status for pod" podUID="095bb4823c284d8bb15baa1a87c3e43c" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:55.093282 master-0 kubenswrapper[35367]: I1204 12:03:55.093220 35367 status_manager.go:851] "Failed to get status for pod" podUID="9b5fd88e9b399c73466d52c7a3c61e3f" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:55.198700 master-0 kubenswrapper[35367]: I1204 12:03:55.198645 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:03:55.199452 master-0 kubenswrapper[35367]: I1204 12:03:55.198957 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:03:55.199452 master-0 kubenswrapper[35367]: I1204 12:03:55.199386 35367 status_manager.go:851] "Failed to get status for pod" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:55.199939 master-0 kubenswrapper[35367]: I1204 12:03:55.199911 35367 status_manager.go:851] "Failed to get status for pod" podUID="095bb4823c284d8bb15baa1a87c3e43c" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:55.200662 master-0 kubenswrapper[35367]: I1204 12:03:55.200567 35367 status_manager.go:851] "Failed to get status for pod" podUID="9b5fd88e9b399c73466d52c7a3c61e3f" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:55.202979 master-0 kubenswrapper[35367]: I1204 12:03:55.202834 35367 status_manager.go:851] "Failed to get status for pod" podUID="a58ec846-7add-4bef-8382-556bb578824d" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:55.203975 master-0 kubenswrapper[35367]: I1204 12:03:55.203909 35367 status_manager.go:851] "Failed to get status for pod" podUID="a58ec846-7add-4bef-8382-556bb578824d" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:55.204529 master-0 kubenswrapper[35367]: I1204 12:03:55.204468 35367 status_manager.go:851] "Failed to get status for pod" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:55.205222 master-0 kubenswrapper[35367]: I1204 12:03:55.205171 35367 status_manager.go:851] "Failed to get status for pod" podUID="095bb4823c284d8bb15baa1a87c3e43c" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:55.205872 master-0 kubenswrapper[35367]: I1204 12:03:55.205828 35367 status_manager.go:851] "Failed to get status for pod" podUID="9b5fd88e9b399c73466d52c7a3c61e3f" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:55.489800 master-0 kubenswrapper[35367]: E1204 12:03:55.489656 35367 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="3.2s" Dec 04 12:03:56.751331 master-0 kubenswrapper[35367]: I1204 12:03:56.751257 35367 status_manager.go:851] "Failed to get status for pod" podUID="a58ec846-7add-4bef-8382-556bb578824d" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:56.752039 master-0 kubenswrapper[35367]: I1204 12:03:56.751974 35367 status_manager.go:851] "Failed to get status for pod" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:56.752614 master-0 kubenswrapper[35367]: I1204 12:03:56.752570 35367 status_manager.go:851] "Failed to get status for pod" podUID="095bb4823c284d8bb15baa1a87c3e43c" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:56.753214 master-0 kubenswrapper[35367]: I1204 12:03:56.753162 35367 status_manager.go:851] "Failed to get status for pod" podUID="9b5fd88e9b399c73466d52c7a3c61e3f" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:03:58.690856 master-0 kubenswrapper[35367]: E1204 12:03:58.690738 35367 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="6.4s" Dec 04 12:04:00.746717 master-0 kubenswrapper[35367]: I1204 12:04:00.746660 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:04:00.748092 master-0 kubenswrapper[35367]: I1204 12:04:00.748008 35367 status_manager.go:851] "Failed to get status for pod" podUID="095bb4823c284d8bb15baa1a87c3e43c" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:04:00.748800 master-0 kubenswrapper[35367]: I1204 12:04:00.748698 35367 status_manager.go:851] "Failed to get status for pod" podUID="9b5fd88e9b399c73466d52c7a3c61e3f" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:04:00.749663 master-0 kubenswrapper[35367]: I1204 12:04:00.749605 35367 status_manager.go:851] "Failed to get status for pod" podUID="a58ec846-7add-4bef-8382-556bb578824d" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:04:00.750303 master-0 kubenswrapper[35367]: I1204 12:04:00.750236 35367 status_manager.go:851] "Failed to get status for pod" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:04:00.770038 master-0 kubenswrapper[35367]: I1204 12:04:00.769980 35367 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="6618e8be-e480-470f-babf-56ddd8340e52" Dec 04 12:04:00.770038 master-0 kubenswrapper[35367]: I1204 12:04:00.770022 35367 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="6618e8be-e480-470f-babf-56ddd8340e52" Dec 04 12:04:00.770678 master-0 kubenswrapper[35367]: E1204 12:04:00.770634 35367 mirror_client.go:138] "Failed deleting a mirror pod" err="Delete \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:04:00.771183 master-0 kubenswrapper[35367]: I1204 12:04:00.771147 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:04:00.790172 master-0 kubenswrapper[35367]: W1204 12:04:00.790094 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33faf0280764958ffeecc2dce44a9bfc.slice/crio-ca91afd703e222d26e6f00192af295b41210f1480e31db8b975c6629e5a0ddd4 WatchSource:0}: Error finding container ca91afd703e222d26e6f00192af295b41210f1480e31db8b975c6629e5a0ddd4: Status 404 returned error can't find the container with id ca91afd703e222d26e6f00192af295b41210f1480e31db8b975c6629e5a0ddd4 Dec 04 12:04:01.232912 master-0 kubenswrapper[35367]: I1204 12:04:01.232831 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"33faf0280764958ffeecc2dce44a9bfc","Type":"ContainerStarted","Data":"ca91afd703e222d26e6f00192af295b41210f1480e31db8b975c6629e5a0ddd4"} Dec 04 12:04:01.897242 master-0 kubenswrapper[35367]: E1204 12:04:01.897062 35367 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/events\": dial tcp 192.168.32.10:6443: connect: connection refused" event="&Event{ObjectMeta:{kube-apiserver-startup-monitor-master-0.187e0191cecdff70 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-startup-monitor-master-0,UID:9b5fd88e9b399c73466d52c7a3c61e3f,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{startup-monitor},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0f43c31aa3359159d4557dad3cfaf812d8ce44db9cb9ae970e06d3479070b660\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 12:03:49.727305584 +0000 UTC m=+273.165366852,LastTimestamp:2025-12-04 12:03:49.727305584 +0000 UTC m=+273.165366852,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 12:04:02.241616 master-0 kubenswrapper[35367]: I1204 12:04:02.241507 35367 generic.go:334] "Generic (PLEG): container finished" podID="33faf0280764958ffeecc2dce44a9bfc" containerID="20886cc5417b688432e3df355bfc0c616c33ee7fc1bbbee81eea63ead26a9aae" exitCode=0 Dec 04 12:04:02.241840 master-0 kubenswrapper[35367]: I1204 12:04:02.241791 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"33faf0280764958ffeecc2dce44a9bfc","Type":"ContainerDied","Data":"20886cc5417b688432e3df355bfc0c616c33ee7fc1bbbee81eea63ead26a9aae"} Dec 04 12:04:02.241913 master-0 kubenswrapper[35367]: I1204 12:04:02.241866 35367 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="6618e8be-e480-470f-babf-56ddd8340e52" Dec 04 12:04:02.241913 master-0 kubenswrapper[35367]: I1204 12:04:02.241905 35367 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="6618e8be-e480-470f-babf-56ddd8340e52" Dec 04 12:04:02.242707 master-0 kubenswrapper[35367]: I1204 12:04:02.242661 35367 status_manager.go:851] "Failed to get status for pod" podUID="9b5fd88e9b399c73466d52c7a3c61e3f" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:04:02.242833 master-0 kubenswrapper[35367]: E1204 12:04:02.242736 35367 mirror_client.go:138] "Failed deleting a mirror pod" err="Delete \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:04:02.243304 master-0 kubenswrapper[35367]: I1204 12:04:02.243275 35367 status_manager.go:851] "Failed to get status for pod" podUID="a58ec846-7add-4bef-8382-556bb578824d" pod="openshift-kube-apiserver/installer-4-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-4-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:04:02.243767 master-0 kubenswrapper[35367]: I1204 12:04:02.243694 35367 status_manager.go:851] "Failed to get status for pod" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-route-controller-manager/pods/route-controller-manager-95cb5f987-46bsk\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:04:02.244299 master-0 kubenswrapper[35367]: I1204 12:04:02.244176 35367 status_manager.go:851] "Failed to get status for pod" podUID="095bb4823c284d8bb15baa1a87c3e43c" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:04:03.254026 master-0 kubenswrapper[35367]: I1204 12:04:03.253973 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"33faf0280764958ffeecc2dce44a9bfc","Type":"ContainerStarted","Data":"3516d1ade9f0ea4269ee4ea096abf88317bfb45f980f730f2d032ccf08c8d87c"} Dec 04 12:04:03.254026 master-0 kubenswrapper[35367]: I1204 12:04:03.254027 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"33faf0280764958ffeecc2dce44a9bfc","Type":"ContainerStarted","Data":"981583e1a62020bed0b320631df16e0dbab14c71cca41f88b718c24fc9b0769f"} Dec 04 12:04:03.747276 master-0 kubenswrapper[35367]: I1204 12:04:03.747210 35367 scope.go:117] "RemoveContainer" containerID="388a36eac650c8c09011f149057b67b4396ceec6d06ae7dcaa9fd13f4018f169" Dec 04 12:04:04.262843 master-0 kubenswrapper[35367]: I1204 12:04:04.262759 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" event={"ID":"e4d7939a-5961-4608-b910-73e71aa55bf6","Type":"ContainerStarted","Data":"c1ac7584fc7724b92eddedadea7e444d64b6c1ea5ee822aeb6c33c06347eee0e"} Dec 04 12:04:04.264637 master-0 kubenswrapper[35367]: I1204 12:04:04.263443 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 12:04:04.267457 master-0 kubenswrapper[35367]: I1204 12:04:04.267417 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"33faf0280764958ffeecc2dce44a9bfc","Type":"ContainerStarted","Data":"3ff6934d1f9c2657fb826df4ed4b1a22637352da037f97d1d2cee14f9481efd0"} Dec 04 12:04:04.267542 master-0 kubenswrapper[35367]: I1204 12:04:04.267454 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"33faf0280764958ffeecc2dce44a9bfc","Type":"ContainerStarted","Data":"1544dafc4450e69e270bc2b89b39af57abe1b6f542477c2578b2641d7b655943"} Dec 04 12:04:04.267542 master-0 kubenswrapper[35367]: I1204 12:04:04.267480 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"33faf0280764958ffeecc2dce44a9bfc","Type":"ContainerStarted","Data":"b0a28d609b06924a057b9984500a4af713b3fc429b6e06d5c9e1333fac00df02"} Dec 04 12:04:04.267645 master-0 kubenswrapper[35367]: I1204 12:04:04.267609 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:04:04.267734 master-0 kubenswrapper[35367]: I1204 12:04:04.267704 35367 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="6618e8be-e480-470f-babf-56ddd8340e52" Dec 04 12:04:04.267734 master-0 kubenswrapper[35367]: I1204 12:04:04.267725 35367 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="6618e8be-e480-470f-babf-56ddd8340e52" Dec 04 12:04:05.264134 master-0 kubenswrapper[35367]: I1204 12:04:05.263967 35367 patch_prober.go:28] interesting pod/route-controller-manager-95cb5f987-46bsk container/route-controller-manager namespace/openshift-route-controller-manager: Readiness probe status=failure output="Get \"https://10.128.0.70:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 12:04:05.264134 master-0 kubenswrapper[35367]: I1204 12:04:05.264144 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" probeResult="failure" output="Get \"https://10.128.0.70:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 12:04:05.772259 master-0 kubenswrapper[35367]: I1204 12:04:05.772177 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:04:05.772259 master-0 kubenswrapper[35367]: I1204 12:04:05.772253 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: I1204 12:04:05.778396 35367 patch_prober.go:28] interesting pod/kube-apiserver-master-0 container/kube-apiserver namespace/openshift-kube-apiserver: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]log ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]etcd ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/openshift.io-startkubeinformers ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/openshift.io-openshift-apiserver-reachable ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/openshift.io-oauth-apiserver-reachable ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/start-apiserver-admission-initializer ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/openshift.io-api-request-count-filter ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/generic-apiserver-start-informers ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/priority-and-fairness-config-consumer ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/priority-and-fairness-filter ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/storage-object-count-tracker-hook ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/start-apiextensions-informers ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/start-apiextensions-controllers ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/crd-informer-synced ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/start-system-namespaces-controller ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/start-cluster-authentication-info-controller ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/start-kube-apiserver-identity-lease-controller ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/start-legacy-token-tracking-controller ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/start-service-ip-repair-controllers ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [-]poststarthook/rbac/bootstrap-roles failed: reason withheld Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/scheduling/bootstrap-system-priority-classes ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/priority-and-fairness-config-producer ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/bootstrap-controller ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/aggregator-reload-proxy-client-cert ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/start-kube-aggregator-informers ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/apiservice-status-local-available-controller ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/apiservice-status-remote-available-controller ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/apiservice-registration-controller ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/apiservice-wait-for-first-sync ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/apiservice-discovery-controller ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/kube-apiserver-autoregistration ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]autoregister-completion ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/apiservice-openapi-controller ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: [+]poststarthook/apiservice-openapiv3-controller ok Dec 04 12:04:05.778450 master-0 kubenswrapper[35367]: livez check failed Dec 04 12:04:05.779660 master-0 kubenswrapper[35367]: I1204 12:04:05.778464 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="kube-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Dec 04 12:04:06.275141 master-0 kubenswrapper[35367]: I1204 12:04:06.275066 35367 patch_prober.go:28] interesting pod/route-controller-manager-95cb5f987-46bsk container/route-controller-manager namespace/openshift-route-controller-manager: Readiness probe status=failure output="Get \"https://10.128.0.70:8443/healthz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 12:04:06.275705 master-0 kubenswrapper[35367]: I1204 12:04:06.275138 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" probeResult="failure" output="Get \"https://10.128.0.70:8443/healthz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Dec 04 12:04:09.648078 master-0 kubenswrapper[35367]: I1204 12:04:09.648019 35367 kubelet.go:1914] "Deleted mirror pod because it is outdated" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:04:09.886412 master-0 kubenswrapper[35367]: I1204 12:04:09.886334 35367 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-apiserver/kube-apiserver-master-0" oldPodUID="33faf0280764958ffeecc2dce44a9bfc" podUID="c0b6c2f2-9a19-4ed6-8062-2457696a3e0b" Dec 04 12:04:10.306336 master-0 kubenswrapper[35367]: I1204 12:04:10.306262 35367 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="6618e8be-e480-470f-babf-56ddd8340e52" Dec 04 12:04:10.306336 master-0 kubenswrapper[35367]: I1204 12:04:10.306300 35367 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="6618e8be-e480-470f-babf-56ddd8340e52" Dec 04 12:04:10.311031 master-0 kubenswrapper[35367]: I1204 12:04:10.310346 35367 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-apiserver/kube-apiserver-master-0" oldPodUID="33faf0280764958ffeecc2dce44a9bfc" podUID="c0b6c2f2-9a19-4ed6-8062-2457696a3e0b" Dec 04 12:04:11.062638 master-0 kubenswrapper[35367]: I1204 12:04:11.062531 35367 patch_prober.go:28] interesting pod/route-controller-manager-95cb5f987-46bsk container/route-controller-manager namespace/openshift-route-controller-manager: Readiness probe status=failure output="Get \"https://10.128.0.70:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 12:04:11.062638 master-0 kubenswrapper[35367]: I1204 12:04:11.062625 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" probeResult="failure" output="Get \"https://10.128.0.70:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 12:04:16.718086 master-0 kubenswrapper[35367]: I1204 12:04:16.718027 35367 kubelet.go:1505] "Image garbage collection succeeded" Dec 04 12:04:16.861195 master-0 kubenswrapper[35367]: I1204 12:04:16.861119 35367 scope.go:117] "RemoveContainer" containerID="f78a7d287972772a3c979bede114291f869074b909122bce68dcbdb34f2d707c" Dec 04 12:04:16.878493 master-0 kubenswrapper[35367]: I1204 12:04:16.878435 35367 scope.go:117] "RemoveContainer" containerID="c7daeda85ec183c8d113e00834a6cc8eb19542aa3278f40e44cf98acd7483141" Dec 04 12:04:16.896611 master-0 kubenswrapper[35367]: I1204 12:04:16.896552 35367 scope.go:117] "RemoveContainer" containerID="a4300d8490d9cbb0f00793e382d3ed2318a1bd59a39a4b37b7e8bc4be83371b7" Dec 04 12:04:16.927243 master-0 kubenswrapper[35367]: I1204 12:04:16.927169 35367 scope.go:117] "RemoveContainer" containerID="56f66e86a303f06a82ff82c486a75d82a740c9bc6ff35f2853c6086d774366c6" Dec 04 12:04:18.616585 master-0 kubenswrapper[35367]: I1204 12:04:18.616489 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"openshift-service-ca.crt" Dec 04 12:04:19.786146 master-0 kubenswrapper[35367]: I1204 12:04:19.786060 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"kube-root-ca.crt" Dec 04 12:04:20.878730 master-0 kubenswrapper[35367]: I1204 12:04:20.878637 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"certified-operators-dockercfg-x4zqf" Dec 04 12:04:21.063063 master-0 kubenswrapper[35367]: I1204 12:04:21.062916 35367 patch_prober.go:28] interesting pod/route-controller-manager-95cb5f987-46bsk container/route-controller-manager namespace/openshift-route-controller-manager: Readiness probe status=failure output="Get \"https://10.128.0.70:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 12:04:21.063560 master-0 kubenswrapper[35367]: I1204 12:04:21.063075 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" probeResult="failure" output="Get \"https://10.128.0.70:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 12:04:21.175150 master-0 kubenswrapper[35367]: I1204 12:04:21.174866 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"kube-root-ca.crt" Dec 04 12:04:21.311951 master-0 kubenswrapper[35367]: I1204 12:04:21.311783 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-client" Dec 04 12:04:21.648212 master-0 kubenswrapper[35367]: I1204 12:04:21.648145 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"config" Dec 04 12:04:21.951331 master-0 kubenswrapper[35367]: I1204 12:04:21.951150 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"openshift-service-ca.crt" Dec 04 12:04:22.182076 master-0 kubenswrapper[35367]: I1204 12:04:22.182025 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"telemetry-config" Dec 04 12:04:22.396087 master-0 kubenswrapper[35367]: I1204 12:04:22.395944 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns-operator"/"metrics-tls" Dec 04 12:04:22.455045 master-0 kubenswrapper[35367]: I1204 12:04:22.454965 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"serving-cert" Dec 04 12:04:22.498337 master-0 kubenswrapper[35367]: I1204 12:04:22.498222 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"config" Dec 04 12:04:22.856467 master-0 kubenswrapper[35367]: I1204 12:04:22.856410 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-storage-operator"/"kube-root-ca.crt" Dec 04 12:04:23.038668 master-0 kubenswrapper[35367]: I1204 12:04:23.038580 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"metrics-daemon-secret" Dec 04 12:04:23.254645 master-0 kubenswrapper[35367]: I1204 12:04:23.254572 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"baremetal-kube-rbac-proxy" Dec 04 12:04:23.331204 master-0 kubenswrapper[35367]: I1204 12:04:23.331143 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"kube-root-ca.crt" Dec 04 12:04:23.339825 master-0 kubenswrapper[35367]: I1204 12:04:23.335083 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-serving-cert" Dec 04 12:04:23.370328 master-0 kubenswrapper[35367]: I1204 12:04:23.370089 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-operator-dockercfg-hkjv7" Dec 04 12:04:23.952847 master-0 kubenswrapper[35367]: I1204 12:04:23.952760 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"serving-cert" Dec 04 12:04:23.973239 master-0 kubenswrapper[35367]: I1204 12:04:23.973132 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"packageserver-service-cert" Dec 04 12:04:24.015459 master-0 kubenswrapper[35367]: I1204 12:04:24.015400 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"trusted-ca-bundle" Dec 04 12:04:24.055161 master-0 kubenswrapper[35367]: I1204 12:04:24.055079 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"openshift-service-ca.crt" Dec 04 12:04:24.132149 master-0 kubenswrapper[35367]: I1204 12:04:24.132053 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"kube-root-ca.crt" Dec 04 12:04:24.152327 master-0 kubenswrapper[35367]: I1204 12:04:24.152246 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication-operator"/"serving-cert" Dec 04 12:04:24.199834 master-0 kubenswrapper[35367]: I1204 12:04:24.199730 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"node-tuning-operator-tls" Dec 04 12:04:24.332639 master-0 kubenswrapper[35367]: I1204 12:04:24.332580 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"openshift-service-ca.crt" Dec 04 12:04:24.383231 master-0 kubenswrapper[35367]: I1204 12:04:24.383168 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-config-operator"/"config-operator-serving-cert" Dec 04 12:04:24.419035 master-0 kubenswrapper[35367]: I1204 12:04:24.418906 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-root-ca.crt" Dec 04 12:04:24.509317 master-0 kubenswrapper[35367]: I1204 12:04:24.509243 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"serving-cert" Dec 04 12:04:24.536104 master-0 kubenswrapper[35367]: I1204 12:04:24.535987 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"machine-config-operator-images" Dec 04 12:04:24.613862 master-0 kubenswrapper[35367]: I1204 12:04:24.613721 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"openshift-service-ca.crt" Dec 04 12:04:24.764617 master-0 kubenswrapper[35367]: I1204 12:04:24.764579 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-rbac-proxy" Dec 04 12:04:24.881077 master-0 kubenswrapper[35367]: I1204 12:04:24.880877 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca"/"signing-key" Dec 04 12:04:24.884892 master-0 kubenswrapper[35367]: I1204 12:04:24.884851 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"openshift-service-ca.crt" Dec 04 12:04:24.918787 master-0 kubenswrapper[35367]: I1204 12:04:24.918722 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-olm-operator"/"cluster-olm-operator-serving-cert" Dec 04 12:04:25.074074 master-0 kubenswrapper[35367]: I1204 12:04:25.074000 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-node-identity"/"network-node-identity-cert" Dec 04 12:04:25.256451 master-0 kubenswrapper[35367]: I1204 12:04:25.256304 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-autoscaler-operator-dockercfg-zs454" Dec 04 12:04:25.329974 master-0 kubenswrapper[35367]: I1204 12:04:25.329907 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"operator-controller-trusted-ca-bundle" Dec 04 12:04:25.335702 master-0 kubenswrapper[35367]: I1204 12:04:25.335641 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-controller-manager-operator"/"cloud-controller-manager-operator-tls" Dec 04 12:04:25.396969 master-0 kubenswrapper[35367]: I1204 12:04:25.396893 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-credential-operator"/"cloud-credential-operator-serving-cert" Dec 04 12:04:25.408063 master-0 kubenswrapper[35367]: I1204 12:04:25.407994 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"openshift-service-ca.crt" Dec 04 12:04:25.518508 master-0 kubenswrapper[35367]: I1204 12:04:25.518340 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"community-operators-dockercfg-kww9g" Dec 04 12:04:25.665450 master-0 kubenswrapper[35367]: I1204 12:04:25.665368 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"marketplace-trusted-ca" Dec 04 12:04:25.678827 master-0 kubenswrapper[35367]: I1204 12:04:25.678736 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"openshift-service-ca.crt" Dec 04 12:04:25.763510 master-0 kubenswrapper[35367]: I1204 12:04:25.763413 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"openshift-service-ca.crt" Dec 04 12:04:25.821726 master-0 kubenswrapper[35367]: I1204 12:04:25.821650 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"openshift-service-ca.crt" Dec 04 12:04:25.837561 master-0 kubenswrapper[35367]: I1204 12:04:25.837475 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-version"/"cluster-version-operator-serving-cert" Dec 04 12:04:25.943958 master-0 kubenswrapper[35367]: I1204 12:04:25.943861 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"dns-default" Dec 04 12:04:25.965132 master-0 kubenswrapper[35367]: I1204 12:04:25.965059 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-service-ca.crt" Dec 04 12:04:26.318654 master-0 kubenswrapper[35367]: I1204 12:04:26.318563 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"kube-root-ca.crt" Dec 04 12:04:26.372418 master-0 kubenswrapper[35367]: I1204 12:04:26.372323 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"env-overrides" Dec 04 12:04:26.384016 master-0 kubenswrapper[35367]: I1204 12:04:26.383957 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"encryption-config-1" Dec 04 12:04:26.424263 master-0 kubenswrapper[35367]: I1204 12:04:26.424193 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"ovnkube-identity-cm" Dec 04 12:04:26.527701 master-0 kubenswrapper[35367]: I1204 12:04:26.527612 35367 reflector.go:368] Caches populated for *v1.RuntimeClass from k8s.io/client-go/informers/factory.go:160 Dec 04 12:04:26.640412 master-0 kubenswrapper[35367]: I1204 12:04:26.640257 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"route-controller-manager-sa-dockercfg-qzw27" Dec 04 12:04:26.642714 master-0 kubenswrapper[35367]: I1204 12:04:26.642679 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"trusted-ca" Dec 04 12:04:26.647442 master-0 kubenswrapper[35367]: I1204 12:04:26.647383 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"trusted-ca" Dec 04 12:04:26.867973 master-0 kubenswrapper[35367]: I1204 12:04:26.867814 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"client-ca" Dec 04 12:04:26.896405 master-0 kubenswrapper[35367]: I1204 12:04:26.896274 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-storage-version-migrator-operator"/"serving-cert" Dec 04 12:04:26.911353 master-0 kubenswrapper[35367]: I1204 12:04:26.911273 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"image-import-ca" Dec 04 12:04:26.931379 master-0 kubenswrapper[35367]: I1204 12:04:26.931312 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"openshift-service-ca.crt" Dec 04 12:04:26.936192 master-0 kubenswrapper[35367]: I1204 12:04:26.936132 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"openshift-service-ca.crt" Dec 04 12:04:26.960774 master-0 kubenswrapper[35367]: I1204 12:04:26.960713 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"cluster-baremetal-operator-images" Dec 04 12:04:26.981097 master-0 kubenswrapper[35367]: I1204 12:04:26.980455 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"redhat-operators-dockercfg-8t954" Dec 04 12:04:27.165621 master-0 kubenswrapper[35367]: I1204 12:04:27.165490 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-autoscaler-operator-cert" Dec 04 12:04:27.230493 master-0 kubenswrapper[35367]: I1204 12:04:27.230435 35367 reflector.go:368] Caches populated for *v1.CSIDriver from k8s.io/client-go/informers/factory.go:160 Dec 04 12:04:27.374947 master-0 kubenswrapper[35367]: I1204 12:04:27.374883 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"machine-api-operator-images" Dec 04 12:04:27.394790 master-0 kubenswrapper[35367]: I1204 12:04:27.394719 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"kube-root-ca.crt" Dec 04 12:04:27.424378 master-0 kubenswrapper[35367]: I1204 12:04:27.424230 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-config" Dec 04 12:04:27.638710 master-0 kubenswrapper[35367]: I1204 12:04:27.638619 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"openshift-service-ca.crt" Dec 04 12:04:27.757929 master-0 kubenswrapper[35367]: I1204 12:04:27.757772 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-scheduler-operator"/"kube-scheduler-operator-serving-cert" Dec 04 12:04:27.793883 master-0 kubenswrapper[35367]: I1204 12:04:27.793798 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"kube-root-ca.crt" Dec 04 12:04:27.912071 master-0 kubenswrapper[35367]: I1204 12:04:27.912025 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"config" Dec 04 12:04:27.947234 master-0 kubenswrapper[35367]: I1204 12:04:27.944402 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"kube-rbac-proxy" Dec 04 12:04:28.013126 master-0 kubenswrapper[35367]: I1204 12:04:28.012933 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-config" Dec 04 12:04:28.014701 master-0 kubenswrapper[35367]: I1204 12:04:28.014640 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-control-plane-metrics-cert" Dec 04 12:04:28.085224 master-0 kubenswrapper[35367]: I1204 12:04:28.085133 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"kube-root-ca.crt" Dec 04 12:04:28.090054 master-0 kubenswrapper[35367]: I1204 12:04:28.089990 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"iptables-alerter-script" Dec 04 12:04:28.094153 master-0 kubenswrapper[35367]: I1204 12:04:28.094083 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns"/"dns-default-metrics-tls" Dec 04 12:04:28.115260 master-0 kubenswrapper[35367]: I1204 12:04:28.115194 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"kube-root-ca.crt" Dec 04 12:04:28.350410 master-0 kubenswrapper[35367]: I1204 12:04:28.349968 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-operator"/"metrics-tls" Dec 04 12:04:28.350410 master-0 kubenswrapper[35367]: I1204 12:04:28.350064 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"control-plane-machine-set-operator-tls" Dec 04 12:04:28.384732 master-0 kubenswrapper[35367]: I1204 12:04:28.384568 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"default-cni-sysctl-allowlist" Dec 04 12:04:28.386633 master-0 kubenswrapper[35367]: I1204 12:04:28.386590 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"cluster-monitoring-operator-tls" Dec 04 12:04:28.401166 master-0 kubenswrapper[35367]: I1204 12:04:28.400988 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-rbac-proxy-cluster-autoscaler-operator" Dec 04 12:04:28.550976 master-0 kubenswrapper[35367]: I1204 12:04:28.550883 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"kube-root-ca.crt" Dec 04 12:04:28.568786 master-0 kubenswrapper[35367]: I1204 12:04:28.568710 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"kube-root-ca.crt" Dec 04 12:04:28.595830 master-0 kubenswrapper[35367]: I1204 12:04:28.595752 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"cni-copy-resources" Dec 04 12:04:28.649033 master-0 kubenswrapper[35367]: I1204 12:04:28.648877 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"machine-api-operator-tls" Dec 04 12:04:28.677061 master-0 kubenswrapper[35367]: I1204 12:04:28.677000 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca-operator"/"serving-cert" Dec 04 12:04:28.838948 master-0 kubenswrapper[35367]: I1204 12:04:28.838854 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Dec 04 12:04:28.861765 master-0 kubenswrapper[35367]: I1204 12:04:28.861630 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"service-ca-bundle" Dec 04 12:04:28.941362 master-0 kubenswrapper[35367]: I1204 12:04:28.941156 35367 reflector.go:368] Caches populated for *v1.Node from k8s.io/client-go/informers/factory.go:160 Dec 04 12:04:28.963265 master-0 kubenswrapper[35367]: I1204 12:04:28.963150 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"openshift-service-ca.crt" Dec 04 12:04:28.985395 master-0 kubenswrapper[35367]: I1204 12:04:28.985311 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-samples-operator"/"openshift-service-ca.crt" Dec 04 12:04:29.002547 master-0 kubenswrapper[35367]: I1204 12:04:29.002455 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"etcd-client" Dec 04 12:04:29.027452 master-0 kubenswrapper[35367]: I1204 12:04:29.027381 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"kube-root-ca.crt" Dec 04 12:04:29.089943 master-0 kubenswrapper[35367]: I1204 12:04:29.089862 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"audit-1" Dec 04 12:04:29.128850 master-0 kubenswrapper[35367]: I1204 12:04:29.128781 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-olm-operator"/"openshift-service-ca.crt" Dec 04 12:04:29.219482 master-0 kubenswrapper[35367]: I1204 12:04:29.219365 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"trusted-ca-bundle" Dec 04 12:04:29.364569 master-0 kubenswrapper[35367]: I1204 12:04:29.364507 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-olm-operator"/"kube-root-ca.crt" Dec 04 12:04:29.547214 master-0 kubenswrapper[35367]: I1204 12:04:29.547084 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"kube-root-ca.crt" Dec 04 12:04:29.724694 master-0 kubenswrapper[35367]: I1204 12:04:29.724626 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"encryption-config-1" Dec 04 12:04:29.804669 master-0 kubenswrapper[35367]: I1204 12:04:29.804336 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"openshift-service-ca.crt" Dec 04 12:04:29.830834 master-0 kubenswrapper[35367]: I1204 12:04:29.830713 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-node-metrics-cert" Dec 04 12:04:29.841598 master-0 kubenswrapper[35367]: I1204 12:04:29.841517 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"trusted-ca-bundle" Dec 04 12:04:29.878798 master-0 kubenswrapper[35367]: I1204 12:04:29.878739 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-machine-approver"/"machine-approver-tls" Dec 04 12:04:30.001521 master-0 kubenswrapper[35367]: I1204 12:04:30.001456 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-storage-operator"/"cluster-storage-operator-serving-cert" Dec 04 12:04:30.044490 master-0 kubenswrapper[35367]: I1204 12:04:30.044410 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kube-root-ca.crt" Dec 04 12:04:30.094933 master-0 kubenswrapper[35367]: I1204 12:04:30.094866 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"authentication-operator-config" Dec 04 12:04:30.103260 master-0 kubenswrapper[35367]: I1204 12:04:30.103198 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-samples-operator"/"kube-root-ca.crt" Dec 04 12:04:30.179751 master-0 kubenswrapper[35367]: I1204 12:04:30.179695 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"olm-operator-serving-cert" Dec 04 12:04:30.225643 master-0 kubenswrapper[35367]: I1204 12:04:30.225560 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-root-ca.crt" Dec 04 12:04:30.273644 master-0 kubenswrapper[35367]: I1204 12:04:30.273598 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"etcd-serving-ca" Dec 04 12:04:30.300389 master-0 kubenswrapper[35367]: I1204 12:04:30.300326 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"signing-cabundle" Dec 04 12:04:30.335343 master-0 kubenswrapper[35367]: I1204 12:04:30.334876 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-config" Dec 04 12:04:30.336795 master-0 kubenswrapper[35367]: I1204 12:04:30.336603 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"kube-root-ca.crt" Dec 04 12:04:30.348763 master-0 kubenswrapper[35367]: I1204 12:04:30.348601 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"multus-daemon-config" Dec 04 12:04:30.363240 master-0 kubenswrapper[35367]: I1204 12:04:30.363179 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator"/"openshift-service-ca.crt" Dec 04 12:04:30.475446 master-0 kubenswrapper[35367]: I1204 12:04:30.475397 35367 reflector.go:368] Caches populated for *v1.Service from k8s.io/client-go/informers/factory.go:160 Dec 04 12:04:30.498197 master-0 kubenswrapper[35367]: I1204 12:04:30.498154 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"openshift-service-ca.crt" Dec 04 12:04:30.551362 master-0 kubenswrapper[35367]: I1204 12:04:30.551315 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"kube-root-ca.crt" Dec 04 12:04:30.571356 master-0 kubenswrapper[35367]: I1204 12:04:30.571272 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"machine-approver-config" Dec 04 12:04:30.601106 master-0 kubenswrapper[35367]: I1204 12:04:30.600983 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"kube-rbac-proxy" Dec 04 12:04:30.696252 master-0 kubenswrapper[35367]: I1204 12:04:30.696172 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-storage-operator"/"openshift-service-ca.crt" Dec 04 12:04:30.699158 master-0 kubenswrapper[35367]: I1204 12:04:30.699081 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-operator-dockercfg-l9v2g" Dec 04 12:04:30.754526 master-0 kubenswrapper[35367]: I1204 12:04:30.754088 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-insights"/"operator-dockercfg-qxdwr" Dec 04 12:04:30.792012 master-0 kubenswrapper[35367]: I1204 12:04:30.791928 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"kube-root-ca.crt" Dec 04 12:04:30.901138 master-0 kubenswrapper[35367]: I1204 12:04:30.900938 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"env-overrides" Dec 04 12:04:31.063625 master-0 kubenswrapper[35367]: I1204 12:04:31.063493 35367 patch_prober.go:28] interesting pod/route-controller-manager-95cb5f987-46bsk container/route-controller-manager namespace/openshift-route-controller-manager: Readiness probe status=failure output="Get \"https://10.128.0.70:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Dec 04 12:04:31.063878 master-0 kubenswrapper[35367]: I1204 12:04:31.063654 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" probeResult="failure" output="Get \"https://10.128.0.70:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 12:04:31.074772 master-0 kubenswrapper[35367]: I1204 12:04:31.074713 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-insights"/"openshift-insights-serving-cert" Dec 04 12:04:31.123832 master-0 kubenswrapper[35367]: I1204 12:04:31.123739 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-catalogd"/"catalogserver-cert" Dec 04 12:04:31.160380 master-0 kubenswrapper[35367]: I1204 12:04:31.160243 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"etcd-client" Dec 04 12:04:31.192006 master-0 kubenswrapper[35367]: I1204 12:04:31.191927 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-global-ca" Dec 04 12:04:31.236103 master-0 kubenswrapper[35367]: I1204 12:04:31.235983 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"image-registry-operator-tls" Dec 04 12:04:31.289927 master-0 kubenswrapper[35367]: I1204 12:04:31.289776 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"openshift-service-ca.crt" Dec 04 12:04:31.431416 master-0 kubenswrapper[35367]: I1204 12:04:31.431239 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"openshift-service-ca.crt" Dec 04 12:04:31.493418 master-0 kubenswrapper[35367]: I1204 12:04:31.493326 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"kube-root-ca.crt" Dec 04 12:04:31.495196 master-0 kubenswrapper[35367]: I1204 12:04:31.494999 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"redhat-marketplace-dockercfg-kpc5q" Dec 04 12:04:31.512121 master-0 kubenswrapper[35367]: I1204 12:04:31.512009 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"openshift-service-ca.crt" Dec 04 12:04:31.565609 master-0 kubenswrapper[35367]: I1204 12:04:31.565489 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"cco-trusted-ca" Dec 04 12:04:31.578564 master-0 kubenswrapper[35367]: I1204 12:04:31.578481 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-operator-serving-cert" Dec 04 12:04:31.690764 master-0 kubenswrapper[35367]: I1204 12:04:31.690604 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"kube-root-ca.crt" Dec 04 12:04:31.835238 master-0 kubenswrapper[35367]: I1204 12:04:31.835164 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator"/"kube-root-ca.crt" Dec 04 12:04:31.846640 master-0 kubenswrapper[35367]: I1204 12:04:31.846544 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"openshift-service-ca.crt" Dec 04 12:04:31.873082 master-0 kubenswrapper[35367]: I1204 12:04:31.873001 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"openshift-service-ca.crt" Dec 04 12:04:31.889717 master-0 kubenswrapper[35367]: I1204 12:04:31.889660 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"kube-root-ca.crt" Dec 04 12:04:31.952484 master-0 kubenswrapper[35367]: I1204 12:04:31.952351 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"mco-proxy-tls" Dec 04 12:04:31.960202 master-0 kubenswrapper[35367]: I1204 12:04:31.960084 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"performance-addon-operator-webhook-cert" Dec 04 12:04:32.003990 master-0 kubenswrapper[35367]: I1204 12:04:32.003884 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"pprof-cert" Dec 04 12:04:32.089835 master-0 kubenswrapper[35367]: I1204 12:04:32.089534 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"catalog-operator-serving-cert" Dec 04 12:04:32.139598 master-0 kubenswrapper[35367]: I1204 12:04:32.139538 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"kube-root-ca.crt" Dec 04 12:04:32.153223 master-0 kubenswrapper[35367]: I1204 12:04:32.153180 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-serving-cert" Dec 04 12:04:32.283118 master-0 kubenswrapper[35367]: I1204 12:04:32.282391 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"kube-root-ca.crt" Dec 04 12:04:32.725368 master-0 kubenswrapper[35367]: I1204 12:04:32.725302 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"catalogd-trusted-ca-bundle" Dec 04 12:04:32.796577 master-0 kubenswrapper[35367]: I1204 12:04:32.796513 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"openshift-service-ca.crt" Dec 04 12:04:32.846273 master-0 kubenswrapper[35367]: I1204 12:04:32.846227 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"kube-root-ca.crt" Dec 04 12:04:32.913311 master-0 kubenswrapper[35367]: I1204 12:04:32.913232 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"kube-root-ca.crt" Dec 04 12:04:32.923370 master-0 kubenswrapper[35367]: I1204 12:04:32.923311 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"package-server-manager-serving-cert" Dec 04 12:04:32.930861 master-0 kubenswrapper[35367]: I1204 12:04:32.930787 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-ca-bundle" Dec 04 12:04:32.969876 master-0 kubenswrapper[35367]: I1204 12:04:32.969796 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"openshift-service-ca.crt" Dec 04 12:04:33.048496 master-0 kubenswrapper[35367]: I1204 12:04:33.048348 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"service-ca-operator-config" Dec 04 12:04:33.102086 master-0 kubenswrapper[35367]: I1204 12:04:33.102019 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"openshift-service-ca.crt" Dec 04 12:04:33.126559 master-0 kubenswrapper[35367]: I1204 12:04:33.126488 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"trusted-ca" Dec 04 12:04:33.135726 master-0 kubenswrapper[35367]: I1204 12:04:33.135677 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-config" Dec 04 12:04:33.163051 master-0 kubenswrapper[35367]: I1204 12:04:33.162996 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"openshift-service-ca.crt" Dec 04 12:04:33.210574 master-0 kubenswrapper[35367]: I1204 12:04:33.210489 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"kube-root-ca.crt" Dec 04 12:04:33.262771 master-0 kubenswrapper[35367]: I1204 12:04:33.262712 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"kube-root-ca.crt" Dec 04 12:04:33.281745 master-0 kubenswrapper[35367]: I1204 12:04:33.281673 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"olm-operator-serviceaccount-dockercfg-8qwsb" Dec 04 12:04:33.600159 master-0 kubenswrapper[35367]: I1204 12:04:33.600111 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-rbac-proxy" Dec 04 12:04:33.619420 master-0 kubenswrapper[35367]: I1204 12:04:33.619372 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"openshift-service-ca.crt" Dec 04 12:04:33.704078 master-0 kubenswrapper[35367]: I1204 12:04:33.703997 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"config" Dec 04 12:04:33.870760 master-0 kubenswrapper[35367]: I1204 12:04:33.870569 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-operator"/"metrics-tls" Dec 04 12:04:33.887196 master-0 kubenswrapper[35367]: I1204 12:04:33.887046 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-service-ca.crt" Dec 04 12:04:33.964951 master-0 kubenswrapper[35367]: I1204 12:04:33.964883 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"service-ca-bundle" Dec 04 12:04:33.990278 master-0 kubenswrapper[35367]: I1204 12:04:33.990216 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"kube-root-ca.crt" Dec 04 12:04:34.134475 master-0 kubenswrapper[35367]: I1204 12:04:34.134232 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-root-ca.crt" Dec 04 12:04:34.153715 master-0 kubenswrapper[35367]: I1204 12:04:34.153631 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"openshift-service-ca.crt" Dec 04 12:04:34.575906 master-0 kubenswrapper[35367]: I1204 12:04:34.575790 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"etcd-serving-ca" Dec 04 12:04:34.664715 master-0 kubenswrapper[35367]: I1204 12:04:34.664604 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-operator-config" Dec 04 12:04:34.818109 master-0 kubenswrapper[35367]: I1204 12:04:34.818047 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"openshift-service-ca.crt" Dec 04 12:04:34.863672 master-0 kubenswrapper[35367]: I1204 12:04:34.863512 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"client-ca" Dec 04 12:04:34.939063 master-0 kubenswrapper[35367]: I1204 12:04:34.938943 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-script-lib" Dec 04 12:04:34.977108 master-0 kubenswrapper[35367]: I1204 12:04:34.977026 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"machine-api-operator-dockercfg-tpbt2" Dec 04 12:04:35.074159 master-0 kubenswrapper[35367]: I1204 12:04:35.074088 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"whereabouts-config" Dec 04 12:04:35.115512 master-0 kubenswrapper[35367]: I1204 12:04:35.115297 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"marketplace-operator-metrics" Dec 04 12:04:35.122971 master-0 kubenswrapper[35367]: I1204 12:04:35.122715 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"kube-root-ca.crt" Dec 04 12:04:35.152689 master-0 kubenswrapper[35367]: I1204 12:04:35.152619 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"kube-root-ca.crt" Dec 04 12:04:35.417667 master-0 kubenswrapper[35367]: I1204 12:04:35.417527 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"cloud-controller-manager-images" Dec 04 12:04:35.419518 master-0 kubenswrapper[35367]: I1204 12:04:35.419464 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"multus-admission-controller-secret" Dec 04 12:04:35.420650 master-0 kubenswrapper[35367]: I1204 12:04:35.420615 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"kube-root-ca.crt" Dec 04 12:04:35.731774 master-0 kubenswrapper[35367]: I1204 12:04:35.731577 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"trusted-ca-bundle" Dec 04 12:04:36.059927 master-0 kubenswrapper[35367]: I1204 12:04:36.059844 35367 reflector.go:368] Caches populated for *v1.Pod from pkg/kubelet/config/apiserver.go:66 Dec 04 12:04:36.062352 master-0 kubenswrapper[35367]: I1204 12:04:36.062276 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" podStartSLOduration=47.062256681 podStartE2EDuration="47.062256681s" podCreationTimestamp="2025-12-04 12:03:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:04:09.722448271 +0000 UTC m=+293.160509529" watchObservedRunningTime="2025-12-04 12:04:36.062256681 +0000 UTC m=+319.500317939" Dec 04 12:04:36.066134 master-0 kubenswrapper[35367]: I1204 12:04:36.066080 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Dec 04 12:04:36.066230 master-0 kubenswrapper[35367]: I1204 12:04:36.066150 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/kube-apiserver-master-0","openshift-machine-config-operator/machine-config-daemon-8jwk5","openshift-image-registry/node-ca-g49xm","openshift-multus/multus-admission-controller-77d4cb9fc-5x5q5","openshift-console-operator/console-operator-54dbc87ccb-n8qgg"] Dec 04 12:04:36.066458 master-0 kubenswrapper[35367]: E1204 12:04:36.066421 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a58ec846-7add-4bef-8382-556bb578824d" containerName="installer" Dec 04 12:04:36.066458 master-0 kubenswrapper[35367]: I1204 12:04:36.066453 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="a58ec846-7add-4bef-8382-556bb578824d" containerName="installer" Dec 04 12:04:36.066705 master-0 kubenswrapper[35367]: I1204 12:04:36.066666 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="a58ec846-7add-4bef-8382-556bb578824d" containerName="installer" Dec 04 12:04:36.066705 master-0 kubenswrapper[35367]: I1204 12:04:36.066682 35367 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="6618e8be-e480-470f-babf-56ddd8340e52" Dec 04 12:04:36.066825 master-0 kubenswrapper[35367]: I1204 12:04:36.066723 35367 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="6618e8be-e480-470f-babf-56ddd8340e52" Dec 04 12:04:36.067438 master-0 kubenswrapper[35367]: I1204 12:04:36.067401 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g49xm" Dec 04 12:04:36.069452 master-0 kubenswrapper[35367]: I1204 12:04:36.069411 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"image-registry-certificates" Dec 04 12:04:36.069721 master-0 kubenswrapper[35367]: I1204 12:04:36.069681 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"node-ca-dockercfg-68j4k" Dec 04 12:04:36.070121 master-0 kubenswrapper[35367]: I1204 12:04:36.070077 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" Dec 04 12:04:36.071509 master-0 kubenswrapper[35367]: I1204 12:04:36.071458 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-admission-controller-77d4cb9fc-5x5q5" Dec 04 12:04:36.072618 master-0 kubenswrapper[35367]: I1204 12:04:36.072563 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2","openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk","openshift-controller-manager/controller-manager-6686654b8d-rrndk","openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq"] Dec 04 12:04:36.073061 master-0 kubenswrapper[35367]: I1204 12:04:36.073002 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" podUID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerName="config-sync-controllers" containerID="cri-o://522499db1b7f9c87ec01e1460e866cf06b4497c66a47056b8d594ba69f505901" gracePeriod=30 Dec 04 12:04:36.073061 master-0 kubenswrapper[35367]: I1204 12:04:36.073024 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" podUID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerName="kube-rbac-proxy" containerID="cri-o://760657f653245b292cc835a469bd76ffdf70307718fd7139083e006a5e12f961" gracePeriod=30 Dec 04 12:04:36.073192 master-0 kubenswrapper[35367]: I1204 12:04:36.073012 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" podUID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerName="cluster-cloud-controller-manager" containerID="cri-o://e6c2fccf4e6fd6d2ffc424d145ecefb24910bddae93bdeeb548a2d4e20d0f630" gracePeriod=30 Dec 04 12:04:36.073192 master-0 kubenswrapper[35367]: I1204 12:04:36.073185 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-54dbc87ccb-n8qgg" Dec 04 12:04:36.073399 master-0 kubenswrapper[35367]: I1204 12:04:36.073359 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" podUID="c835660f-5a79-4679-b9be-8543ca6ef5a1" containerName="machine-approver-controller" containerID="cri-o://699a63b2d7941ed4336c1635f023cff1f0486ae2fd4b4873876780d919314e24" gracePeriod=30 Dec 04 12:04:36.073461 master-0 kubenswrapper[35367]: I1204 12:04:36.073393 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" containerID="cri-o://c1ac7584fc7724b92eddedadea7e444d64b6c1ea5ee822aeb6c33c06347eee0e" gracePeriod=30 Dec 04 12:04:36.074679 master-0 kubenswrapper[35367]: I1204 12:04:36.073736 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"multus-ac-dockercfg-tdcmm" Dec 04 12:04:36.074679 master-0 kubenswrapper[35367]: I1204 12:04:36.073776 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" podUID="24506aa4-ab78-49df-bb58-59093498f13d" containerName="controller-manager" containerID="cri-o://c38ff2120777ff8b1be511702637cc316f617c906d6a31bbe9e628d01aaa9983" gracePeriod=30 Dec 04 12:04:36.074679 master-0 kubenswrapper[35367]: I1204 12:04:36.073851 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:04:36.074679 master-0 kubenswrapper[35367]: I1204 12:04:36.073940 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-daemon-dockercfg-6lrr9" Dec 04 12:04:36.074679 master-0 kubenswrapper[35367]: I1204 12:04:36.073320 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" podUID="c835660f-5a79-4679-b9be-8543ca6ef5a1" containerName="kube-rbac-proxy" containerID="cri-o://77e87b65d2d4db1f1231cca5b248512d4a871ef2353103a6010989d0ff1fc4d1" gracePeriod=30 Dec 04 12:04:36.075328 master-0 kubenswrapper[35367]: I1204 12:04:36.074896 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"proxy-tls" Dec 04 12:04:36.076205 master-0 kubenswrapper[35367]: I1204 12:04:36.075536 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console-operator"/"openshift-service-ca.crt" Dec 04 12:04:36.077334 master-0 kubenswrapper[35367]: I1204 12:04:36.077242 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console-operator"/"console-operator-config" Dec 04 12:04:36.077500 master-0 kubenswrapper[35367]: I1204 12:04:36.077457 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console-operator"/"console-operator-dockercfg-7mzs9" Dec 04 12:04:36.077594 master-0 kubenswrapper[35367]: I1204 12:04:36.077510 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console-operator"/"serving-cert" Dec 04 12:04:36.079546 master-0 kubenswrapper[35367]: I1204 12:04:36.079280 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console-operator"/"kube-root-ca.crt" Dec 04 12:04:36.079668 master-0 kubenswrapper[35367]: I1204 12:04:36.079607 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 12:04:36.085715 master-0 kubenswrapper[35367]: I1204 12:04:36.084509 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console-operator"/"trusted-ca" Dec 04 12:04:36.109734 master-0 kubenswrapper[35367]: I1204 12:04:36.109623 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/kube-apiserver-master-0" podStartSLOduration=27.109577872 podStartE2EDuration="27.109577872s" podCreationTimestamp="2025-12-04 12:04:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:04:36.107468565 +0000 UTC m=+319.545529833" watchObservedRunningTime="2025-12-04 12:04:36.109577872 +0000 UTC m=+319.547639140" Dec 04 12:04:36.158137 master-0 kubenswrapper[35367]: I1204 12:04:36.158042 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-samples-operator"/"samples-operator-tls" Dec 04 12:04:36.164398 master-0 kubenswrapper[35367]: I1204 12:04:36.164315 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"openshift-kube-scheduler-operator-config" Dec 04 12:04:36.193690 master-0 kubenswrapper[35367]: I1204 12:04:36.187238 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckrbs\" (UniqueName: \"kubernetes.io/projected/0ff2cdf4-ea2d-41f9-9887-4334373cf1d5-kube-api-access-ckrbs\") pod \"multus-admission-controller-77d4cb9fc-5x5q5\" (UID: \"0ff2cdf4-ea2d-41f9-9887-4334373cf1d5\") " pod="openshift-multus/multus-admission-controller-77d4cb9fc-5x5q5" Dec 04 12:04:36.193690 master-0 kubenswrapper[35367]: I1204 12:04:36.187405 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rootfs\" (UniqueName: \"kubernetes.io/host-path/99eb764e-656c-4873-a2cd-308ce9c31a7d-rootfs\") pod \"machine-config-daemon-8jwk5\" (UID: \"99eb764e-656c-4873-a2cd-308ce9c31a7d\") " pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" Dec 04 12:04:36.193690 master-0 kubenswrapper[35367]: I1204 12:04:36.187465 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3767f36c-5cb6-4dd1-8d04-812aeb193dad-trusted-ca\") pod \"console-operator-54dbc87ccb-n8qgg\" (UID: \"3767f36c-5cb6-4dd1-8d04-812aeb193dad\") " pod="openshift-console-operator/console-operator-54dbc87ccb-n8qgg" Dec 04 12:04:36.193690 master-0 kubenswrapper[35367]: I1204 12:04:36.187547 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3767f36c-5cb6-4dd1-8d04-812aeb193dad-serving-cert\") pod \"console-operator-54dbc87ccb-n8qgg\" (UID: \"3767f36c-5cb6-4dd1-8d04-812aeb193dad\") " pod="openshift-console-operator/console-operator-54dbc87ccb-n8qgg" Dec 04 12:04:36.193690 master-0 kubenswrapper[35367]: I1204 12:04:36.187583 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx5dk\" (UniqueName: \"kubernetes.io/projected/3767f36c-5cb6-4dd1-8d04-812aeb193dad-kube-api-access-nx5dk\") pod \"console-operator-54dbc87ccb-n8qgg\" (UID: \"3767f36c-5cb6-4dd1-8d04-812aeb193dad\") " pod="openshift-console-operator/console-operator-54dbc87ccb-n8qgg" Dec 04 12:04:36.193690 master-0 kubenswrapper[35367]: I1204 12:04:36.187644 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/99eb764e-656c-4873-a2cd-308ce9c31a7d-proxy-tls\") pod \"machine-config-daemon-8jwk5\" (UID: \"99eb764e-656c-4873-a2cd-308ce9c31a7d\") " pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" Dec 04 12:04:36.193690 master-0 kubenswrapper[35367]: I1204 12:04:36.187687 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3767f36c-5cb6-4dd1-8d04-812aeb193dad-config\") pod \"console-operator-54dbc87ccb-n8qgg\" (UID: \"3767f36c-5cb6-4dd1-8d04-812aeb193dad\") " pod="openshift-console-operator/console-operator-54dbc87ccb-n8qgg" Dec 04 12:04:36.193690 master-0 kubenswrapper[35367]: I1204 12:04:36.187723 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d8a32876-8fcd-4297-8ae3-274e88039a41-host\") pod \"node-ca-g49xm\" (UID: \"d8a32876-8fcd-4297-8ae3-274e88039a41\") " pod="openshift-image-registry/node-ca-g49xm" Dec 04 12:04:36.193690 master-0 kubenswrapper[35367]: I1204 12:04:36.187771 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqcln\" (UniqueName: \"kubernetes.io/projected/d8a32876-8fcd-4297-8ae3-274e88039a41-kube-api-access-mqcln\") pod \"node-ca-g49xm\" (UID: \"d8a32876-8fcd-4297-8ae3-274e88039a41\") " pod="openshift-image-registry/node-ca-g49xm" Dec 04 12:04:36.193690 master-0 kubenswrapper[35367]: I1204 12:04:36.187822 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d8a32876-8fcd-4297-8ae3-274e88039a41-serviceca\") pod \"node-ca-g49xm\" (UID: \"d8a32876-8fcd-4297-8ae3-274e88039a41\") " pod="openshift-image-registry/node-ca-g49xm" Dec 04 12:04:36.193690 master-0 kubenswrapper[35367]: I1204 12:04:36.187865 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/99eb764e-656c-4873-a2cd-308ce9c31a7d-mcd-auth-proxy-config\") pod \"machine-config-daemon-8jwk5\" (UID: \"99eb764e-656c-4873-a2cd-308ce9c31a7d\") " pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" Dec 04 12:04:36.193690 master-0 kubenswrapper[35367]: I1204 12:04:36.187905 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7rr6\" (UniqueName: \"kubernetes.io/projected/99eb764e-656c-4873-a2cd-308ce9c31a7d-kube-api-access-v7rr6\") pod \"machine-config-daemon-8jwk5\" (UID: \"99eb764e-656c-4873-a2cd-308ce9c31a7d\") " pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" Dec 04 12:04:36.193690 master-0 kubenswrapper[35367]: I1204 12:04:36.187935 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/0ff2cdf4-ea2d-41f9-9887-4334373cf1d5-webhook-certs\") pod \"multus-admission-controller-77d4cb9fc-5x5q5\" (UID: \"0ff2cdf4-ea2d-41f9-9887-4334373cf1d5\") " pod="openshift-multus/multus-admission-controller-77d4cb9fc-5x5q5" Dec 04 12:04:36.232129 master-0 kubenswrapper[35367]: I1204 12:04:36.232069 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-config" Dec 04 12:04:36.251033 master-0 kubenswrapper[35367]: I1204 12:04:36.250957 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"kube-root-ca.crt" Dec 04 12:04:36.289130 master-0 kubenswrapper[35367]: I1204 12:04:36.289055 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ckrbs\" (UniqueName: \"kubernetes.io/projected/0ff2cdf4-ea2d-41f9-9887-4334373cf1d5-kube-api-access-ckrbs\") pod \"multus-admission-controller-77d4cb9fc-5x5q5\" (UID: \"0ff2cdf4-ea2d-41f9-9887-4334373cf1d5\") " pod="openshift-multus/multus-admission-controller-77d4cb9fc-5x5q5" Dec 04 12:04:36.289434 master-0 kubenswrapper[35367]: I1204 12:04:36.289145 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rootfs\" (UniqueName: \"kubernetes.io/host-path/99eb764e-656c-4873-a2cd-308ce9c31a7d-rootfs\") pod \"machine-config-daemon-8jwk5\" (UID: \"99eb764e-656c-4873-a2cd-308ce9c31a7d\") " pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" Dec 04 12:04:36.289434 master-0 kubenswrapper[35367]: I1204 12:04:36.289188 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3767f36c-5cb6-4dd1-8d04-812aeb193dad-trusted-ca\") pod \"console-operator-54dbc87ccb-n8qgg\" (UID: \"3767f36c-5cb6-4dd1-8d04-812aeb193dad\") " pod="openshift-console-operator/console-operator-54dbc87ccb-n8qgg" Dec 04 12:04:36.289434 master-0 kubenswrapper[35367]: I1204 12:04:36.289219 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3767f36c-5cb6-4dd1-8d04-812aeb193dad-serving-cert\") pod \"console-operator-54dbc87ccb-n8qgg\" (UID: \"3767f36c-5cb6-4dd1-8d04-812aeb193dad\") " pod="openshift-console-operator/console-operator-54dbc87ccb-n8qgg" Dec 04 12:04:36.289552 master-0 kubenswrapper[35367]: I1204 12:04:36.289437 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nx5dk\" (UniqueName: \"kubernetes.io/projected/3767f36c-5cb6-4dd1-8d04-812aeb193dad-kube-api-access-nx5dk\") pod \"console-operator-54dbc87ccb-n8qgg\" (UID: \"3767f36c-5cb6-4dd1-8d04-812aeb193dad\") " pod="openshift-console-operator/console-operator-54dbc87ccb-n8qgg" Dec 04 12:04:36.289689 master-0 kubenswrapper[35367]: I1204 12:04:36.289657 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/99eb764e-656c-4873-a2cd-308ce9c31a7d-proxy-tls\") pod \"machine-config-daemon-8jwk5\" (UID: \"99eb764e-656c-4873-a2cd-308ce9c31a7d\") " pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" Dec 04 12:04:36.290690 master-0 kubenswrapper[35367]: I1204 12:04:36.290623 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rootfs\" (UniqueName: \"kubernetes.io/host-path/99eb764e-656c-4873-a2cd-308ce9c31a7d-rootfs\") pod \"machine-config-daemon-8jwk5\" (UID: \"99eb764e-656c-4873-a2cd-308ce9c31a7d\") " pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" Dec 04 12:04:36.290764 master-0 kubenswrapper[35367]: I1204 12:04:36.290638 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3767f36c-5cb6-4dd1-8d04-812aeb193dad-config\") pod \"console-operator-54dbc87ccb-n8qgg\" (UID: \"3767f36c-5cb6-4dd1-8d04-812aeb193dad\") " pod="openshift-console-operator/console-operator-54dbc87ccb-n8qgg" Dec 04 12:04:36.290943 master-0 kubenswrapper[35367]: I1204 12:04:36.290907 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d8a32876-8fcd-4297-8ae3-274e88039a41-host\") pod \"node-ca-g49xm\" (UID: \"d8a32876-8fcd-4297-8ae3-274e88039a41\") " pod="openshift-image-registry/node-ca-g49xm" Dec 04 12:04:36.291007 master-0 kubenswrapper[35367]: I1204 12:04:36.290964 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mqcln\" (UniqueName: \"kubernetes.io/projected/d8a32876-8fcd-4297-8ae3-274e88039a41-kube-api-access-mqcln\") pod \"node-ca-g49xm\" (UID: \"d8a32876-8fcd-4297-8ae3-274e88039a41\") " pod="openshift-image-registry/node-ca-g49xm" Dec 04 12:04:36.291069 master-0 kubenswrapper[35367]: I1204 12:04:36.291009 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d8a32876-8fcd-4297-8ae3-274e88039a41-serviceca\") pod \"node-ca-g49xm\" (UID: \"d8a32876-8fcd-4297-8ae3-274e88039a41\") " pod="openshift-image-registry/node-ca-g49xm" Dec 04 12:04:36.291069 master-0 kubenswrapper[35367]: I1204 12:04:36.291053 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/99eb764e-656c-4873-a2cd-308ce9c31a7d-mcd-auth-proxy-config\") pod \"machine-config-daemon-8jwk5\" (UID: \"99eb764e-656c-4873-a2cd-308ce9c31a7d\") " pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" Dec 04 12:04:36.291622 master-0 kubenswrapper[35367]: I1204 12:04:36.291089 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v7rr6\" (UniqueName: \"kubernetes.io/projected/99eb764e-656c-4873-a2cd-308ce9c31a7d-kube-api-access-v7rr6\") pod \"machine-config-daemon-8jwk5\" (UID: \"99eb764e-656c-4873-a2cd-308ce9c31a7d\") " pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" Dec 04 12:04:36.291622 master-0 kubenswrapper[35367]: I1204 12:04:36.291120 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/0ff2cdf4-ea2d-41f9-9887-4334373cf1d5-webhook-certs\") pod \"multus-admission-controller-77d4cb9fc-5x5q5\" (UID: \"0ff2cdf4-ea2d-41f9-9887-4334373cf1d5\") " pod="openshift-multus/multus-admission-controller-77d4cb9fc-5x5q5" Dec 04 12:04:36.292481 master-0 kubenswrapper[35367]: I1204 12:04:36.291771 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d8a32876-8fcd-4297-8ae3-274e88039a41-host\") pod \"node-ca-g49xm\" (UID: \"d8a32876-8fcd-4297-8ae3-274e88039a41\") " pod="openshift-image-registry/node-ca-g49xm" Dec 04 12:04:36.292481 master-0 kubenswrapper[35367]: I1204 12:04:36.291974 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3767f36c-5cb6-4dd1-8d04-812aeb193dad-config\") pod \"console-operator-54dbc87ccb-n8qgg\" (UID: \"3767f36c-5cb6-4dd1-8d04-812aeb193dad\") " pod="openshift-console-operator/console-operator-54dbc87ccb-n8qgg" Dec 04 12:04:36.292481 master-0 kubenswrapper[35367]: I1204 12:04:36.292134 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/99eb764e-656c-4873-a2cd-308ce9c31a7d-mcd-auth-proxy-config\") pod \"machine-config-daemon-8jwk5\" (UID: \"99eb764e-656c-4873-a2cd-308ce9c31a7d\") " pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" Dec 04 12:04:36.292481 master-0 kubenswrapper[35367]: I1204 12:04:36.292420 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d8a32876-8fcd-4297-8ae3-274e88039a41-serviceca\") pod \"node-ca-g49xm\" (UID: \"d8a32876-8fcd-4297-8ae3-274e88039a41\") " pod="openshift-image-registry/node-ca-g49xm" Dec 04 12:04:36.293288 master-0 kubenswrapper[35367]: I1204 12:04:36.293238 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3767f36c-5cb6-4dd1-8d04-812aeb193dad-trusted-ca\") pod \"console-operator-54dbc87ccb-n8qgg\" (UID: \"3767f36c-5cb6-4dd1-8d04-812aeb193dad\") " pod="openshift-console-operator/console-operator-54dbc87ccb-n8qgg" Dec 04 12:04:36.297600 master-0 kubenswrapper[35367]: I1204 12:04:36.297549 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/99eb764e-656c-4873-a2cd-308ce9c31a7d-proxy-tls\") pod \"machine-config-daemon-8jwk5\" (UID: \"99eb764e-656c-4873-a2cd-308ce9c31a7d\") " pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" Dec 04 12:04:36.298683 master-0 kubenswrapper[35367]: I1204 12:04:36.298596 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/0ff2cdf4-ea2d-41f9-9887-4334373cf1d5-webhook-certs\") pod \"multus-admission-controller-77d4cb9fc-5x5q5\" (UID: \"0ff2cdf4-ea2d-41f9-9887-4334373cf1d5\") " pod="openshift-multus/multus-admission-controller-77d4cb9fc-5x5q5" Dec 04 12:04:36.307968 master-0 kubenswrapper[35367]: I1204 12:04:36.307905 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3767f36c-5cb6-4dd1-8d04-812aeb193dad-serving-cert\") pod \"console-operator-54dbc87ccb-n8qgg\" (UID: \"3767f36c-5cb6-4dd1-8d04-812aeb193dad\") " pod="openshift-console-operator/console-operator-54dbc87ccb-n8qgg" Dec 04 12:04:36.308900 master-0 kubenswrapper[35367]: I1204 12:04:36.308849 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckrbs\" (UniqueName: \"kubernetes.io/projected/0ff2cdf4-ea2d-41f9-9887-4334373cf1d5-kube-api-access-ckrbs\") pod \"multus-admission-controller-77d4cb9fc-5x5q5\" (UID: \"0ff2cdf4-ea2d-41f9-9887-4334373cf1d5\") " pod="openshift-multus/multus-admission-controller-77d4cb9fc-5x5q5" Dec 04 12:04:36.309247 master-0 kubenswrapper[35367]: I1204 12:04:36.309189 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7rr6\" (UniqueName: \"kubernetes.io/projected/99eb764e-656c-4873-a2cd-308ce9c31a7d-kube-api-access-v7rr6\") pod \"machine-config-daemon-8jwk5\" (UID: \"99eb764e-656c-4873-a2cd-308ce9c31a7d\") " pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" Dec 04 12:04:36.313025 master-0 kubenswrapper[35367]: I1204 12:04:36.312873 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx5dk\" (UniqueName: \"kubernetes.io/projected/3767f36c-5cb6-4dd1-8d04-812aeb193dad-kube-api-access-nx5dk\") pod \"console-operator-54dbc87ccb-n8qgg\" (UID: \"3767f36c-5cb6-4dd1-8d04-812aeb193dad\") " pod="openshift-console-operator/console-operator-54dbc87ccb-n8qgg" Dec 04 12:04:36.313025 master-0 kubenswrapper[35367]: I1204 12:04:36.312894 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqcln\" (UniqueName: \"kubernetes.io/projected/d8a32876-8fcd-4297-8ae3-274e88039a41-kube-api-access-mqcln\") pod \"node-ca-g49xm\" (UID: \"d8a32876-8fcd-4297-8ae3-274e88039a41\") " pod="openshift-image-registry/node-ca-g49xm" Dec 04 12:04:36.347423 master-0 kubenswrapper[35367]: I1204 12:04:36.347367 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-serving-cert" Dec 04 12:04:36.347660 master-0 kubenswrapper[35367]: I1204 12:04:36.347562 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-root-ca.crt" Dec 04 12:04:36.412871 master-0 kubenswrapper[35367]: I1204 12:04:36.412776 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g49xm" Dec 04 12:04:36.493215 master-0 kubenswrapper[35367]: I1204 12:04:36.493130 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-service-ca-bundle" Dec 04 12:04:36.508562 master-0 kubenswrapper[35367]: I1204 12:04:36.508527 35367 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Dec 04 12:04:36.515175 master-0 kubenswrapper[35367]: I1204 12:04:36.515105 35367 generic.go:334] "Generic (PLEG): container finished" podID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerID="c1ac7584fc7724b92eddedadea7e444d64b6c1ea5ee822aeb6c33c06347eee0e" exitCode=0 Dec 04 12:04:36.515453 master-0 kubenswrapper[35367]: I1204 12:04:36.515224 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" event={"ID":"e4d7939a-5961-4608-b910-73e71aa55bf6","Type":"ContainerDied","Data":"c1ac7584fc7724b92eddedadea7e444d64b6c1ea5ee822aeb6c33c06347eee0e"} Dec 04 12:04:36.515453 master-0 kubenswrapper[35367]: I1204 12:04:36.515266 35367 scope.go:117] "RemoveContainer" containerID="388a36eac650c8c09011f149057b67b4396ceec6d06ae7dcaa9fd13f4018f169" Dec 04 12:04:36.518837 master-0 kubenswrapper[35367]: I1204 12:04:36.518762 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" Dec 04 12:04:36.518926 master-0 kubenswrapper[35367]: I1204 12:04:36.518883 35367 generic.go:334] "Generic (PLEG): container finished" podID="24506aa4-ab78-49df-bb58-59093498f13d" containerID="c38ff2120777ff8b1be511702637cc316f617c906d6a31bbe9e628d01aaa9983" exitCode=0 Dec 04 12:04:36.519059 master-0 kubenswrapper[35367]: I1204 12:04:36.519015 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" event={"ID":"24506aa4-ab78-49df-bb58-59093498f13d","Type":"ContainerDied","Data":"c38ff2120777ff8b1be511702637cc316f617c906d6a31bbe9e628d01aaa9983"} Dec 04 12:04:36.525319 master-0 kubenswrapper[35367]: I1204 12:04:36.523643 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-machine-approver_machine-approver-f797d8546-qvgbq_c835660f-5a79-4679-b9be-8543ca6ef5a1/machine-approver-controller/0.log" Dec 04 12:04:36.529687 master-0 kubenswrapper[35367]: I1204 12:04:36.529234 35367 generic.go:334] "Generic (PLEG): container finished" podID="c835660f-5a79-4679-b9be-8543ca6ef5a1" containerID="699a63b2d7941ed4336c1635f023cff1f0486ae2fd4b4873876780d919314e24" exitCode=0 Dec 04 12:04:36.529687 master-0 kubenswrapper[35367]: I1204 12:04:36.529288 35367 generic.go:334] "Generic (PLEG): container finished" podID="c835660f-5a79-4679-b9be-8543ca6ef5a1" containerID="77e87b65d2d4db1f1231cca5b248512d4a871ef2353103a6010989d0ff1fc4d1" exitCode=0 Dec 04 12:04:36.529687 master-0 kubenswrapper[35367]: I1204 12:04:36.529316 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" event={"ID":"c835660f-5a79-4679-b9be-8543ca6ef5a1","Type":"ContainerDied","Data":"699a63b2d7941ed4336c1635f023cff1f0486ae2fd4b4873876780d919314e24"} Dec 04 12:04:36.529687 master-0 kubenswrapper[35367]: I1204 12:04:36.529400 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" event={"ID":"c835660f-5a79-4679-b9be-8543ca6ef5a1","Type":"ContainerDied","Data":"77e87b65d2d4db1f1231cca5b248512d4a871ef2353103a6010989d0ff1fc4d1"} Dec 04 12:04:36.529687 master-0 kubenswrapper[35367]: I1204 12:04:36.529428 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" event={"ID":"c835660f-5a79-4679-b9be-8543ca6ef5a1","Type":"ContainerDied","Data":"40749160ea3271ba79ddd289ecc16ddea5467363a62ec473910d1a7a9d5f865a"} Dec 04 12:04:36.529687 master-0 kubenswrapper[35367]: I1204 12:04:36.529442 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40749160ea3271ba79ddd289ecc16ddea5467363a62ec473910d1a7a9d5f865a" Dec 04 12:04:36.534993 master-0 kubenswrapper[35367]: I1204 12:04:36.534951 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-74f484689c-jmfn2_f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48/config-sync-controllers/0.log" Dec 04 12:04:36.536145 master-0 kubenswrapper[35367]: I1204 12:04:36.536098 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-74f484689c-jmfn2_f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48/cluster-cloud-controller-manager/0.log" Dec 04 12:04:36.536226 master-0 kubenswrapper[35367]: I1204 12:04:36.536176 35367 generic.go:334] "Generic (PLEG): container finished" podID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerID="e6c2fccf4e6fd6d2ffc424d145ecefb24910bddae93bdeeb548a2d4e20d0f630" exitCode=0 Dec 04 12:04:36.536226 master-0 kubenswrapper[35367]: I1204 12:04:36.536207 35367 generic.go:334] "Generic (PLEG): container finished" podID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerID="522499db1b7f9c87ec01e1460e866cf06b4497c66a47056b8d594ba69f505901" exitCode=0 Dec 04 12:04:36.536226 master-0 kubenswrapper[35367]: I1204 12:04:36.536218 35367 generic.go:334] "Generic (PLEG): container finished" podID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerID="760657f653245b292cc835a469bd76ffdf70307718fd7139083e006a5e12f961" exitCode=0 Dec 04 12:04:36.536385 master-0 kubenswrapper[35367]: I1204 12:04:36.536325 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" event={"ID":"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48","Type":"ContainerDied","Data":"e6c2fccf4e6fd6d2ffc424d145ecefb24910bddae93bdeeb548a2d4e20d0f630"} Dec 04 12:04:36.536433 master-0 kubenswrapper[35367]: I1204 12:04:36.536410 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" event={"ID":"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48","Type":"ContainerDied","Data":"522499db1b7f9c87ec01e1460e866cf06b4497c66a47056b8d594ba69f505901"} Dec 04 12:04:36.536611 master-0 kubenswrapper[35367]: I1204 12:04:36.536436 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" event={"ID":"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48","Type":"ContainerDied","Data":"760657f653245b292cc835a469bd76ffdf70307718fd7139083e006a5e12f961"} Dec 04 12:04:36.536611 master-0 kubenswrapper[35367]: I1204 12:04:36.536455 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" event={"ID":"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48","Type":"ContainerDied","Data":"38aff0440f5b265ce52ca882bf70fe892cd569736c1a9aa92adc7ee8587a099b"} Dec 04 12:04:36.536611 master-0 kubenswrapper[35367]: I1204 12:04:36.536469 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38aff0440f5b265ce52ca882bf70fe892cd569736c1a9aa92adc7ee8587a099b" Dec 04 12:04:36.548150 master-0 kubenswrapper[35367]: W1204 12:04:36.548093 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99eb764e_656c_4873_a2cd_308ce9c31a7d.slice/crio-ec878bdf254b0bede8f78bcede1a350d830f678f4f93e34a159fd2ab2127dde9 WatchSource:0}: Error finding container ec878bdf254b0bede8f78bcede1a350d830f678f4f93e34a159fd2ab2127dde9: Status 404 returned error can't find the container with id ec878bdf254b0bede8f78bcede1a350d830f678f4f93e34a159fd2ab2127dde9 Dec 04 12:04:36.582901 master-0 kubenswrapper[35367]: I1204 12:04:36.582860 35367 scope.go:117] "RemoveContainer" containerID="89ac9be46243609bde604f4ef89b49eac3ee3ceca2042c8efeae7607ac835469" Dec 04 12:04:36.584860 master-0 kubenswrapper[35367]: I1204 12:04:36.583868 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-admission-controller-77d4cb9fc-5x5q5" Dec 04 12:04:36.596858 master-0 kubenswrapper[35367]: I1204 12:04:36.596625 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-54dbc87ccb-n8qgg" Dec 04 12:04:36.600549 master-0 kubenswrapper[35367]: I1204 12:04:36.600508 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-machine-approver_machine-approver-f797d8546-qvgbq_c835660f-5a79-4679-b9be-8543ca6ef5a1/machine-approver-controller/0.log" Dec 04 12:04:36.601577 master-0 kubenswrapper[35367]: I1204 12:04:36.601541 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 12:04:36.642157 master-0 kubenswrapper[35367]: I1204 12:04:36.642003 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-74f484689c-jmfn2_f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48/config-sync-controllers/0.log" Dec 04 12:04:36.643530 master-0 kubenswrapper[35367]: I1204 12:04:36.642979 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-74f484689c-jmfn2_f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48/cluster-cloud-controller-manager/0.log" Dec 04 12:04:36.643530 master-0 kubenswrapper[35367]: I1204 12:04:36.643098 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 12:04:36.651229 master-0 kubenswrapper[35367]: I1204 12:04:36.651179 35367 scope.go:117] "RemoveContainer" containerID="749b44ec9e8d4f00f1e655c70a503d3b1ce1085e0a7eecca2e01f8fe90a6e0c2" Dec 04 12:04:36.688907 master-0 kubenswrapper[35367]: I1204 12:04:36.688862 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-operator-tls" Dec 04 12:04:36.696746 master-0 kubenswrapper[35367]: I1204 12:04:36.696695 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 12:04:36.700372 master-0 kubenswrapper[35367]: I1204 12:04:36.700320 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/c835660f-5a79-4679-b9be-8543ca6ef5a1-auth-proxy-config\") pod \"c835660f-5a79-4679-b9be-8543ca6ef5a1\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " Dec 04 12:04:36.700372 master-0 kubenswrapper[35367]: I1204 12:04:36.700365 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c835660f-5a79-4679-b9be-8543ca6ef5a1-config\") pod \"c835660f-5a79-4679-b9be-8543ca6ef5a1\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " Dec 04 12:04:36.700560 master-0 kubenswrapper[35367]: I1204 12:04:36.700412 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxbts\" (UniqueName: \"kubernetes.io/projected/c835660f-5a79-4679-b9be-8543ca6ef5a1-kube-api-access-nxbts\") pod \"c835660f-5a79-4679-b9be-8543ca6ef5a1\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " Dec 04 12:04:36.700560 master-0 kubenswrapper[35367]: I1204 12:04:36.700509 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/c835660f-5a79-4679-b9be-8543ca6ef5a1-machine-approver-tls\") pod \"c835660f-5a79-4679-b9be-8543ca6ef5a1\" (UID: \"c835660f-5a79-4679-b9be-8543ca6ef5a1\") " Dec 04 12:04:36.701162 master-0 kubenswrapper[35367]: I1204 12:04:36.701097 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c835660f-5a79-4679-b9be-8543ca6ef5a1-config" (OuterVolumeSpecName: "config") pod "c835660f-5a79-4679-b9be-8543ca6ef5a1" (UID: "c835660f-5a79-4679-b9be-8543ca6ef5a1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:04:36.701646 master-0 kubenswrapper[35367]: I1204 12:04:36.701591 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c835660f-5a79-4679-b9be-8543ca6ef5a1-auth-proxy-config" (OuterVolumeSpecName: "auth-proxy-config") pod "c835660f-5a79-4679-b9be-8543ca6ef5a1" (UID: "c835660f-5a79-4679-b9be-8543ca6ef5a1"). InnerVolumeSpecName "auth-proxy-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:04:36.707665 master-0 kubenswrapper[35367]: I1204 12:04:36.707626 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 12:04:36.707921 master-0 kubenswrapper[35367]: I1204 12:04:36.707749 35367 scope.go:117] "RemoveContainer" containerID="a88d1f0e1d80ac478f7ad73d99091a69eb94f507aee6c58fd48df49c97a44d8d" Dec 04 12:04:36.710872 master-0 kubenswrapper[35367]: I1204 12:04:36.710051 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c835660f-5a79-4679-b9be-8543ca6ef5a1-kube-api-access-nxbts" (OuterVolumeSpecName: "kube-api-access-nxbts") pod "c835660f-5a79-4679-b9be-8543ca6ef5a1" (UID: "c835660f-5a79-4679-b9be-8543ca6ef5a1"). InnerVolumeSpecName "kube-api-access-nxbts". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:04:36.710872 master-0 kubenswrapper[35367]: I1204 12:04:36.710655 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c835660f-5a79-4679-b9be-8543ca6ef5a1-machine-approver-tls" (OuterVolumeSpecName: "machine-approver-tls") pod "c835660f-5a79-4679-b9be-8543ca6ef5a1" (UID: "c835660f-5a79-4679-b9be-8543ca6ef5a1"). InnerVolumeSpecName "machine-approver-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:04:36.733126 master-0 kubenswrapper[35367]: I1204 12:04:36.733070 35367 scope.go:117] "RemoveContainer" containerID="7169aa966534042a209dbc77d82db08548c2b38ca834a1a1b58302b3c9862901" Dec 04 12:04:36.804887 master-0 kubenswrapper[35367]: I1204 12:04:36.804563 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d77m8\" (UniqueName: \"kubernetes.io/projected/e4d7939a-5961-4608-b910-73e71aa55bf6-kube-api-access-d77m8\") pod \"e4d7939a-5961-4608-b910-73e71aa55bf6\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " Dec 04 12:04:36.804887 master-0 kubenswrapper[35367]: I1204 12:04:36.804630 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-client-ca\") pod \"24506aa4-ab78-49df-bb58-59093498f13d\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " Dec 04 12:04:36.804887 master-0 kubenswrapper[35367]: I1204 12:04:36.804656 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-client-ca\") pod \"e4d7939a-5961-4608-b910-73e71aa55bf6\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " Dec 04 12:04:36.804887 master-0 kubenswrapper[35367]: I1204 12:04:36.804691 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-auth-proxy-config\") pod \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " Dec 04 12:04:36.804887 master-0 kubenswrapper[35367]: I1204 12:04:36.804716 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2qnk\" (UniqueName: \"kubernetes.io/projected/24506aa4-ab78-49df-bb58-59093498f13d-kube-api-access-w2qnk\") pod \"24506aa4-ab78-49df-bb58-59093498f13d\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " Dec 04 12:04:36.804887 master-0 kubenswrapper[35367]: I1204 12:04:36.804746 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-config\") pod \"24506aa4-ab78-49df-bb58-59093498f13d\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " Dec 04 12:04:36.804887 master-0 kubenswrapper[35367]: I1204 12:04:36.804775 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-images\") pod \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " Dec 04 12:04:36.804887 master-0 kubenswrapper[35367]: I1204 12:04:36.804791 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fssw\" (UniqueName: \"kubernetes.io/projected/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-kube-api-access-6fssw\") pod \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " Dec 04 12:04:36.804887 master-0 kubenswrapper[35367]: I1204 12:04:36.804880 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24506aa4-ab78-49df-bb58-59093498f13d-serving-cert\") pod \"24506aa4-ab78-49df-bb58-59093498f13d\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " Dec 04 12:04:36.804887 master-0 kubenswrapper[35367]: I1204 12:04:36.804901 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4d7939a-5961-4608-b910-73e71aa55bf6-serving-cert\") pod \"e4d7939a-5961-4608-b910-73e71aa55bf6\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " Dec 04 12:04:36.804887 master-0 kubenswrapper[35367]: I1204 12:04:36.804940 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-cloud-controller-manager-operator-tls\") pod \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " Dec 04 12:04:36.808122 master-0 kubenswrapper[35367]: I1204 12:04:36.804974 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-config\") pod \"e4d7939a-5961-4608-b910-73e71aa55bf6\" (UID: \"e4d7939a-5961-4608-b910-73e71aa55bf6\") " Dec 04 12:04:36.808122 master-0 kubenswrapper[35367]: I1204 12:04:36.805056 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-proxy-ca-bundles\") pod \"24506aa4-ab78-49df-bb58-59093498f13d\" (UID: \"24506aa4-ab78-49df-bb58-59093498f13d\") " Dec 04 12:04:36.808122 master-0 kubenswrapper[35367]: I1204 12:04:36.805088 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-host-etc-kube\") pod \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\" (UID: \"f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48\") " Dec 04 12:04:36.808122 master-0 kubenswrapper[35367]: I1204 12:04:36.805351 35367 reconciler_common.go:293] "Volume detached for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/c835660f-5a79-4679-b9be-8543ca6ef5a1-machine-approver-tls\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:36.808122 master-0 kubenswrapper[35367]: I1204 12:04:36.805374 35367 reconciler_common.go:293] "Volume detached for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/c835660f-5a79-4679-b9be-8543ca6ef5a1-auth-proxy-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:36.808122 master-0 kubenswrapper[35367]: I1204 12:04:36.805393 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c835660f-5a79-4679-b9be-8543ca6ef5a1-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:36.808122 master-0 kubenswrapper[35367]: I1204 12:04:36.805407 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nxbts\" (UniqueName: \"kubernetes.io/projected/c835660f-5a79-4679-b9be-8543ca6ef5a1-kube-api-access-nxbts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:36.808122 master-0 kubenswrapper[35367]: I1204 12:04:36.805486 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-host-etc-kube" (OuterVolumeSpecName: "host-etc-kube") pod "f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" (UID: "f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48"). InnerVolumeSpecName "host-etc-kube". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:04:36.808122 master-0 kubenswrapper[35367]: I1204 12:04:36.805921 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-client-ca" (OuterVolumeSpecName: "client-ca") pod "24506aa4-ab78-49df-bb58-59093498f13d" (UID: "24506aa4-ab78-49df-bb58-59093498f13d"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:04:36.808122 master-0 kubenswrapper[35367]: I1204 12:04:36.806279 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-client-ca" (OuterVolumeSpecName: "client-ca") pod "e4d7939a-5961-4608-b910-73e71aa55bf6" (UID: "e4d7939a-5961-4608-b910-73e71aa55bf6"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:04:36.808122 master-0 kubenswrapper[35367]: I1204 12:04:36.806686 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-auth-proxy-config" (OuterVolumeSpecName: "auth-proxy-config") pod "f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" (UID: "f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48"). InnerVolumeSpecName "auth-proxy-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:04:36.810663 master-0 kubenswrapper[35367]: I1204 12:04:36.810475 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-config" (OuterVolumeSpecName: "config") pod "e4d7939a-5961-4608-b910-73e71aa55bf6" (UID: "e4d7939a-5961-4608-b910-73e71aa55bf6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:04:36.810663 master-0 kubenswrapper[35367]: I1204 12:04:36.810524 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-images" (OuterVolumeSpecName: "images") pod "f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" (UID: "f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48"). InnerVolumeSpecName "images". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:04:36.810663 master-0 kubenswrapper[35367]: I1204 12:04:36.810491 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "24506aa4-ab78-49df-bb58-59093498f13d" (UID: "24506aa4-ab78-49df-bb58-59093498f13d"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:04:36.810663 master-0 kubenswrapper[35367]: I1204 12:04:36.810584 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-config" (OuterVolumeSpecName: "config") pod "24506aa4-ab78-49df-bb58-59093498f13d" (UID: "24506aa4-ab78-49df-bb58-59093498f13d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:04:36.821896 master-0 kubenswrapper[35367]: I1204 12:04:36.819227 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24506aa4-ab78-49df-bb58-59093498f13d-kube-api-access-w2qnk" (OuterVolumeSpecName: "kube-api-access-w2qnk") pod "24506aa4-ab78-49df-bb58-59093498f13d" (UID: "24506aa4-ab78-49df-bb58-59093498f13d"). InnerVolumeSpecName "kube-api-access-w2qnk". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:04:36.821896 master-0 kubenswrapper[35367]: I1204 12:04:36.821173 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24506aa4-ab78-49df-bb58-59093498f13d-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "24506aa4-ab78-49df-bb58-59093498f13d" (UID: "24506aa4-ab78-49df-bb58-59093498f13d"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:04:36.838834 master-0 kubenswrapper[35367]: I1204 12:04:36.829081 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4d7939a-5961-4608-b910-73e71aa55bf6-kube-api-access-d77m8" (OuterVolumeSpecName: "kube-api-access-d77m8") pod "e4d7939a-5961-4608-b910-73e71aa55bf6" (UID: "e4d7939a-5961-4608-b910-73e71aa55bf6"). InnerVolumeSpecName "kube-api-access-d77m8". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:04:36.862538 master-0 kubenswrapper[35367]: I1204 12:04:36.843048 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-cloud-controller-manager-operator-tls" (OuterVolumeSpecName: "cloud-controller-manager-operator-tls") pod "f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" (UID: "f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48"). InnerVolumeSpecName "cloud-controller-manager-operator-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:04:36.863243 master-0 kubenswrapper[35367]: I1204 12:04:36.863172 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4d7939a-5961-4608-b910-73e71aa55bf6-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "e4d7939a-5961-4608-b910-73e71aa55bf6" (UID: "e4d7939a-5961-4608-b910-73e71aa55bf6"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:04:36.863414 master-0 kubenswrapper[35367]: I1204 12:04:36.863215 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-kube-api-access-6fssw" (OuterVolumeSpecName: "kube-api-access-6fssw") pod "f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" (UID: "f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48"). InnerVolumeSpecName "kube-api-access-6fssw". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:04:36.908525 master-0 kubenswrapper[35367]: I1204 12:04:36.908454 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w2qnk\" (UniqueName: \"kubernetes.io/projected/24506aa4-ab78-49df-bb58-59093498f13d-kube-api-access-w2qnk\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:36.908890 master-0 kubenswrapper[35367]: I1204 12:04:36.908538 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:36.908890 master-0 kubenswrapper[35367]: I1204 12:04:36.908576 35367 reconciler_common.go:293] "Volume detached for volume \"images\" (UniqueName: \"kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-images\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:36.908890 master-0 kubenswrapper[35367]: I1204 12:04:36.908594 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6fssw\" (UniqueName: \"kubernetes.io/projected/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-kube-api-access-6fssw\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:36.908890 master-0 kubenswrapper[35367]: I1204 12:04:36.908608 35367 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24506aa4-ab78-49df-bb58-59093498f13d-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:36.908890 master-0 kubenswrapper[35367]: I1204 12:04:36.908622 35367 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4d7939a-5961-4608-b910-73e71aa55bf6-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:36.908890 master-0 kubenswrapper[35367]: I1204 12:04:36.908636 35367 reconciler_common.go:293] "Volume detached for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-cloud-controller-manager-operator-tls\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:36.908890 master-0 kubenswrapper[35367]: I1204 12:04:36.908652 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:36.908890 master-0 kubenswrapper[35367]: I1204 12:04:36.908667 35367 reconciler_common.go:293] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-proxy-ca-bundles\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:36.908890 master-0 kubenswrapper[35367]: I1204 12:04:36.908679 35367 reconciler_common.go:293] "Volume detached for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-host-etc-kube\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:36.908890 master-0 kubenswrapper[35367]: I1204 12:04:36.908688 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d77m8\" (UniqueName: \"kubernetes.io/projected/e4d7939a-5961-4608-b910-73e71aa55bf6-kube-api-access-d77m8\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:36.908890 master-0 kubenswrapper[35367]: I1204 12:04:36.908699 35367 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/24506aa4-ab78-49df-bb58-59093498f13d-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:36.908890 master-0 kubenswrapper[35367]: I1204 12:04:36.908708 35367 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/e4d7939a-5961-4608-b910-73e71aa55bf6-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:36.908890 master-0 kubenswrapper[35367]: I1204 12:04:36.908717 35367 reconciler_common.go:293] "Volume detached for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48-auth-proxy-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:37.034372 master-0 kubenswrapper[35367]: I1204 12:04:37.034321 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-multus/multus-admission-controller-77d4cb9fc-5x5q5"] Dec 04 12:04:37.038828 master-0 kubenswrapper[35367]: W1204 12:04:37.038729 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff2cdf4_ea2d_41f9_9887_4334373cf1d5.slice/crio-fffa6c0fee379732f6e8f2f5479cd07979defb7c9ed3033c1cf3f3c66681a9f6 WatchSource:0}: Error finding container fffa6c0fee379732f6e8f2f5479cd07979defb7c9ed3033c1cf3f3c66681a9f6: Status 404 returned error can't find the container with id fffa6c0fee379732f6e8f2f5479cd07979defb7c9ed3033c1cf3f3c66681a9f6 Dec 04 12:04:37.121831 master-0 kubenswrapper[35367]: I1204 12:04:37.121448 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-54dbc87ccb-n8qgg"] Dec 04 12:04:37.121831 master-0 kubenswrapper[35367]: W1204 12:04:37.121696 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3767f36c_5cb6_4dd1_8d04_812aeb193dad.slice/crio-fb3d17f2270bc268e6c775be4939f4c66c8cee34091c10372fcf64c3bafe90c0 WatchSource:0}: Error finding container fb3d17f2270bc268e6c775be4939f4c66c8cee34091c10372fcf64c3bafe90c0: Status 404 returned error can't find the container with id fb3d17f2270bc268e6c775be4939f4c66c8cee34091c10372fcf64c3bafe90c0 Dec 04 12:04:37.331891 master-0 kubenswrapper[35367]: I1204 12:04:37.331693 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"kube-root-ca.crt" Dec 04 12:04:37.445425 master-0 kubenswrapper[35367]: I1204 12:04:37.445353 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"kube-root-ca.crt" Dec 04 12:04:37.547905 master-0 kubenswrapper[35367]: I1204 12:04:37.547825 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2" Dec 04 12:04:37.554566 master-0 kubenswrapper[35367]: I1204 12:04:37.554498 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" event={"ID":"99eb764e-656c-4873-a2cd-308ce9c31a7d","Type":"ContainerStarted","Data":"ba5e0bb47f1bf5fe0f97a50af53222b7c163f4dafcf969d4eb074e804da8f285"} Dec 04 12:04:37.556024 master-0 kubenswrapper[35367]: I1204 12:04:37.554787 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" event={"ID":"99eb764e-656c-4873-a2cd-308ce9c31a7d","Type":"ContainerStarted","Data":"e3f8312339c18fe6525dd740a13670d76d5e47ca3c0e4f63867a795cb0488a3d"} Dec 04 12:04:37.556024 master-0 kubenswrapper[35367]: I1204 12:04:37.554838 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" event={"ID":"99eb764e-656c-4873-a2cd-308ce9c31a7d","Type":"ContainerStarted","Data":"ec878bdf254b0bede8f78bcede1a350d830f678f4f93e34a159fd2ab2127dde9"} Dec 04 12:04:37.557989 master-0 kubenswrapper[35367]: I1204 12:04:37.557775 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" Dec 04 12:04:37.557989 master-0 kubenswrapper[35367]: I1204 12:04:37.557788 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk" event={"ID":"e4d7939a-5961-4608-b910-73e71aa55bf6","Type":"ContainerDied","Data":"2258f6af8e03d9e9b2176864d007811f1c2157002d410c1abd99bd0f7a698646"} Dec 04 12:04:37.557989 master-0 kubenswrapper[35367]: I1204 12:04:37.557907 35367 scope.go:117] "RemoveContainer" containerID="c1ac7584fc7724b92eddedadea7e444d64b6c1ea5ee822aeb6c33c06347eee0e" Dec 04 12:04:37.559505 master-0 kubenswrapper[35367]: I1204 12:04:37.559459 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-54dbc87ccb-n8qgg" event={"ID":"3767f36c-5cb6-4dd1-8d04-812aeb193dad","Type":"ContainerStarted","Data":"fb3d17f2270bc268e6c775be4939f4c66c8cee34091c10372fcf64c3bafe90c0"} Dec 04 12:04:37.569120 master-0 kubenswrapper[35367]: I1204 12:04:37.569040 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" event={"ID":"24506aa4-ab78-49df-bb58-59093498f13d","Type":"ContainerDied","Data":"97556f365f16c1ec11f0ae822f90781c5b826eb96ebe11fadb15589661eb05b6"} Dec 04 12:04:37.569120 master-0 kubenswrapper[35367]: I1204 12:04:37.569045 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-6686654b8d-rrndk" Dec 04 12:04:37.572749 master-0 kubenswrapper[35367]: I1204 12:04:37.572708 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq" Dec 04 12:04:37.574080 master-0 kubenswrapper[35367]: I1204 12:04:37.574037 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g49xm" event={"ID":"d8a32876-8fcd-4297-8ae3-274e88039a41","Type":"ContainerStarted","Data":"d7def7ce64dbd86c54dff79ab63c64572440d8cb895777fab993f1a658a30092"} Dec 04 12:04:37.576024 master-0 kubenswrapper[35367]: I1204 12:04:37.575990 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-77d4cb9fc-5x5q5" event={"ID":"0ff2cdf4-ea2d-41f9-9887-4334373cf1d5","Type":"ContainerStarted","Data":"82f520f5af818e39945bdb904c8aa9f831361191dca719c8391ccdacbe8bde7c"} Dec 04 12:04:37.576024 master-0 kubenswrapper[35367]: I1204 12:04:37.576022 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-77d4cb9fc-5x5q5" event={"ID":"0ff2cdf4-ea2d-41f9-9887-4334373cf1d5","Type":"ContainerStarted","Data":"fffa6c0fee379732f6e8f2f5479cd07979defb7c9ed3033c1cf3f3c66681a9f6"} Dec 04 12:04:37.581060 master-0 kubenswrapper[35367]: I1204 12:04:37.580959 35367 scope.go:117] "RemoveContainer" containerID="c38ff2120777ff8b1be511702637cc316f617c906d6a31bbe9e628d01aaa9983" Dec 04 12:04:37.728254 master-0 kubenswrapper[35367]: I1204 12:04:37.728157 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" podStartSLOduration=20.728136582 podStartE2EDuration="20.728136582s" podCreationTimestamp="2025-12-04 12:04:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:04:37.654961126 +0000 UTC m=+321.093022384" watchObservedRunningTime="2025-12-04 12:04:37.728136582 +0000 UTC m=+321.166197840" Dec 04 12:04:37.752461 master-0 kubenswrapper[35367]: I1204 12:04:37.752391 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2"] Dec 04 12:04:37.758721 master-0 kubenswrapper[35367]: I1204 12:04:37.758645 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-74f484689c-jmfn2"] Dec 04 12:04:37.788115 master-0 kubenswrapper[35367]: I1204 12:04:37.788042 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-webhook-server-cert" Dec 04 12:04:37.838274 master-0 kubenswrapper[35367]: I1204 12:04:37.838017 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk"] Dec 04 12:04:37.844822 master-0 kubenswrapper[35367]: I1204 12:04:37.844733 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw"] Dec 04 12:04:37.845266 master-0 kubenswrapper[35367]: E1204 12:04:37.845242 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c835660f-5a79-4679-b9be-8543ca6ef5a1" containerName="machine-approver-controller" Dec 04 12:04:37.845266 master-0 kubenswrapper[35367]: I1204 12:04:37.845264 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="c835660f-5a79-4679-b9be-8543ca6ef5a1" containerName="machine-approver-controller" Dec 04 12:04:37.845342 master-0 kubenswrapper[35367]: E1204 12:04:37.845281 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c835660f-5a79-4679-b9be-8543ca6ef5a1" containerName="kube-rbac-proxy" Dec 04 12:04:37.845342 master-0 kubenswrapper[35367]: I1204 12:04:37.845287 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="c835660f-5a79-4679-b9be-8543ca6ef5a1" containerName="kube-rbac-proxy" Dec 04 12:04:37.845342 master-0 kubenswrapper[35367]: E1204 12:04:37.845300 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="24506aa4-ab78-49df-bb58-59093498f13d" containerName="controller-manager" Dec 04 12:04:37.845342 master-0 kubenswrapper[35367]: I1204 12:04:37.845306 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="24506aa4-ab78-49df-bb58-59093498f13d" containerName="controller-manager" Dec 04 12:04:37.845342 master-0 kubenswrapper[35367]: E1204 12:04:37.845315 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" Dec 04 12:04:37.845342 master-0 kubenswrapper[35367]: I1204 12:04:37.845321 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" Dec 04 12:04:37.845342 master-0 kubenswrapper[35367]: E1204 12:04:37.845329 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerName="config-sync-controllers" Dec 04 12:04:37.845342 master-0 kubenswrapper[35367]: I1204 12:04:37.845335 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerName="config-sync-controllers" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: E1204 12:04:37.845349 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerName="config-sync-controllers" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: I1204 12:04:37.845355 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerName="config-sync-controllers" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: E1204 12:04:37.845362 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c835660f-5a79-4679-b9be-8543ca6ef5a1" containerName="machine-approver-controller" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: I1204 12:04:37.845368 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="c835660f-5a79-4679-b9be-8543ca6ef5a1" containerName="machine-approver-controller" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: E1204 12:04:37.845376 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: I1204 12:04:37.845382 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: E1204 12:04:37.845390 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerName="cluster-cloud-controller-manager" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: I1204 12:04:37.845396 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerName="cluster-cloud-controller-manager" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: E1204 12:04:37.845416 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerName="kube-rbac-proxy" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: I1204 12:04:37.845423 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerName="kube-rbac-proxy" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: E1204 12:04:37.845431 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: I1204 12:04:37.845437 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: E1204 12:04:37.845444 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerName="cluster-cloud-controller-manager" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: I1204 12:04:37.845450 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerName="cluster-cloud-controller-manager" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: I1204 12:04:37.845556 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: I1204 12:04:37.845576 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="24506aa4-ab78-49df-bb58-59093498f13d" containerName="controller-manager" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: I1204 12:04:37.845588 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="c835660f-5a79-4679-b9be-8543ca6ef5a1" containerName="kube-rbac-proxy" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: I1204 12:04:37.845599 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: I1204 12:04:37.845607 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerName="cluster-cloud-controller-manager" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: I1204 12:04:37.845619 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="c835660f-5a79-4679-b9be-8543ca6ef5a1" containerName="machine-approver-controller" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: I1204 12:04:37.845626 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="c835660f-5a79-4679-b9be-8543ca6ef5a1" containerName="machine-approver-controller" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: I1204 12:04:37.845633 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerName="cluster-cloud-controller-manager" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: I1204 12:04:37.845641 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerName="config-sync-controllers" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: I1204 12:04:37.845651 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerName="config-sync-controllers" Dec 04 12:04:37.845650 master-0 kubenswrapper[35367]: I1204 12:04:37.845665 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" containerName="kube-rbac-proxy" Dec 04 12:04:37.846314 master-0 kubenswrapper[35367]: I1204 12:04:37.845674 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="24506aa4-ab78-49df-bb58-59093498f13d" containerName="controller-manager" Dec 04 12:04:37.846314 master-0 kubenswrapper[35367]: E1204 12:04:37.845785 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" Dec 04 12:04:37.846314 master-0 kubenswrapper[35367]: I1204 12:04:37.845793 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" Dec 04 12:04:37.846314 master-0 kubenswrapper[35367]: E1204 12:04:37.845839 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="24506aa4-ab78-49df-bb58-59093498f13d" containerName="controller-manager" Dec 04 12:04:37.846314 master-0 kubenswrapper[35367]: I1204 12:04:37.845849 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="24506aa4-ab78-49df-bb58-59093498f13d" containerName="controller-manager" Dec 04 12:04:37.846314 master-0 kubenswrapper[35367]: I1204 12:04:37.845948 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" Dec 04 12:04:37.846314 master-0 kubenswrapper[35367]: I1204 12:04:37.845967 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" containerName="route-controller-manager" Dec 04 12:04:37.846829 master-0 kubenswrapper[35367]: I1204 12:04:37.846787 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" Dec 04 12:04:37.848541 master-0 kubenswrapper[35367]: I1204 12:04:37.848496 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-95cb5f987-46bsk"] Dec 04 12:04:37.849328 master-0 kubenswrapper[35367]: I1204 12:04:37.849301 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-controller-manager-operator"/"cluster-cloud-controller-manager-dockercfg-5pdkn" Dec 04 12:04:37.851503 master-0 kubenswrapper[35367]: I1204 12:04:37.851452 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-controller-manager-operator"/"cloud-controller-manager-operator-tls" Dec 04 12:04:37.851640 master-0 kubenswrapper[35367]: I1204 12:04:37.851543 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"kube-rbac-proxy" Dec 04 12:04:37.851640 master-0 kubenswrapper[35367]: I1204 12:04:37.851594 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"openshift-service-ca.crt" Dec 04 12:04:37.851840 master-0 kubenswrapper[35367]: I1204 12:04:37.851544 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"cloud-controller-manager-images" Dec 04 12:04:37.851892 master-0 kubenswrapper[35367]: I1204 12:04:37.851861 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"kube-root-ca.crt" Dec 04 12:04:37.852001 master-0 kubenswrapper[35367]: I1204 12:04:37.851978 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-serving-cert" Dec 04 12:04:37.866628 master-0 kubenswrapper[35367]: I1204 12:04:37.866552 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-6686654b8d-rrndk"] Dec 04 12:04:37.872286 master-0 kubenswrapper[35367]: I1204 12:04:37.872225 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-controller-manager/controller-manager-6686654b8d-rrndk"] Dec 04 12:04:37.930369 master-0 kubenswrapper[35367]: I1204 12:04:37.930297 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/5cd130d9-7309-4ec9-812f-7685934fbd36-images\") pod \"cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw\" (UID: \"5cd130d9-7309-4ec9-812f-7685934fbd36\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" Dec 04 12:04:37.930369 master-0 kubenswrapper[35367]: I1204 12:04:37.930364 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cd130d9-7309-4ec9-812f-7685934fbd36-cloud-controller-manager-operator-tls\") pod \"cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw\" (UID: \"5cd130d9-7309-4ec9-812f-7685934fbd36\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" Dec 04 12:04:37.930642 master-0 kubenswrapper[35367]: I1204 12:04:37.930392 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/5cd130d9-7309-4ec9-812f-7685934fbd36-host-etc-kube\") pod \"cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw\" (UID: \"5cd130d9-7309-4ec9-812f-7685934fbd36\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" Dec 04 12:04:37.930642 master-0 kubenswrapper[35367]: I1204 12:04:37.930417 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/5cd130d9-7309-4ec9-812f-7685934fbd36-auth-proxy-config\") pod \"cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw\" (UID: \"5cd130d9-7309-4ec9-812f-7685934fbd36\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" Dec 04 12:04:37.930642 master-0 kubenswrapper[35367]: I1204 12:04:37.930529 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt9kc\" (UniqueName: \"kubernetes.io/projected/5cd130d9-7309-4ec9-812f-7685934fbd36-kube-api-access-mt9kc\") pod \"cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw\" (UID: \"5cd130d9-7309-4ec9-812f-7685934fbd36\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" Dec 04 12:04:37.996007 master-0 kubenswrapper[35367]: I1204 12:04:37.995893 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq"] Dec 04 12:04:38.002004 master-0 kubenswrapper[35367]: I1204 12:04:38.001880 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-cluster-machine-approver/machine-approver-f797d8546-qvgbq"] Dec 04 12:04:38.032594 master-0 kubenswrapper[35367]: I1204 12:04:38.032540 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/5cd130d9-7309-4ec9-812f-7685934fbd36-host-etc-kube\") pod \"cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw\" (UID: \"5cd130d9-7309-4ec9-812f-7685934fbd36\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" Dec 04 12:04:38.032800 master-0 kubenswrapper[35367]: I1204 12:04:38.032618 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/5cd130d9-7309-4ec9-812f-7685934fbd36-auth-proxy-config\") pod \"cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw\" (UID: \"5cd130d9-7309-4ec9-812f-7685934fbd36\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" Dec 04 12:04:38.032886 master-0 kubenswrapper[35367]: I1204 12:04:38.032837 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mt9kc\" (UniqueName: \"kubernetes.io/projected/5cd130d9-7309-4ec9-812f-7685934fbd36-kube-api-access-mt9kc\") pod \"cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw\" (UID: \"5cd130d9-7309-4ec9-812f-7685934fbd36\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" Dec 04 12:04:38.032972 master-0 kubenswrapper[35367]: I1204 12:04:38.032942 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/5cd130d9-7309-4ec9-812f-7685934fbd36-host-etc-kube\") pod \"cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw\" (UID: \"5cd130d9-7309-4ec9-812f-7685934fbd36\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" Dec 04 12:04:38.033211 master-0 kubenswrapper[35367]: I1204 12:04:38.033171 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/5cd130d9-7309-4ec9-812f-7685934fbd36-images\") pod \"cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw\" (UID: \"5cd130d9-7309-4ec9-812f-7685934fbd36\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" Dec 04 12:04:38.033420 master-0 kubenswrapper[35367]: I1204 12:04:38.033339 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cd130d9-7309-4ec9-812f-7685934fbd36-cloud-controller-manager-operator-tls\") pod \"cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw\" (UID: \"5cd130d9-7309-4ec9-812f-7685934fbd36\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" Dec 04 12:04:38.033605 master-0 kubenswrapper[35367]: I1204 12:04:38.033573 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/5cd130d9-7309-4ec9-812f-7685934fbd36-auth-proxy-config\") pod \"cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw\" (UID: \"5cd130d9-7309-4ec9-812f-7685934fbd36\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" Dec 04 12:04:38.034269 master-0 kubenswrapper[35367]: I1204 12:04:38.034243 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/5cd130d9-7309-4ec9-812f-7685934fbd36-images\") pod \"cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw\" (UID: \"5cd130d9-7309-4ec9-812f-7685934fbd36\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" Dec 04 12:04:38.037252 master-0 kubenswrapper[35367]: I1204 12:04:38.037211 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cloud-controller-manager-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cd130d9-7309-4ec9-812f-7685934fbd36-cloud-controller-manager-operator-tls\") pod \"cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw\" (UID: \"5cd130d9-7309-4ec9-812f-7685934fbd36\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" Dec 04 12:04:38.061202 master-0 kubenswrapper[35367]: I1204 12:04:38.060738 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt9kc\" (UniqueName: \"kubernetes.io/projected/5cd130d9-7309-4ec9-812f-7685934fbd36-kube-api-access-mt9kc\") pod \"cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw\" (UID: \"5cd130d9-7309-4ec9-812f-7685934fbd36\") " pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" Dec 04 12:04:38.065583 master-0 kubenswrapper[35367]: I1204 12:04:38.065508 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-machine-approver/machine-approver-74d9cbffbc-9c59x"] Dec 04 12:04:38.066969 master-0 kubenswrapper[35367]: I1204 12:04:38.066947 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-machine-approver/machine-approver-74d9cbffbc-9c59x" Dec 04 12:04:38.069283 master-0 kubenswrapper[35367]: I1204 12:04:38.069196 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-machine-approver"/"machine-approver-sa-dockercfg-tj7gr" Dec 04 12:04:38.069283 master-0 kubenswrapper[35367]: I1204 12:04:38.069250 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-machine-approver"/"machine-approver-tls" Dec 04 12:04:38.070831 master-0 kubenswrapper[35367]: I1204 12:04:38.069396 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-rbac-proxy" Dec 04 12:04:38.071132 master-0 kubenswrapper[35367]: I1204 12:04:38.071102 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-root-ca.crt" Dec 04 12:04:38.071795 master-0 kubenswrapper[35367]: I1204 12:04:38.071244 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"machine-approver-config" Dec 04 12:04:38.071795 master-0 kubenswrapper[35367]: I1204 12:04:38.071492 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"openshift-service-ca.crt" Dec 04 12:04:38.174359 master-0 kubenswrapper[35367]: I1204 12:04:38.174304 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" Dec 04 12:04:38.237097 master-0 kubenswrapper[35367]: I1204 12:04:38.236755 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/e6224079-e4ed-4ce5-845e-d2692967cce9-machine-approver-tls\") pod \"machine-approver-74d9cbffbc-9c59x\" (UID: \"e6224079-e4ed-4ce5-845e-d2692967cce9\") " pod="openshift-cluster-machine-approver/machine-approver-74d9cbffbc-9c59x" Dec 04 12:04:38.237097 master-0 kubenswrapper[35367]: I1204 12:04:38.236839 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/e6224079-e4ed-4ce5-845e-d2692967cce9-auth-proxy-config\") pod \"machine-approver-74d9cbffbc-9c59x\" (UID: \"e6224079-e4ed-4ce5-845e-d2692967cce9\") " pod="openshift-cluster-machine-approver/machine-approver-74d9cbffbc-9c59x" Dec 04 12:04:38.237097 master-0 kubenswrapper[35367]: I1204 12:04:38.236872 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6224079-e4ed-4ce5-845e-d2692967cce9-config\") pod \"machine-approver-74d9cbffbc-9c59x\" (UID: \"e6224079-e4ed-4ce5-845e-d2692967cce9\") " pod="openshift-cluster-machine-approver/machine-approver-74d9cbffbc-9c59x" Dec 04 12:04:38.237097 master-0 kubenswrapper[35367]: I1204 12:04:38.236939 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtgwf\" (UniqueName: \"kubernetes.io/projected/e6224079-e4ed-4ce5-845e-d2692967cce9-kube-api-access-qtgwf\") pod \"machine-approver-74d9cbffbc-9c59x\" (UID: \"e6224079-e4ed-4ce5-845e-d2692967cce9\") " pod="openshift-cluster-machine-approver/machine-approver-74d9cbffbc-9c59x" Dec 04 12:04:38.329308 master-0 kubenswrapper[35367]: I1204 12:04:38.329245 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-service-ca.crt" Dec 04 12:04:38.338054 master-0 kubenswrapper[35367]: I1204 12:04:38.337995 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qtgwf\" (UniqueName: \"kubernetes.io/projected/e6224079-e4ed-4ce5-845e-d2692967cce9-kube-api-access-qtgwf\") pod \"machine-approver-74d9cbffbc-9c59x\" (UID: \"e6224079-e4ed-4ce5-845e-d2692967cce9\") " pod="openshift-cluster-machine-approver/machine-approver-74d9cbffbc-9c59x" Dec 04 12:04:38.338342 master-0 kubenswrapper[35367]: I1204 12:04:38.338286 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/e6224079-e4ed-4ce5-845e-d2692967cce9-machine-approver-tls\") pod \"machine-approver-74d9cbffbc-9c59x\" (UID: \"e6224079-e4ed-4ce5-845e-d2692967cce9\") " pod="openshift-cluster-machine-approver/machine-approver-74d9cbffbc-9c59x" Dec 04 12:04:38.338456 master-0 kubenswrapper[35367]: I1204 12:04:38.338418 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/e6224079-e4ed-4ce5-845e-d2692967cce9-auth-proxy-config\") pod \"machine-approver-74d9cbffbc-9c59x\" (UID: \"e6224079-e4ed-4ce5-845e-d2692967cce9\") " pod="openshift-cluster-machine-approver/machine-approver-74d9cbffbc-9c59x" Dec 04 12:04:38.338522 master-0 kubenswrapper[35367]: I1204 12:04:38.338477 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6224079-e4ed-4ce5-845e-d2692967cce9-config\") pod \"machine-approver-74d9cbffbc-9c59x\" (UID: \"e6224079-e4ed-4ce5-845e-d2692967cce9\") " pod="openshift-cluster-machine-approver/machine-approver-74d9cbffbc-9c59x" Dec 04 12:04:38.339260 master-0 kubenswrapper[35367]: I1204 12:04:38.339221 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6224079-e4ed-4ce5-845e-d2692967cce9-config\") pod \"machine-approver-74d9cbffbc-9c59x\" (UID: \"e6224079-e4ed-4ce5-845e-d2692967cce9\") " pod="openshift-cluster-machine-approver/machine-approver-74d9cbffbc-9c59x" Dec 04 12:04:38.339362 master-0 kubenswrapper[35367]: I1204 12:04:38.339338 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/e6224079-e4ed-4ce5-845e-d2692967cce9-auth-proxy-config\") pod \"machine-approver-74d9cbffbc-9c59x\" (UID: \"e6224079-e4ed-4ce5-845e-d2692967cce9\") " pod="openshift-cluster-machine-approver/machine-approver-74d9cbffbc-9c59x" Dec 04 12:04:38.343966 master-0 kubenswrapper[35367]: I1204 12:04:38.343931 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/e6224079-e4ed-4ce5-845e-d2692967cce9-machine-approver-tls\") pod \"machine-approver-74d9cbffbc-9c59x\" (UID: \"e6224079-e4ed-4ce5-845e-d2692967cce9\") " pod="openshift-cluster-machine-approver/machine-approver-74d9cbffbc-9c59x" Dec 04 12:04:38.355406 master-0 kubenswrapper[35367]: I1204 12:04:38.355258 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtgwf\" (UniqueName: \"kubernetes.io/projected/e6224079-e4ed-4ce5-845e-d2692967cce9-kube-api-access-qtgwf\") pod \"machine-approver-74d9cbffbc-9c59x\" (UID: \"e6224079-e4ed-4ce5-845e-d2692967cce9\") " pod="openshift-cluster-machine-approver/machine-approver-74d9cbffbc-9c59x" Dec 04 12:04:38.418677 master-0 kubenswrapper[35367]: I1204 12:04:38.418594 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-machine-approver/machine-approver-74d9cbffbc-9c59x" Dec 04 12:04:38.432049 master-0 kubenswrapper[35367]: W1204 12:04:38.431949 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cd130d9_7309_4ec9_812f_7685934fbd36.slice/crio-bde991f7fa720f00fcb0dca839033c65c59c65140e98539f40b3844ce10130e0 WatchSource:0}: Error finding container bde991f7fa720f00fcb0dca839033c65c59c65140e98539f40b3844ce10130e0: Status 404 returned error can't find the container with id bde991f7fa720f00fcb0dca839033c65c59c65140e98539f40b3844ce10130e0 Dec 04 12:04:38.445033 master-0 kubenswrapper[35367]: W1204 12:04:38.444966 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6224079_e4ed_4ce5_845e_d2692967cce9.slice/crio-14f0abe68bf2fce0fec564c68bc6f7d0769794d88f3dcc1a5b135c93a8003ea0 WatchSource:0}: Error finding container 14f0abe68bf2fce0fec564c68bc6f7d0769794d88f3dcc1a5b135c93a8003ea0: Status 404 returned error can't find the container with id 14f0abe68bf2fce0fec564c68bc6f7d0769794d88f3dcc1a5b135c93a8003ea0 Dec 04 12:04:38.590735 master-0 kubenswrapper[35367]: I1204 12:04:38.590669 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-77d4cb9fc-5x5q5" event={"ID":"0ff2cdf4-ea2d-41f9-9887-4334373cf1d5","Type":"ContainerStarted","Data":"306bab7a6bf7082f6f916606d8859c3f597a808c9e3498fdbee46f05e47e47c3"} Dec 04 12:04:38.601114 master-0 kubenswrapper[35367]: I1204 12:04:38.601058 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-74d9cbffbc-9c59x" event={"ID":"e6224079-e4ed-4ce5-845e-d2692967cce9","Type":"ContainerStarted","Data":"14f0abe68bf2fce0fec564c68bc6f7d0769794d88f3dcc1a5b135c93a8003ea0"} Dec 04 12:04:38.608057 master-0 kubenswrapper[35367]: I1204 12:04:38.607519 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" event={"ID":"5cd130d9-7309-4ec9-812f-7685934fbd36","Type":"ContainerStarted","Data":"bde991f7fa720f00fcb0dca839033c65c59c65140e98539f40b3844ce10130e0"} Dec 04 12:04:38.690823 master-0 kubenswrapper[35367]: I1204 12:04:38.690679 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-admission-controller-77d4cb9fc-5x5q5" podStartSLOduration=20.690650277 podStartE2EDuration="20.690650277s" podCreationTimestamp="2025-12-04 12:04:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:04:38.687299111 +0000 UTC m=+322.125360389" watchObservedRunningTime="2025-12-04 12:04:38.690650277 +0000 UTC m=+322.128711535" Dec 04 12:04:38.760279 master-0 kubenswrapper[35367]: I1204 12:04:38.760157 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"audit-1" Dec 04 12:04:38.768440 master-0 kubenswrapper[35367]: I1204 12:04:38.768112 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24506aa4-ab78-49df-bb58-59093498f13d" path="/var/lib/kubelet/pods/24506aa4-ab78-49df-bb58-59093498f13d/volumes" Dec 04 12:04:38.773431 master-0 kubenswrapper[35367]: I1204 12:04:38.769994 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c835660f-5a79-4679-b9be-8543ca6ef5a1" path="/var/lib/kubelet/pods/c835660f-5a79-4679-b9be-8543ca6ef5a1/volumes" Dec 04 12:04:38.773431 master-0 kubenswrapper[35367]: I1204 12:04:38.770876 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4d7939a-5961-4608-b910-73e71aa55bf6" path="/var/lib/kubelet/pods/e4d7939a-5961-4608-b910-73e71aa55bf6/volumes" Dec 04 12:04:38.773431 master-0 kubenswrapper[35367]: I1204 12:04:38.772264 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48" path="/var/lib/kubelet/pods/f79f39e0-4aa6-4eea-b8f5-7b5ef18e8d48/volumes" Dec 04 12:04:38.778051 master-0 kubenswrapper[35367]: I1204 12:04:38.777958 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-multus/multus-admission-controller-7dfc5b745f-258xq"] Dec 04 12:04:38.778336 master-0 kubenswrapper[35367]: I1204 12:04:38.778267 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" podUID="08550069-c1a1-475e-84a2-e56905f1ed38" containerName="multus-admission-controller" containerID="cri-o://8762d647c5e9e97a8049116602f9b1ae80da119559094578719d511b88598148" gracePeriod=30 Dec 04 12:04:38.782721 master-0 kubenswrapper[35367]: I1204 12:04:38.778479 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" podUID="08550069-c1a1-475e-84a2-e56905f1ed38" containerName="kube-rbac-proxy" containerID="cri-o://150e8033295adf15ce019a92e7d442b68772928da716e398fe0f605d8a64f9e6" gracePeriod=30 Dec 04 12:04:39.400935 master-0 kubenswrapper[35367]: I1204 12:04:39.400873 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"openshift-service-ca.crt" Dec 04 12:04:39.557398 master-0 kubenswrapper[35367]: I1204 12:04:39.556903 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t"] Dec 04 12:04:39.560155 master-0 kubenswrapper[35367]: I1204 12:04:39.558925 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" Dec 04 12:04:39.561494 master-0 kubenswrapper[35367]: I1204 12:04:39.561448 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Dec 04 12:04:39.561584 master-0 kubenswrapper[35367]: I1204 12:04:39.561525 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"openshift-service-ca.crt" Dec 04 12:04:39.562025 master-0 kubenswrapper[35367]: I1204 12:04:39.561739 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"kube-root-ca.crt" Dec 04 12:04:39.562025 master-0 kubenswrapper[35367]: I1204 12:04:39.561772 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"client-ca" Dec 04 12:04:39.562025 master-0 kubenswrapper[35367]: I1204 12:04:39.561910 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"config" Dec 04 12:04:39.563433 master-0 kubenswrapper[35367]: I1204 12:04:39.562279 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"route-controller-manager-sa-dockercfg-qzw27" Dec 04 12:04:39.593359 master-0 kubenswrapper[35367]: I1204 12:04:39.593294 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t"] Dec 04 12:04:39.634984 master-0 kubenswrapper[35367]: I1204 12:04:39.634891 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" event={"ID":"5cd130d9-7309-4ec9-812f-7685934fbd36","Type":"ContainerStarted","Data":"422b5d7ea8760f27471ea5411f0ab110605fcaf82440c1f6fbbbc4f5ef4df354"} Dec 04 12:04:39.636933 master-0 kubenswrapper[35367]: I1204 12:04:39.636866 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-74d9cbffbc-9c59x" event={"ID":"e6224079-e4ed-4ce5-845e-d2692967cce9","Type":"ContainerStarted","Data":"849972834da9f5faaaa8e9b5b42769e5b2671c846bc708808273519a89f01d9c"} Dec 04 12:04:39.638327 master-0 kubenswrapper[35367]: I1204 12:04:39.638253 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g49xm" event={"ID":"d8a32876-8fcd-4297-8ae3-274e88039a41","Type":"ContainerStarted","Data":"eb0568418caa954083fde7ab2be4f04697b7cb5a942d8c88456f02b0fe3b7a5a"} Dec 04 12:04:39.642523 master-0 kubenswrapper[35367]: I1204 12:04:39.642461 35367 generic.go:334] "Generic (PLEG): container finished" podID="08550069-c1a1-475e-84a2-e56905f1ed38" containerID="150e8033295adf15ce019a92e7d442b68772928da716e398fe0f605d8a64f9e6" exitCode=0 Dec 04 12:04:39.642661 master-0 kubenswrapper[35367]: I1204 12:04:39.642549 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" event={"ID":"08550069-c1a1-475e-84a2-e56905f1ed38","Type":"ContainerDied","Data":"150e8033295adf15ce019a92e7d442b68772928da716e398fe0f605d8a64f9e6"} Dec 04 12:04:39.657284 master-0 kubenswrapper[35367]: I1204 12:04:39.657140 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cee5f541-b365-478e-a24a-acf6168a45f6-serving-cert\") pod \"route-controller-manager-557cff67c-7qs6t\" (UID: \"cee5f541-b365-478e-a24a-acf6168a45f6\") " pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" Dec 04 12:04:39.657284 master-0 kubenswrapper[35367]: I1204 12:04:39.657240 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9qpq\" (UniqueName: \"kubernetes.io/projected/cee5f541-b365-478e-a24a-acf6168a45f6-kube-api-access-m9qpq\") pod \"route-controller-manager-557cff67c-7qs6t\" (UID: \"cee5f541-b365-478e-a24a-acf6168a45f6\") " pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" Dec 04 12:04:39.659365 master-0 kubenswrapper[35367]: I1204 12:04:39.659004 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cee5f541-b365-478e-a24a-acf6168a45f6-config\") pod \"route-controller-manager-557cff67c-7qs6t\" (UID: \"cee5f541-b365-478e-a24a-acf6168a45f6\") " pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" Dec 04 12:04:39.659365 master-0 kubenswrapper[35367]: I1204 12:04:39.659172 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/cee5f541-b365-478e-a24a-acf6168a45f6-client-ca\") pod \"route-controller-manager-557cff67c-7qs6t\" (UID: \"cee5f541-b365-478e-a24a-acf6168a45f6\") " pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" Dec 04 12:04:39.662543 master-0 kubenswrapper[35367]: I1204 12:04:39.662442 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g49xm" podStartSLOduration=23.538423063 podStartE2EDuration="25.662408673s" podCreationTimestamp="2025-12-04 12:04:14 +0000 UTC" firstStartedPulling="2025-12-04 12:04:36.50837446 +0000 UTC m=+319.946435718" lastFinishedPulling="2025-12-04 12:04:38.63236007 +0000 UTC m=+322.070421328" observedRunningTime="2025-12-04 12:04:39.659735858 +0000 UTC m=+323.097797126" watchObservedRunningTime="2025-12-04 12:04:39.662408673 +0000 UTC m=+323.100469931" Dec 04 12:04:39.762075 master-0 kubenswrapper[35367]: I1204 12:04:39.761316 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m9qpq\" (UniqueName: \"kubernetes.io/projected/cee5f541-b365-478e-a24a-acf6168a45f6-kube-api-access-m9qpq\") pod \"route-controller-manager-557cff67c-7qs6t\" (UID: \"cee5f541-b365-478e-a24a-acf6168a45f6\") " pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" Dec 04 12:04:39.762075 master-0 kubenswrapper[35367]: I1204 12:04:39.761411 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cee5f541-b365-478e-a24a-acf6168a45f6-config\") pod \"route-controller-manager-557cff67c-7qs6t\" (UID: \"cee5f541-b365-478e-a24a-acf6168a45f6\") " pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" Dec 04 12:04:39.762075 master-0 kubenswrapper[35367]: I1204 12:04:39.761467 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/cee5f541-b365-478e-a24a-acf6168a45f6-client-ca\") pod \"route-controller-manager-557cff67c-7qs6t\" (UID: \"cee5f541-b365-478e-a24a-acf6168a45f6\") " pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" Dec 04 12:04:39.763424 master-0 kubenswrapper[35367]: I1204 12:04:39.762790 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cee5f541-b365-478e-a24a-acf6168a45f6-serving-cert\") pod \"route-controller-manager-557cff67c-7qs6t\" (UID: \"cee5f541-b365-478e-a24a-acf6168a45f6\") " pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" Dec 04 12:04:39.763643 master-0 kubenswrapper[35367]: I1204 12:04:39.763583 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cee5f541-b365-478e-a24a-acf6168a45f6-config\") pod \"route-controller-manager-557cff67c-7qs6t\" (UID: \"cee5f541-b365-478e-a24a-acf6168a45f6\") " pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" Dec 04 12:04:39.764561 master-0 kubenswrapper[35367]: I1204 12:04:39.764527 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/cee5f541-b365-478e-a24a-acf6168a45f6-client-ca\") pod \"route-controller-manager-557cff67c-7qs6t\" (UID: \"cee5f541-b365-478e-a24a-acf6168a45f6\") " pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" Dec 04 12:04:39.767949 master-0 kubenswrapper[35367]: I1204 12:04:39.767911 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cee5f541-b365-478e-a24a-acf6168a45f6-serving-cert\") pod \"route-controller-manager-557cff67c-7qs6t\" (UID: \"cee5f541-b365-478e-a24a-acf6168a45f6\") " pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" Dec 04 12:04:39.780020 master-0 kubenswrapper[35367]: I1204 12:04:39.779944 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9qpq\" (UniqueName: \"kubernetes.io/projected/cee5f541-b365-478e-a24a-acf6168a45f6-kube-api-access-m9qpq\") pod \"route-controller-manager-557cff67c-7qs6t\" (UID: \"cee5f541-b365-478e-a24a-acf6168a45f6\") " pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" Dec 04 12:04:39.937463 master-0 kubenswrapper[35367]: I1204 12:04:39.937401 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" Dec 04 12:04:40.653504 master-0 kubenswrapper[35367]: I1204 12:04:40.653424 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" event={"ID":"5cd130d9-7309-4ec9-812f-7685934fbd36","Type":"ContainerStarted","Data":"5d46c284c1d6bcae98100a4b661a5f40265e6a233a72725b619721eca5645f20"} Dec 04 12:04:40.655768 master-0 kubenswrapper[35367]: I1204 12:04:40.655731 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-74d9cbffbc-9c59x" event={"ID":"e6224079-e4ed-4ce5-845e-d2692967cce9","Type":"ContainerStarted","Data":"a7264ce8d4c211be1c9f577e48cdb31ee82fa631304bd96d6bc04dacfb956c6f"} Dec 04 12:04:40.659518 master-0 kubenswrapper[35367]: I1204 12:04:40.659487 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-54dbc87ccb-n8qgg" event={"ID":"3767f36c-5cb6-4dd1-8d04-812aeb193dad","Type":"ContainerStarted","Data":"a471dd97b9f058d8b8c5ac39423946538a9ab1987aecc48f2ffa76d9e22eb62f"} Dec 04 12:04:40.659637 master-0 kubenswrapper[35367]: I1204 12:04:40.659539 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console-operator/console-operator-54dbc87ccb-n8qgg" Dec 04 12:04:40.929863 master-0 kubenswrapper[35367]: I1204 12:04:40.928780 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:04:40.936666 master-0 kubenswrapper[35367]: I1204 12:04:40.936629 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:04:40.957275 master-0 kubenswrapper[35367]: I1204 12:04:40.954849 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t"] Dec 04 12:04:40.962730 master-0 kubenswrapper[35367]: I1204 12:04:40.961971 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-machine-approver/machine-approver-74d9cbffbc-9c59x" podStartSLOduration=2.961942438 podStartE2EDuration="2.961942438s" podCreationTimestamp="2025-12-04 12:04:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:04:40.9537605 +0000 UTC m=+324.391821768" watchObservedRunningTime="2025-12-04 12:04:40.961942438 +0000 UTC m=+324.400003716" Dec 04 12:04:40.964487 master-0 kubenswrapper[35367]: I1204 12:04:40.964435 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-54dbc87ccb-n8qgg" Dec 04 12:04:40.990298 master-0 kubenswrapper[35367]: I1204 12:04:40.989972 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-54dbc87ccb-n8qgg" podStartSLOduration=20.37089941 podStartE2EDuration="22.989950871s" podCreationTimestamp="2025-12-04 12:04:18 +0000 UTC" firstStartedPulling="2025-12-04 12:04:37.12582029 +0000 UTC m=+320.563881538" lastFinishedPulling="2025-12-04 12:04:39.744871751 +0000 UTC m=+323.182932999" observedRunningTime="2025-12-04 12:04:40.986310227 +0000 UTC m=+324.424371495" watchObservedRunningTime="2025-12-04 12:04:40.989950871 +0000 UTC m=+324.428012149" Dec 04 12:04:41.296728 master-0 kubenswrapper[35367]: I1204 12:04:41.296608 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-69cd4c69bf-wlssv"] Dec 04 12:04:41.297621 master-0 kubenswrapper[35367]: I1204 12:04:41.297591 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-69cd4c69bf-wlssv" Dec 04 12:04:41.300177 master-0 kubenswrapper[35367]: I1204 12:04:41.300138 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"openshift-service-ca.crt" Dec 04 12:04:41.300743 master-0 kubenswrapper[35367]: I1204 12:04:41.300681 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"kube-root-ca.crt" Dec 04 12:04:41.321469 master-0 kubenswrapper[35367]: I1204 12:04:41.321373 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-69cd4c69bf-wlssv"] Dec 04 12:04:41.392332 master-0 kubenswrapper[35367]: I1204 12:04:41.392242 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qrmf\" (UniqueName: \"kubernetes.io/projected/0f017aaf-c4b2-46c5-aaff-ba7d5bce6371-kube-api-access-7qrmf\") pod \"downloads-69cd4c69bf-wlssv\" (UID: \"0f017aaf-c4b2-46c5-aaff-ba7d5bce6371\") " pod="openshift-console/downloads-69cd4c69bf-wlssv" Dec 04 12:04:41.494042 master-0 kubenswrapper[35367]: I1204 12:04:41.493946 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7qrmf\" (UniqueName: \"kubernetes.io/projected/0f017aaf-c4b2-46c5-aaff-ba7d5bce6371-kube-api-access-7qrmf\") pod \"downloads-69cd4c69bf-wlssv\" (UID: \"0f017aaf-c4b2-46c5-aaff-ba7d5bce6371\") " pod="openshift-console/downloads-69cd4c69bf-wlssv" Dec 04 12:04:41.531585 master-0 kubenswrapper[35367]: I1204 12:04:41.531520 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-b644f86d6-mvlh8"] Dec 04 12:04:41.532550 master-0 kubenswrapper[35367]: I1204 12:04:41.532525 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" Dec 04 12:04:41.535356 master-0 kubenswrapper[35367]: I1204 12:04:41.535293 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"client-ca" Dec 04 12:04:41.535578 master-0 kubenswrapper[35367]: I1204 12:04:41.535393 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"kube-root-ca.crt" Dec 04 12:04:41.535676 master-0 kubenswrapper[35367]: I1204 12:04:41.535628 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"serving-cert" Dec 04 12:04:41.535851 master-0 kubenswrapper[35367]: I1204 12:04:41.535825 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"openshift-controller-manager-sa-dockercfg-llqk2" Dec 04 12:04:41.536079 master-0 kubenswrapper[35367]: I1204 12:04:41.536045 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-service-ca.crt" Dec 04 12:04:41.538015 master-0 kubenswrapper[35367]: I1204 12:04:41.537980 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"config" Dec 04 12:04:41.544725 master-0 kubenswrapper[35367]: I1204 12:04:41.544681 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-global-ca" Dec 04 12:04:41.548650 master-0 kubenswrapper[35367]: I1204 12:04:41.548259 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qrmf\" (UniqueName: \"kubernetes.io/projected/0f017aaf-c4b2-46c5-aaff-ba7d5bce6371-kube-api-access-7qrmf\") pod \"downloads-69cd4c69bf-wlssv\" (UID: \"0f017aaf-c4b2-46c5-aaff-ba7d5bce6371\") " pod="openshift-console/downloads-69cd4c69bf-wlssv" Dec 04 12:04:41.550010 master-0 kubenswrapper[35367]: I1204 12:04:41.549930 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-b644f86d6-mvlh8"] Dec 04 12:04:41.613754 master-0 kubenswrapper[35367]: I1204 12:04:41.613694 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-69cd4c69bf-wlssv" Dec 04 12:04:41.673138 master-0 kubenswrapper[35367]: I1204 12:04:41.673065 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" event={"ID":"5cd130d9-7309-4ec9-812f-7685934fbd36","Type":"ContainerStarted","Data":"b95100d906731dc6e0b77ec18b0d466572fd010711dd8b9f206fb83272dfc2e8"} Dec 04 12:04:41.676477 master-0 kubenswrapper[35367]: I1204 12:04:41.676378 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" event={"ID":"cee5f541-b365-478e-a24a-acf6168a45f6","Type":"ContainerStarted","Data":"2db28cab881bc989aacef20e329cba357eef899b9438ff67790f2c1e30162811"} Dec 04 12:04:41.676477 master-0 kubenswrapper[35367]: I1204 12:04:41.676447 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" event={"ID":"cee5f541-b365-478e-a24a-acf6168a45f6","Type":"ContainerStarted","Data":"743763456c84f50ab7df9b4b65735bd4d104450531c29c6cf0dd14ad930d0464"} Dec 04 12:04:41.697396 master-0 kubenswrapper[35367]: I1204 12:04:41.697208 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e747fb0-b135-4ca9-9b96-568d3af886e6-serving-cert\") pod \"controller-manager-b644f86d6-mvlh8\" (UID: \"8e747fb0-b135-4ca9-9b96-568d3af886e6\") " pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" Dec 04 12:04:41.697396 master-0 kubenswrapper[35367]: I1204 12:04:41.697340 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/8e747fb0-b135-4ca9-9b96-568d3af886e6-proxy-ca-bundles\") pod \"controller-manager-b644f86d6-mvlh8\" (UID: \"8e747fb0-b135-4ca9-9b96-568d3af886e6\") " pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" Dec 04 12:04:41.697659 master-0 kubenswrapper[35367]: I1204 12:04:41.697549 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45556\" (UniqueName: \"kubernetes.io/projected/8e747fb0-b135-4ca9-9b96-568d3af886e6-kube-api-access-45556\") pod \"controller-manager-b644f86d6-mvlh8\" (UID: \"8e747fb0-b135-4ca9-9b96-568d3af886e6\") " pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" Dec 04 12:04:41.697701 master-0 kubenswrapper[35367]: I1204 12:04:41.697651 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e747fb0-b135-4ca9-9b96-568d3af886e6-config\") pod \"controller-manager-b644f86d6-mvlh8\" (UID: \"8e747fb0-b135-4ca9-9b96-568d3af886e6\") " pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" Dec 04 12:04:41.698253 master-0 kubenswrapper[35367]: I1204 12:04:41.697829 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/8e747fb0-b135-4ca9-9b96-568d3af886e6-client-ca\") pod \"controller-manager-b644f86d6-mvlh8\" (UID: \"8e747fb0-b135-4ca9-9b96-568d3af886e6\") " pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" Dec 04 12:04:41.716382 master-0 kubenswrapper[35367]: I1204 12:04:41.714738 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cloud-controller-manager-operator/cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw" podStartSLOduration=4.714711773 podStartE2EDuration="4.714711773s" podCreationTimestamp="2025-12-04 12:04:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:04:41.711297445 +0000 UTC m=+325.149358703" watchObservedRunningTime="2025-12-04 12:04:41.714711773 +0000 UTC m=+325.152773031" Dec 04 12:04:41.799191 master-0 kubenswrapper[35367]: I1204 12:04:41.799002 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e747fb0-b135-4ca9-9b96-568d3af886e6-serving-cert\") pod \"controller-manager-b644f86d6-mvlh8\" (UID: \"8e747fb0-b135-4ca9-9b96-568d3af886e6\") " pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" Dec 04 12:04:41.799191 master-0 kubenswrapper[35367]: I1204 12:04:41.799184 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/8e747fb0-b135-4ca9-9b96-568d3af886e6-proxy-ca-bundles\") pod \"controller-manager-b644f86d6-mvlh8\" (UID: \"8e747fb0-b135-4ca9-9b96-568d3af886e6\") " pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" Dec 04 12:04:41.799440 master-0 kubenswrapper[35367]: I1204 12:04:41.799310 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-45556\" (UniqueName: \"kubernetes.io/projected/8e747fb0-b135-4ca9-9b96-568d3af886e6-kube-api-access-45556\") pod \"controller-manager-b644f86d6-mvlh8\" (UID: \"8e747fb0-b135-4ca9-9b96-568d3af886e6\") " pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" Dec 04 12:04:41.799440 master-0 kubenswrapper[35367]: I1204 12:04:41.799348 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e747fb0-b135-4ca9-9b96-568d3af886e6-config\") pod \"controller-manager-b644f86d6-mvlh8\" (UID: \"8e747fb0-b135-4ca9-9b96-568d3af886e6\") " pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" Dec 04 12:04:41.799551 master-0 kubenswrapper[35367]: I1204 12:04:41.799521 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/8e747fb0-b135-4ca9-9b96-568d3af886e6-client-ca\") pod \"controller-manager-b644f86d6-mvlh8\" (UID: \"8e747fb0-b135-4ca9-9b96-568d3af886e6\") " pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" Dec 04 12:04:41.802770 master-0 kubenswrapper[35367]: I1204 12:04:41.802748 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/8e747fb0-b135-4ca9-9b96-568d3af886e6-client-ca\") pod \"controller-manager-b644f86d6-mvlh8\" (UID: \"8e747fb0-b135-4ca9-9b96-568d3af886e6\") " pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" Dec 04 12:04:41.803177 master-0 kubenswrapper[35367]: I1204 12:04:41.803121 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e747fb0-b135-4ca9-9b96-568d3af886e6-config\") pod \"controller-manager-b644f86d6-mvlh8\" (UID: \"8e747fb0-b135-4ca9-9b96-568d3af886e6\") " pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" Dec 04 12:04:41.803659 master-0 kubenswrapper[35367]: I1204 12:04:41.803622 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/8e747fb0-b135-4ca9-9b96-568d3af886e6-proxy-ca-bundles\") pod \"controller-manager-b644f86d6-mvlh8\" (UID: \"8e747fb0-b135-4ca9-9b96-568d3af886e6\") " pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" Dec 04 12:04:41.805358 master-0 kubenswrapper[35367]: I1204 12:04:41.805332 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e747fb0-b135-4ca9-9b96-568d3af886e6-serving-cert\") pod \"controller-manager-b644f86d6-mvlh8\" (UID: \"8e747fb0-b135-4ca9-9b96-568d3af886e6\") " pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" Dec 04 12:04:41.842626 master-0 kubenswrapper[35367]: I1204 12:04:41.840283 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-45556\" (UniqueName: \"kubernetes.io/projected/8e747fb0-b135-4ca9-9b96-568d3af886e6-kube-api-access-45556\") pod \"controller-manager-b644f86d6-mvlh8\" (UID: \"8e747fb0-b135-4ca9-9b96-568d3af886e6\") " pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" Dec 04 12:04:41.843883 master-0 kubenswrapper[35367]: I1204 12:04:41.843820 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" podStartSLOduration=18.84378323 podStartE2EDuration="18.84378323s" podCreationTimestamp="2025-12-04 12:04:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:04:41.829397907 +0000 UTC m=+325.267459175" watchObservedRunningTime="2025-12-04 12:04:41.84378323 +0000 UTC m=+325.281844488" Dec 04 12:04:41.874370 master-0 kubenswrapper[35367]: I1204 12:04:41.874265 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" Dec 04 12:04:42.031960 master-0 kubenswrapper[35367]: I1204 12:04:42.031887 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-69cd4c69bf-wlssv"] Dec 04 12:04:42.054788 master-0 kubenswrapper[35367]: W1204 12:04:42.047141 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f017aaf_c4b2_46c5_aaff_ba7d5bce6371.slice/crio-11cc326a99820ac93bdcc53c09e55df3a11e29fd574c61172ceca5a5af929e97 WatchSource:0}: Error finding container 11cc326a99820ac93bdcc53c09e55df3a11e29fd574c61172ceca5a5af929e97: Status 404 returned error can't find the container with id 11cc326a99820ac93bdcc53c09e55df3a11e29fd574c61172ceca5a5af929e97 Dec 04 12:04:42.278590 master-0 kubenswrapper[35367]: I1204 12:04:42.278513 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-b644f86d6-mvlh8"] Dec 04 12:04:42.285404 master-0 kubenswrapper[35367]: W1204 12:04:42.285328 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e747fb0_b135_4ca9_9b96_568d3af886e6.slice/crio-f460809602aa60a1ac3335076e2a9ce34a1eab441f225b236fdc94c9de1db2e3 WatchSource:0}: Error finding container f460809602aa60a1ac3335076e2a9ce34a1eab441f225b236fdc94c9de1db2e3: Status 404 returned error can't find the container with id f460809602aa60a1ac3335076e2a9ce34a1eab441f225b236fdc94c9de1db2e3 Dec 04 12:04:42.687789 master-0 kubenswrapper[35367]: I1204 12:04:42.687639 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" event={"ID":"8e747fb0-b135-4ca9-9b96-568d3af886e6","Type":"ContainerStarted","Data":"49a0d6309ed6f8f2bc43f4f7f9b511f214d6ee6fdde8b845d34d939e22a42db1"} Dec 04 12:04:42.687789 master-0 kubenswrapper[35367]: I1204 12:04:42.687730 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" Dec 04 12:04:42.687789 master-0 kubenswrapper[35367]: I1204 12:04:42.687752 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" event={"ID":"8e747fb0-b135-4ca9-9b96-568d3af886e6","Type":"ContainerStarted","Data":"f460809602aa60a1ac3335076e2a9ce34a1eab441f225b236fdc94c9de1db2e3"} Dec 04 12:04:42.695248 master-0 kubenswrapper[35367]: I1204 12:04:42.694836 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" Dec 04 12:04:42.696564 master-0 kubenswrapper[35367]: I1204 12:04:42.696474 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-69cd4c69bf-wlssv" event={"ID":"0f017aaf-c4b2-46c5-aaff-ba7d5bce6371","Type":"ContainerStarted","Data":"11cc326a99820ac93bdcc53c09e55df3a11e29fd574c61172ceca5a5af929e97"} Dec 04 12:04:42.697056 master-0 kubenswrapper[35367]: I1204 12:04:42.696977 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" Dec 04 12:04:42.705280 master-0 kubenswrapper[35367]: I1204 12:04:42.705225 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" Dec 04 12:04:42.716815 master-0 kubenswrapper[35367]: I1204 12:04:42.716196 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" podStartSLOduration=19.716176775 podStartE2EDuration="19.716176775s" podCreationTimestamp="2025-12-04 12:04:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:04:42.713290334 +0000 UTC m=+326.151351592" watchObservedRunningTime="2025-12-04 12:04:42.716176775 +0000 UTC m=+326.154238033" Dec 04 12:04:45.932941 master-0 kubenswrapper[35367]: I1204 12:04:45.932870 35367 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 12:04:45.933554 master-0 kubenswrapper[35367]: I1204 12:04:45.933148 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" podUID="9b5fd88e9b399c73466d52c7a3c61e3f" containerName="startup-monitor" containerID="cri-o://26c2ca0b0c1dab49d0d3007fd11a1b3b60fa01f1ed7acd97cdf107198b219fe8" gracePeriod=5 Dec 04 12:04:51.515208 master-0 kubenswrapper[35367]: I1204 12:04:51.515136 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-startup-monitor-master-0_9b5fd88e9b399c73466d52c7a3c61e3f/startup-monitor/0.log" Dec 04 12:04:51.515799 master-0 kubenswrapper[35367]: I1204 12:04:51.515247 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:04:51.677701 master-0 kubenswrapper[35367]: I1204 12:04:51.677583 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-var-log\") pod \"9b5fd88e9b399c73466d52c7a3c61e3f\" (UID: \"9b5fd88e9b399c73466d52c7a3c61e3f\") " Dec 04 12:04:51.678034 master-0 kubenswrapper[35367]: I1204 12:04:51.677908 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-var-log" (OuterVolumeSpecName: "var-log") pod "9b5fd88e9b399c73466d52c7a3c61e3f" (UID: "9b5fd88e9b399c73466d52c7a3c61e3f"). InnerVolumeSpecName "var-log". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:04:51.678034 master-0 kubenswrapper[35367]: I1204 12:04:51.678027 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "9b5fd88e9b399c73466d52c7a3c61e3f" (UID: "9b5fd88e9b399c73466d52c7a3c61e3f"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:04:51.678437 master-0 kubenswrapper[35367]: I1204 12:04:51.678157 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-resource-dir\") pod \"9b5fd88e9b399c73466d52c7a3c61e3f\" (UID: \"9b5fd88e9b399c73466d52c7a3c61e3f\") " Dec 04 12:04:51.678437 master-0 kubenswrapper[35367]: I1204 12:04:51.678252 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-pod-resource-dir\") pod \"9b5fd88e9b399c73466d52c7a3c61e3f\" (UID: \"9b5fd88e9b399c73466d52c7a3c61e3f\") " Dec 04 12:04:51.678437 master-0 kubenswrapper[35367]: I1204 12:04:51.678354 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-var-lock\") pod \"9b5fd88e9b399c73466d52c7a3c61e3f\" (UID: \"9b5fd88e9b399c73466d52c7a3c61e3f\") " Dec 04 12:04:51.678437 master-0 kubenswrapper[35367]: I1204 12:04:51.678373 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-manifests\") pod \"9b5fd88e9b399c73466d52c7a3c61e3f\" (UID: \"9b5fd88e9b399c73466d52c7a3c61e3f\") " Dec 04 12:04:51.678649 master-0 kubenswrapper[35367]: I1204 12:04:51.678582 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-var-lock" (OuterVolumeSpecName: "var-lock") pod "9b5fd88e9b399c73466d52c7a3c61e3f" (UID: "9b5fd88e9b399c73466d52c7a3c61e3f"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:04:51.678902 master-0 kubenswrapper[35367]: I1204 12:04:51.678762 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-manifests" (OuterVolumeSpecName: "manifests") pod "9b5fd88e9b399c73466d52c7a3c61e3f" (UID: "9b5fd88e9b399c73466d52c7a3c61e3f"). InnerVolumeSpecName "manifests". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:04:51.679383 master-0 kubenswrapper[35367]: I1204 12:04:51.679347 35367 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:51.679383 master-0 kubenswrapper[35367]: I1204 12:04:51.679381 35367 reconciler_common.go:293] "Volume detached for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-manifests\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:51.679457 master-0 kubenswrapper[35367]: I1204 12:04:51.679396 35367 reconciler_common.go:293] "Volume detached for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-var-log\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:51.679457 master-0 kubenswrapper[35367]: I1204 12:04:51.679414 35367 reconciler_common.go:293] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:51.686543 master-0 kubenswrapper[35367]: I1204 12:04:51.686438 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-pod-resource-dir" (OuterVolumeSpecName: "pod-resource-dir") pod "9b5fd88e9b399c73466d52c7a3c61e3f" (UID: "9b5fd88e9b399c73466d52c7a3c61e3f"). InnerVolumeSpecName "pod-resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:04:51.767606 master-0 kubenswrapper[35367]: I1204 12:04:51.767455 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-startup-monitor-master-0_9b5fd88e9b399c73466d52c7a3c61e3f/startup-monitor/0.log" Dec 04 12:04:51.768028 master-0 kubenswrapper[35367]: I1204 12:04:51.767997 35367 generic.go:334] "Generic (PLEG): container finished" podID="9b5fd88e9b399c73466d52c7a3c61e3f" containerID="26c2ca0b0c1dab49d0d3007fd11a1b3b60fa01f1ed7acd97cdf107198b219fe8" exitCode=137 Dec 04 12:04:51.768133 master-0 kubenswrapper[35367]: I1204 12:04:51.768088 35367 scope.go:117] "RemoveContainer" containerID="26c2ca0b0c1dab49d0d3007fd11a1b3b60fa01f1ed7acd97cdf107198b219fe8" Dec 04 12:04:51.768219 master-0 kubenswrapper[35367]: I1204 12:04:51.768093 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:04:51.781129 master-0 kubenswrapper[35367]: I1204 12:04:51.781069 35367 reconciler_common.go:293] "Volume detached for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/9b5fd88e9b399c73466d52c7a3c61e3f-pod-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:04:51.794500 master-0 kubenswrapper[35367]: I1204 12:04:51.794455 35367 scope.go:117] "RemoveContainer" containerID="26c2ca0b0c1dab49d0d3007fd11a1b3b60fa01f1ed7acd97cdf107198b219fe8" Dec 04 12:04:51.795104 master-0 kubenswrapper[35367]: E1204 12:04:51.795060 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26c2ca0b0c1dab49d0d3007fd11a1b3b60fa01f1ed7acd97cdf107198b219fe8\": container with ID starting with 26c2ca0b0c1dab49d0d3007fd11a1b3b60fa01f1ed7acd97cdf107198b219fe8 not found: ID does not exist" containerID="26c2ca0b0c1dab49d0d3007fd11a1b3b60fa01f1ed7acd97cdf107198b219fe8" Dec 04 12:04:51.795179 master-0 kubenswrapper[35367]: I1204 12:04:51.795102 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26c2ca0b0c1dab49d0d3007fd11a1b3b60fa01f1ed7acd97cdf107198b219fe8"} err="failed to get container status \"26c2ca0b0c1dab49d0d3007fd11a1b3b60fa01f1ed7acd97cdf107198b219fe8\": rpc error: code = NotFound desc = could not find container \"26c2ca0b0c1dab49d0d3007fd11a1b3b60fa01f1ed7acd97cdf107198b219fe8\": container with ID starting with 26c2ca0b0c1dab49d0d3007fd11a1b3b60fa01f1ed7acd97cdf107198b219fe8 not found: ID does not exist" Dec 04 12:04:52.756223 master-0 kubenswrapper[35367]: I1204 12:04:52.756148 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b5fd88e9b399c73466d52c7a3c61e3f" path="/var/lib/kubelet/pods/9b5fd88e9b399c73466d52c7a3c61e3f/volumes" Dec 04 12:04:52.756769 master-0 kubenswrapper[35367]: I1204 12:04:52.756457 35367 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" podUID="" Dec 04 12:04:55.749364 master-0 kubenswrapper[35367]: E1204 12:04:55.749083 35367 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="3.002s" Dec 04 12:04:55.758482 master-0 kubenswrapper[35367]: I1204 12:04:55.758416 35367 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" podUID="" Dec 04 12:04:55.825336 master-0 kubenswrapper[35367]: I1204 12:04:55.825261 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 12:04:55.825336 master-0 kubenswrapper[35367]: I1204 12:04:55.825306 35367 kubelet.go:2649] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" mirrorPodUID="4e354b96-4359-45b4-8f79-018a19de4d64" Dec 04 12:04:55.825336 master-0 kubenswrapper[35367]: I1204 12:04:55.825328 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 12:04:55.826149 master-0 kubenswrapper[35367]: I1204 12:04:55.825339 35367 kubelet.go:2673] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" mirrorPodUID="4e354b96-4359-45b4-8f79-018a19de4d64" Dec 04 12:05:08.911380 master-0 kubenswrapper[35367]: I1204 12:05:08.911281 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-admission-controller-7dfc5b745f-258xq_08550069-c1a1-475e-84a2-e56905f1ed38/multus-admission-controller/0.log" Dec 04 12:05:08.911380 master-0 kubenswrapper[35367]: I1204 12:05:08.911366 35367 generic.go:334] "Generic (PLEG): container finished" podID="08550069-c1a1-475e-84a2-e56905f1ed38" containerID="8762d647c5e9e97a8049116602f9b1ae80da119559094578719d511b88598148" exitCode=137 Dec 04 12:05:08.912120 master-0 kubenswrapper[35367]: I1204 12:05:08.911410 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" event={"ID":"08550069-c1a1-475e-84a2-e56905f1ed38","Type":"ContainerDied","Data":"8762d647c5e9e97a8049116602f9b1ae80da119559094578719d511b88598148"} Dec 04 12:05:12.553726 master-0 kubenswrapper[35367]: I1204 12:05:12.553678 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-admission-controller-7dfc5b745f-258xq_08550069-c1a1-475e-84a2-e56905f1ed38/multus-admission-controller/0.log" Dec 04 12:05:12.554377 master-0 kubenswrapper[35367]: I1204 12:05:12.553766 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 12:05:12.707330 master-0 kubenswrapper[35367]: I1204 12:05:12.707241 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs\") pod \"08550069-c1a1-475e-84a2-e56905f1ed38\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " Dec 04 12:05:12.707791 master-0 kubenswrapper[35367]: I1204 12:05:12.707418 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cffn\" (UniqueName: \"kubernetes.io/projected/08550069-c1a1-475e-84a2-e56905f1ed38-kube-api-access-8cffn\") pod \"08550069-c1a1-475e-84a2-e56905f1ed38\" (UID: \"08550069-c1a1-475e-84a2-e56905f1ed38\") " Dec 04 12:05:12.711821 master-0 kubenswrapper[35367]: I1204 12:05:12.711705 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs" (OuterVolumeSpecName: "webhook-certs") pod "08550069-c1a1-475e-84a2-e56905f1ed38" (UID: "08550069-c1a1-475e-84a2-e56905f1ed38"). InnerVolumeSpecName "webhook-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:05:12.712086 master-0 kubenswrapper[35367]: I1204 12:05:12.711852 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08550069-c1a1-475e-84a2-e56905f1ed38-kube-api-access-8cffn" (OuterVolumeSpecName: "kube-api-access-8cffn") pod "08550069-c1a1-475e-84a2-e56905f1ed38" (UID: "08550069-c1a1-475e-84a2-e56905f1ed38"). InnerVolumeSpecName "kube-api-access-8cffn". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:05:12.809320 master-0 kubenswrapper[35367]: I1204 12:05:12.809078 35367 reconciler_common.go:293] "Volume detached for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/08550069-c1a1-475e-84a2-e56905f1ed38-webhook-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:05:12.809689 master-0 kubenswrapper[35367]: I1204 12:05:12.809427 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8cffn\" (UniqueName: \"kubernetes.io/projected/08550069-c1a1-475e-84a2-e56905f1ed38-kube-api-access-8cffn\") on node \"master-0\" DevicePath \"\"" Dec 04 12:05:12.915833 master-0 kubenswrapper[35367]: E1204 12:05:12.915705 35367 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08550069_c1a1_475e_84a2_e56905f1ed38.slice/crio-7458153a023b91d017eed71d76df09c0bc8fa59fa08b1c40a9a1e8366760b372\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08550069_c1a1_475e_84a2_e56905f1ed38.slice\": RecentStats: unable to find data in memory cache]" Dec 04 12:05:12.951036 master-0 kubenswrapper[35367]: I1204 12:05:12.950964 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-admission-controller-7dfc5b745f-258xq_08550069-c1a1-475e-84a2-e56905f1ed38/multus-admission-controller/0.log" Dec 04 12:05:12.951292 master-0 kubenswrapper[35367]: I1204 12:05:12.951142 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" Dec 04 12:05:12.951863 master-0 kubenswrapper[35367]: I1204 12:05:12.951790 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-7dfc5b745f-258xq" event={"ID":"08550069-c1a1-475e-84a2-e56905f1ed38","Type":"ContainerDied","Data":"7458153a023b91d017eed71d76df09c0bc8fa59fa08b1c40a9a1e8366760b372"} Dec 04 12:05:12.951911 master-0 kubenswrapper[35367]: I1204 12:05:12.951874 35367 scope.go:117] "RemoveContainer" containerID="150e8033295adf15ce019a92e7d442b68772928da716e398fe0f605d8a64f9e6" Dec 04 12:05:12.955630 master-0 kubenswrapper[35367]: I1204 12:05:12.955539 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-69cd4c69bf-wlssv" event={"ID":"0f017aaf-c4b2-46c5-aaff-ba7d5bce6371","Type":"ContainerStarted","Data":"995e45f325e79081b455fd65ed401194af54ba2d48b39ca8e296e264869b4750"} Dec 04 12:05:12.955710 master-0 kubenswrapper[35367]: I1204 12:05:12.955663 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/downloads-69cd4c69bf-wlssv" Dec 04 12:05:12.958074 master-0 kubenswrapper[35367]: I1204 12:05:12.957975 35367 patch_prober.go:28] interesting pod/downloads-69cd4c69bf-wlssv container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.128.0.86:8080/\": dial tcp 10.128.0.86:8080: connect: connection refused" start-of-body= Dec 04 12:05:12.958074 master-0 kubenswrapper[35367]: I1204 12:05:12.958033 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-69cd4c69bf-wlssv" podUID="0f017aaf-c4b2-46c5-aaff-ba7d5bce6371" containerName="download-server" probeResult="failure" output="Get \"http://10.128.0.86:8080/\": dial tcp 10.128.0.86:8080: connect: connection refused" Dec 04 12:05:12.974518 master-0 kubenswrapper[35367]: I1204 12:05:12.974465 35367 scope.go:117] "RemoveContainer" containerID="8762d647c5e9e97a8049116602f9b1ae80da119559094578719d511b88598148" Dec 04 12:05:12.997003 master-0 kubenswrapper[35367]: I1204 12:05:12.996918 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-69cd4c69bf-wlssv" podStartSLOduration=1.7003093150000002 podStartE2EDuration="31.996894832s" podCreationTimestamp="2025-12-04 12:04:41 +0000 UTC" firstStartedPulling="2025-12-04 12:04:42.054553863 +0000 UTC m=+325.492615121" lastFinishedPulling="2025-12-04 12:05:12.35113938 +0000 UTC m=+355.789200638" observedRunningTime="2025-12-04 12:05:12.994042162 +0000 UTC m=+356.432103440" watchObservedRunningTime="2025-12-04 12:05:12.996894832 +0000 UTC m=+356.434956090" Dec 04 12:05:13.020235 master-0 kubenswrapper[35367]: I1204 12:05:13.020169 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-multus/multus-admission-controller-7dfc5b745f-258xq"] Dec 04 12:05:13.025798 master-0 kubenswrapper[35367]: I1204 12:05:13.025718 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-multus/multus-admission-controller-7dfc5b745f-258xq"] Dec 04 12:05:13.967951 master-0 kubenswrapper[35367]: I1204 12:05:13.967886 35367 patch_prober.go:28] interesting pod/downloads-69cd4c69bf-wlssv container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.128.0.86:8080/\": dial tcp 10.128.0.86:8080: connect: connection refused" start-of-body= Dec 04 12:05:13.968489 master-0 kubenswrapper[35367]: I1204 12:05:13.967963 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-69cd4c69bf-wlssv" podUID="0f017aaf-c4b2-46c5-aaff-ba7d5bce6371" containerName="download-server" probeResult="failure" output="Get \"http://10.128.0.86:8080/\": dial tcp 10.128.0.86:8080: connect: connection refused" Dec 04 12:05:14.757304 master-0 kubenswrapper[35367]: I1204 12:05:14.757231 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08550069-c1a1-475e-84a2-e56905f1ed38" path="/var/lib/kubelet/pods/08550069-c1a1-475e-84a2-e56905f1ed38/volumes" Dec 04 12:05:16.977037 master-0 kubenswrapper[35367]: I1204 12:05:16.976978 35367 scope.go:117] "RemoveContainer" containerID="33431b10151447abe91f891b95bb44699da99e3035e0d5ffbd8c1b04917becde" Dec 04 12:05:17.512940 master-0 kubenswrapper[35367]: I1204 12:05:16.995411 35367 scope.go:117] "RemoveContainer" containerID="699a63b2d7941ed4336c1635f023cff1f0486ae2fd4b4873876780d919314e24" Dec 04 12:05:17.512940 master-0 kubenswrapper[35367]: I1204 12:05:17.016370 35367 scope.go:117] "RemoveContainer" containerID="760657f653245b292cc835a469bd76ffdf70307718fd7139083e006a5e12f961" Dec 04 12:05:17.512940 master-0 kubenswrapper[35367]: I1204 12:05:17.036544 35367 scope.go:117] "RemoveContainer" containerID="77e87b65d2d4db1f1231cca5b248512d4a871ef2353103a6010989d0ff1fc4d1" Dec 04 12:05:17.512940 master-0 kubenswrapper[35367]: I1204 12:05:17.052091 35367 scope.go:117] "RemoveContainer" containerID="093d2c6afc84903316f06d61c2011b5876f2371e9251cd94a18d8c28080caa20" Dec 04 12:05:17.512940 master-0 kubenswrapper[35367]: I1204 12:05:17.068582 35367 scope.go:117] "RemoveContainer" containerID="e6c2fccf4e6fd6d2ffc424d145ecefb24910bddae93bdeeb548a2d4e20d0f630" Dec 04 12:05:17.512940 master-0 kubenswrapper[35367]: I1204 12:05:17.086260 35367 scope.go:117] "RemoveContainer" containerID="522499db1b7f9c87ec01e1460e866cf06b4497c66a47056b8d594ba69f505901" Dec 04 12:05:17.512940 master-0 kubenswrapper[35367]: I1204 12:05:17.101868 35367 scope.go:117] "RemoveContainer" containerID="1088ace64761e3c007911c989818e39a17d1b9944859d157200f13ef28d4942e" Dec 04 12:05:21.624416 master-0 kubenswrapper[35367]: I1204 12:05:21.624339 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-69cd4c69bf-wlssv" Dec 04 12:05:56.242528 master-0 kubenswrapper[35367]: I1204 12:05:56.242448 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_bdd20c68f1ccfd1240fb273af0638d01/kube-scheduler-cert-syncer/1.log" Dec 04 12:05:56.244221 master-0 kubenswrapper[35367]: I1204 12:05:56.244178 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_bdd20c68f1ccfd1240fb273af0638d01/kube-scheduler-cert-syncer/0.log" Dec 04 12:05:56.245150 master-0 kubenswrapper[35367]: I1204 12:05:56.245128 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_bdd20c68f1ccfd1240fb273af0638d01/kube-scheduler/0.log" Dec 04 12:05:56.245729 master-0 kubenswrapper[35367]: I1204 12:05:56.245701 35367 generic.go:334] "Generic (PLEG): container finished" podID="bdd20c68f1ccfd1240fb273af0638d01" containerID="9e6711a29e80dd1a67221ee7d3cb99dca0b39d86d535ebc251bf63200ef5ce12" exitCode=1 Dec 04 12:05:56.245824 master-0 kubenswrapper[35367]: I1204 12:05:56.245743 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"bdd20c68f1ccfd1240fb273af0638d01","Type":"ContainerDied","Data":"9e6711a29e80dd1a67221ee7d3cb99dca0b39d86d535ebc251bf63200ef5ce12"} Dec 04 12:05:56.245824 master-0 kubenswrapper[35367]: I1204 12:05:56.245789 35367 scope.go:117] "RemoveContainer" containerID="83e55c475e3dc5500479af8907cda3d13a24a31c8ee5c2278bdd8d400f5e7292" Dec 04 12:05:56.246650 master-0 kubenswrapper[35367]: I1204 12:05:56.246602 35367 scope.go:117] "RemoveContainer" containerID="9e6711a29e80dd1a67221ee7d3cb99dca0b39d86d535ebc251bf63200ef5ce12" Dec 04 12:05:57.254167 master-0 kubenswrapper[35367]: I1204 12:05:57.254132 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_bdd20c68f1ccfd1240fb273af0638d01/kube-scheduler-cert-syncer/1.log" Dec 04 12:05:57.256274 master-0 kubenswrapper[35367]: I1204 12:05:57.256227 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_bdd20c68f1ccfd1240fb273af0638d01/kube-scheduler/0.log" Dec 04 12:05:57.256795 master-0 kubenswrapper[35367]: I1204 12:05:57.256746 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"bdd20c68f1ccfd1240fb273af0638d01","Type":"ContainerStarted","Data":"0e3fb5e9fe4481e5a52c8778d150f0c86ce142116f508b1439fac0aa3de5e005"} Dec 04 12:06:01.273292 master-0 kubenswrapper[35367]: I1204 12:06:01.273187 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/installer-4-master-0"] Dec 04 12:06:01.274271 master-0 kubenswrapper[35367]: E1204 12:06:01.273496 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9b5fd88e9b399c73466d52c7a3c61e3f" containerName="startup-monitor" Dec 04 12:06:01.274271 master-0 kubenswrapper[35367]: I1204 12:06:01.273511 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b5fd88e9b399c73466d52c7a3c61e3f" containerName="startup-monitor" Dec 04 12:06:01.274271 master-0 kubenswrapper[35367]: E1204 12:06:01.273522 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="08550069-c1a1-475e-84a2-e56905f1ed38" containerName="kube-rbac-proxy" Dec 04 12:06:01.274271 master-0 kubenswrapper[35367]: I1204 12:06:01.273529 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="08550069-c1a1-475e-84a2-e56905f1ed38" containerName="kube-rbac-proxy" Dec 04 12:06:01.274271 master-0 kubenswrapper[35367]: E1204 12:06:01.273544 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="08550069-c1a1-475e-84a2-e56905f1ed38" containerName="multus-admission-controller" Dec 04 12:06:01.274271 master-0 kubenswrapper[35367]: I1204 12:06:01.273553 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="08550069-c1a1-475e-84a2-e56905f1ed38" containerName="multus-admission-controller" Dec 04 12:06:01.274271 master-0 kubenswrapper[35367]: I1204 12:06:01.273655 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="08550069-c1a1-475e-84a2-e56905f1ed38" containerName="multus-admission-controller" Dec 04 12:06:01.274271 master-0 kubenswrapper[35367]: I1204 12:06:01.273680 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="08550069-c1a1-475e-84a2-e56905f1ed38" containerName="kube-rbac-proxy" Dec 04 12:06:01.274271 master-0 kubenswrapper[35367]: I1204 12:06:01.273701 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="9b5fd88e9b399c73466d52c7a3c61e3f" containerName="startup-monitor" Dec 04 12:06:01.274271 master-0 kubenswrapper[35367]: I1204 12:06:01.274118 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 12:06:01.276300 master-0 kubenswrapper[35367]: I1204 12:06:01.276257 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager"/"installer-sa-dockercfg-vn92f" Dec 04 12:06:01.276414 master-0 kubenswrapper[35367]: I1204 12:06:01.276300 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager"/"kube-root-ca.crt" Dec 04 12:06:01.304310 master-0 kubenswrapper[35367]: I1204 12:06:01.304197 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/e7fffd09-09be-49a8-937b-aa2e95c2968f-kube-api-access\") pod \"installer-4-master-0\" (UID: \"e7fffd09-09be-49a8-937b-aa2e95c2968f\") " pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 12:06:01.304310 master-0 kubenswrapper[35367]: I1204 12:06:01.304278 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/e7fffd09-09be-49a8-937b-aa2e95c2968f-var-lock\") pod \"installer-4-master-0\" (UID: \"e7fffd09-09be-49a8-937b-aa2e95c2968f\") " pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 12:06:01.304310 master-0 kubenswrapper[35367]: I1204 12:06:01.304297 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7fffd09-09be-49a8-937b-aa2e95c2968f-kubelet-dir\") pod \"installer-4-master-0\" (UID: \"e7fffd09-09be-49a8-937b-aa2e95c2968f\") " pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 12:06:01.371147 master-0 kubenswrapper[35367]: I1204 12:06:01.371049 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-4-master-0"] Dec 04 12:06:01.406522 master-0 kubenswrapper[35367]: I1204 12:06:01.406448 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/e7fffd09-09be-49a8-937b-aa2e95c2968f-kube-api-access\") pod \"installer-4-master-0\" (UID: \"e7fffd09-09be-49a8-937b-aa2e95c2968f\") " pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 12:06:01.406522 master-0 kubenswrapper[35367]: I1204 12:06:01.406518 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/e7fffd09-09be-49a8-937b-aa2e95c2968f-var-lock\") pod \"installer-4-master-0\" (UID: \"e7fffd09-09be-49a8-937b-aa2e95c2968f\") " pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 12:06:01.406792 master-0 kubenswrapper[35367]: I1204 12:06:01.406695 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7fffd09-09be-49a8-937b-aa2e95c2968f-kubelet-dir\") pod \"installer-4-master-0\" (UID: \"e7fffd09-09be-49a8-937b-aa2e95c2968f\") " pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 12:06:01.406876 master-0 kubenswrapper[35367]: I1204 12:06:01.406800 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7fffd09-09be-49a8-937b-aa2e95c2968f-kubelet-dir\") pod \"installer-4-master-0\" (UID: \"e7fffd09-09be-49a8-937b-aa2e95c2968f\") " pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 12:06:01.406876 master-0 kubenswrapper[35367]: I1204 12:06:01.406872 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/e7fffd09-09be-49a8-937b-aa2e95c2968f-var-lock\") pod \"installer-4-master-0\" (UID: \"e7fffd09-09be-49a8-937b-aa2e95c2968f\") " pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 12:06:01.430079 master-0 kubenswrapper[35367]: I1204 12:06:01.430006 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/e7fffd09-09be-49a8-937b-aa2e95c2968f-kube-api-access\") pod \"installer-4-master-0\" (UID: \"e7fffd09-09be-49a8-937b-aa2e95c2968f\") " pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 12:06:01.592762 master-0 kubenswrapper[35367]: I1204 12:06:01.592681 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 12:06:02.096181 master-0 kubenswrapper[35367]: I1204 12:06:02.096133 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-4-master-0"] Dec 04 12:06:02.295104 master-0 kubenswrapper[35367]: I1204 12:06:02.295030 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-4-master-0" event={"ID":"e7fffd09-09be-49a8-937b-aa2e95c2968f","Type":"ContainerStarted","Data":"02c40cea8fe7ab82d164b6933acb9e6387721f4f9ca7b46263806f0ade5328d7"} Dec 04 12:06:03.305499 master-0 kubenswrapper[35367]: I1204 12:06:03.305405 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-4-master-0" event={"ID":"e7fffd09-09be-49a8-937b-aa2e95c2968f","Type":"ContainerStarted","Data":"1fad34659bf0c3a3a160bf0ab5c988f36b917bbc7df6cfadd4949144dbe428d9"} Dec 04 12:06:03.341488 master-0 kubenswrapper[35367]: I1204 12:06:03.341369 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/installer-4-master-0" podStartSLOduration=2.341343181 podStartE2EDuration="2.341343181s" podCreationTimestamp="2025-12-04 12:06:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:06:03.334153244 +0000 UTC m=+406.772214512" watchObservedRunningTime="2025-12-04 12:06:03.341343181 +0000 UTC m=+406.779404449" Dec 04 12:06:08.725145 master-0 kubenswrapper[35367]: I1204 12:06:08.725075 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/machine-config-controller-7c6d64c4cd-5wrwt"] Dec 04 12:06:08.726765 master-0 kubenswrapper[35367]: I1204 12:06:08.726333 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-controller-7c6d64c4cd-5wrwt" Dec 04 12:06:08.729135 master-0 kubenswrapper[35367]: I1204 12:06:08.729090 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"mcc-proxy-tls" Dec 04 12:06:08.729223 master-0 kubenswrapper[35367]: I1204 12:06:08.729156 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-controller-dockercfg-mtqb4" Dec 04 12:06:08.754247 master-0 kubenswrapper[35367]: I1204 12:06:08.754156 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/fa606e05-58bb-483a-92c3-46639085073a-mcc-auth-proxy-config\") pod \"machine-config-controller-7c6d64c4cd-5wrwt\" (UID: \"fa606e05-58bb-483a-92c3-46639085073a\") " pod="openshift-machine-config-operator/machine-config-controller-7c6d64c4cd-5wrwt" Dec 04 12:06:08.754247 master-0 kubenswrapper[35367]: I1204 12:06:08.754255 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fa606e05-58bb-483a-92c3-46639085073a-proxy-tls\") pod \"machine-config-controller-7c6d64c4cd-5wrwt\" (UID: \"fa606e05-58bb-483a-92c3-46639085073a\") " pod="openshift-machine-config-operator/machine-config-controller-7c6d64c4cd-5wrwt" Dec 04 12:06:08.754609 master-0 kubenswrapper[35367]: I1204 12:06:08.754291 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5wcm\" (UniqueName: \"kubernetes.io/projected/fa606e05-58bb-483a-92c3-46639085073a-kube-api-access-s5wcm\") pod \"machine-config-controller-7c6d64c4cd-5wrwt\" (UID: \"fa606e05-58bb-483a-92c3-46639085073a\") " pod="openshift-machine-config-operator/machine-config-controller-7c6d64c4cd-5wrwt" Dec 04 12:06:08.755059 master-0 kubenswrapper[35367]: I1204 12:06:08.754962 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-config-operator/machine-config-controller-7c6d64c4cd-5wrwt"] Dec 04 12:06:08.855917 master-0 kubenswrapper[35367]: I1204 12:06:08.855835 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/fa606e05-58bb-483a-92c3-46639085073a-mcc-auth-proxy-config\") pod \"machine-config-controller-7c6d64c4cd-5wrwt\" (UID: \"fa606e05-58bb-483a-92c3-46639085073a\") " pod="openshift-machine-config-operator/machine-config-controller-7c6d64c4cd-5wrwt" Dec 04 12:06:08.855917 master-0 kubenswrapper[35367]: I1204 12:06:08.855927 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fa606e05-58bb-483a-92c3-46639085073a-proxy-tls\") pod \"machine-config-controller-7c6d64c4cd-5wrwt\" (UID: \"fa606e05-58bb-483a-92c3-46639085073a\") " pod="openshift-machine-config-operator/machine-config-controller-7c6d64c4cd-5wrwt" Dec 04 12:06:08.856195 master-0 kubenswrapper[35367]: I1204 12:06:08.855970 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s5wcm\" (UniqueName: \"kubernetes.io/projected/fa606e05-58bb-483a-92c3-46639085073a-kube-api-access-s5wcm\") pod \"machine-config-controller-7c6d64c4cd-5wrwt\" (UID: \"fa606e05-58bb-483a-92c3-46639085073a\") " pod="openshift-machine-config-operator/machine-config-controller-7c6d64c4cd-5wrwt" Dec 04 12:06:08.857370 master-0 kubenswrapper[35367]: I1204 12:06:08.857304 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/fa606e05-58bb-483a-92c3-46639085073a-mcc-auth-proxy-config\") pod \"machine-config-controller-7c6d64c4cd-5wrwt\" (UID: \"fa606e05-58bb-483a-92c3-46639085073a\") " pod="openshift-machine-config-operator/machine-config-controller-7c6d64c4cd-5wrwt" Dec 04 12:06:08.859687 master-0 kubenswrapper[35367]: I1204 12:06:08.859637 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fa606e05-58bb-483a-92c3-46639085073a-proxy-tls\") pod \"machine-config-controller-7c6d64c4cd-5wrwt\" (UID: \"fa606e05-58bb-483a-92c3-46639085073a\") " pod="openshift-machine-config-operator/machine-config-controller-7c6d64c4cd-5wrwt" Dec 04 12:06:08.874417 master-0 kubenswrapper[35367]: I1204 12:06:08.874368 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5wcm\" (UniqueName: \"kubernetes.io/projected/fa606e05-58bb-483a-92c3-46639085073a-kube-api-access-s5wcm\") pod \"machine-config-controller-7c6d64c4cd-5wrwt\" (UID: \"fa606e05-58bb-483a-92c3-46639085073a\") " pod="openshift-machine-config-operator/machine-config-controller-7c6d64c4cd-5wrwt" Dec 04 12:06:09.050729 master-0 kubenswrapper[35367]: I1204 12:06:09.050592 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-controller-7c6d64c4cd-5wrwt" Dec 04 12:06:09.518762 master-0 kubenswrapper[35367]: I1204 12:06:09.518696 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-config-operator/machine-config-controller-7c6d64c4cd-5wrwt"] Dec 04 12:06:09.522372 master-0 kubenswrapper[35367]: W1204 12:06:09.522313 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa606e05_58bb_483a_92c3_46639085073a.slice/crio-17d6224d212b036e419609523b5f893a63300f0e2d7f7dfc39feecd13f451ea8 WatchSource:0}: Error finding container 17d6224d212b036e419609523b5f893a63300f0e2d7f7dfc39feecd13f451ea8: Status 404 returned error can't find the container with id 17d6224d212b036e419609523b5f893a63300f0e2d7f7dfc39feecd13f451ea8 Dec 04 12:06:09.812308 master-0 kubenswrapper[35367]: I1204 12:06:09.812246 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7d45bf9455-w67z7"] Dec 04 12:06:09.813250 master-0 kubenswrapper[35367]: I1204 12:06:09.813227 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7d45bf9455-w67z7" Dec 04 12:06:09.818246 master-0 kubenswrapper[35367]: I1204 12:06:09.818195 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-console"/"networking-console-plugin-cert" Dec 04 12:06:09.819992 master-0 kubenswrapper[35367]: I1204 12:06:09.819946 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-console"/"networking-console-plugin" Dec 04 12:06:09.821823 master-0 kubenswrapper[35367]: I1204 12:06:09.821766 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5465c8b4db-58d52"] Dec 04 12:06:09.823693 master-0 kubenswrapper[35367]: I1204 12:06:09.823641 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5465c8b4db-58d52" Dec 04 12:06:09.829258 master-0 kubenswrapper[35367]: I1204 12:06:09.829215 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress"/"openshift-service-ca.crt" Dec 04 12:06:09.829522 master-0 kubenswrapper[35367]: I1204 12:06:09.829494 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress"/"service-ca-bundle" Dec 04 12:06:09.829836 master-0 kubenswrapper[35367]: I1204 12:06:09.829703 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress"/"kube-root-ca.crt" Dec 04 12:06:09.833700 master-0 kubenswrapper[35367]: I1204 12:06:09.830086 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-stats-default" Dec 04 12:06:09.833700 master-0 kubenswrapper[35367]: I1204 12:06:09.830089 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-metrics-certs-default" Dec 04 12:06:09.833700 master-0 kubenswrapper[35367]: I1204 12:06:09.830374 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-certs-default" Dec 04 12:06:09.833700 master-0 kubenswrapper[35367]: I1204 12:06:09.831433 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv"] Dec 04 12:06:09.833700 master-0 kubenswrapper[35367]: I1204 12:06:09.832757 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv" Dec 04 12:06:09.861075 master-0 kubenswrapper[35367]: I1204 12:06:09.861008 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-85d8db45d4-5bjlq"] Dec 04 12:06:09.862666 master-0 kubenswrapper[35367]: I1204 12:06:09.862638 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-85d8db45d4-5bjlq" Dec 04 12:06:09.863544 master-0 kubenswrapper[35367]: I1204 12:06:09.863502 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"collect-profiles-dockercfg-hd7lj" Dec 04 12:06:09.863791 master-0 kubenswrapper[35367]: I1204 12:06:09.863764 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"collect-profiles-config" Dec 04 12:06:09.872918 master-0 kubenswrapper[35367]: I1204 12:06:09.872779 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7c85c4dffd-xv2wn"] Dec 04 12:06:09.876861 master-0 kubenswrapper[35367]: I1204 12:06:09.875177 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7c85c4dffd-xv2wn" Dec 04 12:06:09.878559 master-0 kubenswrapper[35367]: I1204 12:06:09.878515 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-admission-webhook-tls" Dec 04 12:06:09.894872 master-0 kubenswrapper[35367]: I1204 12:06:09.882849 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pz4lp"] Dec 04 12:06:09.934630 master-0 kubenswrapper[35367]: I1204 12:06:09.934573 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pz4lp" Dec 04 12:06:09.937546 master-0 kubenswrapper[35367]: I1204 12:06:09.937198 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv"] Dec 04 12:06:09.938256 master-0 kubenswrapper[35367]: I1204 12:06:09.938174 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-canary"/"canary-serving-cert" Dec 04 12:06:09.938446 master-0 kubenswrapper[35367]: I1204 12:06:09.938245 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-canary"/"kube-root-ca.crt" Dec 04 12:06:09.938550 master-0 kubenswrapper[35367]: I1204 12:06:09.938505 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-canary"/"openshift-service-ca.crt" Dec 04 12:06:09.942686 master-0 kubenswrapper[35367]: I1204 12:06:09.942625 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7c85c4dffd-xv2wn"] Dec 04 12:06:09.943747 master-0 kubenswrapper[35367]: I1204 12:06:09.943557 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-canary"/"default-dockercfg-9mbcr" Dec 04 12:06:09.947352 master-0 kubenswrapper[35367]: I1204 12:06:09.946926 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7d45bf9455-w67z7"] Dec 04 12:06:09.953372 master-0 kubenswrapper[35367]: I1204 12:06:09.953133 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pz4lp"] Dec 04 12:06:09.959298 master-0 kubenswrapper[35367]: I1204 12:06:09.959197 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-85d8db45d4-5bjlq"] Dec 04 12:06:09.980692 master-0 kubenswrapper[35367]: I1204 12:06:09.980599 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5b06b803-1aad-4536-9a41-7369580701d2-nginx-conf\") pod \"networking-console-plugin-7d45bf9455-w67z7\" (UID: \"5b06b803-1aad-4536-9a41-7369580701d2\") " pod="openshift-network-console/networking-console-plugin-7d45bf9455-w67z7" Dec 04 12:06:09.980692 master-0 kubenswrapper[35367]: I1204 12:06:09.980694 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b321ddb3-08ce-4101-bfa3-4200006f11ac-service-ca-bundle\") pod \"router-default-5465c8b4db-58d52\" (UID: \"b321ddb3-08ce-4101-bfa3-4200006f11ac\") " pod="openshift-ingress/router-default-5465c8b4db-58d52" Dec 04 12:06:09.981001 master-0 kubenswrapper[35367]: I1204 12:06:09.980719 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b321ddb3-08ce-4101-bfa3-4200006f11ac-stats-auth\") pod \"router-default-5465c8b4db-58d52\" (UID: \"b321ddb3-08ce-4101-bfa3-4200006f11ac\") " pod="openshift-ingress/router-default-5465c8b4db-58d52" Dec 04 12:06:09.981001 master-0 kubenswrapper[35367]: I1204 12:06:09.980772 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8fa6831-60e8-415e-978a-d203d46ecbdc-cert\") pod \"ingress-canary-pz4lp\" (UID: \"d8fa6831-60e8-415e-978a-d203d46ecbdc\") " pod="openshift-ingress-canary/ingress-canary-pz4lp" Dec 04 12:06:09.981001 master-0 kubenswrapper[35367]: I1204 12:06:09.980792 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b321ddb3-08ce-4101-bfa3-4200006f11ac-metrics-certs\") pod \"router-default-5465c8b4db-58d52\" (UID: \"b321ddb3-08ce-4101-bfa3-4200006f11ac\") " pod="openshift-ingress/router-default-5465c8b4db-58d52" Dec 04 12:06:09.981151 master-0 kubenswrapper[35367]: I1204 12:06:09.980966 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ae0f644f-a31c-4b6c-b854-e01417aa448e-tls-certificates\") pod \"prometheus-operator-admission-webhook-7c85c4dffd-xv2wn\" (UID: \"ae0f644f-a31c-4b6c-b854-e01417aa448e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7c85c4dffd-xv2wn" Dec 04 12:06:09.981151 master-0 kubenswrapper[35367]: I1204 12:06:09.981069 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4h9t\" (UniqueName: \"kubernetes.io/projected/0372b35f-9414-43a9-b739-509eaababbb1-kube-api-access-r4h9t\") pod \"network-check-source-85d8db45d4-5bjlq\" (UID: \"0372b35f-9414-43a9-b739-509eaababbb1\") " pod="openshift-network-diagnostics/network-check-source-85d8db45d4-5bjlq" Dec 04 12:06:09.981467 master-0 kubenswrapper[35367]: I1204 12:06:09.981320 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5b06b803-1aad-4536-9a41-7369580701d2-networking-console-plugin-cert\") pod \"networking-console-plugin-7d45bf9455-w67z7\" (UID: \"5b06b803-1aad-4536-9a41-7369580701d2\") " pod="openshift-network-console/networking-console-plugin-7d45bf9455-w67z7" Dec 04 12:06:09.981467 master-0 kubenswrapper[35367]: I1204 12:06:09.981449 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4clj7\" (UniqueName: \"kubernetes.io/projected/b321ddb3-08ce-4101-bfa3-4200006f11ac-kube-api-access-4clj7\") pod \"router-default-5465c8b4db-58d52\" (UID: \"b321ddb3-08ce-4101-bfa3-4200006f11ac\") " pod="openshift-ingress/router-default-5465c8b4db-58d52" Dec 04 12:06:09.981770 master-0 kubenswrapper[35367]: I1204 12:06:09.981500 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/18a37b73-52bc-444b-be63-5b7f7b4419ab-config-volume\") pod \"collect-profiles-29414160-dmjlv\" (UID: \"18a37b73-52bc-444b-be63-5b7f7b4419ab\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv" Dec 04 12:06:09.981770 master-0 kubenswrapper[35367]: I1204 12:06:09.981639 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/18a37b73-52bc-444b-be63-5b7f7b4419ab-secret-volume\") pod \"collect-profiles-29414160-dmjlv\" (UID: \"18a37b73-52bc-444b-be63-5b7f7b4419ab\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv" Dec 04 12:06:09.981770 master-0 kubenswrapper[35367]: I1204 12:06:09.981678 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b321ddb3-08ce-4101-bfa3-4200006f11ac-default-certificate\") pod \"router-default-5465c8b4db-58d52\" (UID: \"b321ddb3-08ce-4101-bfa3-4200006f11ac\") " pod="openshift-ingress/router-default-5465c8b4db-58d52" Dec 04 12:06:09.982303 master-0 kubenswrapper[35367]: I1204 12:06:09.982256 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82gds\" (UniqueName: \"kubernetes.io/projected/d8fa6831-60e8-415e-978a-d203d46ecbdc-kube-api-access-82gds\") pod \"ingress-canary-pz4lp\" (UID: \"d8fa6831-60e8-415e-978a-d203d46ecbdc\") " pod="openshift-ingress-canary/ingress-canary-pz4lp" Dec 04 12:06:09.982374 master-0 kubenswrapper[35367]: I1204 12:06:09.982342 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97rp9\" (UniqueName: \"kubernetes.io/projected/18a37b73-52bc-444b-be63-5b7f7b4419ab-kube-api-access-97rp9\") pod \"collect-profiles-29414160-dmjlv\" (UID: \"18a37b73-52bc-444b-be63-5b7f7b4419ab\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv" Dec 04 12:06:10.083251 master-0 kubenswrapper[35367]: I1204 12:06:10.083198 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/18a37b73-52bc-444b-be63-5b7f7b4419ab-secret-volume\") pod \"collect-profiles-29414160-dmjlv\" (UID: \"18a37b73-52bc-444b-be63-5b7f7b4419ab\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv" Dec 04 12:06:10.083543 master-0 kubenswrapper[35367]: I1204 12:06:10.083520 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b321ddb3-08ce-4101-bfa3-4200006f11ac-default-certificate\") pod \"router-default-5465c8b4db-58d52\" (UID: \"b321ddb3-08ce-4101-bfa3-4200006f11ac\") " pod="openshift-ingress/router-default-5465c8b4db-58d52" Dec 04 12:06:10.083738 master-0 kubenswrapper[35367]: I1204 12:06:10.083670 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-82gds\" (UniqueName: \"kubernetes.io/projected/d8fa6831-60e8-415e-978a-d203d46ecbdc-kube-api-access-82gds\") pod \"ingress-canary-pz4lp\" (UID: \"d8fa6831-60e8-415e-978a-d203d46ecbdc\") " pod="openshift-ingress-canary/ingress-canary-pz4lp" Dec 04 12:06:10.083841 master-0 kubenswrapper[35367]: I1204 12:06:10.083826 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-97rp9\" (UniqueName: \"kubernetes.io/projected/18a37b73-52bc-444b-be63-5b7f7b4419ab-kube-api-access-97rp9\") pod \"collect-profiles-29414160-dmjlv\" (UID: \"18a37b73-52bc-444b-be63-5b7f7b4419ab\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv" Dec 04 12:06:10.083952 master-0 kubenswrapper[35367]: I1204 12:06:10.083918 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5b06b803-1aad-4536-9a41-7369580701d2-nginx-conf\") pod \"networking-console-plugin-7d45bf9455-w67z7\" (UID: \"5b06b803-1aad-4536-9a41-7369580701d2\") " pod="openshift-network-console/networking-console-plugin-7d45bf9455-w67z7" Dec 04 12:06:10.084129 master-0 kubenswrapper[35367]: I1204 12:06:10.084105 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b321ddb3-08ce-4101-bfa3-4200006f11ac-service-ca-bundle\") pod \"router-default-5465c8b4db-58d52\" (UID: \"b321ddb3-08ce-4101-bfa3-4200006f11ac\") " pod="openshift-ingress/router-default-5465c8b4db-58d52" Dec 04 12:06:10.084172 master-0 kubenswrapper[35367]: I1204 12:06:10.084138 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b321ddb3-08ce-4101-bfa3-4200006f11ac-stats-auth\") pod \"router-default-5465c8b4db-58d52\" (UID: \"b321ddb3-08ce-4101-bfa3-4200006f11ac\") " pod="openshift-ingress/router-default-5465c8b4db-58d52" Dec 04 12:06:10.084202 master-0 kubenswrapper[35367]: I1204 12:06:10.084176 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8fa6831-60e8-415e-978a-d203d46ecbdc-cert\") pod \"ingress-canary-pz4lp\" (UID: \"d8fa6831-60e8-415e-978a-d203d46ecbdc\") " pod="openshift-ingress-canary/ingress-canary-pz4lp" Dec 04 12:06:10.084250 master-0 kubenswrapper[35367]: I1204 12:06:10.084195 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b321ddb3-08ce-4101-bfa3-4200006f11ac-metrics-certs\") pod \"router-default-5465c8b4db-58d52\" (UID: \"b321ddb3-08ce-4101-bfa3-4200006f11ac\") " pod="openshift-ingress/router-default-5465c8b4db-58d52" Dec 04 12:06:10.084286 master-0 kubenswrapper[35367]: I1204 12:06:10.084264 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ae0f644f-a31c-4b6c-b854-e01417aa448e-tls-certificates\") pod \"prometheus-operator-admission-webhook-7c85c4dffd-xv2wn\" (UID: \"ae0f644f-a31c-4b6c-b854-e01417aa448e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7c85c4dffd-xv2wn" Dec 04 12:06:10.084326 master-0 kubenswrapper[35367]: I1204 12:06:10.084284 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r4h9t\" (UniqueName: \"kubernetes.io/projected/0372b35f-9414-43a9-b739-509eaababbb1-kube-api-access-r4h9t\") pod \"network-check-source-85d8db45d4-5bjlq\" (UID: \"0372b35f-9414-43a9-b739-509eaababbb1\") " pod="openshift-network-diagnostics/network-check-source-85d8db45d4-5bjlq" Dec 04 12:06:10.084326 master-0 kubenswrapper[35367]: I1204 12:06:10.084309 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5b06b803-1aad-4536-9a41-7369580701d2-networking-console-plugin-cert\") pod \"networking-console-plugin-7d45bf9455-w67z7\" (UID: \"5b06b803-1aad-4536-9a41-7369580701d2\") " pod="openshift-network-console/networking-console-plugin-7d45bf9455-w67z7" Dec 04 12:06:10.084385 master-0 kubenswrapper[35367]: I1204 12:06:10.084331 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4clj7\" (UniqueName: \"kubernetes.io/projected/b321ddb3-08ce-4101-bfa3-4200006f11ac-kube-api-access-4clj7\") pod \"router-default-5465c8b4db-58d52\" (UID: \"b321ddb3-08ce-4101-bfa3-4200006f11ac\") " pod="openshift-ingress/router-default-5465c8b4db-58d52" Dec 04 12:06:10.084385 master-0 kubenswrapper[35367]: I1204 12:06:10.084348 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/18a37b73-52bc-444b-be63-5b7f7b4419ab-config-volume\") pod \"collect-profiles-29414160-dmjlv\" (UID: \"18a37b73-52bc-444b-be63-5b7f7b4419ab\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv" Dec 04 12:06:10.085224 master-0 kubenswrapper[35367]: I1204 12:06:10.085177 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b321ddb3-08ce-4101-bfa3-4200006f11ac-service-ca-bundle\") pod \"router-default-5465c8b4db-58d52\" (UID: \"b321ddb3-08ce-4101-bfa3-4200006f11ac\") " pod="openshift-ingress/router-default-5465c8b4db-58d52" Dec 04 12:06:10.085367 master-0 kubenswrapper[35367]: I1204 12:06:10.085352 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5b06b803-1aad-4536-9a41-7369580701d2-nginx-conf\") pod \"networking-console-plugin-7d45bf9455-w67z7\" (UID: \"5b06b803-1aad-4536-9a41-7369580701d2\") " pod="openshift-network-console/networking-console-plugin-7d45bf9455-w67z7" Dec 04 12:06:10.085638 master-0 kubenswrapper[35367]: I1204 12:06:10.085612 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/18a37b73-52bc-444b-be63-5b7f7b4419ab-config-volume\") pod \"collect-profiles-29414160-dmjlv\" (UID: \"18a37b73-52bc-444b-be63-5b7f7b4419ab\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv" Dec 04 12:06:10.088224 master-0 kubenswrapper[35367]: I1204 12:06:10.087997 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b321ddb3-08ce-4101-bfa3-4200006f11ac-default-certificate\") pod \"router-default-5465c8b4db-58d52\" (UID: \"b321ddb3-08ce-4101-bfa3-4200006f11ac\") " pod="openshift-ingress/router-default-5465c8b4db-58d52" Dec 04 12:06:10.089780 master-0 kubenswrapper[35367]: I1204 12:06:10.089319 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8fa6831-60e8-415e-978a-d203d46ecbdc-cert\") pod \"ingress-canary-pz4lp\" (UID: \"d8fa6831-60e8-415e-978a-d203d46ecbdc\") " pod="openshift-ingress-canary/ingress-canary-pz4lp" Dec 04 12:06:10.089780 master-0 kubenswrapper[35367]: I1204 12:06:10.089469 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ae0f644f-a31c-4b6c-b854-e01417aa448e-tls-certificates\") pod \"prometheus-operator-admission-webhook-7c85c4dffd-xv2wn\" (UID: \"ae0f644f-a31c-4b6c-b854-e01417aa448e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7c85c4dffd-xv2wn" Dec 04 12:06:10.091247 master-0 kubenswrapper[35367]: I1204 12:06:10.090969 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/18a37b73-52bc-444b-be63-5b7f7b4419ab-secret-volume\") pod \"collect-profiles-29414160-dmjlv\" (UID: \"18a37b73-52bc-444b-be63-5b7f7b4419ab\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv" Dec 04 12:06:10.091721 master-0 kubenswrapper[35367]: I1204 12:06:10.091642 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b321ddb3-08ce-4101-bfa3-4200006f11ac-stats-auth\") pod \"router-default-5465c8b4db-58d52\" (UID: \"b321ddb3-08ce-4101-bfa3-4200006f11ac\") " pod="openshift-ingress/router-default-5465c8b4db-58d52" Dec 04 12:06:10.091897 master-0 kubenswrapper[35367]: I1204 12:06:10.091866 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5b06b803-1aad-4536-9a41-7369580701d2-networking-console-plugin-cert\") pod \"networking-console-plugin-7d45bf9455-w67z7\" (UID: \"5b06b803-1aad-4536-9a41-7369580701d2\") " pod="openshift-network-console/networking-console-plugin-7d45bf9455-w67z7" Dec 04 12:06:10.095896 master-0 kubenswrapper[35367]: I1204 12:06:10.095862 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b321ddb3-08ce-4101-bfa3-4200006f11ac-metrics-certs\") pod \"router-default-5465c8b4db-58d52\" (UID: \"b321ddb3-08ce-4101-bfa3-4200006f11ac\") " pod="openshift-ingress/router-default-5465c8b4db-58d52" Dec 04 12:06:10.104177 master-0 kubenswrapper[35367]: I1204 12:06:10.102686 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-82gds\" (UniqueName: \"kubernetes.io/projected/d8fa6831-60e8-415e-978a-d203d46ecbdc-kube-api-access-82gds\") pod \"ingress-canary-pz4lp\" (UID: \"d8fa6831-60e8-415e-978a-d203d46ecbdc\") " pod="openshift-ingress-canary/ingress-canary-pz4lp" Dec 04 12:06:10.107329 master-0 kubenswrapper[35367]: I1204 12:06:10.104868 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4h9t\" (UniqueName: \"kubernetes.io/projected/0372b35f-9414-43a9-b739-509eaababbb1-kube-api-access-r4h9t\") pod \"network-check-source-85d8db45d4-5bjlq\" (UID: \"0372b35f-9414-43a9-b739-509eaababbb1\") " pod="openshift-network-diagnostics/network-check-source-85d8db45d4-5bjlq" Dec 04 12:06:10.107329 master-0 kubenswrapper[35367]: I1204 12:06:10.106863 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-97rp9\" (UniqueName: \"kubernetes.io/projected/18a37b73-52bc-444b-be63-5b7f7b4419ab-kube-api-access-97rp9\") pod \"collect-profiles-29414160-dmjlv\" (UID: \"18a37b73-52bc-444b-be63-5b7f7b4419ab\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv" Dec 04 12:06:10.110247 master-0 kubenswrapper[35367]: I1204 12:06:10.110170 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4clj7\" (UniqueName: \"kubernetes.io/projected/b321ddb3-08ce-4101-bfa3-4200006f11ac-kube-api-access-4clj7\") pod \"router-default-5465c8b4db-58d52\" (UID: \"b321ddb3-08ce-4101-bfa3-4200006f11ac\") " pod="openshift-ingress/router-default-5465c8b4db-58d52" Dec 04 12:06:10.139592 master-0 kubenswrapper[35367]: I1204 12:06:10.139489 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7d45bf9455-w67z7" Dec 04 12:06:10.249068 master-0 kubenswrapper[35367]: I1204 12:06:10.248914 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5465c8b4db-58d52" Dec 04 12:06:10.290395 master-0 kubenswrapper[35367]: I1204 12:06:10.290148 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv" Dec 04 12:06:10.295419 master-0 kubenswrapper[35367]: W1204 12:06:10.295313 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb321ddb3_08ce_4101_bfa3_4200006f11ac.slice/crio-333bb83cffde4dd93a07461ff1cdd04db47ddfe6aa324369d1a5a83c7f808c01 WatchSource:0}: Error finding container 333bb83cffde4dd93a07461ff1cdd04db47ddfe6aa324369d1a5a83c7f808c01: Status 404 returned error can't find the container with id 333bb83cffde4dd93a07461ff1cdd04db47ddfe6aa324369d1a5a83c7f808c01 Dec 04 12:06:10.322211 master-0 kubenswrapper[35367]: I1204 12:06:10.322157 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-85d8db45d4-5bjlq" Dec 04 12:06:10.351971 master-0 kubenswrapper[35367]: I1204 12:06:10.349524 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7c85c4dffd-xv2wn" Dec 04 12:06:10.361188 master-0 kubenswrapper[35367]: I1204 12:06:10.361119 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-controller-7c6d64c4cd-5wrwt" event={"ID":"fa606e05-58bb-483a-92c3-46639085073a","Type":"ContainerStarted","Data":"4f2c2545b563cf94083b5e86db91d68d3c66e1e4d175ffcd7f5f2bac968db271"} Dec 04 12:06:10.361296 master-0 kubenswrapper[35367]: I1204 12:06:10.361191 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-controller-7c6d64c4cd-5wrwt" event={"ID":"fa606e05-58bb-483a-92c3-46639085073a","Type":"ContainerStarted","Data":"bb8f1b071355731f6f7fc0890f9b80b34416dbc1961e06833da6ac0fbe967a36"} Dec 04 12:06:10.361296 master-0 kubenswrapper[35367]: I1204 12:06:10.361211 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-controller-7c6d64c4cd-5wrwt" event={"ID":"fa606e05-58bb-483a-92c3-46639085073a","Type":"ContainerStarted","Data":"17d6224d212b036e419609523b5f893a63300f0e2d7f7dfc39feecd13f451ea8"} Dec 04 12:06:10.362923 master-0 kubenswrapper[35367]: I1204 12:06:10.362898 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5465c8b4db-58d52" event={"ID":"b321ddb3-08ce-4101-bfa3-4200006f11ac","Type":"ContainerStarted","Data":"333bb83cffde4dd93a07461ff1cdd04db47ddfe6aa324369d1a5a83c7f808c01"} Dec 04 12:06:10.377165 master-0 kubenswrapper[35367]: I1204 12:06:10.377096 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pz4lp" Dec 04 12:06:10.388032 master-0 kubenswrapper[35367]: I1204 12:06:10.387103 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-controller-7c6d64c4cd-5wrwt" podStartSLOduration=2.387051066 podStartE2EDuration="2.387051066s" podCreationTimestamp="2025-12-04 12:06:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:06:10.384450755 +0000 UTC m=+413.822512013" watchObservedRunningTime="2025-12-04 12:06:10.387051066 +0000 UTC m=+413.825112324" Dec 04 12:06:10.572304 master-0 kubenswrapper[35367]: I1204 12:06:10.570582 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler/installer-5-master-0"] Dec 04 12:06:10.572304 master-0 kubenswrapper[35367]: I1204 12:06:10.571682 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 12:06:10.576914 master-0 kubenswrapper[35367]: I1204 12:06:10.576828 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-scheduler"/"installer-sa-dockercfg-z45bl" Dec 04 12:06:10.577239 master-0 kubenswrapper[35367]: I1204 12:06:10.577198 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler"/"kube-root-ca.crt" Dec 04 12:06:10.579990 master-0 kubenswrapper[35367]: I1204 12:06:10.578430 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/installer-5-master-0"] Dec 04 12:06:10.616584 master-0 kubenswrapper[35367]: I1204 12:06:10.616029 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7d45bf9455-w67z7"] Dec 04 12:06:10.706544 master-0 kubenswrapper[35367]: I1204 12:06:10.706466 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/57c3adf2-e10a-419a-80bf-59cec1bb0a28-kube-api-access\") pod \"installer-5-master-0\" (UID: \"57c3adf2-e10a-419a-80bf-59cec1bb0a28\") " pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 12:06:10.706544 master-0 kubenswrapper[35367]: I1204 12:06:10.706560 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/57c3adf2-e10a-419a-80bf-59cec1bb0a28-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"57c3adf2-e10a-419a-80bf-59cec1bb0a28\") " pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 12:06:10.707026 master-0 kubenswrapper[35367]: I1204 12:06:10.706607 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/57c3adf2-e10a-419a-80bf-59cec1bb0a28-var-lock\") pod \"installer-5-master-0\" (UID: \"57c3adf2-e10a-419a-80bf-59cec1bb0a28\") " pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 12:06:10.767656 master-0 kubenswrapper[35367]: I1204 12:06:10.767580 35367 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Dec 04 12:06:10.812771 master-0 kubenswrapper[35367]: I1204 12:06:10.812660 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/57c3adf2-e10a-419a-80bf-59cec1bb0a28-kube-api-access\") pod \"installer-5-master-0\" (UID: \"57c3adf2-e10a-419a-80bf-59cec1bb0a28\") " pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 12:06:10.812771 master-0 kubenswrapper[35367]: I1204 12:06:10.812784 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/57c3adf2-e10a-419a-80bf-59cec1bb0a28-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"57c3adf2-e10a-419a-80bf-59cec1bb0a28\") " pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 12:06:10.813467 master-0 kubenswrapper[35367]: I1204 12:06:10.812855 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/57c3adf2-e10a-419a-80bf-59cec1bb0a28-var-lock\") pod \"installer-5-master-0\" (UID: \"57c3adf2-e10a-419a-80bf-59cec1bb0a28\") " pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 12:06:10.813467 master-0 kubenswrapper[35367]: I1204 12:06:10.812966 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/57c3adf2-e10a-419a-80bf-59cec1bb0a28-var-lock\") pod \"installer-5-master-0\" (UID: \"57c3adf2-e10a-419a-80bf-59cec1bb0a28\") " pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 12:06:10.813467 master-0 kubenswrapper[35367]: I1204 12:06:10.813020 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/57c3adf2-e10a-419a-80bf-59cec1bb0a28-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"57c3adf2-e10a-419a-80bf-59cec1bb0a28\") " pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 12:06:10.839652 master-0 kubenswrapper[35367]: I1204 12:06:10.839517 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/57c3adf2-e10a-419a-80bf-59cec1bb0a28-kube-api-access\") pod \"installer-5-master-0\" (UID: \"57c3adf2-e10a-419a-80bf-59cec1bb0a28\") " pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 12:06:10.875820 master-0 kubenswrapper[35367]: I1204 12:06:10.875558 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv"] Dec 04 12:06:10.914746 master-0 kubenswrapper[35367]: I1204 12:06:10.914641 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 12:06:10.943338 master-0 kubenswrapper[35367]: I1204 12:06:10.943269 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-85d8db45d4-5bjlq"] Dec 04 12:06:10.945388 master-0 kubenswrapper[35367]: W1204 12:06:10.945266 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0372b35f_9414_43a9_b739_509eaababbb1.slice/crio-b22fdf852cb5d78e0e649575f75c10c10d0bcb29633d3884f5ee6a4fea0ef89a WatchSource:0}: Error finding container b22fdf852cb5d78e0e649575f75c10c10d0bcb29633d3884f5ee6a4fea0ef89a: Status 404 returned error can't find the container with id b22fdf852cb5d78e0e649575f75c10c10d0bcb29633d3884f5ee6a4fea0ef89a Dec 04 12:06:11.030636 master-0 kubenswrapper[35367]: I1204 12:06:11.025878 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pz4lp"] Dec 04 12:06:11.160648 master-0 kubenswrapper[35367]: I1204 12:06:11.159978 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7c85c4dffd-xv2wn"] Dec 04 12:06:11.176160 master-0 kubenswrapper[35367]: W1204 12:06:11.174481 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae0f644f_a31c_4b6c_b854_e01417aa448e.slice/crio-46dd6bdffaff8cbb89697e2ecaffa9214374b6c7cb79c0f0b1925596e4bedcd8 WatchSource:0}: Error finding container 46dd6bdffaff8cbb89697e2ecaffa9214374b6c7cb79c0f0b1925596e4bedcd8: Status 404 returned error can't find the container with id 46dd6bdffaff8cbb89697e2ecaffa9214374b6c7cb79c0f0b1925596e4bedcd8 Dec 04 12:06:11.375437 master-0 kubenswrapper[35367]: I1204 12:06:11.375273 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pz4lp" event={"ID":"d8fa6831-60e8-415e-978a-d203d46ecbdc","Type":"ContainerStarted","Data":"9500a76ef11dc3ad8f9df638f5db0ab5a485fe0f21edf7e35603d8a557e0b148"} Dec 04 12:06:11.375437 master-0 kubenswrapper[35367]: I1204 12:06:11.375343 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pz4lp" event={"ID":"d8fa6831-60e8-415e-978a-d203d46ecbdc","Type":"ContainerStarted","Data":"a12302e5d9bede68a94fbea86f72ea063db4e9d9c4ba6b65293add0c1a69345f"} Dec 04 12:06:11.381170 master-0 kubenswrapper[35367]: I1204 12:06:11.381106 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7d45bf9455-w67z7" event={"ID":"5b06b803-1aad-4536-9a41-7369580701d2","Type":"ContainerStarted","Data":"78ff8750b1265dce5394692fcb7f2565034174716c4de0f27c372fca11120d2b"} Dec 04 12:06:11.384337 master-0 kubenswrapper[35367]: I1204 12:06:11.384289 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7c85c4dffd-xv2wn" event={"ID":"ae0f644f-a31c-4b6c-b854-e01417aa448e","Type":"ContainerStarted","Data":"46dd6bdffaff8cbb89697e2ecaffa9214374b6c7cb79c0f0b1925596e4bedcd8"} Dec 04 12:06:11.398551 master-0 kubenswrapper[35367]: I1204 12:06:11.398451 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-85d8db45d4-5bjlq" event={"ID":"0372b35f-9414-43a9-b739-509eaababbb1","Type":"ContainerStarted","Data":"bb08b3dbbc8f76abbffa199da4929a5da7eb20e543a661b96e2cc8aca830cbe2"} Dec 04 12:06:11.398551 master-0 kubenswrapper[35367]: I1204 12:06:11.398531 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-85d8db45d4-5bjlq" event={"ID":"0372b35f-9414-43a9-b739-509eaababbb1","Type":"ContainerStarted","Data":"b22fdf852cb5d78e0e649575f75c10c10d0bcb29633d3884f5ee6a4fea0ef89a"} Dec 04 12:06:11.400334 master-0 kubenswrapper[35367]: I1204 12:06:11.400262 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pz4lp" podStartSLOduration=2.400235899 podStartE2EDuration="2.400235899s" podCreationTimestamp="2025-12-04 12:06:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:06:11.398855087 +0000 UTC m=+414.836916365" watchObservedRunningTime="2025-12-04 12:06:11.400235899 +0000 UTC m=+414.838297157" Dec 04 12:06:11.411319 master-0 kubenswrapper[35367]: I1204 12:06:11.406234 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv" event={"ID":"18a37b73-52bc-444b-be63-5b7f7b4419ab","Type":"ContainerStarted","Data":"65d4adb50e9475c1094a0a214de6dde18cb1ca9e2c3daf843488c72586e7a86e"} Dec 04 12:06:11.411319 master-0 kubenswrapper[35367]: I1204 12:06:11.406586 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv" event={"ID":"18a37b73-52bc-444b-be63-5b7f7b4419ab","Type":"ContainerStarted","Data":"703bb95fd887906aed1f2d1640ebc2602b90f323662e4997b1d15c0833457992"} Dec 04 12:06:11.443778 master-0 kubenswrapper[35367]: I1204 12:06:11.441950 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-85d8db45d4-5bjlq" podStartSLOduration=1766.441918391 podStartE2EDuration="29m26.441918391s" podCreationTimestamp="2025-12-04 11:36:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:06:11.433090013 +0000 UTC m=+414.871151271" watchObservedRunningTime="2025-12-04 12:06:11.441918391 +0000 UTC m=+414.879979649" Dec 04 12:06:11.467879 master-0 kubenswrapper[35367]: I1204 12:06:11.467723 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv" podStartSLOduration=117.467696802 podStartE2EDuration="1m57.467696802s" podCreationTimestamp="2025-12-04 12:04:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:06:11.461119385 +0000 UTC m=+414.899180643" watchObservedRunningTime="2025-12-04 12:06:11.467696802 +0000 UTC m=+414.905758060" Dec 04 12:06:11.487352 master-0 kubenswrapper[35367]: I1204 12:06:11.487292 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/installer-5-master-0"] Dec 04 12:06:12.423642 master-0 kubenswrapper[35367]: I1204 12:06:12.423554 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-5-master-0" event={"ID":"57c3adf2-e10a-419a-80bf-59cec1bb0a28","Type":"ContainerStarted","Data":"4de9e4c9ad1f8c9ab97c8dcba0f17366eac40ff921ab5fb6cd3feabefa557308"} Dec 04 12:06:12.427685 master-0 kubenswrapper[35367]: I1204 12:06:12.423654 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-5-master-0" event={"ID":"57c3adf2-e10a-419a-80bf-59cec1bb0a28","Type":"ContainerStarted","Data":"956bcc6030dd3ba364684c4af517e43051d6e34fb847f5da92488d96fdd3ae47"} Dec 04 12:06:12.447725 master-0 kubenswrapper[35367]: I1204 12:06:12.447635 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler/installer-5-master-0" podStartSLOduration=2.447611338 podStartE2EDuration="2.447611338s" podCreationTimestamp="2025-12-04 12:06:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:06:12.444924154 +0000 UTC m=+415.882985432" watchObservedRunningTime="2025-12-04 12:06:12.447611338 +0000 UTC m=+415.885672596" Dec 04 12:06:13.158135 master-0 kubenswrapper[35367]: I1204 12:06:13.157989 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/installer-5-master-0"] Dec 04 12:06:13.160890 master-0 kubenswrapper[35367]: I1204 12:06:13.159277 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 12:06:13.171954 master-0 kubenswrapper[35367]: I1204 12:06:13.166522 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver"/"kube-root-ca.crt" Dec 04 12:06:13.171954 master-0 kubenswrapper[35367]: I1204 12:06:13.166911 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-5-master-0"] Dec 04 12:06:13.171954 master-0 kubenswrapper[35367]: I1204 12:06:13.168676 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver"/"installer-sa-dockercfg-79r7d" Dec 04 12:06:13.210760 master-0 kubenswrapper[35367]: I1204 12:06:13.210609 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/machine-config-server-lh6sx"] Dec 04 12:06:13.212157 master-0 kubenswrapper[35367]: I1204 12:06:13.212105 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-server-lh6sx" Dec 04 12:06:13.219546 master-0 kubenswrapper[35367]: I1204 12:06:13.219377 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-server-tls" Dec 04 12:06:13.219546 master-0 kubenswrapper[35367]: I1204 12:06:13.219544 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-server-dockercfg-4rb2l" Dec 04 12:06:13.220152 master-0 kubenswrapper[35367]: I1204 12:06:13.220108 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"node-bootstrapper-token" Dec 04 12:06:13.278595 master-0 kubenswrapper[35367]: I1204 12:06:13.278491 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/1925d356-c016-404c-8860-52707bf633be-var-lock\") pod \"installer-5-master-0\" (UID: \"1925d356-c016-404c-8860-52707bf633be\") " pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 12:06:13.278595 master-0 kubenswrapper[35367]: I1204 12:06:13.278583 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1925d356-c016-404c-8860-52707bf633be-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"1925d356-c016-404c-8860-52707bf633be\") " pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 12:06:13.278995 master-0 kubenswrapper[35367]: I1204 12:06:13.278740 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1925d356-c016-404c-8860-52707bf633be-kube-api-access\") pod \"installer-5-master-0\" (UID: \"1925d356-c016-404c-8860-52707bf633be\") " pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 12:06:13.382383 master-0 kubenswrapper[35367]: I1204 12:06:13.381771 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/c239f1ad-3f61-48a8-8f6e-62a499c8eee8-node-bootstrap-token\") pod \"machine-config-server-lh6sx\" (UID: \"c239f1ad-3f61-48a8-8f6e-62a499c8eee8\") " pod="openshift-machine-config-operator/machine-config-server-lh6sx" Dec 04 12:06:13.382383 master-0 kubenswrapper[35367]: I1204 12:06:13.381893 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftxq8\" (UniqueName: \"kubernetes.io/projected/c239f1ad-3f61-48a8-8f6e-62a499c8eee8-kube-api-access-ftxq8\") pod \"machine-config-server-lh6sx\" (UID: \"c239f1ad-3f61-48a8-8f6e-62a499c8eee8\") " pod="openshift-machine-config-operator/machine-config-server-lh6sx" Dec 04 12:06:13.382383 master-0 kubenswrapper[35367]: I1204 12:06:13.381928 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/secret/c239f1ad-3f61-48a8-8f6e-62a499c8eee8-certs\") pod \"machine-config-server-lh6sx\" (UID: \"c239f1ad-3f61-48a8-8f6e-62a499c8eee8\") " pod="openshift-machine-config-operator/machine-config-server-lh6sx" Dec 04 12:06:13.382383 master-0 kubenswrapper[35367]: I1204 12:06:13.381970 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/1925d356-c016-404c-8860-52707bf633be-var-lock\") pod \"installer-5-master-0\" (UID: \"1925d356-c016-404c-8860-52707bf633be\") " pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 12:06:13.382383 master-0 kubenswrapper[35367]: I1204 12:06:13.381996 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1925d356-c016-404c-8860-52707bf633be-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"1925d356-c016-404c-8860-52707bf633be\") " pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 12:06:13.382383 master-0 kubenswrapper[35367]: I1204 12:06:13.382032 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1925d356-c016-404c-8860-52707bf633be-kube-api-access\") pod \"installer-5-master-0\" (UID: \"1925d356-c016-404c-8860-52707bf633be\") " pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 12:06:13.382880 master-0 kubenswrapper[35367]: I1204 12:06:13.382578 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/1925d356-c016-404c-8860-52707bf633be-var-lock\") pod \"installer-5-master-0\" (UID: \"1925d356-c016-404c-8860-52707bf633be\") " pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 12:06:13.382880 master-0 kubenswrapper[35367]: I1204 12:06:13.382623 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1925d356-c016-404c-8860-52707bf633be-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"1925d356-c016-404c-8860-52707bf633be\") " pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 12:06:13.403659 master-0 kubenswrapper[35367]: I1204 12:06:13.403527 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1925d356-c016-404c-8860-52707bf633be-kube-api-access\") pod \"installer-5-master-0\" (UID: \"1925d356-c016-404c-8860-52707bf633be\") " pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 12:06:13.440694 master-0 kubenswrapper[35367]: I1204 12:06:13.440527 35367 generic.go:334] "Generic (PLEG): container finished" podID="18a37b73-52bc-444b-be63-5b7f7b4419ab" containerID="65d4adb50e9475c1094a0a214de6dde18cb1ca9e2c3daf843488c72586e7a86e" exitCode=0 Dec 04 12:06:13.440694 master-0 kubenswrapper[35367]: I1204 12:06:13.440634 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv" event={"ID":"18a37b73-52bc-444b-be63-5b7f7b4419ab","Type":"ContainerDied","Data":"65d4adb50e9475c1094a0a214de6dde18cb1ca9e2c3daf843488c72586e7a86e"} Dec 04 12:06:13.484746 master-0 kubenswrapper[35367]: I1204 12:06:13.483885 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/c239f1ad-3f61-48a8-8f6e-62a499c8eee8-node-bootstrap-token\") pod \"machine-config-server-lh6sx\" (UID: \"c239f1ad-3f61-48a8-8f6e-62a499c8eee8\") " pod="openshift-machine-config-operator/machine-config-server-lh6sx" Dec 04 12:06:13.484746 master-0 kubenswrapper[35367]: I1204 12:06:13.483976 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ftxq8\" (UniqueName: \"kubernetes.io/projected/c239f1ad-3f61-48a8-8f6e-62a499c8eee8-kube-api-access-ftxq8\") pod \"machine-config-server-lh6sx\" (UID: \"c239f1ad-3f61-48a8-8f6e-62a499c8eee8\") " pod="openshift-machine-config-operator/machine-config-server-lh6sx" Dec 04 12:06:13.484746 master-0 kubenswrapper[35367]: I1204 12:06:13.484021 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/secret/c239f1ad-3f61-48a8-8f6e-62a499c8eee8-certs\") pod \"machine-config-server-lh6sx\" (UID: \"c239f1ad-3f61-48a8-8f6e-62a499c8eee8\") " pod="openshift-machine-config-operator/machine-config-server-lh6sx" Dec 04 12:06:13.488586 master-0 kubenswrapper[35367]: I1204 12:06:13.488530 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"certs\" (UniqueName: \"kubernetes.io/secret/c239f1ad-3f61-48a8-8f6e-62a499c8eee8-certs\") pod \"machine-config-server-lh6sx\" (UID: \"c239f1ad-3f61-48a8-8f6e-62a499c8eee8\") " pod="openshift-machine-config-operator/machine-config-server-lh6sx" Dec 04 12:06:13.489391 master-0 kubenswrapper[35367]: I1204 12:06:13.489345 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/c239f1ad-3f61-48a8-8f6e-62a499c8eee8-node-bootstrap-token\") pod \"machine-config-server-lh6sx\" (UID: \"c239f1ad-3f61-48a8-8f6e-62a499c8eee8\") " pod="openshift-machine-config-operator/machine-config-server-lh6sx" Dec 04 12:06:13.497404 master-0 kubenswrapper[35367]: I1204 12:06:13.497343 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 12:06:13.505456 master-0 kubenswrapper[35367]: I1204 12:06:13.505409 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftxq8\" (UniqueName: \"kubernetes.io/projected/c239f1ad-3f61-48a8-8f6e-62a499c8eee8-kube-api-access-ftxq8\") pod \"machine-config-server-lh6sx\" (UID: \"c239f1ad-3f61-48a8-8f6e-62a499c8eee8\") " pod="openshift-machine-config-operator/machine-config-server-lh6sx" Dec 04 12:06:13.538541 master-0 kubenswrapper[35367]: I1204 12:06:13.538449 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-server-lh6sx" Dec 04 12:06:14.290232 master-0 kubenswrapper[35367]: W1204 12:06:14.290155 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1925d356_c016_404c_8860_52707bf633be.slice/crio-ccb540b6448fe41a1ecc2fce791b9b971e549d400c0e0f028f96d9d0afdefbcb WatchSource:0}: Error finding container ccb540b6448fe41a1ecc2fce791b9b971e549d400c0e0f028f96d9d0afdefbcb: Status 404 returned error can't find the container with id ccb540b6448fe41a1ecc2fce791b9b971e549d400c0e0f028f96d9d0afdefbcb Dec 04 12:06:14.291371 master-0 kubenswrapper[35367]: I1204 12:06:14.291216 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-5-master-0"] Dec 04 12:06:14.464767 master-0 kubenswrapper[35367]: I1204 12:06:14.464635 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-server-lh6sx" event={"ID":"c239f1ad-3f61-48a8-8f6e-62a499c8eee8","Type":"ContainerStarted","Data":"edfb08ff8e24430203a4733b4861c4e8b3e7ed350228d5505635a1ec9e4333cc"} Dec 04 12:06:14.464767 master-0 kubenswrapper[35367]: I1204 12:06:14.464699 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-server-lh6sx" event={"ID":"c239f1ad-3f61-48a8-8f6e-62a499c8eee8","Type":"ContainerStarted","Data":"b629d393a0a324c64596daf1fbec76772b32dc358ec87ac759cd0c888fd1104e"} Dec 04 12:06:14.466778 master-0 kubenswrapper[35367]: I1204 12:06:14.466678 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-5-master-0" event={"ID":"1925d356-c016-404c-8860-52707bf633be","Type":"ContainerStarted","Data":"ccb540b6448fe41a1ecc2fce791b9b971e549d400c0e0f028f96d9d0afdefbcb"} Dec 04 12:06:14.474792 master-0 kubenswrapper[35367]: I1204 12:06:14.473526 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5465c8b4db-58d52" event={"ID":"b321ddb3-08ce-4101-bfa3-4200006f11ac","Type":"ContainerStarted","Data":"719f9350e4ee03cd8866bf3a541b7abac2e129f6ace4074abfb54a19e70b1b23"} Dec 04 12:06:14.479859 master-0 kubenswrapper[35367]: I1204 12:06:14.479788 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/console-654c77b6c6-kh7ws"] Dec 04 12:06:14.480936 master-0 kubenswrapper[35367]: I1204 12:06:14.480829 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:14.505837 master-0 kubenswrapper[35367]: I1204 12:06:14.503219 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-serving-cert" Dec 04 12:06:14.505837 master-0 kubenswrapper[35367]: I1204 12:06:14.503495 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"console-config" Dec 04 12:06:14.505837 master-0 kubenswrapper[35367]: I1204 12:06:14.503776 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7d45bf9455-w67z7" event={"ID":"5b06b803-1aad-4536-9a41-7369580701d2","Type":"ContainerStarted","Data":"577db43037f2ee14f334c5ccd4f5e2f52f94c08ba90c99b66c2f5ca66db39306"} Dec 04 12:06:14.509829 master-0 kubenswrapper[35367]: I1204 12:06:14.508790 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-oauth-config" Dec 04 12:06:14.509829 master-0 kubenswrapper[35367]: I1204 12:06:14.509055 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-dockercfg-2nzng" Dec 04 12:06:14.510066 master-0 kubenswrapper[35367]: I1204 12:06:14.510028 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea79af85-e731-449a-a476-2ff8b05f9d80-oauth-serving-cert\") pod \"console-654c77b6c6-kh7ws\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:14.510126 master-0 kubenswrapper[35367]: I1204 12:06:14.510094 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea79af85-e731-449a-a476-2ff8b05f9d80-console-config\") pod \"console-654c77b6c6-kh7ws\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:14.511261 master-0 kubenswrapper[35367]: I1204 12:06:14.511228 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klcpm\" (UniqueName: \"kubernetes.io/projected/ea79af85-e731-449a-a476-2ff8b05f9d80-kube-api-access-klcpm\") pod \"console-654c77b6c6-kh7ws\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:14.511339 master-0 kubenswrapper[35367]: I1204 12:06:14.511287 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea79af85-e731-449a-a476-2ff8b05f9d80-console-oauth-config\") pod \"console-654c77b6c6-kh7ws\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:14.511339 master-0 kubenswrapper[35367]: I1204 12:06:14.511319 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea79af85-e731-449a-a476-2ff8b05f9d80-service-ca\") pod \"console-654c77b6c6-kh7ws\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:14.511426 master-0 kubenswrapper[35367]: I1204 12:06:14.511360 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea79af85-e731-449a-a476-2ff8b05f9d80-console-serving-cert\") pod \"console-654c77b6c6-kh7ws\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:14.522847 master-0 kubenswrapper[35367]: I1204 12:06:14.521927 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"service-ca" Dec 04 12:06:14.544799 master-0 kubenswrapper[35367]: I1204 12:06:14.544743 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7c85c4dffd-xv2wn" event={"ID":"ae0f644f-a31c-4b6c-b854-e01417aa448e","Type":"ContainerStarted","Data":"c2d6fea157ab334260cb0d7d481aa6c7271794154cbd06f7016f6ecacf6184cc"} Dec 04 12:06:14.544799 master-0 kubenswrapper[35367]: I1204 12:06:14.544820 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-monitoring/prometheus-operator-admission-webhook-7c85c4dffd-xv2wn" Dec 04 12:06:14.566097 master-0 kubenswrapper[35367]: I1204 12:06:14.564264 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-server-lh6sx" podStartSLOduration=1.564229584 podStartE2EDuration="1.564229584s" podCreationTimestamp="2025-12-04 12:06:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:06:14.509268955 +0000 UTC m=+417.947330233" watchObservedRunningTime="2025-12-04 12:06:14.564229584 +0000 UTC m=+418.002290842" Dec 04 12:06:14.566097 master-0 kubenswrapper[35367]: I1204 12:06:14.565904 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-654c77b6c6-kh7ws"] Dec 04 12:06:14.566097 master-0 kubenswrapper[35367]: I1204 12:06:14.565973 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"oauth-serving-cert" Dec 04 12:06:14.566097 master-0 kubenswrapper[35367]: I1204 12:06:14.566045 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7c85c4dffd-xv2wn" Dec 04 12:06:14.614209 master-0 kubenswrapper[35367]: I1204 12:06:14.614159 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea79af85-e731-449a-a476-2ff8b05f9d80-oauth-serving-cert\") pod \"console-654c77b6c6-kh7ws\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:14.614400 master-0 kubenswrapper[35367]: I1204 12:06:14.614376 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea79af85-e731-449a-a476-2ff8b05f9d80-console-config\") pod \"console-654c77b6c6-kh7ws\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:14.614561 master-0 kubenswrapper[35367]: I1204 12:06:14.614541 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-klcpm\" (UniqueName: \"kubernetes.io/projected/ea79af85-e731-449a-a476-2ff8b05f9d80-kube-api-access-klcpm\") pod \"console-654c77b6c6-kh7ws\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:14.614671 master-0 kubenswrapper[35367]: I1204 12:06:14.614655 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea79af85-e731-449a-a476-2ff8b05f9d80-console-oauth-config\") pod \"console-654c77b6c6-kh7ws\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:14.614771 master-0 kubenswrapper[35367]: I1204 12:06:14.614755 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea79af85-e731-449a-a476-2ff8b05f9d80-service-ca\") pod \"console-654c77b6c6-kh7ws\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:14.614911 master-0 kubenswrapper[35367]: I1204 12:06:14.614893 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea79af85-e731-449a-a476-2ff8b05f9d80-console-serving-cert\") pod \"console-654c77b6c6-kh7ws\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:14.620640 master-0 kubenswrapper[35367]: I1204 12:06:14.618070 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea79af85-e731-449a-a476-2ff8b05f9d80-oauth-serving-cert\") pod \"console-654c77b6c6-kh7ws\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:14.620640 master-0 kubenswrapper[35367]: I1204 12:06:14.618762 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea79af85-e731-449a-a476-2ff8b05f9d80-console-config\") pod \"console-654c77b6c6-kh7ws\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:14.623237 master-0 kubenswrapper[35367]: I1204 12:06:14.621768 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea79af85-e731-449a-a476-2ff8b05f9d80-service-ca\") pod \"console-654c77b6c6-kh7ws\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:14.626777 master-0 kubenswrapper[35367]: I1204 12:06:14.626745 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea79af85-e731-449a-a476-2ff8b05f9d80-console-serving-cert\") pod \"console-654c77b6c6-kh7ws\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:14.630119 master-0 kubenswrapper[35367]: I1204 12:06:14.630060 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea79af85-e731-449a-a476-2ff8b05f9d80-console-oauth-config\") pod \"console-654c77b6c6-kh7ws\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:14.675748 master-0 kubenswrapper[35367]: I1204 12:06:14.675710 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-klcpm\" (UniqueName: \"kubernetes.io/projected/ea79af85-e731-449a-a476-2ff8b05f9d80-kube-api-access-klcpm\") pod \"console-654c77b6c6-kh7ws\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:14.712853 master-0 kubenswrapper[35367]: I1204 12:06:14.705470 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7d45bf9455-w67z7" podStartSLOduration=113.461361723 podStartE2EDuration="1m56.705443656s" podCreationTimestamp="2025-12-04 12:04:18 +0000 UTC" firstStartedPulling="2025-12-04 12:06:10.627924894 +0000 UTC m=+414.065986152" lastFinishedPulling="2025-12-04 12:06:13.872006827 +0000 UTC m=+417.310068085" observedRunningTime="2025-12-04 12:06:14.605070128 +0000 UTC m=+418.043131406" watchObservedRunningTime="2025-12-04 12:06:14.705443656 +0000 UTC m=+418.143504914" Dec 04 12:06:14.712853 master-0 kubenswrapper[35367]: I1204 12:06:14.707641 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-5465c8b4db-58d52" podStartSLOduration=1670.151902008 podStartE2EDuration="27m53.707624235s" podCreationTimestamp="2025-12-04 11:38:21 +0000 UTC" firstStartedPulling="2025-12-04 12:06:10.322136404 +0000 UTC m=+413.760197662" lastFinishedPulling="2025-12-04 12:06:13.877858631 +0000 UTC m=+417.315919889" observedRunningTime="2025-12-04 12:06:14.689960919 +0000 UTC m=+418.128022197" watchObservedRunningTime="2025-12-04 12:06:14.707624235 +0000 UTC m=+418.145685493" Dec 04 12:06:14.733536 master-0 kubenswrapper[35367]: I1204 12:06:14.733183 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:14.798022 master-0 kubenswrapper[35367]: I1204 12:06:14.797887 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7c85c4dffd-xv2wn" podStartSLOduration=1659.116238285 podStartE2EDuration="27m41.797794322s" podCreationTimestamp="2025-12-04 11:38:33 +0000 UTC" firstStartedPulling="2025-12-04 12:06:11.196290654 +0000 UTC m=+414.634351922" lastFinishedPulling="2025-12-04 12:06:13.877846701 +0000 UTC m=+417.315907959" observedRunningTime="2025-12-04 12:06:14.774286532 +0000 UTC m=+418.212347790" watchObservedRunningTime="2025-12-04 12:06:14.797794322 +0000 UTC m=+418.235855590" Dec 04 12:06:14.949883 master-0 kubenswrapper[35367]: I1204 12:06:14.946898 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv" Dec 04 12:06:15.121097 master-0 kubenswrapper[35367]: I1204 12:06:15.121035 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/18a37b73-52bc-444b-be63-5b7f7b4419ab-secret-volume\") pod \"18a37b73-52bc-444b-be63-5b7f7b4419ab\" (UID: \"18a37b73-52bc-444b-be63-5b7f7b4419ab\") " Dec 04 12:06:15.121352 master-0 kubenswrapper[35367]: I1204 12:06:15.121158 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/18a37b73-52bc-444b-be63-5b7f7b4419ab-config-volume\") pod \"18a37b73-52bc-444b-be63-5b7f7b4419ab\" (UID: \"18a37b73-52bc-444b-be63-5b7f7b4419ab\") " Dec 04 12:06:15.121352 master-0 kubenswrapper[35367]: I1204 12:06:15.121264 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97rp9\" (UniqueName: \"kubernetes.io/projected/18a37b73-52bc-444b-be63-5b7f7b4419ab-kube-api-access-97rp9\") pod \"18a37b73-52bc-444b-be63-5b7f7b4419ab\" (UID: \"18a37b73-52bc-444b-be63-5b7f7b4419ab\") " Dec 04 12:06:15.121699 master-0 kubenswrapper[35367]: I1204 12:06:15.121644 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a37b73-52bc-444b-be63-5b7f7b4419ab-config-volume" (OuterVolumeSpecName: "config-volume") pod "18a37b73-52bc-444b-be63-5b7f7b4419ab" (UID: "18a37b73-52bc-444b-be63-5b7f7b4419ab"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:06:15.122470 master-0 kubenswrapper[35367]: I1204 12:06:15.122441 35367 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/18a37b73-52bc-444b-be63-5b7f7b4419ab-config-volume\") on node \"master-0\" DevicePath \"\"" Dec 04 12:06:15.124259 master-0 kubenswrapper[35367]: I1204 12:06:15.124212 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a37b73-52bc-444b-be63-5b7f7b4419ab-kube-api-access-97rp9" (OuterVolumeSpecName: "kube-api-access-97rp9") pod "18a37b73-52bc-444b-be63-5b7f7b4419ab" (UID: "18a37b73-52bc-444b-be63-5b7f7b4419ab"). InnerVolumeSpecName "kube-api-access-97rp9". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:06:15.124458 master-0 kubenswrapper[35367]: I1204 12:06:15.124419 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18a37b73-52bc-444b-be63-5b7f7b4419ab-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "18a37b73-52bc-444b-be63-5b7f7b4419ab" (UID: "18a37b73-52bc-444b-be63-5b7f7b4419ab"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:06:15.223845 master-0 kubenswrapper[35367]: I1204 12:06:15.223754 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-97rp9\" (UniqueName: \"kubernetes.io/projected/18a37b73-52bc-444b-be63-5b7f7b4419ab-kube-api-access-97rp9\") on node \"master-0\" DevicePath \"\"" Dec 04 12:06:15.223845 master-0 kubenswrapper[35367]: I1204 12:06:15.223858 35367 reconciler_common.go:293] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/18a37b73-52bc-444b-be63-5b7f7b4419ab-secret-volume\") on node \"master-0\" DevicePath \"\"" Dec 04 12:06:15.249751 master-0 kubenswrapper[35367]: I1204 12:06:15.249668 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5465c8b4db-58d52" Dec 04 12:06:15.253131 master-0 kubenswrapper[35367]: I1204 12:06:15.253079 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5465c8b4db-58d52" Dec 04 12:06:15.513164 master-0 kubenswrapper[35367]: W1204 12:06:15.512798 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea79af85_e731_449a_a476_2ff8b05f9d80.slice/crio-e70df1a09f004267e3c1981bc4703949577e230940d387e84c720d0dcbaf6420 WatchSource:0}: Error finding container e70df1a09f004267e3c1981bc4703949577e230940d387e84c720d0dcbaf6420: Status 404 returned error can't find the container with id e70df1a09f004267e3c1981bc4703949577e230940d387e84c720d0dcbaf6420 Dec 04 12:06:15.514830 master-0 kubenswrapper[35367]: I1204 12:06:15.514734 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-654c77b6c6-kh7ws"] Dec 04 12:06:15.551827 master-0 kubenswrapper[35367]: I1204 12:06:15.551752 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv" event={"ID":"18a37b73-52bc-444b-be63-5b7f7b4419ab","Type":"ContainerDied","Data":"703bb95fd887906aed1f2d1640ebc2602b90f323662e4997b1d15c0833457992"} Dec 04 12:06:15.551827 master-0 kubenswrapper[35367]: I1204 12:06:15.551832 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="703bb95fd887906aed1f2d1640ebc2602b90f323662e4997b1d15c0833457992" Dec 04 12:06:15.552094 master-0 kubenswrapper[35367]: I1204 12:06:15.551891 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv" Dec 04 12:06:15.556942 master-0 kubenswrapper[35367]: I1204 12:06:15.555673 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-5-master-0" event={"ID":"1925d356-c016-404c-8860-52707bf633be","Type":"ContainerStarted","Data":"c5c1336556cbcb95165f1f102bb4eac819f4ced445d9c55a6a1d6f55ca3e40fa"} Dec 04 12:06:15.559848 master-0 kubenswrapper[35367]: I1204 12:06:15.559024 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654c77b6c6-kh7ws" event={"ID":"ea79af85-e731-449a-a476-2ff8b05f9d80","Type":"ContainerStarted","Data":"e70df1a09f004267e3c1981bc4703949577e230940d387e84c720d0dcbaf6420"} Dec 04 12:06:15.559848 master-0 kubenswrapper[35367]: I1204 12:06:15.559708 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ingress/router-default-5465c8b4db-58d52" Dec 04 12:06:15.562258 master-0 kubenswrapper[35367]: I1204 12:06:15.562207 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5465c8b4db-58d52" Dec 04 12:06:16.016418 master-0 kubenswrapper[35367]: I1204 12:06:16.016333 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/installer-5-master-0" podStartSLOduration=3.016306313 podStartE2EDuration="3.016306313s" podCreationTimestamp="2025-12-04 12:06:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:06:16.008526109 +0000 UTC m=+419.446587377" watchObservedRunningTime="2025-12-04 12:06:16.016306313 +0000 UTC m=+419.454367571" Dec 04 12:06:16.987051 master-0 kubenswrapper[35367]: I1204 12:06:16.986949 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6c74d9cb9f-pxd98"] Dec 04 12:06:16.987711 master-0 kubenswrapper[35367]: E1204 12:06:16.987321 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="18a37b73-52bc-444b-be63-5b7f7b4419ab" containerName="collect-profiles" Dec 04 12:06:16.987711 master-0 kubenswrapper[35367]: I1204 12:06:16.987338 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="18a37b73-52bc-444b-be63-5b7f7b4419ab" containerName="collect-profiles" Dec 04 12:06:16.987711 master-0 kubenswrapper[35367]: I1204 12:06:16.987524 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="18a37b73-52bc-444b-be63-5b7f7b4419ab" containerName="collect-profiles" Dec 04 12:06:16.994319 master-0 kubenswrapper[35367]: I1204 12:06:16.988929 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6c74d9cb9f-pxd98" Dec 04 12:06:16.994319 master-0 kubenswrapper[35367]: I1204 12:06:16.992315 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-dockercfg-4hfp5" Dec 04 12:06:16.994319 master-0 kubenswrapper[35367]: I1204 12:06:16.992744 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-tls" Dec 04 12:06:16.994319 master-0 kubenswrapper[35367]: I1204 12:06:16.993062 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"metrics-client-ca" Dec 04 12:06:16.994319 master-0 kubenswrapper[35367]: I1204 12:06:16.993246 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-kube-rbac-proxy-config" Dec 04 12:06:17.075917 master-0 kubenswrapper[35367]: I1204 12:06:17.072787 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6c74d9cb9f-pxd98"] Dec 04 12:06:17.113968 master-0 kubenswrapper[35367]: I1204 12:06:17.113884 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dc95c8d8-klv7m"] Dec 04 12:06:17.116306 master-0 kubenswrapper[35367]: I1204 12:06:17.115706 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.128449 master-0 kubenswrapper[35367]: I1204 12:06:17.128390 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"trusted-ca-bundle" Dec 04 12:06:17.166177 master-0 kubenswrapper[35367]: I1204 12:06:17.166085 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdwzw\" (UniqueName: \"kubernetes.io/projected/e62ab42a-086e-451b-a036-1171285d7d24-kube-api-access-sdwzw\") pod \"prometheus-operator-6c74d9cb9f-pxd98\" (UID: \"e62ab42a-086e-451b-a036-1171285d7d24\") " pod="openshift-monitoring/prometheus-operator-6c74d9cb9f-pxd98" Dec 04 12:06:17.166177 master-0 kubenswrapper[35367]: I1204 12:06:17.166171 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e62ab42a-086e-451b-a036-1171285d7d24-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6c74d9cb9f-pxd98\" (UID: \"e62ab42a-086e-451b-a036-1171285d7d24\") " pod="openshift-monitoring/prometheus-operator-6c74d9cb9f-pxd98" Dec 04 12:06:17.166510 master-0 kubenswrapper[35367]: I1204 12:06:17.166209 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e62ab42a-086e-451b-a036-1171285d7d24-prometheus-operator-tls\") pod \"prometheus-operator-6c74d9cb9f-pxd98\" (UID: \"e62ab42a-086e-451b-a036-1171285d7d24\") " pod="openshift-monitoring/prometheus-operator-6c74d9cb9f-pxd98" Dec 04 12:06:17.166510 master-0 kubenswrapper[35367]: I1204 12:06:17.166246 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e62ab42a-086e-451b-a036-1171285d7d24-metrics-client-ca\") pod \"prometheus-operator-6c74d9cb9f-pxd98\" (UID: \"e62ab42a-086e-451b-a036-1171285d7d24\") " pod="openshift-monitoring/prometheus-operator-6c74d9cb9f-pxd98" Dec 04 12:06:17.183835 master-0 kubenswrapper[35367]: I1204 12:06:17.183761 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dc95c8d8-klv7m"] Dec 04 12:06:17.267376 master-0 kubenswrapper[35367]: I1204 12:06:17.267224 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e62ab42a-086e-451b-a036-1171285d7d24-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6c74d9cb9f-pxd98\" (UID: \"e62ab42a-086e-451b-a036-1171285d7d24\") " pod="openshift-monitoring/prometheus-operator-6c74d9cb9f-pxd98" Dec 04 12:06:17.267376 master-0 kubenswrapper[35367]: I1204 12:06:17.267298 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-service-ca\") pod \"console-6dc95c8d8-klv7m\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.267376 master-0 kubenswrapper[35367]: I1204 12:06:17.267351 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e62ab42a-086e-451b-a036-1171285d7d24-prometheus-operator-tls\") pod \"prometheus-operator-6c74d9cb9f-pxd98\" (UID: \"e62ab42a-086e-451b-a036-1171285d7d24\") " pod="openshift-monitoring/prometheus-operator-6c74d9cb9f-pxd98" Dec 04 12:06:17.267716 master-0 kubenswrapper[35367]: I1204 12:06:17.267541 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-console-oauth-config\") pod \"console-6dc95c8d8-klv7m\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.267716 master-0 kubenswrapper[35367]: I1204 12:06:17.267601 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-console-config\") pod \"console-6dc95c8d8-klv7m\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.267716 master-0 kubenswrapper[35367]: I1204 12:06:17.267667 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e62ab42a-086e-451b-a036-1171285d7d24-metrics-client-ca\") pod \"prometheus-operator-6c74d9cb9f-pxd98\" (UID: \"e62ab42a-086e-451b-a036-1171285d7d24\") " pod="openshift-monitoring/prometheus-operator-6c74d9cb9f-pxd98" Dec 04 12:06:17.268011 master-0 kubenswrapper[35367]: I1204 12:06:17.267695 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-trusted-ca-bundle\") pod \"console-6dc95c8d8-klv7m\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.268011 master-0 kubenswrapper[35367]: I1204 12:06:17.267747 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-console-serving-cert\") pod \"console-6dc95c8d8-klv7m\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.268011 master-0 kubenswrapper[35367]: I1204 12:06:17.267825 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trh8p\" (UniqueName: \"kubernetes.io/projected/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-kube-api-access-trh8p\") pod \"console-6dc95c8d8-klv7m\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.268011 master-0 kubenswrapper[35367]: I1204 12:06:17.267896 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-oauth-serving-cert\") pod \"console-6dc95c8d8-klv7m\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.268210 master-0 kubenswrapper[35367]: I1204 12:06:17.268164 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sdwzw\" (UniqueName: \"kubernetes.io/projected/e62ab42a-086e-451b-a036-1171285d7d24-kube-api-access-sdwzw\") pod \"prometheus-operator-6c74d9cb9f-pxd98\" (UID: \"e62ab42a-086e-451b-a036-1171285d7d24\") " pod="openshift-monitoring/prometheus-operator-6c74d9cb9f-pxd98" Dec 04 12:06:17.268946 master-0 kubenswrapper[35367]: I1204 12:06:17.268897 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e62ab42a-086e-451b-a036-1171285d7d24-metrics-client-ca\") pod \"prometheus-operator-6c74d9cb9f-pxd98\" (UID: \"e62ab42a-086e-451b-a036-1171285d7d24\") " pod="openshift-monitoring/prometheus-operator-6c74d9cb9f-pxd98" Dec 04 12:06:17.271133 master-0 kubenswrapper[35367]: I1204 12:06:17.271103 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e62ab42a-086e-451b-a036-1171285d7d24-prometheus-operator-tls\") pod \"prometheus-operator-6c74d9cb9f-pxd98\" (UID: \"e62ab42a-086e-451b-a036-1171285d7d24\") " pod="openshift-monitoring/prometheus-operator-6c74d9cb9f-pxd98" Dec 04 12:06:17.272531 master-0 kubenswrapper[35367]: I1204 12:06:17.272489 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e62ab42a-086e-451b-a036-1171285d7d24-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6c74d9cb9f-pxd98\" (UID: \"e62ab42a-086e-451b-a036-1171285d7d24\") " pod="openshift-monitoring/prometheus-operator-6c74d9cb9f-pxd98" Dec 04 12:06:17.322422 master-0 kubenswrapper[35367]: I1204 12:06:17.322349 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdwzw\" (UniqueName: \"kubernetes.io/projected/e62ab42a-086e-451b-a036-1171285d7d24-kube-api-access-sdwzw\") pod \"prometheus-operator-6c74d9cb9f-pxd98\" (UID: \"e62ab42a-086e-451b-a036-1171285d7d24\") " pod="openshift-monitoring/prometheus-operator-6c74d9cb9f-pxd98" Dec 04 12:06:17.370248 master-0 kubenswrapper[35367]: I1204 12:06:17.370174 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-service-ca\") pod \"console-6dc95c8d8-klv7m\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.370664 master-0 kubenswrapper[35367]: I1204 12:06:17.370441 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-console-config\") pod \"console-6dc95c8d8-klv7m\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.370664 master-0 kubenswrapper[35367]: I1204 12:06:17.370543 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-console-oauth-config\") pod \"console-6dc95c8d8-klv7m\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.370664 master-0 kubenswrapper[35367]: I1204 12:06:17.370644 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-trusted-ca-bundle\") pod \"console-6dc95c8d8-klv7m\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.370664 master-0 kubenswrapper[35367]: I1204 12:06:17.370662 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-console-serving-cert\") pod \"console-6dc95c8d8-klv7m\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.370974 master-0 kubenswrapper[35367]: I1204 12:06:17.370692 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-trh8p\" (UniqueName: \"kubernetes.io/projected/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-kube-api-access-trh8p\") pod \"console-6dc95c8d8-klv7m\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.370974 master-0 kubenswrapper[35367]: I1204 12:06:17.370766 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-oauth-serving-cert\") pod \"console-6dc95c8d8-klv7m\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.371308 master-0 kubenswrapper[35367]: I1204 12:06:17.371231 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-service-ca\") pod \"console-6dc95c8d8-klv7m\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.371700 master-0 kubenswrapper[35367]: I1204 12:06:17.371628 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-console-config\") pod \"console-6dc95c8d8-klv7m\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.372115 master-0 kubenswrapper[35367]: I1204 12:06:17.372076 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-oauth-serving-cert\") pod \"console-6dc95c8d8-klv7m\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.372326 master-0 kubenswrapper[35367]: I1204 12:06:17.372290 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-trusted-ca-bundle\") pod \"console-6dc95c8d8-klv7m\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.373951 master-0 kubenswrapper[35367]: I1204 12:06:17.373905 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-console-oauth-config\") pod \"console-6dc95c8d8-klv7m\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.375984 master-0 kubenswrapper[35367]: I1204 12:06:17.375917 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-console-serving-cert\") pod \"console-6dc95c8d8-klv7m\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.430614 master-0 kubenswrapper[35367]: I1204 12:06:17.430558 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-trh8p\" (UniqueName: \"kubernetes.io/projected/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-kube-api-access-trh8p\") pod \"console-6dc95c8d8-klv7m\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.448551 master-0 kubenswrapper[35367]: I1204 12:06:17.448450 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:17.615093 master-0 kubenswrapper[35367]: I1204 12:06:17.615034 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6c74d9cb9f-pxd98" Dec 04 12:06:18.520448 master-0 kubenswrapper[35367]: I1204 12:06:18.520382 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dc95c8d8-klv7m"] Dec 04 12:06:18.537298 master-0 kubenswrapper[35367]: I1204 12:06:18.537201 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6c74d9cb9f-pxd98"] Dec 04 12:06:18.853905 master-0 kubenswrapper[35367]: I1204 12:06:18.845263 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-authentication/oauth-openshift-d676f96d8-88p47"] Dec 04 12:06:18.853905 master-0 kubenswrapper[35367]: I1204 12:06:18.847006 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:18.853905 master-0 kubenswrapper[35367]: I1204 12:06:18.850172 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-template-error" Dec 04 12:06:18.854318 master-0 kubenswrapper[35367]: I1204 12:06:18.854240 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-serving-cert" Dec 04 12:06:18.854373 master-0 kubenswrapper[35367]: I1204 12:06:18.854340 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"audit" Dec 04 12:06:18.854443 master-0 kubenswrapper[35367]: I1204 12:06:18.854375 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-template-provider-selection" Dec 04 12:06:18.854989 master-0 kubenswrapper[35367]: I1204 12:06:18.854965 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-template-login" Dec 04 12:06:18.855071 master-0 kubenswrapper[35367]: I1204 12:06:18.855007 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"kube-root-ca.crt" Dec 04 12:06:18.855209 master-0 kubenswrapper[35367]: I1204 12:06:18.855189 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"openshift-service-ca.crt" Dec 04 12:06:18.855313 master-0 kubenswrapper[35367]: I1204 12:06:18.855283 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-session" Dec 04 12:06:18.855367 master-0 kubenswrapper[35367]: I1204 12:06:18.855334 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"v4-0-config-system-cliconfig" Dec 04 12:06:18.855408 master-0 kubenswrapper[35367]: I1204 12:06:18.855335 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"oauth-openshift-dockercfg-vxnhq" Dec 04 12:06:18.855527 master-0 kubenswrapper[35367]: I1204 12:06:18.855506 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"v4-0-config-system-service-ca" Dec 04 12:06:18.866078 master-0 kubenswrapper[35367]: I1204 12:06:18.866004 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"v4-0-config-system-trusted-ca-bundle" Dec 04 12:06:18.868162 master-0 kubenswrapper[35367]: I1204 12:06:18.868124 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-router-certs" Dec 04 12:06:18.870511 master-0 kubenswrapper[35367]: I1204 12:06:18.870456 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-ocp-branding-template" Dec 04 12:06:18.901218 master-0 kubenswrapper[35367]: I1204 12:06:18.901091 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/005c4859-1367-4bdf-96c7-1a1319099b9d-audit-dir\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:18.901218 master-0 kubenswrapper[35367]: I1204 12:06:18.901179 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:18.901218 master-0 kubenswrapper[35367]: I1204 12:06:18.901208 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-service-ca\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:18.901218 master-0 kubenswrapper[35367]: I1204 12:06:18.901235 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-user-template-login\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:18.901690 master-0 kubenswrapper[35367]: I1204 12:06:18.901291 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:18.901690 master-0 kubenswrapper[35367]: I1204 12:06:18.901323 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-audit-policies\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:18.901690 master-0 kubenswrapper[35367]: I1204 12:06:18.901353 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-cliconfig\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:18.901690 master-0 kubenswrapper[35367]: I1204 12:06:18.901373 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-router-certs\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:18.901690 master-0 kubenswrapper[35367]: I1204 12:06:18.901399 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-user-template-error\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:18.901690 master-0 kubenswrapper[35367]: I1204 12:06:18.901427 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:18.901690 master-0 kubenswrapper[35367]: I1204 12:06:18.901450 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm8w2\" (UniqueName: \"kubernetes.io/projected/005c4859-1367-4bdf-96c7-1a1319099b9d-kube-api-access-zm8w2\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:18.901690 master-0 kubenswrapper[35367]: I1204 12:06:18.901474 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-session\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:18.901690 master-0 kubenswrapper[35367]: I1204 12:06:18.901497 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-serving-cert\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.003219 master-0 kubenswrapper[35367]: I1204 12:06:19.003111 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-user-template-error\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.003496 master-0 kubenswrapper[35367]: I1204 12:06:19.003363 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.003496 master-0 kubenswrapper[35367]: I1204 12:06:19.003417 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zm8w2\" (UniqueName: \"kubernetes.io/projected/005c4859-1367-4bdf-96c7-1a1319099b9d-kube-api-access-zm8w2\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.003727 master-0 kubenswrapper[35367]: I1204 12:06:19.003664 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-session\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.003790 master-0 kubenswrapper[35367]: I1204 12:06:19.003769 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-serving-cert\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.003979 master-0 kubenswrapper[35367]: I1204 12:06:19.003910 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/005c4859-1367-4bdf-96c7-1a1319099b9d-audit-dir\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.004032 master-0 kubenswrapper[35367]: I1204 12:06:19.003987 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.004082 master-0 kubenswrapper[35367]: I1204 12:06:19.004032 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-service-ca\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.004082 master-0 kubenswrapper[35367]: I1204 12:06:19.004071 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-user-template-login\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.004167 master-0 kubenswrapper[35367]: I1204 12:06:19.004142 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.004265 master-0 kubenswrapper[35367]: I1204 12:06:19.004244 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-audit-policies\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.004476 master-0 kubenswrapper[35367]: I1204 12:06:19.004399 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/005c4859-1367-4bdf-96c7-1a1319099b9d-audit-dir\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.005245 master-0 kubenswrapper[35367]: I1204 12:06:19.005210 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-service-ca\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.005309 master-0 kubenswrapper[35367]: I1204 12:06:19.005284 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-cliconfig\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.005366 master-0 kubenswrapper[35367]: I1204 12:06:19.005320 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-router-certs\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.006097 master-0 kubenswrapper[35367]: I1204 12:06:19.006059 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.006305 master-0 kubenswrapper[35367]: I1204 12:06:19.006255 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-user-template-error\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.006561 master-0 kubenswrapper[35367]: I1204 12:06:19.006529 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-audit-policies\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.006655 master-0 kubenswrapper[35367]: I1204 12:06:19.006624 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-cliconfig\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.006999 master-0 kubenswrapper[35367]: I1204 12:06:19.006968 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.007061 master-0 kubenswrapper[35367]: I1204 12:06:19.007036 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-serving-cert\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.008000 master-0 kubenswrapper[35367]: I1204 12:06:19.007963 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-router-certs\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.008070 master-0 kubenswrapper[35367]: I1204 12:06:19.007975 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-user-template-login\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.008923 master-0 kubenswrapper[35367]: I1204 12:06:19.008884 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.013428 master-0 kubenswrapper[35367]: I1204 12:06:19.013391 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-session\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.045558 master-0 kubenswrapper[35367]: I1204 12:06:19.045454 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-d676f96d8-88p47"] Dec 04 12:06:19.103068 master-0 kubenswrapper[35367]: I1204 12:06:19.102984 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm8w2\" (UniqueName: \"kubernetes.io/projected/005c4859-1367-4bdf-96c7-1a1319099b9d-kube-api-access-zm8w2\") pod \"oauth-openshift-d676f96d8-88p47\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:19.178842 master-0 kubenswrapper[35367]: I1204 12:06:19.178688 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:20.530497 master-0 kubenswrapper[35367]: W1204 12:06:20.530415 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91498480_8e7a_4ac5_86b3_9ff689a2e0c6.slice/crio-b8aceefe7b2192688f532c62ad0aff8e1186af89459726967952610ed0719e36 WatchSource:0}: Error finding container b8aceefe7b2192688f532c62ad0aff8e1186af89459726967952610ed0719e36: Status 404 returned error can't find the container with id b8aceefe7b2192688f532c62ad0aff8e1186af89459726967952610ed0719e36 Dec 04 12:06:20.533007 master-0 kubenswrapper[35367]: W1204 12:06:20.532717 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode62ab42a_086e_451b_a036_1171285d7d24.slice/crio-c44985eca616daba949971e66710ff0e7d78a57e4acb6d2e865ae4cd41fe02b4 WatchSource:0}: Error finding container c44985eca616daba949971e66710ff0e7d78a57e4acb6d2e865ae4cd41fe02b4: Status 404 returned error can't find the container with id c44985eca616daba949971e66710ff0e7d78a57e4acb6d2e865ae4cd41fe02b4 Dec 04 12:06:20.630256 master-0 kubenswrapper[35367]: I1204 12:06:20.630176 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc95c8d8-klv7m" event={"ID":"91498480-8e7a-4ac5-86b3-9ff689a2e0c6","Type":"ContainerStarted","Data":"b8aceefe7b2192688f532c62ad0aff8e1186af89459726967952610ed0719e36"} Dec 04 12:06:20.632780 master-0 kubenswrapper[35367]: I1204 12:06:20.632744 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6c74d9cb9f-pxd98" event={"ID":"e62ab42a-086e-451b-a036-1171285d7d24","Type":"ContainerStarted","Data":"c44985eca616daba949971e66710ff0e7d78a57e4acb6d2e865ae4cd41fe02b4"} Dec 04 12:06:21.189126 master-0 kubenswrapper[35367]: I1204 12:06:21.187281 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-d676f96d8-88p47"] Dec 04 12:06:21.197589 master-0 kubenswrapper[35367]: W1204 12:06:21.197466 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod005c4859_1367_4bdf_96c7_1a1319099b9d.slice/crio-59f8f9d4fcef17c194802af5e163c7bd99ffaf9ce09bb67946ac67c85212f95a WatchSource:0}: Error finding container 59f8f9d4fcef17c194802af5e163c7bd99ffaf9ce09bb67946ac67c85212f95a: Status 404 returned error can't find the container with id 59f8f9d4fcef17c194802af5e163c7bd99ffaf9ce09bb67946ac67c85212f95a Dec 04 12:06:21.643270 master-0 kubenswrapper[35367]: I1204 12:06:21.643212 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" event={"ID":"005c4859-1367-4bdf-96c7-1a1319099b9d","Type":"ContainerStarted","Data":"59f8f9d4fcef17c194802af5e163c7bd99ffaf9ce09bb67946ac67c85212f95a"} Dec 04 12:06:24.663948 master-0 kubenswrapper[35367]: I1204 12:06:24.663742 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654c77b6c6-kh7ws" event={"ID":"ea79af85-e731-449a-a476-2ff8b05f9d80","Type":"ContainerStarted","Data":"48d1d94cdb64153b163172f3e070a70c759cd71fe0a8a80d756ac993a61a5ffa"} Dec 04 12:06:24.734919 master-0 kubenswrapper[35367]: I1204 12:06:24.734844 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:24.734919 master-0 kubenswrapper[35367]: I1204 12:06:24.734929 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:06:24.736606 master-0 kubenswrapper[35367]: I1204 12:06:24.736548 35367 patch_prober.go:28] interesting pod/console-654c77b6c6-kh7ws container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.97:8443/health\": dial tcp 10.128.0.97:8443: connect: connection refused" start-of-body= Dec 04 12:06:24.736666 master-0 kubenswrapper[35367]: I1204 12:06:24.736635 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-654c77b6c6-kh7ws" podUID="ea79af85-e731-449a-a476-2ff8b05f9d80" containerName="console" probeResult="failure" output="Get \"https://10.128.0.97:8443/health\": dial tcp 10.128.0.97:8443: connect: connection refused" Dec 04 12:06:26.681225 master-0 kubenswrapper[35367]: I1204 12:06:26.680997 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc95c8d8-klv7m" event={"ID":"91498480-8e7a-4ac5-86b3-9ff689a2e0c6","Type":"ContainerStarted","Data":"f24f51c7ff141061cf0d30a56d1a3fc0f69f3a574425e2310157fa1024ef0202"} Dec 04 12:06:26.806077 master-0 kubenswrapper[35367]: I1204 12:06:26.805992 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-654c77b6c6-kh7ws" podStartSLOduration=4.903220471 podStartE2EDuration="12.805970488s" podCreationTimestamp="2025-12-04 12:06:14 +0000 UTC" firstStartedPulling="2025-12-04 12:06:15.515773948 +0000 UTC m=+418.953835206" lastFinishedPulling="2025-12-04 12:06:23.418523965 +0000 UTC m=+426.856585223" observedRunningTime="2025-12-04 12:06:26.801426836 +0000 UTC m=+430.239488114" watchObservedRunningTime="2025-12-04 12:06:26.805970488 +0000 UTC m=+430.244031746" Dec 04 12:06:27.209928 master-0 kubenswrapper[35367]: I1204 12:06:27.209838 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-authentication/oauth-openshift-d676f96d8-88p47"] Dec 04 12:06:33.221257 master-0 kubenswrapper[35367]: I1204 12:06:33.221116 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6dc95c8d8-klv7m" podStartSLOduration=11.95481976 podStartE2EDuration="17.221084178s" podCreationTimestamp="2025-12-04 12:06:16 +0000 UTC" firstStartedPulling="2025-12-04 12:06:20.544638538 +0000 UTC m=+423.982699796" lastFinishedPulling="2025-12-04 12:06:25.810902956 +0000 UTC m=+429.248964214" observedRunningTime="2025-12-04 12:06:33.216673558 +0000 UTC m=+436.654734836" watchObservedRunningTime="2025-12-04 12:06:33.221084178 +0000 UTC m=+436.659145456" Dec 04 12:06:33.291917 master-0 kubenswrapper[35367]: I1204 12:06:33.291769 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-w4cqh"] Dec 04 12:06:33.293391 master-0 kubenswrapper[35367]: I1204 12:06:33.293356 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-w4cqh" Dec 04 12:06:33.354072 master-0 kubenswrapper[35367]: I1204 12:06:33.353992 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9d9dd887-e9eb-44d9-b34f-ac87681ccf98-catalog-content\") pod \"certified-operators-w4cqh\" (UID: \"9d9dd887-e9eb-44d9-b34f-ac87681ccf98\") " pod="openshift-marketplace/certified-operators-w4cqh" Dec 04 12:06:33.354328 master-0 kubenswrapper[35367]: I1204 12:06:33.354245 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4pq8\" (UniqueName: \"kubernetes.io/projected/9d9dd887-e9eb-44d9-b34f-ac87681ccf98-kube-api-access-q4pq8\") pod \"certified-operators-w4cqh\" (UID: \"9d9dd887-e9eb-44d9-b34f-ac87681ccf98\") " pod="openshift-marketplace/certified-operators-w4cqh" Dec 04 12:06:33.354328 master-0 kubenswrapper[35367]: I1204 12:06:33.354314 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9d9dd887-e9eb-44d9-b34f-ac87681ccf98-utilities\") pod \"certified-operators-w4cqh\" (UID: \"9d9dd887-e9eb-44d9-b34f-ac87681ccf98\") " pod="openshift-marketplace/certified-operators-w4cqh" Dec 04 12:06:33.458247 master-0 kubenswrapper[35367]: I1204 12:06:33.458153 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q4pq8\" (UniqueName: \"kubernetes.io/projected/9d9dd887-e9eb-44d9-b34f-ac87681ccf98-kube-api-access-q4pq8\") pod \"certified-operators-w4cqh\" (UID: \"9d9dd887-e9eb-44d9-b34f-ac87681ccf98\") " pod="openshift-marketplace/certified-operators-w4cqh" Dec 04 12:06:33.458670 master-0 kubenswrapper[35367]: I1204 12:06:33.458651 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9d9dd887-e9eb-44d9-b34f-ac87681ccf98-utilities\") pod \"certified-operators-w4cqh\" (UID: \"9d9dd887-e9eb-44d9-b34f-ac87681ccf98\") " pod="openshift-marketplace/certified-operators-w4cqh" Dec 04 12:06:33.458846 master-0 kubenswrapper[35367]: I1204 12:06:33.458830 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9d9dd887-e9eb-44d9-b34f-ac87681ccf98-catalog-content\") pod \"certified-operators-w4cqh\" (UID: \"9d9dd887-e9eb-44d9-b34f-ac87681ccf98\") " pod="openshift-marketplace/certified-operators-w4cqh" Dec 04 12:06:33.459417 master-0 kubenswrapper[35367]: I1204 12:06:33.459355 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9d9dd887-e9eb-44d9-b34f-ac87681ccf98-utilities\") pod \"certified-operators-w4cqh\" (UID: \"9d9dd887-e9eb-44d9-b34f-ac87681ccf98\") " pod="openshift-marketplace/certified-operators-w4cqh" Dec 04 12:06:33.459597 master-0 kubenswrapper[35367]: I1204 12:06:33.459543 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9d9dd887-e9eb-44d9-b34f-ac87681ccf98-catalog-content\") pod \"certified-operators-w4cqh\" (UID: \"9d9dd887-e9eb-44d9-b34f-ac87681ccf98\") " pod="openshift-marketplace/certified-operators-w4cqh" Dec 04 12:06:34.046682 master-0 kubenswrapper[35367]: I1204 12:06:34.046640 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-w4cqh"] Dec 04 12:06:34.734746 master-0 kubenswrapper[35367]: I1204 12:06:34.734686 35367 patch_prober.go:28] interesting pod/console-654c77b6c6-kh7ws container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.97:8443/health\": dial tcp 10.128.0.97:8443: connect: connection refused" start-of-body= Dec 04 12:06:34.735404 master-0 kubenswrapper[35367]: I1204 12:06:34.735332 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-654c77b6c6-kh7ws" podUID="ea79af85-e731-449a-a476-2ff8b05f9d80" containerName="console" probeResult="failure" output="Get \"https://10.128.0.97:8443/health\": dial tcp 10.128.0.97:8443: connect: connection refused" Dec 04 12:06:34.892238 master-0 kubenswrapper[35367]: I1204 12:06:34.892188 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4pq8\" (UniqueName: \"kubernetes.io/projected/9d9dd887-e9eb-44d9-b34f-ac87681ccf98-kube-api-access-q4pq8\") pod \"certified-operators-w4cqh\" (UID: \"9d9dd887-e9eb-44d9-b34f-ac87681ccf98\") " pod="openshift-marketplace/certified-operators-w4cqh" Dec 04 12:06:35.112001 master-0 kubenswrapper[35367]: I1204 12:06:35.111937 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-w4cqh" Dec 04 12:06:35.749616 master-0 kubenswrapper[35367]: I1204 12:06:35.749549 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6c74d9cb9f-pxd98" event={"ID":"e62ab42a-086e-451b-a036-1171285d7d24","Type":"ContainerStarted","Data":"879cfdd02600d61f2aa9c0348c12f9f0fb0e1e6ea67f28b400341c228332da27"} Dec 04 12:06:35.749616 master-0 kubenswrapper[35367]: I1204 12:06:35.749606 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6c74d9cb9f-pxd98" event={"ID":"e62ab42a-086e-451b-a036-1171285d7d24","Type":"ContainerStarted","Data":"77d615e12f9ea4f3b58843cd3660523b7544920722d649f9e871cc5473d7440d"} Dec 04 12:06:35.860250 master-0 kubenswrapper[35367]: W1204 12:06:35.860164 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d9dd887_e9eb_44d9_b34f_ac87681ccf98.slice/crio-15b990de9351fdb896d98a81a2f77e91b0de93f225cfce60f7d20c6ebc04107c WatchSource:0}: Error finding container 15b990de9351fdb896d98a81a2f77e91b0de93f225cfce60f7d20c6ebc04107c: Status 404 returned error can't find the container with id 15b990de9351fdb896d98a81a2f77e91b0de93f225cfce60f7d20c6ebc04107c Dec 04 12:06:35.861088 master-0 kubenswrapper[35367]: I1204 12:06:35.861063 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-w4cqh"] Dec 04 12:06:35.864141 master-0 kubenswrapper[35367]: I1204 12:06:35.864073 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6c74d9cb9f-pxd98" podStartSLOduration=6.344282091 podStartE2EDuration="19.864053451s" podCreationTimestamp="2025-12-04 12:06:16 +0000 UTC" firstStartedPulling="2025-12-04 12:06:20.544357499 +0000 UTC m=+423.982418757" lastFinishedPulling="2025-12-04 12:06:34.064128859 +0000 UTC m=+437.502190117" observedRunningTime="2025-12-04 12:06:35.849275826 +0000 UTC m=+439.287337084" watchObservedRunningTime="2025-12-04 12:06:35.864053451 +0000 UTC m=+439.302114709" Dec 04 12:06:36.136696 master-0 kubenswrapper[35367]: I1204 12:06:36.136634 35367 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 12:06:36.137059 master-0 kubenswrapper[35367]: I1204 12:06:36.137013 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="095bb4823c284d8bb15baa1a87c3e43c" containerName="kube-controller-manager" containerID="cri-o://0c0be354baac322c2a33b711de6a55086e966119960fe151968eb12d634f84ad" gracePeriod=30 Dec 04 12:06:36.137186 master-0 kubenswrapper[35367]: I1204 12:06:36.137122 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="095bb4823c284d8bb15baa1a87c3e43c" containerName="kube-controller-manager-cert-syncer" containerID="cri-o://015e2371341f29f754ea5dcca5238131c27fb3ff324d2a98ccffc6fb90b665ef" gracePeriod=30 Dec 04 12:06:36.137239 master-0 kubenswrapper[35367]: I1204 12:06:36.137173 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="095bb4823c284d8bb15baa1a87c3e43c" containerName="cluster-policy-controller" containerID="cri-o://6c19e584112eedeb13decc9df9666352919e150b045ee486fc000a978b305461" gracePeriod=30 Dec 04 12:06:36.137407 master-0 kubenswrapper[35367]: I1204 12:06:36.137173 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="095bb4823c284d8bb15baa1a87c3e43c" containerName="kube-controller-manager-recovery-controller" containerID="cri-o://53b4382d88729adf6a9704531b58a07011c633cdf64d8e147f628473c5513794" gracePeriod=30 Dec 04 12:06:36.138654 master-0 kubenswrapper[35367]: I1204 12:06:36.138319 35367 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 12:06:36.138704 master-0 kubenswrapper[35367]: E1204 12:06:36.138665 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="095bb4823c284d8bb15baa1a87c3e43c" containerName="kube-controller-manager" Dec 04 12:06:36.138704 master-0 kubenswrapper[35367]: I1204 12:06:36.138680 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="095bb4823c284d8bb15baa1a87c3e43c" containerName="kube-controller-manager" Dec 04 12:06:36.138704 master-0 kubenswrapper[35367]: E1204 12:06:36.138699 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="095bb4823c284d8bb15baa1a87c3e43c" containerName="kube-controller-manager-cert-syncer" Dec 04 12:06:36.138704 master-0 kubenswrapper[35367]: I1204 12:06:36.138706 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="095bb4823c284d8bb15baa1a87c3e43c" containerName="kube-controller-manager-cert-syncer" Dec 04 12:06:36.138902 master-0 kubenswrapper[35367]: E1204 12:06:36.138723 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="095bb4823c284d8bb15baa1a87c3e43c" containerName="cluster-policy-controller" Dec 04 12:06:36.138902 master-0 kubenswrapper[35367]: I1204 12:06:36.138731 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="095bb4823c284d8bb15baa1a87c3e43c" containerName="cluster-policy-controller" Dec 04 12:06:36.138902 master-0 kubenswrapper[35367]: E1204 12:06:36.138755 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="095bb4823c284d8bb15baa1a87c3e43c" containerName="kube-controller-manager-recovery-controller" Dec 04 12:06:36.138902 master-0 kubenswrapper[35367]: I1204 12:06:36.138761 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="095bb4823c284d8bb15baa1a87c3e43c" containerName="kube-controller-manager-recovery-controller" Dec 04 12:06:36.138902 master-0 kubenswrapper[35367]: I1204 12:06:36.138906 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="095bb4823c284d8bb15baa1a87c3e43c" containerName="cluster-policy-controller" Dec 04 12:06:36.139112 master-0 kubenswrapper[35367]: I1204 12:06:36.138925 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="095bb4823c284d8bb15baa1a87c3e43c" containerName="kube-controller-manager" Dec 04 12:06:36.139112 master-0 kubenswrapper[35367]: I1204 12:06:36.138938 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="095bb4823c284d8bb15baa1a87c3e43c" containerName="kube-controller-manager-recovery-controller" Dec 04 12:06:36.139112 master-0 kubenswrapper[35367]: I1204 12:06:36.138955 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="095bb4823c284d8bb15baa1a87c3e43c" containerName="kube-controller-manager-cert-syncer" Dec 04 12:06:36.203219 master-0 kubenswrapper[35367]: I1204 12:06:36.203084 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/b44cd0a1c87587350014492d2bc077ab-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"b44cd0a1c87587350014492d2bc077ab\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:06:36.203500 master-0 kubenswrapper[35367]: I1204 12:06:36.203294 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/b44cd0a1c87587350014492d2bc077ab-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"b44cd0a1c87587350014492d2bc077ab\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:06:36.305249 master-0 kubenswrapper[35367]: I1204 12:06:36.305118 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/b44cd0a1c87587350014492d2bc077ab-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"b44cd0a1c87587350014492d2bc077ab\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:06:36.305249 master-0 kubenswrapper[35367]: I1204 12:06:36.305264 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/b44cd0a1c87587350014492d2bc077ab-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"b44cd0a1c87587350014492d2bc077ab\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:06:36.305620 master-0 kubenswrapper[35367]: I1204 12:06:36.305301 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/b44cd0a1c87587350014492d2bc077ab-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"b44cd0a1c87587350014492d2bc077ab\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:06:36.305620 master-0 kubenswrapper[35367]: I1204 12:06:36.305364 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/b44cd0a1c87587350014492d2bc077ab-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"b44cd0a1c87587350014492d2bc077ab\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:06:36.520752 master-0 kubenswrapper[35367]: I1204 12:06:36.520701 35367 patch_prober.go:28] interesting pod/machine-config-daemon-8jwk5 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Dec 04 12:06:36.521189 master-0 kubenswrapper[35367]: I1204 12:06:36.521153 35367 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" podUID="99eb764e-656c-4873-a2cd-308ce9c31a7d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Dec 04 12:06:36.757059 master-0 kubenswrapper[35367]: I1204 12:06:36.756951 35367 generic.go:334] "Generic (PLEG): container finished" podID="e7fffd09-09be-49a8-937b-aa2e95c2968f" containerID="1fad34659bf0c3a3a160bf0ab5c988f36b917bbc7df6cfadd4949144dbe428d9" exitCode=0 Dec 04 12:06:36.757569 master-0 kubenswrapper[35367]: I1204 12:06:36.757023 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-4-master-0" event={"ID":"e7fffd09-09be-49a8-937b-aa2e95c2968f","Type":"ContainerDied","Data":"1fad34659bf0c3a3a160bf0ab5c988f36b917bbc7df6cfadd4949144dbe428d9"} Dec 04 12:06:36.759695 master-0 kubenswrapper[35367]: I1204 12:06:36.759664 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_095bb4823c284d8bb15baa1a87c3e43c/kube-controller-manager-cert-syncer/0.log" Dec 04 12:06:36.760505 master-0 kubenswrapper[35367]: I1204 12:06:36.760485 35367 generic.go:334] "Generic (PLEG): container finished" podID="095bb4823c284d8bb15baa1a87c3e43c" containerID="53b4382d88729adf6a9704531b58a07011c633cdf64d8e147f628473c5513794" exitCode=0 Dec 04 12:06:36.760505 master-0 kubenswrapper[35367]: I1204 12:06:36.760502 35367 generic.go:334] "Generic (PLEG): container finished" podID="095bb4823c284d8bb15baa1a87c3e43c" containerID="015e2371341f29f754ea5dcca5238131c27fb3ff324d2a98ccffc6fb90b665ef" exitCode=2 Dec 04 12:06:36.760650 master-0 kubenswrapper[35367]: I1204 12:06:36.760510 35367 generic.go:334] "Generic (PLEG): container finished" podID="095bb4823c284d8bb15baa1a87c3e43c" containerID="6c19e584112eedeb13decc9df9666352919e150b045ee486fc000a978b305461" exitCode=0 Dec 04 12:06:36.760650 master-0 kubenswrapper[35367]: I1204 12:06:36.760518 35367 generic.go:334] "Generic (PLEG): container finished" podID="095bb4823c284d8bb15baa1a87c3e43c" containerID="0c0be354baac322c2a33b711de6a55086e966119960fe151968eb12d634f84ad" exitCode=0 Dec 04 12:06:36.762403 master-0 kubenswrapper[35367]: I1204 12:06:36.762353 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" event={"ID":"005c4859-1367-4bdf-96c7-1a1319099b9d","Type":"ContainerStarted","Data":"ca08ffac691ae248342c1dcb4945471bcfb6930e1198922f94ec7be78cd84360"} Dec 04 12:06:36.762575 master-0 kubenswrapper[35367]: I1204 12:06:36.762518 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:36.764312 master-0 kubenswrapper[35367]: I1204 12:06:36.764271 35367 generic.go:334] "Generic (PLEG): container finished" podID="9d9dd887-e9eb-44d9-b34f-ac87681ccf98" containerID="6368e11429db20b7669fb0af0dc17ff66e76bf8de35364611625fa82c5a1f4dc" exitCode=0 Dec 04 12:06:36.764445 master-0 kubenswrapper[35367]: I1204 12:06:36.764337 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-w4cqh" event={"ID":"9d9dd887-e9eb-44d9-b34f-ac87681ccf98","Type":"ContainerDied","Data":"6368e11429db20b7669fb0af0dc17ff66e76bf8de35364611625fa82c5a1f4dc"} Dec 04 12:06:36.764445 master-0 kubenswrapper[35367]: I1204 12:06:36.764378 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-w4cqh" event={"ID":"9d9dd887-e9eb-44d9-b34f-ac87681ccf98","Type":"ContainerStarted","Data":"15b990de9351fdb896d98a81a2f77e91b0de93f225cfce60f7d20c6ebc04107c"} Dec 04 12:06:36.768088 master-0 kubenswrapper[35367]: I1204 12:06:36.768050 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:06:36.777059 master-0 kubenswrapper[35367]: I1204 12:06:36.776955 35367 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" oldPodUID="095bb4823c284d8bb15baa1a87c3e43c" podUID="b44cd0a1c87587350014492d2bc077ab" Dec 04 12:06:37.313255 master-0 kubenswrapper[35367]: I1204 12:06:37.313207 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_095bb4823c284d8bb15baa1a87c3e43c/kube-controller-manager-cert-syncer/0.log" Dec 04 12:06:37.313964 master-0 kubenswrapper[35367]: I1204 12:06:37.313935 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:06:37.423299 master-0 kubenswrapper[35367]: I1204 12:06:37.423199 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/095bb4823c284d8bb15baa1a87c3e43c-cert-dir\") pod \"095bb4823c284d8bb15baa1a87c3e43c\" (UID: \"095bb4823c284d8bb15baa1a87c3e43c\") " Dec 04 12:06:37.423594 master-0 kubenswrapper[35367]: I1204 12:06:37.423288 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/095bb4823c284d8bb15baa1a87c3e43c-cert-dir" (OuterVolumeSpecName: "cert-dir") pod "095bb4823c284d8bb15baa1a87c3e43c" (UID: "095bb4823c284d8bb15baa1a87c3e43c"). InnerVolumeSpecName "cert-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:06:37.423594 master-0 kubenswrapper[35367]: I1204 12:06:37.423391 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/095bb4823c284d8bb15baa1a87c3e43c-resource-dir\") pod \"095bb4823c284d8bb15baa1a87c3e43c\" (UID: \"095bb4823c284d8bb15baa1a87c3e43c\") " Dec 04 12:06:37.423594 master-0 kubenswrapper[35367]: I1204 12:06:37.423424 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/095bb4823c284d8bb15baa1a87c3e43c-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "095bb4823c284d8bb15baa1a87c3e43c" (UID: "095bb4823c284d8bb15baa1a87c3e43c"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:06:37.423763 master-0 kubenswrapper[35367]: I1204 12:06:37.423658 35367 reconciler_common.go:293] "Volume detached for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/095bb4823c284d8bb15baa1a87c3e43c-cert-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:06:37.423763 master-0 kubenswrapper[35367]: I1204 12:06:37.423672 35367 reconciler_common.go:293] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/095bb4823c284d8bb15baa1a87c3e43c-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:06:37.449349 master-0 kubenswrapper[35367]: I1204 12:06:37.449220 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:37.449349 master-0 kubenswrapper[35367]: I1204 12:06:37.449342 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:06:37.451484 master-0 kubenswrapper[35367]: I1204 12:06:37.451424 35367 patch_prober.go:28] interesting pod/console-6dc95c8d8-klv7m container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.99:8443/health\": dial tcp 10.128.0.99:8443: connect: connection refused" start-of-body= Dec 04 12:06:37.451617 master-0 kubenswrapper[35367]: I1204 12:06:37.451487 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-6dc95c8d8-klv7m" podUID="91498480-8e7a-4ac5-86b3-9ff689a2e0c6" containerName="console" probeResult="failure" output="Get \"https://10.128.0.99:8443/health\": dial tcp 10.128.0.99:8443: connect: connection refused" Dec 04 12:06:37.773615 master-0 kubenswrapper[35367]: I1204 12:06:37.773547 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_095bb4823c284d8bb15baa1a87c3e43c/kube-controller-manager-cert-syncer/0.log" Dec 04 12:06:37.774692 master-0 kubenswrapper[35367]: I1204 12:06:37.774628 35367 scope.go:117] "RemoveContainer" containerID="53b4382d88729adf6a9704531b58a07011c633cdf64d8e147f628473c5513794" Dec 04 12:06:37.774753 master-0 kubenswrapper[35367]: I1204 12:06:37.774681 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:06:37.796144 master-0 kubenswrapper[35367]: I1204 12:06:37.796099 35367 scope.go:117] "RemoveContainer" containerID="015e2371341f29f754ea5dcca5238131c27fb3ff324d2a98ccffc6fb90b665ef" Dec 04 12:06:37.813421 master-0 kubenswrapper[35367]: I1204 12:06:37.813381 35367 scope.go:117] "RemoveContainer" containerID="6c19e584112eedeb13decc9df9666352919e150b045ee486fc000a978b305461" Dec 04 12:06:37.828891 master-0 kubenswrapper[35367]: I1204 12:06:37.828837 35367 scope.go:117] "RemoveContainer" containerID="0c0be354baac322c2a33b711de6a55086e966119960fe151968eb12d634f84ad" Dec 04 12:06:38.135249 master-0 kubenswrapper[35367]: I1204 12:06:38.135207 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 12:06:38.235361 master-0 kubenswrapper[35367]: I1204 12:06:38.235225 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7fffd09-09be-49a8-937b-aa2e95c2968f-kubelet-dir\") pod \"e7fffd09-09be-49a8-937b-aa2e95c2968f\" (UID: \"e7fffd09-09be-49a8-937b-aa2e95c2968f\") " Dec 04 12:06:38.235361 master-0 kubenswrapper[35367]: I1204 12:06:38.235339 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/e7fffd09-09be-49a8-937b-aa2e95c2968f-var-lock\") pod \"e7fffd09-09be-49a8-937b-aa2e95c2968f\" (UID: \"e7fffd09-09be-49a8-937b-aa2e95c2968f\") " Dec 04 12:06:38.235361 master-0 kubenswrapper[35367]: I1204 12:06:38.235379 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/e7fffd09-09be-49a8-937b-aa2e95c2968f-kube-api-access\") pod \"e7fffd09-09be-49a8-937b-aa2e95c2968f\" (UID: \"e7fffd09-09be-49a8-937b-aa2e95c2968f\") " Dec 04 12:06:38.235797 master-0 kubenswrapper[35367]: I1204 12:06:38.235440 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e7fffd09-09be-49a8-937b-aa2e95c2968f-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "e7fffd09-09be-49a8-937b-aa2e95c2968f" (UID: "e7fffd09-09be-49a8-937b-aa2e95c2968f"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:06:38.235797 master-0 kubenswrapper[35367]: I1204 12:06:38.235511 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e7fffd09-09be-49a8-937b-aa2e95c2968f-var-lock" (OuterVolumeSpecName: "var-lock") pod "e7fffd09-09be-49a8-937b-aa2e95c2968f" (UID: "e7fffd09-09be-49a8-937b-aa2e95c2968f"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:06:38.236057 master-0 kubenswrapper[35367]: I1204 12:06:38.236003 35367 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7fffd09-09be-49a8-937b-aa2e95c2968f-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:06:38.236144 master-0 kubenswrapper[35367]: I1204 12:06:38.236095 35367 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/e7fffd09-09be-49a8-937b-aa2e95c2968f-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 12:06:38.239541 master-0 kubenswrapper[35367]: I1204 12:06:38.239384 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7fffd09-09be-49a8-937b-aa2e95c2968f-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "e7fffd09-09be-49a8-937b-aa2e95c2968f" (UID: "e7fffd09-09be-49a8-937b-aa2e95c2968f"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:06:38.337181 master-0 kubenswrapper[35367]: I1204 12:06:38.337114 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/e7fffd09-09be-49a8-937b-aa2e95c2968f-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 12:06:38.756017 master-0 kubenswrapper[35367]: I1204 12:06:38.755948 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="095bb4823c284d8bb15baa1a87c3e43c" path="/var/lib/kubelet/pods/095bb4823c284d8bb15baa1a87c3e43c/volumes" Dec 04 12:06:38.784383 master-0 kubenswrapper[35367]: I1204 12:06:38.784305 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-4-master-0" event={"ID":"e7fffd09-09be-49a8-937b-aa2e95c2968f","Type":"ContainerDied","Data":"02c40cea8fe7ab82d164b6933acb9e6387721f4f9ca7b46263806f0ade5328d7"} Dec 04 12:06:38.784383 master-0 kubenswrapper[35367]: I1204 12:06:38.784377 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02c40cea8fe7ab82d164b6933acb9e6387721f4f9ca7b46263806f0ade5328d7" Dec 04 12:06:38.785915 master-0 kubenswrapper[35367]: I1204 12:06:38.784393 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-4-master-0" Dec 04 12:06:39.373362 master-0 kubenswrapper[35367]: I1204 12:06:39.373169 35367 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" oldPodUID="095bb4823c284d8bb15baa1a87c3e43c" podUID="b44cd0a1c87587350014492d2bc077ab" Dec 04 12:06:41.647175 master-0 kubenswrapper[35367]: I1204 12:06:41.647045 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" podStartSLOduration=9.596250249 podStartE2EDuration="23.647012593s" podCreationTimestamp="2025-12-04 12:06:18 +0000 UTC" firstStartedPulling="2025-12-04 12:06:21.200319424 +0000 UTC m=+424.638380682" lastFinishedPulling="2025-12-04 12:06:35.251081778 +0000 UTC m=+438.689143026" observedRunningTime="2025-12-04 12:06:41.643406119 +0000 UTC m=+445.081467397" watchObservedRunningTime="2025-12-04 12:06:41.647012593 +0000 UTC m=+445.085073851" Dec 04 12:06:42.823751 master-0 kubenswrapper[35367]: I1204 12:06:42.823696 35367 generic.go:334] "Generic (PLEG): container finished" podID="9d9dd887-e9eb-44d9-b34f-ac87681ccf98" containerID="1329a8ee84a4f9feea9bb041c302a67a19fc1f3a8cf945238571cde53ed64941" exitCode=0 Dec 04 12:06:42.824285 master-0 kubenswrapper[35367]: I1204 12:06:42.823769 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-w4cqh" event={"ID":"9d9dd887-e9eb-44d9-b34f-ac87681ccf98","Type":"ContainerDied","Data":"1329a8ee84a4f9feea9bb041c302a67a19fc1f3a8cf945238571cde53ed64941"} Dec 04 12:06:43.171529 master-0 kubenswrapper[35367]: I1204 12:06:43.171397 35367 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-kube-scheduler/openshift-kube-scheduler-master-0"] Dec 04 12:06:43.171996 master-0 kubenswrapper[35367]: I1204 12:06:43.171910 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler-recovery-controller" containerID="cri-o://1dd3e9bec426604298540a62160aa04995ba35e82eac44c41bf666b47786e5c9" gracePeriod=30 Dec 04 12:06:43.172115 master-0 kubenswrapper[35367]: I1204 12:06:43.172092 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler" containerID="cri-o://e2713a2b9adf8ac2cd64c11a8cc47639892df9751d3f6828f4bd8b7f6c344a80" gracePeriod=30 Dec 04 12:06:43.172166 master-0 kubenswrapper[35367]: I1204 12:06:43.172129 35367 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-scheduler/openshift-kube-scheduler-master-0"] Dec 04 12:06:43.172314 master-0 kubenswrapper[35367]: I1204 12:06:43.172261 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler-cert-syncer" containerID="cri-o://0e3fb5e9fe4481e5a52c8778d150f0c86ce142116f508b1439fac0aa3de5e005" gracePeriod=30 Dec 04 12:06:43.173911 master-0 kubenswrapper[35367]: E1204 12:06:43.173295 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler-cert-syncer" Dec 04 12:06:43.173911 master-0 kubenswrapper[35367]: I1204 12:06:43.173321 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler-cert-syncer" Dec 04 12:06:43.173911 master-0 kubenswrapper[35367]: E1204 12:06:43.173382 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler-cert-syncer" Dec 04 12:06:43.173911 master-0 kubenswrapper[35367]: I1204 12:06:43.173390 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler-cert-syncer" Dec 04 12:06:43.173911 master-0 kubenswrapper[35367]: E1204 12:06:43.173408 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler-recovery-controller" Dec 04 12:06:43.173911 master-0 kubenswrapper[35367]: I1204 12:06:43.173419 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler-recovery-controller" Dec 04 12:06:43.173911 master-0 kubenswrapper[35367]: E1204 12:06:43.173477 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler" Dec 04 12:06:43.173911 master-0 kubenswrapper[35367]: I1204 12:06:43.173487 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler" Dec 04 12:06:43.173911 master-0 kubenswrapper[35367]: E1204 12:06:43.173503 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler" Dec 04 12:06:43.173911 master-0 kubenswrapper[35367]: I1204 12:06:43.173510 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler" Dec 04 12:06:43.173911 master-0 kubenswrapper[35367]: E1204 12:06:43.173549 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler-cert-syncer" Dec 04 12:06:43.173911 master-0 kubenswrapper[35367]: I1204 12:06:43.173558 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler-cert-syncer" Dec 04 12:06:43.173911 master-0 kubenswrapper[35367]: E1204 12:06:43.173568 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e7fffd09-09be-49a8-937b-aa2e95c2968f" containerName="installer" Dec 04 12:06:43.173911 master-0 kubenswrapper[35367]: I1204 12:06:43.173574 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7fffd09-09be-49a8-937b-aa2e95c2968f" containerName="installer" Dec 04 12:06:43.173911 master-0 kubenswrapper[35367]: E1204 12:06:43.173591 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="wait-for-host-port" Dec 04 12:06:43.173911 master-0 kubenswrapper[35367]: I1204 12:06:43.173598 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="wait-for-host-port" Dec 04 12:06:43.174466 master-0 kubenswrapper[35367]: I1204 12:06:43.173979 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler" Dec 04 12:06:43.174466 master-0 kubenswrapper[35367]: I1204 12:06:43.174010 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler-recovery-controller" Dec 04 12:06:43.174466 master-0 kubenswrapper[35367]: I1204 12:06:43.174019 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler" Dec 04 12:06:43.174466 master-0 kubenswrapper[35367]: I1204 12:06:43.174057 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler-cert-syncer" Dec 04 12:06:43.174466 master-0 kubenswrapper[35367]: I1204 12:06:43.174071 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler-cert-syncer" Dec 04 12:06:43.174466 master-0 kubenswrapper[35367]: I1204 12:06:43.174080 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="e7fffd09-09be-49a8-937b-aa2e95c2968f" containerName="installer" Dec 04 12:06:43.174466 master-0 kubenswrapper[35367]: I1204 12:06:43.174436 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="bdd20c68f1ccfd1240fb273af0638d01" containerName="kube-scheduler-cert-syncer" Dec 04 12:06:43.243084 master-0 kubenswrapper[35367]: I1204 12:06:43.238830 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/2cb8c983acca0c27a191b3f720d4b1e0-resource-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"2cb8c983acca0c27a191b3f720d4b1e0\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 12:06:43.243084 master-0 kubenswrapper[35367]: I1204 12:06:43.238902 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/2cb8c983acca0c27a191b3f720d4b1e0-cert-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"2cb8c983acca0c27a191b3f720d4b1e0\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 12:06:43.322295 master-0 kubenswrapper[35367]: I1204 12:06:43.319723 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-apiserver/installer-5-master-0"] Dec 04 12:06:43.322295 master-0 kubenswrapper[35367]: I1204 12:06:43.319986 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/installer-5-master-0" podUID="1925d356-c016-404c-8860-52707bf633be" containerName="installer" containerID="cri-o://c5c1336556cbcb95165f1f102bb4eac819f4ced445d9c55a6a1d6f55ca3e40fa" gracePeriod=30 Dec 04 12:06:43.327341 master-0 kubenswrapper[35367]: I1204 12:06:43.327257 35367 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" oldPodUID="bdd20c68f1ccfd1240fb273af0638d01" podUID="2cb8c983acca0c27a191b3f720d4b1e0" Dec 04 12:06:43.343367 master-0 kubenswrapper[35367]: I1204 12:06:43.342915 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/2cb8c983acca0c27a191b3f720d4b1e0-resource-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"2cb8c983acca0c27a191b3f720d4b1e0\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 12:06:43.343367 master-0 kubenswrapper[35367]: I1204 12:06:43.343006 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/2cb8c983acca0c27a191b3f720d4b1e0-cert-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"2cb8c983acca0c27a191b3f720d4b1e0\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 12:06:43.343367 master-0 kubenswrapper[35367]: I1204 12:06:43.343158 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/2cb8c983acca0c27a191b3f720d4b1e0-cert-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"2cb8c983acca0c27a191b3f720d4b1e0\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 12:06:43.343367 master-0 kubenswrapper[35367]: I1204 12:06:43.343211 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/2cb8c983acca0c27a191b3f720d4b1e0-resource-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"2cb8c983acca0c27a191b3f720d4b1e0\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 12:06:43.412485 master-0 kubenswrapper[35367]: I1204 12:06:43.412435 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_bdd20c68f1ccfd1240fb273af0638d01/kube-scheduler-cert-syncer/2.log" Dec 04 12:06:43.414425 master-0 kubenswrapper[35367]: I1204 12:06:43.414304 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_bdd20c68f1ccfd1240fb273af0638d01/kube-scheduler-cert-syncer/1.log" Dec 04 12:06:43.417723 master-0 kubenswrapper[35367]: I1204 12:06:43.416012 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_bdd20c68f1ccfd1240fb273af0638d01/kube-scheduler/0.log" Dec 04 12:06:43.417723 master-0 kubenswrapper[35367]: I1204 12:06:43.417151 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 12:06:43.434922 master-0 kubenswrapper[35367]: I1204 12:06:43.428507 35367 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" oldPodUID="bdd20c68f1ccfd1240fb273af0638d01" podUID="2cb8c983acca0c27a191b3f720d4b1e0" Dec 04 12:06:43.445177 master-0 kubenswrapper[35367]: I1204 12:06:43.444400 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/bdd20c68f1ccfd1240fb273af0638d01-cert-dir\") pod \"bdd20c68f1ccfd1240fb273af0638d01\" (UID: \"bdd20c68f1ccfd1240fb273af0638d01\") " Dec 04 12:06:43.445177 master-0 kubenswrapper[35367]: I1204 12:06:43.444650 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/bdd20c68f1ccfd1240fb273af0638d01-resource-dir\") pod \"bdd20c68f1ccfd1240fb273af0638d01\" (UID: \"bdd20c68f1ccfd1240fb273af0638d01\") " Dec 04 12:06:43.445177 master-0 kubenswrapper[35367]: I1204 12:06:43.445130 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/bdd20c68f1ccfd1240fb273af0638d01-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "bdd20c68f1ccfd1240fb273af0638d01" (UID: "bdd20c68f1ccfd1240fb273af0638d01"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:06:43.445177 master-0 kubenswrapper[35367]: I1204 12:06:43.445133 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/bdd20c68f1ccfd1240fb273af0638d01-cert-dir" (OuterVolumeSpecName: "cert-dir") pod "bdd20c68f1ccfd1240fb273af0638d01" (UID: "bdd20c68f1ccfd1240fb273af0638d01"). InnerVolumeSpecName "cert-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:06:43.545928 master-0 kubenswrapper[35367]: I1204 12:06:43.545860 35367 reconciler_common.go:293] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/bdd20c68f1ccfd1240fb273af0638d01-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:06:43.545928 master-0 kubenswrapper[35367]: I1204 12:06:43.545915 35367 reconciler_common.go:293] "Volume detached for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/bdd20c68f1ccfd1240fb273af0638d01-cert-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:06:43.832658 master-0 kubenswrapper[35367]: I1204 12:06:43.832560 35367 generic.go:334] "Generic (PLEG): container finished" podID="57c3adf2-e10a-419a-80bf-59cec1bb0a28" containerID="4de9e4c9ad1f8c9ab97c8dcba0f17366eac40ff921ab5fb6cd3feabefa557308" exitCode=0 Dec 04 12:06:43.832658 master-0 kubenswrapper[35367]: I1204 12:06:43.832658 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-5-master-0" event={"ID":"57c3adf2-e10a-419a-80bf-59cec1bb0a28","Type":"ContainerDied","Data":"4de9e4c9ad1f8c9ab97c8dcba0f17366eac40ff921ab5fb6cd3feabefa557308"} Dec 04 12:06:43.834651 master-0 kubenswrapper[35367]: I1204 12:06:43.834613 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_bdd20c68f1ccfd1240fb273af0638d01/kube-scheduler-cert-syncer/2.log" Dec 04 12:06:43.835230 master-0 kubenswrapper[35367]: I1204 12:06:43.835195 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_bdd20c68f1ccfd1240fb273af0638d01/kube-scheduler-cert-syncer/1.log" Dec 04 12:06:43.836837 master-0 kubenswrapper[35367]: I1204 12:06:43.836789 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_bdd20c68f1ccfd1240fb273af0638d01/kube-scheduler/0.log" Dec 04 12:06:43.837495 master-0 kubenswrapper[35367]: I1204 12:06:43.837456 35367 generic.go:334] "Generic (PLEG): container finished" podID="bdd20c68f1ccfd1240fb273af0638d01" containerID="0e3fb5e9fe4481e5a52c8778d150f0c86ce142116f508b1439fac0aa3de5e005" exitCode=2 Dec 04 12:06:43.837542 master-0 kubenswrapper[35367]: I1204 12:06:43.837487 35367 generic.go:334] "Generic (PLEG): container finished" podID="bdd20c68f1ccfd1240fb273af0638d01" containerID="e2713a2b9adf8ac2cd64c11a8cc47639892df9751d3f6828f4bd8b7f6c344a80" exitCode=0 Dec 04 12:06:43.837542 master-0 kubenswrapper[35367]: I1204 12:06:43.837507 35367 generic.go:334] "Generic (PLEG): container finished" podID="bdd20c68f1ccfd1240fb273af0638d01" containerID="1dd3e9bec426604298540a62160aa04995ba35e82eac44c41bf666b47786e5c9" exitCode=0 Dec 04 12:06:43.837607 master-0 kubenswrapper[35367]: I1204 12:06:43.837533 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a1b18048a411d2d744b17951526af70eccaa227a92df3b43814bef05c92e2a1" Dec 04 12:06:43.837607 master-0 kubenswrapper[35367]: I1204 12:06:43.837573 35367 scope.go:117] "RemoveContainer" containerID="9e6711a29e80dd1a67221ee7d3cb99dca0b39d86d535ebc251bf63200ef5ce12" Dec 04 12:06:43.837607 master-0 kubenswrapper[35367]: I1204 12:06:43.837574 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 12:06:43.840512 master-0 kubenswrapper[35367]: I1204 12:06:43.840458 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-w4cqh" event={"ID":"9d9dd887-e9eb-44d9-b34f-ac87681ccf98","Type":"ContainerStarted","Data":"76599d3c7678b3c5ec53305caebf8b3a1975b7ff40ecc7bf753138b6fcb6b6f8"} Dec 04 12:06:43.858314 master-0 kubenswrapper[35367]: I1204 12:06:43.858273 35367 scope.go:117] "RemoveContainer" containerID="e892e4a03cb775cc984461c05f66ebb315e6e3256740bfe4765f9efa5a82a35d" Dec 04 12:06:43.897182 master-0 kubenswrapper[35367]: I1204 12:06:43.893597 35367 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" oldPodUID="bdd20c68f1ccfd1240fb273af0638d01" podUID="2cb8c983acca0c27a191b3f720d4b1e0" Dec 04 12:06:43.936128 master-0 kubenswrapper[35367]: I1204 12:06:43.936023 35367 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" oldPodUID="bdd20c68f1ccfd1240fb273af0638d01" podUID="2cb8c983acca0c27a191b3f720d4b1e0" Dec 04 12:06:43.938321 master-0 kubenswrapper[35367]: I1204 12:06:43.938136 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-w4cqh" podStartSLOduration=4.459907635 podStartE2EDuration="10.938104547s" podCreationTimestamp="2025-12-04 12:06:33 +0000 UTC" firstStartedPulling="2025-12-04 12:06:36.765946064 +0000 UTC m=+440.204007332" lastFinishedPulling="2025-12-04 12:06:43.244142986 +0000 UTC m=+446.682204244" observedRunningTime="2025-12-04 12:06:43.932350716 +0000 UTC m=+447.370411984" watchObservedRunningTime="2025-12-04 12:06:43.938104547 +0000 UTC m=+447.376165805" Dec 04 12:06:44.734615 master-0 kubenswrapper[35367]: I1204 12:06:44.734545 35367 patch_prober.go:28] interesting pod/console-654c77b6c6-kh7ws container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.97:8443/health\": dial tcp 10.128.0.97:8443: connect: connection refused" start-of-body= Dec 04 12:06:44.734874 master-0 kubenswrapper[35367]: I1204 12:06:44.734633 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-654c77b6c6-kh7ws" podUID="ea79af85-e731-449a-a476-2ff8b05f9d80" containerName="console" probeResult="failure" output="Get \"https://10.128.0.97:8443/health\": dial tcp 10.128.0.97:8443: connect: connection refused" Dec 04 12:06:44.755671 master-0 kubenswrapper[35367]: I1204 12:06:44.755621 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdd20c68f1ccfd1240fb273af0638d01" path="/var/lib/kubelet/pods/bdd20c68f1ccfd1240fb273af0638d01/volumes" Dec 04 12:06:44.848840 master-0 kubenswrapper[35367]: I1204 12:06:44.848767 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_bdd20c68f1ccfd1240fb273af0638d01/kube-scheduler-cert-syncer/2.log" Dec 04 12:06:45.112366 master-0 kubenswrapper[35367]: I1204 12:06:45.112306 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-w4cqh" Dec 04 12:06:45.112366 master-0 kubenswrapper[35367]: I1204 12:06:45.112365 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-w4cqh" Dec 04 12:06:45.158202 master-0 kubenswrapper[35367]: I1204 12:06:45.157319 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-w4cqh" Dec 04 12:06:45.192944 master-0 kubenswrapper[35367]: I1204 12:06:45.192896 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 12:06:45.284226 master-0 kubenswrapper[35367]: I1204 12:06:45.283853 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/57c3adf2-e10a-419a-80bf-59cec1bb0a28-kubelet-dir\") pod \"57c3adf2-e10a-419a-80bf-59cec1bb0a28\" (UID: \"57c3adf2-e10a-419a-80bf-59cec1bb0a28\") " Dec 04 12:06:45.284226 master-0 kubenswrapper[35367]: I1204 12:06:45.284001 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/57c3adf2-e10a-419a-80bf-59cec1bb0a28-var-lock\") pod \"57c3adf2-e10a-419a-80bf-59cec1bb0a28\" (UID: \"57c3adf2-e10a-419a-80bf-59cec1bb0a28\") " Dec 04 12:06:45.284226 master-0 kubenswrapper[35367]: I1204 12:06:45.284128 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/57c3adf2-e10a-419a-80bf-59cec1bb0a28-var-lock" (OuterVolumeSpecName: "var-lock") pod "57c3adf2-e10a-419a-80bf-59cec1bb0a28" (UID: "57c3adf2-e10a-419a-80bf-59cec1bb0a28"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:06:45.284226 master-0 kubenswrapper[35367]: I1204 12:06:45.284206 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/57c3adf2-e10a-419a-80bf-59cec1bb0a28-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "57c3adf2-e10a-419a-80bf-59cec1bb0a28" (UID: "57c3adf2-e10a-419a-80bf-59cec1bb0a28"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:06:45.284686 master-0 kubenswrapper[35367]: I1204 12:06:45.284350 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/57c3adf2-e10a-419a-80bf-59cec1bb0a28-kube-api-access\") pod \"57c3adf2-e10a-419a-80bf-59cec1bb0a28\" (UID: \"57c3adf2-e10a-419a-80bf-59cec1bb0a28\") " Dec 04 12:06:45.284738 master-0 kubenswrapper[35367]: I1204 12:06:45.284719 35367 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/57c3adf2-e10a-419a-80bf-59cec1bb0a28-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:06:45.284738 master-0 kubenswrapper[35367]: I1204 12:06:45.284733 35367 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/57c3adf2-e10a-419a-80bf-59cec1bb0a28-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 12:06:45.287609 master-0 kubenswrapper[35367]: I1204 12:06:45.287537 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57c3adf2-e10a-419a-80bf-59cec1bb0a28-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "57c3adf2-e10a-419a-80bf-59cec1bb0a28" (UID: "57c3adf2-e10a-419a-80bf-59cec1bb0a28"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:06:45.393986 master-0 kubenswrapper[35367]: I1204 12:06:45.386934 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/57c3adf2-e10a-419a-80bf-59cec1bb0a28-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 12:06:45.857899 master-0 kubenswrapper[35367]: I1204 12:06:45.857844 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-5-master-0_1925d356-c016-404c-8860-52707bf633be/installer/0.log" Dec 04 12:06:45.857899 master-0 kubenswrapper[35367]: I1204 12:06:45.857900 35367 generic.go:334] "Generic (PLEG): container finished" podID="1925d356-c016-404c-8860-52707bf633be" containerID="c5c1336556cbcb95165f1f102bb4eac819f4ced445d9c55a6a1d6f55ca3e40fa" exitCode=1 Dec 04 12:06:45.858576 master-0 kubenswrapper[35367]: I1204 12:06:45.857961 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-5-master-0" event={"ID":"1925d356-c016-404c-8860-52707bf633be","Type":"ContainerDied","Data":"c5c1336556cbcb95165f1f102bb4eac819f4ced445d9c55a6a1d6f55ca3e40fa"} Dec 04 12:06:45.858576 master-0 kubenswrapper[35367]: I1204 12:06:45.857997 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-5-master-0" event={"ID":"1925d356-c016-404c-8860-52707bf633be","Type":"ContainerDied","Data":"ccb540b6448fe41a1ecc2fce791b9b971e549d400c0e0f028f96d9d0afdefbcb"} Dec 04 12:06:45.858576 master-0 kubenswrapper[35367]: I1204 12:06:45.858010 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ccb540b6448fe41a1ecc2fce791b9b971e549d400c0e0f028f96d9d0afdefbcb" Dec 04 12:06:45.859488 master-0 kubenswrapper[35367]: I1204 12:06:45.859450 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-5-master-0" event={"ID":"57c3adf2-e10a-419a-80bf-59cec1bb0a28","Type":"ContainerDied","Data":"956bcc6030dd3ba364684c4af517e43051d6e34fb847f5da92488d96fdd3ae47"} Dec 04 12:06:45.859532 master-0 kubenswrapper[35367]: I1204 12:06:45.859486 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-5-master-0" Dec 04 12:06:45.859671 master-0 kubenswrapper[35367]: I1204 12:06:45.859489 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="956bcc6030dd3ba364684c4af517e43051d6e34fb847f5da92488d96fdd3ae47" Dec 04 12:06:45.873272 master-0 kubenswrapper[35367]: I1204 12:06:45.873229 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-5-master-0_1925d356-c016-404c-8860-52707bf633be/installer/0.log" Dec 04 12:06:45.873415 master-0 kubenswrapper[35367]: I1204 12:06:45.873316 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 12:06:45.998352 master-0 kubenswrapper[35367]: I1204 12:06:45.998136 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/1925d356-c016-404c-8860-52707bf633be-var-lock\") pod \"1925d356-c016-404c-8860-52707bf633be\" (UID: \"1925d356-c016-404c-8860-52707bf633be\") " Dec 04 12:06:45.998352 master-0 kubenswrapper[35367]: I1204 12:06:45.998245 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1925d356-c016-404c-8860-52707bf633be-kube-api-access\") pod \"1925d356-c016-404c-8860-52707bf633be\" (UID: \"1925d356-c016-404c-8860-52707bf633be\") " Dec 04 12:06:45.998352 master-0 kubenswrapper[35367]: I1204 12:06:45.998285 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1925d356-c016-404c-8860-52707bf633be-kubelet-dir\") pod \"1925d356-c016-404c-8860-52707bf633be\" (UID: \"1925d356-c016-404c-8860-52707bf633be\") " Dec 04 12:06:45.998352 master-0 kubenswrapper[35367]: I1204 12:06:45.998267 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1925d356-c016-404c-8860-52707bf633be-var-lock" (OuterVolumeSpecName: "var-lock") pod "1925d356-c016-404c-8860-52707bf633be" (UID: "1925d356-c016-404c-8860-52707bf633be"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:06:45.998666 master-0 kubenswrapper[35367]: I1204 12:06:45.998522 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1925d356-c016-404c-8860-52707bf633be-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "1925d356-c016-404c-8860-52707bf633be" (UID: "1925d356-c016-404c-8860-52707bf633be"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:06:45.998799 master-0 kubenswrapper[35367]: I1204 12:06:45.998778 35367 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/1925d356-c016-404c-8860-52707bf633be-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 12:06:45.998864 master-0 kubenswrapper[35367]: I1204 12:06:45.998798 35367 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1925d356-c016-404c-8860-52707bf633be-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:06:46.001206 master-0 kubenswrapper[35367]: I1204 12:06:46.001171 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1925d356-c016-404c-8860-52707bf633be-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "1925d356-c016-404c-8860-52707bf633be" (UID: "1925d356-c016-404c-8860-52707bf633be"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:06:46.100323 master-0 kubenswrapper[35367]: I1204 12:06:46.100158 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1925d356-c016-404c-8860-52707bf633be-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 12:06:46.874548 master-0 kubenswrapper[35367]: I1204 12:06:46.874497 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-5-master-0" Dec 04 12:06:46.900243 master-0 kubenswrapper[35367]: I1204 12:06:46.900199 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-apiserver/installer-5-master-0"] Dec 04 12:06:46.908364 master-0 kubenswrapper[35367]: I1204 12:06:46.908284 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-apiserver/installer-5-master-0"] Dec 04 12:06:47.317391 master-0 kubenswrapper[35367]: I1204 12:06:47.317313 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/installer-6-master-0"] Dec 04 12:06:47.317794 master-0 kubenswrapper[35367]: E1204 12:06:47.317679 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1925d356-c016-404c-8860-52707bf633be" containerName="installer" Dec 04 12:06:47.317794 master-0 kubenswrapper[35367]: I1204 12:06:47.317700 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="1925d356-c016-404c-8860-52707bf633be" containerName="installer" Dec 04 12:06:47.317794 master-0 kubenswrapper[35367]: E1204 12:06:47.317747 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="57c3adf2-e10a-419a-80bf-59cec1bb0a28" containerName="installer" Dec 04 12:06:47.317794 master-0 kubenswrapper[35367]: I1204 12:06:47.317757 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c3adf2-e10a-419a-80bf-59cec1bb0a28" containerName="installer" Dec 04 12:06:47.318000 master-0 kubenswrapper[35367]: I1204 12:06:47.317957 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="57c3adf2-e10a-419a-80bf-59cec1bb0a28" containerName="installer" Dec 04 12:06:47.318000 master-0 kubenswrapper[35367]: I1204 12:06:47.317986 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="1925d356-c016-404c-8860-52707bf633be" containerName="installer" Dec 04 12:06:47.318626 master-0 kubenswrapper[35367]: I1204 12:06:47.318603 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-6-master-0" Dec 04 12:06:47.324786 master-0 kubenswrapper[35367]: I1204 12:06:47.324738 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver"/"installer-sa-dockercfg-79r7d" Dec 04 12:06:47.325177 master-0 kubenswrapper[35367]: I1204 12:06:47.325141 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver"/"kube-root-ca.crt" Dec 04 12:06:47.335606 master-0 kubenswrapper[35367]: I1204 12:06:47.335548 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-6-master-0"] Dec 04 12:06:47.436974 master-0 kubenswrapper[35367]: I1204 12:06:47.436907 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/7f04fa4e-8587-43ad-bd31-0d6cb1067e28-var-lock\") pod \"installer-6-master-0\" (UID: \"7f04fa4e-8587-43ad-bd31-0d6cb1067e28\") " pod="openshift-kube-apiserver/installer-6-master-0" Dec 04 12:06:47.437372 master-0 kubenswrapper[35367]: I1204 12:06:47.436995 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/7f04fa4e-8587-43ad-bd31-0d6cb1067e28-kube-api-access\") pod \"installer-6-master-0\" (UID: \"7f04fa4e-8587-43ad-bd31-0d6cb1067e28\") " pod="openshift-kube-apiserver/installer-6-master-0" Dec 04 12:06:47.437372 master-0 kubenswrapper[35367]: I1204 12:06:47.437040 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7f04fa4e-8587-43ad-bd31-0d6cb1067e28-kubelet-dir\") pod \"installer-6-master-0\" (UID: \"7f04fa4e-8587-43ad-bd31-0d6cb1067e28\") " pod="openshift-kube-apiserver/installer-6-master-0" Dec 04 12:06:47.450145 master-0 kubenswrapper[35367]: I1204 12:06:47.450079 35367 patch_prober.go:28] interesting pod/console-6dc95c8d8-klv7m container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.99:8443/health\": dial tcp 10.128.0.99:8443: connect: connection refused" start-of-body= Dec 04 12:06:47.450359 master-0 kubenswrapper[35367]: I1204 12:06:47.450159 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-6dc95c8d8-klv7m" podUID="91498480-8e7a-4ac5-86b3-9ff689a2e0c6" containerName="console" probeResult="failure" output="Get \"https://10.128.0.99:8443/health\": dial tcp 10.128.0.99:8443: connect: connection refused" Dec 04 12:06:47.538760 master-0 kubenswrapper[35367]: I1204 12:06:47.538705 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7f04fa4e-8587-43ad-bd31-0d6cb1067e28-kubelet-dir\") pod \"installer-6-master-0\" (UID: \"7f04fa4e-8587-43ad-bd31-0d6cb1067e28\") " pod="openshift-kube-apiserver/installer-6-master-0" Dec 04 12:06:47.539054 master-0 kubenswrapper[35367]: I1204 12:06:47.539034 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/7f04fa4e-8587-43ad-bd31-0d6cb1067e28-var-lock\") pod \"installer-6-master-0\" (UID: \"7f04fa4e-8587-43ad-bd31-0d6cb1067e28\") " pod="openshift-kube-apiserver/installer-6-master-0" Dec 04 12:06:47.539203 master-0 kubenswrapper[35367]: I1204 12:06:47.539184 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/7f04fa4e-8587-43ad-bd31-0d6cb1067e28-kube-api-access\") pod \"installer-6-master-0\" (UID: \"7f04fa4e-8587-43ad-bd31-0d6cb1067e28\") " pod="openshift-kube-apiserver/installer-6-master-0" Dec 04 12:06:47.539327 master-0 kubenswrapper[35367]: I1204 12:06:47.539091 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/7f04fa4e-8587-43ad-bd31-0d6cb1067e28-var-lock\") pod \"installer-6-master-0\" (UID: \"7f04fa4e-8587-43ad-bd31-0d6cb1067e28\") " pod="openshift-kube-apiserver/installer-6-master-0" Dec 04 12:06:47.539414 master-0 kubenswrapper[35367]: I1204 12:06:47.538841 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7f04fa4e-8587-43ad-bd31-0d6cb1067e28-kubelet-dir\") pod \"installer-6-master-0\" (UID: \"7f04fa4e-8587-43ad-bd31-0d6cb1067e28\") " pod="openshift-kube-apiserver/installer-6-master-0" Dec 04 12:06:47.556337 master-0 kubenswrapper[35367]: I1204 12:06:47.556284 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/7f04fa4e-8587-43ad-bd31-0d6cb1067e28-kube-api-access\") pod \"installer-6-master-0\" (UID: \"7f04fa4e-8587-43ad-bd31-0d6cb1067e28\") " pod="openshift-kube-apiserver/installer-6-master-0" Dec 04 12:06:47.640747 master-0 kubenswrapper[35367]: I1204 12:06:47.640555 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-6-master-0" Dec 04 12:06:48.054974 master-0 kubenswrapper[35367]: I1204 12:06:48.054835 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-6-master-0"] Dec 04 12:06:48.748457 master-0 kubenswrapper[35367]: I1204 12:06:48.747529 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:06:48.757989 master-0 kubenswrapper[35367]: I1204 12:06:48.757931 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1925d356-c016-404c-8860-52707bf633be" path="/var/lib/kubelet/pods/1925d356-c016-404c-8860-52707bf633be/volumes" Dec 04 12:06:48.766038 master-0 kubenswrapper[35367]: I1204 12:06:48.765996 35367 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="d7349f75-09c1-4788-b94f-ca47e852c3a6" Dec 04 12:06:48.766246 master-0 kubenswrapper[35367]: I1204 12:06:48.766231 35367 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="d7349f75-09c1-4788-b94f-ca47e852c3a6" Dec 04 12:06:48.782820 master-0 kubenswrapper[35367]: I1204 12:06:48.782735 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 12:06:48.784015 master-0 kubenswrapper[35367]: I1204 12:06:48.783983 35367 kubelet.go:1914] "Deleted mirror pod because it is outdated" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:06:48.791304 master-0 kubenswrapper[35367]: I1204 12:06:48.791250 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 12:06:48.799905 master-0 kubenswrapper[35367]: I1204 12:06:48.799854 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:06:48.805884 master-0 kubenswrapper[35367]: I1204 12:06:48.805836 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 12:06:48.820661 master-0 kubenswrapper[35367]: W1204 12:06:48.820369 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb44cd0a1c87587350014492d2bc077ab.slice/crio-b9c547db8f3d1775c2293200cf9fba0697a05da3135db2e09fd4d6b2f71a4b96 WatchSource:0}: Error finding container b9c547db8f3d1775c2293200cf9fba0697a05da3135db2e09fd4d6b2f71a4b96: Status 404 returned error can't find the container with id b9c547db8f3d1775c2293200cf9fba0697a05da3135db2e09fd4d6b2f71a4b96 Dec 04 12:06:48.892004 master-0 kubenswrapper[35367]: I1204 12:06:48.890937 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-6-master-0" event={"ID":"7f04fa4e-8587-43ad-bd31-0d6cb1067e28","Type":"ContainerStarted","Data":"585bacb93e60f35eb92174eb88dcdb336737d4b379c222dafd525594c9b15a74"} Dec 04 12:06:48.892004 master-0 kubenswrapper[35367]: I1204 12:06:48.891413 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-6-master-0" event={"ID":"7f04fa4e-8587-43ad-bd31-0d6cb1067e28","Type":"ContainerStarted","Data":"a63bef7747da289ea93851f26af934981dff18c1b2a517c8c63ca7c5ec064ecc"} Dec 04 12:06:48.892961 master-0 kubenswrapper[35367]: I1204 12:06:48.892905 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"b44cd0a1c87587350014492d2bc077ab","Type":"ContainerStarted","Data":"b9c547db8f3d1775c2293200cf9fba0697a05da3135db2e09fd4d6b2f71a4b96"} Dec 04 12:06:48.917834 master-0 kubenswrapper[35367]: I1204 12:06:48.914102 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/installer-6-master-0" podStartSLOduration=1.914080832 podStartE2EDuration="1.914080832s" podCreationTimestamp="2025-12-04 12:06:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:06:48.911584874 +0000 UTC m=+452.349646132" watchObservedRunningTime="2025-12-04 12:06:48.914080832 +0000 UTC m=+452.352142090" Dec 04 12:06:49.911448 master-0 kubenswrapper[35367]: I1204 12:06:49.910503 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"b44cd0a1c87587350014492d2bc077ab","Type":"ContainerStarted","Data":"87cce827effecd0ad9bf56376fa0e0297a57ac12320d9c37847065d59e9f1dcb"} Dec 04 12:06:49.911448 master-0 kubenswrapper[35367]: I1204 12:06:49.910570 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"b44cd0a1c87587350014492d2bc077ab","Type":"ContainerStarted","Data":"7f675575cba3c965d1f9b34083dc70d57869771c4340830fd96ff7e46be44567"} Dec 04 12:06:49.911448 master-0 kubenswrapper[35367]: I1204 12:06:49.910586 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"b44cd0a1c87587350014492d2bc077ab","Type":"ContainerStarted","Data":"49ef9434da945c3e39895526d46f11bec0f9c0ac87b5d0b5182c9471dfcd33bb"} Dec 04 12:06:50.925828 master-0 kubenswrapper[35367]: I1204 12:06:50.925654 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"b44cd0a1c87587350014492d2bc077ab","Type":"ContainerStarted","Data":"ae936500a2ecbcb16991b68e1fb2a6d81ea108368e7c98a8d24a4e0249d4b678"} Dec 04 12:06:50.947963 master-0 kubenswrapper[35367]: I1204 12:06:50.947846 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podStartSLOduration=2.947829771 podStartE2EDuration="2.947829771s" podCreationTimestamp="2025-12-04 12:06:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:06:50.947325465 +0000 UTC m=+454.385386743" watchObservedRunningTime="2025-12-04 12:06:50.947829771 +0000 UTC m=+454.385891029" Dec 04 12:06:54.735235 master-0 kubenswrapper[35367]: I1204 12:06:54.735158 35367 patch_prober.go:28] interesting pod/console-654c77b6c6-kh7ws container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.97:8443/health\": dial tcp 10.128.0.97:8443: connect: connection refused" start-of-body= Dec 04 12:06:54.735961 master-0 kubenswrapper[35367]: I1204 12:06:54.735247 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-654c77b6c6-kh7ws" podUID="ea79af85-e731-449a-a476-2ff8b05f9d80" containerName="console" probeResult="failure" output="Get \"https://10.128.0.97:8443/health\": dial tcp 10.128.0.97:8443: connect: connection refused" Dec 04 12:06:55.152729 master-0 kubenswrapper[35367]: I1204 12:06:55.152668 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-w4cqh" Dec 04 12:06:55.203526 master-0 kubenswrapper[35367]: I1204 12:06:55.203443 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-w4cqh"] Dec 04 12:06:55.958281 master-0 kubenswrapper[35367]: I1204 12:06:55.958170 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-w4cqh" podUID="9d9dd887-e9eb-44d9-b34f-ac87681ccf98" containerName="registry-server" containerID="cri-o://76599d3c7678b3c5ec53305caebf8b3a1975b7ff40ecc7bf753138b6fcb6b6f8" gracePeriod=2 Dec 04 12:06:56.414168 master-0 kubenswrapper[35367]: I1204 12:06:56.413342 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-w4cqh" Dec 04 12:06:56.485597 master-0 kubenswrapper[35367]: I1204 12:06:56.485534 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9d9dd887-e9eb-44d9-b34f-ac87681ccf98-catalog-content\") pod \"9d9dd887-e9eb-44d9-b34f-ac87681ccf98\" (UID: \"9d9dd887-e9eb-44d9-b34f-ac87681ccf98\") " Dec 04 12:06:56.485597 master-0 kubenswrapper[35367]: I1204 12:06:56.485612 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4pq8\" (UniqueName: \"kubernetes.io/projected/9d9dd887-e9eb-44d9-b34f-ac87681ccf98-kube-api-access-q4pq8\") pod \"9d9dd887-e9eb-44d9-b34f-ac87681ccf98\" (UID: \"9d9dd887-e9eb-44d9-b34f-ac87681ccf98\") " Dec 04 12:06:56.485890 master-0 kubenswrapper[35367]: I1204 12:06:56.485754 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9d9dd887-e9eb-44d9-b34f-ac87681ccf98-utilities\") pod \"9d9dd887-e9eb-44d9-b34f-ac87681ccf98\" (UID: \"9d9dd887-e9eb-44d9-b34f-ac87681ccf98\") " Dec 04 12:06:56.487624 master-0 kubenswrapper[35367]: I1204 12:06:56.486852 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d9dd887-e9eb-44d9-b34f-ac87681ccf98-utilities" (OuterVolumeSpecName: "utilities") pod "9d9dd887-e9eb-44d9-b34f-ac87681ccf98" (UID: "9d9dd887-e9eb-44d9-b34f-ac87681ccf98"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:06:56.489692 master-0 kubenswrapper[35367]: I1204 12:06:56.489647 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d9dd887-e9eb-44d9-b34f-ac87681ccf98-kube-api-access-q4pq8" (OuterVolumeSpecName: "kube-api-access-q4pq8") pod "9d9dd887-e9eb-44d9-b34f-ac87681ccf98" (UID: "9d9dd887-e9eb-44d9-b34f-ac87681ccf98"). InnerVolumeSpecName "kube-api-access-q4pq8". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:06:56.544211 master-0 kubenswrapper[35367]: I1204 12:06:56.544100 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d9dd887-e9eb-44d9-b34f-ac87681ccf98-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "9d9dd887-e9eb-44d9-b34f-ac87681ccf98" (UID: "9d9dd887-e9eb-44d9-b34f-ac87681ccf98"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:06:56.587691 master-0 kubenswrapper[35367]: I1204 12:06:56.587598 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9d9dd887-e9eb-44d9-b34f-ac87681ccf98-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:06:56.587691 master-0 kubenswrapper[35367]: I1204 12:06:56.587652 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9d9dd887-e9eb-44d9-b34f-ac87681ccf98-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:06:56.587691 master-0 kubenswrapper[35367]: I1204 12:06:56.587664 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q4pq8\" (UniqueName: \"kubernetes.io/projected/9d9dd887-e9eb-44d9-b34f-ac87681ccf98-kube-api-access-q4pq8\") on node \"master-0\" DevicePath \"\"" Dec 04 12:06:56.747896 master-0 kubenswrapper[35367]: I1204 12:06:56.747705 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 12:06:56.785093 master-0 kubenswrapper[35367]: I1204 12:06:56.785038 35367 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" podUID="b1f518f0-9b56-41aa-b487-3cfaeff48585" Dec 04 12:06:56.785407 master-0 kubenswrapper[35367]: I1204 12:06:56.785393 35367 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" podUID="b1f518f0-9b56-41aa-b487-3cfaeff48585" Dec 04 12:06:56.813305 master-0 kubenswrapper[35367]: I1204 12:06:56.813246 35367 kubelet.go:1914] "Deleted mirror pod because it is outdated" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 12:06:56.817548 master-0 kubenswrapper[35367]: I1204 12:06:56.817499 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-scheduler/openshift-kube-scheduler-master-0"] Dec 04 12:06:56.823773 master-0 kubenswrapper[35367]: I1204 12:06:56.823718 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-scheduler/openshift-kube-scheduler-master-0"] Dec 04 12:06:56.827237 master-0 kubenswrapper[35367]: I1204 12:06:56.827189 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 12:06:56.831987 master-0 kubenswrapper[35367]: I1204 12:06:56.831919 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler/openshift-kube-scheduler-master-0"] Dec 04 12:06:56.973070 master-0 kubenswrapper[35367]: I1204 12:06:56.973016 35367 generic.go:334] "Generic (PLEG): container finished" podID="9d9dd887-e9eb-44d9-b34f-ac87681ccf98" containerID="76599d3c7678b3c5ec53305caebf8b3a1975b7ff40ecc7bf753138b6fcb6b6f8" exitCode=0 Dec 04 12:06:56.973585 master-0 kubenswrapper[35367]: I1204 12:06:56.973125 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-w4cqh" event={"ID":"9d9dd887-e9eb-44d9-b34f-ac87681ccf98","Type":"ContainerDied","Data":"76599d3c7678b3c5ec53305caebf8b3a1975b7ff40ecc7bf753138b6fcb6b6f8"} Dec 04 12:06:56.973585 master-0 kubenswrapper[35367]: I1204 12:06:56.973170 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-w4cqh" event={"ID":"9d9dd887-e9eb-44d9-b34f-ac87681ccf98","Type":"ContainerDied","Data":"15b990de9351fdb896d98a81a2f77e91b0de93f225cfce60f7d20c6ebc04107c"} Dec 04 12:06:56.973585 master-0 kubenswrapper[35367]: I1204 12:06:56.973160 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-w4cqh" Dec 04 12:06:56.973585 master-0 kubenswrapper[35367]: I1204 12:06:56.973190 35367 scope.go:117] "RemoveContainer" containerID="76599d3c7678b3c5ec53305caebf8b3a1975b7ff40ecc7bf753138b6fcb6b6f8" Dec 04 12:06:56.976889 master-0 kubenswrapper[35367]: I1204 12:06:56.976839 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"2cb8c983acca0c27a191b3f720d4b1e0","Type":"ContainerStarted","Data":"adceaaa6262b46c35f92ff49d2375e6fa872222b1b693e441457c7434304abb4"} Dec 04 12:06:57.006041 master-0 kubenswrapper[35367]: I1204 12:06:57.005987 35367 scope.go:117] "RemoveContainer" containerID="1329a8ee84a4f9feea9bb041c302a67a19fc1f3a8cf945238571cde53ed64941" Dec 04 12:06:57.029027 master-0 kubenswrapper[35367]: I1204 12:06:57.028930 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-w4cqh"] Dec 04 12:06:57.035700 master-0 kubenswrapper[35367]: I1204 12:06:57.035629 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-w4cqh"] Dec 04 12:06:57.052925 master-0 kubenswrapper[35367]: I1204 12:06:57.052861 35367 scope.go:117] "RemoveContainer" containerID="6368e11429db20b7669fb0af0dc17ff66e76bf8de35364611625fa82c5a1f4dc" Dec 04 12:06:57.084850 master-0 kubenswrapper[35367]: I1204 12:06:57.084723 35367 scope.go:117] "RemoveContainer" containerID="76599d3c7678b3c5ec53305caebf8b3a1975b7ff40ecc7bf753138b6fcb6b6f8" Dec 04 12:06:57.087298 master-0 kubenswrapper[35367]: E1204 12:06:57.087245 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76599d3c7678b3c5ec53305caebf8b3a1975b7ff40ecc7bf753138b6fcb6b6f8\": container with ID starting with 76599d3c7678b3c5ec53305caebf8b3a1975b7ff40ecc7bf753138b6fcb6b6f8 not found: ID does not exist" containerID="76599d3c7678b3c5ec53305caebf8b3a1975b7ff40ecc7bf753138b6fcb6b6f8" Dec 04 12:06:57.087475 master-0 kubenswrapper[35367]: I1204 12:06:57.087315 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76599d3c7678b3c5ec53305caebf8b3a1975b7ff40ecc7bf753138b6fcb6b6f8"} err="failed to get container status \"76599d3c7678b3c5ec53305caebf8b3a1975b7ff40ecc7bf753138b6fcb6b6f8\": rpc error: code = NotFound desc = could not find container \"76599d3c7678b3c5ec53305caebf8b3a1975b7ff40ecc7bf753138b6fcb6b6f8\": container with ID starting with 76599d3c7678b3c5ec53305caebf8b3a1975b7ff40ecc7bf753138b6fcb6b6f8 not found: ID does not exist" Dec 04 12:06:57.087475 master-0 kubenswrapper[35367]: I1204 12:06:57.087347 35367 scope.go:117] "RemoveContainer" containerID="1329a8ee84a4f9feea9bb041c302a67a19fc1f3a8cf945238571cde53ed64941" Dec 04 12:06:57.088408 master-0 kubenswrapper[35367]: E1204 12:06:57.088340 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1329a8ee84a4f9feea9bb041c302a67a19fc1f3a8cf945238571cde53ed64941\": container with ID starting with 1329a8ee84a4f9feea9bb041c302a67a19fc1f3a8cf945238571cde53ed64941 not found: ID does not exist" containerID="1329a8ee84a4f9feea9bb041c302a67a19fc1f3a8cf945238571cde53ed64941" Dec 04 12:06:57.088566 master-0 kubenswrapper[35367]: I1204 12:06:57.088412 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1329a8ee84a4f9feea9bb041c302a67a19fc1f3a8cf945238571cde53ed64941"} err="failed to get container status \"1329a8ee84a4f9feea9bb041c302a67a19fc1f3a8cf945238571cde53ed64941\": rpc error: code = NotFound desc = could not find container \"1329a8ee84a4f9feea9bb041c302a67a19fc1f3a8cf945238571cde53ed64941\": container with ID starting with 1329a8ee84a4f9feea9bb041c302a67a19fc1f3a8cf945238571cde53ed64941 not found: ID does not exist" Dec 04 12:06:57.088566 master-0 kubenswrapper[35367]: I1204 12:06:57.088451 35367 scope.go:117] "RemoveContainer" containerID="6368e11429db20b7669fb0af0dc17ff66e76bf8de35364611625fa82c5a1f4dc" Dec 04 12:06:57.089035 master-0 kubenswrapper[35367]: E1204 12:06:57.088976 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6368e11429db20b7669fb0af0dc17ff66e76bf8de35364611625fa82c5a1f4dc\": container with ID starting with 6368e11429db20b7669fb0af0dc17ff66e76bf8de35364611625fa82c5a1f4dc not found: ID does not exist" containerID="6368e11429db20b7669fb0af0dc17ff66e76bf8de35364611625fa82c5a1f4dc" Dec 04 12:06:57.089093 master-0 kubenswrapper[35367]: I1204 12:06:57.089038 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6368e11429db20b7669fb0af0dc17ff66e76bf8de35364611625fa82c5a1f4dc"} err="failed to get container status \"6368e11429db20b7669fb0af0dc17ff66e76bf8de35364611625fa82c5a1f4dc\": rpc error: code = NotFound desc = could not find container \"6368e11429db20b7669fb0af0dc17ff66e76bf8de35364611625fa82c5a1f4dc\": container with ID starting with 6368e11429db20b7669fb0af0dc17ff66e76bf8de35364611625fa82c5a1f4dc not found: ID does not exist" Dec 04 12:06:57.449914 master-0 kubenswrapper[35367]: I1204 12:06:57.449830 35367 patch_prober.go:28] interesting pod/console-6dc95c8d8-klv7m container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.99:8443/health\": dial tcp 10.128.0.99:8443: connect: connection refused" start-of-body= Dec 04 12:06:57.449914 master-0 kubenswrapper[35367]: I1204 12:06:57.449906 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-6dc95c8d8-klv7m" podUID="91498480-8e7a-4ac5-86b3-9ff689a2e0c6" containerName="console" probeResult="failure" output="Get \"https://10.128.0.99:8443/health\": dial tcp 10.128.0.99:8443: connect: connection refused" Dec 04 12:06:57.987302 master-0 kubenswrapper[35367]: I1204 12:06:57.987243 35367 generic.go:334] "Generic (PLEG): container finished" podID="2cb8c983acca0c27a191b3f720d4b1e0" containerID="e91bf472fdaad5a1392a12c30a0c87c31de3b7effff58a68d9c2a33e4fe7cb25" exitCode=0 Dec 04 12:06:57.988575 master-0 kubenswrapper[35367]: I1204 12:06:57.988519 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"2cb8c983acca0c27a191b3f720d4b1e0","Type":"ContainerDied","Data":"e91bf472fdaad5a1392a12c30a0c87c31de3b7effff58a68d9c2a33e4fe7cb25"} Dec 04 12:06:58.759012 master-0 kubenswrapper[35367]: I1204 12:06:58.758865 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d9dd887-e9eb-44d9-b34f-ac87681ccf98" path="/var/lib/kubelet/pods/9d9dd887-e9eb-44d9-b34f-ac87681ccf98/volumes" Dec 04 12:06:58.801028 master-0 kubenswrapper[35367]: I1204 12:06:58.800946 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:06:58.801306 master-0 kubenswrapper[35367]: I1204 12:06:58.801075 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:06:58.801306 master-0 kubenswrapper[35367]: I1204 12:06:58.801199 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:06:58.801585 master-0 kubenswrapper[35367]: I1204 12:06:58.801559 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:06:58.805709 master-0 kubenswrapper[35367]: I1204 12:06:58.805650 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:06:58.807313 master-0 kubenswrapper[35367]: I1204 12:06:58.807238 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:06:59.010716 master-0 kubenswrapper[35367]: I1204 12:06:59.010571 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"2cb8c983acca0c27a191b3f720d4b1e0","Type":"ContainerStarted","Data":"1b303f7d9d38502e32591c7f33a167196adc75aa6d643d4a4536ff73eda5d1f9"} Dec 04 12:06:59.010716 master-0 kubenswrapper[35367]: I1204 12:06:59.010653 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"2cb8c983acca0c27a191b3f720d4b1e0","Type":"ContainerStarted","Data":"b5aba1c47dc98cecc25bf14fb1340e9bc551fc81844a57aef4e80639a931e57f"} Dec 04 12:06:59.017238 master-0 kubenswrapper[35367]: I1204 12:06:59.017135 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:06:59.018435 master-0 kubenswrapper[35367]: I1204 12:06:59.018381 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:06:59.131610 master-0 kubenswrapper[35367]: I1204 12:06:59.131533 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-tnlxw"] Dec 04 12:06:59.131911 master-0 kubenswrapper[35367]: E1204 12:06:59.131856 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9d9dd887-e9eb-44d9-b34f-ac87681ccf98" containerName="registry-server" Dec 04 12:06:59.131911 master-0 kubenswrapper[35367]: I1204 12:06:59.131869 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9dd887-e9eb-44d9-b34f-ac87681ccf98" containerName="registry-server" Dec 04 12:06:59.131911 master-0 kubenswrapper[35367]: E1204 12:06:59.131905 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9d9dd887-e9eb-44d9-b34f-ac87681ccf98" containerName="extract-content" Dec 04 12:06:59.131911 master-0 kubenswrapper[35367]: I1204 12:06:59.131911 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9dd887-e9eb-44d9-b34f-ac87681ccf98" containerName="extract-content" Dec 04 12:06:59.132087 master-0 kubenswrapper[35367]: E1204 12:06:59.131926 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9d9dd887-e9eb-44d9-b34f-ac87681ccf98" containerName="extract-utilities" Dec 04 12:06:59.132087 master-0 kubenswrapper[35367]: I1204 12:06:59.131934 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9dd887-e9eb-44d9-b34f-ac87681ccf98" containerName="extract-utilities" Dec 04 12:06:59.132087 master-0 kubenswrapper[35367]: I1204 12:06:59.132052 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="9d9dd887-e9eb-44d9-b34f-ac87681ccf98" containerName="registry-server" Dec 04 12:06:59.133050 master-0 kubenswrapper[35367]: I1204 12:06:59.133016 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-tnlxw" Dec 04 12:06:59.152975 master-0 kubenswrapper[35367]: I1204 12:06:59.152869 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-tnlxw"] Dec 04 12:06:59.230528 master-0 kubenswrapper[35367]: I1204 12:06:59.230456 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/38307089-8577-4193-b461-4ebb13fd7d95-utilities\") pod \"community-operators-tnlxw\" (UID: \"38307089-8577-4193-b461-4ebb13fd7d95\") " pod="openshift-marketplace/community-operators-tnlxw" Dec 04 12:06:59.230624 master-0 kubenswrapper[35367]: I1204 12:06:59.230528 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/38307089-8577-4193-b461-4ebb13fd7d95-catalog-content\") pod \"community-operators-tnlxw\" (UID: \"38307089-8577-4193-b461-4ebb13fd7d95\") " pod="openshift-marketplace/community-operators-tnlxw" Dec 04 12:06:59.230624 master-0 kubenswrapper[35367]: I1204 12:06:59.230595 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mdnd\" (UniqueName: \"kubernetes.io/projected/38307089-8577-4193-b461-4ebb13fd7d95-kube-api-access-8mdnd\") pod \"community-operators-tnlxw\" (UID: \"38307089-8577-4193-b461-4ebb13fd7d95\") " pod="openshift-marketplace/community-operators-tnlxw" Dec 04 12:06:59.332576 master-0 kubenswrapper[35367]: I1204 12:06:59.332463 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8mdnd\" (UniqueName: \"kubernetes.io/projected/38307089-8577-4193-b461-4ebb13fd7d95-kube-api-access-8mdnd\") pod \"community-operators-tnlxw\" (UID: \"38307089-8577-4193-b461-4ebb13fd7d95\") " pod="openshift-marketplace/community-operators-tnlxw" Dec 04 12:06:59.332576 master-0 kubenswrapper[35367]: I1204 12:06:59.332583 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/38307089-8577-4193-b461-4ebb13fd7d95-utilities\") pod \"community-operators-tnlxw\" (UID: \"38307089-8577-4193-b461-4ebb13fd7d95\") " pod="openshift-marketplace/community-operators-tnlxw" Dec 04 12:06:59.332576 master-0 kubenswrapper[35367]: I1204 12:06:59.332604 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/38307089-8577-4193-b461-4ebb13fd7d95-catalog-content\") pod \"community-operators-tnlxw\" (UID: \"38307089-8577-4193-b461-4ebb13fd7d95\") " pod="openshift-marketplace/community-operators-tnlxw" Dec 04 12:06:59.333917 master-0 kubenswrapper[35367]: I1204 12:06:59.333863 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/38307089-8577-4193-b461-4ebb13fd7d95-utilities\") pod \"community-operators-tnlxw\" (UID: \"38307089-8577-4193-b461-4ebb13fd7d95\") " pod="openshift-marketplace/community-operators-tnlxw" Dec 04 12:06:59.334034 master-0 kubenswrapper[35367]: I1204 12:06:59.333863 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/38307089-8577-4193-b461-4ebb13fd7d95-catalog-content\") pod \"community-operators-tnlxw\" (UID: \"38307089-8577-4193-b461-4ebb13fd7d95\") " pod="openshift-marketplace/community-operators-tnlxw" Dec 04 12:06:59.351377 master-0 kubenswrapper[35367]: I1204 12:06:59.351276 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mdnd\" (UniqueName: \"kubernetes.io/projected/38307089-8577-4193-b461-4ebb13fd7d95-kube-api-access-8mdnd\") pod \"community-operators-tnlxw\" (UID: \"38307089-8577-4193-b461-4ebb13fd7d95\") " pod="openshift-marketplace/community-operators-tnlxw" Dec 04 12:06:59.466280 master-0 kubenswrapper[35367]: I1204 12:06:59.466222 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-tnlxw" Dec 04 12:06:59.892511 master-0 kubenswrapper[35367]: I1204 12:06:59.892373 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-tnlxw"] Dec 04 12:07:00.020466 master-0 kubenswrapper[35367]: I1204 12:07:00.020384 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-tnlxw" event={"ID":"38307089-8577-4193-b461-4ebb13fd7d95","Type":"ContainerStarted","Data":"53765bf5ef375a97c7d89746ff5ac949e2994758c10157cbcad9dcdbe717748c"} Dec 04 12:07:00.022742 master-0 kubenswrapper[35367]: I1204 12:07:00.022676 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"2cb8c983acca0c27a191b3f720d4b1e0","Type":"ContainerStarted","Data":"2454e77509dc6e46a53e26b638248cc102791dcf3e63a3d255d309bb5ac8524c"} Dec 04 12:07:00.023033 master-0 kubenswrapper[35367]: I1204 12:07:00.023004 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 12:07:00.053349 master-0 kubenswrapper[35367]: I1204 12:07:00.053192 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" podStartSLOduration=4.053161859 podStartE2EDuration="4.053161859s" podCreationTimestamp="2025-12-04 12:06:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:07:00.047446209 +0000 UTC m=+463.485507487" watchObservedRunningTime="2025-12-04 12:07:00.053161859 +0000 UTC m=+463.491223117" Dec 04 12:07:01.037318 master-0 kubenswrapper[35367]: I1204 12:07:01.037257 35367 generic.go:334] "Generic (PLEG): container finished" podID="38307089-8577-4193-b461-4ebb13fd7d95" containerID="74c289df40e104efa62f1178e78b085885edaa95b08a947f24eb46e2207819ef" exitCode=0 Dec 04 12:07:01.038036 master-0 kubenswrapper[35367]: I1204 12:07:01.038000 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-tnlxw" event={"ID":"38307089-8577-4193-b461-4ebb13fd7d95","Type":"ContainerDied","Data":"74c289df40e104efa62f1178e78b085885edaa95b08a947f24eb46e2207819ef"} Dec 04 12:07:01.786926 master-0 kubenswrapper[35367]: I1204 12:07:01.786854 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" podUID="005c4859-1367-4bdf-96c7-1a1319099b9d" containerName="oauth-openshift" containerID="cri-o://ca08ffac691ae248342c1dcb4945471bcfb6930e1198922f94ec7be78cd84360" gracePeriod=15 Dec 04 12:07:02.048146 master-0 kubenswrapper[35367]: I1204 12:07:02.048052 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-tnlxw" event={"ID":"38307089-8577-4193-b461-4ebb13fd7d95","Type":"ContainerStarted","Data":"b35de08ed21af77e058c43d185ac3318dd6c20f1bbb40d3e4a65afbc80cbdab9"} Dec 04 12:07:02.050895 master-0 kubenswrapper[35367]: I1204 12:07:02.050826 35367 generic.go:334] "Generic (PLEG): container finished" podID="005c4859-1367-4bdf-96c7-1a1319099b9d" containerID="ca08ffac691ae248342c1dcb4945471bcfb6930e1198922f94ec7be78cd84360" exitCode=0 Dec 04 12:07:02.051179 master-0 kubenswrapper[35367]: I1204 12:07:02.050893 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" event={"ID":"005c4859-1367-4bdf-96c7-1a1319099b9d","Type":"ContainerDied","Data":"ca08ffac691ae248342c1dcb4945471bcfb6930e1198922f94ec7be78cd84360"} Dec 04 12:07:02.297681 master-0 kubenswrapper[35367]: I1204 12:07:02.297614 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:07:02.379909 master-0 kubenswrapper[35367]: I1204 12:07:02.379259 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-user-template-provider-selection\") pod \"005c4859-1367-4bdf-96c7-1a1319099b9d\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " Dec 04 12:07:02.380179 master-0 kubenswrapper[35367]: I1204 12:07:02.380064 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-service-ca\") pod \"005c4859-1367-4bdf-96c7-1a1319099b9d\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " Dec 04 12:07:02.380179 master-0 kubenswrapper[35367]: I1204 12:07:02.380147 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-user-template-error\") pod \"005c4859-1367-4bdf-96c7-1a1319099b9d\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " Dec 04 12:07:02.380279 master-0 kubenswrapper[35367]: I1204 12:07:02.380236 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-user-template-login\") pod \"005c4859-1367-4bdf-96c7-1a1319099b9d\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " Dec 04 12:07:02.380384 master-0 kubenswrapper[35367]: I1204 12:07:02.380336 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-router-certs\") pod \"005c4859-1367-4bdf-96c7-1a1319099b9d\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " Dec 04 12:07:02.380444 master-0 kubenswrapper[35367]: I1204 12:07:02.380405 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-trusted-ca-bundle\") pod \"005c4859-1367-4bdf-96c7-1a1319099b9d\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " Dec 04 12:07:02.380493 master-0 kubenswrapper[35367]: I1204 12:07:02.380444 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-audit-policies\") pod \"005c4859-1367-4bdf-96c7-1a1319099b9d\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " Dec 04 12:07:02.380534 master-0 kubenswrapper[35367]: I1204 12:07:02.380491 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-serving-cert\") pod \"005c4859-1367-4bdf-96c7-1a1319099b9d\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " Dec 04 12:07:02.380661 master-0 kubenswrapper[35367]: I1204 12:07:02.380622 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-ocp-branding-template\") pod \"005c4859-1367-4bdf-96c7-1a1319099b9d\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " Dec 04 12:07:02.380755 master-0 kubenswrapper[35367]: I1204 12:07:02.380734 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-session\") pod \"005c4859-1367-4bdf-96c7-1a1319099b9d\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " Dec 04 12:07:02.381339 master-0 kubenswrapper[35367]: I1204 12:07:02.381296 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-trusted-ca-bundle" (OuterVolumeSpecName: "v4-0-config-system-trusted-ca-bundle") pod "005c4859-1367-4bdf-96c7-1a1319099b9d" (UID: "005c4859-1367-4bdf-96c7-1a1319099b9d"). InnerVolumeSpecName "v4-0-config-system-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:07:02.381415 master-0 kubenswrapper[35367]: I1204 12:07:02.381316 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-service-ca" (OuterVolumeSpecName: "v4-0-config-system-service-ca") pod "005c4859-1367-4bdf-96c7-1a1319099b9d" (UID: "005c4859-1367-4bdf-96c7-1a1319099b9d"). InnerVolumeSpecName "v4-0-config-system-service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:07:02.381485 master-0 kubenswrapper[35367]: I1204 12:07:02.381457 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-cliconfig\") pod \"005c4859-1367-4bdf-96c7-1a1319099b9d\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " Dec 04 12:07:02.381572 master-0 kubenswrapper[35367]: I1204 12:07:02.381547 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm8w2\" (UniqueName: \"kubernetes.io/projected/005c4859-1367-4bdf-96c7-1a1319099b9d-kube-api-access-zm8w2\") pod \"005c4859-1367-4bdf-96c7-1a1319099b9d\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " Dec 04 12:07:02.381629 master-0 kubenswrapper[35367]: I1204 12:07:02.381615 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/005c4859-1367-4bdf-96c7-1a1319099b9d-audit-dir\") pod \"005c4859-1367-4bdf-96c7-1a1319099b9d\" (UID: \"005c4859-1367-4bdf-96c7-1a1319099b9d\") " Dec 04 12:07:02.382014 master-0 kubenswrapper[35367]: I1204 12:07:02.381975 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/005c4859-1367-4bdf-96c7-1a1319099b9d-audit-dir" (OuterVolumeSpecName: "audit-dir") pod "005c4859-1367-4bdf-96c7-1a1319099b9d" (UID: "005c4859-1367-4bdf-96c7-1a1319099b9d"). InnerVolumeSpecName "audit-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:07:02.382198 master-0 kubenswrapper[35367]: I1204 12:07:02.382168 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-cliconfig" (OuterVolumeSpecName: "v4-0-config-system-cliconfig") pod "005c4859-1367-4bdf-96c7-1a1319099b9d" (UID: "005c4859-1367-4bdf-96c7-1a1319099b9d"). InnerVolumeSpecName "v4-0-config-system-cliconfig". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:07:02.382343 master-0 kubenswrapper[35367]: I1204 12:07:02.382296 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-audit-policies" (OuterVolumeSpecName: "audit-policies") pod "005c4859-1367-4bdf-96c7-1a1319099b9d" (UID: "005c4859-1367-4bdf-96c7-1a1319099b9d"). InnerVolumeSpecName "audit-policies". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:07:02.382588 master-0 kubenswrapper[35367]: I1204 12:07:02.382560 35367 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-service-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:02.382653 master-0 kubenswrapper[35367]: I1204 12:07:02.382616 35367 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:02.382653 master-0 kubenswrapper[35367]: I1204 12:07:02.382635 35367 reconciler_common.go:293] "Volume detached for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-audit-policies\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:02.382823 master-0 kubenswrapper[35367]: I1204 12:07:02.382651 35367 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-cliconfig\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:02.382823 master-0 kubenswrapper[35367]: I1204 12:07:02.382692 35367 reconciler_common.go:293] "Volume detached for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/005c4859-1367-4bdf-96c7-1a1319099b9d-audit-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:02.384865 master-0 kubenswrapper[35367]: I1204 12:07:02.384419 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-ocp-branding-template" (OuterVolumeSpecName: "v4-0-config-system-ocp-branding-template") pod "005c4859-1367-4bdf-96c7-1a1319099b9d" (UID: "005c4859-1367-4bdf-96c7-1a1319099b9d"). InnerVolumeSpecName "v4-0-config-system-ocp-branding-template". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:07:02.385768 master-0 kubenswrapper[35367]: I1204 12:07:02.385692 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-router-certs" (OuterVolumeSpecName: "v4-0-config-system-router-certs") pod "005c4859-1367-4bdf-96c7-1a1319099b9d" (UID: "005c4859-1367-4bdf-96c7-1a1319099b9d"). InnerVolumeSpecName "v4-0-config-system-router-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:07:02.385874 master-0 kubenswrapper[35367]: I1204 12:07:02.385755 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-user-template-error" (OuterVolumeSpecName: "v4-0-config-user-template-error") pod "005c4859-1367-4bdf-96c7-1a1319099b9d" (UID: "005c4859-1367-4bdf-96c7-1a1319099b9d"). InnerVolumeSpecName "v4-0-config-user-template-error". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:07:02.386286 master-0 kubenswrapper[35367]: I1204 12:07:02.386223 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/005c4859-1367-4bdf-96c7-1a1319099b9d-kube-api-access-zm8w2" (OuterVolumeSpecName: "kube-api-access-zm8w2") pod "005c4859-1367-4bdf-96c7-1a1319099b9d" (UID: "005c4859-1367-4bdf-96c7-1a1319099b9d"). InnerVolumeSpecName "kube-api-access-zm8w2". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:07:02.386487 master-0 kubenswrapper[35367]: I1204 12:07:02.386403 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-user-template-login" (OuterVolumeSpecName: "v4-0-config-user-template-login") pod "005c4859-1367-4bdf-96c7-1a1319099b9d" (UID: "005c4859-1367-4bdf-96c7-1a1319099b9d"). InnerVolumeSpecName "v4-0-config-user-template-login". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:07:02.387936 master-0 kubenswrapper[35367]: I1204 12:07:02.387852 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-session" (OuterVolumeSpecName: "v4-0-config-system-session") pod "005c4859-1367-4bdf-96c7-1a1319099b9d" (UID: "005c4859-1367-4bdf-96c7-1a1319099b9d"). InnerVolumeSpecName "v4-0-config-system-session". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:07:02.388957 master-0 kubenswrapper[35367]: I1204 12:07:02.388911 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-serving-cert" (OuterVolumeSpecName: "v4-0-config-system-serving-cert") pod "005c4859-1367-4bdf-96c7-1a1319099b9d" (UID: "005c4859-1367-4bdf-96c7-1a1319099b9d"). InnerVolumeSpecName "v4-0-config-system-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:07:02.402245 master-0 kubenswrapper[35367]: I1204 12:07:02.402175 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-user-template-provider-selection" (OuterVolumeSpecName: "v4-0-config-user-template-provider-selection") pod "005c4859-1367-4bdf-96c7-1a1319099b9d" (UID: "005c4859-1367-4bdf-96c7-1a1319099b9d"). InnerVolumeSpecName "v4-0-config-user-template-provider-selection". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:07:02.450497 master-0 kubenswrapper[35367]: I1204 12:07:02.450387 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-authentication/oauth-openshift-5b466d87-4hv4r"] Dec 04 12:07:02.451033 master-0 kubenswrapper[35367]: E1204 12:07:02.451014 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="005c4859-1367-4bdf-96c7-1a1319099b9d" containerName="oauth-openshift" Dec 04 12:07:02.451139 master-0 kubenswrapper[35367]: I1204 12:07:02.451129 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="005c4859-1367-4bdf-96c7-1a1319099b9d" containerName="oauth-openshift" Dec 04 12:07:02.451351 master-0 kubenswrapper[35367]: I1204 12:07:02.451340 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="005c4859-1367-4bdf-96c7-1a1319099b9d" containerName="oauth-openshift" Dec 04 12:07:02.451881 master-0 kubenswrapper[35367]: I1204 12:07:02.451866 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.473173 master-0 kubenswrapper[35367]: I1204 12:07:02.473055 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-5b466d87-4hv4r"] Dec 04 12:07:02.490150 master-0 kubenswrapper[35367]: I1204 12:07:02.489734 35367 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-ocp-branding-template\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:02.490150 master-0 kubenswrapper[35367]: I1204 12:07:02.489798 35367 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-session\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:02.490150 master-0 kubenswrapper[35367]: I1204 12:07:02.489839 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zm8w2\" (UniqueName: \"kubernetes.io/projected/005c4859-1367-4bdf-96c7-1a1319099b9d-kube-api-access-zm8w2\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:02.490150 master-0 kubenswrapper[35367]: I1204 12:07:02.489848 35367 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-user-template-provider-selection\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:02.490150 master-0 kubenswrapper[35367]: I1204 12:07:02.489859 35367 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-user-template-error\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:02.490150 master-0 kubenswrapper[35367]: I1204 12:07:02.489870 35367 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-user-template-login\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:02.490150 master-0 kubenswrapper[35367]: I1204 12:07:02.489883 35367 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-router-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:02.490150 master-0 kubenswrapper[35367]: I1204 12:07:02.489893 35367 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/005c4859-1367-4bdf-96c7-1a1319099b9d-v4-0-config-system-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:02.591407 master-0 kubenswrapper[35367]: I1204 12:07:02.591346 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/69f92ed9-1a7c-4830-95d3-18f88b1775b7-audit-policies\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.591702 master-0 kubenswrapper[35367]: I1204 12:07:02.591683 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qqsg\" (UniqueName: \"kubernetes.io/projected/69f92ed9-1a7c-4830-95d3-18f88b1775b7-kube-api-access-5qqsg\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.591897 master-0 kubenswrapper[35367]: I1204 12:07:02.591872 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.592150 master-0 kubenswrapper[35367]: I1204 12:07:02.592086 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-system-service-ca\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.592226 master-0 kubenswrapper[35367]: I1204 12:07:02.592193 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-system-cliconfig\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.592270 master-0 kubenswrapper[35367]: I1204 12:07:02.592233 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-user-template-login\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.592316 master-0 kubenswrapper[35367]: I1204 12:07:02.592288 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.592402 master-0 kubenswrapper[35367]: I1204 12:07:02.592373 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/69f92ed9-1a7c-4830-95d3-18f88b1775b7-audit-dir\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.592446 master-0 kubenswrapper[35367]: I1204 12:07:02.592407 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-system-serving-cert\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.592446 master-0 kubenswrapper[35367]: I1204 12:07:02.592439 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-system-session\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.592547 master-0 kubenswrapper[35367]: I1204 12:07:02.592520 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-system-router-certs\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.592596 master-0 kubenswrapper[35367]: I1204 12:07:02.592565 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-user-template-error\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.592636 master-0 kubenswrapper[35367]: I1204 12:07:02.592599 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.693722 master-0 kubenswrapper[35367]: I1204 12:07:02.693656 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/69f92ed9-1a7c-4830-95d3-18f88b1775b7-audit-policies\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.693722 master-0 kubenswrapper[35367]: I1204 12:07:02.693718 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5qqsg\" (UniqueName: \"kubernetes.io/projected/69f92ed9-1a7c-4830-95d3-18f88b1775b7-kube-api-access-5qqsg\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.694040 master-0 kubenswrapper[35367]: I1204 12:07:02.693747 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.694225 master-0 kubenswrapper[35367]: I1204 12:07:02.694178 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-system-service-ca\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.694345 master-0 kubenswrapper[35367]: I1204 12:07:02.694329 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-system-cliconfig\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.694431 master-0 kubenswrapper[35367]: I1204 12:07:02.694418 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-user-template-login\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.694577 master-0 kubenswrapper[35367]: I1204 12:07:02.694558 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.694773 master-0 kubenswrapper[35367]: I1204 12:07:02.694758 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/69f92ed9-1a7c-4830-95d3-18f88b1775b7-audit-dir\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.694873 master-0 kubenswrapper[35367]: I1204 12:07:02.694858 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-system-serving-cert\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.695147 master-0 kubenswrapper[35367]: I1204 12:07:02.695133 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-system-session\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.695299 master-0 kubenswrapper[35367]: I1204 12:07:02.695284 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-system-router-certs\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.695388 master-0 kubenswrapper[35367]: I1204 12:07:02.695373 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-user-template-error\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.695493 master-0 kubenswrapper[35367]: I1204 12:07:02.695476 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.695608 master-0 kubenswrapper[35367]: I1204 12:07:02.694560 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/69f92ed9-1a7c-4830-95d3-18f88b1775b7-audit-policies\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.695720 master-0 kubenswrapper[35367]: I1204 12:07:02.695388 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-system-service-ca\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.695917 master-0 kubenswrapper[35367]: I1204 12:07:02.695641 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/69f92ed9-1a7c-4830-95d3-18f88b1775b7-audit-dir\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.696237 master-0 kubenswrapper[35367]: I1204 12:07:02.696176 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-system-cliconfig\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.696749 master-0 kubenswrapper[35367]: I1204 12:07:02.696718 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.698660 master-0 kubenswrapper[35367]: I1204 12:07:02.698635 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-system-router-certs\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.698862 master-0 kubenswrapper[35367]: I1204 12:07:02.698835 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-system-session\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.699263 master-0 kubenswrapper[35367]: I1204 12:07:02.698886 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-user-template-login\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.699263 master-0 kubenswrapper[35367]: I1204 12:07:02.699029 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.699263 master-0 kubenswrapper[35367]: I1204 12:07:02.699190 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.699701 master-0 kubenswrapper[35367]: I1204 12:07:02.699641 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-system-serving-cert\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.701740 master-0 kubenswrapper[35367]: I1204 12:07:02.701649 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/69f92ed9-1a7c-4830-95d3-18f88b1775b7-v4-0-config-user-template-error\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.712449 master-0 kubenswrapper[35367]: I1204 12:07:02.712372 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qqsg\" (UniqueName: \"kubernetes.io/projected/69f92ed9-1a7c-4830-95d3-18f88b1775b7-kube-api-access-5qqsg\") pod \"oauth-openshift-5b466d87-4hv4r\" (UID: \"69f92ed9-1a7c-4830-95d3-18f88b1775b7\") " pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:02.779979 master-0 kubenswrapper[35367]: I1204 12:07:02.779914 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:03.060523 master-0 kubenswrapper[35367]: I1204 12:07:03.060452 35367 generic.go:334] "Generic (PLEG): container finished" podID="38307089-8577-4193-b461-4ebb13fd7d95" containerID="b35de08ed21af77e058c43d185ac3318dd6c20f1bbb40d3e4a65afbc80cbdab9" exitCode=0 Dec 04 12:07:03.061116 master-0 kubenswrapper[35367]: I1204 12:07:03.060511 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-tnlxw" event={"ID":"38307089-8577-4193-b461-4ebb13fd7d95","Type":"ContainerDied","Data":"b35de08ed21af77e058c43d185ac3318dd6c20f1bbb40d3e4a65afbc80cbdab9"} Dec 04 12:07:03.062866 master-0 kubenswrapper[35367]: I1204 12:07:03.062791 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" event={"ID":"005c4859-1367-4bdf-96c7-1a1319099b9d","Type":"ContainerDied","Data":"59f8f9d4fcef17c194802af5e163c7bd99ffaf9ce09bb67946ac67c85212f95a"} Dec 04 12:07:03.062979 master-0 kubenswrapper[35367]: I1204 12:07:03.062886 35367 scope.go:117] "RemoveContainer" containerID="ca08ffac691ae248342c1dcb4945471bcfb6930e1198922f94ec7be78cd84360" Dec 04 12:07:03.063232 master-0 kubenswrapper[35367]: I1204 12:07:03.063209 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-d676f96d8-88p47" Dec 04 12:07:03.109317 master-0 kubenswrapper[35367]: I1204 12:07:03.109241 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-authentication/oauth-openshift-d676f96d8-88p47"] Dec 04 12:07:03.115290 master-0 kubenswrapper[35367]: I1204 12:07:03.115223 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-authentication/oauth-openshift-d676f96d8-88p47"] Dec 04 12:07:03.161145 master-0 kubenswrapper[35367]: I1204 12:07:03.161014 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-5b466d87-4hv4r"] Dec 04 12:07:03.165863 master-0 kubenswrapper[35367]: W1204 12:07:03.165822 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69f92ed9_1a7c_4830_95d3_18f88b1775b7.slice/crio-b8c0db6ac49f5122fda5e6cae244a2f496a84400982601ea83fc86c7311a5e89 WatchSource:0}: Error finding container b8c0db6ac49f5122fda5e6cae244a2f496a84400982601ea83fc86c7311a5e89: Status 404 returned error can't find the container with id b8c0db6ac49f5122fda5e6cae244a2f496a84400982601ea83fc86c7311a5e89 Dec 04 12:07:04.080848 master-0 kubenswrapper[35367]: I1204 12:07:04.080744 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-tnlxw" event={"ID":"38307089-8577-4193-b461-4ebb13fd7d95","Type":"ContainerStarted","Data":"8a834fb932328595704942ed808a81044805ae6d021e288b70c283c900372be2"} Dec 04 12:07:04.084704 master-0 kubenswrapper[35367]: I1204 12:07:04.084644 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" event={"ID":"69f92ed9-1a7c-4830-95d3-18f88b1775b7","Type":"ContainerStarted","Data":"242687e8a6153c74bf0496510409eedccb15efbb4e38b311e6deb1906548db23"} Dec 04 12:07:04.084788 master-0 kubenswrapper[35367]: I1204 12:07:04.084719 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" event={"ID":"69f92ed9-1a7c-4830-95d3-18f88b1775b7","Type":"ContainerStarted","Data":"b8c0db6ac49f5122fda5e6cae244a2f496a84400982601ea83fc86c7311a5e89"} Dec 04 12:07:04.085274 master-0 kubenswrapper[35367]: I1204 12:07:04.085248 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:04.091540 master-0 kubenswrapper[35367]: I1204 12:07:04.091479 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" Dec 04 12:07:04.211609 master-0 kubenswrapper[35367]: I1204 12:07:04.211490 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-tnlxw" podStartSLOduration=13.683202168 podStartE2EDuration="16.211456633s" podCreationTimestamp="2025-12-04 12:06:48 +0000 UTC" firstStartedPulling="2025-12-04 12:07:01.039030933 +0000 UTC m=+464.477092191" lastFinishedPulling="2025-12-04 12:07:03.567285398 +0000 UTC m=+467.005346656" observedRunningTime="2025-12-04 12:07:04.191770803 +0000 UTC m=+467.629832081" watchObservedRunningTime="2025-12-04 12:07:04.211456633 +0000 UTC m=+467.649517891" Dec 04 12:07:04.226108 master-0 kubenswrapper[35367]: I1204 12:07:04.226017 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-authentication/oauth-openshift-5b466d87-4hv4r" podStartSLOduration=31.225995 podStartE2EDuration="31.225995s" podCreationTimestamp="2025-12-04 12:06:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:07:04.223190032 +0000 UTC m=+467.661251290" watchObservedRunningTime="2025-12-04 12:07:04.225995 +0000 UTC m=+467.664056258" Dec 04 12:07:04.734523 master-0 kubenswrapper[35367]: I1204 12:07:04.734450 35367 patch_prober.go:28] interesting pod/console-654c77b6c6-kh7ws container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.97:8443/health\": dial tcp 10.128.0.97:8443: connect: connection refused" start-of-body= Dec 04 12:07:04.734919 master-0 kubenswrapper[35367]: I1204 12:07:04.734559 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-654c77b6c6-kh7ws" podUID="ea79af85-e731-449a-a476-2ff8b05f9d80" containerName="console" probeResult="failure" output="Get \"https://10.128.0.97:8443/health\": dial tcp 10.128.0.97:8443: connect: connection refused" Dec 04 12:07:04.755955 master-0 kubenswrapper[35367]: I1204 12:07:04.755913 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="005c4859-1367-4bdf-96c7-1a1319099b9d" path="/var/lib/kubelet/pods/005c4859-1367-4bdf-96c7-1a1319099b9d/volumes" Dec 04 12:07:06.521023 master-0 kubenswrapper[35367]: I1204 12:07:06.520542 35367 patch_prober.go:28] interesting pod/machine-config-daemon-8jwk5 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Dec 04 12:07:06.521651 master-0 kubenswrapper[35367]: I1204 12:07:06.521033 35367 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" podUID="99eb764e-656c-4873-a2cd-308ce9c31a7d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Dec 04 12:07:07.449945 master-0 kubenswrapper[35367]: I1204 12:07:07.449871 35367 patch_prober.go:28] interesting pod/console-6dc95c8d8-klv7m container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.99:8443/health\": dial tcp 10.128.0.99:8443: connect: connection refused" start-of-body= Dec 04 12:07:07.450390 master-0 kubenswrapper[35367]: I1204 12:07:07.449948 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-6dc95c8d8-klv7m" podUID="91498480-8e7a-4ac5-86b3-9ff689a2e0c6" containerName="console" probeResult="failure" output="Get \"https://10.128.0.99:8443/health\": dial tcp 10.128.0.99:8443: connect: connection refused" Dec 04 12:07:09.399383 master-0 kubenswrapper[35367]: I1204 12:07:09.395763 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-58f547f9c9-wnpsq"] Dec 04 12:07:09.399383 master-0 kubenswrapper[35367]: I1204 12:07:09.396867 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-58f547f9c9-wnpsq" Dec 04 12:07:09.399383 master-0 kubenswrapper[35367]: I1204 12:07:09.397895 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-88f9c775c-fw4ls"] Dec 04 12:07:09.399383 master-0 kubenswrapper[35367]: I1204 12:07:09.398973 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.403605 master-0 kubenswrapper[35367]: I1204 12:07:09.403353 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-tls" Dec 04 12:07:09.403744 master-0 kubenswrapper[35367]: I1204 12:07:09.403674 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-4a8jt9e8fr012" Dec 04 12:07:09.404625 master-0 kubenswrapper[35367]: I1204 12:07:09.403911 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kubelet-serving-ca-bundle" Dec 04 12:07:09.404625 master-0 kubenswrapper[35367]: I1204 12:07:09.404055 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"monitoring-plugin-cert" Dec 04 12:07:09.404625 master-0 kubenswrapper[35367]: I1204 12:07:09.404162 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-client-certs" Dec 04 12:07:09.404625 master-0 kubenswrapper[35367]: I1204 12:07:09.404277 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-dockercfg-dd25z" Dec 04 12:07:09.404625 master-0 kubenswrapper[35367]: I1204 12:07:09.404375 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"default-dockercfg-hn9ls" Dec 04 12:07:09.404625 master-0 kubenswrapper[35367]: I1204 12:07:09.404476 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"metrics-server-audit-profiles" Dec 04 12:07:09.408887 master-0 kubenswrapper[35367]: I1204 12:07:09.403793 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5857974f64-4rstk"] Dec 04 12:07:09.408887 master-0 kubenswrapper[35367]: I1204 12:07:09.407045 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" Dec 04 12:07:09.412857 master-0 kubenswrapper[35367]: I1204 12:07:09.411859 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kube-state-metrics-custom-resource-state-configmap" Dec 04 12:07:09.412857 master-0 kubenswrapper[35367]: I1204 12:07:09.412098 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-state-metrics-dockercfg-fcql2" Dec 04 12:07:09.412857 master-0 kubenswrapper[35367]: I1204 12:07:09.412336 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-state-metrics-kube-rbac-proxy-config" Dec 04 12:07:09.412857 master-0 kubenswrapper[35367]: I1204 12:07:09.412489 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-state-metrics-tls" Dec 04 12:07:09.442541 master-0 kubenswrapper[35367]: I1204 12:07:09.441975 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z89ck"] Dec 04 12:07:09.444103 master-0 kubenswrapper[35367]: I1204 12:07:09.443956 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.449932 master-0 kubenswrapper[35367]: I1204 12:07:09.447429 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-dockercfg-c2w2p" Dec 04 12:07:09.449932 master-0 kubenswrapper[35367]: I1204 12:07:09.447691 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-kube-rbac-proxy-config" Dec 04 12:07:09.449932 master-0 kubenswrapper[35367]: I1204 12:07:09.448398 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-tls" Dec 04 12:07:09.469193 master-0 kubenswrapper[35367]: I1204 12:07:09.468043 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-tnlxw" Dec 04 12:07:09.469193 master-0 kubenswrapper[35367]: I1204 12:07:09.468111 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-tnlxw" Dec 04 12:07:09.470658 master-0 kubenswrapper[35367]: I1204 12:07:09.470613 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-58f547f9c9-wnpsq"] Dec 04 12:07:09.483144 master-0 kubenswrapper[35367]: I1204 12:07:09.483084 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Dec 04 12:07:09.499174 master-0 kubenswrapper[35367]: I1204 12:07:09.486453 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.499174 master-0 kubenswrapper[35367]: I1204 12:07:09.498509 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Dec 04 12:07:09.499174 master-0 kubenswrapper[35367]: I1204 12:07:09.498964 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-rbac-proxy" Dec 04 12:07:09.509839 master-0 kubenswrapper[35367]: I1204 12:07:09.505676 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.509839 master-0 kubenswrapper[35367]: I1204 12:07:09.508319 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5857974f64-4rstk"] Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.516724 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-88f9c775c-fw4ls"] Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.517964 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-dockercfg-fcvp2" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.518142 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-thanos-prometheus-http-client-file" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.518331 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-grpc-tls-90vge34bcmpum" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.513778 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-metrics-client-ca\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.525099 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-root\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.525137 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/071abc3c-51a4-46ae-a2aa-35cf3bace606-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5857974f64-4rstk\" (UID: \"071abc3c-51a4-46ae-a2aa-35cf3bace606\") " pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.525243 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e173cc4d-77b4-4af3-94b7-e9fc4f8db701-client-ca-bundle\") pod \"metrics-server-88f9c775c-fw4ls\" (UID: \"e173cc4d-77b4-4af3-94b7-e9fc4f8db701\") " pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.525325 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-sys\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.525375 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pxpb\" (UniqueName: \"kubernetes.io/projected/e173cc4d-77b4-4af3-94b7-e9fc4f8db701-kube-api-access-2pxpb\") pod \"metrics-server-88f9c775c-fw4ls\" (UID: \"e173cc4d-77b4-4af3-94b7-e9fc4f8db701\") " pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.525424 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/898ad5e8-757e-4faa-a118-67eac3f76c73-monitoring-plugin-cert\") pod \"monitoring-plugin-58f547f9c9-wnpsq\" (UID: \"898ad5e8-757e-4faa-a118-67eac3f76c73\") " pod="openshift-monitoring/monitoring-plugin-58f547f9c9-wnpsq" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.525467 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/071abc3c-51a4-46ae-a2aa-35cf3bace606-volume-directive-shadow\") pod \"kube-state-metrics-5857974f64-4rstk\" (UID: \"071abc3c-51a4-46ae-a2aa-35cf3bace606\") " pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.525497 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-node-exporter-wtmp\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.525527 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/071abc3c-51a4-46ae-a2aa-35cf3bace606-metrics-client-ca\") pod \"kube-state-metrics-5857974f64-4rstk\" (UID: \"071abc3c-51a4-46ae-a2aa-35cf3bace606\") " pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.525557 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcgbd\" (UniqueName: \"kubernetes.io/projected/071abc3c-51a4-46ae-a2aa-35cf3bace606-kube-api-access-jcgbd\") pod \"kube-state-metrics-5857974f64-4rstk\" (UID: \"071abc3c-51a4-46ae-a2aa-35cf3bace606\") " pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.525640 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e173cc4d-77b4-4af3-94b7-e9fc4f8db701-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-88f9c775c-fw4ls\" (UID: \"e173cc4d-77b4-4af3-94b7-e9fc4f8db701\") " pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.525685 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqx67\" (UniqueName: \"kubernetes.io/projected/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-kube-api-access-cqx67\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.525718 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e173cc4d-77b4-4af3-94b7-e9fc4f8db701-audit-log\") pod \"metrics-server-88f9c775c-fw4ls\" (UID: \"e173cc4d-77b4-4af3-94b7-e9fc4f8db701\") " pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.525755 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e173cc4d-77b4-4af3-94b7-e9fc4f8db701-secret-metrics-server-tls\") pod \"metrics-server-88f9c775c-fw4ls\" (UID: \"e173cc4d-77b4-4af3-94b7-e9fc4f8db701\") " pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.525830 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/071abc3c-51a4-46ae-a2aa-35cf3bace606-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5857974f64-4rstk\" (UID: \"071abc3c-51a4-46ae-a2aa-35cf3bace606\") " pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.525869 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.525929 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e173cc4d-77b4-4af3-94b7-e9fc4f8db701-secret-metrics-client-certs\") pod \"metrics-server-88f9c775c-fw4ls\" (UID: \"e173cc4d-77b4-4af3-94b7-e9fc4f8db701\") " pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.526002 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e173cc4d-77b4-4af3-94b7-e9fc4f8db701-metrics-server-audit-profiles\") pod \"metrics-server-88f9c775c-fw4ls\" (UID: \"e173cc4d-77b4-4af3-94b7-e9fc4f8db701\") " pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.526026 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"serving-certs-ca-bundle" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.526042 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-node-exporter-textfile\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.526369 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-node-exporter-tls\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.526400 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/071abc3c-51a4-46ae-a2aa-35cf3bace606-kube-state-metrics-tls\") pod \"kube-state-metrics-5857974f64-4rstk\" (UID: \"071abc3c-51a4-46ae-a2aa-35cf3bace606\") " pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.526440 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"prometheus-k8s-rulefiles-0" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.526589 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-kube-rbac-proxy-web" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.526640 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-tls" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.526820 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-thanos-sidecar-tls" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.527013 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-tls-assets-0" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.531128 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s" Dec 04 12:07:09.531854 master-0 kubenswrapper[35367]: I1204 12:07:09.531319 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-web-config" Dec 04 12:07:09.547478 master-0 kubenswrapper[35367]: I1204 12:07:09.538404 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-654c77b6c6-kh7ws"] Dec 04 12:07:09.547478 master-0 kubenswrapper[35367]: I1204 12:07:09.539748 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-dockercfg-xdnxp" Dec 04 12:07:09.547478 master-0 kubenswrapper[35367]: I1204 12:07:09.540169 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-tls-assets-0" Dec 04 12:07:09.547478 master-0 kubenswrapper[35367]: I1204 12:07:09.540831 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy" Dec 04 12:07:09.547478 master-0 kubenswrapper[35367]: I1204 12:07:09.547047 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-tls" Dec 04 12:07:09.549008 master-0 kubenswrapper[35367]: I1204 12:07:09.548943 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"prometheus-trusted-ca-bundle" Dec 04 12:07:09.570843 master-0 kubenswrapper[35367]: I1204 12:07:09.561974 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-generated" Dec 04 12:07:09.570843 master-0 kubenswrapper[35367]: I1204 12:07:09.562334 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy-web" Dec 04 12:07:09.570843 master-0 kubenswrapper[35367]: I1204 12:07:09.562494 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-web-config" Dec 04 12:07:09.570843 master-0 kubenswrapper[35367]: I1204 12:07:09.563725 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-tnlxw" Dec 04 12:07:09.572388 master-0 kubenswrapper[35367]: I1204 12:07:09.572120 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy-metric" Dec 04 12:07:09.584866 master-0 kubenswrapper[35367]: I1204 12:07:09.578421 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"alertmanager-trusted-ca-bundle" Dec 04 12:07:09.596913 master-0 kubenswrapper[35367]: I1204 12:07:09.587768 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-b644f86d6-mvlh8"] Dec 04 12:07:09.596913 master-0 kubenswrapper[35367]: I1204 12:07:09.588071 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" podUID="8e747fb0-b135-4ca9-9b96-568d3af886e6" containerName="controller-manager" containerID="cri-o://49a0d6309ed6f8f2bc43f4f7f9b511f214d6ee6fdde8b845d34d939e22a42db1" gracePeriod=30 Dec 04 12:07:09.619366 master-0 kubenswrapper[35367]: I1204 12:07:09.613412 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8"] Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.664570 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.664643 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e173cc4d-77b4-4af3-94b7-e9fc4f8db701-secret-metrics-client-certs\") pod \"metrics-server-88f9c775c-fw4ls\" (UID: \"e173cc4d-77b4-4af3-94b7-e9fc4f8db701\") " pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.664673 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/136126db-b6ad-440f-8add-e9e206ec25c6-config-out\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.664702 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.664728 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.664752 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.664773 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.664797 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e173cc4d-77b4-4af3-94b7-e9fc4f8db701-metrics-server-audit-profiles\") pod \"metrics-server-88f9c775c-fw4ls\" (UID: \"e173cc4d-77b4-4af3-94b7-e9fc4f8db701\") " pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.664838 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-web-config\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.664866 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-node-exporter-textfile\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.664887 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-node-exporter-tls\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.664912 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/071abc3c-51a4-46ae-a2aa-35cf3bace606-kube-state-metrics-tls\") pod \"kube-state-metrics-5857974f64-4rstk\" (UID: \"071abc3c-51a4-46ae-a2aa-35cf3bace606\") " pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.664937 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.664961 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.664987 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a39b763e-1e11-489e-bfef-df396e96d6b8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665009 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-metrics-client-ca\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665032 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665056 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-root\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665082 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/071abc3c-51a4-46ae-a2aa-35cf3bace606-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5857974f64-4rstk\" (UID: \"071abc3c-51a4-46ae-a2aa-35cf3bace606\") " pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665106 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665129 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bbjd\" (UniqueName: \"kubernetes.io/projected/136126db-b6ad-440f-8add-e9e206ec25c6-kube-api-access-9bbjd\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665155 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a39b763e-1e11-489e-bfef-df396e96d6b8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665176 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665195 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a39b763e-1e11-489e-bfef-df396e96d6b8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665220 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e173cc4d-77b4-4af3-94b7-e9fc4f8db701-client-ca-bundle\") pod \"metrics-server-88f9c775c-fw4ls\" (UID: \"e173cc4d-77b4-4af3-94b7-e9fc4f8db701\") " pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665239 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a39b763e-1e11-489e-bfef-df396e96d6b8-config-out\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665260 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665283 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a39b763e-1e11-489e-bfef-df396e96d6b8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665306 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-config\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665327 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/136126db-b6ad-440f-8add-e9e206ec25c6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665350 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665377 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-sys\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665412 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlzld\" (UniqueName: \"kubernetes.io/projected/a39b763e-1e11-489e-bfef-df396e96d6b8-kube-api-access-rlzld\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665441 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2pxpb\" (UniqueName: \"kubernetes.io/projected/e173cc4d-77b4-4af3-94b7-e9fc4f8db701-kube-api-access-2pxpb\") pod \"metrics-server-88f9c775c-fw4ls\" (UID: \"e173cc4d-77b4-4af3-94b7-e9fc4f8db701\") " pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665464 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665486 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/898ad5e8-757e-4faa-a118-67eac3f76c73-monitoring-plugin-cert\") pod \"monitoring-plugin-58f547f9c9-wnpsq\" (UID: \"898ad5e8-757e-4faa-a118-67eac3f76c73\") " pod="openshift-monitoring/monitoring-plugin-58f547f9c9-wnpsq" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665551 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665643 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/071abc3c-51a4-46ae-a2aa-35cf3bace606-volume-directive-shadow\") pod \"kube-state-metrics-5857974f64-4rstk\" (UID: \"071abc3c-51a4-46ae-a2aa-35cf3bace606\") " pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" Dec 04 12:07:09.668030 master-0 kubenswrapper[35367]: I1204 12:07:09.665668 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-node-exporter-wtmp\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.677619 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/071abc3c-51a4-46ae-a2aa-35cf3bace606-metrics-client-ca\") pod \"kube-state-metrics-5857974f64-4rstk\" (UID: \"071abc3c-51a4-46ae-a2aa-35cf3bace606\") " pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.677671 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jcgbd\" (UniqueName: \"kubernetes.io/projected/071abc3c-51a4-46ae-a2aa-35cf3bace606-kube-api-access-jcgbd\") pod \"kube-state-metrics-5857974f64-4rstk\" (UID: \"071abc3c-51a4-46ae-a2aa-35cf3bace606\") " pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.677750 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-config-volume\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.677783 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e173cc4d-77b4-4af3-94b7-e9fc4f8db701-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-88f9c775c-fw4ls\" (UID: \"e173cc4d-77b4-4af3-94b7-e9fc4f8db701\") " pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.677840 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cqx67\" (UniqueName: \"kubernetes.io/projected/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-kube-api-access-cqx67\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.677872 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e173cc4d-77b4-4af3-94b7-e9fc4f8db701-audit-log\") pod \"metrics-server-88f9c775c-fw4ls\" (UID: \"e173cc4d-77b4-4af3-94b7-e9fc4f8db701\") " pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.677900 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/136126db-b6ad-440f-8add-e9e206ec25c6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.677948 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e173cc4d-77b4-4af3-94b7-e9fc4f8db701-secret-metrics-server-tls\") pod \"metrics-server-88f9c775c-fw4ls\" (UID: \"e173cc4d-77b4-4af3-94b7-e9fc4f8db701\") " pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.677974 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.678008 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.678061 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/071abc3c-51a4-46ae-a2aa-35cf3bace606-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5857974f64-4rstk\" (UID: \"071abc3c-51a4-46ae-a2aa-35cf3bace606\") " pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.678099 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-web-config\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.678132 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.680390 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-metrics-client-ca\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.680771 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/071abc3c-51a4-46ae-a2aa-35cf3bace606-kube-state-metrics-tls\") pod \"kube-state-metrics-5857974f64-4rstk\" (UID: \"071abc3c-51a4-46ae-a2aa-35cf3bace606\") " pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.681025 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-root\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.681374 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-node-exporter-textfile\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.682717 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e173cc4d-77b4-4af3-94b7-e9fc4f8db701-metrics-server-audit-profiles\") pod \"metrics-server-88f9c775c-fw4ls\" (UID: \"e173cc4d-77b4-4af3-94b7-e9fc4f8db701\") " pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.683821 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e173cc4d-77b4-4af3-94b7-e9fc4f8db701-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-88f9c775c-fw4ls\" (UID: \"e173cc4d-77b4-4af3-94b7-e9fc4f8db701\") " pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.684268 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/071abc3c-51a4-46ae-a2aa-35cf3bace606-volume-directive-shadow\") pod \"kube-state-metrics-5857974f64-4rstk\" (UID: \"071abc3c-51a4-46ae-a2aa-35cf3bace606\") " pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.685211 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e173cc4d-77b4-4af3-94b7-e9fc4f8db701-secret-metrics-client-certs\") pod \"metrics-server-88f9c775c-fw4ls\" (UID: \"e173cc4d-77b4-4af3-94b7-e9fc4f8db701\") " pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.667478 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-node-exporter-wtmp\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.689974 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-sys\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.690163 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e173cc4d-77b4-4af3-94b7-e9fc4f8db701-audit-log\") pod \"metrics-server-88f9c775c-fw4ls\" (UID: \"e173cc4d-77b4-4af3-94b7-e9fc4f8db701\") " pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.691034 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/071abc3c-51a4-46ae-a2aa-35cf3bace606-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5857974f64-4rstk\" (UID: \"071abc3c-51a4-46ae-a2aa-35cf3bace606\") " pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.692161 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-node-exporter-tls\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.693765 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/071abc3c-51a4-46ae-a2aa-35cf3bace606-metrics-client-ca\") pod \"kube-state-metrics-5857974f64-4rstk\" (UID: \"071abc3c-51a4-46ae-a2aa-35cf3bace606\") " pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.710006 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e173cc4d-77b4-4af3-94b7-e9fc4f8db701-secret-metrics-server-tls\") pod \"metrics-server-88f9c775c-fw4ls\" (UID: \"e173cc4d-77b4-4af3-94b7-e9fc4f8db701\") " pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.710350 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/898ad5e8-757e-4faa-a118-67eac3f76c73-monitoring-plugin-cert\") pod \"monitoring-plugin-58f547f9c9-wnpsq\" (UID: \"898ad5e8-757e-4faa-a118-67eac3f76c73\") " pod="openshift-monitoring/monitoring-plugin-58f547f9c9-wnpsq" Dec 04 12:07:09.728352 master-0 kubenswrapper[35367]: I1204 12:07:09.721863 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.757376 master-0 kubenswrapper[35367]: I1204 12:07:09.757305 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e173cc4d-77b4-4af3-94b7-e9fc4f8db701-client-ca-bundle\") pod \"metrics-server-88f9c775c-fw4ls\" (UID: \"e173cc4d-77b4-4af3-94b7-e9fc4f8db701\") " pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.758211 master-0 kubenswrapper[35367]: I1204 12:07:09.758161 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/071abc3c-51a4-46ae-a2aa-35cf3bace606-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5857974f64-4rstk\" (UID: \"071abc3c-51a4-46ae-a2aa-35cf3bace606\") " pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" Dec 04 12:07:09.759676 master-0 kubenswrapper[35367]: I1204 12:07:09.759453 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Dec 04 12:07:09.759962 master-0 kubenswrapper[35367]: I1204 12:07:09.759930 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8" Dec 04 12:07:09.760192 master-0 kubenswrapper[35367]: I1204 12:07:09.760091 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-58f547f9c9-wnpsq" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.764629 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7487d49bdb-7f2xj"] Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.766823 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.779006 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.779697 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"openshift-state-metrics-kube-rbac-proxy-config" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.779943 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"openshift-state-metrics-dockercfg-7vm6p" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.780147 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"telemeter-client" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.780306 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"openshift-state-metrics-tls" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.780486 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"telemeter-client-dockercfg-ggdx4" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.780654 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"telemeter-client-serving-certs-ca-bundle" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.783907 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.783963 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/136126db-b6ad-440f-8add-e9e206ec25c6-config-out\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.784114 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"telemeter-client-kube-rbac-proxy-config" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.787913 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8"] Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788020 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788071 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788112 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788139 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788187 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-web-config\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788290 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788315 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788347 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a39b763e-1e11-489e-bfef-df396e96d6b8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788412 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788455 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788486 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9bbjd\" (UniqueName: \"kubernetes.io/projected/136126db-b6ad-440f-8add-e9e206ec25c6-kube-api-access-9bbjd\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788487 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/136126db-b6ad-440f-8add-e9e206ec25c6-config-out\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788556 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a39b763e-1e11-489e-bfef-df396e96d6b8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788585 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a39b763e-1e11-489e-bfef-df396e96d6b8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788610 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788643 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a39b763e-1e11-489e-bfef-df396e96d6b8-config-out\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788662 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788687 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a39b763e-1e11-489e-bfef-df396e96d6b8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788714 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-config\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788740 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/136126db-b6ad-440f-8add-e9e206ec25c6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788761 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788796 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rlzld\" (UniqueName: \"kubernetes.io/projected/a39b763e-1e11-489e-bfef-df396e96d6b8-kube-api-access-rlzld\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.789027 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"federate-client-certs" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.788856 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.789207 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.789264 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"telemeter-client-tls" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.789295 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-config-volume\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.789339 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/136126db-b6ad-440f-8add-e9e206ec25c6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.789364 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.789388 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.789429 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-web-config\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.789467 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.792661 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.793066 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a39b763e-1e11-489e-bfef-df396e96d6b8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.793692 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.794238 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.794735 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcgbd\" (UniqueName: \"kubernetes.io/projected/071abc3c-51a4-46ae-a2aa-35cf3bace606-kube-api-access-jcgbd\") pod \"kube-state-metrics-5857974f64-4rstk\" (UID: \"071abc3c-51a4-46ae-a2aa-35cf3bace606\") " pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.796730 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-config-volume\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.797429 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.797640 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.799694 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.800406 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.808024 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.815390 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a39b763e-1e11-489e-bfef-df396e96d6b8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.821992 master-0 kubenswrapper[35367]: I1204 12:07:09.816598 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/136126db-b6ad-440f-8add-e9e206ec25c6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.827640 master-0 kubenswrapper[35367]: I1204 12:07:09.823561 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"telemeter-trusted-ca-bundle-56c9b9fa8d9gs" Dec 04 12:07:09.827640 master-0 kubenswrapper[35367]: I1204 12:07:09.825072 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-config\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.827640 master-0 kubenswrapper[35367]: I1204 12:07:09.825558 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/136126db-b6ad-440f-8add-e9e206ec25c6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.827640 master-0 kubenswrapper[35367]: I1204 12:07:09.825622 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a39b763e-1e11-489e-bfef-df396e96d6b8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.827640 master-0 kubenswrapper[35367]: I1204 12:07:09.826743 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.827640 master-0 kubenswrapper[35367]: I1204 12:07:09.826979 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a39b763e-1e11-489e-bfef-df396e96d6b8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.829569 master-0 kubenswrapper[35367]: I1204 12:07:09.829003 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.829569 master-0 kubenswrapper[35367]: I1204 12:07:09.829522 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.830700 master-0 kubenswrapper[35367]: I1204 12:07:09.830632 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-web-config\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.830999 master-0 kubenswrapper[35367]: I1204 12:07:09.830943 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bbjd\" (UniqueName: \"kubernetes.io/projected/136126db-b6ad-440f-8add-e9e206ec25c6-kube-api-access-9bbjd\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.831173 master-0 kubenswrapper[35367]: I1204 12:07:09.831149 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.831650 master-0 kubenswrapper[35367]: I1204 12:07:09.831607 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.832127 master-0 kubenswrapper[35367]: I1204 12:07:09.832103 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.850755 master-0 kubenswrapper[35367]: I1204 12:07:09.839231 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.850755 master-0 kubenswrapper[35367]: I1204 12:07:09.849550 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqx67\" (UniqueName: \"kubernetes.io/projected/2d3a9769-2a09-41ce-b1ab-6fe3bd192832-kube-api-access-cqx67\") pod \"node-exporter-z89ck\" (UID: \"2d3a9769-2a09-41ce-b1ab-6fe3bd192832\") " pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:09.850755 master-0 kubenswrapper[35367]: I1204 12:07:09.849938 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pxpb\" (UniqueName: \"kubernetes.io/projected/e173cc4d-77b4-4af3-94b7-e9fc4f8db701-kube-api-access-2pxpb\") pod \"metrics-server-88f9c775c-fw4ls\" (UID: \"e173cc4d-77b4-4af3-94b7-e9fc4f8db701\") " pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:09.850755 master-0 kubenswrapper[35367]: I1204 12:07:09.850641 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a39b763e-1e11-489e-bfef-df396e96d6b8-config-out\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.851316 master-0 kubenswrapper[35367]: I1204 12:07:09.850916 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-web-config\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.899836 master-0 kubenswrapper[35367]: I1204 12:07:09.884518 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7487d49bdb-7f2xj"] Dec 04 12:07:09.899836 master-0 kubenswrapper[35367]: I1204 12:07:09.886379 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" Dec 04 12:07:09.899836 master-0 kubenswrapper[35367]: I1204 12:07:09.891221 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f40cbd35-aa53-4e7c-82c1-3abc0455cf51-openshift-state-metrics-tls\") pod \"openshift-state-metrics-5974b6b869-5fzg8\" (UID: \"f40cbd35-aa53-4e7c-82c1-3abc0455cf51\") " pod="openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8" Dec 04 12:07:09.899836 master-0 kubenswrapper[35367]: I1204 12:07:09.891339 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6546d9a8-710e-4166-a36f-cea7ba5ba41c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:09.899836 master-0 kubenswrapper[35367]: I1204 12:07:09.891371 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6546d9a8-710e-4166-a36f-cea7ba5ba41c-telemeter-client-tls\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:09.899836 master-0 kubenswrapper[35367]: I1204 12:07:09.891404 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xbhq\" (UniqueName: \"kubernetes.io/projected/6546d9a8-710e-4166-a36f-cea7ba5ba41c-kube-api-access-6xbhq\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:09.899836 master-0 kubenswrapper[35367]: I1204 12:07:09.891429 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f40cbd35-aa53-4e7c-82c1-3abc0455cf51-metrics-client-ca\") pod \"openshift-state-metrics-5974b6b869-5fzg8\" (UID: \"f40cbd35-aa53-4e7c-82c1-3abc0455cf51\") " pod="openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8" Dec 04 12:07:09.899836 master-0 kubenswrapper[35367]: I1204 12:07:09.891472 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6546d9a8-710e-4166-a36f-cea7ba5ba41c-federate-client-tls\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:09.899836 master-0 kubenswrapper[35367]: I1204 12:07:09.891519 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6546d9a8-710e-4166-a36f-cea7ba5ba41c-secret-telemeter-client\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:09.899836 master-0 kubenswrapper[35367]: I1204 12:07:09.891573 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6546d9a8-710e-4166-a36f-cea7ba5ba41c-metrics-client-ca\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:09.899836 master-0 kubenswrapper[35367]: I1204 12:07:09.891610 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f40cbd35-aa53-4e7c-82c1-3abc0455cf51-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-5974b6b869-5fzg8\" (UID: \"f40cbd35-aa53-4e7c-82c1-3abc0455cf51\") " pod="openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8" Dec 04 12:07:09.899836 master-0 kubenswrapper[35367]: I1204 12:07:09.891721 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l7nm\" (UniqueName: \"kubernetes.io/projected/f40cbd35-aa53-4e7c-82c1-3abc0455cf51-kube-api-access-5l7nm\") pod \"openshift-state-metrics-5974b6b869-5fzg8\" (UID: \"f40cbd35-aa53-4e7c-82c1-3abc0455cf51\") " pod="openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8" Dec 04 12:07:09.899836 master-0 kubenswrapper[35367]: I1204 12:07:09.891758 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6546d9a8-710e-4166-a36f-cea7ba5ba41c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:09.899836 master-0 kubenswrapper[35367]: I1204 12:07:09.891918 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6546d9a8-710e-4166-a36f-cea7ba5ba41c-serving-certs-ca-bundle\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:09.912263 master-0 kubenswrapper[35367]: I1204 12:07:09.912204 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlzld\" (UniqueName: \"kubernetes.io/projected/a39b763e-1e11-489e-bfef-df396e96d6b8-kube-api-access-rlzld\") pod \"alertmanager-main-0\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.917022 master-0 kubenswrapper[35367]: I1204 12:07:09.916955 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts"] Dec 04 12:07:09.949880 master-0 kubenswrapper[35367]: I1204 12:07:09.930221 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t"] Dec 04 12:07:09.949880 master-0 kubenswrapper[35367]: I1204 12:07:09.934199 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" podUID="cee5f541-b365-478e-a24a-acf6168a45f6" containerName="route-controller-manager" containerID="cri-o://2db28cab881bc989aacef20e329cba357eef899b9438ff67790f2c1e30162811" gracePeriod=30 Dec 04 12:07:09.949880 master-0 kubenswrapper[35367]: I1204 12:07:09.934513 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:09.952441 master-0 kubenswrapper[35367]: I1204 12:07:09.950416 35367 patch_prober.go:28] interesting pod/route-controller-manager-557cff67c-7qs6t container/route-controller-manager namespace/openshift-route-controller-manager: Readiness probe status=failure output="Get \"https://10.128.0.85:8443/healthz\": dial tcp 10.128.0.85:8443: connect: connection refused" start-of-body= Dec 04 12:07:09.952441 master-0 kubenswrapper[35367]: I1204 12:07:09.950484 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" podUID="cee5f541-b365-478e-a24a-acf6168a45f6" containerName="route-controller-manager" probeResult="failure" output="Get \"https://10.128.0.85:8443/healthz\": dial tcp 10.128.0.85:8443: connect: connection refused" Dec 04 12:07:09.952441 master-0 kubenswrapper[35367]: I1204 12:07:09.950984 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-tls" Dec 04 12:07:09.952441 master-0 kubenswrapper[35367]: I1204 12:07:09.951222 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-kube-rbac-proxy" Dec 04 12:07:09.952441 master-0 kubenswrapper[35367]: I1204 12:07:09.951322 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-kube-rbac-proxy-rules" Dec 04 12:07:09.952441 master-0 kubenswrapper[35367]: I1204 12:07:09.951429 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-dockercfg-wmtl9" Dec 04 12:07:09.952441 master-0 kubenswrapper[35367]: I1204 12:07:09.951527 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-kube-rbac-proxy-web" Dec 04 12:07:09.952441 master-0 kubenswrapper[35367]: I1204 12:07:09.951668 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-kube-rbac-proxy-metrics" Dec 04 12:07:09.952441 master-0 kubenswrapper[35367]: I1204 12:07:09.951852 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-grpc-tls-65n1etrkcotip" Dec 04 12:07:09.961100 master-0 kubenswrapper[35367]: I1204 12:07:09.960869 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:09.986050 master-0 kubenswrapper[35367]: I1204 12:07:09.962444 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/console-64cdd44ddd-2t62p"] Dec 04 12:07:09.986050 master-0 kubenswrapper[35367]: I1204 12:07:09.963662 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:09.998299 master-0 kubenswrapper[35367]: I1204 12:07:09.994799 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:07:09.998299 master-0 kubenswrapper[35367]: I1204 12:07:09.997503 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6546d9a8-710e-4166-a36f-cea7ba5ba41c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:09.998299 master-0 kubenswrapper[35367]: I1204 12:07:09.997538 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6546d9a8-710e-4166-a36f-cea7ba5ba41c-telemeter-client-tls\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:09.998299 master-0 kubenswrapper[35367]: I1204 12:07:09.997566 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6xbhq\" (UniqueName: \"kubernetes.io/projected/6546d9a8-710e-4166-a36f-cea7ba5ba41c-kube-api-access-6xbhq\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:09.998299 master-0 kubenswrapper[35367]: I1204 12:07:09.997591 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f40cbd35-aa53-4e7c-82c1-3abc0455cf51-metrics-client-ca\") pod \"openshift-state-metrics-5974b6b869-5fzg8\" (UID: \"f40cbd35-aa53-4e7c-82c1-3abc0455cf51\") " pod="openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8" Dec 04 12:07:09.998299 master-0 kubenswrapper[35367]: I1204 12:07:09.997616 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6546d9a8-710e-4166-a36f-cea7ba5ba41c-federate-client-tls\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:09.998299 master-0 kubenswrapper[35367]: I1204 12:07:09.997657 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6546d9a8-710e-4166-a36f-cea7ba5ba41c-secret-telemeter-client\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:09.998299 master-0 kubenswrapper[35367]: I1204 12:07:09.997688 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6546d9a8-710e-4166-a36f-cea7ba5ba41c-metrics-client-ca\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:09.998299 master-0 kubenswrapper[35367]: I1204 12:07:09.997707 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f40cbd35-aa53-4e7c-82c1-3abc0455cf51-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-5974b6b869-5fzg8\" (UID: \"f40cbd35-aa53-4e7c-82c1-3abc0455cf51\") " pod="openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8" Dec 04 12:07:10.002645 master-0 kubenswrapper[35367]: I1204 12:07:09.999180 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5l7nm\" (UniqueName: \"kubernetes.io/projected/f40cbd35-aa53-4e7c-82c1-3abc0455cf51-kube-api-access-5l7nm\") pod \"openshift-state-metrics-5974b6b869-5fzg8\" (UID: \"f40cbd35-aa53-4e7c-82c1-3abc0455cf51\") " pod="openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8" Dec 04 12:07:10.002645 master-0 kubenswrapper[35367]: I1204 12:07:09.999213 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6546d9a8-710e-4166-a36f-cea7ba5ba41c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:10.002645 master-0 kubenswrapper[35367]: I1204 12:07:09.999263 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6546d9a8-710e-4166-a36f-cea7ba5ba41c-serving-certs-ca-bundle\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:10.002645 master-0 kubenswrapper[35367]: I1204 12:07:09.999300 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f40cbd35-aa53-4e7c-82c1-3abc0455cf51-openshift-state-metrics-tls\") pod \"openshift-state-metrics-5974b6b869-5fzg8\" (UID: \"f40cbd35-aa53-4e7c-82c1-3abc0455cf51\") " pod="openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8" Dec 04 12:07:10.010430 master-0 kubenswrapper[35367]: I1204 12:07:10.005826 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6546d9a8-710e-4166-a36f-cea7ba5ba41c-metrics-client-ca\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:10.010430 master-0 kubenswrapper[35367]: I1204 12:07:10.007113 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6546d9a8-710e-4166-a36f-cea7ba5ba41c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:10.010430 master-0 kubenswrapper[35367]: I1204 12:07:10.007135 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f40cbd35-aa53-4e7c-82c1-3abc0455cf51-metrics-client-ca\") pod \"openshift-state-metrics-5974b6b869-5fzg8\" (UID: \"f40cbd35-aa53-4e7c-82c1-3abc0455cf51\") " pod="openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8" Dec 04 12:07:10.010430 master-0 kubenswrapper[35367]: I1204 12:07:10.008494 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f40cbd35-aa53-4e7c-82c1-3abc0455cf51-openshift-state-metrics-tls\") pod \"openshift-state-metrics-5974b6b869-5fzg8\" (UID: \"f40cbd35-aa53-4e7c-82c1-3abc0455cf51\") " pod="openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8" Dec 04 12:07:10.010430 master-0 kubenswrapper[35367]: I1204 12:07:10.009647 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6546d9a8-710e-4166-a36f-cea7ba5ba41c-serving-certs-ca-bundle\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:10.010430 master-0 kubenswrapper[35367]: I1204 12:07:10.010025 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z89ck" Dec 04 12:07:10.019119 master-0 kubenswrapper[35367]: I1204 12:07:10.017640 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f40cbd35-aa53-4e7c-82c1-3abc0455cf51-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-5974b6b869-5fzg8\" (UID: \"f40cbd35-aa53-4e7c-82c1-3abc0455cf51\") " pod="openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8" Dec 04 12:07:10.019119 master-0 kubenswrapper[35367]: I1204 12:07:10.018277 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6546d9a8-710e-4166-a36f-cea7ba5ba41c-secret-telemeter-client\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:10.019119 master-0 kubenswrapper[35367]: I1204 12:07:10.018788 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6546d9a8-710e-4166-a36f-cea7ba5ba41c-federate-client-tls\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:10.020824 master-0 kubenswrapper[35367]: I1204 12:07:10.020758 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6546d9a8-710e-4166-a36f-cea7ba5ba41c-telemeter-client-tls\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:10.039010 master-0 kubenswrapper[35367]: I1204 12:07:10.026415 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts"] Dec 04 12:07:10.039010 master-0 kubenswrapper[35367]: I1204 12:07:10.029485 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6546d9a8-710e-4166-a36f-cea7ba5ba41c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:10.039010 master-0 kubenswrapper[35367]: I1204 12:07:10.038952 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l7nm\" (UniqueName: \"kubernetes.io/projected/f40cbd35-aa53-4e7c-82c1-3abc0455cf51-kube-api-access-5l7nm\") pod \"openshift-state-metrics-5974b6b869-5fzg8\" (UID: \"f40cbd35-aa53-4e7c-82c1-3abc0455cf51\") " pod="openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8" Dec 04 12:07:10.057669 master-0 kubenswrapper[35367]: I1204 12:07:10.056982 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64cdd44ddd-2t62p"] Dec 04 12:07:10.075189 master-0 kubenswrapper[35367]: I1204 12:07:10.074753 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xbhq\" (UniqueName: \"kubernetes.io/projected/6546d9a8-710e-4166-a36f-cea7ba5ba41c-kube-api-access-6xbhq\") pod \"telemeter-client-7487d49bdb-7f2xj\" (UID: \"6546d9a8-710e-4166-a36f-cea7ba5ba41c\") " pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:10.119981 master-0 kubenswrapper[35367]: I1204 12:07:10.119217 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7fzr\" (UniqueName: \"kubernetes.io/projected/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-kube-api-access-p7fzr\") pod \"console-64cdd44ddd-2t62p\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.119981 master-0 kubenswrapper[35367]: I1204 12:07:10.119349 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-trusted-ca-bundle\") pod \"console-64cdd44ddd-2t62p\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.119981 master-0 kubenswrapper[35367]: I1204 12:07:10.119417 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4c8907fe-87b6-4290-af7a-22ae41f3ff16-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.119981 master-0 kubenswrapper[35367]: I1204 12:07:10.119477 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-oauth-serving-cert\") pod \"console-64cdd44ddd-2t62p\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.119981 master-0 kubenswrapper[35367]: I1204 12:07:10.119557 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-console-config\") pod \"console-64cdd44ddd-2t62p\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.119981 master-0 kubenswrapper[35367]: I1204 12:07:10.119589 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-console-serving-cert\") pod \"console-64cdd44ddd-2t62p\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.119981 master-0 kubenswrapper[35367]: I1204 12:07:10.119644 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c8907fe-87b6-4290-af7a-22ae41f3ff16-secret-grpc-tls\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.119981 master-0 kubenswrapper[35367]: I1204 12:07:10.119724 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c8907fe-87b6-4290-af7a-22ae41f3ff16-metrics-client-ca\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.119981 master-0 kubenswrapper[35367]: I1204 12:07:10.119793 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4c8907fe-87b6-4290-af7a-22ae41f3ff16-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.119981 master-0 kubenswrapper[35367]: I1204 12:07:10.119846 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-console-oauth-config\") pod \"console-64cdd44ddd-2t62p\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.119981 master-0 kubenswrapper[35367]: I1204 12:07:10.119873 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbx5l\" (UniqueName: \"kubernetes.io/projected/4c8907fe-87b6-4290-af7a-22ae41f3ff16-kube-api-access-kbx5l\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.119981 master-0 kubenswrapper[35367]: I1204 12:07:10.119939 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4c8907fe-87b6-4290-af7a-22ae41f3ff16-secret-thanos-querier-tls\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.126012 master-0 kubenswrapper[35367]: I1204 12:07:10.120001 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c8907fe-87b6-4290-af7a-22ae41f3ff16-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.126012 master-0 kubenswrapper[35367]: I1204 12:07:10.120040 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-service-ca\") pod \"console-64cdd44ddd-2t62p\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.126012 master-0 kubenswrapper[35367]: I1204 12:07:10.120146 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c8907fe-87b6-4290-af7a-22ae41f3ff16-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.126012 master-0 kubenswrapper[35367]: I1204 12:07:10.121524 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:10.151939 master-0 kubenswrapper[35367]: I1204 12:07:10.140777 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8" Dec 04 12:07:10.174628 master-0 kubenswrapper[35367]: I1204 12:07:10.162018 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" Dec 04 12:07:10.187934 master-0 kubenswrapper[35367]: I1204 12:07:10.187534 35367 generic.go:334] "Generic (PLEG): container finished" podID="cee5f541-b365-478e-a24a-acf6168a45f6" containerID="2db28cab881bc989aacef20e329cba357eef899b9438ff67790f2c1e30162811" exitCode=0 Dec 04 12:07:10.187934 master-0 kubenswrapper[35367]: I1204 12:07:10.187610 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" event={"ID":"cee5f541-b365-478e-a24a-acf6168a45f6","Type":"ContainerDied","Data":"2db28cab881bc989aacef20e329cba357eef899b9438ff67790f2c1e30162811"} Dec 04 12:07:10.189505 master-0 kubenswrapper[35367]: I1204 12:07:10.188947 35367 generic.go:334] "Generic (PLEG): container finished" podID="8e747fb0-b135-4ca9-9b96-568d3af886e6" containerID="49a0d6309ed6f8f2bc43f4f7f9b511f214d6ee6fdde8b845d34d939e22a42db1" exitCode=0 Dec 04 12:07:10.194772 master-0 kubenswrapper[35367]: I1204 12:07:10.189903 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" event={"ID":"8e747fb0-b135-4ca9-9b96-568d3af886e6","Type":"ContainerDied","Data":"49a0d6309ed6f8f2bc43f4f7f9b511f214d6ee6fdde8b845d34d939e22a42db1"} Dec 04 12:07:10.224410 master-0 kubenswrapper[35367]: I1204 12:07:10.221582 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p7fzr\" (UniqueName: \"kubernetes.io/projected/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-kube-api-access-p7fzr\") pod \"console-64cdd44ddd-2t62p\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.224410 master-0 kubenswrapper[35367]: I1204 12:07:10.221646 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-trusted-ca-bundle\") pod \"console-64cdd44ddd-2t62p\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.224410 master-0 kubenswrapper[35367]: I1204 12:07:10.221677 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4c8907fe-87b6-4290-af7a-22ae41f3ff16-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.224410 master-0 kubenswrapper[35367]: I1204 12:07:10.221700 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-oauth-serving-cert\") pod \"console-64cdd44ddd-2t62p\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.224410 master-0 kubenswrapper[35367]: I1204 12:07:10.221759 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-console-config\") pod \"console-64cdd44ddd-2t62p\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.224410 master-0 kubenswrapper[35367]: I1204 12:07:10.221784 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-console-serving-cert\") pod \"console-64cdd44ddd-2t62p\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.224410 master-0 kubenswrapper[35367]: I1204 12:07:10.221838 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c8907fe-87b6-4290-af7a-22ae41f3ff16-secret-grpc-tls\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.224410 master-0 kubenswrapper[35367]: I1204 12:07:10.221862 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c8907fe-87b6-4290-af7a-22ae41f3ff16-metrics-client-ca\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.224410 master-0 kubenswrapper[35367]: I1204 12:07:10.221909 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4c8907fe-87b6-4290-af7a-22ae41f3ff16-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.224410 master-0 kubenswrapper[35367]: I1204 12:07:10.221941 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-console-oauth-config\") pod \"console-64cdd44ddd-2t62p\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.224410 master-0 kubenswrapper[35367]: I1204 12:07:10.221971 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kbx5l\" (UniqueName: \"kubernetes.io/projected/4c8907fe-87b6-4290-af7a-22ae41f3ff16-kube-api-access-kbx5l\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.224410 master-0 kubenswrapper[35367]: I1204 12:07:10.222002 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4c8907fe-87b6-4290-af7a-22ae41f3ff16-secret-thanos-querier-tls\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.224410 master-0 kubenswrapper[35367]: I1204 12:07:10.222045 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c8907fe-87b6-4290-af7a-22ae41f3ff16-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.224410 master-0 kubenswrapper[35367]: I1204 12:07:10.222077 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-service-ca\") pod \"console-64cdd44ddd-2t62p\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.224410 master-0 kubenswrapper[35367]: I1204 12:07:10.222111 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c8907fe-87b6-4290-af7a-22ae41f3ff16-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.232400 master-0 kubenswrapper[35367]: I1204 12:07:10.227498 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-oauth-serving-cert\") pod \"console-64cdd44ddd-2t62p\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.232400 master-0 kubenswrapper[35367]: I1204 12:07:10.228194 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-trusted-ca-bundle\") pod \"console-64cdd44ddd-2t62p\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.232400 master-0 kubenswrapper[35367]: I1204 12:07:10.228483 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-console-config\") pod \"console-64cdd44ddd-2t62p\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.232400 master-0 kubenswrapper[35367]: I1204 12:07:10.231854 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c8907fe-87b6-4290-af7a-22ae41f3ff16-secret-grpc-tls\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.233472 master-0 kubenswrapper[35367]: I1204 12:07:10.233218 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c8907fe-87b6-4290-af7a-22ae41f3ff16-metrics-client-ca\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.233472 master-0 kubenswrapper[35367]: I1204 12:07:10.233348 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4c8907fe-87b6-4290-af7a-22ae41f3ff16-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.251954 master-0 kubenswrapper[35367]: I1204 12:07:10.248408 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-service-ca\") pod \"console-64cdd44ddd-2t62p\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.283585 master-0 kubenswrapper[35367]: I1204 12:07:10.280320 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-console-oauth-config\") pod \"console-64cdd44ddd-2t62p\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.283585 master-0 kubenswrapper[35367]: I1204 12:07:10.282758 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4c8907fe-87b6-4290-af7a-22ae41f3ff16-secret-thanos-querier-tls\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.283585 master-0 kubenswrapper[35367]: I1204 12:07:10.283040 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbx5l\" (UniqueName: \"kubernetes.io/projected/4c8907fe-87b6-4290-af7a-22ae41f3ff16-kube-api-access-kbx5l\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.283585 master-0 kubenswrapper[35367]: I1204 12:07:10.283491 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c8907fe-87b6-4290-af7a-22ae41f3ff16-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.284592 master-0 kubenswrapper[35367]: I1204 12:07:10.284523 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c8907fe-87b6-4290-af7a-22ae41f3ff16-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.288431 master-0 kubenswrapper[35367]: I1204 12:07:10.288148 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-console-serving-cert\") pod \"console-64cdd44ddd-2t62p\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.288431 master-0 kubenswrapper[35367]: I1204 12:07:10.288364 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4c8907fe-87b6-4290-af7a-22ae41f3ff16-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c5fbf6b84-vvhts\" (UID: \"4c8907fe-87b6-4290-af7a-22ae41f3ff16\") " pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.299684 master-0 kubenswrapper[35367]: I1204 12:07:10.299502 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7fzr\" (UniqueName: \"kubernetes.io/projected/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-kube-api-access-p7fzr\") pod \"console-64cdd44ddd-2t62p\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.316880 master-0 kubenswrapper[35367]: I1204 12:07:10.316030 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-tnlxw" Dec 04 12:07:10.341842 master-0 kubenswrapper[35367]: I1204 12:07:10.340083 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-58f547f9c9-wnpsq"] Dec 04 12:07:10.391329 master-0 kubenswrapper[35367]: I1204 12:07:10.388889 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:10.482604 master-0 kubenswrapper[35367]: I1204 12:07:10.482034 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-tnlxw"] Dec 04 12:07:10.502041 master-0 kubenswrapper[35367]: I1204 12:07:10.501987 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:10.788637 master-0 kubenswrapper[35367]: I1204 12:07:10.788581 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" Dec 04 12:07:10.894535 master-0 kubenswrapper[35367]: I1204 12:07:10.894468 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5857974f64-4rstk"] Dec 04 12:07:10.928920 master-0 kubenswrapper[35367]: I1204 12:07:10.925391 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Dec 04 12:07:10.931931 master-0 kubenswrapper[35367]: W1204 12:07:10.931862 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod071abc3c_51a4_46ae_a2aa_35cf3bace606.slice/crio-cf3307b64c828a6ba168dafff01e4886df0d5fb9342ce0adfa51c782b7cacf9f WatchSource:0}: Error finding container cf3307b64c828a6ba168dafff01e4886df0d5fb9342ce0adfa51c782b7cacf9f: Status 404 returned error can't find the container with id cf3307b64c828a6ba168dafff01e4886df0d5fb9342ce0adfa51c782b7cacf9f Dec 04 12:07:10.951353 master-0 kubenswrapper[35367]: I1204 12:07:10.949761 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9qpq\" (UniqueName: \"kubernetes.io/projected/cee5f541-b365-478e-a24a-acf6168a45f6-kube-api-access-m9qpq\") pod \"cee5f541-b365-478e-a24a-acf6168a45f6\" (UID: \"cee5f541-b365-478e-a24a-acf6168a45f6\") " Dec 04 12:07:10.951353 master-0 kubenswrapper[35367]: I1204 12:07:10.949993 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cee5f541-b365-478e-a24a-acf6168a45f6-config\") pod \"cee5f541-b365-478e-a24a-acf6168a45f6\" (UID: \"cee5f541-b365-478e-a24a-acf6168a45f6\") " Dec 04 12:07:10.951353 master-0 kubenswrapper[35367]: I1204 12:07:10.950113 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/cee5f541-b365-478e-a24a-acf6168a45f6-client-ca\") pod \"cee5f541-b365-478e-a24a-acf6168a45f6\" (UID: \"cee5f541-b365-478e-a24a-acf6168a45f6\") " Dec 04 12:07:10.951353 master-0 kubenswrapper[35367]: I1204 12:07:10.950206 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cee5f541-b365-478e-a24a-acf6168a45f6-serving-cert\") pod \"cee5f541-b365-478e-a24a-acf6168a45f6\" (UID: \"cee5f541-b365-478e-a24a-acf6168a45f6\") " Dec 04 12:07:10.955503 master-0 kubenswrapper[35367]: I1204 12:07:10.955434 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cee5f541-b365-478e-a24a-acf6168a45f6-config" (OuterVolumeSpecName: "config") pod "cee5f541-b365-478e-a24a-acf6168a45f6" (UID: "cee5f541-b365-478e-a24a-acf6168a45f6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:07:10.958534 master-0 kubenswrapper[35367]: I1204 12:07:10.956742 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cee5f541-b365-478e-a24a-acf6168a45f6-client-ca" (OuterVolumeSpecName: "client-ca") pod "cee5f541-b365-478e-a24a-acf6168a45f6" (UID: "cee5f541-b365-478e-a24a-acf6168a45f6"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:07:10.962015 master-0 kubenswrapper[35367]: I1204 12:07:10.961934 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cee5f541-b365-478e-a24a-acf6168a45f6-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "cee5f541-b365-478e-a24a-acf6168a45f6" (UID: "cee5f541-b365-478e-a24a-acf6168a45f6"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:07:10.962015 master-0 kubenswrapper[35367]: I1204 12:07:10.961955 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cee5f541-b365-478e-a24a-acf6168a45f6-kube-api-access-m9qpq" (OuterVolumeSpecName: "kube-api-access-m9qpq") pod "cee5f541-b365-478e-a24a-acf6168a45f6" (UID: "cee5f541-b365-478e-a24a-acf6168a45f6"). InnerVolumeSpecName "kube-api-access-m9qpq". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:07:11.044239 master-0 kubenswrapper[35367]: I1204 12:07:11.043884 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" Dec 04 12:07:11.053457 master-0 kubenswrapper[35367]: I1204 12:07:11.053349 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cee5f541-b365-478e-a24a-acf6168a45f6-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:11.053457 master-0 kubenswrapper[35367]: I1204 12:07:11.053400 35367 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/cee5f541-b365-478e-a24a-acf6168a45f6-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:11.053457 master-0 kubenswrapper[35367]: I1204 12:07:11.053414 35367 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cee5f541-b365-478e-a24a-acf6168a45f6-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:11.053457 master-0 kubenswrapper[35367]: I1204 12:07:11.053427 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-m9qpq\" (UniqueName: \"kubernetes.io/projected/cee5f541-b365-478e-a24a-acf6168a45f6-kube-api-access-m9qpq\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:11.126741 master-0 kubenswrapper[35367]: I1204 12:07:11.126308 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-88f9c775c-fw4ls"] Dec 04 12:07:11.135417 master-0 kubenswrapper[35367]: W1204 12:07:11.135364 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode173cc4d_77b4_4af3_94b7_e9fc4f8db701.slice/crio-b842ac46b994fe81a62edf21191360731dd6d1b97587fb4a6c0eede2fc41567e WatchSource:0}: Error finding container b842ac46b994fe81a62edf21191360731dd6d1b97587fb4a6c0eede2fc41567e: Status 404 returned error can't find the container with id b842ac46b994fe81a62edf21191360731dd6d1b97587fb4a6c0eede2fc41567e Dec 04 12:07:11.155207 master-0 kubenswrapper[35367]: I1204 12:07:11.154577 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45556\" (UniqueName: \"kubernetes.io/projected/8e747fb0-b135-4ca9-9b96-568d3af886e6-kube-api-access-45556\") pod \"8e747fb0-b135-4ca9-9b96-568d3af886e6\" (UID: \"8e747fb0-b135-4ca9-9b96-568d3af886e6\") " Dec 04 12:07:11.155207 master-0 kubenswrapper[35367]: I1204 12:07:11.154936 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/8e747fb0-b135-4ca9-9b96-568d3af886e6-client-ca\") pod \"8e747fb0-b135-4ca9-9b96-568d3af886e6\" (UID: \"8e747fb0-b135-4ca9-9b96-568d3af886e6\") " Dec 04 12:07:11.155207 master-0 kubenswrapper[35367]: I1204 12:07:11.155042 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e747fb0-b135-4ca9-9b96-568d3af886e6-serving-cert\") pod \"8e747fb0-b135-4ca9-9b96-568d3af886e6\" (UID: \"8e747fb0-b135-4ca9-9b96-568d3af886e6\") " Dec 04 12:07:11.160411 master-0 kubenswrapper[35367]: I1204 12:07:11.159937 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e747fb0-b135-4ca9-9b96-568d3af886e6-client-ca" (OuterVolumeSpecName: "client-ca") pod "8e747fb0-b135-4ca9-9b96-568d3af886e6" (UID: "8e747fb0-b135-4ca9-9b96-568d3af886e6"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:07:11.161160 master-0 kubenswrapper[35367]: I1204 12:07:11.160906 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e747fb0-b135-4ca9-9b96-568d3af886e6-config\") pod \"8e747fb0-b135-4ca9-9b96-568d3af886e6\" (UID: \"8e747fb0-b135-4ca9-9b96-568d3af886e6\") " Dec 04 12:07:11.161160 master-0 kubenswrapper[35367]: I1204 12:07:11.160982 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/8e747fb0-b135-4ca9-9b96-568d3af886e6-proxy-ca-bundles\") pod \"8e747fb0-b135-4ca9-9b96-568d3af886e6\" (UID: \"8e747fb0-b135-4ca9-9b96-568d3af886e6\") " Dec 04 12:07:11.162055 master-0 kubenswrapper[35367]: I1204 12:07:11.162006 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e747fb0-b135-4ca9-9b96-568d3af886e6-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "8e747fb0-b135-4ca9-9b96-568d3af886e6" (UID: "8e747fb0-b135-4ca9-9b96-568d3af886e6"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:07:11.162692 master-0 kubenswrapper[35367]: I1204 12:07:11.162651 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e747fb0-b135-4ca9-9b96-568d3af886e6-config" (OuterVolumeSpecName: "config") pod "8e747fb0-b135-4ca9-9b96-568d3af886e6" (UID: "8e747fb0-b135-4ca9-9b96-568d3af886e6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:07:11.163441 master-0 kubenswrapper[35367]: I1204 12:07:11.163405 35367 reconciler_common.go:293] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/8e747fb0-b135-4ca9-9b96-568d3af886e6-proxy-ca-bundles\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:11.163623 master-0 kubenswrapper[35367]: I1204 12:07:11.163445 35367 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/8e747fb0-b135-4ca9-9b96-568d3af886e6-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:11.167279 master-0 kubenswrapper[35367]: I1204 12:07:11.167105 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e747fb0-b135-4ca9-9b96-568d3af886e6-kube-api-access-45556" (OuterVolumeSpecName: "kube-api-access-45556") pod "8e747fb0-b135-4ca9-9b96-568d3af886e6" (UID: "8e747fb0-b135-4ca9-9b96-568d3af886e6"). InnerVolumeSpecName "kube-api-access-45556". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:07:11.167279 master-0 kubenswrapper[35367]: I1204 12:07:11.167187 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e747fb0-b135-4ca9-9b96-568d3af886e6-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "8e747fb0-b135-4ca9-9b96-568d3af886e6" (UID: "8e747fb0-b135-4ca9-9b96-568d3af886e6"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:07:11.170026 master-0 kubenswrapper[35367]: I1204 12:07:11.169990 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8"] Dec 04 12:07:11.184580 master-0 kubenswrapper[35367]: I1204 12:07:11.184473 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Dec 04 12:07:11.200920 master-0 kubenswrapper[35367]: I1204 12:07:11.200737 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-5dcd7f7489-ts824"] Dec 04 12:07:11.201261 master-0 kubenswrapper[35367]: E1204 12:07:11.201238 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8e747fb0-b135-4ca9-9b96-568d3af886e6" containerName="controller-manager" Dec 04 12:07:11.201261 master-0 kubenswrapper[35367]: I1204 12:07:11.201259 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e747fb0-b135-4ca9-9b96-568d3af886e6" containerName="controller-manager" Dec 04 12:07:11.201422 master-0 kubenswrapper[35367]: E1204 12:07:11.201299 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cee5f541-b365-478e-a24a-acf6168a45f6" containerName="route-controller-manager" Dec 04 12:07:11.201422 master-0 kubenswrapper[35367]: I1204 12:07:11.201309 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="cee5f541-b365-478e-a24a-acf6168a45f6" containerName="route-controller-manager" Dec 04 12:07:11.201540 master-0 kubenswrapper[35367]: I1204 12:07:11.201482 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="8e747fb0-b135-4ca9-9b96-568d3af886e6" containerName="controller-manager" Dec 04 12:07:11.201575 master-0 kubenswrapper[35367]: I1204 12:07:11.201547 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="cee5f541-b365-478e-a24a-acf6168a45f6" containerName="route-controller-manager" Dec 04 12:07:11.202233 master-0 kubenswrapper[35367]: I1204 12:07:11.202194 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-58f547f9c9-wnpsq" event={"ID":"898ad5e8-757e-4faa-a118-67eac3f76c73","Type":"ContainerStarted","Data":"9d07b4c26f2544e1e56ffd7fadb5ba8add178bde014db5f326ab03d46badeadb"} Dec 04 12:07:11.202342 master-0 kubenswrapper[35367]: I1204 12:07:11.202314 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" Dec 04 12:07:11.206376 master-0 kubenswrapper[35367]: I1204 12:07:11.205080 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" Dec 04 12:07:11.206376 master-0 kubenswrapper[35367]: I1204 12:07:11.205099 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t" event={"ID":"cee5f541-b365-478e-a24a-acf6168a45f6","Type":"ContainerDied","Data":"743763456c84f50ab7df9b4b65735bd4d104450531c29c6cf0dd14ad930d0464"} Dec 04 12:07:11.206376 master-0 kubenswrapper[35367]: I1204 12:07:11.205190 35367 scope.go:117] "RemoveContainer" containerID="2db28cab881bc989aacef20e329cba357eef899b9438ff67790f2c1e30162811" Dec 04 12:07:11.207943 master-0 kubenswrapper[35367]: I1204 12:07:11.207775 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8" event={"ID":"f40cbd35-aa53-4e7c-82c1-3abc0455cf51","Type":"ContainerStarted","Data":"a55c22598e508015b0e6029c0feebdaa8f4585f73d073f009859a12bbd47e3c5"} Dec 04 12:07:11.210916 master-0 kubenswrapper[35367]: I1204 12:07:11.210567 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136126db-b6ad-440f-8add-e9e206ec25c6","Type":"ContainerStarted","Data":"8b3032b48cc2869a9eea4e05ca18a1d61a10c8efa21193017124190727356777"} Dec 04 12:07:11.213931 master-0 kubenswrapper[35367]: I1204 12:07:11.213667 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" event={"ID":"e173cc4d-77b4-4af3-94b7-e9fc4f8db701","Type":"ContainerStarted","Data":"b842ac46b994fe81a62edf21191360731dd6d1b97587fb4a6c0eede2fc41567e"} Dec 04 12:07:11.217969 master-0 kubenswrapper[35367]: I1204 12:07:11.215204 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z89ck" event={"ID":"2d3a9769-2a09-41ce-b1ab-6fe3bd192832","Type":"ContainerStarted","Data":"10c84ee785d9c1bb5afd45028d205883cb15c905addd1f22a6f1d490744646ec"} Dec 04 12:07:11.217969 master-0 kubenswrapper[35367]: I1204 12:07:11.216543 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" event={"ID":"8e747fb0-b135-4ca9-9b96-568d3af886e6","Type":"ContainerDied","Data":"f460809602aa60a1ac3335076e2a9ce34a1eab441f225b236fdc94c9de1db2e3"} Dec 04 12:07:11.217969 master-0 kubenswrapper[35367]: I1204 12:07:11.216638 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-b644f86d6-mvlh8" Dec 04 12:07:11.219548 master-0 kubenswrapper[35367]: I1204 12:07:11.219438 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" event={"ID":"071abc3c-51a4-46ae-a2aa-35cf3bace606","Type":"ContainerStarted","Data":"cf3307b64c828a6ba168dafff01e4886df0d5fb9342ce0adfa51c782b7cacf9f"} Dec 04 12:07:11.222705 master-0 kubenswrapper[35367]: I1204 12:07:11.222660 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39b763e-1e11-489e-bfef-df396e96d6b8","Type":"ContainerStarted","Data":"e6f4556655dde2062eebb1de6477b0604f520a3a7c7383e5063ea2de5338cc20"} Dec 04 12:07:11.223910 master-0 kubenswrapper[35367]: I1204 12:07:11.223721 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk"] Dec 04 12:07:11.228268 master-0 kubenswrapper[35367]: I1204 12:07:11.228195 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk" Dec 04 12:07:11.231613 master-0 kubenswrapper[35367]: I1204 12:07:11.230877 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"config" Dec 04 12:07:11.233889 master-0 kubenswrapper[35367]: I1204 12:07:11.231995 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Dec 04 12:07:11.233889 master-0 kubenswrapper[35367]: I1204 12:07:11.233509 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"client-ca" Dec 04 12:07:11.234657 master-0 kubenswrapper[35367]: I1204 12:07:11.234546 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"route-controller-manager-sa-dockercfg-qzw27" Dec 04 12:07:11.235306 master-0 kubenswrapper[35367]: I1204 12:07:11.235001 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"openshift-service-ca.crt" Dec 04 12:07:11.235306 master-0 kubenswrapper[35367]: I1204 12:07:11.235222 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"kube-root-ca.crt" Dec 04 12:07:11.250868 master-0 kubenswrapper[35367]: I1204 12:07:11.246166 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-5dcd7f7489-ts824"] Dec 04 12:07:11.250868 master-0 kubenswrapper[35367]: I1204 12:07:11.249781 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk"] Dec 04 12:07:11.260546 master-0 kubenswrapper[35367]: I1204 12:07:11.260511 35367 scope.go:117] "RemoveContainer" containerID="49a0d6309ed6f8f2bc43f4f7f9b511f214d6ee6fdde8b845d34d939e22a42db1" Dec 04 12:07:11.272378 master-0 kubenswrapper[35367]: I1204 12:07:11.272309 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a8880cb-61ca-4885-b911-14a6d51896af-serving-cert\") pod \"controller-manager-5dcd7f7489-ts824\" (UID: \"8a8880cb-61ca-4885-b911-14a6d51896af\") " pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" Dec 04 12:07:11.272644 master-0 kubenswrapper[35367]: I1204 12:07:11.272610 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/8a8880cb-61ca-4885-b911-14a6d51896af-client-ca\") pod \"controller-manager-5dcd7f7489-ts824\" (UID: \"8a8880cb-61ca-4885-b911-14a6d51896af\") " pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" Dec 04 12:07:11.272744 master-0 kubenswrapper[35367]: I1204 12:07:11.272718 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsnfr\" (UniqueName: \"kubernetes.io/projected/8a8880cb-61ca-4885-b911-14a6d51896af-kube-api-access-rsnfr\") pod \"controller-manager-5dcd7f7489-ts824\" (UID: \"8a8880cb-61ca-4885-b911-14a6d51896af\") " pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" Dec 04 12:07:11.272823 master-0 kubenswrapper[35367]: I1204 12:07:11.272751 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/8a8880cb-61ca-4885-b911-14a6d51896af-proxy-ca-bundles\") pod \"controller-manager-5dcd7f7489-ts824\" (UID: \"8a8880cb-61ca-4885-b911-14a6d51896af\") " pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" Dec 04 12:07:11.272823 master-0 kubenswrapper[35367]: I1204 12:07:11.272774 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a8880cb-61ca-4885-b911-14a6d51896af-config\") pod \"controller-manager-5dcd7f7489-ts824\" (UID: \"8a8880cb-61ca-4885-b911-14a6d51896af\") " pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" Dec 04 12:07:11.272924 master-0 kubenswrapper[35367]: I1204 12:07:11.272871 35367 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e747fb0-b135-4ca9-9b96-568d3af886e6-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:11.272924 master-0 kubenswrapper[35367]: I1204 12:07:11.272883 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e747fb0-b135-4ca9-9b96-568d3af886e6-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:11.272924 master-0 kubenswrapper[35367]: I1204 12:07:11.272893 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-45556\" (UniqueName: \"kubernetes.io/projected/8e747fb0-b135-4ca9-9b96-568d3af886e6-kube-api-access-45556\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:11.326222 master-0 kubenswrapper[35367]: I1204 12:07:11.320306 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t"] Dec 04 12:07:11.358378 master-0 kubenswrapper[35367]: I1204 12:07:11.358337 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-557cff67c-7qs6t"] Dec 04 12:07:11.369696 master-0 kubenswrapper[35367]: I1204 12:07:11.369610 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts"] Dec 04 12:07:11.374834 master-0 kubenswrapper[35367]: I1204 12:07:11.374099 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd449d33-b67b-427f-9578-8ab72f22fce4-serving-cert\") pod \"route-controller-manager-74fbf9d4cf-77szk\" (UID: \"cd449d33-b67b-427f-9578-8ab72f22fce4\") " pod="openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk" Dec 04 12:07:11.374834 master-0 kubenswrapper[35367]: I1204 12:07:11.374187 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/cd449d33-b67b-427f-9578-8ab72f22fce4-client-ca\") pod \"route-controller-manager-74fbf9d4cf-77szk\" (UID: \"cd449d33-b67b-427f-9578-8ab72f22fce4\") " pod="openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk" Dec 04 12:07:11.374834 master-0 kubenswrapper[35367]: I1204 12:07:11.374352 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/8a8880cb-61ca-4885-b911-14a6d51896af-client-ca\") pod \"controller-manager-5dcd7f7489-ts824\" (UID: \"8a8880cb-61ca-4885-b911-14a6d51896af\") " pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" Dec 04 12:07:11.374834 master-0 kubenswrapper[35367]: I1204 12:07:11.374388 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp96c\" (UniqueName: \"kubernetes.io/projected/cd449d33-b67b-427f-9578-8ab72f22fce4-kube-api-access-xp96c\") pod \"route-controller-manager-74fbf9d4cf-77szk\" (UID: \"cd449d33-b67b-427f-9578-8ab72f22fce4\") " pod="openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk" Dec 04 12:07:11.374834 master-0 kubenswrapper[35367]: I1204 12:07:11.374419 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd449d33-b67b-427f-9578-8ab72f22fce4-config\") pod \"route-controller-manager-74fbf9d4cf-77szk\" (UID: \"cd449d33-b67b-427f-9578-8ab72f22fce4\") " pod="openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk" Dec 04 12:07:11.374834 master-0 kubenswrapper[35367]: I1204 12:07:11.374472 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rsnfr\" (UniqueName: \"kubernetes.io/projected/8a8880cb-61ca-4885-b911-14a6d51896af-kube-api-access-rsnfr\") pod \"controller-manager-5dcd7f7489-ts824\" (UID: \"8a8880cb-61ca-4885-b911-14a6d51896af\") " pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" Dec 04 12:07:11.374834 master-0 kubenswrapper[35367]: I1204 12:07:11.374508 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/8a8880cb-61ca-4885-b911-14a6d51896af-proxy-ca-bundles\") pod \"controller-manager-5dcd7f7489-ts824\" (UID: \"8a8880cb-61ca-4885-b911-14a6d51896af\") " pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" Dec 04 12:07:11.374834 master-0 kubenswrapper[35367]: I1204 12:07:11.374539 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a8880cb-61ca-4885-b911-14a6d51896af-config\") pod \"controller-manager-5dcd7f7489-ts824\" (UID: \"8a8880cb-61ca-4885-b911-14a6d51896af\") " pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" Dec 04 12:07:11.376213 master-0 kubenswrapper[35367]: I1204 12:07:11.375616 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a8880cb-61ca-4885-b911-14a6d51896af-serving-cert\") pod \"controller-manager-5dcd7f7489-ts824\" (UID: \"8a8880cb-61ca-4885-b911-14a6d51896af\") " pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" Dec 04 12:07:11.376213 master-0 kubenswrapper[35367]: I1204 12:07:11.375766 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/8a8880cb-61ca-4885-b911-14a6d51896af-client-ca\") pod \"controller-manager-5dcd7f7489-ts824\" (UID: \"8a8880cb-61ca-4885-b911-14a6d51896af\") " pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" Dec 04 12:07:11.378229 master-0 kubenswrapper[35367]: I1204 12:07:11.378186 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/8a8880cb-61ca-4885-b911-14a6d51896af-proxy-ca-bundles\") pod \"controller-manager-5dcd7f7489-ts824\" (UID: \"8a8880cb-61ca-4885-b911-14a6d51896af\") " pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" Dec 04 12:07:11.379051 master-0 kubenswrapper[35367]: I1204 12:07:11.379015 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a8880cb-61ca-4885-b911-14a6d51896af-config\") pod \"controller-manager-5dcd7f7489-ts824\" (UID: \"8a8880cb-61ca-4885-b911-14a6d51896af\") " pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" Dec 04 12:07:11.387149 master-0 kubenswrapper[35367]: I1204 12:07:11.387085 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a8880cb-61ca-4885-b911-14a6d51896af-serving-cert\") pod \"controller-manager-5dcd7f7489-ts824\" (UID: \"8a8880cb-61ca-4885-b911-14a6d51896af\") " pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" Dec 04 12:07:11.387311 master-0 kubenswrapper[35367]: I1204 12:07:11.387157 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64cdd44ddd-2t62p"] Dec 04 12:07:11.394702 master-0 kubenswrapper[35367]: I1204 12:07:11.394640 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsnfr\" (UniqueName: \"kubernetes.io/projected/8a8880cb-61ca-4885-b911-14a6d51896af-kube-api-access-rsnfr\") pod \"controller-manager-5dcd7f7489-ts824\" (UID: \"8a8880cb-61ca-4885-b911-14a6d51896af\") " pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" Dec 04 12:07:11.418309 master-0 kubenswrapper[35367]: I1204 12:07:11.418248 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-b644f86d6-mvlh8"] Dec 04 12:07:11.427091 master-0 kubenswrapper[35367]: I1204 12:07:11.427029 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7487d49bdb-7f2xj"] Dec 04 12:07:11.435959 master-0 kubenswrapper[35367]: I1204 12:07:11.435875 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-controller-manager/controller-manager-b644f86d6-mvlh8"] Dec 04 12:07:11.477630 master-0 kubenswrapper[35367]: I1204 12:07:11.477562 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd449d33-b67b-427f-9578-8ab72f22fce4-serving-cert\") pod \"route-controller-manager-74fbf9d4cf-77szk\" (UID: \"cd449d33-b67b-427f-9578-8ab72f22fce4\") " pod="openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk" Dec 04 12:07:11.477630 master-0 kubenswrapper[35367]: I1204 12:07:11.477619 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/cd449d33-b67b-427f-9578-8ab72f22fce4-client-ca\") pod \"route-controller-manager-74fbf9d4cf-77szk\" (UID: \"cd449d33-b67b-427f-9578-8ab72f22fce4\") " pod="openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk" Dec 04 12:07:11.478047 master-0 kubenswrapper[35367]: I1204 12:07:11.477669 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xp96c\" (UniqueName: \"kubernetes.io/projected/cd449d33-b67b-427f-9578-8ab72f22fce4-kube-api-access-xp96c\") pod \"route-controller-manager-74fbf9d4cf-77szk\" (UID: \"cd449d33-b67b-427f-9578-8ab72f22fce4\") " pod="openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk" Dec 04 12:07:11.478047 master-0 kubenswrapper[35367]: I1204 12:07:11.477718 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd449d33-b67b-427f-9578-8ab72f22fce4-config\") pod \"route-controller-manager-74fbf9d4cf-77szk\" (UID: \"cd449d33-b67b-427f-9578-8ab72f22fce4\") " pod="openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk" Dec 04 12:07:11.479241 master-0 kubenswrapper[35367]: I1204 12:07:11.479190 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd449d33-b67b-427f-9578-8ab72f22fce4-config\") pod \"route-controller-manager-74fbf9d4cf-77szk\" (UID: \"cd449d33-b67b-427f-9578-8ab72f22fce4\") " pod="openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk" Dec 04 12:07:11.481045 master-0 kubenswrapper[35367]: I1204 12:07:11.479775 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/cd449d33-b67b-427f-9578-8ab72f22fce4-client-ca\") pod \"route-controller-manager-74fbf9d4cf-77szk\" (UID: \"cd449d33-b67b-427f-9578-8ab72f22fce4\") " pod="openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk" Dec 04 12:07:11.484633 master-0 kubenswrapper[35367]: I1204 12:07:11.484577 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd449d33-b67b-427f-9578-8ab72f22fce4-serving-cert\") pod \"route-controller-manager-74fbf9d4cf-77szk\" (UID: \"cd449d33-b67b-427f-9578-8ab72f22fce4\") " pod="openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk" Dec 04 12:07:11.498535 master-0 kubenswrapper[35367]: I1204 12:07:11.498418 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp96c\" (UniqueName: \"kubernetes.io/projected/cd449d33-b67b-427f-9578-8ab72f22fce4-kube-api-access-xp96c\") pod \"route-controller-manager-74fbf9d4cf-77szk\" (UID: \"cd449d33-b67b-427f-9578-8ab72f22fce4\") " pod="openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk" Dec 04 12:07:11.570025 master-0 kubenswrapper[35367]: I1204 12:07:11.569946 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" Dec 04 12:07:11.608331 master-0 kubenswrapper[35367]: I1204 12:07:11.608273 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk" Dec 04 12:07:12.234421 master-0 kubenswrapper[35367]: I1204 12:07:12.234350 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8" event={"ID":"f40cbd35-aa53-4e7c-82c1-3abc0455cf51","Type":"ContainerStarted","Data":"ab0eb807e8e21e95b9dbf61b3cc2af0583d8b2ed5966751d8d46991c9bd631b9"} Dec 04 12:07:12.234421 master-0 kubenswrapper[35367]: I1204 12:07:12.234419 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8" event={"ID":"f40cbd35-aa53-4e7c-82c1-3abc0455cf51","Type":"ContainerStarted","Data":"9e31dd468f4f985b7dc33c42dac10480272bf003b04a37dc1b6ad0c5f3f8ca35"} Dec 04 12:07:12.236200 master-0 kubenswrapper[35367]: I1204 12:07:12.236147 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64cdd44ddd-2t62p" event={"ID":"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8","Type":"ContainerStarted","Data":"52a0c355bee98dc1c509350cb5cc16a9089b917d04373250deeb902fb9b69101"} Dec 04 12:07:12.236200 master-0 kubenswrapper[35367]: I1204 12:07:12.236196 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64cdd44ddd-2t62p" event={"ID":"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8","Type":"ContainerStarted","Data":"398df05d7ca6580f264cbc6b63ffb19d9e2b2347a38fe0e86f54edc2900c117f"} Dec 04 12:07:12.239489 master-0 kubenswrapper[35367]: I1204 12:07:12.239447 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" event={"ID":"4c8907fe-87b6-4290-af7a-22ae41f3ff16","Type":"ContainerStarted","Data":"7f69cfe4d3563ac58bddba8c44548c6cfac4258dff2dd1f8aa4b36777b1f16af"} Dec 04 12:07:12.240479 master-0 kubenswrapper[35367]: I1204 12:07:12.240437 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" event={"ID":"6546d9a8-710e-4166-a36f-cea7ba5ba41c","Type":"ContainerStarted","Data":"b08f0d559a4bd5dd1c89f0aed5f5c48c4c180bef24a644f6657fc2e6c9f2f615"} Dec 04 12:07:12.242015 master-0 kubenswrapper[35367]: I1204 12:07:12.241947 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-tnlxw" podUID="38307089-8577-4193-b461-4ebb13fd7d95" containerName="registry-server" containerID="cri-o://8a834fb932328595704942ed808a81044805ae6d021e288b70c283c900372be2" gracePeriod=2 Dec 04 12:07:12.326391 master-0 kubenswrapper[35367]: I1204 12:07:12.325416 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-64cdd44ddd-2t62p" podStartSLOduration=3.325401223 podStartE2EDuration="3.325401223s" podCreationTimestamp="2025-12-04 12:07:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:07:12.321711957 +0000 UTC m=+475.759773215" watchObservedRunningTime="2025-12-04 12:07:12.325401223 +0000 UTC m=+475.763462481" Dec 04 12:07:12.761834 master-0 kubenswrapper[35367]: I1204 12:07:12.761767 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e747fb0-b135-4ca9-9b96-568d3af886e6" path="/var/lib/kubelet/pods/8e747fb0-b135-4ca9-9b96-568d3af886e6/volumes" Dec 04 12:07:12.762559 master-0 kubenswrapper[35367]: I1204 12:07:12.762539 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cee5f541-b365-478e-a24a-acf6168a45f6" path="/var/lib/kubelet/pods/cee5f541-b365-478e-a24a-acf6168a45f6/volumes" Dec 04 12:07:13.255191 master-0 kubenswrapper[35367]: I1204 12:07:13.255108 35367 generic.go:334] "Generic (PLEG): container finished" podID="38307089-8577-4193-b461-4ebb13fd7d95" containerID="8a834fb932328595704942ed808a81044805ae6d021e288b70c283c900372be2" exitCode=0 Dec 04 12:07:13.255454 master-0 kubenswrapper[35367]: I1204 12:07:13.255221 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-tnlxw" event={"ID":"38307089-8577-4193-b461-4ebb13fd7d95","Type":"ContainerDied","Data":"8a834fb932328595704942ed808a81044805ae6d021e288b70c283c900372be2"} Dec 04 12:07:13.627827 master-0 kubenswrapper[35367]: I1204 12:07:13.627780 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-tnlxw" Dec 04 12:07:13.721942 master-0 kubenswrapper[35367]: I1204 12:07:13.721896 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mdnd\" (UniqueName: \"kubernetes.io/projected/38307089-8577-4193-b461-4ebb13fd7d95-kube-api-access-8mdnd\") pod \"38307089-8577-4193-b461-4ebb13fd7d95\" (UID: \"38307089-8577-4193-b461-4ebb13fd7d95\") " Dec 04 12:07:13.722059 master-0 kubenswrapper[35367]: I1204 12:07:13.721950 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/38307089-8577-4193-b461-4ebb13fd7d95-utilities\") pod \"38307089-8577-4193-b461-4ebb13fd7d95\" (UID: \"38307089-8577-4193-b461-4ebb13fd7d95\") " Dec 04 12:07:13.722200 master-0 kubenswrapper[35367]: I1204 12:07:13.722174 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/38307089-8577-4193-b461-4ebb13fd7d95-catalog-content\") pod \"38307089-8577-4193-b461-4ebb13fd7d95\" (UID: \"38307089-8577-4193-b461-4ebb13fd7d95\") " Dec 04 12:07:13.723065 master-0 kubenswrapper[35367]: I1204 12:07:13.723015 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38307089-8577-4193-b461-4ebb13fd7d95-utilities" (OuterVolumeSpecName: "utilities") pod "38307089-8577-4193-b461-4ebb13fd7d95" (UID: "38307089-8577-4193-b461-4ebb13fd7d95"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:07:13.725386 master-0 kubenswrapper[35367]: I1204 12:07:13.725298 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38307089-8577-4193-b461-4ebb13fd7d95-kube-api-access-8mdnd" (OuterVolumeSpecName: "kube-api-access-8mdnd") pod "38307089-8577-4193-b461-4ebb13fd7d95" (UID: "38307089-8577-4193-b461-4ebb13fd7d95"). InnerVolumeSpecName "kube-api-access-8mdnd". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:07:13.777347 master-0 kubenswrapper[35367]: I1204 12:07:13.777213 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38307089-8577-4193-b461-4ebb13fd7d95-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "38307089-8577-4193-b461-4ebb13fd7d95" (UID: "38307089-8577-4193-b461-4ebb13fd7d95"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:07:13.825192 master-0 kubenswrapper[35367]: I1204 12:07:13.825135 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/38307089-8577-4193-b461-4ebb13fd7d95-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:13.825192 master-0 kubenswrapper[35367]: I1204 12:07:13.825182 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8mdnd\" (UniqueName: \"kubernetes.io/projected/38307089-8577-4193-b461-4ebb13fd7d95-kube-api-access-8mdnd\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:13.825192 master-0 kubenswrapper[35367]: I1204 12:07:13.825199 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/38307089-8577-4193-b461-4ebb13fd7d95-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:13.938536 master-0 kubenswrapper[35367]: I1204 12:07:13.938460 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk"] Dec 04 12:07:14.265380 master-0 kubenswrapper[35367]: I1204 12:07:14.265328 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-tnlxw" event={"ID":"38307089-8577-4193-b461-4ebb13fd7d95","Type":"ContainerDied","Data":"53765bf5ef375a97c7d89746ff5ac949e2994758c10157cbcad9dcdbe717748c"} Dec 04 12:07:14.265380 master-0 kubenswrapper[35367]: I1204 12:07:14.265387 35367 scope.go:117] "RemoveContainer" containerID="8a834fb932328595704942ed808a81044805ae6d021e288b70c283c900372be2" Dec 04 12:07:14.265633 master-0 kubenswrapper[35367]: I1204 12:07:14.265397 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-tnlxw" Dec 04 12:07:14.329698 master-0 kubenswrapper[35367]: I1204 12:07:14.329640 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-tnlxw"] Dec 04 12:07:14.338140 master-0 kubenswrapper[35367]: I1204 12:07:14.338075 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-tnlxw"] Dec 04 12:07:14.756648 master-0 kubenswrapper[35367]: I1204 12:07:14.756582 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38307089-8577-4193-b461-4ebb13fd7d95" path="/var/lib/kubelet/pods/38307089-8577-4193-b461-4ebb13fd7d95/volumes" Dec 04 12:07:15.561236 master-0 kubenswrapper[35367]: W1204 12:07:15.561168 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd449d33_b67b_427f_9578_8ab72f22fce4.slice/crio-a76d70628ee44771e22102fbc4be51e01d03c7cf8aadbb65adc6d466433b8621 WatchSource:0}: Error finding container a76d70628ee44771e22102fbc4be51e01d03c7cf8aadbb65adc6d466433b8621: Status 404 returned error can't find the container with id a76d70628ee44771e22102fbc4be51e01d03c7cf8aadbb65adc6d466433b8621 Dec 04 12:07:15.667356 master-0 kubenswrapper[35367]: I1204 12:07:15.667283 35367 scope.go:117] "RemoveContainer" containerID="b35de08ed21af77e058c43d185ac3318dd6c20f1bbb40d3e4a65afbc80cbdab9" Dec 04 12:07:15.694588 master-0 kubenswrapper[35367]: I1204 12:07:15.694555 35367 scope.go:117] "RemoveContainer" containerID="74c289df40e104efa62f1178e78b085885edaa95b08a947f24eb46e2207819ef" Dec 04 12:07:15.941996 master-0 kubenswrapper[35367]: I1204 12:07:15.941939 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-5dcd7f7489-ts824"] Dec 04 12:07:15.966271 master-0 kubenswrapper[35367]: W1204 12:07:15.966191 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a8880cb_61ca_4885_b911_14a6d51896af.slice/crio-60c41d7ff88fbbaecdf896cd4b0ce33adff7113b2e814649c9d1b3f4be7b9c6d WatchSource:0}: Error finding container 60c41d7ff88fbbaecdf896cd4b0ce33adff7113b2e814649c9d1b3f4be7b9c6d: Status 404 returned error can't find the container with id 60c41d7ff88fbbaecdf896cd4b0ce33adff7113b2e814649c9d1b3f4be7b9c6d Dec 04 12:07:16.285384 master-0 kubenswrapper[35367]: I1204 12:07:16.285318 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" event={"ID":"6546d9a8-710e-4166-a36f-cea7ba5ba41c","Type":"ContainerStarted","Data":"384da347a26d9b5964de5d18b925601adce77870532fce3fbca4c9ea127b4617"} Dec 04 12:07:16.298733 master-0 kubenswrapper[35367]: I1204 12:07:16.298677 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" event={"ID":"e173cc4d-77b4-4af3-94b7-e9fc4f8db701","Type":"ContainerStarted","Data":"829fed14c663c0b5b4107ac17866f40d2ef79a6cbc9a77edfeac61d9d12310b9"} Dec 04 12:07:16.311406 master-0 kubenswrapper[35367]: I1204 12:07:16.311356 35367 generic.go:334] "Generic (PLEG): container finished" podID="2d3a9769-2a09-41ce-b1ab-6fe3bd192832" containerID="0c816a95edc52d81580dd1214b6d34fb0e2961afcb76fd7a08b4c4efc5691bf5" exitCode=0 Dec 04 12:07:16.311601 master-0 kubenswrapper[35367]: I1204 12:07:16.311409 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z89ck" event={"ID":"2d3a9769-2a09-41ce-b1ab-6fe3bd192832","Type":"ContainerDied","Data":"0c816a95edc52d81580dd1214b6d34fb0e2961afcb76fd7a08b4c4efc5691bf5"} Dec 04 12:07:16.319045 master-0 kubenswrapper[35367]: I1204 12:07:16.318971 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" event={"ID":"8a8880cb-61ca-4885-b911-14a6d51896af","Type":"ContainerStarted","Data":"0273b1eda267fa5e084b4b0d9bb217ca6db0a725450375f7658ab2450fe17494"} Dec 04 12:07:16.319177 master-0 kubenswrapper[35367]: I1204 12:07:16.319045 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" event={"ID":"8a8880cb-61ca-4885-b911-14a6d51896af","Type":"ContainerStarted","Data":"60c41d7ff88fbbaecdf896cd4b0ce33adff7113b2e814649c9d1b3f4be7b9c6d"} Dec 04 12:07:16.319686 master-0 kubenswrapper[35367]: I1204 12:07:16.319618 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" Dec 04 12:07:16.322720 master-0 kubenswrapper[35367]: I1204 12:07:16.322606 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39b763e-1e11-489e-bfef-df396e96d6b8","Type":"ContainerStarted","Data":"d5449d9e93f204c3f451709d8a21cb9e3907020c8208cd54d6cda721f31ebdf5"} Dec 04 12:07:16.331664 master-0 kubenswrapper[35367]: I1204 12:07:16.325314 35367 patch_prober.go:28] interesting pod/controller-manager-5dcd7f7489-ts824 container/controller-manager namespace/openshift-controller-manager: Readiness probe status=failure output="Get \"https://10.128.0.114:8443/healthz\": dial tcp 10.128.0.114:8443: connect: connection refused" start-of-body= Dec 04 12:07:16.331664 master-0 kubenswrapper[35367]: I1204 12:07:16.325381 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" podUID="8a8880cb-61ca-4885-b911-14a6d51896af" containerName="controller-manager" probeResult="failure" output="Get \"https://10.128.0.114:8443/healthz\": dial tcp 10.128.0.114:8443: connect: connection refused" Dec 04 12:07:16.331664 master-0 kubenswrapper[35367]: I1204 12:07:16.330366 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk" event={"ID":"cd449d33-b67b-427f-9578-8ab72f22fce4","Type":"ContainerStarted","Data":"8e0cac8aae0ce05efca95d03a453c9acdd54abb252f041e49af9d960c1ddb445"} Dec 04 12:07:16.331664 master-0 kubenswrapper[35367]: I1204 12:07:16.330678 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk" event={"ID":"cd449d33-b67b-427f-9578-8ab72f22fce4","Type":"ContainerStarted","Data":"a76d70628ee44771e22102fbc4be51e01d03c7cf8aadbb65adc6d466433b8621"} Dec 04 12:07:16.331664 master-0 kubenswrapper[35367]: I1204 12:07:16.331357 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk" Dec 04 12:07:16.335618 master-0 kubenswrapper[35367]: I1204 12:07:16.335562 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" event={"ID":"4c8907fe-87b6-4290-af7a-22ae41f3ff16","Type":"ContainerStarted","Data":"9ec046b2cb7429912d81f0d72e615b80f9e58a1322428506ae2ae4a599a98078"} Dec 04 12:07:16.339154 master-0 kubenswrapper[35367]: I1204 12:07:16.339066 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" podStartSLOduration=2.7682639460000003 podStartE2EDuration="7.339039735s" podCreationTimestamp="2025-12-04 12:07:09 +0000 UTC" firstStartedPulling="2025-12-04 12:07:11.138548347 +0000 UTC m=+474.576609605" lastFinishedPulling="2025-12-04 12:07:15.709324146 +0000 UTC m=+479.147385394" observedRunningTime="2025-12-04 12:07:16.326182351 +0000 UTC m=+479.764243619" watchObservedRunningTime="2025-12-04 12:07:16.339039735 +0000 UTC m=+479.777100993" Dec 04 12:07:16.339418 master-0 kubenswrapper[35367]: I1204 12:07:16.339346 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" event={"ID":"071abc3c-51a4-46ae-a2aa-35cf3bace606","Type":"ContainerStarted","Data":"a663480f6bc1b7c7bf640e49086a09238e25c0e54e8d16bef1c0a9ea467e51b6"} Dec 04 12:07:16.339458 master-0 kubenswrapper[35367]: I1204 12:07:16.339439 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" event={"ID":"071abc3c-51a4-46ae-a2aa-35cf3bace606","Type":"ContainerStarted","Data":"940393bf039154c37d009bffcc9b4ba423abb6f19bfe5e185db202ffc2bc530e"} Dec 04 12:07:16.343721 master-0 kubenswrapper[35367]: I1204 12:07:16.342821 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8" event={"ID":"f40cbd35-aa53-4e7c-82c1-3abc0455cf51","Type":"ContainerStarted","Data":"3a2c75861cfe6b99755b43e1d35db459ebf2a34c9b92f484b39b73348fa0d25b"} Dec 04 12:07:16.350910 master-0 kubenswrapper[35367]: I1204 12:07:16.350445 35367 generic.go:334] "Generic (PLEG): container finished" podID="136126db-b6ad-440f-8add-e9e206ec25c6" containerID="5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6" exitCode=0 Dec 04 12:07:16.350910 master-0 kubenswrapper[35367]: I1204 12:07:16.350544 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136126db-b6ad-440f-8add-e9e206ec25c6","Type":"ContainerDied","Data":"5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6"} Dec 04 12:07:16.359685 master-0 kubenswrapper[35367]: I1204 12:07:16.359631 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk" Dec 04 12:07:16.375829 master-0 kubenswrapper[35367]: I1204 12:07:16.372387 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-58f547f9c9-wnpsq" event={"ID":"898ad5e8-757e-4faa-a118-67eac3f76c73","Type":"ContainerStarted","Data":"6f962a0ea1f371e51bff6569a0860738d452cfec33f5559ff68fd90061ebef2d"} Dec 04 12:07:16.375829 master-0 kubenswrapper[35367]: I1204 12:07:16.373039 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-monitoring/monitoring-plugin-58f547f9c9-wnpsq" Dec 04 12:07:16.375829 master-0 kubenswrapper[35367]: I1204 12:07:16.373469 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" podStartSLOduration=7.3734461079999996 podStartE2EDuration="7.373446108s" podCreationTimestamp="2025-12-04 12:07:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:07:16.362169723 +0000 UTC m=+479.800231001" watchObservedRunningTime="2025-12-04 12:07:16.373446108 +0000 UTC m=+479.811507366" Dec 04 12:07:16.409836 master-0 kubenswrapper[35367]: I1204 12:07:16.393139 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-58f547f9c9-wnpsq" Dec 04 12:07:16.654754 master-0 kubenswrapper[35367]: I1204 12:07:16.654653 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-route-controller-manager/route-controller-manager-74fbf9d4cf-77szk" podStartSLOduration=7.654622573 podStartE2EDuration="7.654622573s" podCreationTimestamp="2025-12-04 12:07:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:07:16.643563535 +0000 UTC m=+480.081624793" watchObservedRunningTime="2025-12-04 12:07:16.654622573 +0000 UTC m=+480.092683831" Dec 04 12:07:16.817611 master-0 kubenswrapper[35367]: I1204 12:07:16.817505 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-5974b6b869-5fzg8" podStartSLOduration=3.679918845 podStartE2EDuration="7.817477446s" podCreationTimestamp="2025-12-04 12:07:09 +0000 UTC" firstStartedPulling="2025-12-04 12:07:11.540615415 +0000 UTC m=+474.978676683" lastFinishedPulling="2025-12-04 12:07:15.678174026 +0000 UTC m=+479.116235284" observedRunningTime="2025-12-04 12:07:16.752543813 +0000 UTC m=+480.190605071" watchObservedRunningTime="2025-12-04 12:07:16.817477446 +0000 UTC m=+480.255538704" Dec 04 12:07:16.819657 master-0 kubenswrapper[35367]: I1204 12:07:16.819572 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-58f547f9c9-wnpsq" podStartSLOduration=2.614386756 podStartE2EDuration="7.819553322s" podCreationTimestamp="2025-12-04 12:07:09 +0000 UTC" firstStartedPulling="2025-12-04 12:07:10.378000601 +0000 UTC m=+473.816061869" lastFinishedPulling="2025-12-04 12:07:15.583167177 +0000 UTC m=+479.021228435" observedRunningTime="2025-12-04 12:07:16.80963915 +0000 UTC m=+480.247700418" watchObservedRunningTime="2025-12-04 12:07:16.819553322 +0000 UTC m=+480.257614580" Dec 04 12:07:17.226841 master-0 kubenswrapper[35367]: I1204 12:07:17.226544 35367 scope.go:117] "RemoveContainer" containerID="1dd3e9bec426604298540a62160aa04995ba35e82eac44c41bf666b47786e5c9" Dec 04 12:07:17.251971 master-0 kubenswrapper[35367]: I1204 12:07:17.251941 35367 scope.go:117] "RemoveContainer" containerID="e2713a2b9adf8ac2cd64c11a8cc47639892df9751d3f6828f4bd8b7f6c344a80" Dec 04 12:07:17.281214 master-0 kubenswrapper[35367]: I1204 12:07:17.278335 35367 scope.go:117] "RemoveContainer" containerID="f22a84f6fb348e29fba57d1a09fc02c20059513a38fe36937800076d569de9eb" Dec 04 12:07:17.389643 master-0 kubenswrapper[35367]: I1204 12:07:17.389572 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" event={"ID":"6546d9a8-710e-4166-a36f-cea7ba5ba41c","Type":"ContainerStarted","Data":"4fd22d7730efa5d2bff06534aec8f3abb8b9c29680b20d1a3e4f1804c3ffb3b8"} Dec 04 12:07:17.389643 master-0 kubenswrapper[35367]: I1204 12:07:17.389640 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" event={"ID":"6546d9a8-710e-4166-a36f-cea7ba5ba41c","Type":"ContainerStarted","Data":"940e453c7c114b0db7400fc601952bfe027554c3f8e5003d4319ce4c18aae72e"} Dec 04 12:07:17.395256 master-0 kubenswrapper[35367]: I1204 12:07:17.395197 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z89ck" event={"ID":"2d3a9769-2a09-41ce-b1ab-6fe3bd192832","Type":"ContainerStarted","Data":"6ab80f7f70a0a8eec5acc5cc01b930d9e6f63dbadd8de34d82f56bc859ba4346"} Dec 04 12:07:17.395256 master-0 kubenswrapper[35367]: I1204 12:07:17.395258 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z89ck" event={"ID":"2d3a9769-2a09-41ce-b1ab-6fe3bd192832","Type":"ContainerStarted","Data":"3a373d6b889cb969b00ed40e9b173d65f73c546e9444a30127466eb1838fe095"} Dec 04 12:07:17.399593 master-0 kubenswrapper[35367]: I1204 12:07:17.399544 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" event={"ID":"071abc3c-51a4-46ae-a2aa-35cf3bace606","Type":"ContainerStarted","Data":"8400cfbd25c6e529df7314a4393b7d21ac16e53067bdab9d03417b33e5551067"} Dec 04 12:07:17.403617 master-0 kubenswrapper[35367]: I1204 12:07:17.403561 35367 generic.go:334] "Generic (PLEG): container finished" podID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerID="d5449d9e93f204c3f451709d8a21cb9e3907020c8208cd54d6cda721f31ebdf5" exitCode=0 Dec 04 12:07:17.403706 master-0 kubenswrapper[35367]: I1204 12:07:17.403640 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39b763e-1e11-489e-bfef-df396e96d6b8","Type":"ContainerDied","Data":"d5449d9e93f204c3f451709d8a21cb9e3907020c8208cd54d6cda721f31ebdf5"} Dec 04 12:07:17.407920 master-0 kubenswrapper[35367]: I1204 12:07:17.407796 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" event={"ID":"4c8907fe-87b6-4290-af7a-22ae41f3ff16","Type":"ContainerStarted","Data":"6eef4779eb4644d997d2709c30d6a9f6cbc66cbf8bc32f0eb40c26eed491747b"} Dec 04 12:07:17.408023 master-0 kubenswrapper[35367]: I1204 12:07:17.407923 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" event={"ID":"4c8907fe-87b6-4290-af7a-22ae41f3ff16","Type":"ContainerStarted","Data":"a53ad19cda0ea9aa89bdac001f86f0cca480018d60f3695595424a8e195d37fc"} Dec 04 12:07:17.417075 master-0 kubenswrapper[35367]: I1204 12:07:17.415713 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_openshift-kube-scheduler-master-0_bdd20c68f1ccfd1240fb273af0638d01/kube-scheduler-cert-syncer/2.log" Dec 04 12:07:17.430101 master-0 kubenswrapper[35367]: I1204 12:07:17.423795 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-5dcd7f7489-ts824" Dec 04 12:07:17.433340 master-0 kubenswrapper[35367]: I1204 12:07:17.433252 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7487d49bdb-7f2xj" podStartSLOduration=4.103190261 podStartE2EDuration="8.433174525s" podCreationTimestamp="2025-12-04 12:07:09 +0000 UTC" firstStartedPulling="2025-12-04 12:07:11.382291145 +0000 UTC m=+474.820352403" lastFinishedPulling="2025-12-04 12:07:15.712275409 +0000 UTC m=+479.150336667" observedRunningTime="2025-12-04 12:07:17.422934843 +0000 UTC m=+480.860996101" watchObservedRunningTime="2025-12-04 12:07:17.433174525 +0000 UTC m=+480.871235783" Dec 04 12:07:17.466764 master-0 kubenswrapper[35367]: I1204 12:07:17.466687 35367 patch_prober.go:28] interesting pod/console-6dc95c8d8-klv7m container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.99:8443/health\": dial tcp 10.128.0.99:8443: connect: connection refused" start-of-body= Dec 04 12:07:17.467006 master-0 kubenswrapper[35367]: I1204 12:07:17.466776 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-6dc95c8d8-klv7m" podUID="91498480-8e7a-4ac5-86b3-9ff689a2e0c6" containerName="console" probeResult="failure" output="Get \"https://10.128.0.99:8443/health\": dial tcp 10.128.0.99:8443: connect: connection refused" Dec 04 12:07:17.470521 master-0 kubenswrapper[35367]: I1204 12:07:17.470450 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z89ck" podStartSLOduration=4.3626946140000005 podStartE2EDuration="8.470423597s" podCreationTimestamp="2025-12-04 12:07:09 +0000 UTC" firstStartedPulling="2025-12-04 12:07:10.210018466 +0000 UTC m=+473.648079714" lastFinishedPulling="2025-12-04 12:07:14.317747439 +0000 UTC m=+477.755808697" observedRunningTime="2025-12-04 12:07:17.467202136 +0000 UTC m=+480.905263394" watchObservedRunningTime="2025-12-04 12:07:17.470423597 +0000 UTC m=+480.908484865" Dec 04 12:07:17.557202 master-0 kubenswrapper[35367]: I1204 12:07:17.557143 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5857974f64-4rstk" podStartSLOduration=3.889894951 podStartE2EDuration="8.557124875s" podCreationTimestamp="2025-12-04 12:07:09 +0000 UTC" firstStartedPulling="2025-12-04 12:07:11.000219925 +0000 UTC m=+474.438281193" lastFinishedPulling="2025-12-04 12:07:15.667449859 +0000 UTC m=+479.105511117" observedRunningTime="2025-12-04 12:07:17.550086304 +0000 UTC m=+480.988147552" watchObservedRunningTime="2025-12-04 12:07:17.557124875 +0000 UTC m=+480.995186133" Dec 04 12:07:18.139483 master-0 kubenswrapper[35367]: I1204 12:07:18.139406 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dc95c8d8-klv7m"] Dec 04 12:07:18.197887 master-0 kubenswrapper[35367]: I1204 12:07:18.197392 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/console-75b84c855f-2zcgd"] Dec 04 12:07:18.197887 master-0 kubenswrapper[35367]: E1204 12:07:18.197779 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="38307089-8577-4193-b461-4ebb13fd7d95" containerName="registry-server" Dec 04 12:07:18.198232 master-0 kubenswrapper[35367]: I1204 12:07:18.197897 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="38307089-8577-4193-b461-4ebb13fd7d95" containerName="registry-server" Dec 04 12:07:18.198232 master-0 kubenswrapper[35367]: E1204 12:07:18.197934 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="38307089-8577-4193-b461-4ebb13fd7d95" containerName="extract-utilities" Dec 04 12:07:18.198232 master-0 kubenswrapper[35367]: I1204 12:07:18.197941 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="38307089-8577-4193-b461-4ebb13fd7d95" containerName="extract-utilities" Dec 04 12:07:18.198232 master-0 kubenswrapper[35367]: E1204 12:07:18.197961 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="38307089-8577-4193-b461-4ebb13fd7d95" containerName="extract-content" Dec 04 12:07:18.198232 master-0 kubenswrapper[35367]: I1204 12:07:18.197968 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="38307089-8577-4193-b461-4ebb13fd7d95" containerName="extract-content" Dec 04 12:07:18.198232 master-0 kubenswrapper[35367]: I1204 12:07:18.198139 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="38307089-8577-4193-b461-4ebb13fd7d95" containerName="registry-server" Dec 04 12:07:18.199002 master-0 kubenswrapper[35367]: I1204 12:07:18.198825 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.233434 master-0 kubenswrapper[35367]: I1204 12:07:18.222683 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75b84c855f-2zcgd"] Dec 04 12:07:18.345014 master-0 kubenswrapper[35367]: I1204 12:07:18.344974 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-trusted-ca-bundle\") pod \"console-75b84c855f-2zcgd\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.345228 master-0 kubenswrapper[35367]: I1204 12:07:18.345064 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9vdp\" (UniqueName: \"kubernetes.io/projected/5c66df21-a05d-4cb4-91ca-59d039629f95-kube-api-access-p9vdp\") pod \"console-75b84c855f-2zcgd\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.345228 master-0 kubenswrapper[35367]: I1204 12:07:18.345165 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-console-config\") pod \"console-75b84c855f-2zcgd\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.345383 master-0 kubenswrapper[35367]: I1204 12:07:18.345277 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c66df21-a05d-4cb4-91ca-59d039629f95-console-oauth-config\") pod \"console-75b84c855f-2zcgd\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.345383 master-0 kubenswrapper[35367]: I1204 12:07:18.345339 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-service-ca\") pod \"console-75b84c855f-2zcgd\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.345497 master-0 kubenswrapper[35367]: I1204 12:07:18.345480 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-oauth-serving-cert\") pod \"console-75b84c855f-2zcgd\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.345604 master-0 kubenswrapper[35367]: I1204 12:07:18.345573 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c66df21-a05d-4cb4-91ca-59d039629f95-console-serving-cert\") pod \"console-75b84c855f-2zcgd\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.440848 master-0 kubenswrapper[35367]: I1204 12:07:18.435439 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" event={"ID":"4c8907fe-87b6-4290-af7a-22ae41f3ff16","Type":"ContainerStarted","Data":"35c9a2a557ec3679b789f344fbbb2a762f931c64945f33b90f1d010054592897"} Dec 04 12:07:18.440848 master-0 kubenswrapper[35367]: I1204 12:07:18.435543 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" event={"ID":"4c8907fe-87b6-4290-af7a-22ae41f3ff16","Type":"ContainerStarted","Data":"9b8d81afbbfe84d956be488feb54329d088d19d96b83b1ac0469aa60ef41262f"} Dec 04 12:07:18.447938 master-0 kubenswrapper[35367]: I1204 12:07:18.447881 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p9vdp\" (UniqueName: \"kubernetes.io/projected/5c66df21-a05d-4cb4-91ca-59d039629f95-kube-api-access-p9vdp\") pod \"console-75b84c855f-2zcgd\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.447938 master-0 kubenswrapper[35367]: I1204 12:07:18.447935 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-console-config\") pod \"console-75b84c855f-2zcgd\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.448216 master-0 kubenswrapper[35367]: I1204 12:07:18.447965 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c66df21-a05d-4cb4-91ca-59d039629f95-console-oauth-config\") pod \"console-75b84c855f-2zcgd\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.448216 master-0 kubenswrapper[35367]: I1204 12:07:18.447990 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-service-ca\") pod \"console-75b84c855f-2zcgd\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.448216 master-0 kubenswrapper[35367]: I1204 12:07:18.448038 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-oauth-serving-cert\") pod \"console-75b84c855f-2zcgd\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.448216 master-0 kubenswrapper[35367]: I1204 12:07:18.448070 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c66df21-a05d-4cb4-91ca-59d039629f95-console-serving-cert\") pod \"console-75b84c855f-2zcgd\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.448216 master-0 kubenswrapper[35367]: I1204 12:07:18.448095 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-trusted-ca-bundle\") pod \"console-75b84c855f-2zcgd\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.450912 master-0 kubenswrapper[35367]: I1204 12:07:18.448784 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-console-config\") pod \"console-75b84c855f-2zcgd\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.450912 master-0 kubenswrapper[35367]: I1204 12:07:18.449123 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-service-ca\") pod \"console-75b84c855f-2zcgd\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.450912 master-0 kubenswrapper[35367]: I1204 12:07:18.450548 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-oauth-serving-cert\") pod \"console-75b84c855f-2zcgd\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.453182 master-0 kubenswrapper[35367]: I1204 12:07:18.453081 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c66df21-a05d-4cb4-91ca-59d039629f95-console-serving-cert\") pod \"console-75b84c855f-2zcgd\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.455911 master-0 kubenswrapper[35367]: I1204 12:07:18.455859 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c66df21-a05d-4cb4-91ca-59d039629f95-console-oauth-config\") pod \"console-75b84c855f-2zcgd\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.456411 master-0 kubenswrapper[35367]: I1204 12:07:18.456349 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-trusted-ca-bundle\") pod \"console-75b84c855f-2zcgd\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.477632 master-0 kubenswrapper[35367]: I1204 12:07:18.477415 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9vdp\" (UniqueName: \"kubernetes.io/projected/5c66df21-a05d-4cb4-91ca-59d039629f95-kube-api-access-p9vdp\") pod \"console-75b84c855f-2zcgd\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:18.526847 master-0 kubenswrapper[35367]: I1204 12:07:18.526782 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:19.093773 master-0 kubenswrapper[35367]: I1204 12:07:19.093709 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75b84c855f-2zcgd"] Dec 04 12:07:19.446276 master-0 kubenswrapper[35367]: I1204 12:07:19.446099 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" event={"ID":"4c8907fe-87b6-4290-af7a-22ae41f3ff16","Type":"ContainerStarted","Data":"7cd95c5e3bc5ee294e2dc49fb1d7cea3e96d30deeef7c472c46c2f29e4d849fb"} Dec 04 12:07:19.446900 master-0 kubenswrapper[35367]: I1204 12:07:19.446600 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:19.462485 master-0 kubenswrapper[35367]: W1204 12:07:19.462412 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c66df21_a05d_4cb4_91ca_59d039629f95.slice/crio-e2c64d26b099b52412f399f7ffd182449d788319c401104c65f8413c4608c8af WatchSource:0}: Error finding container e2c64d26b099b52412f399f7ffd182449d788319c401104c65f8413c4608c8af: Status 404 returned error can't find the container with id e2c64d26b099b52412f399f7ffd182449d788319c401104c65f8413c4608c8af Dec 04 12:07:19.472914 master-0 kubenswrapper[35367]: I1204 12:07:19.471739 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" podStartSLOduration=3.84886894 podStartE2EDuration="10.471721935s" podCreationTimestamp="2025-12-04 12:07:09 +0000 UTC" firstStartedPulling="2025-12-04 12:07:11.360898301 +0000 UTC m=+474.798959559" lastFinishedPulling="2025-12-04 12:07:17.983751296 +0000 UTC m=+481.421812554" observedRunningTime="2025-12-04 12:07:19.470223908 +0000 UTC m=+482.908285186" watchObservedRunningTime="2025-12-04 12:07:19.471721935 +0000 UTC m=+482.909783183" Dec 04 12:07:20.392448 master-0 kubenswrapper[35367]: I1204 12:07:20.391756 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:20.394406 master-0 kubenswrapper[35367]: I1204 12:07:20.394370 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:07:20.395587 master-0 kubenswrapper[35367]: I1204 12:07:20.395548 35367 patch_prober.go:28] interesting pod/console-64cdd44ddd-2t62p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.113:8443/health\": dial tcp 10.128.0.113:8443: connect: connection refused" start-of-body= Dec 04 12:07:20.395682 master-0 kubenswrapper[35367]: I1204 12:07:20.395595 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-64cdd44ddd-2t62p" podUID="29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8" containerName="console" probeResult="failure" output="Get \"https://10.128.0.113:8443/health\": dial tcp 10.128.0.113:8443: connect: connection refused" Dec 04 12:07:20.453767 master-0 kubenswrapper[35367]: I1204 12:07:20.453679 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b84c855f-2zcgd" event={"ID":"5c66df21-a05d-4cb4-91ca-59d039629f95","Type":"ContainerStarted","Data":"e2c64d26b099b52412f399f7ffd182449d788319c401104c65f8413c4608c8af"} Dec 04 12:07:21.464392 master-0 kubenswrapper[35367]: I1204 12:07:21.464333 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39b763e-1e11-489e-bfef-df396e96d6b8","Type":"ContainerStarted","Data":"57bc89e425e8fa97e475093f61959d7c2b495d60491dbc042c89acb3ffcb5b6b"} Dec 04 12:07:21.464392 master-0 kubenswrapper[35367]: I1204 12:07:21.464380 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39b763e-1e11-489e-bfef-df396e96d6b8","Type":"ContainerStarted","Data":"7e001579a42dceee5e35c7aa24eb2603ab820a146afd5de67175c9099377098d"} Dec 04 12:07:21.464392 master-0 kubenswrapper[35367]: I1204 12:07:21.464390 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39b763e-1e11-489e-bfef-df396e96d6b8","Type":"ContainerStarted","Data":"6a985bd66414f1ece90f85d73dd315ae61aaf212ef9e2f26a69fba73a8fd6d76"} Dec 04 12:07:21.473352 master-0 kubenswrapper[35367]: I1204 12:07:21.466114 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b84c855f-2zcgd" event={"ID":"5c66df21-a05d-4cb4-91ca-59d039629f95","Type":"ContainerStarted","Data":"b4f6a9dece1534cc6bed922e8202fb9f74d2f6917ddffe8c13c8b7b33f40c699"} Dec 04 12:07:21.473352 master-0 kubenswrapper[35367]: I1204 12:07:21.471282 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136126db-b6ad-440f-8add-e9e206ec25c6","Type":"ContainerStarted","Data":"279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077"} Dec 04 12:07:21.473352 master-0 kubenswrapper[35367]: I1204 12:07:21.471321 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136126db-b6ad-440f-8add-e9e206ec25c6","Type":"ContainerStarted","Data":"d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe"} Dec 04 12:07:21.492671 master-0 kubenswrapper[35367]: I1204 12:07:21.492591 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-75b84c855f-2zcgd" podStartSLOduration=3.492572057 podStartE2EDuration="3.492572057s" podCreationTimestamp="2025-12-04 12:07:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:07:21.49168211 +0000 UTC m=+484.929743378" watchObservedRunningTime="2025-12-04 12:07:21.492572057 +0000 UTC m=+484.930633315" Dec 04 12:07:22.485048 master-0 kubenswrapper[35367]: I1204 12:07:22.484917 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136126db-b6ad-440f-8add-e9e206ec25c6","Type":"ContainerStarted","Data":"7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af"} Dec 04 12:07:22.485492 master-0 kubenswrapper[35367]: I1204 12:07:22.485135 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136126db-b6ad-440f-8add-e9e206ec25c6","Type":"ContainerStarted","Data":"1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4"} Dec 04 12:07:22.485492 master-0 kubenswrapper[35367]: I1204 12:07:22.485157 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136126db-b6ad-440f-8add-e9e206ec25c6","Type":"ContainerStarted","Data":"139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec"} Dec 04 12:07:22.485492 master-0 kubenswrapper[35367]: I1204 12:07:22.485187 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136126db-b6ad-440f-8add-e9e206ec25c6","Type":"ContainerStarted","Data":"8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710"} Dec 04 12:07:22.494119 master-0 kubenswrapper[35367]: I1204 12:07:22.494017 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39b763e-1e11-489e-bfef-df396e96d6b8","Type":"ContainerStarted","Data":"9866abeb71ec8984443fb997f49da59f71789745ebaabc056781e0b1073cfe6d"} Dec 04 12:07:22.494119 master-0 kubenswrapper[35367]: I1204 12:07:22.494117 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39b763e-1e11-489e-bfef-df396e96d6b8","Type":"ContainerStarted","Data":"a45df79f959cc5193e82829472e5d19fea383de9deb904eedbcdc2996518b016"} Dec 04 12:07:22.494405 master-0 kubenswrapper[35367]: I1204 12:07:22.494135 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39b763e-1e11-489e-bfef-df396e96d6b8","Type":"ContainerStarted","Data":"ab8ef15589b1ad926e9756eb655c64edd6f6cae7500f99ea6cd36fa48adfd1a9"} Dec 04 12:07:22.521214 master-0 kubenswrapper[35367]: I1204 12:07:22.521128 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.732574472 podStartE2EDuration="13.521108033s" podCreationTimestamp="2025-12-04 12:07:09 +0000 UTC" firstStartedPulling="2025-12-04 12:07:11.000488944 +0000 UTC m=+474.438550202" lastFinishedPulling="2025-12-04 12:07:20.789022505 +0000 UTC m=+484.227083763" observedRunningTime="2025-12-04 12:07:22.5184664 +0000 UTC m=+485.956527658" watchObservedRunningTime="2025-12-04 12:07:22.521108033 +0000 UTC m=+485.959169281" Dec 04 12:07:22.561890 master-0 kubenswrapper[35367]: I1204 12:07:22.561637 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.943065874 podStartE2EDuration="13.561602017s" podCreationTimestamp="2025-12-04 12:07:09 +0000 UTC" firstStartedPulling="2025-12-04 12:07:11.15995269 +0000 UTC m=+474.598013938" lastFinishedPulling="2025-12-04 12:07:20.778488813 +0000 UTC m=+484.216550081" observedRunningTime="2025-12-04 12:07:22.555095223 +0000 UTC m=+485.993156501" watchObservedRunningTime="2025-12-04 12:07:22.561602017 +0000 UTC m=+485.999663275" Dec 04 12:07:24.962433 master-0 kubenswrapper[35367]: I1204 12:07:24.962352 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:07:25.514881 master-0 kubenswrapper[35367]: I1204 12:07:25.514786 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6c5fbf6b84-vvhts" Dec 04 12:07:26.123979 master-0 kubenswrapper[35367]: I1204 12:07:26.123927 35367 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 12:07:26.125020 master-0 kubenswrapper[35367]: I1204 12:07:26.124993 35367 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Dec 04 12:07:26.125286 master-0 kubenswrapper[35367]: I1204 12:07:26.125239 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="kube-apiserver" containerID="cri-o://981583e1a62020bed0b320631df16e0dbab14c71cca41f88b718c24fc9b0769f" gracePeriod=15 Dec 04 12:07:26.125330 master-0 kubenswrapper[35367]: I1204 12:07:26.125301 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:07:26.125382 master-0 kubenswrapper[35367]: I1204 12:07:26.125330 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="kube-apiserver-insecure-readyz" containerID="cri-o://1544dafc4450e69e270bc2b89b39af57abe1b6f542477c2578b2641d7b655943" gracePeriod=15 Dec 04 12:07:26.125473 master-0 kubenswrapper[35367]: I1204 12:07:26.125369 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="kube-apiserver-cert-regeneration-controller" containerID="cri-o://b0a28d609b06924a057b9984500a4af713b3fc429b6e06d5c9e1333fac00df02" gracePeriod=15 Dec 04 12:07:26.125521 master-0 kubenswrapper[35367]: I1204 12:07:26.125506 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="kube-apiserver-check-endpoints" containerID="cri-o://3ff6934d1f9c2657fb826df4ed4b1a22637352da037f97d1d2cee14f9481efd0" gracePeriod=15 Dec 04 12:07:26.125563 master-0 kubenswrapper[35367]: I1204 12:07:26.125367 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="kube-apiserver-cert-syncer" containerID="cri-o://3516d1ade9f0ea4269ee4ea096abf88317bfb45f980f730f2d032ccf08c8d87c" gracePeriod=15 Dec 04 12:07:26.126220 master-0 kubenswrapper[35367]: I1204 12:07:26.126083 35367 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Dec 04 12:07:26.126332 master-0 kubenswrapper[35367]: E1204 12:07:26.126308 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="kube-apiserver-check-endpoints" Dec 04 12:07:26.126332 master-0 kubenswrapper[35367]: I1204 12:07:26.126326 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="kube-apiserver-check-endpoints" Dec 04 12:07:26.126404 master-0 kubenswrapper[35367]: E1204 12:07:26.126346 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="kube-apiserver-cert-regeneration-controller" Dec 04 12:07:26.126404 master-0 kubenswrapper[35367]: I1204 12:07:26.126355 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="kube-apiserver-cert-regeneration-controller" Dec 04 12:07:26.126404 master-0 kubenswrapper[35367]: E1204 12:07:26.126365 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="kube-apiserver-cert-syncer" Dec 04 12:07:26.126404 master-0 kubenswrapper[35367]: I1204 12:07:26.126374 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="kube-apiserver-cert-syncer" Dec 04 12:07:26.126404 master-0 kubenswrapper[35367]: E1204 12:07:26.126385 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="kube-apiserver-insecure-readyz" Dec 04 12:07:26.126404 master-0 kubenswrapper[35367]: I1204 12:07:26.126391 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="kube-apiserver-insecure-readyz" Dec 04 12:07:26.126711 master-0 kubenswrapper[35367]: E1204 12:07:26.126409 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="kube-apiserver" Dec 04 12:07:26.126711 master-0 kubenswrapper[35367]: I1204 12:07:26.126414 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="kube-apiserver" Dec 04 12:07:26.126711 master-0 kubenswrapper[35367]: E1204 12:07:26.126436 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="setup" Dec 04 12:07:26.126711 master-0 kubenswrapper[35367]: I1204 12:07:26.126448 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="setup" Dec 04 12:07:26.126711 master-0 kubenswrapper[35367]: I1204 12:07:26.126641 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="kube-apiserver" Dec 04 12:07:26.126711 master-0 kubenswrapper[35367]: I1204 12:07:26.126671 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="kube-apiserver-cert-syncer" Dec 04 12:07:26.126711 master-0 kubenswrapper[35367]: I1204 12:07:26.126688 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="kube-apiserver-insecure-readyz" Dec 04 12:07:26.126711 master-0 kubenswrapper[35367]: I1204 12:07:26.126702 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="kube-apiserver-cert-regeneration-controller" Dec 04 12:07:26.126711 master-0 kubenswrapper[35367]: I1204 12:07:26.126713 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="33faf0280764958ffeecc2dce44a9bfc" containerName="kube-apiserver-check-endpoints" Dec 04 12:07:26.211545 master-0 kubenswrapper[35367]: I1204 12:07:26.211474 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f6ff77581942073946c662abf05d3494\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:07:26.211545 master-0 kubenswrapper[35367]: I1204 12:07:26.211537 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/b1fa13939a6c6bc926f15f953210c126-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"b1fa13939a6c6bc926f15f953210c126\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:07:26.211545 master-0 kubenswrapper[35367]: I1204 12:07:26.211563 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/b1fa13939a6c6bc926f15f953210c126-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"b1fa13939a6c6bc926f15f953210c126\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:07:26.212014 master-0 kubenswrapper[35367]: I1204 12:07:26.211583 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/b1fa13939a6c6bc926f15f953210c126-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"b1fa13939a6c6bc926f15f953210c126\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:07:26.212014 master-0 kubenswrapper[35367]: I1204 12:07:26.211633 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f6ff77581942073946c662abf05d3494\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:07:26.212014 master-0 kubenswrapper[35367]: I1204 12:07:26.211659 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f6ff77581942073946c662abf05d3494\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:07:26.212014 master-0 kubenswrapper[35367]: I1204 12:07:26.211690 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f6ff77581942073946c662abf05d3494\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:07:26.212014 master-0 kubenswrapper[35367]: I1204 12:07:26.211716 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f6ff77581942073946c662abf05d3494\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:07:26.213073 master-0 kubenswrapper[35367]: I1204 12:07:26.212432 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 12:07:26.313565 master-0 kubenswrapper[35367]: I1204 12:07:26.313485 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f6ff77581942073946c662abf05d3494\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:07:26.313565 master-0 kubenswrapper[35367]: I1204 12:07:26.313557 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/b1fa13939a6c6bc926f15f953210c126-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"b1fa13939a6c6bc926f15f953210c126\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:07:26.313960 master-0 kubenswrapper[35367]: I1204 12:07:26.313595 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/b1fa13939a6c6bc926f15f953210c126-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"b1fa13939a6c6bc926f15f953210c126\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:07:26.313960 master-0 kubenswrapper[35367]: I1204 12:07:26.313841 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/b1fa13939a6c6bc926f15f953210c126-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"b1fa13939a6c6bc926f15f953210c126\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:07:26.314064 master-0 kubenswrapper[35367]: I1204 12:07:26.313965 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/b1fa13939a6c6bc926f15f953210c126-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"b1fa13939a6c6bc926f15f953210c126\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:07:26.314121 master-0 kubenswrapper[35367]: I1204 12:07:26.314058 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/b1fa13939a6c6bc926f15f953210c126-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"b1fa13939a6c6bc926f15f953210c126\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:07:26.314177 master-0 kubenswrapper[35367]: I1204 12:07:26.314127 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-var-log\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f6ff77581942073946c662abf05d3494\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:07:26.314177 master-0 kubenswrapper[35367]: I1204 12:07:26.314150 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f6ff77581942073946c662abf05d3494\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:07:26.314275 master-0 kubenswrapper[35367]: I1204 12:07:26.314188 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f6ff77581942073946c662abf05d3494\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:07:26.314275 master-0 kubenswrapper[35367]: I1204 12:07:26.314190 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/b1fa13939a6c6bc926f15f953210c126-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"b1fa13939a6c6bc926f15f953210c126\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:07:26.314275 master-0 kubenswrapper[35367]: I1204 12:07:26.314233 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-var-lock\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f6ff77581942073946c662abf05d3494\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:07:26.314415 master-0 kubenswrapper[35367]: I1204 12:07:26.314269 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f6ff77581942073946c662abf05d3494\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:07:26.314415 master-0 kubenswrapper[35367]: I1204 12:07:26.314291 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f6ff77581942073946c662abf05d3494\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:07:26.314415 master-0 kubenswrapper[35367]: I1204 12:07:26.314329 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-manifests\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f6ff77581942073946c662abf05d3494\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:07:26.314415 master-0 kubenswrapper[35367]: I1204 12:07:26.314358 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f6ff77581942073946c662abf05d3494\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:07:26.314415 master-0 kubenswrapper[35367]: I1204 12:07:26.314388 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-resource-dir\") pod \"kube-apiserver-startup-monitor-master-0\" (UID: \"f6ff77581942073946c662abf05d3494\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:07:26.496443 master-0 kubenswrapper[35367]: I1204 12:07:26.496309 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:07:26.522823 master-0 kubenswrapper[35367]: W1204 12:07:26.522306 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6ff77581942073946c662abf05d3494.slice/crio-91ea45b82dc6426eaea8b368ae025756a6467106069e46f31f5e8fde44a0a7cb WatchSource:0}: Error finding container 91ea45b82dc6426eaea8b368ae025756a6467106069e46f31f5e8fde44a0a7cb: Status 404 returned error can't find the container with id 91ea45b82dc6426eaea8b368ae025756a6467106069e46f31f5e8fde44a0a7cb Dec 04 12:07:26.525332 master-0 kubenswrapper[35367]: E1204 12:07:26.525174 35367 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/events\": dial tcp 192.168.32.10:6443: connect: connection refused" event="&Event{ObjectMeta:{kube-apiserver-startup-monitor-master-0.187e01c448e970c1 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-startup-monitor-master-0,UID:f6ff77581942073946c662abf05d3494,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{startup-monitor},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0f43c31aa3359159d4557dad3cfaf812d8ce44db9cb9ae970e06d3479070b660\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 12:07:26.524289217 +0000 UTC m=+489.962350475,LastTimestamp:2025-12-04 12:07:26.524289217 +0000 UTC m=+489.962350475,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 12:07:26.538123 master-0 kubenswrapper[35367]: I1204 12:07:26.538061 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" event={"ID":"f6ff77581942073946c662abf05d3494","Type":"ContainerStarted","Data":"91ea45b82dc6426eaea8b368ae025756a6467106069e46f31f5e8fde44a0a7cb"} Dec 04 12:07:26.542385 master-0 kubenswrapper[35367]: I1204 12:07:26.542299 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_33faf0280764958ffeecc2dce44a9bfc/kube-apiserver-cert-syncer/0.log" Dec 04 12:07:26.543582 master-0 kubenswrapper[35367]: I1204 12:07:26.543513 35367 generic.go:334] "Generic (PLEG): container finished" podID="33faf0280764958ffeecc2dce44a9bfc" containerID="3ff6934d1f9c2657fb826df4ed4b1a22637352da037f97d1d2cee14f9481efd0" exitCode=0 Dec 04 12:07:26.543582 master-0 kubenswrapper[35367]: I1204 12:07:26.543563 35367 generic.go:334] "Generic (PLEG): container finished" podID="33faf0280764958ffeecc2dce44a9bfc" containerID="1544dafc4450e69e270bc2b89b39af57abe1b6f542477c2578b2641d7b655943" exitCode=0 Dec 04 12:07:26.543582 master-0 kubenswrapper[35367]: I1204 12:07:26.543574 35367 generic.go:334] "Generic (PLEG): container finished" podID="33faf0280764958ffeecc2dce44a9bfc" containerID="b0a28d609b06924a057b9984500a4af713b3fc429b6e06d5c9e1333fac00df02" exitCode=0 Dec 04 12:07:26.543582 master-0 kubenswrapper[35367]: I1204 12:07:26.543584 35367 generic.go:334] "Generic (PLEG): container finished" podID="33faf0280764958ffeecc2dce44a9bfc" containerID="3516d1ade9f0ea4269ee4ea096abf88317bfb45f980f730f2d032ccf08c8d87c" exitCode=2 Dec 04 12:07:26.546349 master-0 kubenswrapper[35367]: I1204 12:07:26.546276 35367 generic.go:334] "Generic (PLEG): container finished" podID="7f04fa4e-8587-43ad-bd31-0d6cb1067e28" containerID="585bacb93e60f35eb92174eb88dcdb336737d4b379c222dafd525594c9b15a74" exitCode=0 Dec 04 12:07:26.546349 master-0 kubenswrapper[35367]: I1204 12:07:26.546345 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-6-master-0" event={"ID":"7f04fa4e-8587-43ad-bd31-0d6cb1067e28","Type":"ContainerDied","Data":"585bacb93e60f35eb92174eb88dcdb336737d4b379c222dafd525594c9b15a74"} Dec 04 12:07:26.548374 master-0 kubenswrapper[35367]: I1204 12:07:26.548308 35367 status_manager.go:851] "Failed to get status for pod" podUID="33faf0280764958ffeecc2dce44a9bfc" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:26.549077 master-0 kubenswrapper[35367]: I1204 12:07:26.548973 35367 status_manager.go:851] "Failed to get status for pod" podUID="f6ff77581942073946c662abf05d3494" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:26.549605 master-0 kubenswrapper[35367]: I1204 12:07:26.549550 35367 status_manager.go:851] "Failed to get status for pod" podUID="7f04fa4e-8587-43ad-bd31-0d6cb1067e28" pod="openshift-kube-apiserver/installer-6-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-6-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:26.752901 master-0 kubenswrapper[35367]: I1204 12:07:26.752798 35367 status_manager.go:851] "Failed to get status for pod" podUID="7f04fa4e-8587-43ad-bd31-0d6cb1067e28" pod="openshift-kube-apiserver/installer-6-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-6-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:26.753484 master-0 kubenswrapper[35367]: I1204 12:07:26.753450 35367 status_manager.go:851] "Failed to get status for pod" podUID="33faf0280764958ffeecc2dce44a9bfc" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:26.754007 master-0 kubenswrapper[35367]: I1204 12:07:26.753966 35367 status_manager.go:851] "Failed to get status for pod" podUID="f6ff77581942073946c662abf05d3494" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:27.555065 master-0 kubenswrapper[35367]: I1204 12:07:27.554964 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" event={"ID":"f6ff77581942073946c662abf05d3494","Type":"ContainerStarted","Data":"dda5b2fb3bd943c974521ae6793f137afa4009d15742fc9cc977c202f508305a"} Dec 04 12:07:27.556367 master-0 kubenswrapper[35367]: I1204 12:07:27.556294 35367 status_manager.go:851] "Failed to get status for pod" podUID="7f04fa4e-8587-43ad-bd31-0d6cb1067e28" pod="openshift-kube-apiserver/installer-6-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-6-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:27.557280 master-0 kubenswrapper[35367]: I1204 12:07:27.557202 35367 status_manager.go:851] "Failed to get status for pod" podUID="f6ff77581942073946c662abf05d3494" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:28.027483 master-0 kubenswrapper[35367]: I1204 12:07:28.027423 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-6-master-0" Dec 04 12:07:28.028854 master-0 kubenswrapper[35367]: I1204 12:07:28.028761 35367 status_manager.go:851] "Failed to get status for pod" podUID="f6ff77581942073946c662abf05d3494" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:28.030590 master-0 kubenswrapper[35367]: I1204 12:07:28.030225 35367 status_manager.go:851] "Failed to get status for pod" podUID="7f04fa4e-8587-43ad-bd31-0d6cb1067e28" pod="openshift-kube-apiserver/installer-6-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-6-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:28.043314 master-0 kubenswrapper[35367]: I1204 12:07:28.043246 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7f04fa4e-8587-43ad-bd31-0d6cb1067e28-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "7f04fa4e-8587-43ad-bd31-0d6cb1067e28" (UID: "7f04fa4e-8587-43ad-bd31-0d6cb1067e28"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:07:28.043548 master-0 kubenswrapper[35367]: I1204 12:07:28.043330 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7f04fa4e-8587-43ad-bd31-0d6cb1067e28-kubelet-dir\") pod \"7f04fa4e-8587-43ad-bd31-0d6cb1067e28\" (UID: \"7f04fa4e-8587-43ad-bd31-0d6cb1067e28\") " Dec 04 12:07:28.043548 master-0 kubenswrapper[35367]: I1204 12:07:28.043448 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/7f04fa4e-8587-43ad-bd31-0d6cb1067e28-kube-api-access\") pod \"7f04fa4e-8587-43ad-bd31-0d6cb1067e28\" (UID: \"7f04fa4e-8587-43ad-bd31-0d6cb1067e28\") " Dec 04 12:07:28.043664 master-0 kubenswrapper[35367]: I1204 12:07:28.043644 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/7f04fa4e-8587-43ad-bd31-0d6cb1067e28-var-lock\") pod \"7f04fa4e-8587-43ad-bd31-0d6cb1067e28\" (UID: \"7f04fa4e-8587-43ad-bd31-0d6cb1067e28\") " Dec 04 12:07:28.043814 master-0 kubenswrapper[35367]: I1204 12:07:28.043733 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7f04fa4e-8587-43ad-bd31-0d6cb1067e28-var-lock" (OuterVolumeSpecName: "var-lock") pod "7f04fa4e-8587-43ad-bd31-0d6cb1067e28" (UID: "7f04fa4e-8587-43ad-bd31-0d6cb1067e28"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:07:28.044519 master-0 kubenswrapper[35367]: I1204 12:07:28.044480 35367 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7f04fa4e-8587-43ad-bd31-0d6cb1067e28-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:28.044519 master-0 kubenswrapper[35367]: I1204 12:07:28.044512 35367 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/7f04fa4e-8587-43ad-bd31-0d6cb1067e28-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:28.046579 master-0 kubenswrapper[35367]: I1204 12:07:28.046518 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f04fa4e-8587-43ad-bd31-0d6cb1067e28-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "7f04fa4e-8587-43ad-bd31-0d6cb1067e28" (UID: "7f04fa4e-8587-43ad-bd31-0d6cb1067e28"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:07:28.146877 master-0 kubenswrapper[35367]: I1204 12:07:28.146793 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/7f04fa4e-8587-43ad-bd31-0d6cb1067e28-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:28.527738 master-0 kubenswrapper[35367]: I1204 12:07:28.527626 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:28.527738 master-0 kubenswrapper[35367]: I1204 12:07:28.527727 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:07:28.530746 master-0 kubenswrapper[35367]: I1204 12:07:28.530691 35367 patch_prober.go:28] interesting pod/console-75b84c855f-2zcgd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.116:8443/health\": dial tcp 10.128.0.116:8443: connect: connection refused" start-of-body= Dec 04 12:07:28.530924 master-0 kubenswrapper[35367]: I1204 12:07:28.530767 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-75b84c855f-2zcgd" podUID="5c66df21-a05d-4cb4-91ca-59d039629f95" containerName="console" probeResult="failure" output="Get \"https://10.128.0.116:8443/health\": dial tcp 10.128.0.116:8443: connect: connection refused" Dec 04 12:07:28.567031 master-0 kubenswrapper[35367]: I1204 12:07:28.566989 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_33faf0280764958ffeecc2dce44a9bfc/kube-apiserver-cert-syncer/0.log" Dec 04 12:07:28.568455 master-0 kubenswrapper[35367]: I1204 12:07:28.568414 35367 generic.go:334] "Generic (PLEG): container finished" podID="33faf0280764958ffeecc2dce44a9bfc" containerID="981583e1a62020bed0b320631df16e0dbab14c71cca41f88b718c24fc9b0769f" exitCode=0 Dec 04 12:07:28.570514 master-0 kubenswrapper[35367]: I1204 12:07:28.570464 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-6-master-0" event={"ID":"7f04fa4e-8587-43ad-bd31-0d6cb1067e28","Type":"ContainerDied","Data":"a63bef7747da289ea93851f26af934981dff18c1b2a517c8c63ca7c5ec064ecc"} Dec 04 12:07:28.570514 master-0 kubenswrapper[35367]: I1204 12:07:28.570497 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-6-master-0" Dec 04 12:07:28.570514 master-0 kubenswrapper[35367]: I1204 12:07:28.570517 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a63bef7747da289ea93851f26af934981dff18c1b2a517c8c63ca7c5ec064ecc" Dec 04 12:07:28.593701 master-0 kubenswrapper[35367]: I1204 12:07:28.593636 35367 status_manager.go:851] "Failed to get status for pod" podUID="7f04fa4e-8587-43ad-bd31-0d6cb1067e28" pod="openshift-kube-apiserver/installer-6-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-6-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:28.594190 master-0 kubenswrapper[35367]: I1204 12:07:28.594147 35367 status_manager.go:851] "Failed to get status for pod" podUID="f6ff77581942073946c662abf05d3494" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:28.642765 master-0 kubenswrapper[35367]: I1204 12:07:28.642706 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_33faf0280764958ffeecc2dce44a9bfc/kube-apiserver-cert-syncer/0.log" Dec 04 12:07:28.643714 master-0 kubenswrapper[35367]: I1204 12:07:28.643680 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:07:28.645497 master-0 kubenswrapper[35367]: I1204 12:07:28.645421 35367 status_manager.go:851] "Failed to get status for pod" podUID="33faf0280764958ffeecc2dce44a9bfc" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:28.646136 master-0 kubenswrapper[35367]: I1204 12:07:28.646085 35367 status_manager.go:851] "Failed to get status for pod" podUID="f6ff77581942073946c662abf05d3494" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:28.646601 master-0 kubenswrapper[35367]: I1204 12:07:28.646547 35367 status_manager.go:851] "Failed to get status for pod" podUID="7f04fa4e-8587-43ad-bd31-0d6cb1067e28" pod="openshift-kube-apiserver/installer-6-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-6-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:28.764180 master-0 kubenswrapper[35367]: I1204 12:07:28.763973 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/33faf0280764958ffeecc2dce44a9bfc-resource-dir\") pod \"33faf0280764958ffeecc2dce44a9bfc\" (UID: \"33faf0280764958ffeecc2dce44a9bfc\") " Dec 04 12:07:28.764180 master-0 kubenswrapper[35367]: I1204 12:07:28.764083 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/33faf0280764958ffeecc2dce44a9bfc-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "33faf0280764958ffeecc2dce44a9bfc" (UID: "33faf0280764958ffeecc2dce44a9bfc"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:07:28.764180 master-0 kubenswrapper[35367]: I1204 12:07:28.764119 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/33faf0280764958ffeecc2dce44a9bfc-audit-dir\") pod \"33faf0280764958ffeecc2dce44a9bfc\" (UID: \"33faf0280764958ffeecc2dce44a9bfc\") " Dec 04 12:07:28.764540 master-0 kubenswrapper[35367]: I1204 12:07:28.764198 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/33faf0280764958ffeecc2dce44a9bfc-audit-dir" (OuterVolumeSpecName: "audit-dir") pod "33faf0280764958ffeecc2dce44a9bfc" (UID: "33faf0280764958ffeecc2dce44a9bfc"). InnerVolumeSpecName "audit-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:07:28.764540 master-0 kubenswrapper[35367]: I1204 12:07:28.764476 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/33faf0280764958ffeecc2dce44a9bfc-cert-dir\") pod \"33faf0280764958ffeecc2dce44a9bfc\" (UID: \"33faf0280764958ffeecc2dce44a9bfc\") " Dec 04 12:07:28.764739 master-0 kubenswrapper[35367]: I1204 12:07:28.764665 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/33faf0280764958ffeecc2dce44a9bfc-cert-dir" (OuterVolumeSpecName: "cert-dir") pod "33faf0280764958ffeecc2dce44a9bfc" (UID: "33faf0280764958ffeecc2dce44a9bfc"). InnerVolumeSpecName "cert-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:07:28.765373 master-0 kubenswrapper[35367]: I1204 12:07:28.765332 35367 reconciler_common.go:293] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/33faf0280764958ffeecc2dce44a9bfc-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:28.765373 master-0 kubenswrapper[35367]: I1204 12:07:28.765361 35367 reconciler_common.go:293] "Volume detached for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/33faf0280764958ffeecc2dce44a9bfc-audit-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:28.765373 master-0 kubenswrapper[35367]: I1204 12:07:28.765374 35367 reconciler_common.go:293] "Volume detached for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/33faf0280764958ffeecc2dce44a9bfc-cert-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:29.581404 master-0 kubenswrapper[35367]: I1204 12:07:29.581364 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_33faf0280764958ffeecc2dce44a9bfc/kube-apiserver-cert-syncer/0.log" Dec 04 12:07:29.582493 master-0 kubenswrapper[35367]: I1204 12:07:29.582473 35367 scope.go:117] "RemoveContainer" containerID="3ff6934d1f9c2657fb826df4ed4b1a22637352da037f97d1d2cee14f9481efd0" Dec 04 12:07:29.582627 master-0 kubenswrapper[35367]: I1204 12:07:29.582591 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:07:29.583586 master-0 kubenswrapper[35367]: I1204 12:07:29.583538 35367 status_manager.go:851] "Failed to get status for pod" podUID="f6ff77581942073946c662abf05d3494" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:29.584216 master-0 kubenswrapper[35367]: I1204 12:07:29.584035 35367 status_manager.go:851] "Failed to get status for pod" podUID="7f04fa4e-8587-43ad-bd31-0d6cb1067e28" pod="openshift-kube-apiserver/installer-6-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-6-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:29.585253 master-0 kubenswrapper[35367]: I1204 12:07:29.585215 35367 status_manager.go:851] "Failed to get status for pod" podUID="33faf0280764958ffeecc2dce44a9bfc" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:29.602675 master-0 kubenswrapper[35367]: I1204 12:07:29.601989 35367 scope.go:117] "RemoveContainer" containerID="1544dafc4450e69e270bc2b89b39af57abe1b6f542477c2578b2641d7b655943" Dec 04 12:07:29.602675 master-0 kubenswrapper[35367]: I1204 12:07:29.602615 35367 status_manager.go:851] "Failed to get status for pod" podUID="7f04fa4e-8587-43ad-bd31-0d6cb1067e28" pod="openshift-kube-apiserver/installer-6-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-6-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:29.603582 master-0 kubenswrapper[35367]: I1204 12:07:29.603520 35367 status_manager.go:851] "Failed to get status for pod" podUID="33faf0280764958ffeecc2dce44a9bfc" pod="openshift-kube-apiserver/kube-apiserver-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:29.605258 master-0 kubenswrapper[35367]: I1204 12:07:29.605183 35367 status_manager.go:851] "Failed to get status for pod" podUID="f6ff77581942073946c662abf05d3494" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:29.627650 master-0 kubenswrapper[35367]: I1204 12:07:29.627229 35367 scope.go:117] "RemoveContainer" containerID="b0a28d609b06924a057b9984500a4af713b3fc429b6e06d5c9e1333fac00df02" Dec 04 12:07:29.646652 master-0 kubenswrapper[35367]: I1204 12:07:29.646602 35367 scope.go:117] "RemoveContainer" containerID="3516d1ade9f0ea4269ee4ea096abf88317bfb45f980f730f2d032ccf08c8d87c" Dec 04 12:07:29.667757 master-0 kubenswrapper[35367]: I1204 12:07:29.667629 35367 scope.go:117] "RemoveContainer" containerID="981583e1a62020bed0b320631df16e0dbab14c71cca41f88b718c24fc9b0769f" Dec 04 12:07:29.691673 master-0 kubenswrapper[35367]: I1204 12:07:29.691635 35367 scope.go:117] "RemoveContainer" containerID="20886cc5417b688432e3df355bfc0c616c33ee7fc1bbbee81eea63ead26a9aae" Dec 04 12:07:30.122483 master-0 kubenswrapper[35367]: I1204 12:07:30.122418 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:30.122483 master-0 kubenswrapper[35367]: I1204 12:07:30.122493 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:30.394875 master-0 kubenswrapper[35367]: I1204 12:07:30.394732 35367 patch_prober.go:28] interesting pod/console-64cdd44ddd-2t62p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.113:8443/health\": dial tcp 10.128.0.113:8443: connect: connection refused" start-of-body= Dec 04 12:07:30.394875 master-0 kubenswrapper[35367]: I1204 12:07:30.394823 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-64cdd44ddd-2t62p" podUID="29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8" containerName="console" probeResult="failure" output="Get \"https://10.128.0.113:8443/health\": dial tcp 10.128.0.113:8443: connect: connection refused" Dec 04 12:07:30.759211 master-0 kubenswrapper[35367]: I1204 12:07:30.759035 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33faf0280764958ffeecc2dce44a9bfc" path="/var/lib/kubelet/pods/33faf0280764958ffeecc2dce44a9bfc/volumes" Dec 04 12:07:33.315800 master-0 kubenswrapper[35367]: E1204 12:07:33.315720 35367 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:33.316826 master-0 kubenswrapper[35367]: E1204 12:07:33.316725 35367 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:33.317349 master-0 kubenswrapper[35367]: E1204 12:07:33.317309 35367 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:33.317704 master-0 kubenswrapper[35367]: E1204 12:07:33.317675 35367 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:33.318099 master-0 kubenswrapper[35367]: E1204 12:07:33.318066 35367 controller.go:195] "Failed to update lease" err="Put \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:33.318099 master-0 kubenswrapper[35367]: I1204 12:07:33.318096 35367 controller.go:115] "failed to update lease using latest lease, fallback to ensure lease" err="failed 5 attempts to update lease" Dec 04 12:07:33.318518 master-0 kubenswrapper[35367]: E1204 12:07:33.318469 35367 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="200ms" Dec 04 12:07:33.520382 master-0 kubenswrapper[35367]: E1204 12:07:33.520276 35367 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="400ms" Dec 04 12:07:33.922471 master-0 kubenswrapper[35367]: E1204 12:07:33.922395 35367 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="800ms" Dec 04 12:07:34.579543 master-0 kubenswrapper[35367]: I1204 12:07:34.579468 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-console/console-654c77b6c6-kh7ws" podUID="ea79af85-e731-449a-a476-2ff8b05f9d80" containerName="console" containerID="cri-o://48d1d94cdb64153b163172f3e070a70c759cd71fe0a8a80d756ac993a61a5ffa" gracePeriod=15 Dec 04 12:07:34.724481 master-0 kubenswrapper[35367]: E1204 12:07:34.724376 35367 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="1.6s" Dec 04 12:07:35.274990 master-0 kubenswrapper[35367]: E1204 12:07:35.274739 35367 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/events\": dial tcp 192.168.32.10:6443: connect: connection refused" event="&Event{ObjectMeta:{kube-apiserver-startup-monitor-master-0.187e01c448e970c1 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-startup-monitor-master-0,UID:f6ff77581942073946c662abf05d3494,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{startup-monitor},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0f43c31aa3359159d4557dad3cfaf812d8ce44db9cb9ae970e06d3479070b660\" already present on machine,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-12-04 12:07:26.524289217 +0000 UTC m=+489.962350475,LastTimestamp:2025-12-04 12:07:26.524289217 +0000 UTC m=+489.962350475,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Dec 04 12:07:35.645264 master-0 kubenswrapper[35367]: I1204 12:07:35.645176 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-654c77b6c6-kh7ws_ea79af85-e731-449a-a476-2ff8b05f9d80/console/0.log" Dec 04 12:07:35.645264 master-0 kubenswrapper[35367]: I1204 12:07:35.645256 35367 generic.go:334] "Generic (PLEG): container finished" podID="ea79af85-e731-449a-a476-2ff8b05f9d80" containerID="48d1d94cdb64153b163172f3e070a70c759cd71fe0a8a80d756ac993a61a5ffa" exitCode=2 Dec 04 12:07:35.646154 master-0 kubenswrapper[35367]: I1204 12:07:35.645303 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654c77b6c6-kh7ws" event={"ID":"ea79af85-e731-449a-a476-2ff8b05f9d80","Type":"ContainerDied","Data":"48d1d94cdb64153b163172f3e070a70c759cd71fe0a8a80d756ac993a61a5ffa"} Dec 04 12:07:36.269820 master-0 kubenswrapper[35367]: I1204 12:07:36.269733 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-654c77b6c6-kh7ws_ea79af85-e731-449a-a476-2ff8b05f9d80/console/0.log" Dec 04 12:07:36.270211 master-0 kubenswrapper[35367]: I1204 12:07:36.269851 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:07:36.270899 master-0 kubenswrapper[35367]: I1204 12:07:36.270849 35367 status_manager.go:851] "Failed to get status for pod" podUID="7f04fa4e-8587-43ad-bd31-0d6cb1067e28" pod="openshift-kube-apiserver/installer-6-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-6-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:36.271572 master-0 kubenswrapper[35367]: I1204 12:07:36.271529 35367 status_manager.go:851] "Failed to get status for pod" podUID="f6ff77581942073946c662abf05d3494" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:36.272063 master-0 kubenswrapper[35367]: I1204 12:07:36.272019 35367 status_manager.go:851] "Failed to get status for pod" podUID="ea79af85-e731-449a-a476-2ff8b05f9d80" pod="openshift-console/console-654c77b6c6-kh7ws" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/pods/console-654c77b6c6-kh7ws\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:36.300970 master-0 kubenswrapper[35367]: I1204 12:07:36.300886 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea79af85-e731-449a-a476-2ff8b05f9d80-console-oauth-config\") pod \"ea79af85-e731-449a-a476-2ff8b05f9d80\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " Dec 04 12:07:36.301257 master-0 kubenswrapper[35367]: I1204 12:07:36.301055 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klcpm\" (UniqueName: \"kubernetes.io/projected/ea79af85-e731-449a-a476-2ff8b05f9d80-kube-api-access-klcpm\") pod \"ea79af85-e731-449a-a476-2ff8b05f9d80\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " Dec 04 12:07:36.301257 master-0 kubenswrapper[35367]: I1204 12:07:36.301107 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea79af85-e731-449a-a476-2ff8b05f9d80-console-serving-cert\") pod \"ea79af85-e731-449a-a476-2ff8b05f9d80\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " Dec 04 12:07:36.301257 master-0 kubenswrapper[35367]: I1204 12:07:36.301143 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea79af85-e731-449a-a476-2ff8b05f9d80-oauth-serving-cert\") pod \"ea79af85-e731-449a-a476-2ff8b05f9d80\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " Dec 04 12:07:36.301257 master-0 kubenswrapper[35367]: I1204 12:07:36.301172 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea79af85-e731-449a-a476-2ff8b05f9d80-console-config\") pod \"ea79af85-e731-449a-a476-2ff8b05f9d80\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " Dec 04 12:07:36.301407 master-0 kubenswrapper[35367]: I1204 12:07:36.301320 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea79af85-e731-449a-a476-2ff8b05f9d80-service-ca\") pod \"ea79af85-e731-449a-a476-2ff8b05f9d80\" (UID: \"ea79af85-e731-449a-a476-2ff8b05f9d80\") " Dec 04 12:07:36.302019 master-0 kubenswrapper[35367]: I1204 12:07:36.301966 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea79af85-e731-449a-a476-2ff8b05f9d80-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ea79af85-e731-449a-a476-2ff8b05f9d80" (UID: "ea79af85-e731-449a-a476-2ff8b05f9d80"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:07:36.302083 master-0 kubenswrapper[35367]: I1204 12:07:36.302041 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea79af85-e731-449a-a476-2ff8b05f9d80-service-ca" (OuterVolumeSpecName: "service-ca") pod "ea79af85-e731-449a-a476-2ff8b05f9d80" (UID: "ea79af85-e731-449a-a476-2ff8b05f9d80"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:07:36.302124 master-0 kubenswrapper[35367]: I1204 12:07:36.302098 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea79af85-e731-449a-a476-2ff8b05f9d80-console-config" (OuterVolumeSpecName: "console-config") pod "ea79af85-e731-449a-a476-2ff8b05f9d80" (UID: "ea79af85-e731-449a-a476-2ff8b05f9d80"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:07:36.304553 master-0 kubenswrapper[35367]: I1204 12:07:36.304488 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea79af85-e731-449a-a476-2ff8b05f9d80-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ea79af85-e731-449a-a476-2ff8b05f9d80" (UID: "ea79af85-e731-449a-a476-2ff8b05f9d80"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:07:36.304827 master-0 kubenswrapper[35367]: I1204 12:07:36.304783 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea79af85-e731-449a-a476-2ff8b05f9d80-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ea79af85-e731-449a-a476-2ff8b05f9d80" (UID: "ea79af85-e731-449a-a476-2ff8b05f9d80"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:07:36.305206 master-0 kubenswrapper[35367]: I1204 12:07:36.304996 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea79af85-e731-449a-a476-2ff8b05f9d80-kube-api-access-klcpm" (OuterVolumeSpecName: "kube-api-access-klcpm") pod "ea79af85-e731-449a-a476-2ff8b05f9d80" (UID: "ea79af85-e731-449a-a476-2ff8b05f9d80"). InnerVolumeSpecName "kube-api-access-klcpm". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:07:36.326326 master-0 kubenswrapper[35367]: E1204 12:07:36.326240 35367 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="3.2s" Dec 04 12:07:36.403886 master-0 kubenswrapper[35367]: I1204 12:07:36.403416 35367 reconciler_common.go:293] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea79af85-e731-449a-a476-2ff8b05f9d80-console-oauth-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:36.403886 master-0 kubenswrapper[35367]: I1204 12:07:36.403489 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-klcpm\" (UniqueName: \"kubernetes.io/projected/ea79af85-e731-449a-a476-2ff8b05f9d80-kube-api-access-klcpm\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:36.403886 master-0 kubenswrapper[35367]: I1204 12:07:36.403502 35367 reconciler_common.go:293] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea79af85-e731-449a-a476-2ff8b05f9d80-console-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:36.403886 master-0 kubenswrapper[35367]: I1204 12:07:36.403515 35367 reconciler_common.go:293] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea79af85-e731-449a-a476-2ff8b05f9d80-oauth-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:36.403886 master-0 kubenswrapper[35367]: I1204 12:07:36.403526 35367 reconciler_common.go:293] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea79af85-e731-449a-a476-2ff8b05f9d80-console-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:36.403886 master-0 kubenswrapper[35367]: I1204 12:07:36.403536 35367 reconciler_common.go:293] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea79af85-e731-449a-a476-2ff8b05f9d80-service-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:36.520012 master-0 kubenswrapper[35367]: I1204 12:07:36.519848 35367 patch_prober.go:28] interesting pod/machine-config-daemon-8jwk5 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Dec 04 12:07:36.520012 master-0 kubenswrapper[35367]: I1204 12:07:36.519942 35367 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" podUID="99eb764e-656c-4873-a2cd-308ce9c31a7d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Dec 04 12:07:36.520012 master-0 kubenswrapper[35367]: I1204 12:07:36.520006 35367 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" Dec 04 12:07:36.520932 master-0 kubenswrapper[35367]: I1204 12:07:36.520886 35367 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"e3f8312339c18fe6525dd740a13670d76d5e47ca3c0e4f63867a795cb0488a3d"} pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Dec 04 12:07:36.520994 master-0 kubenswrapper[35367]: I1204 12:07:36.520968 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" podUID="99eb764e-656c-4873-a2cd-308ce9c31a7d" containerName="machine-config-daemon" containerID="cri-o://e3f8312339c18fe6525dd740a13670d76d5e47ca3c0e4f63867a795cb0488a3d" gracePeriod=600 Dec 04 12:07:36.656798 master-0 kubenswrapper[35367]: I1204 12:07:36.656761 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-654c77b6c6-kh7ws_ea79af85-e731-449a-a476-2ff8b05f9d80/console/0.log" Dec 04 12:07:36.657196 master-0 kubenswrapper[35367]: I1204 12:07:36.656891 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654c77b6c6-kh7ws" event={"ID":"ea79af85-e731-449a-a476-2ff8b05f9d80","Type":"ContainerDied","Data":"e70df1a09f004267e3c1981bc4703949577e230940d387e84c720d0dcbaf6420"} Dec 04 12:07:36.657196 master-0 kubenswrapper[35367]: I1204 12:07:36.656949 35367 scope.go:117] "RemoveContainer" containerID="48d1d94cdb64153b163172f3e070a70c759cd71fe0a8a80d756ac993a61a5ffa" Dec 04 12:07:36.657196 master-0 kubenswrapper[35367]: I1204 12:07:36.657097 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654c77b6c6-kh7ws" Dec 04 12:07:36.659002 master-0 kubenswrapper[35367]: I1204 12:07:36.658938 35367 status_manager.go:851] "Failed to get status for pod" podUID="7f04fa4e-8587-43ad-bd31-0d6cb1067e28" pod="openshift-kube-apiserver/installer-6-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-6-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:36.659843 master-0 kubenswrapper[35367]: I1204 12:07:36.659771 35367 generic.go:334] "Generic (PLEG): container finished" podID="99eb764e-656c-4873-a2cd-308ce9c31a7d" containerID="e3f8312339c18fe6525dd740a13670d76d5e47ca3c0e4f63867a795cb0488a3d" exitCode=0 Dec 04 12:07:36.659928 master-0 kubenswrapper[35367]: I1204 12:07:36.659835 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" event={"ID":"99eb764e-656c-4873-a2cd-308ce9c31a7d","Type":"ContainerDied","Data":"e3f8312339c18fe6525dd740a13670d76d5e47ca3c0e4f63867a795cb0488a3d"} Dec 04 12:07:36.659928 master-0 kubenswrapper[35367]: I1204 12:07:36.659845 35367 status_manager.go:851] "Failed to get status for pod" podUID="f6ff77581942073946c662abf05d3494" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:36.660599 master-0 kubenswrapper[35367]: I1204 12:07:36.660554 35367 status_manager.go:851] "Failed to get status for pod" podUID="ea79af85-e731-449a-a476-2ff8b05f9d80" pod="openshift-console/console-654c77b6c6-kh7ws" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/pods/console-654c77b6c6-kh7ws\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:36.682881 master-0 kubenswrapper[35367]: I1204 12:07:36.682744 35367 status_manager.go:851] "Failed to get status for pod" podUID="f6ff77581942073946c662abf05d3494" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:36.683601 master-0 kubenswrapper[35367]: I1204 12:07:36.683510 35367 status_manager.go:851] "Failed to get status for pod" podUID="ea79af85-e731-449a-a476-2ff8b05f9d80" pod="openshift-console/console-654c77b6c6-kh7ws" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/pods/console-654c77b6c6-kh7ws\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:36.684716 master-0 kubenswrapper[35367]: I1204 12:07:36.684663 35367 status_manager.go:851] "Failed to get status for pod" podUID="7f04fa4e-8587-43ad-bd31-0d6cb1067e28" pod="openshift-kube-apiserver/installer-6-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-6-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:36.752566 master-0 kubenswrapper[35367]: I1204 12:07:36.752454 35367 status_manager.go:851] "Failed to get status for pod" podUID="ea79af85-e731-449a-a476-2ff8b05f9d80" pod="openshift-console/console-654c77b6c6-kh7ws" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/pods/console-654c77b6c6-kh7ws\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:36.753521 master-0 kubenswrapper[35367]: I1204 12:07:36.753442 35367 status_manager.go:851] "Failed to get status for pod" podUID="7f04fa4e-8587-43ad-bd31-0d6cb1067e28" pod="openshift-kube-apiserver/installer-6-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-6-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:36.754437 master-0 kubenswrapper[35367]: I1204 12:07:36.754380 35367 status_manager.go:851] "Failed to get status for pod" podUID="f6ff77581942073946c662abf05d3494" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:37.669891 master-0 kubenswrapper[35367]: I1204 12:07:37.669822 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" event={"ID":"99eb764e-656c-4873-a2cd-308ce9c31a7d","Type":"ContainerStarted","Data":"8d0aa816436264c6de974912961c14d7bba4c6200d4aa016b86e93bcb0a9c75d"} Dec 04 12:07:37.670991 master-0 kubenswrapper[35367]: I1204 12:07:37.670954 35367 status_manager.go:851] "Failed to get status for pod" podUID="99eb764e-656c-4873-a2cd-308ce9c31a7d" pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-config-operator/pods/machine-config-daemon-8jwk5\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:37.671752 master-0 kubenswrapper[35367]: I1204 12:07:37.671717 35367 status_manager.go:851] "Failed to get status for pod" podUID="7f04fa4e-8587-43ad-bd31-0d6cb1067e28" pod="openshift-kube-apiserver/installer-6-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-6-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:37.672337 master-0 kubenswrapper[35367]: I1204 12:07:37.672295 35367 status_manager.go:851] "Failed to get status for pod" podUID="f6ff77581942073946c662abf05d3494" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:37.672901 master-0 kubenswrapper[35367]: I1204 12:07:37.672839 35367 status_manager.go:851] "Failed to get status for pod" podUID="ea79af85-e731-449a-a476-2ff8b05f9d80" pod="openshift-console/console-654c77b6c6-kh7ws" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/pods/console-654c77b6c6-kh7ws\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:38.527964 master-0 kubenswrapper[35367]: I1204 12:07:38.527856 35367 patch_prober.go:28] interesting pod/console-75b84c855f-2zcgd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.116:8443/health\": dial tcp 10.128.0.116:8443: connect: connection refused" start-of-body= Dec 04 12:07:38.527964 master-0 kubenswrapper[35367]: I1204 12:07:38.527931 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-75b84c855f-2zcgd" podUID="5c66df21-a05d-4cb4-91ca-59d039629f95" containerName="console" probeResult="failure" output="Get \"https://10.128.0.116:8443/health\": dial tcp 10.128.0.116:8443: connect: connection refused" Dec 04 12:07:39.527973 master-0 kubenswrapper[35367]: E1204 12:07:39.527881 35367 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.sno.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": dial tcp 192.168.32.10:6443: connect: connection refused" interval="6.4s" Dec 04 12:07:39.698774 master-0 kubenswrapper[35367]: I1204 12:07:39.698716 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_b44cd0a1c87587350014492d2bc077ab/kube-controller-manager/0.log" Dec 04 12:07:39.699057 master-0 kubenswrapper[35367]: I1204 12:07:39.698783 35367 generic.go:334] "Generic (PLEG): container finished" podID="b44cd0a1c87587350014492d2bc077ab" containerID="49ef9434da945c3e39895526d46f11bec0f9c0ac87b5d0b5182c9471dfcd33bb" exitCode=1 Dec 04 12:07:39.699057 master-0 kubenswrapper[35367]: I1204 12:07:39.698835 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"b44cd0a1c87587350014492d2bc077ab","Type":"ContainerDied","Data":"49ef9434da945c3e39895526d46f11bec0f9c0ac87b5d0b5182c9471dfcd33bb"} Dec 04 12:07:39.699526 master-0 kubenswrapper[35367]: I1204 12:07:39.699487 35367 scope.go:117] "RemoveContainer" containerID="49ef9434da945c3e39895526d46f11bec0f9c0ac87b5d0b5182c9471dfcd33bb" Dec 04 12:07:39.700591 master-0 kubenswrapper[35367]: I1204 12:07:39.700391 35367 status_manager.go:851] "Failed to get status for pod" podUID="f6ff77581942073946c662abf05d3494" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:39.701091 master-0 kubenswrapper[35367]: I1204 12:07:39.701036 35367 status_manager.go:851] "Failed to get status for pod" podUID="ea79af85-e731-449a-a476-2ff8b05f9d80" pod="openshift-console/console-654c77b6c6-kh7ws" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/pods/console-654c77b6c6-kh7ws\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:39.701616 master-0 kubenswrapper[35367]: I1204 12:07:39.701571 35367 status_manager.go:851] "Failed to get status for pod" podUID="b44cd0a1c87587350014492d2bc077ab" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:39.702065 master-0 kubenswrapper[35367]: I1204 12:07:39.702024 35367 status_manager.go:851] "Failed to get status for pod" podUID="99eb764e-656c-4873-a2cd-308ce9c31a7d" pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-config-operator/pods/machine-config-daemon-8jwk5\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:39.702516 master-0 kubenswrapper[35367]: I1204 12:07:39.702482 35367 status_manager.go:851] "Failed to get status for pod" podUID="7f04fa4e-8587-43ad-bd31-0d6cb1067e28" pod="openshift-kube-apiserver/installer-6-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-6-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:39.746482 master-0 kubenswrapper[35367]: I1204 12:07:39.746420 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:07:39.748074 master-0 kubenswrapper[35367]: I1204 12:07:39.748026 35367 status_manager.go:851] "Failed to get status for pod" podUID="b44cd0a1c87587350014492d2bc077ab" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:39.748728 master-0 kubenswrapper[35367]: I1204 12:07:39.748700 35367 status_manager.go:851] "Failed to get status for pod" podUID="99eb764e-656c-4873-a2cd-308ce9c31a7d" pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-config-operator/pods/machine-config-daemon-8jwk5\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:39.749271 master-0 kubenswrapper[35367]: I1204 12:07:39.749234 35367 status_manager.go:851] "Failed to get status for pod" podUID="7f04fa4e-8587-43ad-bd31-0d6cb1067e28" pod="openshift-kube-apiserver/installer-6-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-6-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:39.749965 master-0 kubenswrapper[35367]: I1204 12:07:39.749911 35367 status_manager.go:851] "Failed to get status for pod" podUID="f6ff77581942073946c662abf05d3494" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:39.750431 master-0 kubenswrapper[35367]: I1204 12:07:39.750395 35367 status_manager.go:851] "Failed to get status for pod" podUID="ea79af85-e731-449a-a476-2ff8b05f9d80" pod="openshift-console/console-654c77b6c6-kh7ws" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/pods/console-654c77b6c6-kh7ws\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:39.787951 master-0 kubenswrapper[35367]: I1204 12:07:39.787829 35367 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="c0b6c2f2-9a19-4ed6-8062-2457696a3e0b" Dec 04 12:07:39.787951 master-0 kubenswrapper[35367]: I1204 12:07:39.787876 35367 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="c0b6c2f2-9a19-4ed6-8062-2457696a3e0b" Dec 04 12:07:39.788938 master-0 kubenswrapper[35367]: E1204 12:07:39.788893 35367 mirror_client.go:138] "Failed deleting a mirror pod" err="Delete \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:07:39.789678 master-0 kubenswrapper[35367]: I1204 12:07:39.789661 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:07:39.810902 master-0 kubenswrapper[35367]: W1204 12:07:39.810829 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1fa13939a6c6bc926f15f953210c126.slice/crio-1ae8a2339602035cfbf8a7e67c58e10a07c6cd48621e06e4288338552a43c679 WatchSource:0}: Error finding container 1ae8a2339602035cfbf8a7e67c58e10a07c6cd48621e06e4288338552a43c679: Status 404 returned error can't find the container with id 1ae8a2339602035cfbf8a7e67c58e10a07c6cd48621e06e4288338552a43c679 Dec 04 12:07:40.394827 master-0 kubenswrapper[35367]: I1204 12:07:40.394721 35367 patch_prober.go:28] interesting pod/console-64cdd44ddd-2t62p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.113:8443/health\": dial tcp 10.128.0.113:8443: connect: connection refused" start-of-body= Dec 04 12:07:40.395053 master-0 kubenswrapper[35367]: I1204 12:07:40.394841 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-64cdd44ddd-2t62p" podUID="29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8" containerName="console" probeResult="failure" output="Get \"https://10.128.0.113:8443/health\": dial tcp 10.128.0.113:8443: connect: connection refused" Dec 04 12:07:40.720080 master-0 kubenswrapper[35367]: I1204 12:07:40.719909 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_b44cd0a1c87587350014492d2bc077ab/kube-controller-manager/0.log" Dec 04 12:07:40.720675 master-0 kubenswrapper[35367]: I1204 12:07:40.720159 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"b44cd0a1c87587350014492d2bc077ab","Type":"ContainerStarted","Data":"e87ca3f10b069a54e1783b77fabd7eac4480fb70fe7b5031d4fc5e5b5de80aae"} Dec 04 12:07:40.721870 master-0 kubenswrapper[35367]: I1204 12:07:40.721790 35367 status_manager.go:851] "Failed to get status for pod" podUID="7f04fa4e-8587-43ad-bd31-0d6cb1067e28" pod="openshift-kube-apiserver/installer-6-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-6-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:40.722654 master-0 kubenswrapper[35367]: I1204 12:07:40.722596 35367 status_manager.go:851] "Failed to get status for pod" podUID="f6ff77581942073946c662abf05d3494" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:40.722724 master-0 kubenswrapper[35367]: I1204 12:07:40.722677 35367 generic.go:334] "Generic (PLEG): container finished" podID="b1fa13939a6c6bc926f15f953210c126" containerID="63eb6f7281c848c89adc551a5703b794efc077365a8665b9976836fa2f7b153d" exitCode=0 Dec 04 12:07:40.722783 master-0 kubenswrapper[35367]: I1204 12:07:40.722736 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"b1fa13939a6c6bc926f15f953210c126","Type":"ContainerDied","Data":"63eb6f7281c848c89adc551a5703b794efc077365a8665b9976836fa2f7b153d"} Dec 04 12:07:40.722783 master-0 kubenswrapper[35367]: I1204 12:07:40.722773 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"b1fa13939a6c6bc926f15f953210c126","Type":"ContainerStarted","Data":"1ae8a2339602035cfbf8a7e67c58e10a07c6cd48621e06e4288338552a43c679"} Dec 04 12:07:40.723158 master-0 kubenswrapper[35367]: I1204 12:07:40.723086 35367 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="c0b6c2f2-9a19-4ed6-8062-2457696a3e0b" Dec 04 12:07:40.723158 master-0 kubenswrapper[35367]: I1204 12:07:40.723121 35367 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="c0b6c2f2-9a19-4ed6-8062-2457696a3e0b" Dec 04 12:07:40.723707 master-0 kubenswrapper[35367]: I1204 12:07:40.723641 35367 status_manager.go:851] "Failed to get status for pod" podUID="ea79af85-e731-449a-a476-2ff8b05f9d80" pod="openshift-console/console-654c77b6c6-kh7ws" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/pods/console-654c77b6c6-kh7ws\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:40.723881 master-0 kubenswrapper[35367]: E1204 12:07:40.723756 35367 mirror_client.go:138] "Failed deleting a mirror pod" err="Delete \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:07:40.726115 master-0 kubenswrapper[35367]: I1204 12:07:40.725401 35367 status_manager.go:851] "Failed to get status for pod" podUID="b44cd0a1c87587350014492d2bc077ab" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:40.726115 master-0 kubenswrapper[35367]: I1204 12:07:40.726044 35367 status_manager.go:851] "Failed to get status for pod" podUID="99eb764e-656c-4873-a2cd-308ce9c31a7d" pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-config-operator/pods/machine-config-daemon-8jwk5\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:40.726861 master-0 kubenswrapper[35367]: I1204 12:07:40.726780 35367 status_manager.go:851] "Failed to get status for pod" podUID="f6ff77581942073946c662abf05d3494" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:40.727484 master-0 kubenswrapper[35367]: I1204 12:07:40.727415 35367 status_manager.go:851] "Failed to get status for pod" podUID="ea79af85-e731-449a-a476-2ff8b05f9d80" pod="openshift-console/console-654c77b6c6-kh7ws" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-console/pods/console-654c77b6c6-kh7ws\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:40.728080 master-0 kubenswrapper[35367]: I1204 12:07:40.728021 35367 status_manager.go:851] "Failed to get status for pod" podUID="b44cd0a1c87587350014492d2bc077ab" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:40.729078 master-0 kubenswrapper[35367]: I1204 12:07:40.729025 35367 status_manager.go:851] "Failed to get status for pod" podUID="99eb764e-656c-4873-a2cd-308ce9c31a7d" pod="openshift-machine-config-operator/machine-config-daemon-8jwk5" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-machine-config-operator/pods/machine-config-daemon-8jwk5\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:40.729634 master-0 kubenswrapper[35367]: I1204 12:07:40.729556 35367 status_manager.go:851] "Failed to get status for pod" podUID="7f04fa4e-8587-43ad-bd31-0d6cb1067e28" pod="openshift-kube-apiserver/installer-6-master-0" err="Get \"https://api-int.sno.openstack.lab:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-6-master-0\": dial tcp 192.168.32.10:6443: connect: connection refused" Dec 04 12:07:41.744150 master-0 kubenswrapper[35367]: I1204 12:07:41.740498 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"b1fa13939a6c6bc926f15f953210c126","Type":"ContainerStarted","Data":"f199fe939e34ff361f48a30e8009b0d1e4eb20a7ff107f3b93853b2ee4c65933"} Dec 04 12:07:41.744150 master-0 kubenswrapper[35367]: I1204 12:07:41.740565 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"b1fa13939a6c6bc926f15f953210c126","Type":"ContainerStarted","Data":"711b3feef00c81f46da31aee742db76ef660d631c908ab4d17ae789c30af9cfb"} Dec 04 12:07:41.744150 master-0 kubenswrapper[35367]: I1204 12:07:41.740581 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"b1fa13939a6c6bc926f15f953210c126","Type":"ContainerStarted","Data":"a28b058e1c88aa3966c86bf4ce0a7a584a53be12dec7833584dc3555d1d0aed4"} Dec 04 12:07:42.761050 master-0 kubenswrapper[35367]: I1204 12:07:42.760982 35367 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="c0b6c2f2-9a19-4ed6-8062-2457696a3e0b" Dec 04 12:07:42.761050 master-0 kubenswrapper[35367]: I1204 12:07:42.761039 35367 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="c0b6c2f2-9a19-4ed6-8062-2457696a3e0b" Dec 04 12:07:42.775865 master-0 kubenswrapper[35367]: I1204 12:07:42.771305 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:07:42.775865 master-0 kubenswrapper[35367]: I1204 12:07:42.771383 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"b1fa13939a6c6bc926f15f953210c126","Type":"ContainerStarted","Data":"0dc6b56d20ff837c0db0f86d2e0c261fd9214b583197668cc08876b5a6f50391"} Dec 04 12:07:42.775865 master-0 kubenswrapper[35367]: I1204 12:07:42.771417 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"b1fa13939a6c6bc926f15f953210c126","Type":"ContainerStarted","Data":"5f25c335afc07f98c17afa952215800e254df0bbedf431919e55322a5c67a39b"} Dec 04 12:07:43.182375 master-0 kubenswrapper[35367]: I1204 12:07:43.182261 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-console/console-6dc95c8d8-klv7m" podUID="91498480-8e7a-4ac5-86b3-9ff689a2e0c6" containerName="console" containerID="cri-o://f24f51c7ff141061cf0d30a56d1a3fc0f69f3a574425e2310157fa1024ef0202" gracePeriod=15 Dec 04 12:07:43.771079 master-0 kubenswrapper[35367]: I1204 12:07:43.771027 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6dc95c8d8-klv7m_91498480-8e7a-4ac5-86b3-9ff689a2e0c6/console/0.log" Dec 04 12:07:43.771658 master-0 kubenswrapper[35367]: I1204 12:07:43.771100 35367 generic.go:334] "Generic (PLEG): container finished" podID="91498480-8e7a-4ac5-86b3-9ff689a2e0c6" containerID="f24f51c7ff141061cf0d30a56d1a3fc0f69f3a574425e2310157fa1024ef0202" exitCode=2 Dec 04 12:07:43.771658 master-0 kubenswrapper[35367]: I1204 12:07:43.771156 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc95c8d8-klv7m" event={"ID":"91498480-8e7a-4ac5-86b3-9ff689a2e0c6","Type":"ContainerDied","Data":"f24f51c7ff141061cf0d30a56d1a3fc0f69f3a574425e2310157fa1024ef0202"} Dec 04 12:07:44.298608 master-0 kubenswrapper[35367]: I1204 12:07:44.298554 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6dc95c8d8-klv7m_91498480-8e7a-4ac5-86b3-9ff689a2e0c6/console/0.log" Dec 04 12:07:44.298855 master-0 kubenswrapper[35367]: I1204 12:07:44.298633 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:07:44.358656 master-0 kubenswrapper[35367]: I1204 12:07:44.358585 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-oauth-serving-cert\") pod \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " Dec 04 12:07:44.358896 master-0 kubenswrapper[35367]: I1204 12:07:44.358700 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-console-config\") pod \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " Dec 04 12:07:44.358896 master-0 kubenswrapper[35367]: I1204 12:07:44.358725 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-console-serving-cert\") pod \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " Dec 04 12:07:44.358896 master-0 kubenswrapper[35367]: I1204 12:07:44.358757 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-service-ca\") pod \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " Dec 04 12:07:44.358896 master-0 kubenswrapper[35367]: I1204 12:07:44.358775 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trh8p\" (UniqueName: \"kubernetes.io/projected/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-kube-api-access-trh8p\") pod \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " Dec 04 12:07:44.358896 master-0 kubenswrapper[35367]: I1204 12:07:44.358851 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-console-oauth-config\") pod \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " Dec 04 12:07:44.358896 master-0 kubenswrapper[35367]: I1204 12:07:44.358887 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-trusted-ca-bundle\") pod \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\" (UID: \"91498480-8e7a-4ac5-86b3-9ff689a2e0c6\") " Dec 04 12:07:44.359615 master-0 kubenswrapper[35367]: I1204 12:07:44.359572 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-service-ca" (OuterVolumeSpecName: "service-ca") pod "91498480-8e7a-4ac5-86b3-9ff689a2e0c6" (UID: "91498480-8e7a-4ac5-86b3-9ff689a2e0c6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:07:44.359675 master-0 kubenswrapper[35367]: I1204 12:07:44.359430 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "91498480-8e7a-4ac5-86b3-9ff689a2e0c6" (UID: "91498480-8e7a-4ac5-86b3-9ff689a2e0c6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:07:44.359716 master-0 kubenswrapper[35367]: I1204 12:07:44.359672 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "91498480-8e7a-4ac5-86b3-9ff689a2e0c6" (UID: "91498480-8e7a-4ac5-86b3-9ff689a2e0c6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:07:44.360054 master-0 kubenswrapper[35367]: I1204 12:07:44.359998 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-console-config" (OuterVolumeSpecName: "console-config") pod "91498480-8e7a-4ac5-86b3-9ff689a2e0c6" (UID: "91498480-8e7a-4ac5-86b3-9ff689a2e0c6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:07:44.362184 master-0 kubenswrapper[35367]: I1204 12:07:44.362140 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "91498480-8e7a-4ac5-86b3-9ff689a2e0c6" (UID: "91498480-8e7a-4ac5-86b3-9ff689a2e0c6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:07:44.362695 master-0 kubenswrapper[35367]: I1204 12:07:44.362644 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "91498480-8e7a-4ac5-86b3-9ff689a2e0c6" (UID: "91498480-8e7a-4ac5-86b3-9ff689a2e0c6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:07:44.363280 master-0 kubenswrapper[35367]: I1204 12:07:44.363227 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-kube-api-access-trh8p" (OuterVolumeSpecName: "kube-api-access-trh8p") pod "91498480-8e7a-4ac5-86b3-9ff689a2e0c6" (UID: "91498480-8e7a-4ac5-86b3-9ff689a2e0c6"). InnerVolumeSpecName "kube-api-access-trh8p". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:07:44.460257 master-0 kubenswrapper[35367]: I1204 12:07:44.460205 35367 reconciler_common.go:293] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-console-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:44.460257 master-0 kubenswrapper[35367]: I1204 12:07:44.460247 35367 reconciler_common.go:293] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-console-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:44.460257 master-0 kubenswrapper[35367]: I1204 12:07:44.460265 35367 reconciler_common.go:293] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-service-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:44.460533 master-0 kubenswrapper[35367]: I1204 12:07:44.460281 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-trh8p\" (UniqueName: \"kubernetes.io/projected/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-kube-api-access-trh8p\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:44.460533 master-0 kubenswrapper[35367]: I1204 12:07:44.460295 35367 reconciler_common.go:293] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-console-oauth-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:44.460533 master-0 kubenswrapper[35367]: I1204 12:07:44.460307 35367 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:44.460533 master-0 kubenswrapper[35367]: I1204 12:07:44.460319 35367 reconciler_common.go:293] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91498480-8e7a-4ac5-86b3-9ff689a2e0c6-oauth-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 12:07:44.779602 master-0 kubenswrapper[35367]: I1204 12:07:44.779552 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6dc95c8d8-klv7m_91498480-8e7a-4ac5-86b3-9ff689a2e0c6/console/0.log" Dec 04 12:07:44.780079 master-0 kubenswrapper[35367]: I1204 12:07:44.779617 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc95c8d8-klv7m" event={"ID":"91498480-8e7a-4ac5-86b3-9ff689a2e0c6","Type":"ContainerDied","Data":"b8aceefe7b2192688f532c62ad0aff8e1186af89459726967952610ed0719e36"} Dec 04 12:07:44.780079 master-0 kubenswrapper[35367]: I1204 12:07:44.779663 35367 scope.go:117] "RemoveContainer" containerID="f24f51c7ff141061cf0d30a56d1a3fc0f69f3a574425e2310157fa1024ef0202" Dec 04 12:07:44.780079 master-0 kubenswrapper[35367]: I1204 12:07:44.779687 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc95c8d8-klv7m" Dec 04 12:07:44.790116 master-0 kubenswrapper[35367]: I1204 12:07:44.790057 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:07:44.790305 master-0 kubenswrapper[35367]: I1204 12:07:44.790129 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:07:44.795392 master-0 kubenswrapper[35367]: I1204 12:07:44.795335 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:07:46.834381 master-0 kubenswrapper[35367]: I1204 12:07:46.834312 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Dec 04 12:07:47.775818 master-0 kubenswrapper[35367]: I1204 12:07:47.775752 35367 kubelet.go:1914] "Deleted mirror pod because it is outdated" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:07:47.803389 master-0 kubenswrapper[35367]: I1204 12:07:47.803329 35367 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="c0b6c2f2-9a19-4ed6-8062-2457696a3e0b" Dec 04 12:07:47.803389 master-0 kubenswrapper[35367]: I1204 12:07:47.803381 35367 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="c0b6c2f2-9a19-4ed6-8062-2457696a3e0b" Dec 04 12:07:47.808235 master-0 kubenswrapper[35367]: I1204 12:07:47.808192 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:07:47.913092 master-0 kubenswrapper[35367]: I1204 12:07:47.913006 35367 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-apiserver/kube-apiserver-master-0" oldPodUID="b1fa13939a6c6bc926f15f953210c126" podUID="cd156764-9ad3-438d-8c92-2ba0bb2f43ce" Dec 04 12:07:48.527739 master-0 kubenswrapper[35367]: I1204 12:07:48.527676 35367 patch_prober.go:28] interesting pod/console-75b84c855f-2zcgd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.116:8443/health\": dial tcp 10.128.0.116:8443: connect: connection refused" start-of-body= Dec 04 12:07:48.528034 master-0 kubenswrapper[35367]: I1204 12:07:48.527767 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-75b84c855f-2zcgd" podUID="5c66df21-a05d-4cb4-91ca-59d039629f95" containerName="console" probeResult="failure" output="Get \"https://10.128.0.116:8443/health\": dial tcp 10.128.0.116:8443: connect: connection refused" Dec 04 12:07:48.800471 master-0 kubenswrapper[35367]: I1204 12:07:48.800276 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:07:48.800471 master-0 kubenswrapper[35367]: I1204 12:07:48.800347 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:07:48.804661 master-0 kubenswrapper[35367]: I1204 12:07:48.804633 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:07:48.815048 master-0 kubenswrapper[35367]: I1204 12:07:48.814794 35367 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="c0b6c2f2-9a19-4ed6-8062-2457696a3e0b" Dec 04 12:07:48.815048 master-0 kubenswrapper[35367]: I1204 12:07:48.815039 35367 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="c0b6c2f2-9a19-4ed6-8062-2457696a3e0b" Dec 04 12:07:50.127984 master-0 kubenswrapper[35367]: I1204 12:07:50.127851 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:50.134049 master-0 kubenswrapper[35367]: I1204 12:07:50.132198 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-88f9c775c-fw4ls" Dec 04 12:07:50.398055 master-0 kubenswrapper[35367]: I1204 12:07:50.397913 35367 patch_prober.go:28] interesting pod/console-64cdd44ddd-2t62p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.113:8443/health\": dial tcp 10.128.0.113:8443: connect: connection refused" start-of-body= Dec 04 12:07:50.398055 master-0 kubenswrapper[35367]: I1204 12:07:50.397995 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-64cdd44ddd-2t62p" podUID="29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8" containerName="console" probeResult="failure" output="Get \"https://10.128.0.113:8443/health\": dial tcp 10.128.0.113:8443: connect: connection refused" Dec 04 12:07:56.773972 master-0 kubenswrapper[35367]: I1204 12:07:56.773788 35367 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-apiserver/kube-apiserver-master-0" oldPodUID="b1fa13939a6c6bc926f15f953210c126" podUID="cd156764-9ad3-438d-8c92-2ba0bb2f43ce" Dec 04 12:07:57.665669 master-0 kubenswrapper[35367]: I1204 12:07:57.665564 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-oauth-config" Dec 04 12:07:57.973883 master-0 kubenswrapper[35367]: I1204 12:07:57.973798 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"openshift-service-ca.crt" Dec 04 12:07:58.081223 master-0 kubenswrapper[35367]: I1204 12:07:58.081155 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"kube-root-ca.crt" Dec 04 12:07:58.491212 master-0 kubenswrapper[35367]: I1204 12:07:58.491134 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-dockercfg-fcvp2" Dec 04 12:07:58.528489 master-0 kubenswrapper[35367]: I1204 12:07:58.528388 35367 patch_prober.go:28] interesting pod/console-75b84c855f-2zcgd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.116:8443/health\": dial tcp 10.128.0.116:8443: connect: connection refused" start-of-body= Dec 04 12:07:58.528768 master-0 kubenswrapper[35367]: I1204 12:07:58.528487 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-75b84c855f-2zcgd" podUID="5c66df21-a05d-4cb4-91ca-59d039629f95" containerName="console" probeResult="failure" output="Get \"https://10.128.0.116:8443/health\": dial tcp 10.128.0.116:8443: connect: connection refused" Dec 04 12:07:58.729905 master-0 kubenswrapper[35367]: I1204 12:07:58.729716 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-root-ca.crt" Dec 04 12:07:58.805548 master-0 kubenswrapper[35367]: I1204 12:07:58.805147 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:07:58.891891 master-0 kubenswrapper[35367]: I1204 12:07:58.891782 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-machine-approver"/"machine-approver-tls" Dec 04 12:07:58.907400 master-0 kubenswrapper[35367]: I1204 12:07:58.907340 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"openshift-kube-scheduler-operator-config" Dec 04 12:07:59.084459 master-0 kubenswrapper[35367]: I1204 12:07:59.084364 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"audit" Dec 04 12:07:59.236713 master-0 kubenswrapper[35367]: I1204 12:07:59.236648 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"encryption-config-1" Dec 04 12:07:59.318322 master-0 kubenswrapper[35367]: I1204 12:07:59.318259 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"cloud-controller-manager-images" Dec 04 12:07:59.395287 master-0 kubenswrapper[35367]: I1204 12:07:59.395166 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-samples-operator"/"openshift-service-ca.crt" Dec 04 12:07:59.455468 master-0 kubenswrapper[35367]: I1204 12:07:59.455377 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-root-ca.crt" Dec 04 12:07:59.505797 master-0 kubenswrapper[35367]: I1204 12:07:59.505717 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-state-metrics-dockercfg-fcql2" Dec 04 12:07:59.603619 master-0 kubenswrapper[35367]: I1204 12:07:59.603530 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"kube-root-ca.crt" Dec 04 12:07:59.668648 master-0 kubenswrapper[35367]: I1204 12:07:59.668493 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-config" Dec 04 12:07:59.728192 master-0 kubenswrapper[35367]: I1204 12:07:59.728141 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"openshift-state-metrics-kube-rbac-proxy-config" Dec 04 12:08:00.137972 master-0 kubenswrapper[35367]: I1204 12:08:00.137878 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"openshift-service-ca.crt" Dec 04 12:08:00.203994 master-0 kubenswrapper[35367]: I1204 12:08:00.203906 35367 reflector.go:368] Caches populated for *v1.Service from k8s.io/client-go/informers/factory.go:160 Dec 04 12:08:00.235762 master-0 kubenswrapper[35367]: I1204 12:08:00.228075 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-autoscaler-operator-dockercfg-zs454" Dec 04 12:08:00.235762 master-0 kubenswrapper[35367]: I1204 12:08:00.235342 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"trusted-ca-bundle" Dec 04 12:08:00.322036 master-0 kubenswrapper[35367]: I1204 12:08:00.321930 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy-web" Dec 04 12:08:00.394971 master-0 kubenswrapper[35367]: I1204 12:08:00.394845 35367 patch_prober.go:28] interesting pod/console-64cdd44ddd-2t62p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.113:8443/health\": dial tcp 10.128.0.113:8443: connect: connection refused" start-of-body= Dec 04 12:08:00.395267 master-0 kubenswrapper[35367]: I1204 12:08:00.395227 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-64cdd44ddd-2t62p" podUID="29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8" containerName="console" probeResult="failure" output="Get \"https://10.128.0.113:8443/health\": dial tcp 10.128.0.113:8443: connect: connection refused" Dec 04 12:08:00.508853 master-0 kubenswrapper[35367]: I1204 12:08:00.508767 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-dockercfg-xdnxp" Dec 04 12:08:00.605424 master-0 kubenswrapper[35367]: I1204 12:08:00.605344 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"openshift-service-ca.crt" Dec 04 12:08:00.691426 master-0 kubenswrapper[35367]: I1204 12:08:00.691283 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"service-ca-bundle" Dec 04 12:08:00.907156 master-0 kubenswrapper[35367]: I1204 12:08:00.907085 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-console"/"networking-console-plugin" Dec 04 12:08:01.122428 master-0 kubenswrapper[35367]: I1204 12:08:01.122366 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"openshift-service-ca.crt" Dec 04 12:08:01.138795 master-0 kubenswrapper[35367]: I1204 12:08:01.138730 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress"/"kube-root-ca.crt" Dec 04 12:08:01.139616 master-0 kubenswrapper[35367]: I1204 12:08:01.139494 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"openshift-service-ca.crt" Dec 04 12:08:01.263507 master-0 kubenswrapper[35367]: I1204 12:08:01.263461 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-operator-dockercfg-hkjv7" Dec 04 12:08:01.307564 master-0 kubenswrapper[35367]: I1204 12:08:01.307526 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca"/"signing-key" Dec 04 12:08:01.374323 master-0 kubenswrapper[35367]: I1204 12:08:01.374180 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-metrics-certs-default" Dec 04 12:08:01.410850 master-0 kubenswrapper[35367]: I1204 12:08:01.410661 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"certified-operators-dockercfg-x4zqf" Dec 04 12:08:01.447598 master-0 kubenswrapper[35367]: I1204 12:08:01.447117 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"node-tuning-operator-tls" Dec 04 12:08:01.735053 master-0 kubenswrapper[35367]: I1204 12:08:01.734876 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"openshift-state-metrics-dockercfg-7vm6p" Dec 04 12:08:01.791888 master-0 kubenswrapper[35367]: I1204 12:08:01.791455 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"community-operators-dockercfg-kww9g" Dec 04 12:08:01.792875 master-0 kubenswrapper[35367]: I1204 12:08:01.792835 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"machine-config-operator-images" Dec 04 12:08:01.802413 master-0 kubenswrapper[35367]: I1204 12:08:01.802313 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-dockercfg-4hfp5" Dec 04 12:08:01.920034 master-0 kubenswrapper[35367]: I1204 12:08:01.919963 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"image-import-ca" Dec 04 12:08:01.951908 master-0 kubenswrapper[35367]: I1204 12:08:01.951842 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-storage-operator"/"openshift-service-ca.crt" Dec 04 12:08:02.016707 master-0 kubenswrapper[35367]: I1204 12:08:02.016593 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"catalog-operator-serving-cert" Dec 04 12:08:02.018600 master-0 kubenswrapper[35367]: I1204 12:08:02.017937 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-thanos-sidecar-tls" Dec 04 12:08:02.114500 master-0 kubenswrapper[35367]: I1204 12:08:02.114430 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"ovnkube-identity-cm" Dec 04 12:08:02.168367 master-0 kubenswrapper[35367]: I1204 12:08:02.168224 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"openshift-service-ca.crt" Dec 04 12:08:02.209664 master-0 kubenswrapper[35367]: I1204 12:08:02.209584 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"audit-1" Dec 04 12:08:02.215066 master-0 kubenswrapper[35367]: I1204 12:08:02.215020 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"encryption-config-1" Dec 04 12:08:02.284414 master-0 kubenswrapper[35367]: I1204 12:08:02.284282 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"openshift-service-ca.crt" Dec 04 12:08:02.289197 master-0 kubenswrapper[35367]: I1204 12:08:02.289135 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"kube-root-ca.crt" Dec 04 12:08:02.330288 master-0 kubenswrapper[35367]: I1204 12:08:02.330165 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"kube-root-ca.crt" Dec 04 12:08:02.357925 master-0 kubenswrapper[35367]: I1204 12:08:02.357794 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-tls-assets-0" Dec 04 12:08:02.475882 master-0 kubenswrapper[35367]: I1204 12:08:02.475777 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-dockercfg-2nzng" Dec 04 12:08:02.489429 master-0 kubenswrapper[35367]: I1204 12:08:02.489320 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"serving-cert" Dec 04 12:08:02.502373 master-0 kubenswrapper[35367]: I1204 12:08:02.502203 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"openshift-service-ca.crt" Dec 04 12:08:02.567258 master-0 kubenswrapper[35367]: I1204 12:08:02.566943 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-kube-rbac-proxy-web" Dec 04 12:08:02.578145 master-0 kubenswrapper[35367]: I1204 12:08:02.578091 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-config" Dec 04 12:08:02.685541 master-0 kubenswrapper[35367]: I1204 12:08:02.685475 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"oauth-openshift-dockercfg-vxnhq" Dec 04 12:08:02.736178 master-0 kubenswrapper[35367]: I1204 12:08:02.734737 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-serving-cert" Dec 04 12:08:02.746419 master-0 kubenswrapper[35367]: I1204 12:08:02.746358 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"dns-default" Dec 04 12:08:02.802188 master-0 kubenswrapper[35367]: I1204 12:08:02.802116 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"etcd-serving-ca" Dec 04 12:08:02.858594 master-0 kubenswrapper[35367]: I1204 12:08:02.858447 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"whereabouts-config" Dec 04 12:08:02.897745 master-0 kubenswrapper[35367]: I1204 12:08:02.897669 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"kube-root-ca.crt" Dec 04 12:08:02.918122 master-0 kubenswrapper[35367]: I1204 12:08:02.917953 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"multus-admission-controller-secret" Dec 04 12:08:02.918583 master-0 kubenswrapper[35367]: I1204 12:08:02.918550 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-control-plane-metrics-cert" Dec 04 12:08:02.928830 master-0 kubenswrapper[35367]: I1204 12:08:02.928757 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"metrics-server-audit-profiles" Dec 04 12:08:02.972588 master-0 kubenswrapper[35367]: I1204 12:08:02.972499 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-web-config" Dec 04 12:08:02.998838 master-0 kubenswrapper[35367]: I1204 12:08:02.998736 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns"/"dns-default-metrics-tls" Dec 04 12:08:03.082934 master-0 kubenswrapper[35367]: I1204 12:08:03.075545 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"kube-rbac-proxy" Dec 04 12:08:03.091388 master-0 kubenswrapper[35367]: I1204 12:08:03.091335 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"openshift-service-ca.crt" Dec 04 12:08:03.157793 master-0 kubenswrapper[35367]: I1204 12:08:03.157626 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"kube-root-ca.crt" Dec 04 12:08:03.247827 master-0 kubenswrapper[35367]: I1204 12:08:03.247767 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console-operator"/"console-operator-dockercfg-7mzs9" Dec 04 12:08:03.310727 master-0 kubenswrapper[35367]: I1204 12:08:03.310647 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"etcd-client" Dec 04 12:08:03.317515 master-0 kubenswrapper[35367]: I1204 12:08:03.317256 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"kube-root-ca.crt" Dec 04 12:08:03.367079 master-0 kubenswrapper[35367]: I1204 12:08:03.367017 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"redhat-marketplace-dockercfg-kpc5q" Dec 04 12:08:03.412043 master-0 kubenswrapper[35367]: I1204 12:08:03.411689 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"trusted-ca-bundle" Dec 04 12:08:03.485311 master-0 kubenswrapper[35367]: I1204 12:08:03.485172 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-certs-default" Dec 04 12:08:03.517248 master-0 kubenswrapper[35367]: I1204 12:08:03.517177 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-serving-cert" Dec 04 12:08:03.552308 master-0 kubenswrapper[35367]: I1204 12:08:03.552226 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"v4-0-config-system-cliconfig" Dec 04 12:08:03.613642 master-0 kubenswrapper[35367]: I1204 12:08:03.613392 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console-operator"/"openshift-service-ca.crt" Dec 04 12:08:03.698430 master-0 kubenswrapper[35367]: I1204 12:08:03.698307 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"machine-approver-config" Dec 04 12:08:03.715542 master-0 kubenswrapper[35367]: I1204 12:08:03.715476 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"multus-daemon-config" Dec 04 12:08:03.715825 master-0 kubenswrapper[35367]: I1204 12:08:03.715476 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"trusted-ca" Dec 04 12:08:03.820338 master-0 kubenswrapper[35367]: I1204 12:08:03.820259 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"trusted-ca-bundle" Dec 04 12:08:03.846341 master-0 kubenswrapper[35367]: I1204 12:08:03.846275 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"kube-root-ca.crt" Dec 04 12:08:03.894962 master-0 kubenswrapper[35367]: I1204 12:08:03.894912 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-samples-operator"/"samples-operator-tls" Dec 04 12:08:03.928413 master-0 kubenswrapper[35367]: I1204 12:08:03.928359 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-service-ca.crt" Dec 04 12:08:03.936258 master-0 kubenswrapper[35367]: I1204 12:08:03.936200 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator"/"kube-root-ca.crt" Dec 04 12:08:03.946283 master-0 kubenswrapper[35367]: I1204 12:08:03.946221 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-console"/"networking-console-plugin-cert" Dec 04 12:08:03.962344 master-0 kubenswrapper[35367]: I1204 12:08:03.962226 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-tls" Dec 04 12:08:04.002474 master-0 kubenswrapper[35367]: I1204 12:08:04.002257 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"cni-copy-resources" Dec 04 12:08:04.002474 master-0 kubenswrapper[35367]: I1204 12:08:04.002257 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"kube-root-ca.crt" Dec 04 12:08:04.041162 master-0 kubenswrapper[35367]: I1204 12:08:04.041086 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"openshift-service-ca.crt" Dec 04 12:08:04.089513 master-0 kubenswrapper[35367]: I1204 12:08:04.089442 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"trusted-ca-bundle" Dec 04 12:08:04.091408 master-0 kubenswrapper[35367]: I1204 12:08:04.091375 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-dockercfg-wmtl9" Dec 04 12:08:04.122731 master-0 kubenswrapper[35367]: I1204 12:08:04.122667 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-rbac-proxy-cluster-autoscaler-operator" Dec 04 12:08:04.144727 master-0 kubenswrapper[35367]: I1204 12:08:04.144675 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"serving-certs-ca-bundle" Dec 04 12:08:04.149445 master-0 kubenswrapper[35367]: I1204 12:08:04.149394 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"machine-api-operator-tls" Dec 04 12:08:04.176390 master-0 kubenswrapper[35367]: I1204 12:08:04.176314 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"authentication-operator-config" Dec 04 12:08:04.264103 master-0 kubenswrapper[35367]: I1204 12:08:04.263935 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-serving-cert" Dec 04 12:08:04.295392 master-0 kubenswrapper[35367]: I1204 12:08:04.295311 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"control-plane-machine-set-operator-tls" Dec 04 12:08:04.369096 master-0 kubenswrapper[35367]: I1204 12:08:04.369018 35367 reflector.go:368] Caches populated for *v1.Node from k8s.io/client-go/informers/factory.go:160 Dec 04 12:08:04.386618 master-0 kubenswrapper[35367]: I1204 12:08:04.386535 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-thanos-prometheus-http-client-file" Dec 04 12:08:04.397146 master-0 kubenswrapper[35367]: I1204 12:08:04.397081 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-config" Dec 04 12:08:04.507389 master-0 kubenswrapper[35367]: I1204 12:08:04.507305 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"openshift-service-ca.crt" Dec 04 12:08:04.507936 master-0 kubenswrapper[35367]: I1204 12:08:04.507892 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-olm-operator"/"kube-root-ca.crt" Dec 04 12:08:04.601196 master-0 kubenswrapper[35367]: I1204 12:08:04.601102 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-webhook-server-cert" Dec 04 12:08:04.656954 master-0 kubenswrapper[35367]: I1204 12:08:04.656839 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"kube-root-ca.crt" Dec 04 12:08:04.786382 master-0 kubenswrapper[35367]: I1204 12:08:04.786309 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-global-ca" Dec 04 12:08:04.829150 master-0 kubenswrapper[35367]: I1204 12:08:04.829086 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"oauth-serving-cert" Dec 04 12:08:04.835779 master-0 kubenswrapper[35367]: I1204 12:08:04.835726 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-session" Dec 04 12:08:04.844056 master-0 kubenswrapper[35367]: I1204 12:08:04.843986 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-client-certs" Dec 04 12:08:04.900124 master-0 kubenswrapper[35367]: I1204 12:08:04.899980 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"image-registry-certificates" Dec 04 12:08:04.954262 master-0 kubenswrapper[35367]: I1204 12:08:04.954203 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-template-error" Dec 04 12:08:04.956007 master-0 kubenswrapper[35367]: I1204 12:08:04.955961 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-controller-manager-operator"/"cluster-cloud-controller-manager-dockercfg-5pdkn" Dec 04 12:08:04.974364 master-0 kubenswrapper[35367]: I1204 12:08:04.974306 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"node-ca-dockercfg-68j4k" Dec 04 12:08:04.994586 master-0 kubenswrapper[35367]: I1204 12:08:04.994280 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"kube-root-ca.crt" Dec 04 12:08:05.120102 master-0 kubenswrapper[35367]: I1204 12:08:05.120040 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-router-certs" Dec 04 12:08:05.166531 master-0 kubenswrapper[35367]: I1204 12:08:05.166366 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-config-operator"/"config-operator-serving-cert" Dec 04 12:08:05.184295 master-0 kubenswrapper[35367]: I1204 12:08:05.184166 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-ca-bundle" Dec 04 12:08:05.227025 master-0 kubenswrapper[35367]: I1204 12:08:05.226931 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"v4-0-config-system-trusted-ca-bundle" Dec 04 12:08:05.331240 master-0 kubenswrapper[35367]: I1204 12:08:05.331156 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"marketplace-operator-metrics" Dec 04 12:08:05.358774 master-0 kubenswrapper[35367]: I1204 12:08:05.358692 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"openshift-service-ca.crt" Dec 04 12:08:05.554973 master-0 kubenswrapper[35367]: I1204 12:08:05.554799 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"pprof-cert" Dec 04 12:08:05.612238 master-0 kubenswrapper[35367]: I1204 12:08:05.611272 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-state-metrics-kube-rbac-proxy-config" Dec 04 12:08:05.639049 master-0 kubenswrapper[35367]: I1204 12:08:05.638981 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-canary"/"openshift-service-ca.crt" Dec 04 12:08:05.701997 master-0 kubenswrapper[35367]: I1204 12:08:05.701933 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"kube-root-ca.crt" Dec 04 12:08:05.730202 master-0 kubenswrapper[35367]: I1204 12:08:05.730089 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-generated" Dec 04 12:08:05.736516 master-0 kubenswrapper[35367]: I1204 12:08:05.736469 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"telemeter-client-tls" Dec 04 12:08:05.756762 master-0 kubenswrapper[35367]: I1204 12:08:05.756683 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"olm-operator-serviceaccount-dockercfg-8qwsb" Dec 04 12:08:05.757009 master-0 kubenswrapper[35367]: I1204 12:08:05.756782 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"iptables-alerter-script" Dec 04 12:08:05.774052 master-0 kubenswrapper[35367]: I1204 12:08:05.773981 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"openshift-state-metrics-tls" Dec 04 12:08:05.866289 master-0 kubenswrapper[35367]: I1204 12:08:05.866226 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"performance-addon-operator-webhook-cert" Dec 04 12:08:05.890220 master-0 kubenswrapper[35367]: I1204 12:08:05.890082 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"catalogd-trusted-ca-bundle" Dec 04 12:08:05.912601 master-0 kubenswrapper[35367]: I1204 12:08:05.912530 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-node-metrics-cert" Dec 04 12:08:05.944007 master-0 kubenswrapper[35367]: I1204 12:08:05.943930 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"kube-root-ca.crt" Dec 04 12:08:05.969022 master-0 kubenswrapper[35367]: I1204 12:08:05.968957 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"telemeter-trusted-ca-bundle-56c9b9fa8d9gs" Dec 04 12:08:05.974950 master-0 kubenswrapper[35367]: I1204 12:08:05.974869 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"openshift-service-ca.crt" Dec 04 12:08:06.002619 master-0 kubenswrapper[35367]: I1204 12:08:06.002552 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-web-config" Dec 04 12:08:06.043770 master-0 kubenswrapper[35367]: I1204 12:08:06.043687 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console-operator"/"trusted-ca" Dec 04 12:08:06.045250 master-0 kubenswrapper[35367]: I1204 12:08:06.045220 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"serving-cert" Dec 04 12:08:06.057762 master-0 kubenswrapper[35367]: I1204 12:08:06.057691 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-daemon-dockercfg-6lrr9" Dec 04 12:08:06.068777 master-0 kubenswrapper[35367]: I1204 12:08:06.068717 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-grpc-tls-65n1etrkcotip" Dec 04 12:08:06.105235 master-0 kubenswrapper[35367]: I1204 12:08:06.105122 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"default-cni-sysctl-allowlist" Dec 04 12:08:06.118838 master-0 kubenswrapper[35367]: I1204 12:08:06.118661 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-admission-webhook-tls" Dec 04 12:08:06.131534 master-0 kubenswrapper[35367]: I1204 12:08:06.130558 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"kube-root-ca.crt" Dec 04 12:08:06.194302 master-0 kubenswrapper[35367]: I1204 12:08:06.194165 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"default-dockercfg-hn9ls" Dec 04 12:08:06.230947 master-0 kubenswrapper[35367]: I1204 12:08:06.230860 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"prometheus-k8s-rulefiles-0" Dec 04 12:08:06.247653 master-0 kubenswrapper[35367]: I1204 12:08:06.247575 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"proxy-tls" Dec 04 12:08:06.267094 master-0 kubenswrapper[35367]: I1204 12:08:06.267001 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-tls" Dec 04 12:08:06.278363 master-0 kubenswrapper[35367]: I1204 12:08:06.277064 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"alertmanager-trusted-ca-bundle" Dec 04 12:08:06.319285 master-0 kubenswrapper[35367]: I1204 12:08:06.319201 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"telemetry-config" Dec 04 12:08:06.416422 master-0 kubenswrapper[35367]: I1204 12:08:06.416308 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"kube-root-ca.crt" Dec 04 12:08:06.471501 master-0 kubenswrapper[35367]: I1204 12:08:06.471437 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"kube-root-ca.crt" Dec 04 12:08:06.504262 master-0 kubenswrapper[35367]: I1204 12:08:06.504052 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-config" Dec 04 12:08:06.539527 master-0 kubenswrapper[35367]: I1204 12:08:06.539453 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-template-provider-selection" Dec 04 12:08:06.583278 master-0 kubenswrapper[35367]: I1204 12:08:06.583183 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-serving-cert" Dec 04 12:08:06.623382 master-0 kubenswrapper[35367]: I1204 12:08:06.623297 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"kube-root-ca.crt" Dec 04 12:08:06.667664 master-0 kubenswrapper[35367]: I1204 12:08:06.667537 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-ocp-branding-template" Dec 04 12:08:06.705465 master-0 kubenswrapper[35367]: I1204 12:08:06.705392 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kubelet-serving-ca-bundle" Dec 04 12:08:06.864199 master-0 kubenswrapper[35367]: I1204 12:08:06.864121 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"kube-root-ca.crt" Dec 04 12:08:06.909190 master-0 kubenswrapper[35367]: I1204 12:08:06.909120 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-tls" Dec 04 12:08:06.910128 master-0 kubenswrapper[35367]: I1204 12:08:06.910094 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"marketplace-trusted-ca" Dec 04 12:08:06.964325 master-0 kubenswrapper[35367]: I1204 12:08:06.964139 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-dockercfg-dd25z" Dec 04 12:08:07.137344 master-0 kubenswrapper[35367]: I1204 12:08:07.137261 35367 reflector.go:368] Caches populated for *v1.CSIDriver from k8s.io/client-go/informers/factory.go:160 Dec 04 12:08:07.154637 master-0 kubenswrapper[35367]: I1204 12:08:07.154576 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-autoscaler-operator-cert" Dec 04 12:08:07.180901 master-0 kubenswrapper[35367]: I1204 12:08:07.180786 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"service-ca-operator-config" Dec 04 12:08:07.205626 master-0 kubenswrapper[35367]: I1204 12:08:07.205533 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-insights"/"operator-dockercfg-qxdwr" Dec 04 12:08:07.296997 master-0 kubenswrapper[35367]: I1204 12:08:07.296861 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"openshift-service-ca.crt" Dec 04 12:08:07.303931 master-0 kubenswrapper[35367]: I1204 12:08:07.303872 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"trusted-ca" Dec 04 12:08:07.322717 master-0 kubenswrapper[35367]: I1204 12:08:07.322561 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"multus-ac-dockercfg-tdcmm" Dec 04 12:08:07.336978 master-0 kubenswrapper[35367]: I1204 12:08:07.336900 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"telemeter-client-serving-certs-ca-bundle" Dec 04 12:08:07.361414 master-0 kubenswrapper[35367]: I1204 12:08:07.361327 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-controller-dockercfg-mtqb4" Dec 04 12:08:07.395323 master-0 kubenswrapper[35367]: I1204 12:08:07.395238 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-samples-operator"/"kube-root-ca.crt" Dec 04 12:08:07.499326 master-0 kubenswrapper[35367]: I1204 12:08:07.499255 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-storage-operator"/"kube-root-ca.crt" Dec 04 12:08:07.518271 master-0 kubenswrapper[35367]: I1204 12:08:07.518222 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"console-config" Dec 04 12:08:07.540312 master-0 kubenswrapper[35367]: I1204 12:08:07.540256 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"mco-proxy-tls" Dec 04 12:08:07.544053 master-0 kubenswrapper[35367]: I1204 12:08:07.544017 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-olm-operator"/"openshift-service-ca.crt" Dec 04 12:08:07.548996 master-0 kubenswrapper[35367]: I1204 12:08:07.548920 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"kube-root-ca.crt" Dec 04 12:08:07.565387 master-0 kubenswrapper[35367]: I1204 12:08:07.565313 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"openshift-service-ca.crt" Dec 04 12:08:07.567502 master-0 kubenswrapper[35367]: I1204 12:08:07.567471 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"telemeter-client" Dec 04 12:08:07.595854 master-0 kubenswrapper[35367]: I1204 12:08:07.595756 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-4a8jt9e8fr012" Dec 04 12:08:07.603190 master-0 kubenswrapper[35367]: I1204 12:08:07.602229 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kube-state-metrics-custom-resource-state-configmap" Dec 04 12:08:07.611954 master-0 kubenswrapper[35367]: I1204 12:08:07.611886 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"openshift-service-ca.crt" Dec 04 12:08:07.617245 master-0 kubenswrapper[35367]: I1204 12:08:07.617185 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s" Dec 04 12:08:07.687449 master-0 kubenswrapper[35367]: I1204 12:08:07.687373 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"monitoring-plugin-cert" Dec 04 12:08:07.698563 master-0 kubenswrapper[35367]: I1204 12:08:07.698504 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-serving-cert" Dec 04 12:08:07.700180 master-0 kubenswrapper[35367]: I1204 12:08:07.700149 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"kube-root-ca.crt" Dec 04 12:08:07.712792 master-0 kubenswrapper[35367]: I1204 12:08:07.712742 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"openshift-service-ca.crt" Dec 04 12:08:07.787994 master-0 kubenswrapper[35367]: I1204 12:08:07.787916 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-machine-approver"/"machine-approver-sa-dockercfg-tj7gr" Dec 04 12:08:07.797376 master-0 kubenswrapper[35367]: I1204 12:08:07.797314 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"config" Dec 04 12:08:07.832183 master-0 kubenswrapper[35367]: I1204 12:08:07.832079 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"telemeter-client-kube-rbac-proxy-config" Dec 04 12:08:07.846769 master-0 kubenswrapper[35367]: I1204 12:08:07.846674 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-olm-operator"/"cluster-olm-operator-serving-cert" Dec 04 12:08:07.857225 master-0 kubenswrapper[35367]: I1204 12:08:07.857166 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-grpc-tls-90vge34bcmpum" Dec 04 12:08:07.901087 master-0 kubenswrapper[35367]: I1204 12:08:07.901022 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-catalogd"/"kube-root-ca.crt" Dec 04 12:08:07.913604 master-0 kubenswrapper[35367]: I1204 12:08:07.913566 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-state-metrics-tls" Dec 04 12:08:07.921225 master-0 kubenswrapper[35367]: I1204 12:08:07.921182 35367 reflector.go:368] Caches populated for *v1.RuntimeClass from k8s.io/client-go/informers/factory.go:160 Dec 04 12:08:08.042407 master-0 kubenswrapper[35367]: I1204 12:08:08.042351 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-service-ca.crt" Dec 04 12:08:08.072389 master-0 kubenswrapper[35367]: I1204 12:08:08.072347 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-stats-default" Dec 04 12:08:08.138407 master-0 kubenswrapper[35367]: I1204 12:08:08.138265 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-canary"/"kube-root-ca.crt" Dec 04 12:08:08.154128 master-0 kubenswrapper[35367]: I1204 12:08:08.154084 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"baremetal-kube-rbac-proxy" Dec 04 12:08:08.167220 master-0 kubenswrapper[35367]: I1204 12:08:08.167124 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console-operator"/"console-operator-config" Dec 04 12:08:08.171218 master-0 kubenswrapper[35367]: I1204 12:08:08.171122 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"serving-cert" Dec 04 12:08:08.222358 master-0 kubenswrapper[35367]: I1204 12:08:08.222298 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"v4-0-config-system-service-ca" Dec 04 12:08:08.286927 master-0 kubenswrapper[35367]: I1204 12:08:08.286670 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"trusted-ca" Dec 04 12:08:08.288182 master-0 kubenswrapper[35367]: I1204 12:08:08.288140 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-kube-rbac-proxy-config" Dec 04 12:08:08.292735 master-0 kubenswrapper[35367]: I1204 12:08:08.292700 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-root-ca.crt" Dec 04 12:08:08.293908 master-0 kubenswrapper[35367]: I1204 12:08:08.293883 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Dec 04 12:08:08.295690 master-0 kubenswrapper[35367]: I1204 12:08:08.295548 35367 reflector.go:368] Caches populated for *v1.Pod from pkg/kubelet/config/apiserver.go:66 Dec 04 12:08:08.296789 master-0 kubenswrapper[35367]: I1204 12:08:08.296707 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" podStartSLOduration=42.296684876 podStartE2EDuration="42.296684876s" podCreationTimestamp="2025-12-04 12:07:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:07:47.807756229 +0000 UTC m=+511.245817497" watchObservedRunningTime="2025-12-04 12:08:08.296684876 +0000 UTC m=+531.734746134" Dec 04 12:08:08.303879 master-0 kubenswrapper[35367]: I1204 12:08:08.303839 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-master-0","openshift-console/console-654c77b6c6-kh7ws","openshift-console/console-6dc95c8d8-klv7m"] Dec 04 12:08:08.303966 master-0 kubenswrapper[35367]: I1204 12:08:08.303916 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Dec 04 12:08:08.308047 master-0 kubenswrapper[35367]: I1204 12:08:08.308003 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-master-0" Dec 04 12:08:08.315918 master-0 kubenswrapper[35367]: I1204 12:08:08.315869 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"kube-root-ca.crt" Dec 04 12:08:08.336569 master-0 kubenswrapper[35367]: I1204 12:08:08.336477 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/kube-apiserver-master-0" podStartSLOduration=21.336453747 podStartE2EDuration="21.336453747s" podCreationTimestamp="2025-12-04 12:07:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:08:08.326108711 +0000 UTC m=+531.764170009" watchObservedRunningTime="2025-12-04 12:08:08.336453747 +0000 UTC m=+531.774515005" Dec 04 12:08:08.362453 master-0 kubenswrapper[35367]: I1204 12:08:08.362385 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"openshift-service-ca.crt" Dec 04 12:08:08.432375 master-0 kubenswrapper[35367]: I1204 12:08:08.432162 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-operator"/"metrics-tls" Dec 04 12:08:08.433085 master-0 kubenswrapper[35367]: I1204 12:08:08.433069 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-storage-operator"/"cluster-storage-operator-serving-cert" Dec 04 12:08:08.438582 master-0 kubenswrapper[35367]: I1204 12:08:08.438559 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-server-tls" Dec 04 12:08:08.454706 master-0 kubenswrapper[35367]: I1204 12:08:08.454638 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-operator-config" Dec 04 12:08:08.469821 master-0 kubenswrapper[35367]: I1204 12:08:08.469761 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"federate-client-certs" Dec 04 12:08:08.482720 master-0 kubenswrapper[35367]: I1204 12:08:08.482661 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"openshift-service-ca.crt" Dec 04 12:08:08.529269 master-0 kubenswrapper[35367]: I1204 12:08:08.529201 35367 patch_prober.go:28] interesting pod/console-75b84c855f-2zcgd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.116:8443/health\": dial tcp 10.128.0.116:8443: connect: connection refused" start-of-body= Dec 04 12:08:08.529848 master-0 kubenswrapper[35367]: I1204 12:08:08.529282 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-75b84c855f-2zcgd" podUID="5c66df21-a05d-4cb4-91ca-59d039629f95" containerName="console" probeResult="failure" output="Get \"https://10.128.0.116:8443/health\": dial tcp 10.128.0.116:8443: connect: connection refused" Dec 04 12:08:08.536145 master-0 kubenswrapper[35367]: I1204 12:08:08.536100 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"trusted-ca-bundle" Dec 04 12:08:08.558353 master-0 kubenswrapper[35367]: I1204 12:08:08.557836 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-storage-version-migrator-operator"/"serving-cert" Dec 04 12:08:08.577290 master-0 kubenswrapper[35367]: I1204 12:08:08.577249 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"kube-root-ca.crt" Dec 04 12:08:08.612122 master-0 kubenswrapper[35367]: I1204 12:08:08.612083 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"telemeter-client-dockercfg-ggdx4" Dec 04 12:08:08.625992 master-0 kubenswrapper[35367]: I1204 12:08:08.625942 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"metrics-daemon-secret" Dec 04 12:08:08.717723 master-0 kubenswrapper[35367]: I1204 12:08:08.717623 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-template-login" Dec 04 12:08:08.755663 master-0 kubenswrapper[35367]: I1204 12:08:08.755614 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91498480-8e7a-4ac5-86b3-9ff689a2e0c6" path="/var/lib/kubelet/pods/91498480-8e7a-4ac5-86b3-9ff689a2e0c6/volumes" Dec 04 12:08:08.756174 master-0 kubenswrapper[35367]: I1204 12:08:08.756114 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"cco-trusted-ca" Dec 04 12:08:08.756399 master-0 kubenswrapper[35367]: I1204 12:08:08.756370 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea79af85-e731-449a-a476-2ff8b05f9d80" path="/var/lib/kubelet/pods/ea79af85-e731-449a-a476-2ff8b05f9d80/volumes" Dec 04 12:08:08.806167 master-0 kubenswrapper[35367]: I1204 12:08:08.806102 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-server-dockercfg-4rb2l" Dec 04 12:08:08.822820 master-0 kubenswrapper[35367]: I1204 12:08:08.822750 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-kube-rbac-proxy" Dec 04 12:08:08.847514 master-0 kubenswrapper[35367]: I1204 12:08:08.847444 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"env-overrides" Dec 04 12:08:08.849410 master-0 kubenswrapper[35367]: I1204 12:08:08.849382 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"metrics-client-ca" Dec 04 12:08:09.028054 master-0 kubenswrapper[35367]: I1204 12:08:09.027927 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"cluster-monitoring-operator-tls" Dec 04 12:08:09.058267 master-0 kubenswrapper[35367]: I1204 12:08:09.058207 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy-metric" Dec 04 12:08:09.058638 master-0 kubenswrapper[35367]: I1204 12:08:09.058603 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"mcc-proxy-tls" Dec 04 12:08:09.098821 master-0 kubenswrapper[35367]: I1204 12:08:09.092697 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"node-bootstrapper-token" Dec 04 12:08:09.132162 master-0 kubenswrapper[35367]: I1204 12:08:09.132087 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-insights"/"openshift-insights-serving-cert" Dec 04 12:08:09.162745 master-0 kubenswrapper[35367]: I1204 12:08:09.162698 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"openshift-service-ca.crt" Dec 04 12:08:09.170418 master-0 kubenswrapper[35367]: I1204 12:08:09.170367 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-kube-rbac-proxy-rules" Dec 04 12:08:09.342116 master-0 kubenswrapper[35367]: I1204 12:08:09.342045 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-operator-dockercfg-l9v2g" Dec 04 12:08:09.344534 master-0 kubenswrapper[35367]: I1204 12:08:09.344482 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-tls" Dec 04 12:08:09.344729 master-0 kubenswrapper[35367]: I1204 12:08:09.344507 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"openshift-service-ca.crt" Dec 04 12:08:09.346009 master-0 kubenswrapper[35367]: I1204 12:08:09.345982 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console-operator"/"serving-cert" Dec 04 12:08:09.504262 master-0 kubenswrapper[35367]: I1204 12:08:09.504191 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"etcd-client" Dec 04 12:08:09.541258 master-0 kubenswrapper[35367]: I1204 12:08:09.541142 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"redhat-operators-dockercfg-8t954" Dec 04 12:08:09.602448 master-0 kubenswrapper[35367]: I1204 12:08:09.602318 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-operator-tls" Dec 04 12:08:09.626583 master-0 kubenswrapper[35367]: I1204 12:08:09.626521 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns-operator"/"metrics-tls" Dec 04 12:08:09.636465 master-0 kubenswrapper[35367]: I1204 12:08:09.636409 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-tls-assets-0" Dec 04 12:08:09.743480 master-0 kubenswrapper[35367]: I1204 12:08:09.743413 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-client" Dec 04 12:08:09.841034 master-0 kubenswrapper[35367]: I1204 12:08:09.840966 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-kube-rbac-proxy-web" Dec 04 12:08:09.870675 master-0 kubenswrapper[35367]: I1204 12:08:09.870544 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"openshift-service-ca.crt" Dec 04 12:08:09.909987 master-0 kubenswrapper[35367]: I1204 12:08:09.909942 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-scheduler-operator"/"kube-scheduler-operator-serving-cert" Dec 04 12:08:09.944173 master-0 kubenswrapper[35367]: I1204 12:08:09.944117 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca-operator"/"serving-cert" Dec 04 12:08:09.962581 master-0 kubenswrapper[35367]: I1204 12:08:09.962514 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:08:09.984084 master-0 kubenswrapper[35367]: I1204 12:08:09.984032 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-insights"/"service-ca-bundle" Dec 04 12:08:09.994383 master-0 kubenswrapper[35367]: I1204 12:08:09.994335 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:08:10.001756 master-0 kubenswrapper[35367]: I1204 12:08:10.001717 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"signing-cabundle" Dec 04 12:08:10.024582 master-0 kubenswrapper[35367]: I1204 12:08:10.024523 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:08:10.029872 master-0 kubenswrapper[35367]: I1204 12:08:10.028897 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"cluster-baremetal-operator-images" Dec 04 12:08:10.129197 master-0 kubenswrapper[35367]: I1204 12:08:10.128520 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-rbac-proxy" Dec 04 12:08:10.146599 master-0 kubenswrapper[35367]: I1204 12:08:10.146541 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress"/"service-ca-bundle" Dec 04 12:08:10.173594 master-0 kubenswrapper[35367]: I1204 12:08:10.171085 35367 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 12:08:10.173594 master-0 kubenswrapper[35367]: I1204 12:08:10.171370 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" podUID="f6ff77581942073946c662abf05d3494" containerName="startup-monitor" containerID="cri-o://dda5b2fb3bd943c974521ae6793f137afa4009d15742fc9cc977c202f508305a" gracePeriod=5 Dec 04 12:08:10.203673 master-0 kubenswrapper[35367]: I1204 12:08:10.203573 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-canary"/"canary-serving-cert" Dec 04 12:08:10.235378 master-0 kubenswrapper[35367]: I1204 12:08:10.235309 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"env-overrides" Dec 04 12:08:10.321314 master-0 kubenswrapper[35367]: I1204 12:08:10.321225 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-root-ca.crt" Dec 04 12:08:10.365016 master-0 kubenswrapper[35367]: I1204 12:08:10.364954 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator"/"openshift-service-ca.crt" Dec 04 12:08:10.386133 master-0 kubenswrapper[35367]: I1204 12:08:10.385912 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-rbac-proxy" Dec 04 12:08:10.393438 master-0 kubenswrapper[35367]: I1204 12:08:10.393352 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-operator"/"metrics-tls" Dec 04 12:08:10.398509 master-0 kubenswrapper[35367]: I1204 12:08:10.398460 35367 patch_prober.go:28] interesting pod/console-64cdd44ddd-2t62p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.128.0.113:8443/health\": dial tcp 10.128.0.113:8443: connect: connection refused" start-of-body= Dec 04 12:08:10.398679 master-0 kubenswrapper[35367]: I1204 12:08:10.398513 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-64cdd44ddd-2t62p" podUID="29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8" containerName="console" probeResult="failure" output="Get \"https://10.128.0.113:8443/health\": dial tcp 10.128.0.113:8443: connect: connection refused" Dec 04 12:08:10.456070 master-0 kubenswrapper[35367]: I1204 12:08:10.456017 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"config" Dec 04 12:08:10.561697 master-0 kubenswrapper[35367]: I1204 12:08:10.561632 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"kube-root-ca.crt" Dec 04 12:08:10.573974 master-0 kubenswrapper[35367]: I1204 12:08:10.573921 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"config" Dec 04 12:08:10.600423 master-0 kubenswrapper[35367]: I1204 12:08:10.600355 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-kube-rbac-proxy-config" Dec 04 12:08:10.605470 master-0 kubenswrapper[35367]: I1204 12:08:10.605415 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"kube-root-ca.crt" Dec 04 12:08:10.643696 master-0 kubenswrapper[35367]: I1204 12:08:10.643562 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-service-ca.crt" Dec 04 12:08:10.649589 master-0 kubenswrapper[35367]: I1204 12:08:10.649558 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-operator-serving-cert" Dec 04 12:08:10.717029 master-0 kubenswrapper[35367]: I1204 12:08:10.716853 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console-operator"/"kube-root-ca.crt" Dec 04 12:08:10.734631 master-0 kubenswrapper[35367]: I1204 12:08:10.734549 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-version"/"cluster-version-operator-serving-cert" Dec 04 12:08:10.808076 master-0 kubenswrapper[35367]: I1204 12:08:10.807931 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-credential-operator"/"cloud-credential-operator-serving-cert" Dec 04 12:08:10.832926 master-0 kubenswrapper[35367]: I1204 12:08:10.830384 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"openshift-service-ca.crt" Dec 04 12:08:10.834486 master-0 kubenswrapper[35367]: I1204 12:08:10.833510 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"etcd-serving-ca" Dec 04 12:08:10.863801 master-0 kubenswrapper[35367]: I1204 12:08:10.863736 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"machine-api-operator-dockercfg-tpbt2" Dec 04 12:08:10.866543 master-0 kubenswrapper[35367]: I1204 12:08:10.866490 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"openshift-service-ca.crt" Dec 04 12:08:10.866766 master-0 kubenswrapper[35367]: I1204 12:08:10.866709 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"kube-root-ca.crt" Dec 04 12:08:10.923146 master-0 kubenswrapper[35367]: I1204 12:08:10.922914 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-catalogd"/"catalogserver-cert" Dec 04 12:08:10.940111 master-0 kubenswrapper[35367]: I1204 12:08:10.940021 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"openshift-service-ca.crt" Dec 04 12:08:10.943724 master-0 kubenswrapper[35367]: I1204 12:08:10.943661 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"kube-root-ca.crt" Dec 04 12:08:10.950068 master-0 kubenswrapper[35367]: I1204 12:08:10.949953 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"audit-1" Dec 04 12:08:10.987897 master-0 kubenswrapper[35367]: I1204 12:08:10.987795 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"package-server-manager-serving-cert" Dec 04 12:08:10.996696 master-0 kubenswrapper[35367]: I1204 12:08:10.996634 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"config" Dec 04 12:08:11.020911 master-0 kubenswrapper[35367]: I1204 12:08:11.020774 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"packageserver-service-cert" Dec 04 12:08:11.116187 master-0 kubenswrapper[35367]: I1204 12:08:11.116114 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"service-ca" Dec 04 12:08:11.152298 master-0 kubenswrapper[35367]: I1204 12:08:11.152184 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress"/"openshift-service-ca.crt" Dec 04 12:08:11.182406 master-0 kubenswrapper[35367]: I1204 12:08:11.182187 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"client-ca" Dec 04 12:08:11.259562 master-0 kubenswrapper[35367]: I1204 12:08:11.259496 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-controller-manager-operator"/"kube-rbac-proxy" Dec 04 12:08:11.319426 master-0 kubenswrapper[35367]: I1204 12:08:11.319340 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication-operator"/"serving-cert" Dec 04 12:08:11.336211 master-0 kubenswrapper[35367]: I1204 12:08:11.335949 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"openshift-service-ca.crt" Dec 04 12:08:11.367184 master-0 kubenswrapper[35367]: I1204 12:08:11.367110 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-config" Dec 04 12:08:11.524170 master-0 kubenswrapper[35367]: I1204 12:08:11.524028 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"openshift-controller-manager-sa-dockercfg-llqk2" Dec 04 12:08:11.525775 master-0 kubenswrapper[35367]: I1204 12:08:11.525737 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"kube-root-ca.crt" Dec 04 12:08:11.586251 master-0 kubenswrapper[35367]: I1204 12:08:11.586185 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"kube-root-ca.crt" Dec 04 12:08:11.611432 master-0 kubenswrapper[35367]: I1204 12:08:11.609332 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"client-ca" Dec 04 12:08:11.616102 master-0 kubenswrapper[35367]: I1204 12:08:11.615737 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy" Dec 04 12:08:11.674945 master-0 kubenswrapper[35367]: I1204 12:08:11.674874 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"machine-api-operator-images" Dec 04 12:08:11.749433 master-0 kubenswrapper[35367]: I1204 12:08:11.749358 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-service-ca-bundle" Dec 04 12:08:11.752516 master-0 kubenswrapper[35367]: I1204 12:08:11.752481 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"openshift-service-ca.crt" Dec 04 12:08:11.842387 master-0 kubenswrapper[35367]: I1204 12:08:11.842291 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-node-identity"/"network-node-identity-cert" Dec 04 12:08:12.089382 master-0 kubenswrapper[35367]: I1204 12:08:12.089305 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kube-root-ca.crt" Dec 04 12:08:12.172036 master-0 kubenswrapper[35367]: I1204 12:08:12.171899 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cloud-credential-operator"/"openshift-service-ca.crt" Dec 04 12:08:12.226416 master-0 kubenswrapper[35367]: I1204 12:08:12.226370 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"kube-root-ca.crt" Dec 04 12:08:12.310173 master-0 kubenswrapper[35367]: I1204 12:08:12.310123 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"image-registry-operator-tls" Dec 04 12:08:12.489433 master-0 kubenswrapper[35367]: I1204 12:08:12.489299 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"olm-operator-serving-cert" Dec 04 12:08:12.549916 master-0 kubenswrapper[35367]: I1204 12:08:12.549871 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-tls" Dec 04 12:08:12.683348 master-0 kubenswrapper[35367]: I1204 12:08:12.683288 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"kube-root-ca.crt" Dec 04 12:08:12.739541 master-0 kubenswrapper[35367]: I1204 12:08:12.739407 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"openshift-service-ca.crt" Dec 04 12:08:12.816757 master-0 kubenswrapper[35367]: I1204 12:08:12.816693 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-dockercfg-c2w2p" Dec 04 12:08:12.864876 master-0 kubenswrapper[35367]: I1204 12:08:12.864823 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"openshift-service-ca.crt" Dec 04 12:08:13.065855 master-0 kubenswrapper[35367]: I1204 12:08:13.065751 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"openshift-service-ca.crt" Dec 04 12:08:13.091402 master-0 kubenswrapper[35367]: I1204 12:08:13.091316 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-canary"/"default-dockercfg-9mbcr" Dec 04 12:08:13.169435 master-0 kubenswrapper[35367]: I1204 12:08:13.169380 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"kube-root-ca.crt" Dec 04 12:08:13.169687 master-0 kubenswrapper[35367]: I1204 12:08:13.169670 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"cluster-baremetal-operator-tls" Dec 04 12:08:13.426146 master-0 kubenswrapper[35367]: I1204 12:08:13.426037 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"route-controller-manager-sa-dockercfg-qzw27" Dec 04 12:08:13.437107 master-0 kubenswrapper[35367]: I1204 12:08:13.437051 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"thanos-querier-kube-rbac-proxy-metrics" Dec 04 12:08:13.461055 master-0 kubenswrapper[35367]: I1204 12:08:13.460988 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-serving-cert" Dec 04 12:08:13.492186 master-0 kubenswrapper[35367]: I1204 12:08:13.492131 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cloud-controller-manager-operator"/"cloud-controller-manager-operator-tls" Dec 04 12:08:13.681469 master-0 kubenswrapper[35367]: I1204 12:08:13.681343 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"kube-root-ca.crt" Dec 04 12:08:13.739704 master-0 kubenswrapper[35367]: I1204 12:08:13.739616 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"openshift-service-ca.crt" Dec 04 12:08:14.130969 master-0 kubenswrapper[35367]: I1204 12:08:14.130871 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-script-lib" Dec 04 12:08:14.159093 master-0 kubenswrapper[35367]: I1204 12:08:14.159026 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"prometheus-trusted-ca-bundle" Dec 04 12:08:14.535901 master-0 kubenswrapper[35367]: I1204 12:08:14.535776 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"kube-root-ca.crt" Dec 04 12:08:14.630449 master-0 kubenswrapper[35367]: I1204 12:08:14.630387 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-controller"/"operator-controller-trusted-ca-bundle" Dec 04 12:08:14.824084 master-0 kubenswrapper[35367]: I1204 12:08:14.823997 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"openshift-service-ca.crt" Dec 04 12:08:15.643041 master-0 kubenswrapper[35367]: I1204 12:08:15.642990 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-rbac-proxy" Dec 04 12:08:15.765346 master-0 kubenswrapper[35367]: I1204 12:08:15.765302 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-startup-monitor-master-0_f6ff77581942073946c662abf05d3494/startup-monitor/0.log" Dec 04 12:08:15.765586 master-0 kubenswrapper[35367]: I1204 12:08:15.765395 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:08:15.915377 master-0 kubenswrapper[35367]: I1204 12:08:15.915225 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-var-lock\") pod \"f6ff77581942073946c662abf05d3494\" (UID: \"f6ff77581942073946c662abf05d3494\") " Dec 04 12:08:15.915927 master-0 kubenswrapper[35367]: I1204 12:08:15.915322 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-var-lock" (OuterVolumeSpecName: "var-lock") pod "f6ff77581942073946c662abf05d3494" (UID: "f6ff77581942073946c662abf05d3494"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:08:15.915927 master-0 kubenswrapper[35367]: I1204 12:08:15.915428 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-resource-dir\") pod \"f6ff77581942073946c662abf05d3494\" (UID: \"f6ff77581942073946c662abf05d3494\") " Dec 04 12:08:15.915927 master-0 kubenswrapper[35367]: I1204 12:08:15.915455 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-pod-resource-dir\") pod \"f6ff77581942073946c662abf05d3494\" (UID: \"f6ff77581942073946c662abf05d3494\") " Dec 04 12:08:15.915927 master-0 kubenswrapper[35367]: I1204 12:08:15.915507 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-manifests\") pod \"f6ff77581942073946c662abf05d3494\" (UID: \"f6ff77581942073946c662abf05d3494\") " Dec 04 12:08:15.915927 master-0 kubenswrapper[35367]: I1204 12:08:15.915530 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-var-log\") pod \"f6ff77581942073946c662abf05d3494\" (UID: \"f6ff77581942073946c662abf05d3494\") " Dec 04 12:08:15.916122 master-0 kubenswrapper[35367]: I1204 12:08:15.915558 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "f6ff77581942073946c662abf05d3494" (UID: "f6ff77581942073946c662abf05d3494"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:08:15.916122 master-0 kubenswrapper[35367]: I1204 12:08:15.915597 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-var-log" (OuterVolumeSpecName: "var-log") pod "f6ff77581942073946c662abf05d3494" (UID: "f6ff77581942073946c662abf05d3494"). InnerVolumeSpecName "var-log". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:08:15.916122 master-0 kubenswrapper[35367]: I1204 12:08:15.915621 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-manifests" (OuterVolumeSpecName: "manifests") pod "f6ff77581942073946c662abf05d3494" (UID: "f6ff77581942073946c662abf05d3494"). InnerVolumeSpecName "manifests". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:08:15.916122 master-0 kubenswrapper[35367]: I1204 12:08:15.916121 35367 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 12:08:15.916280 master-0 kubenswrapper[35367]: I1204 12:08:15.916139 35367 reconciler_common.go:293] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:08:15.916280 master-0 kubenswrapper[35367]: I1204 12:08:15.916149 35367 reconciler_common.go:293] "Volume detached for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-manifests\") on node \"master-0\" DevicePath \"\"" Dec 04 12:08:15.916280 master-0 kubenswrapper[35367]: I1204 12:08:15.916158 35367 reconciler_common.go:293] "Volume detached for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-var-log\") on node \"master-0\" DevicePath \"\"" Dec 04 12:08:15.919588 master-0 kubenswrapper[35367]: I1204 12:08:15.919553 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-pod-resource-dir" (OuterVolumeSpecName: "pod-resource-dir") pod "f6ff77581942073946c662abf05d3494" (UID: "f6ff77581942073946c662abf05d3494"). InnerVolumeSpecName "pod-resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:08:16.017379 master-0 kubenswrapper[35367]: I1204 12:08:16.017280 35367 reconciler_common.go:293] "Volume detached for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/f6ff77581942073946c662abf05d3494-pod-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:08:16.028934 master-0 kubenswrapper[35367]: I1204 12:08:16.028856 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-startup-monitor-master-0_f6ff77581942073946c662abf05d3494/startup-monitor/0.log" Dec 04 12:08:16.029198 master-0 kubenswrapper[35367]: I1204 12:08:16.028944 35367 generic.go:334] "Generic (PLEG): container finished" podID="f6ff77581942073946c662abf05d3494" containerID="dda5b2fb3bd943c974521ae6793f137afa4009d15742fc9cc977c202f508305a" exitCode=137 Dec 04 12:08:16.029198 master-0 kubenswrapper[35367]: I1204 12:08:16.029004 35367 scope.go:117] "RemoveContainer" containerID="dda5b2fb3bd943c974521ae6793f137afa4009d15742fc9cc977c202f508305a" Dec 04 12:08:16.029198 master-0 kubenswrapper[35367]: I1204 12:08:16.029017 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" Dec 04 12:08:16.048376 master-0 kubenswrapper[35367]: I1204 12:08:16.048337 35367 scope.go:117] "RemoveContainer" containerID="dda5b2fb3bd943c974521ae6793f137afa4009d15742fc9cc977c202f508305a" Dec 04 12:08:16.048856 master-0 kubenswrapper[35367]: E1204 12:08:16.048824 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dda5b2fb3bd943c974521ae6793f137afa4009d15742fc9cc977c202f508305a\": container with ID starting with dda5b2fb3bd943c974521ae6793f137afa4009d15742fc9cc977c202f508305a not found: ID does not exist" containerID="dda5b2fb3bd943c974521ae6793f137afa4009d15742fc9cc977c202f508305a" Dec 04 12:08:16.048935 master-0 kubenswrapper[35367]: I1204 12:08:16.048857 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dda5b2fb3bd943c974521ae6793f137afa4009d15742fc9cc977c202f508305a"} err="failed to get container status \"dda5b2fb3bd943c974521ae6793f137afa4009d15742fc9cc977c202f508305a\": rpc error: code = NotFound desc = could not find container \"dda5b2fb3bd943c974521ae6793f137afa4009d15742fc9cc977c202f508305a\": container with ID starting with dda5b2fb3bd943c974521ae6793f137afa4009d15742fc9cc977c202f508305a not found: ID does not exist" Dec 04 12:08:16.759471 master-0 kubenswrapper[35367]: I1204 12:08:16.759390 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6ff77581942073946c662abf05d3494" path="/var/lib/kubelet/pods/f6ff77581942073946c662abf05d3494/volumes" Dec 04 12:08:16.759768 master-0 kubenswrapper[35367]: I1204 12:08:16.759715 35367 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" podUID="" Dec 04 12:08:16.779038 master-0 kubenswrapper[35367]: I1204 12:08:16.778952 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 12:08:16.779038 master-0 kubenswrapper[35367]: I1204 12:08:16.779034 35367 kubelet.go:2649] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" mirrorPodUID="4cdefe3b-ca65-4622-a39c-02a8c07979ac" Dec 04 12:08:16.789120 master-0 kubenswrapper[35367]: I1204 12:08:16.789066 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0"] Dec 04 12:08:16.789425 master-0 kubenswrapper[35367]: I1204 12:08:16.789122 35367 kubelet.go:2673] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-kube-apiserver/kube-apiserver-startup-monitor-master-0" mirrorPodUID="4cdefe3b-ca65-4622-a39c-02a8c07979ac" Dec 04 12:08:18.534262 master-0 kubenswrapper[35367]: I1204 12:08:18.534155 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:08:18.538835 master-0 kubenswrapper[35367]: I1204 12:08:18.538756 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:08:18.634619 master-0 kubenswrapper[35367]: I1204 12:08:18.634520 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64cdd44ddd-2t62p"] Dec 04 12:08:37.214647 master-0 kubenswrapper[35367]: I1204 12:08:37.214536 35367 generic.go:334] "Generic (PLEG): container finished" podID="fd4c4c6f-380a-4cda-9a21-352b55ec2d98" containerID="89db4c9e7a1f15edef2376bc38c5315348eb359a29dfa924891df6a33cb2f7e5" exitCode=0 Dec 04 12:08:37.215384 master-0 kubenswrapper[35367]: I1204 12:08:37.214648 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" event={"ID":"fd4c4c6f-380a-4cda-9a21-352b55ec2d98","Type":"ContainerDied","Data":"89db4c9e7a1f15edef2376bc38c5315348eb359a29dfa924891df6a33cb2f7e5"} Dec 04 12:08:37.215384 master-0 kubenswrapper[35367]: I1204 12:08:37.214722 35367 scope.go:117] "RemoveContainer" containerID="44b8506d6a819dafeb21c5a4e661b7d718d0df7d433b1764865e76d91ef84eca" Dec 04 12:08:37.215928 master-0 kubenswrapper[35367]: I1204 12:08:37.215873 35367 scope.go:117] "RemoveContainer" containerID="89db4c9e7a1f15edef2376bc38c5315348eb359a29dfa924891df6a33cb2f7e5" Dec 04 12:08:38.224304 master-0 kubenswrapper[35367]: I1204 12:08:38.224235 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" event={"ID":"fd4c4c6f-380a-4cda-9a21-352b55ec2d98","Type":"ContainerStarted","Data":"de6c9ba5d10b41eabe90040d631dcab163496b6f7f85d72db147de31d5a7eeeb"} Dec 04 12:08:38.224867 master-0 kubenswrapper[35367]: I1204 12:08:38.224602 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 12:08:38.226522 master-0 kubenswrapper[35367]: I1204 12:08:38.226459 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/marketplace-operator-f797b99b6-hjjrk" Dec 04 12:08:38.328164 master-0 kubenswrapper[35367]: I1204 12:08:38.327421 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-v2gh5"] Dec 04 12:08:38.328164 master-0 kubenswrapper[35367]: E1204 12:08:38.327985 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f6ff77581942073946c662abf05d3494" containerName="startup-monitor" Dec 04 12:08:38.328164 master-0 kubenswrapper[35367]: I1204 12:08:38.328005 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6ff77581942073946c662abf05d3494" containerName="startup-monitor" Dec 04 12:08:38.328164 master-0 kubenswrapper[35367]: E1204 12:08:38.328051 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ea79af85-e731-449a-a476-2ff8b05f9d80" containerName="console" Dec 04 12:08:38.328164 master-0 kubenswrapper[35367]: I1204 12:08:38.328060 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea79af85-e731-449a-a476-2ff8b05f9d80" containerName="console" Dec 04 12:08:38.328164 master-0 kubenswrapper[35367]: E1204 12:08:38.328074 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7f04fa4e-8587-43ad-bd31-0d6cb1067e28" containerName="installer" Dec 04 12:08:38.328164 master-0 kubenswrapper[35367]: I1204 12:08:38.328083 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f04fa4e-8587-43ad-bd31-0d6cb1067e28" containerName="installer" Dec 04 12:08:38.328666 master-0 kubenswrapper[35367]: E1204 12:08:38.328316 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="91498480-8e7a-4ac5-86b3-9ff689a2e0c6" containerName="console" Dec 04 12:08:38.328666 master-0 kubenswrapper[35367]: I1204 12:08:38.328331 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="91498480-8e7a-4ac5-86b3-9ff689a2e0c6" containerName="console" Dec 04 12:08:38.328666 master-0 kubenswrapper[35367]: I1204 12:08:38.328522 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="7f04fa4e-8587-43ad-bd31-0d6cb1067e28" containerName="installer" Dec 04 12:08:38.328666 master-0 kubenswrapper[35367]: I1204 12:08:38.328560 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="ea79af85-e731-449a-a476-2ff8b05f9d80" containerName="console" Dec 04 12:08:38.328666 master-0 kubenswrapper[35367]: I1204 12:08:38.328573 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="91498480-8e7a-4ac5-86b3-9ff689a2e0c6" containerName="console" Dec 04 12:08:38.328666 master-0 kubenswrapper[35367]: I1204 12:08:38.328585 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="f6ff77581942073946c662abf05d3494" containerName="startup-monitor" Dec 04 12:08:38.330790 master-0 kubenswrapper[35367]: I1204 12:08:38.330737 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-v2gh5" Dec 04 12:08:38.347347 master-0 kubenswrapper[35367]: I1204 12:08:38.347251 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-v2gh5"] Dec 04 12:08:38.427327 master-0 kubenswrapper[35367]: I1204 12:08:38.427240 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f4283051-9a72-4bab-b4e9-0fcff55962f9-catalog-content\") pod \"redhat-operators-v2gh5\" (UID: \"f4283051-9a72-4bab-b4e9-0fcff55962f9\") " pod="openshift-marketplace/redhat-operators-v2gh5" Dec 04 12:08:38.427327 master-0 kubenswrapper[35367]: I1204 12:08:38.427332 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86p48\" (UniqueName: \"kubernetes.io/projected/f4283051-9a72-4bab-b4e9-0fcff55962f9-kube-api-access-86p48\") pod \"redhat-operators-v2gh5\" (UID: \"f4283051-9a72-4bab-b4e9-0fcff55962f9\") " pod="openshift-marketplace/redhat-operators-v2gh5" Dec 04 12:08:38.427773 master-0 kubenswrapper[35367]: I1204 12:08:38.427363 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f4283051-9a72-4bab-b4e9-0fcff55962f9-utilities\") pod \"redhat-operators-v2gh5\" (UID: \"f4283051-9a72-4bab-b4e9-0fcff55962f9\") " pod="openshift-marketplace/redhat-operators-v2gh5" Dec 04 12:08:38.529200 master-0 kubenswrapper[35367]: I1204 12:08:38.529042 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-86p48\" (UniqueName: \"kubernetes.io/projected/f4283051-9a72-4bab-b4e9-0fcff55962f9-kube-api-access-86p48\") pod \"redhat-operators-v2gh5\" (UID: \"f4283051-9a72-4bab-b4e9-0fcff55962f9\") " pod="openshift-marketplace/redhat-operators-v2gh5" Dec 04 12:08:38.529399 master-0 kubenswrapper[35367]: I1204 12:08:38.529198 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f4283051-9a72-4bab-b4e9-0fcff55962f9-utilities\") pod \"redhat-operators-v2gh5\" (UID: \"f4283051-9a72-4bab-b4e9-0fcff55962f9\") " pod="openshift-marketplace/redhat-operators-v2gh5" Dec 04 12:08:38.529399 master-0 kubenswrapper[35367]: I1204 12:08:38.529374 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f4283051-9a72-4bab-b4e9-0fcff55962f9-catalog-content\") pod \"redhat-operators-v2gh5\" (UID: \"f4283051-9a72-4bab-b4e9-0fcff55962f9\") " pod="openshift-marketplace/redhat-operators-v2gh5" Dec 04 12:08:38.529877 master-0 kubenswrapper[35367]: I1204 12:08:38.529775 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f4283051-9a72-4bab-b4e9-0fcff55962f9-utilities\") pod \"redhat-operators-v2gh5\" (UID: \"f4283051-9a72-4bab-b4e9-0fcff55962f9\") " pod="openshift-marketplace/redhat-operators-v2gh5" Dec 04 12:08:38.529951 master-0 kubenswrapper[35367]: I1204 12:08:38.529860 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f4283051-9a72-4bab-b4e9-0fcff55962f9-catalog-content\") pod \"redhat-operators-v2gh5\" (UID: \"f4283051-9a72-4bab-b4e9-0fcff55962f9\") " pod="openshift-marketplace/redhat-operators-v2gh5" Dec 04 12:08:38.547237 master-0 kubenswrapper[35367]: I1204 12:08:38.547187 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-86p48\" (UniqueName: \"kubernetes.io/projected/f4283051-9a72-4bab-b4e9-0fcff55962f9-kube-api-access-86p48\") pod \"redhat-operators-v2gh5\" (UID: \"f4283051-9a72-4bab-b4e9-0fcff55962f9\") " pod="openshift-marketplace/redhat-operators-v2gh5" Dec 04 12:08:38.662722 master-0 kubenswrapper[35367]: I1204 12:08:38.662588 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-v2gh5" Dec 04 12:08:38.703694 master-0 kubenswrapper[35367]: I1204 12:08:38.703462 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-gzs5w"] Dec 04 12:08:38.704950 master-0 kubenswrapper[35367]: I1204 12:08:38.704922 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-gzs5w" Dec 04 12:08:38.721036 master-0 kubenswrapper[35367]: I1204 12:08:38.720950 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-gzs5w"] Dec 04 12:08:38.734399 master-0 kubenswrapper[35367]: I1204 12:08:38.734324 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/14fef399-4e8f-4867-ace9-3b273117f886-utilities\") pod \"redhat-operators-gzs5w\" (UID: \"14fef399-4e8f-4867-ace9-3b273117f886\") " pod="openshift-marketplace/redhat-operators-gzs5w" Dec 04 12:08:38.734399 master-0 kubenswrapper[35367]: I1204 12:08:38.734386 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/14fef399-4e8f-4867-ace9-3b273117f886-catalog-content\") pod \"redhat-operators-gzs5w\" (UID: \"14fef399-4e8f-4867-ace9-3b273117f886\") " pod="openshift-marketplace/redhat-operators-gzs5w" Dec 04 12:08:38.838132 master-0 kubenswrapper[35367]: I1204 12:08:38.838029 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqh49\" (UniqueName: \"kubernetes.io/projected/14fef399-4e8f-4867-ace9-3b273117f886-kube-api-access-xqh49\") pod \"redhat-operators-gzs5w\" (UID: \"14fef399-4e8f-4867-ace9-3b273117f886\") " pod="openshift-marketplace/redhat-operators-gzs5w" Dec 04 12:08:38.838375 master-0 kubenswrapper[35367]: I1204 12:08:38.838141 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/14fef399-4e8f-4867-ace9-3b273117f886-utilities\") pod \"redhat-operators-gzs5w\" (UID: \"14fef399-4e8f-4867-ace9-3b273117f886\") " pod="openshift-marketplace/redhat-operators-gzs5w" Dec 04 12:08:38.838375 master-0 kubenswrapper[35367]: I1204 12:08:38.838174 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/14fef399-4e8f-4867-ace9-3b273117f886-catalog-content\") pod \"redhat-operators-gzs5w\" (UID: \"14fef399-4e8f-4867-ace9-3b273117f886\") " pod="openshift-marketplace/redhat-operators-gzs5w" Dec 04 12:08:38.839444 master-0 kubenswrapper[35367]: I1204 12:08:38.839399 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/14fef399-4e8f-4867-ace9-3b273117f886-utilities\") pod \"redhat-operators-gzs5w\" (UID: \"14fef399-4e8f-4867-ace9-3b273117f886\") " pod="openshift-marketplace/redhat-operators-gzs5w" Dec 04 12:08:38.839851 master-0 kubenswrapper[35367]: I1204 12:08:38.839793 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/14fef399-4e8f-4867-ace9-3b273117f886-catalog-content\") pod \"redhat-operators-gzs5w\" (UID: \"14fef399-4e8f-4867-ace9-3b273117f886\") " pod="openshift-marketplace/redhat-operators-gzs5w" Dec 04 12:08:38.939688 master-0 kubenswrapper[35367]: I1204 12:08:38.939593 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xqh49\" (UniqueName: \"kubernetes.io/projected/14fef399-4e8f-4867-ace9-3b273117f886-kube-api-access-xqh49\") pod \"redhat-operators-gzs5w\" (UID: \"14fef399-4e8f-4867-ace9-3b273117f886\") " pod="openshift-marketplace/redhat-operators-gzs5w" Dec 04 12:08:38.958553 master-0 kubenswrapper[35367]: I1204 12:08:38.958467 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqh49\" (UniqueName: \"kubernetes.io/projected/14fef399-4e8f-4867-ace9-3b273117f886-kube-api-access-xqh49\") pod \"redhat-operators-gzs5w\" (UID: \"14fef399-4e8f-4867-ace9-3b273117f886\") " pod="openshift-marketplace/redhat-operators-gzs5w" Dec 04 12:08:39.062533 master-0 kubenswrapper[35367]: I1204 12:08:39.062355 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-gzs5w" Dec 04 12:08:39.105431 master-0 kubenswrapper[35367]: I1204 12:08:39.105348 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-v2gh5"] Dec 04 12:08:39.109405 master-0 kubenswrapper[35367]: W1204 12:08:39.109349 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4283051_9a72_4bab_b4e9_0fcff55962f9.slice/crio-72bff524da6626ec4dd623bf443a5b2a63c4bbd36813d294a4cc4bfb85b20411 WatchSource:0}: Error finding container 72bff524da6626ec4dd623bf443a5b2a63c4bbd36813d294a4cc4bfb85b20411: Status 404 returned error can't find the container with id 72bff524da6626ec4dd623bf443a5b2a63c4bbd36813d294a4cc4bfb85b20411 Dec 04 12:08:39.237108 master-0 kubenswrapper[35367]: I1204 12:08:39.237054 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v2gh5" event={"ID":"f4283051-9a72-4bab-b4e9-0fcff55962f9","Type":"ContainerStarted","Data":"72bff524da6626ec4dd623bf443a5b2a63c4bbd36813d294a4cc4bfb85b20411"} Dec 04 12:08:39.514305 master-0 kubenswrapper[35367]: I1204 12:08:39.514227 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-gzs5w"] Dec 04 12:08:39.517637 master-0 kubenswrapper[35367]: W1204 12:08:39.517575 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14fef399_4e8f_4867_ace9_3b273117f886.slice/crio-71ccdfd0f9f95b32e09489ae5a58c9134e27c8cb9e22165d5705f1ccacccb445 WatchSource:0}: Error finding container 71ccdfd0f9f95b32e09489ae5a58c9134e27c8cb9e22165d5705f1ccacccb445: Status 404 returned error can't find the container with id 71ccdfd0f9f95b32e09489ae5a58c9134e27c8cb9e22165d5705f1ccacccb445 Dec 04 12:08:39.902628 master-0 kubenswrapper[35367]: I1204 12:08:39.901724 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-mwsqm"] Dec 04 12:08:39.904606 master-0 kubenswrapper[35367]: I1204 12:08:39.904505 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-mwsqm" Dec 04 12:08:39.919937 master-0 kubenswrapper[35367]: I1204 12:08:39.919866 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-mwsqm"] Dec 04 12:08:40.061061 master-0 kubenswrapper[35367]: I1204 12:08:40.060986 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5b2522d3-a2e9-435f-971f-9cc73721e99c-catalog-content\") pod \"redhat-operators-mwsqm\" (UID: \"5b2522d3-a2e9-435f-971f-9cc73721e99c\") " pod="openshift-marketplace/redhat-operators-mwsqm" Dec 04 12:08:40.061061 master-0 kubenswrapper[35367]: I1204 12:08:40.061059 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5b2522d3-a2e9-435f-971f-9cc73721e99c-utilities\") pod \"redhat-operators-mwsqm\" (UID: \"5b2522d3-a2e9-435f-971f-9cc73721e99c\") " pod="openshift-marketplace/redhat-operators-mwsqm" Dec 04 12:08:40.061478 master-0 kubenswrapper[35367]: I1204 12:08:40.061102 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwml4\" (UniqueName: \"kubernetes.io/projected/5b2522d3-a2e9-435f-971f-9cc73721e99c-kube-api-access-jwml4\") pod \"redhat-operators-mwsqm\" (UID: \"5b2522d3-a2e9-435f-971f-9cc73721e99c\") " pod="openshift-marketplace/redhat-operators-mwsqm" Dec 04 12:08:40.162843 master-0 kubenswrapper[35367]: I1204 12:08:40.162659 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5b2522d3-a2e9-435f-971f-9cc73721e99c-catalog-content\") pod \"redhat-operators-mwsqm\" (UID: \"5b2522d3-a2e9-435f-971f-9cc73721e99c\") " pod="openshift-marketplace/redhat-operators-mwsqm" Dec 04 12:08:40.162843 master-0 kubenswrapper[35367]: I1204 12:08:40.162728 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5b2522d3-a2e9-435f-971f-9cc73721e99c-utilities\") pod \"redhat-operators-mwsqm\" (UID: \"5b2522d3-a2e9-435f-971f-9cc73721e99c\") " pod="openshift-marketplace/redhat-operators-mwsqm" Dec 04 12:08:40.163143 master-0 kubenswrapper[35367]: I1204 12:08:40.162955 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jwml4\" (UniqueName: \"kubernetes.io/projected/5b2522d3-a2e9-435f-971f-9cc73721e99c-kube-api-access-jwml4\") pod \"redhat-operators-mwsqm\" (UID: \"5b2522d3-a2e9-435f-971f-9cc73721e99c\") " pod="openshift-marketplace/redhat-operators-mwsqm" Dec 04 12:08:40.163534 master-0 kubenswrapper[35367]: I1204 12:08:40.163471 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5b2522d3-a2e9-435f-971f-9cc73721e99c-catalog-content\") pod \"redhat-operators-mwsqm\" (UID: \"5b2522d3-a2e9-435f-971f-9cc73721e99c\") " pod="openshift-marketplace/redhat-operators-mwsqm" Dec 04 12:08:40.163678 master-0 kubenswrapper[35367]: I1204 12:08:40.163632 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5b2522d3-a2e9-435f-971f-9cc73721e99c-utilities\") pod \"redhat-operators-mwsqm\" (UID: \"5b2522d3-a2e9-435f-971f-9cc73721e99c\") " pod="openshift-marketplace/redhat-operators-mwsqm" Dec 04 12:08:40.180673 master-0 kubenswrapper[35367]: I1204 12:08:40.180585 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwml4\" (UniqueName: \"kubernetes.io/projected/5b2522d3-a2e9-435f-971f-9cc73721e99c-kube-api-access-jwml4\") pod \"redhat-operators-mwsqm\" (UID: \"5b2522d3-a2e9-435f-971f-9cc73721e99c\") " pod="openshift-marketplace/redhat-operators-mwsqm" Dec 04 12:08:40.224623 master-0 kubenswrapper[35367]: I1204 12:08:40.224544 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-mwsqm" Dec 04 12:08:40.246798 master-0 kubenswrapper[35367]: I1204 12:08:40.246728 35367 generic.go:334] "Generic (PLEG): container finished" podID="f4283051-9a72-4bab-b4e9-0fcff55962f9" containerID="2453d8e49a90c4a332b0d1a1773e5eeded1fc6928741e05b8f148a051f7b3ada" exitCode=0 Dec 04 12:08:40.246798 master-0 kubenswrapper[35367]: I1204 12:08:40.246795 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v2gh5" event={"ID":"f4283051-9a72-4bab-b4e9-0fcff55962f9","Type":"ContainerDied","Data":"2453d8e49a90c4a332b0d1a1773e5eeded1fc6928741e05b8f148a051f7b3ada"} Dec 04 12:08:40.251559 master-0 kubenswrapper[35367]: I1204 12:08:40.251480 35367 generic.go:334] "Generic (PLEG): container finished" podID="14fef399-4e8f-4867-ace9-3b273117f886" containerID="2fec0147f28de4ddeaa1abd5cf2aca66cb69d36b1c5e9cf3708b03d0119ba17b" exitCode=0 Dec 04 12:08:40.251788 master-0 kubenswrapper[35367]: I1204 12:08:40.251684 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-gzs5w" event={"ID":"14fef399-4e8f-4867-ace9-3b273117f886","Type":"ContainerDied","Data":"2fec0147f28de4ddeaa1abd5cf2aca66cb69d36b1c5e9cf3708b03d0119ba17b"} Dec 04 12:08:40.251788 master-0 kubenswrapper[35367]: I1204 12:08:40.251734 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-gzs5w" event={"ID":"14fef399-4e8f-4867-ace9-3b273117f886","Type":"ContainerStarted","Data":"71ccdfd0f9f95b32e09489ae5a58c9134e27c8cb9e22165d5705f1ccacccb445"} Dec 04 12:08:40.639492 master-0 kubenswrapper[35367]: I1204 12:08:40.639408 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-mwsqm"] Dec 04 12:08:41.263886 master-0 kubenswrapper[35367]: I1204 12:08:41.263008 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-wgn8s"] Dec 04 12:08:41.266123 master-0 kubenswrapper[35367]: I1204 12:08:41.265881 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-wgn8s" Dec 04 12:08:41.270252 master-0 kubenswrapper[35367]: I1204 12:08:41.270190 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-mwsqm" event={"ID":"5b2522d3-a2e9-435f-971f-9cc73721e99c","Type":"ContainerStarted","Data":"9c8e124675e9725ba55a905a966d8d3ef44987fb357aee12d91d2a425dc44d00"} Dec 04 12:08:41.270252 master-0 kubenswrapper[35367]: I1204 12:08:41.270249 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-mwsqm" event={"ID":"5b2522d3-a2e9-435f-971f-9cc73721e99c","Type":"ContainerStarted","Data":"9a224e4232cdaa1d99867695878c059e13a6af30eb8239b7bb49f581e178d5b8"} Dec 04 12:08:41.281992 master-0 kubenswrapper[35367]: I1204 12:08:41.281627 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-wgn8s"] Dec 04 12:08:41.386893 master-0 kubenswrapper[35367]: I1204 12:08:41.386670 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2297684c-a98b-441c-8913-b5e9f39a2570-catalog-content\") pod \"redhat-operators-wgn8s\" (UID: \"2297684c-a98b-441c-8913-b5e9f39a2570\") " pod="openshift-marketplace/redhat-operators-wgn8s" Dec 04 12:08:41.386997 master-0 kubenswrapper[35367]: I1204 12:08:41.386891 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v6c2\" (UniqueName: \"kubernetes.io/projected/2297684c-a98b-441c-8913-b5e9f39a2570-kube-api-access-4v6c2\") pod \"redhat-operators-wgn8s\" (UID: \"2297684c-a98b-441c-8913-b5e9f39a2570\") " pod="openshift-marketplace/redhat-operators-wgn8s" Dec 04 12:08:41.386997 master-0 kubenswrapper[35367]: I1204 12:08:41.386961 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2297684c-a98b-441c-8913-b5e9f39a2570-utilities\") pod \"redhat-operators-wgn8s\" (UID: \"2297684c-a98b-441c-8913-b5e9f39a2570\") " pod="openshift-marketplace/redhat-operators-wgn8s" Dec 04 12:08:41.488553 master-0 kubenswrapper[35367]: I1204 12:08:41.488474 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4v6c2\" (UniqueName: \"kubernetes.io/projected/2297684c-a98b-441c-8913-b5e9f39a2570-kube-api-access-4v6c2\") pod \"redhat-operators-wgn8s\" (UID: \"2297684c-a98b-441c-8913-b5e9f39a2570\") " pod="openshift-marketplace/redhat-operators-wgn8s" Dec 04 12:08:41.488779 master-0 kubenswrapper[35367]: I1204 12:08:41.488629 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2297684c-a98b-441c-8913-b5e9f39a2570-utilities\") pod \"redhat-operators-wgn8s\" (UID: \"2297684c-a98b-441c-8913-b5e9f39a2570\") " pod="openshift-marketplace/redhat-operators-wgn8s" Dec 04 12:08:41.488779 master-0 kubenswrapper[35367]: I1204 12:08:41.488702 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2297684c-a98b-441c-8913-b5e9f39a2570-catalog-content\") pod \"redhat-operators-wgn8s\" (UID: \"2297684c-a98b-441c-8913-b5e9f39a2570\") " pod="openshift-marketplace/redhat-operators-wgn8s" Dec 04 12:08:41.489787 master-0 kubenswrapper[35367]: I1204 12:08:41.489658 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2297684c-a98b-441c-8913-b5e9f39a2570-catalog-content\") pod \"redhat-operators-wgn8s\" (UID: \"2297684c-a98b-441c-8913-b5e9f39a2570\") " pod="openshift-marketplace/redhat-operators-wgn8s" Dec 04 12:08:41.489787 master-0 kubenswrapper[35367]: I1204 12:08:41.489709 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2297684c-a98b-441c-8913-b5e9f39a2570-utilities\") pod \"redhat-operators-wgn8s\" (UID: \"2297684c-a98b-441c-8913-b5e9f39a2570\") " pod="openshift-marketplace/redhat-operators-wgn8s" Dec 04 12:08:41.508287 master-0 kubenswrapper[35367]: I1204 12:08:41.508232 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v6c2\" (UniqueName: \"kubernetes.io/projected/2297684c-a98b-441c-8913-b5e9f39a2570-kube-api-access-4v6c2\") pod \"redhat-operators-wgn8s\" (UID: \"2297684c-a98b-441c-8913-b5e9f39a2570\") " pod="openshift-marketplace/redhat-operators-wgn8s" Dec 04 12:08:41.652932 master-0 kubenswrapper[35367]: I1204 12:08:41.649732 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-wgn8s" Dec 04 12:08:42.114392 master-0 kubenswrapper[35367]: I1204 12:08:42.114320 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-wgn8s"] Dec 04 12:08:42.116771 master-0 kubenswrapper[35367]: W1204 12:08:42.116706 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2297684c_a98b_441c_8913_b5e9f39a2570.slice/crio-0fd4c5bea87c5cd3111596b9acffa2dd041a256756ba3890029ef92e6bbed72b WatchSource:0}: Error finding container 0fd4c5bea87c5cd3111596b9acffa2dd041a256756ba3890029ef92e6bbed72b: Status 404 returned error can't find the container with id 0fd4c5bea87c5cd3111596b9acffa2dd041a256756ba3890029ef92e6bbed72b Dec 04 12:08:42.326892 master-0 kubenswrapper[35367]: I1204 12:08:42.326768 35367 generic.go:334] "Generic (PLEG): container finished" podID="5b2522d3-a2e9-435f-971f-9cc73721e99c" containerID="9c8e124675e9725ba55a905a966d8d3ef44987fb357aee12d91d2a425dc44d00" exitCode=0 Dec 04 12:08:42.327451 master-0 kubenswrapper[35367]: I1204 12:08:42.326839 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-mwsqm" event={"ID":"5b2522d3-a2e9-435f-971f-9cc73721e99c","Type":"ContainerDied","Data":"9c8e124675e9725ba55a905a966d8d3ef44987fb357aee12d91d2a425dc44d00"} Dec 04 12:08:42.332378 master-0 kubenswrapper[35367]: I1204 12:08:42.331741 35367 generic.go:334] "Generic (PLEG): container finished" podID="14fef399-4e8f-4867-ace9-3b273117f886" containerID="13599e6553dc2db648ff80f480ffab8f464630bd915ce19f875791f6c4bca59b" exitCode=0 Dec 04 12:08:42.332378 master-0 kubenswrapper[35367]: I1204 12:08:42.331927 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-gzs5w" event={"ID":"14fef399-4e8f-4867-ace9-3b273117f886","Type":"ContainerDied","Data":"13599e6553dc2db648ff80f480ffab8f464630bd915ce19f875791f6c4bca59b"} Dec 04 12:08:42.336742 master-0 kubenswrapper[35367]: I1204 12:08:42.336688 35367 generic.go:334] "Generic (PLEG): container finished" podID="f4283051-9a72-4bab-b4e9-0fcff55962f9" containerID="77e669638d1dc8570f6e947be6eec8a24399150cf79b518ab9818b5524a9d70a" exitCode=0 Dec 04 12:08:42.336862 master-0 kubenswrapper[35367]: I1204 12:08:42.336784 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v2gh5" event={"ID":"f4283051-9a72-4bab-b4e9-0fcff55962f9","Type":"ContainerDied","Data":"77e669638d1dc8570f6e947be6eec8a24399150cf79b518ab9818b5524a9d70a"} Dec 04 12:08:42.342752 master-0 kubenswrapper[35367]: I1204 12:08:42.340125 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wgn8s" event={"ID":"2297684c-a98b-441c-8913-b5e9f39a2570","Type":"ContainerStarted","Data":"0fd4c5bea87c5cd3111596b9acffa2dd041a256756ba3890029ef92e6bbed72b"} Dec 04 12:08:43.352652 master-0 kubenswrapper[35367]: I1204 12:08:43.352578 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v2gh5" event={"ID":"f4283051-9a72-4bab-b4e9-0fcff55962f9","Type":"ContainerStarted","Data":"e97f2b5bc3088bf8739c99d1cbca9dd4c05df8fab750e9737b9ab7e87eefb9a8"} Dec 04 12:08:43.355648 master-0 kubenswrapper[35367]: I1204 12:08:43.355587 35367 generic.go:334] "Generic (PLEG): container finished" podID="2297684c-a98b-441c-8913-b5e9f39a2570" containerID="677ec065b70f155df40d70bf079febe49a4f71d0c91ebe9e4cf791321e1267ab" exitCode=0 Dec 04 12:08:43.355995 master-0 kubenswrapper[35367]: I1204 12:08:43.355753 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wgn8s" event={"ID":"2297684c-a98b-441c-8913-b5e9f39a2570","Type":"ContainerDied","Data":"677ec065b70f155df40d70bf079febe49a4f71d0c91ebe9e4cf791321e1267ab"} Dec 04 12:08:43.359727 master-0 kubenswrapper[35367]: I1204 12:08:43.359511 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-mwsqm" event={"ID":"5b2522d3-a2e9-435f-971f-9cc73721e99c","Type":"ContainerStarted","Data":"ccbfa971ce10ce80ece76db21d329b5536317f531f46326eafb15e4b5067cc8e"} Dec 04 12:08:43.365606 master-0 kubenswrapper[35367]: I1204 12:08:43.365556 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-gzs5w" event={"ID":"14fef399-4e8f-4867-ace9-3b273117f886","Type":"ContainerStarted","Data":"80075ccf80a901ff3c2063889175ff290fa865853a873b055cff5eba73a5b2bf"} Dec 04 12:08:43.430751 master-0 kubenswrapper[35367]: I1204 12:08:43.426994 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-v2gh5" podStartSLOduration=2.927764495 podStartE2EDuration="5.426968545s" podCreationTimestamp="2025-12-04 12:08:38 +0000 UTC" firstStartedPulling="2025-12-04 12:08:40.248687092 +0000 UTC m=+563.686748360" lastFinishedPulling="2025-12-04 12:08:42.747891152 +0000 UTC m=+566.185952410" observedRunningTime="2025-12-04 12:08:43.388151863 +0000 UTC m=+566.826213121" watchObservedRunningTime="2025-12-04 12:08:43.426968545 +0000 UTC m=+566.865029803" Dec 04 12:08:43.430751 master-0 kubenswrapper[35367]: I1204 12:08:43.430005 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-gzs5w" podStartSLOduration=2.9644955079999997 podStartE2EDuration="5.429987239s" podCreationTimestamp="2025-12-04 12:08:38 +0000 UTC" firstStartedPulling="2025-12-04 12:08:40.253261195 +0000 UTC m=+563.691322453" lastFinishedPulling="2025-12-04 12:08:42.718752926 +0000 UTC m=+566.156814184" observedRunningTime="2025-12-04 12:08:43.420915524 +0000 UTC m=+566.858976802" watchObservedRunningTime="2025-12-04 12:08:43.429987239 +0000 UTC m=+566.868048497" Dec 04 12:08:43.801325 master-0 kubenswrapper[35367]: I1204 12:08:43.801157 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-console/console-64cdd44ddd-2t62p" podUID="29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8" containerName="console" containerID="cri-o://52a0c355bee98dc1c509350cb5cc16a9089b917d04373250deeb902fb9b69101" gracePeriod=15 Dec 04 12:08:44.306589 master-0 kubenswrapper[35367]: I1204 12:08:44.306522 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64cdd44ddd-2t62p_29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8/console/0.log" Dec 04 12:08:44.306903 master-0 kubenswrapper[35367]: I1204 12:08:44.306615 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:08:44.408998 master-0 kubenswrapper[35367]: I1204 12:08:44.406056 35367 generic.go:334] "Generic (PLEG): container finished" podID="5b2522d3-a2e9-435f-971f-9cc73721e99c" containerID="ccbfa971ce10ce80ece76db21d329b5536317f531f46326eafb15e4b5067cc8e" exitCode=0 Dec 04 12:08:44.408998 master-0 kubenswrapper[35367]: I1204 12:08:44.406161 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-mwsqm" event={"ID":"5b2522d3-a2e9-435f-971f-9cc73721e99c","Type":"ContainerDied","Data":"ccbfa971ce10ce80ece76db21d329b5536317f531f46326eafb15e4b5067cc8e"} Dec 04 12:08:44.411100 master-0 kubenswrapper[35367]: I1204 12:08:44.411027 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64cdd44ddd-2t62p_29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8/console/0.log" Dec 04 12:08:44.411313 master-0 kubenswrapper[35367]: I1204 12:08:44.411188 35367 generic.go:334] "Generic (PLEG): container finished" podID="29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8" containerID="52a0c355bee98dc1c509350cb5cc16a9089b917d04373250deeb902fb9b69101" exitCode=2 Dec 04 12:08:44.411313 master-0 kubenswrapper[35367]: I1204 12:08:44.411229 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64cdd44ddd-2t62p" Dec 04 12:08:44.411416 master-0 kubenswrapper[35367]: I1204 12:08:44.411258 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64cdd44ddd-2t62p" event={"ID":"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8","Type":"ContainerDied","Data":"52a0c355bee98dc1c509350cb5cc16a9089b917d04373250deeb902fb9b69101"} Dec 04 12:08:44.411416 master-0 kubenswrapper[35367]: I1204 12:08:44.411365 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64cdd44ddd-2t62p" event={"ID":"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8","Type":"ContainerDied","Data":"398df05d7ca6580f264cbc6b63ffb19d9e2b2347a38fe0e86f54edc2900c117f"} Dec 04 12:08:44.411416 master-0 kubenswrapper[35367]: I1204 12:08:44.411398 35367 scope.go:117] "RemoveContainer" containerID="52a0c355bee98dc1c509350cb5cc16a9089b917d04373250deeb902fb9b69101" Dec 04 12:08:44.415638 master-0 kubenswrapper[35367]: I1204 12:08:44.415577 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wgn8s" event={"ID":"2297684c-a98b-441c-8913-b5e9f39a2570","Type":"ContainerStarted","Data":"ca0e5bea4c5c1e2d0618e56119c2b86cdbe733b6f151b73b0105174f0737c5fb"} Dec 04 12:08:44.451904 master-0 kubenswrapper[35367]: I1204 12:08:44.446645 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-oauth-serving-cert\") pod \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " Dec 04 12:08:44.451904 master-0 kubenswrapper[35367]: I1204 12:08:44.446732 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7fzr\" (UniqueName: \"kubernetes.io/projected/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-kube-api-access-p7fzr\") pod \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " Dec 04 12:08:44.451904 master-0 kubenswrapper[35367]: I1204 12:08:44.446876 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-console-serving-cert\") pod \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " Dec 04 12:08:44.451904 master-0 kubenswrapper[35367]: I1204 12:08:44.446942 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-console-config\") pod \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " Dec 04 12:08:44.451904 master-0 kubenswrapper[35367]: I1204 12:08:44.446982 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-trusted-ca-bundle\") pod \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " Dec 04 12:08:44.451904 master-0 kubenswrapper[35367]: I1204 12:08:44.447035 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-service-ca\") pod \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " Dec 04 12:08:44.451904 master-0 kubenswrapper[35367]: I1204 12:08:44.447092 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-console-oauth-config\") pod \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\" (UID: \"29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8\") " Dec 04 12:08:44.451904 master-0 kubenswrapper[35367]: I1204 12:08:44.447217 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8" (UID: "29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:08:44.451904 master-0 kubenswrapper[35367]: I1204 12:08:44.447682 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-console-config" (OuterVolumeSpecName: "console-config") pod "29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8" (UID: "29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:08:44.451904 master-0 kubenswrapper[35367]: I1204 12:08:44.448033 35367 reconciler_common.go:293] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-oauth-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 12:08:44.451904 master-0 kubenswrapper[35367]: I1204 12:08:44.448057 35367 reconciler_common.go:293] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-console-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:08:44.451904 master-0 kubenswrapper[35367]: I1204 12:08:44.449369 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-service-ca" (OuterVolumeSpecName: "service-ca") pod "29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8" (UID: "29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:08:44.451904 master-0 kubenswrapper[35367]: I1204 12:08:44.449421 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8" (UID: "29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:08:44.451904 master-0 kubenswrapper[35367]: I1204 12:08:44.450671 35367 scope.go:117] "RemoveContainer" containerID="52a0c355bee98dc1c509350cb5cc16a9089b917d04373250deeb902fb9b69101" Dec 04 12:08:44.451904 master-0 kubenswrapper[35367]: E1204 12:08:44.451625 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52a0c355bee98dc1c509350cb5cc16a9089b917d04373250deeb902fb9b69101\": container with ID starting with 52a0c355bee98dc1c509350cb5cc16a9089b917d04373250deeb902fb9b69101 not found: ID does not exist" containerID="52a0c355bee98dc1c509350cb5cc16a9089b917d04373250deeb902fb9b69101" Dec 04 12:08:44.451904 master-0 kubenswrapper[35367]: I1204 12:08:44.451755 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a0c355bee98dc1c509350cb5cc16a9089b917d04373250deeb902fb9b69101"} err="failed to get container status \"52a0c355bee98dc1c509350cb5cc16a9089b917d04373250deeb902fb9b69101\": rpc error: code = NotFound desc = could not find container \"52a0c355bee98dc1c509350cb5cc16a9089b917d04373250deeb902fb9b69101\": container with ID starting with 52a0c355bee98dc1c509350cb5cc16a9089b917d04373250deeb902fb9b69101 not found: ID does not exist" Dec 04 12:08:44.452935 master-0 kubenswrapper[35367]: I1204 12:08:44.452384 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8" (UID: "29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:08:44.452935 master-0 kubenswrapper[35367]: I1204 12:08:44.452541 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8" (UID: "29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:08:44.455072 master-0 kubenswrapper[35367]: I1204 12:08:44.454988 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-kube-api-access-p7fzr" (OuterVolumeSpecName: "kube-api-access-p7fzr") pod "29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8" (UID: "29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8"). InnerVolumeSpecName "kube-api-access-p7fzr". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:08:44.550886 master-0 kubenswrapper[35367]: I1204 12:08:44.549745 35367 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:08:44.550886 master-0 kubenswrapper[35367]: I1204 12:08:44.549798 35367 reconciler_common.go:293] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-service-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 12:08:44.550886 master-0 kubenswrapper[35367]: I1204 12:08:44.549823 35367 reconciler_common.go:293] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-console-oauth-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:08:44.550886 master-0 kubenswrapper[35367]: I1204 12:08:44.549833 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-p7fzr\" (UniqueName: \"kubernetes.io/projected/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-kube-api-access-p7fzr\") on node \"master-0\" DevicePath \"\"" Dec 04 12:08:44.550886 master-0 kubenswrapper[35367]: I1204 12:08:44.549844 35367 reconciler_common.go:293] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8-console-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 12:08:44.846367 master-0 kubenswrapper[35367]: I1204 12:08:44.846301 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64cdd44ddd-2t62p"] Dec 04 12:08:44.852819 master-0 kubenswrapper[35367]: I1204 12:08:44.852745 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64cdd44ddd-2t62p"] Dec 04 12:08:45.304623 master-0 kubenswrapper[35367]: I1204 12:08:45.304480 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-brsq4"] Dec 04 12:08:45.304933 master-0 kubenswrapper[35367]: E1204 12:08:45.304906 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8" containerName="console" Dec 04 12:08:45.304933 master-0 kubenswrapper[35367]: I1204 12:08:45.304924 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8" containerName="console" Dec 04 12:08:45.305158 master-0 kubenswrapper[35367]: I1204 12:08:45.305130 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8" containerName="console" Dec 04 12:08:45.306305 master-0 kubenswrapper[35367]: I1204 12:08:45.306275 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-brsq4" Dec 04 12:08:45.326328 master-0 kubenswrapper[35367]: I1204 12:08:45.326248 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-brsq4"] Dec 04 12:08:45.439043 master-0 kubenswrapper[35367]: I1204 12:08:45.438951 35367 generic.go:334] "Generic (PLEG): container finished" podID="2297684c-a98b-441c-8913-b5e9f39a2570" containerID="ca0e5bea4c5c1e2d0618e56119c2b86cdbe733b6f151b73b0105174f0737c5fb" exitCode=0 Dec 04 12:08:45.439974 master-0 kubenswrapper[35367]: I1204 12:08:45.439120 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wgn8s" event={"ID":"2297684c-a98b-441c-8913-b5e9f39a2570","Type":"ContainerDied","Data":"ca0e5bea4c5c1e2d0618e56119c2b86cdbe733b6f151b73b0105174f0737c5fb"} Dec 04 12:08:45.445047 master-0 kubenswrapper[35367]: I1204 12:08:45.444998 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-mwsqm" event={"ID":"5b2522d3-a2e9-435f-971f-9cc73721e99c","Type":"ContainerStarted","Data":"d3382182c0711e7e570d1be95249b1c4086cf837be9ff59228a2076596b4b7d6"} Dec 04 12:08:45.464858 master-0 kubenswrapper[35367]: I1204 12:08:45.464242 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6e4bb27b-25c2-4ea3-b339-11b6d962fa1d-utilities\") pod \"redhat-operators-brsq4\" (UID: \"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d\") " pod="openshift-marketplace/redhat-operators-brsq4" Dec 04 12:08:45.464858 master-0 kubenswrapper[35367]: I1204 12:08:45.464342 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6e4bb27b-25c2-4ea3-b339-11b6d962fa1d-catalog-content\") pod \"redhat-operators-brsq4\" (UID: \"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d\") " pod="openshift-marketplace/redhat-operators-brsq4" Dec 04 12:08:45.464858 master-0 kubenswrapper[35367]: I1204 12:08:45.464391 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qmrg\" (UniqueName: \"kubernetes.io/projected/6e4bb27b-25c2-4ea3-b339-11b6d962fa1d-kube-api-access-5qmrg\") pod \"redhat-operators-brsq4\" (UID: \"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d\") " pod="openshift-marketplace/redhat-operators-brsq4" Dec 04 12:08:45.499203 master-0 kubenswrapper[35367]: I1204 12:08:45.499110 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-mwsqm" podStartSLOduration=4.037993308 podStartE2EDuration="6.49908677s" podCreationTimestamp="2025-12-04 12:08:39 +0000 UTC" firstStartedPulling="2025-12-04 12:08:42.329883362 +0000 UTC m=+565.767944630" lastFinishedPulling="2025-12-04 12:08:44.790976834 +0000 UTC m=+568.229038092" observedRunningTime="2025-12-04 12:08:45.491088408 +0000 UTC m=+568.929149676" watchObservedRunningTime="2025-12-04 12:08:45.49908677 +0000 UTC m=+568.937148028" Dec 04 12:08:45.515018 master-0 kubenswrapper[35367]: I1204 12:08:45.514931 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-pdr77"] Dec 04 12:08:45.519820 master-0 kubenswrapper[35367]: I1204 12:08:45.517227 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-pdr77" Dec 04 12:08:45.525244 master-0 kubenswrapper[35367]: I1204 12:08:45.523133 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-pdr77"] Dec 04 12:08:45.565982 master-0 kubenswrapper[35367]: I1204 12:08:45.565924 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5qmrg\" (UniqueName: \"kubernetes.io/projected/6e4bb27b-25c2-4ea3-b339-11b6d962fa1d-kube-api-access-5qmrg\") pod \"redhat-operators-brsq4\" (UID: \"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d\") " pod="openshift-marketplace/redhat-operators-brsq4" Dec 04 12:08:45.566315 master-0 kubenswrapper[35367]: I1204 12:08:45.566058 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6e4bb27b-25c2-4ea3-b339-11b6d962fa1d-utilities\") pod \"redhat-operators-brsq4\" (UID: \"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d\") " pod="openshift-marketplace/redhat-operators-brsq4" Dec 04 12:08:45.566652 master-0 kubenswrapper[35367]: I1204 12:08:45.566621 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6e4bb27b-25c2-4ea3-b339-11b6d962fa1d-catalog-content\") pod \"redhat-operators-brsq4\" (UID: \"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d\") " pod="openshift-marketplace/redhat-operators-brsq4" Dec 04 12:08:45.567279 master-0 kubenswrapper[35367]: I1204 12:08:45.567244 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6e4bb27b-25c2-4ea3-b339-11b6d962fa1d-catalog-content\") pod \"redhat-operators-brsq4\" (UID: \"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d\") " pod="openshift-marketplace/redhat-operators-brsq4" Dec 04 12:08:45.567964 master-0 kubenswrapper[35367]: I1204 12:08:45.567909 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6e4bb27b-25c2-4ea3-b339-11b6d962fa1d-utilities\") pod \"redhat-operators-brsq4\" (UID: \"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d\") " pod="openshift-marketplace/redhat-operators-brsq4" Dec 04 12:08:45.586709 master-0 kubenswrapper[35367]: I1204 12:08:45.586623 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qmrg\" (UniqueName: \"kubernetes.io/projected/6e4bb27b-25c2-4ea3-b339-11b6d962fa1d-kube-api-access-5qmrg\") pod \"redhat-operators-brsq4\" (UID: \"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d\") " pod="openshift-marketplace/redhat-operators-brsq4" Dec 04 12:08:45.630509 master-0 kubenswrapper[35367]: I1204 12:08:45.630423 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-brsq4" Dec 04 12:08:45.668146 master-0 kubenswrapper[35367]: I1204 12:08:45.668047 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/16b1a088-3ac8-45f8-9f7e-504caab0307b-catalog-content\") pod \"redhat-marketplace-pdr77\" (UID: \"16b1a088-3ac8-45f8-9f7e-504caab0307b\") " pod="openshift-marketplace/redhat-marketplace-pdr77" Dec 04 12:08:45.668469 master-0 kubenswrapper[35367]: I1204 12:08:45.668387 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/16b1a088-3ac8-45f8-9f7e-504caab0307b-utilities\") pod \"redhat-marketplace-pdr77\" (UID: \"16b1a088-3ac8-45f8-9f7e-504caab0307b\") " pod="openshift-marketplace/redhat-marketplace-pdr77" Dec 04 12:08:45.668694 master-0 kubenswrapper[35367]: I1204 12:08:45.668635 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhtm9\" (UniqueName: \"kubernetes.io/projected/16b1a088-3ac8-45f8-9f7e-504caab0307b-kube-api-access-nhtm9\") pod \"redhat-marketplace-pdr77\" (UID: \"16b1a088-3ac8-45f8-9f7e-504caab0307b\") " pod="openshift-marketplace/redhat-marketplace-pdr77" Dec 04 12:08:45.787615 master-0 kubenswrapper[35367]: I1204 12:08:45.770601 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/16b1a088-3ac8-45f8-9f7e-504caab0307b-catalog-content\") pod \"redhat-marketplace-pdr77\" (UID: \"16b1a088-3ac8-45f8-9f7e-504caab0307b\") " pod="openshift-marketplace/redhat-marketplace-pdr77" Dec 04 12:08:45.787615 master-0 kubenswrapper[35367]: I1204 12:08:45.770725 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/16b1a088-3ac8-45f8-9f7e-504caab0307b-utilities\") pod \"redhat-marketplace-pdr77\" (UID: \"16b1a088-3ac8-45f8-9f7e-504caab0307b\") " pod="openshift-marketplace/redhat-marketplace-pdr77" Dec 04 12:08:45.787615 master-0 kubenswrapper[35367]: I1204 12:08:45.770785 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nhtm9\" (UniqueName: \"kubernetes.io/projected/16b1a088-3ac8-45f8-9f7e-504caab0307b-kube-api-access-nhtm9\") pod \"redhat-marketplace-pdr77\" (UID: \"16b1a088-3ac8-45f8-9f7e-504caab0307b\") " pod="openshift-marketplace/redhat-marketplace-pdr77" Dec 04 12:08:45.787615 master-0 kubenswrapper[35367]: I1204 12:08:45.771571 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/16b1a088-3ac8-45f8-9f7e-504caab0307b-catalog-content\") pod \"redhat-marketplace-pdr77\" (UID: \"16b1a088-3ac8-45f8-9f7e-504caab0307b\") " pod="openshift-marketplace/redhat-marketplace-pdr77" Dec 04 12:08:45.787615 master-0 kubenswrapper[35367]: I1204 12:08:45.771593 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/16b1a088-3ac8-45f8-9f7e-504caab0307b-utilities\") pod \"redhat-marketplace-pdr77\" (UID: \"16b1a088-3ac8-45f8-9f7e-504caab0307b\") " pod="openshift-marketplace/redhat-marketplace-pdr77" Dec 04 12:08:45.798782 master-0 kubenswrapper[35367]: I1204 12:08:45.798729 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhtm9\" (UniqueName: \"kubernetes.io/projected/16b1a088-3ac8-45f8-9f7e-504caab0307b-kube-api-access-nhtm9\") pod \"redhat-marketplace-pdr77\" (UID: \"16b1a088-3ac8-45f8-9f7e-504caab0307b\") " pod="openshift-marketplace/redhat-marketplace-pdr77" Dec 04 12:08:45.846720 master-0 kubenswrapper[35367]: I1204 12:08:45.846521 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-pdr77" Dec 04 12:08:46.071903 master-0 kubenswrapper[35367]: I1204 12:08:46.071793 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-brsq4"] Dec 04 12:08:46.323114 master-0 kubenswrapper[35367]: I1204 12:08:46.320512 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-pdr77"] Dec 04 12:08:46.323886 master-0 kubenswrapper[35367]: W1204 12:08:46.323597 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b1a088_3ac8_45f8_9f7e_504caab0307b.slice/crio-f8c2319179d03d4c8d762938124afe3d50bff8e2f0dd16f408388bcdd84a22c7 WatchSource:0}: Error finding container f8c2319179d03d4c8d762938124afe3d50bff8e2f0dd16f408388bcdd84a22c7: Status 404 returned error can't find the container with id f8c2319179d03d4c8d762938124afe3d50bff8e2f0dd16f408388bcdd84a22c7 Dec 04 12:08:46.461090 master-0 kubenswrapper[35367]: I1204 12:08:46.461003 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wgn8s" event={"ID":"2297684c-a98b-441c-8913-b5e9f39a2570","Type":"ContainerStarted","Data":"67ca2c7d08b481fe515a75f9c4cd734d3a64a4b1aa833e7f445224197b4dbbad"} Dec 04 12:08:46.463198 master-0 kubenswrapper[35367]: I1204 12:08:46.462173 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-pdr77" event={"ID":"16b1a088-3ac8-45f8-9f7e-504caab0307b","Type":"ContainerStarted","Data":"f8c2319179d03d4c8d762938124afe3d50bff8e2f0dd16f408388bcdd84a22c7"} Dec 04 12:08:46.466829 master-0 kubenswrapper[35367]: I1204 12:08:46.463717 35367 generic.go:334] "Generic (PLEG): container finished" podID="6e4bb27b-25c2-4ea3-b339-11b6d962fa1d" containerID="c66ae82599df5c75ce044d2837c9d0f5a6658490fd9c9a7e6b198bc7c8f6d0f0" exitCode=0 Dec 04 12:08:46.466829 master-0 kubenswrapper[35367]: I1204 12:08:46.464934 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-brsq4" event={"ID":"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d","Type":"ContainerDied","Data":"c66ae82599df5c75ce044d2837c9d0f5a6658490fd9c9a7e6b198bc7c8f6d0f0"} Dec 04 12:08:46.466829 master-0 kubenswrapper[35367]: I1204 12:08:46.465022 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-brsq4" event={"ID":"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d","Type":"ContainerStarted","Data":"25a3c9325feb8655e359e5fe29f659a83af096ae46a4c8fbcded7ef199a358fc"} Dec 04 12:08:46.497471 master-0 kubenswrapper[35367]: I1204 12:08:46.494528 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-wgn8s" podStartSLOduration=2.910500935 podStartE2EDuration="5.494499324s" podCreationTimestamp="2025-12-04 12:08:41 +0000 UTC" firstStartedPulling="2025-12-04 12:08:43.359614606 +0000 UTC m=+566.797675864" lastFinishedPulling="2025-12-04 12:08:45.943612995 +0000 UTC m=+569.381674253" observedRunningTime="2025-12-04 12:08:46.48770504 +0000 UTC m=+569.925766318" watchObservedRunningTime="2025-12-04 12:08:46.494499324 +0000 UTC m=+569.932560582" Dec 04 12:08:46.758670 master-0 kubenswrapper[35367]: I1204 12:08:46.758455 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8" path="/var/lib/kubelet/pods/29f9d9e6-a26a-4c1d-811d-437ad2d1f3e8/volumes" Dec 04 12:08:47.474066 master-0 kubenswrapper[35367]: I1204 12:08:47.473995 35367 generic.go:334] "Generic (PLEG): container finished" podID="16b1a088-3ac8-45f8-9f7e-504caab0307b" containerID="db691e24cab0b180f95b00877c8396a8487a3847bb967cda25f87f2f9c0feda1" exitCode=0 Dec 04 12:08:47.474757 master-0 kubenswrapper[35367]: I1204 12:08:47.474067 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-pdr77" event={"ID":"16b1a088-3ac8-45f8-9f7e-504caab0307b","Type":"ContainerDied","Data":"db691e24cab0b180f95b00877c8396a8487a3847bb967cda25f87f2f9c0feda1"} Dec 04 12:08:47.918491 master-0 kubenswrapper[35367]: I1204 12:08:47.918405 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-b7n8z"] Dec 04 12:08:47.921098 master-0 kubenswrapper[35367]: I1204 12:08:47.921039 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-b7n8z" Dec 04 12:08:47.939238 master-0 kubenswrapper[35367]: I1204 12:08:47.939165 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-b7n8z"] Dec 04 12:08:47.943095 master-0 kubenswrapper[35367]: I1204 12:08:47.943038 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6b275f26-6d4a-40a3-8dee-c58ae09c0263-catalog-content\") pod \"redhat-operators-b7n8z\" (UID: \"6b275f26-6d4a-40a3-8dee-c58ae09c0263\") " pod="openshift-marketplace/redhat-operators-b7n8z" Dec 04 12:08:47.943271 master-0 kubenswrapper[35367]: I1204 12:08:47.943127 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6b275f26-6d4a-40a3-8dee-c58ae09c0263-utilities\") pod \"redhat-operators-b7n8z\" (UID: \"6b275f26-6d4a-40a3-8dee-c58ae09c0263\") " pod="openshift-marketplace/redhat-operators-b7n8z" Dec 04 12:08:47.943271 master-0 kubenswrapper[35367]: I1204 12:08:47.943194 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96cdn\" (UniqueName: \"kubernetes.io/projected/6b275f26-6d4a-40a3-8dee-c58ae09c0263-kube-api-access-96cdn\") pod \"redhat-operators-b7n8z\" (UID: \"6b275f26-6d4a-40a3-8dee-c58ae09c0263\") " pod="openshift-marketplace/redhat-operators-b7n8z" Dec 04 12:08:48.047263 master-0 kubenswrapper[35367]: I1204 12:08:48.047113 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6b275f26-6d4a-40a3-8dee-c58ae09c0263-catalog-content\") pod \"redhat-operators-b7n8z\" (UID: \"6b275f26-6d4a-40a3-8dee-c58ae09c0263\") " pod="openshift-marketplace/redhat-operators-b7n8z" Dec 04 12:08:48.047263 master-0 kubenswrapper[35367]: I1204 12:08:48.047223 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6b275f26-6d4a-40a3-8dee-c58ae09c0263-utilities\") pod \"redhat-operators-b7n8z\" (UID: \"6b275f26-6d4a-40a3-8dee-c58ae09c0263\") " pod="openshift-marketplace/redhat-operators-b7n8z" Dec 04 12:08:48.047545 master-0 kubenswrapper[35367]: I1204 12:08:48.047287 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-96cdn\" (UniqueName: \"kubernetes.io/projected/6b275f26-6d4a-40a3-8dee-c58ae09c0263-kube-api-access-96cdn\") pod \"redhat-operators-b7n8z\" (UID: \"6b275f26-6d4a-40a3-8dee-c58ae09c0263\") " pod="openshift-marketplace/redhat-operators-b7n8z" Dec 04 12:08:48.049075 master-0 kubenswrapper[35367]: I1204 12:08:48.048275 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6b275f26-6d4a-40a3-8dee-c58ae09c0263-catalog-content\") pod \"redhat-operators-b7n8z\" (UID: \"6b275f26-6d4a-40a3-8dee-c58ae09c0263\") " pod="openshift-marketplace/redhat-operators-b7n8z" Dec 04 12:08:48.049670 master-0 kubenswrapper[35367]: I1204 12:08:48.049626 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6b275f26-6d4a-40a3-8dee-c58ae09c0263-utilities\") pod \"redhat-operators-b7n8z\" (UID: \"6b275f26-6d4a-40a3-8dee-c58ae09c0263\") " pod="openshift-marketplace/redhat-operators-b7n8z" Dec 04 12:08:48.070988 master-0 kubenswrapper[35367]: I1204 12:08:48.070850 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-96cdn\" (UniqueName: \"kubernetes.io/projected/6b275f26-6d4a-40a3-8dee-c58ae09c0263-kube-api-access-96cdn\") pod \"redhat-operators-b7n8z\" (UID: \"6b275f26-6d4a-40a3-8dee-c58ae09c0263\") " pod="openshift-marketplace/redhat-operators-b7n8z" Dec 04 12:08:48.247376 master-0 kubenswrapper[35367]: I1204 12:08:48.247311 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-b7n8z" Dec 04 12:08:48.498176 master-0 kubenswrapper[35367]: I1204 12:08:48.498094 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-pdr77" event={"ID":"16b1a088-3ac8-45f8-9f7e-504caab0307b","Type":"ContainerStarted","Data":"ccef75c2edbcebdfe738c9fbfb89cdaaa96cfc75dcc67875b5e4179d13aeb477"} Dec 04 12:08:48.509176 master-0 kubenswrapper[35367]: I1204 12:08:48.509067 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-brsq4" event={"ID":"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d","Type":"ContainerStarted","Data":"399a60cb933df0ffd4914d14c11eb2d07eacf03ee64091ae18971b6d71cfee9b"} Dec 04 12:08:48.663101 master-0 kubenswrapper[35367]: I1204 12:08:48.662975 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-v2gh5" Dec 04 12:08:48.663101 master-0 kubenswrapper[35367]: I1204 12:08:48.663026 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-v2gh5" Dec 04 12:08:48.706340 master-0 kubenswrapper[35367]: I1204 12:08:48.706285 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-v2gh5" Dec 04 12:08:48.857255 master-0 kubenswrapper[35367]: I1204 12:08:48.850741 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-b7n8z"] Dec 04 12:08:49.062990 master-0 kubenswrapper[35367]: I1204 12:08:49.062914 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-gzs5w" Dec 04 12:08:49.062990 master-0 kubenswrapper[35367]: I1204 12:08:49.063007 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-gzs5w" Dec 04 12:08:49.114722 master-0 kubenswrapper[35367]: I1204 12:08:49.114680 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-gzs5w" Dec 04 12:08:49.519370 master-0 kubenswrapper[35367]: I1204 12:08:49.519156 35367 generic.go:334] "Generic (PLEG): container finished" podID="16b1a088-3ac8-45f8-9f7e-504caab0307b" containerID="ccef75c2edbcebdfe738c9fbfb89cdaaa96cfc75dcc67875b5e4179d13aeb477" exitCode=0 Dec 04 12:08:49.519370 master-0 kubenswrapper[35367]: I1204 12:08:49.519238 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-pdr77" event={"ID":"16b1a088-3ac8-45f8-9f7e-504caab0307b","Type":"ContainerDied","Data":"ccef75c2edbcebdfe738c9fbfb89cdaaa96cfc75dcc67875b5e4179d13aeb477"} Dec 04 12:08:49.522882 master-0 kubenswrapper[35367]: I1204 12:08:49.522830 35367 generic.go:334] "Generic (PLEG): container finished" podID="6b275f26-6d4a-40a3-8dee-c58ae09c0263" containerID="f3b0f3e1337d6375a84953a5f7055f8c2ca55a1c8f46b299bff3619f11fdfe3a" exitCode=0 Dec 04 12:08:49.523969 master-0 kubenswrapper[35367]: I1204 12:08:49.523101 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-b7n8z" event={"ID":"6b275f26-6d4a-40a3-8dee-c58ae09c0263","Type":"ContainerDied","Data":"f3b0f3e1337d6375a84953a5f7055f8c2ca55a1c8f46b299bff3619f11fdfe3a"} Dec 04 12:08:49.523969 master-0 kubenswrapper[35367]: I1204 12:08:49.523189 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-b7n8z" event={"ID":"6b275f26-6d4a-40a3-8dee-c58ae09c0263","Type":"ContainerStarted","Data":"75af2e9c043f5e8883884f2b10950069cac085e9c4ebd029a6b6ceffdabb1db1"} Dec 04 12:08:49.528824 master-0 kubenswrapper[35367]: I1204 12:08:49.527689 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-brsq4" event={"ID":"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d","Type":"ContainerDied","Data":"399a60cb933df0ffd4914d14c11eb2d07eacf03ee64091ae18971b6d71cfee9b"} Dec 04 12:08:49.528824 master-0 kubenswrapper[35367]: I1204 12:08:49.527908 35367 generic.go:334] "Generic (PLEG): container finished" podID="6e4bb27b-25c2-4ea3-b339-11b6d962fa1d" containerID="399a60cb933df0ffd4914d14c11eb2d07eacf03ee64091ae18971b6d71cfee9b" exitCode=0 Dec 04 12:08:49.571522 master-0 kubenswrapper[35367]: I1204 12:08:49.571443 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-gzs5w" Dec 04 12:08:49.571956 master-0 kubenswrapper[35367]: I1204 12:08:49.571928 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-v2gh5" Dec 04 12:08:50.225169 master-0 kubenswrapper[35367]: I1204 12:08:50.225022 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-mwsqm" Dec 04 12:08:50.229831 master-0 kubenswrapper[35367]: I1204 12:08:50.227735 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-mwsqm" Dec 04 12:08:50.309757 master-0 kubenswrapper[35367]: I1204 12:08:50.309683 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-xgzlt"] Dec 04 12:08:50.312192 master-0 kubenswrapper[35367]: I1204 12:08:50.312153 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-xgzlt" Dec 04 12:08:50.326507 master-0 kubenswrapper[35367]: I1204 12:08:50.326437 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-xgzlt"] Dec 04 12:08:50.496468 master-0 kubenswrapper[35367]: I1204 12:08:50.496418 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fcfbd087-b1aa-47da-a672-cde747408887-catalog-content\") pod \"redhat-operators-xgzlt\" (UID: \"fcfbd087-b1aa-47da-a672-cde747408887\") " pod="openshift-marketplace/redhat-operators-xgzlt" Dec 04 12:08:50.496782 master-0 kubenswrapper[35367]: I1204 12:08:50.496499 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fcfbd087-b1aa-47da-a672-cde747408887-utilities\") pod \"redhat-operators-xgzlt\" (UID: \"fcfbd087-b1aa-47da-a672-cde747408887\") " pod="openshift-marketplace/redhat-operators-xgzlt" Dec 04 12:08:50.496782 master-0 kubenswrapper[35367]: I1204 12:08:50.496527 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mrw9\" (UniqueName: \"kubernetes.io/projected/fcfbd087-b1aa-47da-a672-cde747408887-kube-api-access-7mrw9\") pod \"redhat-operators-xgzlt\" (UID: \"fcfbd087-b1aa-47da-a672-cde747408887\") " pod="openshift-marketplace/redhat-operators-xgzlt" Dec 04 12:08:50.541190 master-0 kubenswrapper[35367]: I1204 12:08:50.541137 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-b7n8z" event={"ID":"6b275f26-6d4a-40a3-8dee-c58ae09c0263","Type":"ContainerStarted","Data":"7c64074f8b89aa532f2845a13e9a98b1e20319c1ab7fae7d16023a7bcf722c5e"} Dec 04 12:08:50.549350 master-0 kubenswrapper[35367]: I1204 12:08:50.549305 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-brsq4" event={"ID":"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d","Type":"ContainerStarted","Data":"91433051c4ed3dd110a118ddc2c2f17cc00879edcdb4b6552ea2da8d0bed8061"} Dec 04 12:08:50.553629 master-0 kubenswrapper[35367]: I1204 12:08:50.553536 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-pdr77" event={"ID":"16b1a088-3ac8-45f8-9f7e-504caab0307b","Type":"ContainerStarted","Data":"4c4c50f6ed837b50065ec95193774f36a2b50695d48f4bc50c159cabef802a01"} Dec 04 12:08:50.596905 master-0 kubenswrapper[35367]: I1204 12:08:50.596744 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-pdr77" podStartSLOduration=2.832860537 podStartE2EDuration="5.596688613s" podCreationTimestamp="2025-12-04 12:08:45 +0000 UTC" firstStartedPulling="2025-12-04 12:08:47.476406023 +0000 UTC m=+570.914467281" lastFinishedPulling="2025-12-04 12:08:50.240234099 +0000 UTC m=+573.678295357" observedRunningTime="2025-12-04 12:08:50.593700769 +0000 UTC m=+574.031762037" watchObservedRunningTime="2025-12-04 12:08:50.596688613 +0000 UTC m=+574.034749871" Dec 04 12:08:50.602830 master-0 kubenswrapper[35367]: I1204 12:08:50.598825 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fcfbd087-b1aa-47da-a672-cde747408887-utilities\") pod \"redhat-operators-xgzlt\" (UID: \"fcfbd087-b1aa-47da-a672-cde747408887\") " pod="openshift-marketplace/redhat-operators-xgzlt" Dec 04 12:08:50.602830 master-0 kubenswrapper[35367]: I1204 12:08:50.598931 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7mrw9\" (UniqueName: \"kubernetes.io/projected/fcfbd087-b1aa-47da-a672-cde747408887-kube-api-access-7mrw9\") pod \"redhat-operators-xgzlt\" (UID: \"fcfbd087-b1aa-47da-a672-cde747408887\") " pod="openshift-marketplace/redhat-operators-xgzlt" Dec 04 12:08:50.602830 master-0 kubenswrapper[35367]: I1204 12:08:50.599201 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fcfbd087-b1aa-47da-a672-cde747408887-catalog-content\") pod \"redhat-operators-xgzlt\" (UID: \"fcfbd087-b1aa-47da-a672-cde747408887\") " pod="openshift-marketplace/redhat-operators-xgzlt" Dec 04 12:08:50.602830 master-0 kubenswrapper[35367]: I1204 12:08:50.599953 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fcfbd087-b1aa-47da-a672-cde747408887-catalog-content\") pod \"redhat-operators-xgzlt\" (UID: \"fcfbd087-b1aa-47da-a672-cde747408887\") " pod="openshift-marketplace/redhat-operators-xgzlt" Dec 04 12:08:50.602830 master-0 kubenswrapper[35367]: I1204 12:08:50.600197 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fcfbd087-b1aa-47da-a672-cde747408887-utilities\") pod \"redhat-operators-xgzlt\" (UID: \"fcfbd087-b1aa-47da-a672-cde747408887\") " pod="openshift-marketplace/redhat-operators-xgzlt" Dec 04 12:08:50.629952 master-0 kubenswrapper[35367]: I1204 12:08:50.628329 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mrw9\" (UniqueName: \"kubernetes.io/projected/fcfbd087-b1aa-47da-a672-cde747408887-kube-api-access-7mrw9\") pod \"redhat-operators-xgzlt\" (UID: \"fcfbd087-b1aa-47da-a672-cde747408887\") " pod="openshift-marketplace/redhat-operators-xgzlt" Dec 04 12:08:50.629952 master-0 kubenswrapper[35367]: I1204 12:08:50.628550 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-brsq4" podStartSLOduration=2.120315281 podStartE2EDuration="5.628508913s" podCreationTimestamp="2025-12-04 12:08:45 +0000 UTC" firstStartedPulling="2025-12-04 12:08:46.466273696 +0000 UTC m=+569.904334954" lastFinishedPulling="2025-12-04 12:08:49.974467328 +0000 UTC m=+573.412528586" observedRunningTime="2025-12-04 12:08:50.628262775 +0000 UTC m=+574.066324053" watchObservedRunningTime="2025-12-04 12:08:50.628508913 +0000 UTC m=+574.066570171" Dec 04 12:08:50.689990 master-0 kubenswrapper[35367]: I1204 12:08:50.689911 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-xgzlt" Dec 04 12:08:51.194391 master-0 kubenswrapper[35367]: I1204 12:08:51.193550 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-xgzlt"] Dec 04 12:08:51.287763 master-0 kubenswrapper[35367]: I1204 12:08:51.287707 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-mwsqm" podUID="5b2522d3-a2e9-435f-971f-9cc73721e99c" containerName="registry-server" probeResult="failure" output=< Dec 04 12:08:51.287763 master-0 kubenswrapper[35367]: timeout: failed to connect service ":50051" within 1s Dec 04 12:08:51.287763 master-0 kubenswrapper[35367]: > Dec 04 12:08:51.561395 master-0 kubenswrapper[35367]: I1204 12:08:51.561346 35367 generic.go:334] "Generic (PLEG): container finished" podID="fcfbd087-b1aa-47da-a672-cde747408887" containerID="7300347a11fb72bc40cb0d2baae59b412be23527e9e85a5b56a0470005ff4b06" exitCode=0 Dec 04 12:08:51.561952 master-0 kubenswrapper[35367]: I1204 12:08:51.561423 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-xgzlt" event={"ID":"fcfbd087-b1aa-47da-a672-cde747408887","Type":"ContainerDied","Data":"7300347a11fb72bc40cb0d2baae59b412be23527e9e85a5b56a0470005ff4b06"} Dec 04 12:08:51.561952 master-0 kubenswrapper[35367]: I1204 12:08:51.561453 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-xgzlt" event={"ID":"fcfbd087-b1aa-47da-a672-cde747408887","Type":"ContainerStarted","Data":"85470070d3e44d1cb189b34c424383587f5a487fb0659121479c77a37a24644f"} Dec 04 12:08:51.564846 master-0 kubenswrapper[35367]: I1204 12:08:51.564798 35367 generic.go:334] "Generic (PLEG): container finished" podID="6b275f26-6d4a-40a3-8dee-c58ae09c0263" containerID="7c64074f8b89aa532f2845a13e9a98b1e20319c1ab7fae7d16023a7bcf722c5e" exitCode=0 Dec 04 12:08:51.564970 master-0 kubenswrapper[35367]: I1204 12:08:51.564866 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-b7n8z" event={"ID":"6b275f26-6d4a-40a3-8dee-c58ae09c0263","Type":"ContainerDied","Data":"7c64074f8b89aa532f2845a13e9a98b1e20319c1ab7fae7d16023a7bcf722c5e"} Dec 04 12:08:51.650075 master-0 kubenswrapper[35367]: I1204 12:08:51.649993 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-wgn8s" Dec 04 12:08:51.650075 master-0 kubenswrapper[35367]: I1204 12:08:51.650072 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-wgn8s" Dec 04 12:08:52.577398 master-0 kubenswrapper[35367]: I1204 12:08:52.577322 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-xgzlt" event={"ID":"fcfbd087-b1aa-47da-a672-cde747408887","Type":"ContainerStarted","Data":"7fe2feb7cc0c1d0b73d7b7f52fee11c8c0302465a1f90aa532654e02284a5736"} Dec 04 12:08:52.581984 master-0 kubenswrapper[35367]: I1204 12:08:52.581919 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-b7n8z" event={"ID":"6b275f26-6d4a-40a3-8dee-c58ae09c0263","Type":"ContainerStarted","Data":"5a264c088920fd153fd77df50068fc4860d60ab25b9c5b9d2310b10e10ea96b2"} Dec 04 12:08:52.700209 master-0 kubenswrapper[35367]: I1204 12:08:52.700117 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-wgn8s" podUID="2297684c-a98b-441c-8913-b5e9f39a2570" containerName="registry-server" probeResult="failure" output=< Dec 04 12:08:52.700209 master-0 kubenswrapper[35367]: timeout: failed to connect service ":50051" within 1s Dec 04 12:08:52.700209 master-0 kubenswrapper[35367]: > Dec 04 12:08:53.593447 master-0 kubenswrapper[35367]: I1204 12:08:53.593377 35367 generic.go:334] "Generic (PLEG): container finished" podID="fcfbd087-b1aa-47da-a672-cde747408887" containerID="7fe2feb7cc0c1d0b73d7b7f52fee11c8c0302465a1f90aa532654e02284a5736" exitCode=0 Dec 04 12:08:53.593970 master-0 kubenswrapper[35367]: I1204 12:08:53.593642 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-xgzlt" event={"ID":"fcfbd087-b1aa-47da-a672-cde747408887","Type":"ContainerDied","Data":"7fe2feb7cc0c1d0b73d7b7f52fee11c8c0302465a1f90aa532654e02284a5736"} Dec 04 12:08:55.072907 master-0 kubenswrapper[35367]: I1204 12:08:55.072821 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-jjfcc"] Dec 04 12:08:55.076311 master-0 kubenswrapper[35367]: I1204 12:08:55.076273 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-jjfcc" Dec 04 12:08:55.100267 master-0 kubenswrapper[35367]: I1204 12:08:55.100224 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/414ce51b-cd2f-4311-96e0-bd80fb0ae666-utilities\") pod \"redhat-operators-jjfcc\" (UID: \"414ce51b-cd2f-4311-96e0-bd80fb0ae666\") " pod="openshift-marketplace/redhat-operators-jjfcc" Dec 04 12:08:55.100410 master-0 kubenswrapper[35367]: I1204 12:08:55.100293 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/414ce51b-cd2f-4311-96e0-bd80fb0ae666-catalog-content\") pod \"redhat-operators-jjfcc\" (UID: \"414ce51b-cd2f-4311-96e0-bd80fb0ae666\") " pod="openshift-marketplace/redhat-operators-jjfcc" Dec 04 12:08:55.100410 master-0 kubenswrapper[35367]: I1204 12:08:55.100319 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmlrd\" (UniqueName: \"kubernetes.io/projected/414ce51b-cd2f-4311-96e0-bd80fb0ae666-kube-api-access-bmlrd\") pod \"redhat-operators-jjfcc\" (UID: \"414ce51b-cd2f-4311-96e0-bd80fb0ae666\") " pod="openshift-marketplace/redhat-operators-jjfcc" Dec 04 12:08:55.203036 master-0 kubenswrapper[35367]: I1204 12:08:55.202767 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/414ce51b-cd2f-4311-96e0-bd80fb0ae666-utilities\") pod \"redhat-operators-jjfcc\" (UID: \"414ce51b-cd2f-4311-96e0-bd80fb0ae666\") " pod="openshift-marketplace/redhat-operators-jjfcc" Dec 04 12:08:55.203036 master-0 kubenswrapper[35367]: I1204 12:08:55.202889 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/414ce51b-cd2f-4311-96e0-bd80fb0ae666-catalog-content\") pod \"redhat-operators-jjfcc\" (UID: \"414ce51b-cd2f-4311-96e0-bd80fb0ae666\") " pod="openshift-marketplace/redhat-operators-jjfcc" Dec 04 12:08:55.203036 master-0 kubenswrapper[35367]: I1204 12:08:55.202922 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bmlrd\" (UniqueName: \"kubernetes.io/projected/414ce51b-cd2f-4311-96e0-bd80fb0ae666-kube-api-access-bmlrd\") pod \"redhat-operators-jjfcc\" (UID: \"414ce51b-cd2f-4311-96e0-bd80fb0ae666\") " pod="openshift-marketplace/redhat-operators-jjfcc" Dec 04 12:08:55.204088 master-0 kubenswrapper[35367]: I1204 12:08:55.204058 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/414ce51b-cd2f-4311-96e0-bd80fb0ae666-utilities\") pod \"redhat-operators-jjfcc\" (UID: \"414ce51b-cd2f-4311-96e0-bd80fb0ae666\") " pod="openshift-marketplace/redhat-operators-jjfcc" Dec 04 12:08:55.204634 master-0 kubenswrapper[35367]: I1204 12:08:55.204596 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/414ce51b-cd2f-4311-96e0-bd80fb0ae666-catalog-content\") pod \"redhat-operators-jjfcc\" (UID: \"414ce51b-cd2f-4311-96e0-bd80fb0ae666\") " pod="openshift-marketplace/redhat-operators-jjfcc" Dec 04 12:08:55.610908 master-0 kubenswrapper[35367]: I1204 12:08:55.610766 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-jjfcc"] Dec 04 12:08:55.631246 master-0 kubenswrapper[35367]: I1204 12:08:55.631172 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-brsq4" Dec 04 12:08:55.632502 master-0 kubenswrapper[35367]: I1204 12:08:55.631746 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-brsq4" Dec 04 12:08:55.677437 master-0 kubenswrapper[35367]: I1204 12:08:55.677371 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-brsq4" Dec 04 12:08:55.847521 master-0 kubenswrapper[35367]: I1204 12:08:55.847435 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-pdr77" Dec 04 12:08:55.847521 master-0 kubenswrapper[35367]: I1204 12:08:55.847510 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-pdr77" Dec 04 12:08:55.892274 master-0 kubenswrapper[35367]: I1204 12:08:55.892131 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-pdr77" Dec 04 12:08:56.676266 master-0 kubenswrapper[35367]: I1204 12:08:56.676207 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-pdr77" Dec 04 12:08:56.686722 master-0 kubenswrapper[35367]: I1204 12:08:56.686631 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-brsq4" Dec 04 12:08:56.800815 master-0 kubenswrapper[35367]: I1204 12:08:56.800708 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmlrd\" (UniqueName: \"kubernetes.io/projected/414ce51b-cd2f-4311-96e0-bd80fb0ae666-kube-api-access-bmlrd\") pod \"redhat-operators-jjfcc\" (UID: \"414ce51b-cd2f-4311-96e0-bd80fb0ae666\") " pod="openshift-marketplace/redhat-operators-jjfcc" Dec 04 12:08:56.902289 master-0 kubenswrapper[35367]: I1204 12:08:56.902180 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-jjfcc" Dec 04 12:08:58.247881 master-0 kubenswrapper[35367]: I1204 12:08:58.247704 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-b7n8z" Dec 04 12:08:58.247881 master-0 kubenswrapper[35367]: I1204 12:08:58.247767 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-b7n8z" Dec 04 12:08:58.294452 master-0 kubenswrapper[35367]: I1204 12:08:58.294400 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-b7n8z" Dec 04 12:08:58.689903 master-0 kubenswrapper[35367]: I1204 12:08:58.689843 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-b7n8z" Dec 04 12:08:59.808919 master-0 kubenswrapper[35367]: I1204 12:08:59.808800 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-b7n8z" podStartSLOduration=10.41104492 podStartE2EDuration="12.808773529s" podCreationTimestamp="2025-12-04 12:08:47 +0000 UTC" firstStartedPulling="2025-12-04 12:08:49.530320536 +0000 UTC m=+572.968381794" lastFinishedPulling="2025-12-04 12:08:51.928049145 +0000 UTC m=+575.366110403" observedRunningTime="2025-12-04 12:08:59.805143485 +0000 UTC m=+583.243204743" watchObservedRunningTime="2025-12-04 12:08:59.808773529 +0000 UTC m=+583.246834787" Dec 04 12:09:00.321281 master-0 kubenswrapper[35367]: I1204 12:09:00.321209 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-mwsqm" Dec 04 12:09:00.385610 master-0 kubenswrapper[35367]: I1204 12:09:00.385532 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-mwsqm" Dec 04 12:09:01.731419 master-0 kubenswrapper[35367]: I1204 12:09:01.730605 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-wgn8s" Dec 04 12:09:01.752760 master-0 kubenswrapper[35367]: I1204 12:09:01.750464 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-jjfcc"] Dec 04 12:09:01.805707 master-0 kubenswrapper[35367]: I1204 12:09:01.805627 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-p5ndf"] Dec 04 12:09:01.816637 master-0 kubenswrapper[35367]: I1204 12:09:01.807875 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-p5ndf" Dec 04 12:09:01.842092 master-0 kubenswrapper[35367]: I1204 12:09:01.842021 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0ed2adcc-5493-4adc-ad40-40df2b8dbd2d-utilities\") pod \"redhat-operators-p5ndf\" (UID: \"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d\") " pod="openshift-marketplace/redhat-operators-p5ndf" Dec 04 12:09:01.842377 master-0 kubenswrapper[35367]: I1204 12:09:01.842188 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6kp9\" (UniqueName: \"kubernetes.io/projected/0ed2adcc-5493-4adc-ad40-40df2b8dbd2d-kube-api-access-k6kp9\") pod \"redhat-operators-p5ndf\" (UID: \"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d\") " pod="openshift-marketplace/redhat-operators-p5ndf" Dec 04 12:09:01.842377 master-0 kubenswrapper[35367]: I1204 12:09:01.842246 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0ed2adcc-5493-4adc-ad40-40df2b8dbd2d-catalog-content\") pod \"redhat-operators-p5ndf\" (UID: \"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d\") " pod="openshift-marketplace/redhat-operators-p5ndf" Dec 04 12:09:01.848704 master-0 kubenswrapper[35367]: I1204 12:09:01.848643 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-wgn8s" Dec 04 12:09:01.860496 master-0 kubenswrapper[35367]: I1204 12:09:01.859919 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-p5ndf"] Dec 04 12:09:01.908981 master-0 kubenswrapper[35367]: I1204 12:09:01.908841 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-xgzlt" podStartSLOduration=3.299985474 podStartE2EDuration="11.908797223s" podCreationTimestamp="2025-12-04 12:08:50 +0000 UTC" firstStartedPulling="2025-12-04 12:08:51.562936288 +0000 UTC m=+575.000997546" lastFinishedPulling="2025-12-04 12:09:00.171748037 +0000 UTC m=+583.609809295" observedRunningTime="2025-12-04 12:09:01.90173394 +0000 UTC m=+585.339795208" watchObservedRunningTime="2025-12-04 12:09:01.908797223 +0000 UTC m=+585.346858481" Dec 04 12:09:01.943675 master-0 kubenswrapper[35367]: I1204 12:09:01.943572 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k6kp9\" (UniqueName: \"kubernetes.io/projected/0ed2adcc-5493-4adc-ad40-40df2b8dbd2d-kube-api-access-k6kp9\") pod \"redhat-operators-p5ndf\" (UID: \"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d\") " pod="openshift-marketplace/redhat-operators-p5ndf" Dec 04 12:09:01.944230 master-0 kubenswrapper[35367]: I1204 12:09:01.943987 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0ed2adcc-5493-4adc-ad40-40df2b8dbd2d-catalog-content\") pod \"redhat-operators-p5ndf\" (UID: \"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d\") " pod="openshift-marketplace/redhat-operators-p5ndf" Dec 04 12:09:01.944230 master-0 kubenswrapper[35367]: I1204 12:09:01.944206 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0ed2adcc-5493-4adc-ad40-40df2b8dbd2d-utilities\") pod \"redhat-operators-p5ndf\" (UID: \"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d\") " pod="openshift-marketplace/redhat-operators-p5ndf" Dec 04 12:09:01.944955 master-0 kubenswrapper[35367]: I1204 12:09:01.944885 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0ed2adcc-5493-4adc-ad40-40df2b8dbd2d-catalog-content\") pod \"redhat-operators-p5ndf\" (UID: \"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d\") " pod="openshift-marketplace/redhat-operators-p5ndf" Dec 04 12:09:01.945036 master-0 kubenswrapper[35367]: I1204 12:09:01.944901 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0ed2adcc-5493-4adc-ad40-40df2b8dbd2d-utilities\") pod \"redhat-operators-p5ndf\" (UID: \"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d\") " pod="openshift-marketplace/redhat-operators-p5ndf" Dec 04 12:09:01.963314 master-0 kubenswrapper[35367]: I1204 12:09:01.963246 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6kp9\" (UniqueName: \"kubernetes.io/projected/0ed2adcc-5493-4adc-ad40-40df2b8dbd2d-kube-api-access-k6kp9\") pod \"redhat-operators-p5ndf\" (UID: \"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d\") " pod="openshift-marketplace/redhat-operators-p5ndf" Dec 04 12:09:02.213126 master-0 kubenswrapper[35367]: I1204 12:09:02.212999 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-p5ndf" Dec 04 12:09:02.645680 master-0 kubenswrapper[35367]: I1204 12:09:02.645597 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-p5ndf"] Dec 04 12:09:02.648762 master-0 kubenswrapper[35367]: W1204 12:09:02.648680 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ed2adcc_5493_4adc_ad40_40df2b8dbd2d.slice/crio-5f9fe19663db24efaf394121fb6f74da64ea57aae9fd157ee6c61bb16926bd94 WatchSource:0}: Error finding container 5f9fe19663db24efaf394121fb6f74da64ea57aae9fd157ee6c61bb16926bd94: Status 404 returned error can't find the container with id 5f9fe19663db24efaf394121fb6f74da64ea57aae9fd157ee6c61bb16926bd94 Dec 04 12:09:02.735434 master-0 kubenswrapper[35367]: I1204 12:09:02.735350 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-xgzlt" event={"ID":"fcfbd087-b1aa-47da-a672-cde747408887","Type":"ContainerStarted","Data":"c79851b6fc1af1cb4ffbee3d114e1cad62d62259087025b52fe1bb890fc3c313"} Dec 04 12:09:02.738278 master-0 kubenswrapper[35367]: I1204 12:09:02.738228 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-p5ndf" event={"ID":"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d","Type":"ContainerStarted","Data":"5f9fe19663db24efaf394121fb6f74da64ea57aae9fd157ee6c61bb16926bd94"} Dec 04 12:09:02.741179 master-0 kubenswrapper[35367]: I1204 12:09:02.741131 35367 generic.go:334] "Generic (PLEG): container finished" podID="414ce51b-cd2f-4311-96e0-bd80fb0ae666" containerID="24bcbe84a8dbab71fc5acc96a804e466369c5c0857fffddb8b916256d7b06f90" exitCode=0 Dec 04 12:09:02.741290 master-0 kubenswrapper[35367]: I1204 12:09:02.741184 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-jjfcc" event={"ID":"414ce51b-cd2f-4311-96e0-bd80fb0ae666","Type":"ContainerDied","Data":"24bcbe84a8dbab71fc5acc96a804e466369c5c0857fffddb8b916256d7b06f90"} Dec 04 12:09:02.741290 master-0 kubenswrapper[35367]: I1204 12:09:02.741253 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-jjfcc" event={"ID":"414ce51b-cd2f-4311-96e0-bd80fb0ae666","Type":"ContainerStarted","Data":"2898ff3dded84ce8ed2f755bef052ff36104189fdc90e461069f243458d4bdb4"} Dec 04 12:09:02.935590 master-0 kubenswrapper[35367]: I1204 12:09:02.935146 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-fhdw5"] Dec 04 12:09:02.938594 master-0 kubenswrapper[35367]: I1204 12:09:02.937641 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-fhdw5" Dec 04 12:09:02.957691 master-0 kubenswrapper[35367]: I1204 12:09:02.957611 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-fhdw5"] Dec 04 12:09:02.965856 master-0 kubenswrapper[35367]: I1204 12:09:02.965774 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/11c18264-a296-44af-b112-21ad216ce917-utilities\") pod \"redhat-marketplace-fhdw5\" (UID: \"11c18264-a296-44af-b112-21ad216ce917\") " pod="openshift-marketplace/redhat-marketplace-fhdw5" Dec 04 12:09:02.965856 master-0 kubenswrapper[35367]: I1204 12:09:02.965878 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/11c18264-a296-44af-b112-21ad216ce917-catalog-content\") pod \"redhat-marketplace-fhdw5\" (UID: \"11c18264-a296-44af-b112-21ad216ce917\") " pod="openshift-marketplace/redhat-marketplace-fhdw5" Dec 04 12:09:02.965856 master-0 kubenswrapper[35367]: I1204 12:09:02.965905 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ctmm\" (UniqueName: \"kubernetes.io/projected/11c18264-a296-44af-b112-21ad216ce917-kube-api-access-9ctmm\") pod \"redhat-marketplace-fhdw5\" (UID: \"11c18264-a296-44af-b112-21ad216ce917\") " pod="openshift-marketplace/redhat-marketplace-fhdw5" Dec 04 12:09:03.068329 master-0 kubenswrapper[35367]: I1204 12:09:03.068219 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/11c18264-a296-44af-b112-21ad216ce917-catalog-content\") pod \"redhat-marketplace-fhdw5\" (UID: \"11c18264-a296-44af-b112-21ad216ce917\") " pod="openshift-marketplace/redhat-marketplace-fhdw5" Dec 04 12:09:03.068329 master-0 kubenswrapper[35367]: I1204 12:09:03.068327 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9ctmm\" (UniqueName: \"kubernetes.io/projected/11c18264-a296-44af-b112-21ad216ce917-kube-api-access-9ctmm\") pod \"redhat-marketplace-fhdw5\" (UID: \"11c18264-a296-44af-b112-21ad216ce917\") " pod="openshift-marketplace/redhat-marketplace-fhdw5" Dec 04 12:09:03.068654 master-0 kubenswrapper[35367]: I1204 12:09:03.068464 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/11c18264-a296-44af-b112-21ad216ce917-utilities\") pod \"redhat-marketplace-fhdw5\" (UID: \"11c18264-a296-44af-b112-21ad216ce917\") " pod="openshift-marketplace/redhat-marketplace-fhdw5" Dec 04 12:09:03.069418 master-0 kubenswrapper[35367]: I1204 12:09:03.069083 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/11c18264-a296-44af-b112-21ad216ce917-utilities\") pod \"redhat-marketplace-fhdw5\" (UID: \"11c18264-a296-44af-b112-21ad216ce917\") " pod="openshift-marketplace/redhat-marketplace-fhdw5" Dec 04 12:09:03.069418 master-0 kubenswrapper[35367]: I1204 12:09:03.069347 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/11c18264-a296-44af-b112-21ad216ce917-catalog-content\") pod \"redhat-marketplace-fhdw5\" (UID: \"11c18264-a296-44af-b112-21ad216ce917\") " pod="openshift-marketplace/redhat-marketplace-fhdw5" Dec 04 12:09:03.086301 master-0 kubenswrapper[35367]: I1204 12:09:03.086244 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ctmm\" (UniqueName: \"kubernetes.io/projected/11c18264-a296-44af-b112-21ad216ce917-kube-api-access-9ctmm\") pod \"redhat-marketplace-fhdw5\" (UID: \"11c18264-a296-44af-b112-21ad216ce917\") " pod="openshift-marketplace/redhat-marketplace-fhdw5" Dec 04 12:09:03.274479 master-0 kubenswrapper[35367]: I1204 12:09:03.274010 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-fhdw5" Dec 04 12:09:03.741312 master-0 kubenswrapper[35367]: I1204 12:09:03.741260 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-fhdw5"] Dec 04 12:09:03.755724 master-0 kubenswrapper[35367]: I1204 12:09:03.755608 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-fhdw5" event={"ID":"11c18264-a296-44af-b112-21ad216ce917","Type":"ContainerStarted","Data":"407b41454956b16f90539f4df607f5762959b8217c8fe3b939ff9381c4e5bfed"} Dec 04 12:09:03.759876 master-0 kubenswrapper[35367]: I1204 12:09:03.759802 35367 generic.go:334] "Generic (PLEG): container finished" podID="0ed2adcc-5493-4adc-ad40-40df2b8dbd2d" containerID="4afbc21c1bb0947d5a69cbfecc43205e3da562612e3c78e436992e89bb32a608" exitCode=0 Dec 04 12:09:03.760002 master-0 kubenswrapper[35367]: I1204 12:09:03.759887 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-p5ndf" event={"ID":"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d","Type":"ContainerDied","Data":"4afbc21c1bb0947d5a69cbfecc43205e3da562612e3c78e436992e89bb32a608"} Dec 04 12:09:04.769284 master-0 kubenswrapper[35367]: I1204 12:09:04.769201 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-jjfcc" event={"ID":"414ce51b-cd2f-4311-96e0-bd80fb0ae666","Type":"ContainerStarted","Data":"164f9ed9ed9983efbca38d2d3b5ccbc5acdd215f664829c3365cb1e7705ef432"} Dec 04 12:09:04.771203 master-0 kubenswrapper[35367]: I1204 12:09:04.771161 35367 generic.go:334] "Generic (PLEG): container finished" podID="11c18264-a296-44af-b112-21ad216ce917" containerID="41c1158bb7fa0503998ebe02d8ac275ef6e6ed3beb50d2a6f95b7423f136e0d5" exitCode=0 Dec 04 12:09:04.771203 master-0 kubenswrapper[35367]: I1204 12:09:04.771210 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-fhdw5" event={"ID":"11c18264-a296-44af-b112-21ad216ce917","Type":"ContainerDied","Data":"41c1158bb7fa0503998ebe02d8ac275ef6e6ed3beb50d2a6f95b7423f136e0d5"} Dec 04 12:09:05.780652 master-0 kubenswrapper[35367]: I1204 12:09:05.780495 35367 generic.go:334] "Generic (PLEG): container finished" podID="414ce51b-cd2f-4311-96e0-bd80fb0ae666" containerID="164f9ed9ed9983efbca38d2d3b5ccbc5acdd215f664829c3365cb1e7705ef432" exitCode=0 Dec 04 12:09:05.780652 master-0 kubenswrapper[35367]: I1204 12:09:05.780549 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-jjfcc" event={"ID":"414ce51b-cd2f-4311-96e0-bd80fb0ae666","Type":"ContainerDied","Data":"164f9ed9ed9983efbca38d2d3b5ccbc5acdd215f664829c3365cb1e7705ef432"} Dec 04 12:09:07.087663 master-0 kubenswrapper[35367]: I1204 12:09:07.087579 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-rxp4h"] Dec 04 12:09:07.089696 master-0 kubenswrapper[35367]: I1204 12:09:07.089658 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-rxp4h" Dec 04 12:09:07.142739 master-0 kubenswrapper[35367]: I1204 12:09:07.142651 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/78de4935-3e4c-4f6f-bbb5-d592c35b47da-catalog-content\") pod \"redhat-operators-rxp4h\" (UID: \"78de4935-3e4c-4f6f-bbb5-d592c35b47da\") " pod="openshift-marketplace/redhat-operators-rxp4h" Dec 04 12:09:07.143027 master-0 kubenswrapper[35367]: I1204 12:09:07.142870 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/78de4935-3e4c-4f6f-bbb5-d592c35b47da-utilities\") pod \"redhat-operators-rxp4h\" (UID: \"78de4935-3e4c-4f6f-bbb5-d592c35b47da\") " pod="openshift-marketplace/redhat-operators-rxp4h" Dec 04 12:09:07.143027 master-0 kubenswrapper[35367]: I1204 12:09:07.142937 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzg6x\" (UniqueName: \"kubernetes.io/projected/78de4935-3e4c-4f6f-bbb5-d592c35b47da-kube-api-access-nzg6x\") pod \"redhat-operators-rxp4h\" (UID: \"78de4935-3e4c-4f6f-bbb5-d592c35b47da\") " pod="openshift-marketplace/redhat-operators-rxp4h" Dec 04 12:09:07.242831 master-0 kubenswrapper[35367]: I1204 12:09:07.232694 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-rxp4h"] Dec 04 12:09:07.245087 master-0 kubenswrapper[35367]: I1204 12:09:07.245006 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/78de4935-3e4c-4f6f-bbb5-d592c35b47da-utilities\") pod \"redhat-operators-rxp4h\" (UID: \"78de4935-3e4c-4f6f-bbb5-d592c35b47da\") " pod="openshift-marketplace/redhat-operators-rxp4h" Dec 04 12:09:07.245290 master-0 kubenswrapper[35367]: I1204 12:09:07.245106 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nzg6x\" (UniqueName: \"kubernetes.io/projected/78de4935-3e4c-4f6f-bbb5-d592c35b47da-kube-api-access-nzg6x\") pod \"redhat-operators-rxp4h\" (UID: \"78de4935-3e4c-4f6f-bbb5-d592c35b47da\") " pod="openshift-marketplace/redhat-operators-rxp4h" Dec 04 12:09:07.245290 master-0 kubenswrapper[35367]: I1204 12:09:07.245224 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/78de4935-3e4c-4f6f-bbb5-d592c35b47da-catalog-content\") pod \"redhat-operators-rxp4h\" (UID: \"78de4935-3e4c-4f6f-bbb5-d592c35b47da\") " pod="openshift-marketplace/redhat-operators-rxp4h" Dec 04 12:09:07.246034 master-0 kubenswrapper[35367]: I1204 12:09:07.245994 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/78de4935-3e4c-4f6f-bbb5-d592c35b47da-catalog-content\") pod \"redhat-operators-rxp4h\" (UID: \"78de4935-3e4c-4f6f-bbb5-d592c35b47da\") " pod="openshift-marketplace/redhat-operators-rxp4h" Dec 04 12:09:07.247369 master-0 kubenswrapper[35367]: I1204 12:09:07.246363 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/78de4935-3e4c-4f6f-bbb5-d592c35b47da-utilities\") pod \"redhat-operators-rxp4h\" (UID: \"78de4935-3e4c-4f6f-bbb5-d592c35b47da\") " pod="openshift-marketplace/redhat-operators-rxp4h" Dec 04 12:09:07.270697 master-0 kubenswrapper[35367]: I1204 12:09:07.270598 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzg6x\" (UniqueName: \"kubernetes.io/projected/78de4935-3e4c-4f6f-bbb5-d592c35b47da-kube-api-access-nzg6x\") pod \"redhat-operators-rxp4h\" (UID: \"78de4935-3e4c-4f6f-bbb5-d592c35b47da\") " pod="openshift-marketplace/redhat-operators-rxp4h" Dec 04 12:09:07.285207 master-0 kubenswrapper[35367]: I1204 12:09:07.285066 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-rq9mp"] Dec 04 12:09:07.287920 master-0 kubenswrapper[35367]: I1204 12:09:07.286914 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-rq9mp" Dec 04 12:09:07.304918 master-0 kubenswrapper[35367]: I1204 12:09:07.302694 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-rq9mp"] Dec 04 12:09:07.347656 master-0 kubenswrapper[35367]: I1204 12:09:07.347383 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jrch\" (UniqueName: \"kubernetes.io/projected/e1ea6568-d279-495a-934e-f30deabcd2c9-kube-api-access-7jrch\") pod \"redhat-marketplace-rq9mp\" (UID: \"e1ea6568-d279-495a-934e-f30deabcd2c9\") " pod="openshift-marketplace/redhat-marketplace-rq9mp" Dec 04 12:09:07.347656 master-0 kubenswrapper[35367]: I1204 12:09:07.347449 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e1ea6568-d279-495a-934e-f30deabcd2c9-catalog-content\") pod \"redhat-marketplace-rq9mp\" (UID: \"e1ea6568-d279-495a-934e-f30deabcd2c9\") " pod="openshift-marketplace/redhat-marketplace-rq9mp" Dec 04 12:09:07.347656 master-0 kubenswrapper[35367]: I1204 12:09:07.347476 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e1ea6568-d279-495a-934e-f30deabcd2c9-utilities\") pod \"redhat-marketplace-rq9mp\" (UID: \"e1ea6568-d279-495a-934e-f30deabcd2c9\") " pod="openshift-marketplace/redhat-marketplace-rq9mp" Dec 04 12:09:07.415261 master-0 kubenswrapper[35367]: I1204 12:09:07.415178 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-rxp4h" Dec 04 12:09:07.449776 master-0 kubenswrapper[35367]: I1204 12:09:07.449721 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7jrch\" (UniqueName: \"kubernetes.io/projected/e1ea6568-d279-495a-934e-f30deabcd2c9-kube-api-access-7jrch\") pod \"redhat-marketplace-rq9mp\" (UID: \"e1ea6568-d279-495a-934e-f30deabcd2c9\") " pod="openshift-marketplace/redhat-marketplace-rq9mp" Dec 04 12:09:07.450064 master-0 kubenswrapper[35367]: I1204 12:09:07.449820 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e1ea6568-d279-495a-934e-f30deabcd2c9-catalog-content\") pod \"redhat-marketplace-rq9mp\" (UID: \"e1ea6568-d279-495a-934e-f30deabcd2c9\") " pod="openshift-marketplace/redhat-marketplace-rq9mp" Dec 04 12:09:07.450064 master-0 kubenswrapper[35367]: I1204 12:09:07.449861 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e1ea6568-d279-495a-934e-f30deabcd2c9-utilities\") pod \"redhat-marketplace-rq9mp\" (UID: \"e1ea6568-d279-495a-934e-f30deabcd2c9\") " pod="openshift-marketplace/redhat-marketplace-rq9mp" Dec 04 12:09:07.452455 master-0 kubenswrapper[35367]: I1204 12:09:07.452021 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e1ea6568-d279-495a-934e-f30deabcd2c9-utilities\") pod \"redhat-marketplace-rq9mp\" (UID: \"e1ea6568-d279-495a-934e-f30deabcd2c9\") " pod="openshift-marketplace/redhat-marketplace-rq9mp" Dec 04 12:09:07.454341 master-0 kubenswrapper[35367]: I1204 12:09:07.453050 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e1ea6568-d279-495a-934e-f30deabcd2c9-catalog-content\") pod \"redhat-marketplace-rq9mp\" (UID: \"e1ea6568-d279-495a-934e-f30deabcd2c9\") " pod="openshift-marketplace/redhat-marketplace-rq9mp" Dec 04 12:09:07.471363 master-0 kubenswrapper[35367]: I1204 12:09:07.470908 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jrch\" (UniqueName: \"kubernetes.io/projected/e1ea6568-d279-495a-934e-f30deabcd2c9-kube-api-access-7jrch\") pod \"redhat-marketplace-rq9mp\" (UID: \"e1ea6568-d279-495a-934e-f30deabcd2c9\") " pod="openshift-marketplace/redhat-marketplace-rq9mp" Dec 04 12:09:07.692254 master-0 kubenswrapper[35367]: I1204 12:09:07.692188 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-rq9mp" Dec 04 12:09:07.815908 master-0 kubenswrapper[35367]: I1204 12:09:07.815851 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-p5ndf" event={"ID":"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d","Type":"ContainerStarted","Data":"9b381de18861f1e6749219437ce857d5e6e257e4af3cc8787117a9d8c0e92c73"} Dec 04 12:09:07.821989 master-0 kubenswrapper[35367]: I1204 12:09:07.821923 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-jjfcc" event={"ID":"414ce51b-cd2f-4311-96e0-bd80fb0ae666","Type":"ContainerStarted","Data":"a95164cc8a270d05de9b2a69a6848239d05c00d5a41a825cf74d7ee6fb1794aa"} Dec 04 12:09:07.825210 master-0 kubenswrapper[35367]: I1204 12:09:07.825173 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-fhdw5" event={"ID":"11c18264-a296-44af-b112-21ad216ce917","Type":"ContainerStarted","Data":"e49d5893b53eb81d7075646b4602344fd0296c3aa66518d8b31f3ccd26e49c76"} Dec 04 12:09:07.868611 master-0 kubenswrapper[35367]: I1204 12:09:07.866510 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-jjfcc" podStartSLOduration=11.118065025 podStartE2EDuration="15.866493252s" podCreationTimestamp="2025-12-04 12:08:52 +0000 UTC" firstStartedPulling="2025-12-04 12:09:02.743961156 +0000 UTC m=+586.182022414" lastFinishedPulling="2025-12-04 12:09:07.492389383 +0000 UTC m=+590.930450641" observedRunningTime="2025-12-04 12:09:07.865614944 +0000 UTC m=+591.303676202" watchObservedRunningTime="2025-12-04 12:09:07.866493252 +0000 UTC m=+591.304554510" Dec 04 12:09:08.075042 master-0 kubenswrapper[35367]: I1204 12:09:08.074952 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-rxp4h"] Dec 04 12:09:08.383759 master-0 kubenswrapper[35367]: I1204 12:09:08.383700 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-rq9mp"] Dec 04 12:09:08.838004 master-0 kubenswrapper[35367]: I1204 12:09:08.837955 35367 generic.go:334] "Generic (PLEG): container finished" podID="11c18264-a296-44af-b112-21ad216ce917" containerID="e49d5893b53eb81d7075646b4602344fd0296c3aa66518d8b31f3ccd26e49c76" exitCode=0 Dec 04 12:09:08.838268 master-0 kubenswrapper[35367]: I1204 12:09:08.838010 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-fhdw5" event={"ID":"11c18264-a296-44af-b112-21ad216ce917","Type":"ContainerDied","Data":"e49d5893b53eb81d7075646b4602344fd0296c3aa66518d8b31f3ccd26e49c76"} Dec 04 12:09:08.842083 master-0 kubenswrapper[35367]: I1204 12:09:08.842052 35367 generic.go:334] "Generic (PLEG): container finished" podID="e1ea6568-d279-495a-934e-f30deabcd2c9" containerID="4a97587d11f0377af86568f986099e538ae7d9bffc2ac645e4a6eec35b48f180" exitCode=0 Dec 04 12:09:08.842149 master-0 kubenswrapper[35367]: I1204 12:09:08.842099 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-rq9mp" event={"ID":"e1ea6568-d279-495a-934e-f30deabcd2c9","Type":"ContainerDied","Data":"4a97587d11f0377af86568f986099e538ae7d9bffc2ac645e4a6eec35b48f180"} Dec 04 12:09:08.842206 master-0 kubenswrapper[35367]: I1204 12:09:08.842166 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-rq9mp" event={"ID":"e1ea6568-d279-495a-934e-f30deabcd2c9","Type":"ContainerStarted","Data":"c70324918e4db257c76635e85a30b2cf009b8a2fee98086b59cec7a5ea4bb8a9"} Dec 04 12:09:08.846113 master-0 kubenswrapper[35367]: I1204 12:09:08.846078 35367 generic.go:334] "Generic (PLEG): container finished" podID="78de4935-3e4c-4f6f-bbb5-d592c35b47da" containerID="7a6b0f1a41abf6013bf44ce897eec3a5dccb1897583c77faeb409e52b30f3f94" exitCode=0 Dec 04 12:09:08.847559 master-0 kubenswrapper[35367]: I1204 12:09:08.847534 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-rxp4h" event={"ID":"78de4935-3e4c-4f6f-bbb5-d592c35b47da","Type":"ContainerDied","Data":"7a6b0f1a41abf6013bf44ce897eec3a5dccb1897583c77faeb409e52b30f3f94"} Dec 04 12:09:08.847635 master-0 kubenswrapper[35367]: I1204 12:09:08.847568 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-rxp4h" event={"ID":"78de4935-3e4c-4f6f-bbb5-d592c35b47da","Type":"ContainerStarted","Data":"2153fa565d5e5a981a9451ebde3da593bb6209466681123f0ffaf5d0817bfa1f"} Dec 04 12:09:09.864187 master-0 kubenswrapper[35367]: I1204 12:09:09.864119 35367 generic.go:334] "Generic (PLEG): container finished" podID="0ed2adcc-5493-4adc-ad40-40df2b8dbd2d" containerID="9b381de18861f1e6749219437ce857d5e6e257e4af3cc8787117a9d8c0e92c73" exitCode=0 Dec 04 12:09:09.864187 master-0 kubenswrapper[35367]: I1204 12:09:09.864196 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-p5ndf" event={"ID":"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d","Type":"ContainerDied","Data":"9b381de18861f1e6749219437ce857d5e6e257e4af3cc8787117a9d8c0e92c73"} Dec 04 12:09:09.870046 master-0 kubenswrapper[35367]: I1204 12:09:09.869967 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-fhdw5" event={"ID":"11c18264-a296-44af-b112-21ad216ce917","Type":"ContainerStarted","Data":"4c57d0f9ce18b05e0cb4b824f8cb6a475154e59ee1c527fff3db1930cc7bc930"} Dec 04 12:09:09.926510 master-0 kubenswrapper[35367]: I1204 12:09:09.926426 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-fhdw5" podStartSLOduration=3.462393263 podStartE2EDuration="7.926406463s" podCreationTimestamp="2025-12-04 12:09:02 +0000 UTC" firstStartedPulling="2025-12-04 12:09:04.772580142 +0000 UTC m=+588.210641390" lastFinishedPulling="2025-12-04 12:09:09.236593332 +0000 UTC m=+592.674654590" observedRunningTime="2025-12-04 12:09:09.922217022 +0000 UTC m=+593.360278300" watchObservedRunningTime="2025-12-04 12:09:09.926406463 +0000 UTC m=+593.364467711" Dec 04 12:09:10.312337 master-0 kubenswrapper[35367]: I1204 12:09:10.312279 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-zjmf2"] Dec 04 12:09:10.314105 master-0 kubenswrapper[35367]: I1204 12:09:10.314031 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-zjmf2" Dec 04 12:09:10.325441 master-0 kubenswrapper[35367]: I1204 12:09:10.325381 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-zjmf2"] Dec 04 12:09:10.413576 master-0 kubenswrapper[35367]: I1204 12:09:10.413252 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/31422ce2-eae5-47fb-9c8b-7a77caa95696-catalog-content\") pod \"redhat-marketplace-zjmf2\" (UID: \"31422ce2-eae5-47fb-9c8b-7a77caa95696\") " pod="openshift-marketplace/redhat-marketplace-zjmf2" Dec 04 12:09:10.413576 master-0 kubenswrapper[35367]: I1204 12:09:10.413365 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/31422ce2-eae5-47fb-9c8b-7a77caa95696-utilities\") pod \"redhat-marketplace-zjmf2\" (UID: \"31422ce2-eae5-47fb-9c8b-7a77caa95696\") " pod="openshift-marketplace/redhat-marketplace-zjmf2" Dec 04 12:09:10.413576 master-0 kubenswrapper[35367]: I1204 12:09:10.413417 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vts8\" (UniqueName: \"kubernetes.io/projected/31422ce2-eae5-47fb-9c8b-7a77caa95696-kube-api-access-6vts8\") pod \"redhat-marketplace-zjmf2\" (UID: \"31422ce2-eae5-47fb-9c8b-7a77caa95696\") " pod="openshift-marketplace/redhat-marketplace-zjmf2" Dec 04 12:09:10.515157 master-0 kubenswrapper[35367]: I1204 12:09:10.515099 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/31422ce2-eae5-47fb-9c8b-7a77caa95696-utilities\") pod \"redhat-marketplace-zjmf2\" (UID: \"31422ce2-eae5-47fb-9c8b-7a77caa95696\") " pod="openshift-marketplace/redhat-marketplace-zjmf2" Dec 04 12:09:10.515427 master-0 kubenswrapper[35367]: I1204 12:09:10.515165 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6vts8\" (UniqueName: \"kubernetes.io/projected/31422ce2-eae5-47fb-9c8b-7a77caa95696-kube-api-access-6vts8\") pod \"redhat-marketplace-zjmf2\" (UID: \"31422ce2-eae5-47fb-9c8b-7a77caa95696\") " pod="openshift-marketplace/redhat-marketplace-zjmf2" Dec 04 12:09:10.515427 master-0 kubenswrapper[35367]: I1204 12:09:10.515243 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/31422ce2-eae5-47fb-9c8b-7a77caa95696-catalog-content\") pod \"redhat-marketplace-zjmf2\" (UID: \"31422ce2-eae5-47fb-9c8b-7a77caa95696\") " pod="openshift-marketplace/redhat-marketplace-zjmf2" Dec 04 12:09:10.515722 master-0 kubenswrapper[35367]: I1204 12:09:10.515691 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/31422ce2-eae5-47fb-9c8b-7a77caa95696-catalog-content\") pod \"redhat-marketplace-zjmf2\" (UID: \"31422ce2-eae5-47fb-9c8b-7a77caa95696\") " pod="openshift-marketplace/redhat-marketplace-zjmf2" Dec 04 12:09:10.515988 master-0 kubenswrapper[35367]: I1204 12:09:10.515957 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/31422ce2-eae5-47fb-9c8b-7a77caa95696-utilities\") pod \"redhat-marketplace-zjmf2\" (UID: \"31422ce2-eae5-47fb-9c8b-7a77caa95696\") " pod="openshift-marketplace/redhat-marketplace-zjmf2" Dec 04 12:09:10.535894 master-0 kubenswrapper[35367]: I1204 12:09:10.533766 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vts8\" (UniqueName: \"kubernetes.io/projected/31422ce2-eae5-47fb-9c8b-7a77caa95696-kube-api-access-6vts8\") pod \"redhat-marketplace-zjmf2\" (UID: \"31422ce2-eae5-47fb-9c8b-7a77caa95696\") " pod="openshift-marketplace/redhat-marketplace-zjmf2" Dec 04 12:09:10.690382 master-0 kubenswrapper[35367]: I1204 12:09:10.690290 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-xgzlt" Dec 04 12:09:10.690382 master-0 kubenswrapper[35367]: I1204 12:09:10.690371 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-xgzlt" Dec 04 12:09:10.711072 master-0 kubenswrapper[35367]: I1204 12:09:10.711018 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-zjmf2" Dec 04 12:09:10.753877 master-0 kubenswrapper[35367]: I1204 12:09:10.753787 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-xgzlt" Dec 04 12:09:10.893789 master-0 kubenswrapper[35367]: I1204 12:09:10.893244 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-p5ndf" event={"ID":"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d","Type":"ContainerStarted","Data":"50e4aba05a5634a6aa93e16728c33a772797be815d298cbb9c41818ca8fa4710"} Dec 04 12:09:10.904236 master-0 kubenswrapper[35367]: I1204 12:09:10.902597 35367 generic.go:334] "Generic (PLEG): container finished" podID="e1ea6568-d279-495a-934e-f30deabcd2c9" containerID="dd51aaf518c0a113250b25734d4e0828b25139289158497c9d0bfccb124b2968" exitCode=0 Dec 04 12:09:10.904236 master-0 kubenswrapper[35367]: I1204 12:09:10.902671 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-rq9mp" event={"ID":"e1ea6568-d279-495a-934e-f30deabcd2c9","Type":"ContainerDied","Data":"dd51aaf518c0a113250b25734d4e0828b25139289158497c9d0bfccb124b2968"} Dec 04 12:09:10.908557 master-0 kubenswrapper[35367]: I1204 12:09:10.907786 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-rxp4h" event={"ID":"78de4935-3e4c-4f6f-bbb5-d592c35b47da","Type":"ContainerStarted","Data":"1b41d4bf52eda540862e7178b458fca8537ec72deda15b3448f09847e1e10ba2"} Dec 04 12:09:10.922479 master-0 kubenswrapper[35367]: I1204 12:09:10.922397 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-p5ndf" podStartSLOduration=3.364933158 podStartE2EDuration="9.922368294s" podCreationTimestamp="2025-12-04 12:09:01 +0000 UTC" firstStartedPulling="2025-12-04 12:09:03.793469141 +0000 UTC m=+587.231530399" lastFinishedPulling="2025-12-04 12:09:10.350904287 +0000 UTC m=+593.788965535" observedRunningTime="2025-12-04 12:09:10.918573116 +0000 UTC m=+594.356634374" watchObservedRunningTime="2025-12-04 12:09:10.922368294 +0000 UTC m=+594.360429562" Dec 04 12:09:10.989828 master-0 kubenswrapper[35367]: I1204 12:09:10.989363 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-xgzlt" Dec 04 12:09:11.295568 master-0 kubenswrapper[35367]: I1204 12:09:11.295502 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-zjmf2"] Dec 04 12:09:11.298137 master-0 kubenswrapper[35367]: W1204 12:09:11.298091 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31422ce2_eae5_47fb_9c8b_7a77caa95696.slice/crio-dd7fe7ee1a8ce2c215ee05e3d6929c00e06eac6efc64a06d5e902647d77d3831 WatchSource:0}: Error finding container dd7fe7ee1a8ce2c215ee05e3d6929c00e06eac6efc64a06d5e902647d77d3831: Status 404 returned error can't find the container with id dd7fe7ee1a8ce2c215ee05e3d6929c00e06eac6efc64a06d5e902647d77d3831 Dec 04 12:09:11.918896 master-0 kubenswrapper[35367]: I1204 12:09:11.918771 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-rq9mp" event={"ID":"e1ea6568-d279-495a-934e-f30deabcd2c9","Type":"ContainerStarted","Data":"511983834e9b0f278e91bcd5967e8c5b5a1cb00be72993dffae795499a8eff84"} Dec 04 12:09:11.920907 master-0 kubenswrapper[35367]: I1204 12:09:11.920862 35367 generic.go:334] "Generic (PLEG): container finished" podID="78de4935-3e4c-4f6f-bbb5-d592c35b47da" containerID="1b41d4bf52eda540862e7178b458fca8537ec72deda15b3448f09847e1e10ba2" exitCode=0 Dec 04 12:09:11.920989 master-0 kubenswrapper[35367]: I1204 12:09:11.920932 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-rxp4h" event={"ID":"78de4935-3e4c-4f6f-bbb5-d592c35b47da","Type":"ContainerDied","Data":"1b41d4bf52eda540862e7178b458fca8537ec72deda15b3448f09847e1e10ba2"} Dec 04 12:09:11.923672 master-0 kubenswrapper[35367]: I1204 12:09:11.923140 35367 generic.go:334] "Generic (PLEG): container finished" podID="31422ce2-eae5-47fb-9c8b-7a77caa95696" containerID="b34d3f9ec14a37124a4ae5bce6c68a19a81cf659747228d302c387bbcdeaaf68" exitCode=0 Dec 04 12:09:11.924157 master-0 kubenswrapper[35367]: I1204 12:09:11.923218 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zjmf2" event={"ID":"31422ce2-eae5-47fb-9c8b-7a77caa95696","Type":"ContainerDied","Data":"b34d3f9ec14a37124a4ae5bce6c68a19a81cf659747228d302c387bbcdeaaf68"} Dec 04 12:09:11.924204 master-0 kubenswrapper[35367]: I1204 12:09:11.924174 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zjmf2" event={"ID":"31422ce2-eae5-47fb-9c8b-7a77caa95696","Type":"ContainerStarted","Data":"dd7fe7ee1a8ce2c215ee05e3d6929c00e06eac6efc64a06d5e902647d77d3831"} Dec 04 12:09:11.950868 master-0 kubenswrapper[35367]: I1204 12:09:11.950768 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-rq9mp" podStartSLOduration=2.373759749 podStartE2EDuration="4.950741996s" podCreationTimestamp="2025-12-04 12:09:07 +0000 UTC" firstStartedPulling="2025-12-04 12:09:08.843498797 +0000 UTC m=+592.281560055" lastFinishedPulling="2025-12-04 12:09:11.420481044 +0000 UTC m=+594.858542302" observedRunningTime="2025-12-04 12:09:11.944046385 +0000 UTC m=+595.382107653" watchObservedRunningTime="2025-12-04 12:09:11.950741996 +0000 UTC m=+595.388803254" Dec 04 12:09:12.213937 master-0 kubenswrapper[35367]: I1204 12:09:12.213780 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-p5ndf" Dec 04 12:09:12.213937 master-0 kubenswrapper[35367]: I1204 12:09:12.213890 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-p5ndf" Dec 04 12:09:13.275535 master-0 kubenswrapper[35367]: I1204 12:09:13.275357 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-p5ndf" podUID="0ed2adcc-5493-4adc-ad40-40df2b8dbd2d" containerName="registry-server" probeResult="failure" output=< Dec 04 12:09:13.275535 master-0 kubenswrapper[35367]: timeout: failed to connect service ":50051" within 1s Dec 04 12:09:13.275535 master-0 kubenswrapper[35367]: > Dec 04 12:09:13.275535 master-0 kubenswrapper[35367]: I1204 12:09:13.275451 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-fhdw5" Dec 04 12:09:13.275535 master-0 kubenswrapper[35367]: I1204 12:09:13.275503 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-fhdw5" Dec 04 12:09:13.327168 master-0 kubenswrapper[35367]: I1204 12:09:13.327110 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-fhdw5" Dec 04 12:09:13.707124 master-0 kubenswrapper[35367]: I1204 12:09:13.707052 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Dec 04 12:09:13.707497 master-0 kubenswrapper[35367]: I1204 12:09:13.707457 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="alertmanager" containerID="cri-o://6a985bd66414f1ece90f85d73dd315ae61aaf212ef9e2f26a69fba73a8fd6d76" gracePeriod=120 Dec 04 12:09:13.707579 master-0 kubenswrapper[35367]: I1204 12:09:13.707491 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="prom-label-proxy" containerID="cri-o://9866abeb71ec8984443fb997f49da59f71789745ebaabc056781e0b1073cfe6d" gracePeriod=120 Dec 04 12:09:13.707579 master-0 kubenswrapper[35367]: I1204 12:09:13.707535 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="kube-rbac-proxy-web" containerID="cri-o://57bc89e425e8fa97e475093f61959d7c2b495d60491dbc042c89acb3ffcb5b6b" gracePeriod=120 Dec 04 12:09:13.707668 master-0 kubenswrapper[35367]: I1204 12:09:13.707470 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="kube-rbac-proxy-metric" containerID="cri-o://a45df79f959cc5193e82829472e5d19fea383de9deb904eedbcdc2996518b016" gracePeriod=120 Dec 04 12:09:13.707713 master-0 kubenswrapper[35367]: I1204 12:09:13.707624 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="config-reloader" containerID="cri-o://7e001579a42dceee5e35c7aa24eb2603ab820a146afd5de67175c9099377098d" gracePeriod=120 Dec 04 12:09:13.707713 master-0 kubenswrapper[35367]: I1204 12:09:13.707652 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="kube-rbac-proxy" containerID="cri-o://ab8ef15589b1ad926e9756eb655c64edd6f6cae7500f99ea6cd36fa48adfd1a9" gracePeriod=120 Dec 04 12:09:13.946272 master-0 kubenswrapper[35367]: I1204 12:09:13.946139 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-rxp4h" event={"ID":"78de4935-3e4c-4f6f-bbb5-d592c35b47da","Type":"ContainerStarted","Data":"137da20bd4af181a38127c9a59458b71aed997c9aa122580536bf1a577381627"} Dec 04 12:09:13.949269 master-0 kubenswrapper[35367]: I1204 12:09:13.949223 35367 generic.go:334] "Generic (PLEG): container finished" podID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerID="9866abeb71ec8984443fb997f49da59f71789745ebaabc056781e0b1073cfe6d" exitCode=0 Dec 04 12:09:13.949269 master-0 kubenswrapper[35367]: I1204 12:09:13.949265 35367 generic.go:334] "Generic (PLEG): container finished" podID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerID="ab8ef15589b1ad926e9756eb655c64edd6f6cae7500f99ea6cd36fa48adfd1a9" exitCode=0 Dec 04 12:09:13.949386 master-0 kubenswrapper[35367]: I1204 12:09:13.949277 35367 generic.go:334] "Generic (PLEG): container finished" podID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerID="7e001579a42dceee5e35c7aa24eb2603ab820a146afd5de67175c9099377098d" exitCode=0 Dec 04 12:09:13.949386 master-0 kubenswrapper[35367]: I1204 12:09:13.949288 35367 generic.go:334] "Generic (PLEG): container finished" podID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerID="6a985bd66414f1ece90f85d73dd315ae61aaf212ef9e2f26a69fba73a8fd6d76" exitCode=0 Dec 04 12:09:13.949386 master-0 kubenswrapper[35367]: I1204 12:09:13.949296 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39b763e-1e11-489e-bfef-df396e96d6b8","Type":"ContainerDied","Data":"9866abeb71ec8984443fb997f49da59f71789745ebaabc056781e0b1073cfe6d"} Dec 04 12:09:13.949386 master-0 kubenswrapper[35367]: I1204 12:09:13.949347 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39b763e-1e11-489e-bfef-df396e96d6b8","Type":"ContainerDied","Data":"ab8ef15589b1ad926e9756eb655c64edd6f6cae7500f99ea6cd36fa48adfd1a9"} Dec 04 12:09:13.949386 master-0 kubenswrapper[35367]: I1204 12:09:13.949359 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39b763e-1e11-489e-bfef-df396e96d6b8","Type":"ContainerDied","Data":"7e001579a42dceee5e35c7aa24eb2603ab820a146afd5de67175c9099377098d"} Dec 04 12:09:13.949386 master-0 kubenswrapper[35367]: I1204 12:09:13.949370 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39b763e-1e11-489e-bfef-df396e96d6b8","Type":"ContainerDied","Data":"6a985bd66414f1ece90f85d73dd315ae61aaf212ef9e2f26a69fba73a8fd6d76"} Dec 04 12:09:13.951037 master-0 kubenswrapper[35367]: I1204 12:09:13.951003 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zjmf2" event={"ID":"31422ce2-eae5-47fb-9c8b-7a77caa95696","Type":"ContainerStarted","Data":"1d17a508bbe81486fabcdc52dd4124695521fc6f724810611a1af39a7262a3e4"} Dec 04 12:09:13.973984 master-0 kubenswrapper[35367]: I1204 12:09:13.973911 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-rxp4h" podStartSLOduration=3.5422750670000003 podStartE2EDuration="6.97389352s" podCreationTimestamp="2025-12-04 12:09:07 +0000 UTC" firstStartedPulling="2025-12-04 12:09:08.848520005 +0000 UTC m=+592.286581263" lastFinishedPulling="2025-12-04 12:09:12.280138458 +0000 UTC m=+595.718199716" observedRunningTime="2025-12-04 12:09:13.968684636 +0000 UTC m=+597.406745894" watchObservedRunningTime="2025-12-04 12:09:13.97389352 +0000 UTC m=+597.411954778" Dec 04 12:09:14.083713 master-0 kubenswrapper[35367]: I1204 12:09:14.083648 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-ndng9"] Dec 04 12:09:14.090114 master-0 kubenswrapper[35367]: I1204 12:09:14.090061 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-ndng9" Dec 04 12:09:14.106603 master-0 kubenswrapper[35367]: I1204 12:09:14.106181 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-ndng9"] Dec 04 12:09:14.194145 master-0 kubenswrapper[35367]: I1204 12:09:14.194048 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqkp8\" (UniqueName: \"kubernetes.io/projected/bbe68aaa-bd9b-43b9-b465-fb0c09484c64-kube-api-access-hqkp8\") pod \"redhat-marketplace-ndng9\" (UID: \"bbe68aaa-bd9b-43b9-b465-fb0c09484c64\") " pod="openshift-marketplace/redhat-marketplace-ndng9" Dec 04 12:09:14.194404 master-0 kubenswrapper[35367]: I1204 12:09:14.194148 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/bbe68aaa-bd9b-43b9-b465-fb0c09484c64-utilities\") pod \"redhat-marketplace-ndng9\" (UID: \"bbe68aaa-bd9b-43b9-b465-fb0c09484c64\") " pod="openshift-marketplace/redhat-marketplace-ndng9" Dec 04 12:09:14.194404 master-0 kubenswrapper[35367]: I1204 12:09:14.194287 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/bbe68aaa-bd9b-43b9-b465-fb0c09484c64-catalog-content\") pod \"redhat-marketplace-ndng9\" (UID: \"bbe68aaa-bd9b-43b9-b465-fb0c09484c64\") " pod="openshift-marketplace/redhat-marketplace-ndng9" Dec 04 12:09:14.296129 master-0 kubenswrapper[35367]: I1204 12:09:14.295951 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/bbe68aaa-bd9b-43b9-b465-fb0c09484c64-catalog-content\") pod \"redhat-marketplace-ndng9\" (UID: \"bbe68aaa-bd9b-43b9-b465-fb0c09484c64\") " pod="openshift-marketplace/redhat-marketplace-ndng9" Dec 04 12:09:14.296129 master-0 kubenswrapper[35367]: I1204 12:09:14.296094 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hqkp8\" (UniqueName: \"kubernetes.io/projected/bbe68aaa-bd9b-43b9-b465-fb0c09484c64-kube-api-access-hqkp8\") pod \"redhat-marketplace-ndng9\" (UID: \"bbe68aaa-bd9b-43b9-b465-fb0c09484c64\") " pod="openshift-marketplace/redhat-marketplace-ndng9" Dec 04 12:09:14.296129 master-0 kubenswrapper[35367]: I1204 12:09:14.296131 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/bbe68aaa-bd9b-43b9-b465-fb0c09484c64-utilities\") pod \"redhat-marketplace-ndng9\" (UID: \"bbe68aaa-bd9b-43b9-b465-fb0c09484c64\") " pod="openshift-marketplace/redhat-marketplace-ndng9" Dec 04 12:09:14.296844 master-0 kubenswrapper[35367]: I1204 12:09:14.296742 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/bbe68aaa-bd9b-43b9-b465-fb0c09484c64-utilities\") pod \"redhat-marketplace-ndng9\" (UID: \"bbe68aaa-bd9b-43b9-b465-fb0c09484c64\") " pod="openshift-marketplace/redhat-marketplace-ndng9" Dec 04 12:09:14.296844 master-0 kubenswrapper[35367]: I1204 12:09:14.296789 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/bbe68aaa-bd9b-43b9-b465-fb0c09484c64-catalog-content\") pod \"redhat-marketplace-ndng9\" (UID: \"bbe68aaa-bd9b-43b9-b465-fb0c09484c64\") " pod="openshift-marketplace/redhat-marketplace-ndng9" Dec 04 12:09:14.317877 master-0 kubenswrapper[35367]: I1204 12:09:14.317605 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqkp8\" (UniqueName: \"kubernetes.io/projected/bbe68aaa-bd9b-43b9-b465-fb0c09484c64-kube-api-access-hqkp8\") pod \"redhat-marketplace-ndng9\" (UID: \"bbe68aaa-bd9b-43b9-b465-fb0c09484c64\") " pod="openshift-marketplace/redhat-marketplace-ndng9" Dec 04 12:09:14.422762 master-0 kubenswrapper[35367]: I1204 12:09:14.422691 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-ndng9" Dec 04 12:09:14.964518 master-0 kubenswrapper[35367]: I1204 12:09:14.964365 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-ndng9"] Dec 04 12:09:14.976459 master-0 kubenswrapper[35367]: I1204 12:09:14.976396 35367 generic.go:334] "Generic (PLEG): container finished" podID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerID="a45df79f959cc5193e82829472e5d19fea383de9deb904eedbcdc2996518b016" exitCode=0 Dec 04 12:09:14.976459 master-0 kubenswrapper[35367]: I1204 12:09:14.976449 35367 generic.go:334] "Generic (PLEG): container finished" podID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerID="57bc89e425e8fa97e475093f61959d7c2b495d60491dbc042c89acb3ffcb5b6b" exitCode=0 Dec 04 12:09:14.976789 master-0 kubenswrapper[35367]: I1204 12:09:14.976469 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39b763e-1e11-489e-bfef-df396e96d6b8","Type":"ContainerDied","Data":"a45df79f959cc5193e82829472e5d19fea383de9deb904eedbcdc2996518b016"} Dec 04 12:09:14.976789 master-0 kubenswrapper[35367]: I1204 12:09:14.976553 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39b763e-1e11-489e-bfef-df396e96d6b8","Type":"ContainerDied","Data":"57bc89e425e8fa97e475093f61959d7c2b495d60491dbc042c89acb3ffcb5b6b"} Dec 04 12:09:14.978700 master-0 kubenswrapper[35367]: I1204 12:09:14.978591 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-ndng9" event={"ID":"bbe68aaa-bd9b-43b9-b465-fb0c09484c64","Type":"ContainerStarted","Data":"4bb104d79d9e9808266124028b7630fe77f1d4e68fa1fd096fa5998fb13cc230"} Dec 04 12:09:14.982682 master-0 kubenswrapper[35367]: I1204 12:09:14.982107 35367 generic.go:334] "Generic (PLEG): container finished" podID="31422ce2-eae5-47fb-9c8b-7a77caa95696" containerID="1d17a508bbe81486fabcdc52dd4124695521fc6f724810611a1af39a7262a3e4" exitCode=0 Dec 04 12:09:14.985207 master-0 kubenswrapper[35367]: I1204 12:09:14.985147 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zjmf2" event={"ID":"31422ce2-eae5-47fb-9c8b-7a77caa95696","Type":"ContainerDied","Data":"1d17a508bbe81486fabcdc52dd4124695521fc6f724810611a1af39a7262a3e4"} Dec 04 12:09:15.184669 master-0 kubenswrapper[35367]: I1204 12:09:15.180577 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:15.225033 master-0 kubenswrapper[35367]: I1204 12:09:15.224954 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a39b763e-1e11-489e-bfef-df396e96d6b8-metrics-client-ca\") pod \"a39b763e-1e11-489e-bfef-df396e96d6b8\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " Dec 04 12:09:15.225284 master-0 kubenswrapper[35367]: I1204 12:09:15.225067 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a39b763e-1e11-489e-bfef-df396e96d6b8-alertmanager-trusted-ca-bundle\") pod \"a39b763e-1e11-489e-bfef-df396e96d6b8\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " Dec 04 12:09:15.225284 master-0 kubenswrapper[35367]: I1204 12:09:15.225180 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-config-volume\") pod \"a39b763e-1e11-489e-bfef-df396e96d6b8\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " Dec 04 12:09:15.225284 master-0 kubenswrapper[35367]: I1204 12:09:15.225216 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"a39b763e-1e11-489e-bfef-df396e96d6b8\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " Dec 04 12:09:15.225423 master-0 kubenswrapper[35367]: I1204 12:09:15.225289 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a39b763e-1e11-489e-bfef-df396e96d6b8-alertmanager-main-db\") pod \"a39b763e-1e11-489e-bfef-df396e96d6b8\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " Dec 04 12:09:15.225423 master-0 kubenswrapper[35367]: I1204 12:09:15.225328 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlzld\" (UniqueName: \"kubernetes.io/projected/a39b763e-1e11-489e-bfef-df396e96d6b8-kube-api-access-rlzld\") pod \"a39b763e-1e11-489e-bfef-df396e96d6b8\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " Dec 04 12:09:15.225423 master-0 kubenswrapper[35367]: I1204 12:09:15.225388 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-web-config\") pod \"a39b763e-1e11-489e-bfef-df396e96d6b8\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " Dec 04 12:09:15.225560 master-0 kubenswrapper[35367]: I1204 12:09:15.225432 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a39b763e-1e11-489e-bfef-df396e96d6b8-config-out\") pod \"a39b763e-1e11-489e-bfef-df396e96d6b8\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " Dec 04 12:09:15.225560 master-0 kubenswrapper[35367]: I1204 12:09:15.225459 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-kube-rbac-proxy\") pod \"a39b763e-1e11-489e-bfef-df396e96d6b8\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " Dec 04 12:09:15.225560 master-0 kubenswrapper[35367]: I1204 12:09:15.225534 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-main-tls\") pod \"a39b763e-1e11-489e-bfef-df396e96d6b8\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " Dec 04 12:09:15.225683 master-0 kubenswrapper[35367]: I1204 12:09:15.225570 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a39b763e-1e11-489e-bfef-df396e96d6b8-tls-assets\") pod \"a39b763e-1e11-489e-bfef-df396e96d6b8\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " Dec 04 12:09:15.225683 master-0 kubenswrapper[35367]: I1204 12:09:15.225600 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-kube-rbac-proxy-web\") pod \"a39b763e-1e11-489e-bfef-df396e96d6b8\" (UID: \"a39b763e-1e11-489e-bfef-df396e96d6b8\") " Dec 04 12:09:15.227303 master-0 kubenswrapper[35367]: I1204 12:09:15.226059 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a39b763e-1e11-489e-bfef-df396e96d6b8-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "a39b763e-1e11-489e-bfef-df396e96d6b8" (UID: "a39b763e-1e11-489e-bfef-df396e96d6b8"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:09:15.227303 master-0 kubenswrapper[35367]: I1204 12:09:15.226962 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a39b763e-1e11-489e-bfef-df396e96d6b8-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "a39b763e-1e11-489e-bfef-df396e96d6b8" (UID: "a39b763e-1e11-489e-bfef-df396e96d6b8"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:15.227303 master-0 kubenswrapper[35367]: I1204 12:09:15.226744 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a39b763e-1e11-489e-bfef-df396e96d6b8-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "a39b763e-1e11-489e-bfef-df396e96d6b8" (UID: "a39b763e-1e11-489e-bfef-df396e96d6b8"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:09:15.229720 master-0 kubenswrapper[35367]: I1204 12:09:15.229666 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "a39b763e-1e11-489e-bfef-df396e96d6b8" (UID: "a39b763e-1e11-489e-bfef-df396e96d6b8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:09:15.229821 master-0 kubenswrapper[35367]: I1204 12:09:15.229737 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "a39b763e-1e11-489e-bfef-df396e96d6b8" (UID: "a39b763e-1e11-489e-bfef-df396e96d6b8"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:09:15.229821 master-0 kubenswrapper[35367]: I1204 12:09:15.229766 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-config-volume" (OuterVolumeSpecName: "config-volume") pod "a39b763e-1e11-489e-bfef-df396e96d6b8" (UID: "a39b763e-1e11-489e-bfef-df396e96d6b8"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:09:15.229888 master-0 kubenswrapper[35367]: I1204 12:09:15.229781 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "a39b763e-1e11-489e-bfef-df396e96d6b8" (UID: "a39b763e-1e11-489e-bfef-df396e96d6b8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:09:15.230493 master-0 kubenswrapper[35367]: I1204 12:09:15.230455 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a39b763e-1e11-489e-bfef-df396e96d6b8-config-out" (OuterVolumeSpecName: "config-out") pod "a39b763e-1e11-489e-bfef-df396e96d6b8" (UID: "a39b763e-1e11-489e-bfef-df396e96d6b8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:15.230493 master-0 kubenswrapper[35367]: I1204 12:09:15.230473 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "a39b763e-1e11-489e-bfef-df396e96d6b8" (UID: "a39b763e-1e11-489e-bfef-df396e96d6b8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:09:15.230574 master-0 kubenswrapper[35367]: I1204 12:09:15.230544 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a39b763e-1e11-489e-bfef-df396e96d6b8-kube-api-access-rlzld" (OuterVolumeSpecName: "kube-api-access-rlzld") pod "a39b763e-1e11-489e-bfef-df396e96d6b8" (UID: "a39b763e-1e11-489e-bfef-df396e96d6b8"). InnerVolumeSpecName "kube-api-access-rlzld". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:15.230683 master-0 kubenswrapper[35367]: I1204 12:09:15.230635 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a39b763e-1e11-489e-bfef-df396e96d6b8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a39b763e-1e11-489e-bfef-df396e96d6b8" (UID: "a39b763e-1e11-489e-bfef-df396e96d6b8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:15.291016 master-0 kubenswrapper[35367]: I1204 12:09:15.289547 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-web-config" (OuterVolumeSpecName: "web-config") pod "a39b763e-1e11-489e-bfef-df396e96d6b8" (UID: "a39b763e-1e11-489e-bfef-df396e96d6b8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:09:15.328269 master-0 kubenswrapper[35367]: I1204 12:09:15.328199 35367 reconciler_common.go:293] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-kube-rbac-proxy-web\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:15.328269 master-0 kubenswrapper[35367]: I1204 12:09:15.328265 35367 reconciler_common.go:293] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a39b763e-1e11-489e-bfef-df396e96d6b8-metrics-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:15.328874 master-0 kubenswrapper[35367]: I1204 12:09:15.328287 35367 reconciler_common.go:293] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a39b763e-1e11-489e-bfef-df396e96d6b8-alertmanager-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:15.328874 master-0 kubenswrapper[35367]: I1204 12:09:15.328301 35367 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-config-volume\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:15.328874 master-0 kubenswrapper[35367]: I1204 12:09:15.328315 35367 reconciler_common.go:293] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-kube-rbac-proxy-metric\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:15.328874 master-0 kubenswrapper[35367]: I1204 12:09:15.328327 35367 reconciler_common.go:293] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a39b763e-1e11-489e-bfef-df396e96d6b8-alertmanager-main-db\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:15.328874 master-0 kubenswrapper[35367]: I1204 12:09:15.328340 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rlzld\" (UniqueName: \"kubernetes.io/projected/a39b763e-1e11-489e-bfef-df396e96d6b8-kube-api-access-rlzld\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:15.328874 master-0 kubenswrapper[35367]: I1204 12:09:15.328353 35367 reconciler_common.go:293] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-web-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:15.328874 master-0 kubenswrapper[35367]: I1204 12:09:15.328364 35367 reconciler_common.go:293] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a39b763e-1e11-489e-bfef-df396e96d6b8-config-out\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:15.328874 master-0 kubenswrapper[35367]: I1204 12:09:15.328376 35367 reconciler_common.go:293] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-kube-rbac-proxy\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:15.328874 master-0 kubenswrapper[35367]: I1204 12:09:15.328390 35367 reconciler_common.go:293] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a39b763e-1e11-489e-bfef-df396e96d6b8-secret-alertmanager-main-tls\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:15.328874 master-0 kubenswrapper[35367]: I1204 12:09:15.328402 35367 reconciler_common.go:293] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a39b763e-1e11-489e-bfef-df396e96d6b8-tls-assets\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:15.994624 master-0 kubenswrapper[35367]: I1204 12:09:15.994547 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39b763e-1e11-489e-bfef-df396e96d6b8","Type":"ContainerDied","Data":"e6f4556655dde2062eebb1de6477b0604f520a3a7c7383e5063ea2de5338cc20"} Dec 04 12:09:15.994998 master-0 kubenswrapper[35367]: I1204 12:09:15.994621 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:15.995240 master-0 kubenswrapper[35367]: I1204 12:09:15.995140 35367 scope.go:117] "RemoveContainer" containerID="9866abeb71ec8984443fb997f49da59f71789745ebaabc056781e0b1073cfe6d" Dec 04 12:09:16.001528 master-0 kubenswrapper[35367]: I1204 12:09:16.001477 35367 generic.go:334] "Generic (PLEG): container finished" podID="bbe68aaa-bd9b-43b9-b465-fb0c09484c64" containerID="24bc05696b06ddb6b7c3927901dc1fe286698358816837d22220571188123276" exitCode=0 Dec 04 12:09:16.001752 master-0 kubenswrapper[35367]: I1204 12:09:16.001539 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-ndng9" event={"ID":"bbe68aaa-bd9b-43b9-b465-fb0c09484c64","Type":"ContainerDied","Data":"24bc05696b06ddb6b7c3927901dc1fe286698358816837d22220571188123276"} Dec 04 12:09:16.036945 master-0 kubenswrapper[35367]: I1204 12:09:16.036865 35367 scope.go:117] "RemoveContainer" containerID="a45df79f959cc5193e82829472e5d19fea383de9deb904eedbcdc2996518b016" Dec 04 12:09:16.064286 master-0 kubenswrapper[35367]: I1204 12:09:16.064230 35367 scope.go:117] "RemoveContainer" containerID="ab8ef15589b1ad926e9756eb655c64edd6f6cae7500f99ea6cd36fa48adfd1a9" Dec 04 12:09:16.081328 master-0 kubenswrapper[35367]: I1204 12:09:16.081272 35367 scope.go:117] "RemoveContainer" containerID="57bc89e425e8fa97e475093f61959d7c2b495d60491dbc042c89acb3ffcb5b6b" Dec 04 12:09:16.101659 master-0 kubenswrapper[35367]: I1204 12:09:16.101604 35367 scope.go:117] "RemoveContainer" containerID="7e001579a42dceee5e35c7aa24eb2603ab820a146afd5de67175c9099377098d" Dec 04 12:09:16.165829 master-0 kubenswrapper[35367]: I1204 12:09:16.163038 35367 scope.go:117] "RemoveContainer" containerID="6a985bd66414f1ece90f85d73dd315ae61aaf212ef9e2f26a69fba73a8fd6d76" Dec 04 12:09:16.202392 master-0 kubenswrapper[35367]: I1204 12:09:16.202329 35367 scope.go:117] "RemoveContainer" containerID="d5449d9e93f204c3f451709d8a21cb9e3907020c8208cd54d6cda721f31ebdf5" Dec 04 12:09:16.902667 master-0 kubenswrapper[35367]: I1204 12:09:16.902572 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-jjfcc" Dec 04 12:09:16.902667 master-0 kubenswrapper[35367]: I1204 12:09:16.902671 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-jjfcc" Dec 04 12:09:16.946949 master-0 kubenswrapper[35367]: I1204 12:09:16.946615 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-jjfcc" Dec 04 12:09:17.056425 master-0 kubenswrapper[35367]: I1204 12:09:17.056366 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-jjfcc" Dec 04 12:09:17.399894 master-0 kubenswrapper[35367]: I1204 12:09:17.397011 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Dec 04 12:09:17.405923 master-0 kubenswrapper[35367]: I1204 12:09:17.405857 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Dec 04 12:09:17.416210 master-0 kubenswrapper[35367]: I1204 12:09:17.416145 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-rxp4h" Dec 04 12:09:17.416210 master-0 kubenswrapper[35367]: I1204 12:09:17.416212 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-rxp4h" Dec 04 12:09:17.426353 master-0 kubenswrapper[35367]: I1204 12:09:17.426275 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-g7j5b"] Dec 04 12:09:17.432848 master-0 kubenswrapper[35367]: E1204 12:09:17.432559 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="kube-rbac-proxy" Dec 04 12:09:17.432848 master-0 kubenswrapper[35367]: I1204 12:09:17.432626 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="kube-rbac-proxy" Dec 04 12:09:17.432848 master-0 kubenswrapper[35367]: E1204 12:09:17.432647 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="config-reloader" Dec 04 12:09:17.432848 master-0 kubenswrapper[35367]: I1204 12:09:17.432657 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="config-reloader" Dec 04 12:09:17.432848 master-0 kubenswrapper[35367]: E1204 12:09:17.432683 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="prom-label-proxy" Dec 04 12:09:17.432848 master-0 kubenswrapper[35367]: I1204 12:09:17.432692 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="prom-label-proxy" Dec 04 12:09:17.432848 master-0 kubenswrapper[35367]: E1204 12:09:17.432714 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="kube-rbac-proxy-web" Dec 04 12:09:17.432848 master-0 kubenswrapper[35367]: I1204 12:09:17.432723 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="kube-rbac-proxy-web" Dec 04 12:09:17.432848 master-0 kubenswrapper[35367]: E1204 12:09:17.432743 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="kube-rbac-proxy-metric" Dec 04 12:09:17.432848 master-0 kubenswrapper[35367]: I1204 12:09:17.432754 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="kube-rbac-proxy-metric" Dec 04 12:09:17.432848 master-0 kubenswrapper[35367]: E1204 12:09:17.432767 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="init-config-reloader" Dec 04 12:09:17.432848 master-0 kubenswrapper[35367]: I1204 12:09:17.432775 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="init-config-reloader" Dec 04 12:09:17.432848 master-0 kubenswrapper[35367]: E1204 12:09:17.432796 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="alertmanager" Dec 04 12:09:17.432848 master-0 kubenswrapper[35367]: I1204 12:09:17.432842 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="alertmanager" Dec 04 12:09:17.433727 master-0 kubenswrapper[35367]: I1204 12:09:17.433159 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="kube-rbac-proxy" Dec 04 12:09:17.433727 master-0 kubenswrapper[35367]: I1204 12:09:17.433178 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="config-reloader" Dec 04 12:09:17.433727 master-0 kubenswrapper[35367]: I1204 12:09:17.433198 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="prom-label-proxy" Dec 04 12:09:17.433727 master-0 kubenswrapper[35367]: I1204 12:09:17.433212 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="alertmanager" Dec 04 12:09:17.433727 master-0 kubenswrapper[35367]: I1204 12:09:17.433221 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="kube-rbac-proxy-metric" Dec 04 12:09:17.433727 master-0 kubenswrapper[35367]: I1204 12:09:17.433243 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" containerName="kube-rbac-proxy-web" Dec 04 12:09:17.437558 master-0 kubenswrapper[35367]: I1204 12:09:17.435747 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-g7j5b" Dec 04 12:09:17.508119 master-0 kubenswrapper[35367]: I1204 12:09:17.508066 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-g7j5b"] Dec 04 12:09:17.566532 master-0 kubenswrapper[35367]: I1204 12:09:17.566446 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spghh\" (UniqueName: \"kubernetes.io/projected/46967266-5366-4e53-9c4d-9575e02846cb-kube-api-access-spghh\") pod \"redhat-marketplace-g7j5b\" (UID: \"46967266-5366-4e53-9c4d-9575e02846cb\") " pod="openshift-marketplace/redhat-marketplace-g7j5b" Dec 04 12:09:17.567009 master-0 kubenswrapper[35367]: I1204 12:09:17.566984 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/46967266-5366-4e53-9c4d-9575e02846cb-utilities\") pod \"redhat-marketplace-g7j5b\" (UID: \"46967266-5366-4e53-9c4d-9575e02846cb\") " pod="openshift-marketplace/redhat-marketplace-g7j5b" Dec 04 12:09:17.567136 master-0 kubenswrapper[35367]: I1204 12:09:17.567116 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/46967266-5366-4e53-9c4d-9575e02846cb-catalog-content\") pod \"redhat-marketplace-g7j5b\" (UID: \"46967266-5366-4e53-9c4d-9575e02846cb\") " pod="openshift-marketplace/redhat-marketplace-g7j5b" Dec 04 12:09:17.613141 master-0 kubenswrapper[35367]: I1204 12:09:17.612984 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Dec 04 12:09:17.616283 master-0 kubenswrapper[35367]: I1204 12:09:17.616222 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.620296 master-0 kubenswrapper[35367]: I1204 12:09:17.618714 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy-web" Dec 04 12:09:17.620296 master-0 kubenswrapper[35367]: I1204 12:09:17.618968 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-tls-assets-0" Dec 04 12:09:17.620296 master-0 kubenswrapper[35367]: I1204 12:09:17.619265 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-generated" Dec 04 12:09:17.620296 master-0 kubenswrapper[35367]: I1204 12:09:17.619571 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy-metric" Dec 04 12:09:17.620296 master-0 kubenswrapper[35367]: I1204 12:09:17.619861 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-web-config" Dec 04 12:09:17.620616 master-0 kubenswrapper[35367]: I1204 12:09:17.620485 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy" Dec 04 12:09:17.620754 master-0 kubenswrapper[35367]: I1204 12:09:17.620723 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-dockercfg-xdnxp" Dec 04 12:09:17.620927 master-0 kubenswrapper[35367]: I1204 12:09:17.620901 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-tls" Dec 04 12:09:17.638718 master-0 kubenswrapper[35367]: I1204 12:09:17.633414 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"alertmanager-trusted-ca-bundle" Dec 04 12:09:17.657177 master-0 kubenswrapper[35367]: I1204 12:09:17.656095 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Dec 04 12:09:17.668927 master-0 kubenswrapper[35367]: I1204 12:09:17.668828 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-spghh\" (UniqueName: \"kubernetes.io/projected/46967266-5366-4e53-9c4d-9575e02846cb-kube-api-access-spghh\") pod \"redhat-marketplace-g7j5b\" (UID: \"46967266-5366-4e53-9c4d-9575e02846cb\") " pod="openshift-marketplace/redhat-marketplace-g7j5b" Dec 04 12:09:17.669719 master-0 kubenswrapper[35367]: I1204 12:09:17.669679 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/46967266-5366-4e53-9c4d-9575e02846cb-utilities\") pod \"redhat-marketplace-g7j5b\" (UID: \"46967266-5366-4e53-9c4d-9575e02846cb\") " pod="openshift-marketplace/redhat-marketplace-g7j5b" Dec 04 12:09:17.669865 master-0 kubenswrapper[35367]: I1204 12:09:17.669749 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/46967266-5366-4e53-9c4d-9575e02846cb-catalog-content\") pod \"redhat-marketplace-g7j5b\" (UID: \"46967266-5366-4e53-9c4d-9575e02846cb\") " pod="openshift-marketplace/redhat-marketplace-g7j5b" Dec 04 12:09:17.670564 master-0 kubenswrapper[35367]: I1204 12:09:17.670533 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/46967266-5366-4e53-9c4d-9575e02846cb-utilities\") pod \"redhat-marketplace-g7j5b\" (UID: \"46967266-5366-4e53-9c4d-9575e02846cb\") " pod="openshift-marketplace/redhat-marketplace-g7j5b" Dec 04 12:09:17.671475 master-0 kubenswrapper[35367]: I1204 12:09:17.671427 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/46967266-5366-4e53-9c4d-9575e02846cb-catalog-content\") pod \"redhat-marketplace-g7j5b\" (UID: \"46967266-5366-4e53-9c4d-9575e02846cb\") " pod="openshift-marketplace/redhat-marketplace-g7j5b" Dec 04 12:09:17.699497 master-0 kubenswrapper[35367]: I1204 12:09:17.699155 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-rq9mp" Dec 04 12:09:17.699858 master-0 kubenswrapper[35367]: I1204 12:09:17.699412 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-rq9mp" Dec 04 12:09:17.760219 master-0 kubenswrapper[35367]: I1204 12:09:17.760158 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-rq9mp" Dec 04 12:09:17.771754 master-0 kubenswrapper[35367]: I1204 12:09:17.771689 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5113c857-78d3-4133-82de-5e28735eacb4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.771754 master-0 kubenswrapper[35367]: I1204 12:09:17.771745 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5113c857-78d3-4133-82de-5e28735eacb4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.774341 master-0 kubenswrapper[35367]: I1204 12:09:17.771795 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5113c857-78d3-4133-82de-5e28735eacb4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.774341 master-0 kubenswrapper[35367]: I1204 12:09:17.771825 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5113c857-78d3-4133-82de-5e28735eacb4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.774341 master-0 kubenswrapper[35367]: I1204 12:09:17.771844 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8tsm\" (UniqueName: \"kubernetes.io/projected/5113c857-78d3-4133-82de-5e28735eacb4-kube-api-access-c8tsm\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.774341 master-0 kubenswrapper[35367]: I1204 12:09:17.771873 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5113c857-78d3-4133-82de-5e28735eacb4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.774341 master-0 kubenswrapper[35367]: I1204 12:09:17.771896 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5113c857-78d3-4133-82de-5e28735eacb4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.774341 master-0 kubenswrapper[35367]: I1204 12:09:17.771937 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5113c857-78d3-4133-82de-5e28735eacb4-config-volume\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.774341 master-0 kubenswrapper[35367]: I1204 12:09:17.771967 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5113c857-78d3-4133-82de-5e28735eacb4-web-config\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.774341 master-0 kubenswrapper[35367]: I1204 12:09:17.771987 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5113c857-78d3-4133-82de-5e28735eacb4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.774341 master-0 kubenswrapper[35367]: I1204 12:09:17.772033 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5113c857-78d3-4133-82de-5e28735eacb4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.774341 master-0 kubenswrapper[35367]: I1204 12:09:17.772051 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5113c857-78d3-4133-82de-5e28735eacb4-config-out\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.792043 master-0 kubenswrapper[35367]: I1204 12:09:17.791995 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-spghh\" (UniqueName: \"kubernetes.io/projected/46967266-5366-4e53-9c4d-9575e02846cb-kube-api-access-spghh\") pod \"redhat-marketplace-g7j5b\" (UID: \"46967266-5366-4e53-9c4d-9575e02846cb\") " pod="openshift-marketplace/redhat-marketplace-g7j5b" Dec 04 12:09:17.874215 master-0 kubenswrapper[35367]: I1204 12:09:17.874087 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5113c857-78d3-4133-82de-5e28735eacb4-config-volume\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.874215 master-0 kubenswrapper[35367]: I1204 12:09:17.874153 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5113c857-78d3-4133-82de-5e28735eacb4-web-config\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.874215 master-0 kubenswrapper[35367]: I1204 12:09:17.874184 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5113c857-78d3-4133-82de-5e28735eacb4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.874481 master-0 kubenswrapper[35367]: I1204 12:09:17.874253 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5113c857-78d3-4133-82de-5e28735eacb4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.874481 master-0 kubenswrapper[35367]: I1204 12:09:17.874279 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5113c857-78d3-4133-82de-5e28735eacb4-config-out\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.874481 master-0 kubenswrapper[35367]: I1204 12:09:17.874301 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5113c857-78d3-4133-82de-5e28735eacb4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.874481 master-0 kubenswrapper[35367]: I1204 12:09:17.874332 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5113c857-78d3-4133-82de-5e28735eacb4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.874481 master-0 kubenswrapper[35367]: I1204 12:09:17.874414 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5113c857-78d3-4133-82de-5e28735eacb4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.874481 master-0 kubenswrapper[35367]: I1204 12:09:17.874432 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5113c857-78d3-4133-82de-5e28735eacb4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.874481 master-0 kubenswrapper[35367]: I1204 12:09:17.874449 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c8tsm\" (UniqueName: \"kubernetes.io/projected/5113c857-78d3-4133-82de-5e28735eacb4-kube-api-access-c8tsm\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.874481 master-0 kubenswrapper[35367]: I1204 12:09:17.874478 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5113c857-78d3-4133-82de-5e28735eacb4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.874705 master-0 kubenswrapper[35367]: I1204 12:09:17.874496 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5113c857-78d3-4133-82de-5e28735eacb4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.878823 master-0 kubenswrapper[35367]: I1204 12:09:17.878751 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5113c857-78d3-4133-82de-5e28735eacb4-config-volume\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.881960 master-0 kubenswrapper[35367]: I1204 12:09:17.881920 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5113c857-78d3-4133-82de-5e28735eacb4-web-config\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.890622 master-0 kubenswrapper[35367]: I1204 12:09:17.883047 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5113c857-78d3-4133-82de-5e28735eacb4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.890932 master-0 kubenswrapper[35367]: I1204 12:09:17.890897 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5113c857-78d3-4133-82de-5e28735eacb4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.890932 master-0 kubenswrapper[35367]: I1204 12:09:17.884327 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5113c857-78d3-4133-82de-5e28735eacb4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.891038 master-0 kubenswrapper[35367]: I1204 12:09:17.884643 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5113c857-78d3-4133-82de-5e28735eacb4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.891038 master-0 kubenswrapper[35367]: I1204 12:09:17.884678 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5113c857-78d3-4133-82de-5e28735eacb4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.891038 master-0 kubenswrapper[35367]: I1204 12:09:17.890383 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5113c857-78d3-4133-82de-5e28735eacb4-config-out\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.891159 master-0 kubenswrapper[35367]: I1204 12:09:17.891036 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5113c857-78d3-4133-82de-5e28735eacb4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.891203 master-0 kubenswrapper[35367]: I1204 12:09:17.884295 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5113c857-78d3-4133-82de-5e28735eacb4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.895142 master-0 kubenswrapper[35367]: I1204 12:09:17.894702 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5113c857-78d3-4133-82de-5e28735eacb4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.907496 master-0 kubenswrapper[35367]: I1204 12:09:17.907444 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8tsm\" (UniqueName: \"kubernetes.io/projected/5113c857-78d3-4133-82de-5e28735eacb4-kube-api-access-c8tsm\") pod \"alertmanager-main-0\" (UID: \"5113c857-78d3-4133-82de-5e28735eacb4\") " pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:17.942513 master-0 kubenswrapper[35367]: I1204 12:09:17.942441 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Dec 04 12:09:18.055193 master-0 kubenswrapper[35367]: I1204 12:09:18.052261 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zjmf2" event={"ID":"31422ce2-eae5-47fb-9c8b-7a77caa95696","Type":"ContainerStarted","Data":"a4f1224236144b6c7ea4099d4c5ee862fd897de816a6a8ef813fcf86f4e8b32e"} Dec 04 12:09:18.082958 master-0 kubenswrapper[35367]: I1204 12:09:18.079543 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-zjmf2" podStartSLOduration=2.620317019 podStartE2EDuration="8.079526227s" podCreationTimestamp="2025-12-04 12:09:10 +0000 UTC" firstStartedPulling="2025-12-04 12:09:11.924383426 +0000 UTC m=+595.362444684" lastFinishedPulling="2025-12-04 12:09:17.383592634 +0000 UTC m=+600.821653892" observedRunningTime="2025-12-04 12:09:18.079382683 +0000 UTC m=+601.517443941" watchObservedRunningTime="2025-12-04 12:09:18.079526227 +0000 UTC m=+601.517587485" Dec 04 12:09:18.091310 master-0 kubenswrapper[35367]: I1204 12:09:18.091208 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-g7j5b" Dec 04 12:09:18.109494 master-0 kubenswrapper[35367]: I1204 12:09:18.109427 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-rq9mp" Dec 04 12:09:18.392018 master-0 kubenswrapper[35367]: I1204 12:09:18.391511 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-g7j5b"] Dec 04 12:09:18.405167 master-0 kubenswrapper[35367]: I1204 12:09:18.405110 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Dec 04 12:09:18.464536 master-0 kubenswrapper[35367]: I1204 12:09:18.464414 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-rxp4h" podUID="78de4935-3e4c-4f6f-bbb5-d592c35b47da" containerName="registry-server" probeResult="failure" output=< Dec 04 12:09:18.464536 master-0 kubenswrapper[35367]: timeout: failed to connect service ":50051" within 1s Dec 04 12:09:18.464536 master-0 kubenswrapper[35367]: > Dec 04 12:09:18.762214 master-0 kubenswrapper[35367]: I1204 12:09:18.762068 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a39b763e-1e11-489e-bfef-df396e96d6b8" path="/var/lib/kubelet/pods/a39b763e-1e11-489e-bfef-df396e96d6b8/volumes" Dec 04 12:09:19.061337 master-0 kubenswrapper[35367]: I1204 12:09:19.061262 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5113c857-78d3-4133-82de-5e28735eacb4","Type":"ContainerStarted","Data":"573cd306aec1e80bae3dd0a1e8814dcc2aa23de6857c5f8a1bb902a8f04d3e31"} Dec 04 12:09:19.061337 master-0 kubenswrapper[35367]: I1204 12:09:19.061335 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5113c857-78d3-4133-82de-5e28735eacb4","Type":"ContainerStarted","Data":"95fd8c4fabd938924fa6a8d767ea74bf90865915af34ed58a0c98ca04f1a480b"} Dec 04 12:09:19.064459 master-0 kubenswrapper[35367]: I1204 12:09:19.064379 35367 generic.go:334] "Generic (PLEG): container finished" podID="bbe68aaa-bd9b-43b9-b465-fb0c09484c64" containerID="d2fb9cc22b303926bc6b95efabbdcb1df03c7e5489e2ca96b6193492ec49a932" exitCode=0 Dec 04 12:09:19.064738 master-0 kubenswrapper[35367]: I1204 12:09:19.064477 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-ndng9" event={"ID":"bbe68aaa-bd9b-43b9-b465-fb0c09484c64","Type":"ContainerDied","Data":"d2fb9cc22b303926bc6b95efabbdcb1df03c7e5489e2ca96b6193492ec49a932"} Dec 04 12:09:19.066574 master-0 kubenswrapper[35367]: I1204 12:09:19.066527 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-g7j5b" event={"ID":"46967266-5366-4e53-9c4d-9575e02846cb","Type":"ContainerStarted","Data":"7d278d144ed717e636022cd2338cd424ceeb91e9836765fbc7ad8a10b2dc1694"} Dec 04 12:09:20.084894 master-0 kubenswrapper[35367]: I1204 12:09:20.084736 35367 generic.go:334] "Generic (PLEG): container finished" podID="46967266-5366-4e53-9c4d-9575e02846cb" containerID="bce8e1e916fdd0eba6d72fd0da23146eebd0364aa97651c210b7b133c583d3dd" exitCode=0 Dec 04 12:09:20.084894 master-0 kubenswrapper[35367]: I1204 12:09:20.084840 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-g7j5b" event={"ID":"46967266-5366-4e53-9c4d-9575e02846cb","Type":"ContainerDied","Data":"bce8e1e916fdd0eba6d72fd0da23146eebd0364aa97651c210b7b133c583d3dd"} Dec 04 12:09:20.711266 master-0 kubenswrapper[35367]: I1204 12:09:20.711192 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-zjmf2" Dec 04 12:09:20.711266 master-0 kubenswrapper[35367]: I1204 12:09:20.711271 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-zjmf2" Dec 04 12:09:20.756530 master-0 kubenswrapper[35367]: I1204 12:09:20.756484 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-zjmf2" Dec 04 12:09:20.915381 master-0 kubenswrapper[35367]: I1204 12:09:20.913550 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-7j7ql"] Dec 04 12:09:20.921833 master-0 kubenswrapper[35367]: I1204 12:09:20.915829 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-7j7ql" Dec 04 12:09:20.970382 master-0 kubenswrapper[35367]: I1204 12:09:20.970285 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-7j7ql"] Dec 04 12:09:20.970854 master-0 kubenswrapper[35367]: I1204 12:09:20.970766 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc6sr\" (UniqueName: \"kubernetes.io/projected/1cdce2be-c255-424e-8da3-7665cc617e32-kube-api-access-tc6sr\") pod \"redhat-marketplace-7j7ql\" (UID: \"1cdce2be-c255-424e-8da3-7665cc617e32\") " pod="openshift-marketplace/redhat-marketplace-7j7ql" Dec 04 12:09:20.970854 master-0 kubenswrapper[35367]: I1204 12:09:20.970838 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1cdce2be-c255-424e-8da3-7665cc617e32-utilities\") pod \"redhat-marketplace-7j7ql\" (UID: \"1cdce2be-c255-424e-8da3-7665cc617e32\") " pod="openshift-marketplace/redhat-marketplace-7j7ql" Dec 04 12:09:20.971159 master-0 kubenswrapper[35367]: I1204 12:09:20.970929 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1cdce2be-c255-424e-8da3-7665cc617e32-catalog-content\") pod \"redhat-marketplace-7j7ql\" (UID: \"1cdce2be-c255-424e-8da3-7665cc617e32\") " pod="openshift-marketplace/redhat-marketplace-7j7ql" Dec 04 12:09:21.075162 master-0 kubenswrapper[35367]: I1204 12:09:21.075100 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tc6sr\" (UniqueName: \"kubernetes.io/projected/1cdce2be-c255-424e-8da3-7665cc617e32-kube-api-access-tc6sr\") pod \"redhat-marketplace-7j7ql\" (UID: \"1cdce2be-c255-424e-8da3-7665cc617e32\") " pod="openshift-marketplace/redhat-marketplace-7j7ql" Dec 04 12:09:21.075368 master-0 kubenswrapper[35367]: I1204 12:09:21.075174 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1cdce2be-c255-424e-8da3-7665cc617e32-utilities\") pod \"redhat-marketplace-7j7ql\" (UID: \"1cdce2be-c255-424e-8da3-7665cc617e32\") " pod="openshift-marketplace/redhat-marketplace-7j7ql" Dec 04 12:09:21.075368 master-0 kubenswrapper[35367]: I1204 12:09:21.075249 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1cdce2be-c255-424e-8da3-7665cc617e32-catalog-content\") pod \"redhat-marketplace-7j7ql\" (UID: \"1cdce2be-c255-424e-8da3-7665cc617e32\") " pod="openshift-marketplace/redhat-marketplace-7j7ql" Dec 04 12:09:21.075977 master-0 kubenswrapper[35367]: I1204 12:09:21.075948 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1cdce2be-c255-424e-8da3-7665cc617e32-catalog-content\") pod \"redhat-marketplace-7j7ql\" (UID: \"1cdce2be-c255-424e-8da3-7665cc617e32\") " pod="openshift-marketplace/redhat-marketplace-7j7ql" Dec 04 12:09:21.076343 master-0 kubenswrapper[35367]: I1204 12:09:21.076315 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1cdce2be-c255-424e-8da3-7665cc617e32-utilities\") pod \"redhat-marketplace-7j7ql\" (UID: \"1cdce2be-c255-424e-8da3-7665cc617e32\") " pod="openshift-marketplace/redhat-marketplace-7j7ql" Dec 04 12:09:21.094115 master-0 kubenswrapper[35367]: I1204 12:09:21.094065 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc6sr\" (UniqueName: \"kubernetes.io/projected/1cdce2be-c255-424e-8da3-7665cc617e32-kube-api-access-tc6sr\") pod \"redhat-marketplace-7j7ql\" (UID: \"1cdce2be-c255-424e-8da3-7665cc617e32\") " pod="openshift-marketplace/redhat-marketplace-7j7ql" Dec 04 12:09:21.099650 master-0 kubenswrapper[35367]: I1204 12:09:21.099601 35367 generic.go:334] "Generic (PLEG): container finished" podID="5113c857-78d3-4133-82de-5e28735eacb4" containerID="573cd306aec1e80bae3dd0a1e8814dcc2aa23de6857c5f8a1bb902a8f04d3e31" exitCode=0 Dec 04 12:09:21.099740 master-0 kubenswrapper[35367]: I1204 12:09:21.099691 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5113c857-78d3-4133-82de-5e28735eacb4","Type":"ContainerDied","Data":"573cd306aec1e80bae3dd0a1e8814dcc2aa23de6857c5f8a1bb902a8f04d3e31"} Dec 04 12:09:21.333050 master-0 kubenswrapper[35367]: I1204 12:09:21.332970 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-7j7ql" Dec 04 12:09:22.109633 master-0 kubenswrapper[35367]: I1204 12:09:22.109520 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5113c857-78d3-4133-82de-5e28735eacb4","Type":"ContainerStarted","Data":"20d39240913636f117aec02357dd742a08c3ca2063af324c6b623ee623c74e15"} Dec 04 12:09:22.112105 master-0 kubenswrapper[35367]: I1204 12:09:22.112061 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-ndng9" event={"ID":"bbe68aaa-bd9b-43b9-b465-fb0c09484c64","Type":"ContainerStarted","Data":"8e440fe2c7b2d0aa1f6471c74036b40b7f1b7b30eb51da7ee44fec643b7dd2b4"} Dec 04 12:09:22.263574 master-0 kubenswrapper[35367]: I1204 12:09:22.263517 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-p5ndf" Dec 04 12:09:22.306016 master-0 kubenswrapper[35367]: I1204 12:09:22.305967 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-p5ndf" Dec 04 12:09:23.031103 master-0 kubenswrapper[35367]: I1204 12:09:23.031023 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-7j7ql"] Dec 04 12:09:23.122593 master-0 kubenswrapper[35367]: I1204 12:09:23.122519 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-7j7ql" event={"ID":"1cdce2be-c255-424e-8da3-7665cc617e32","Type":"ContainerStarted","Data":"aa5fdd9a480678147c816766be6f77442a2f35817489611c109c1332c222f2c3"} Dec 04 12:09:23.321045 master-0 kubenswrapper[35367]: I1204 12:09:23.320987 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-fhdw5" Dec 04 12:09:23.361119 master-0 kubenswrapper[35367]: I1204 12:09:23.360996 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-ndng9" podStartSLOduration=5.498510707 podStartE2EDuration="9.360972112s" podCreationTimestamp="2025-12-04 12:09:14 +0000 UTC" firstStartedPulling="2025-12-04 12:09:17.015469654 +0000 UTC m=+600.453530912" lastFinishedPulling="2025-12-04 12:09:20.877931049 +0000 UTC m=+604.315992317" observedRunningTime="2025-12-04 12:09:23.353793606 +0000 UTC m=+606.791854864" watchObservedRunningTime="2025-12-04 12:09:23.360972112 +0000 UTC m=+606.799033370" Dec 04 12:09:23.622817 master-0 kubenswrapper[35367]: I1204 12:09:23.622572 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-2xqkk"] Dec 04 12:09:23.625546 master-0 kubenswrapper[35367]: I1204 12:09:23.625502 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-2xqkk" Dec 04 12:09:23.651610 master-0 kubenswrapper[35367]: I1204 12:09:23.651145 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-2xqkk"] Dec 04 12:09:23.751830 master-0 kubenswrapper[35367]: I1204 12:09:23.751500 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fbd8c7bd5-6tskd"] Dec 04 12:09:23.827096 master-0 kubenswrapper[35367]: I1204 12:09:23.817483 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.837175 master-0 kubenswrapper[35367]: I1204 12:09:23.836564 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvwhc\" (UniqueName: \"kubernetes.io/projected/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-kube-api-access-bvwhc\") pod \"console-6fbd8c7bd5-6tskd\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.837175 master-0 kubenswrapper[35367]: I1204 12:09:23.836774 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-console-serving-cert\") pod \"console-6fbd8c7bd5-6tskd\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.837175 master-0 kubenswrapper[35367]: I1204 12:09:23.836933 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/281cfff8-9bcf-4722-a10a-7872455a391f-catalog-content\") pod \"redhat-marketplace-2xqkk\" (UID: \"281cfff8-9bcf-4722-a10a-7872455a391f\") " pod="openshift-marketplace/redhat-marketplace-2xqkk" Dec 04 12:09:23.837175 master-0 kubenswrapper[35367]: I1204 12:09:23.837026 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-service-ca\") pod \"console-6fbd8c7bd5-6tskd\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.837175 master-0 kubenswrapper[35367]: I1204 12:09:23.837157 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-console-config\") pod \"console-6fbd8c7bd5-6tskd\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.837175 master-0 kubenswrapper[35367]: I1204 12:09:23.837190 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-console-oauth-config\") pod \"console-6fbd8c7bd5-6tskd\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.837475 master-0 kubenswrapper[35367]: I1204 12:09:23.837229 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/281cfff8-9bcf-4722-a10a-7872455a391f-utilities\") pod \"redhat-marketplace-2xqkk\" (UID: \"281cfff8-9bcf-4722-a10a-7872455a391f\") " pod="openshift-marketplace/redhat-marketplace-2xqkk" Dec 04 12:09:23.839295 master-0 kubenswrapper[35367]: I1204 12:09:23.838406 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wql8v\" (UniqueName: \"kubernetes.io/projected/281cfff8-9bcf-4722-a10a-7872455a391f-kube-api-access-wql8v\") pod \"redhat-marketplace-2xqkk\" (UID: \"281cfff8-9bcf-4722-a10a-7872455a391f\") " pod="openshift-marketplace/redhat-marketplace-2xqkk" Dec 04 12:09:23.839295 master-0 kubenswrapper[35367]: I1204 12:09:23.838467 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-trusted-ca-bundle\") pod \"console-6fbd8c7bd5-6tskd\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.839295 master-0 kubenswrapper[35367]: I1204 12:09:23.838509 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-oauth-serving-cert\") pod \"console-6fbd8c7bd5-6tskd\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.845473 master-0 kubenswrapper[35367]: I1204 12:09:23.843373 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fbd8c7bd5-6tskd"] Dec 04 12:09:23.940852 master-0 kubenswrapper[35367]: I1204 12:09:23.940770 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wql8v\" (UniqueName: \"kubernetes.io/projected/281cfff8-9bcf-4722-a10a-7872455a391f-kube-api-access-wql8v\") pod \"redhat-marketplace-2xqkk\" (UID: \"281cfff8-9bcf-4722-a10a-7872455a391f\") " pod="openshift-marketplace/redhat-marketplace-2xqkk" Dec 04 12:09:23.940984 master-0 kubenswrapper[35367]: I1204 12:09:23.940855 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-trusted-ca-bundle\") pod \"console-6fbd8c7bd5-6tskd\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.940984 master-0 kubenswrapper[35367]: I1204 12:09:23.940901 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-oauth-serving-cert\") pod \"console-6fbd8c7bd5-6tskd\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.941189 master-0 kubenswrapper[35367]: I1204 12:09:23.940980 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bvwhc\" (UniqueName: \"kubernetes.io/projected/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-kube-api-access-bvwhc\") pod \"console-6fbd8c7bd5-6tskd\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.941189 master-0 kubenswrapper[35367]: I1204 12:09:23.941067 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-console-serving-cert\") pod \"console-6fbd8c7bd5-6tskd\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.941189 master-0 kubenswrapper[35367]: I1204 12:09:23.941130 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/281cfff8-9bcf-4722-a10a-7872455a391f-catalog-content\") pod \"redhat-marketplace-2xqkk\" (UID: \"281cfff8-9bcf-4722-a10a-7872455a391f\") " pod="openshift-marketplace/redhat-marketplace-2xqkk" Dec 04 12:09:23.941326 master-0 kubenswrapper[35367]: I1204 12:09:23.941227 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-service-ca\") pod \"console-6fbd8c7bd5-6tskd\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.941326 master-0 kubenswrapper[35367]: I1204 12:09:23.941305 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-console-config\") pod \"console-6fbd8c7bd5-6tskd\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.941404 master-0 kubenswrapper[35367]: I1204 12:09:23.941338 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-console-oauth-config\") pod \"console-6fbd8c7bd5-6tskd\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.941404 master-0 kubenswrapper[35367]: I1204 12:09:23.941372 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/281cfff8-9bcf-4722-a10a-7872455a391f-utilities\") pod \"redhat-marketplace-2xqkk\" (UID: \"281cfff8-9bcf-4722-a10a-7872455a391f\") " pod="openshift-marketplace/redhat-marketplace-2xqkk" Dec 04 12:09:23.941997 master-0 kubenswrapper[35367]: I1204 12:09:23.941953 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-oauth-serving-cert\") pod \"console-6fbd8c7bd5-6tskd\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.942069 master-0 kubenswrapper[35367]: I1204 12:09:23.942050 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/281cfff8-9bcf-4722-a10a-7872455a391f-utilities\") pod \"redhat-marketplace-2xqkk\" (UID: \"281cfff8-9bcf-4722-a10a-7872455a391f\") " pod="openshift-marketplace/redhat-marketplace-2xqkk" Dec 04 12:09:23.942574 master-0 kubenswrapper[35367]: I1204 12:09:23.942524 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-trusted-ca-bundle\") pod \"console-6fbd8c7bd5-6tskd\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.942985 master-0 kubenswrapper[35367]: I1204 12:09:23.942954 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/281cfff8-9bcf-4722-a10a-7872455a391f-catalog-content\") pod \"redhat-marketplace-2xqkk\" (UID: \"281cfff8-9bcf-4722-a10a-7872455a391f\") " pod="openshift-marketplace/redhat-marketplace-2xqkk" Dec 04 12:09:23.943327 master-0 kubenswrapper[35367]: I1204 12:09:23.943285 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-console-config\") pod \"console-6fbd8c7bd5-6tskd\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.946206 master-0 kubenswrapper[35367]: I1204 12:09:23.945544 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-service-ca\") pod \"console-6fbd8c7bd5-6tskd\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.946999 master-0 kubenswrapper[35367]: I1204 12:09:23.946954 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-console-oauth-config\") pod \"console-6fbd8c7bd5-6tskd\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.954274 master-0 kubenswrapper[35367]: I1204 12:09:23.954217 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-console-serving-cert\") pod \"console-6fbd8c7bd5-6tskd\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.968122 master-0 kubenswrapper[35367]: I1204 12:09:23.967923 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvwhc\" (UniqueName: \"kubernetes.io/projected/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-kube-api-access-bvwhc\") pod \"console-6fbd8c7bd5-6tskd\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:23.969782 master-0 kubenswrapper[35367]: I1204 12:09:23.969657 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wql8v\" (UniqueName: \"kubernetes.io/projected/281cfff8-9bcf-4722-a10a-7872455a391f-kube-api-access-wql8v\") pod \"redhat-marketplace-2xqkk\" (UID: \"281cfff8-9bcf-4722-a10a-7872455a391f\") " pod="openshift-marketplace/redhat-marketplace-2xqkk" Dec 04 12:09:24.086554 master-0 kubenswrapper[35367]: I1204 12:09:24.086175 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-2xqkk" Dec 04 12:09:24.134356 master-0 kubenswrapper[35367]: I1204 12:09:24.134294 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5113c857-78d3-4133-82de-5e28735eacb4","Type":"ContainerStarted","Data":"197dac006d2fca25417fce4ffff26b2bbd7c2abf61b75a0955b6f09a8c0cc811"} Dec 04 12:09:24.134356 master-0 kubenswrapper[35367]: I1204 12:09:24.134355 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5113c857-78d3-4133-82de-5e28735eacb4","Type":"ContainerStarted","Data":"55cb145c1d7f6cca5014ea9c322dad77af781f74ceb15820feafee624308de53"} Dec 04 12:09:24.134824 master-0 kubenswrapper[35367]: I1204 12:09:24.134368 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5113c857-78d3-4133-82de-5e28735eacb4","Type":"ContainerStarted","Data":"85a53508eb1b63db6093b95e4b66f56894937b8ce6965af75e7b5aa2e8ac8661"} Dec 04 12:09:24.135610 master-0 kubenswrapper[35367]: I1204 12:09:24.135577 35367 generic.go:334] "Generic (PLEG): container finished" podID="1cdce2be-c255-424e-8da3-7665cc617e32" containerID="6860b209617cb69aef392f1f3f953fe3d97d2a8790f9aa8d90f5ce26fdf39029" exitCode=0 Dec 04 12:09:24.135665 master-0 kubenswrapper[35367]: I1204 12:09:24.135646 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-7j7ql" event={"ID":"1cdce2be-c255-424e-8da3-7665cc617e32","Type":"ContainerDied","Data":"6860b209617cb69aef392f1f3f953fe3d97d2a8790f9aa8d90f5ce26fdf39029"} Dec 04 12:09:24.137693 master-0 kubenswrapper[35367]: I1204 12:09:24.137656 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-g7j5b" event={"ID":"46967266-5366-4e53-9c4d-9575e02846cb","Type":"ContainerStarted","Data":"d13e573f6ba1085dc6e76880131407aa69cb3887e24318480bcd5c4bf129fdac"} Dec 04 12:09:24.187445 master-0 kubenswrapper[35367]: I1204 12:09:24.187391 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:24.423855 master-0 kubenswrapper[35367]: I1204 12:09:24.423725 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-ndng9" Dec 04 12:09:24.424956 master-0 kubenswrapper[35367]: I1204 12:09:24.424924 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-ndng9" Dec 04 12:09:24.473679 master-0 kubenswrapper[35367]: I1204 12:09:24.473606 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-ndng9" Dec 04 12:09:24.716574 master-0 kubenswrapper[35367]: I1204 12:09:24.716518 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fbd8c7bd5-6tskd"] Dec 04 12:09:24.718842 master-0 kubenswrapper[35367]: W1204 12:09:24.718748 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b9d7941_a10b_469c_bbf1_8895bd1d5a65.slice/crio-ef04064de3a01bec26a7e66b65fd0a2cc02b3c795d73dc9d0253699f711db800 WatchSource:0}: Error finding container ef04064de3a01bec26a7e66b65fd0a2cc02b3c795d73dc9d0253699f711db800: Status 404 returned error can't find the container with id ef04064de3a01bec26a7e66b65fd0a2cc02b3c795d73dc9d0253699f711db800 Dec 04 12:09:24.737086 master-0 kubenswrapper[35367]: W1204 12:09:24.736959 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod281cfff8_9bcf_4722_a10a_7872455a391f.slice/crio-ff07b571c7d7f220b388132ab36e3437e0604c73d6d05ea1fc689e6735e03eac WatchSource:0}: Error finding container ff07b571c7d7f220b388132ab36e3437e0604c73d6d05ea1fc689e6735e03eac: Status 404 returned error can't find the container with id ff07b571c7d7f220b388132ab36e3437e0604c73d6d05ea1fc689e6735e03eac Dec 04 12:09:24.741706 master-0 kubenswrapper[35367]: I1204 12:09:24.741670 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-2xqkk"] Dec 04 12:09:25.149681 master-0 kubenswrapper[35367]: I1204 12:09:25.149534 35367 generic.go:334] "Generic (PLEG): container finished" podID="281cfff8-9bcf-4722-a10a-7872455a391f" containerID="f5ec9ebe89d57ca803e23dce19c118023e4b418032315c6a8d863fc68b85b2f8" exitCode=0 Dec 04 12:09:25.150273 master-0 kubenswrapper[35367]: I1204 12:09:25.149853 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-2xqkk" event={"ID":"281cfff8-9bcf-4722-a10a-7872455a391f","Type":"ContainerDied","Data":"f5ec9ebe89d57ca803e23dce19c118023e4b418032315c6a8d863fc68b85b2f8"} Dec 04 12:09:25.150273 master-0 kubenswrapper[35367]: I1204 12:09:25.149925 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-2xqkk" event={"ID":"281cfff8-9bcf-4722-a10a-7872455a391f","Type":"ContainerStarted","Data":"ff07b571c7d7f220b388132ab36e3437e0604c73d6d05ea1fc689e6735e03eac"} Dec 04 12:09:25.152885 master-0 kubenswrapper[35367]: I1204 12:09:25.152778 35367 generic.go:334] "Generic (PLEG): container finished" podID="46967266-5366-4e53-9c4d-9575e02846cb" containerID="d13e573f6ba1085dc6e76880131407aa69cb3887e24318480bcd5c4bf129fdac" exitCode=0 Dec 04 12:09:25.153008 master-0 kubenswrapper[35367]: I1204 12:09:25.152932 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-g7j5b" event={"ID":"46967266-5366-4e53-9c4d-9575e02846cb","Type":"ContainerDied","Data":"d13e573f6ba1085dc6e76880131407aa69cb3887e24318480bcd5c4bf129fdac"} Dec 04 12:09:25.167419 master-0 kubenswrapper[35367]: I1204 12:09:25.165791 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5113c857-78d3-4133-82de-5e28735eacb4","Type":"ContainerStarted","Data":"333d0aef43a2de6f27edffb1f2f114b1f10ce6c4b27dacc83ab17d5029cab7a2"} Dec 04 12:09:25.167419 master-0 kubenswrapper[35367]: I1204 12:09:25.165863 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5113c857-78d3-4133-82de-5e28735eacb4","Type":"ContainerStarted","Data":"f954060a5d3d750b25ab284173efcee7278ea6a9859520b0a67681209229d968"} Dec 04 12:09:25.173023 master-0 kubenswrapper[35367]: I1204 12:09:25.172953 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbd8c7bd5-6tskd" event={"ID":"3b9d7941-a10b-469c-bbf1-8895bd1d5a65","Type":"ContainerStarted","Data":"aaba0473e24336416ab8398217fa5ab49bab5230f59b655b2eb87ae0b8988225"} Dec 04 12:09:25.173165 master-0 kubenswrapper[35367]: I1204 12:09:25.173033 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbd8c7bd5-6tskd" event={"ID":"3b9d7941-a10b-469c-bbf1-8895bd1d5a65","Type":"ContainerStarted","Data":"ef04064de3a01bec26a7e66b65fd0a2cc02b3c795d73dc9d0253699f711db800"} Dec 04 12:09:25.200720 master-0 kubenswrapper[35367]: I1204 12:09:25.200623 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6fbd8c7bd5-6tskd" podStartSLOduration=2.200574623 podStartE2EDuration="2.200574623s" podCreationTimestamp="2025-12-04 12:09:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:09:25.198127016 +0000 UTC m=+608.636188274" watchObservedRunningTime="2025-12-04 12:09:25.200574623 +0000 UTC m=+608.638635881" Dec 04 12:09:25.243532 master-0 kubenswrapper[35367]: I1204 12:09:25.243427 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.24340507 podStartE2EDuration="8.24340507s" podCreationTimestamp="2025-12-04 12:09:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:09:25.238707103 +0000 UTC m=+608.676768371" watchObservedRunningTime="2025-12-04 12:09:25.24340507 +0000 UTC m=+608.681466328" Dec 04 12:09:26.189639 master-0 kubenswrapper[35367]: I1204 12:09:26.189509 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-2xqkk" event={"ID":"281cfff8-9bcf-4722-a10a-7872455a391f","Type":"ContainerStarted","Data":"02344c553addbb55afd0589f27651413b9628370d880b30e6fe81db6b594d50e"} Dec 04 12:09:26.192389 master-0 kubenswrapper[35367]: I1204 12:09:26.192334 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-g7j5b" event={"ID":"46967266-5366-4e53-9c4d-9575e02846cb","Type":"ContainerStarted","Data":"b04fc8a08a419e6a27f02b0eb896686273020f4e382cc89c134f0f0c507dd793"} Dec 04 12:09:26.201892 master-0 kubenswrapper[35367]: I1204 12:09:26.201190 35367 generic.go:334] "Generic (PLEG): container finished" podID="1cdce2be-c255-424e-8da3-7665cc617e32" containerID="402e03d57697609d3b01efaf0af0e1c611d8547e9b1a425f786da714860851b7" exitCode=0 Dec 04 12:09:26.201892 master-0 kubenswrapper[35367]: I1204 12:09:26.201522 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-7j7ql" event={"ID":"1cdce2be-c255-424e-8da3-7665cc617e32","Type":"ContainerDied","Data":"402e03d57697609d3b01efaf0af0e1c611d8547e9b1a425f786da714860851b7"} Dec 04 12:09:26.264259 master-0 kubenswrapper[35367]: I1204 12:09:26.264204 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-ndng9" Dec 04 12:09:26.281507 master-0 kubenswrapper[35367]: I1204 12:09:26.281124 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-g7j5b" podStartSLOduration=4.832712446 podStartE2EDuration="9.281104414s" podCreationTimestamp="2025-12-04 12:09:17 +0000 UTC" firstStartedPulling="2025-12-04 12:09:21.106315205 +0000 UTC m=+604.544376463" lastFinishedPulling="2025-12-04 12:09:25.554707173 +0000 UTC m=+608.992768431" observedRunningTime="2025-12-04 12:09:26.275639062 +0000 UTC m=+609.713700320" watchObservedRunningTime="2025-12-04 12:09:26.281104414 +0000 UTC m=+609.719165662" Dec 04 12:09:27.210237 master-0 kubenswrapper[35367]: I1204 12:09:27.210178 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-7j7ql" event={"ID":"1cdce2be-c255-424e-8da3-7665cc617e32","Type":"ContainerStarted","Data":"d445fc59dd070294732be621499138e18dc0f2b923b2554aebf34d4b80035e33"} Dec 04 12:09:27.212766 master-0 kubenswrapper[35367]: I1204 12:09:27.212721 35367 generic.go:334] "Generic (PLEG): container finished" podID="281cfff8-9bcf-4722-a10a-7872455a391f" containerID="02344c553addbb55afd0589f27651413b9628370d880b30e6fe81db6b594d50e" exitCode=0 Dec 04 12:09:27.212921 master-0 kubenswrapper[35367]: I1204 12:09:27.212852 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-2xqkk" event={"ID":"281cfff8-9bcf-4722-a10a-7872455a391f","Type":"ContainerDied","Data":"02344c553addbb55afd0589f27651413b9628370d880b30e6fe81db6b594d50e"} Dec 04 12:09:27.237895 master-0 kubenswrapper[35367]: I1204 12:09:27.237789 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-7j7ql" podStartSLOduration=4.757411411 podStartE2EDuration="7.237768599s" podCreationTimestamp="2025-12-04 12:09:20 +0000 UTC" firstStartedPulling="2025-12-04 12:09:24.137127048 +0000 UTC m=+607.575188306" lastFinishedPulling="2025-12-04 12:09:26.617484236 +0000 UTC m=+610.055545494" observedRunningTime="2025-12-04 12:09:27.234721564 +0000 UTC m=+610.672782832" watchObservedRunningTime="2025-12-04 12:09:27.237768599 +0000 UTC m=+610.675829867" Dec 04 12:09:27.459533 master-0 kubenswrapper[35367]: I1204 12:09:27.459475 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-rxp4h" Dec 04 12:09:27.510879 master-0 kubenswrapper[35367]: I1204 12:09:27.510759 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-rxp4h" Dec 04 12:09:28.091545 master-0 kubenswrapper[35367]: I1204 12:09:28.091360 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-g7j5b" Dec 04 12:09:28.091822 master-0 kubenswrapper[35367]: I1204 12:09:28.091698 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-g7j5b" Dec 04 12:09:28.134120 master-0 kubenswrapper[35367]: I1204 12:09:28.134066 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-g7j5b" Dec 04 12:09:28.229583 master-0 kubenswrapper[35367]: I1204 12:09:28.229521 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-2xqkk" event={"ID":"281cfff8-9bcf-4722-a10a-7872455a391f","Type":"ContainerStarted","Data":"d483209b49df2261128c9b7363923bbf4a7173d8b0c3e987365e70c03960b49d"} Dec 04 12:09:28.257103 master-0 kubenswrapper[35367]: I1204 12:09:28.256993 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-2xqkk" podStartSLOduration=2.81309342 podStartE2EDuration="5.256966341s" podCreationTimestamp="2025-12-04 12:09:23 +0000 UTC" firstStartedPulling="2025-12-04 12:09:25.151257211 +0000 UTC m=+608.589318469" lastFinishedPulling="2025-12-04 12:09:27.595130132 +0000 UTC m=+611.033191390" observedRunningTime="2025-12-04 12:09:28.2524625 +0000 UTC m=+611.690523778" watchObservedRunningTime="2025-12-04 12:09:28.256966341 +0000 UTC m=+611.695027599" Dec 04 12:09:29.807434 master-0 kubenswrapper[35367]: I1204 12:09:29.806382 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-gzs5w"] Dec 04 12:09:29.807434 master-0 kubenswrapper[35367]: I1204 12:09:29.806687 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-gzs5w" podUID="14fef399-4e8f-4867-ace9-3b273117f886" containerName="registry-server" containerID="cri-o://80075ccf80a901ff3c2063889175ff290fa865853a873b055cff5eba73a5b2bf" gracePeriod=2 Dec 04 12:09:30.160433 master-0 kubenswrapper[35367]: I1204 12:09:30.158551 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-b7n8z"] Dec 04 12:09:30.160433 master-0 kubenswrapper[35367]: I1204 12:09:30.159215 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-b7n8z" podUID="6b275f26-6d4a-40a3-8dee-c58ae09c0263" containerName="registry-server" containerID="cri-o://5a264c088920fd153fd77df50068fc4860d60ab25b9c5b9d2310b10e10ea96b2" gracePeriod=2 Dec 04 12:09:30.248974 master-0 kubenswrapper[35367]: I1204 12:09:30.248905 35367 generic.go:334] "Generic (PLEG): container finished" podID="14fef399-4e8f-4867-ace9-3b273117f886" containerID="80075ccf80a901ff3c2063889175ff290fa865853a873b055cff5eba73a5b2bf" exitCode=0 Dec 04 12:09:30.248974 master-0 kubenswrapper[35367]: I1204 12:09:30.248951 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-gzs5w" event={"ID":"14fef399-4e8f-4867-ace9-3b273117f886","Type":"ContainerDied","Data":"80075ccf80a901ff3c2063889175ff290fa865853a873b055cff5eba73a5b2bf"} Dec 04 12:09:30.249452 master-0 kubenswrapper[35367]: I1204 12:09:30.249214 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-gzs5w" event={"ID":"14fef399-4e8f-4867-ace9-3b273117f886","Type":"ContainerDied","Data":"71ccdfd0f9f95b32e09489ae5a58c9134e27c8cb9e22165d5705f1ccacccb445"} Dec 04 12:09:30.249452 master-0 kubenswrapper[35367]: I1204 12:09:30.249259 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71ccdfd0f9f95b32e09489ae5a58c9134e27c8cb9e22165d5705f1ccacccb445" Dec 04 12:09:30.360111 master-0 kubenswrapper[35367]: I1204 12:09:30.360059 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-gzs5w" Dec 04 12:09:30.481749 master-0 kubenswrapper[35367]: I1204 12:09:30.481507 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/14fef399-4e8f-4867-ace9-3b273117f886-utilities\") pod \"14fef399-4e8f-4867-ace9-3b273117f886\" (UID: \"14fef399-4e8f-4867-ace9-3b273117f886\") " Dec 04 12:09:30.481749 master-0 kubenswrapper[35367]: I1204 12:09:30.481725 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/14fef399-4e8f-4867-ace9-3b273117f886-catalog-content\") pod \"14fef399-4e8f-4867-ace9-3b273117f886\" (UID: \"14fef399-4e8f-4867-ace9-3b273117f886\") " Dec 04 12:09:30.482056 master-0 kubenswrapper[35367]: I1204 12:09:30.481853 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqh49\" (UniqueName: \"kubernetes.io/projected/14fef399-4e8f-4867-ace9-3b273117f886-kube-api-access-xqh49\") pod \"14fef399-4e8f-4867-ace9-3b273117f886\" (UID: \"14fef399-4e8f-4867-ace9-3b273117f886\") " Dec 04 12:09:30.482959 master-0 kubenswrapper[35367]: I1204 12:09:30.482903 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14fef399-4e8f-4867-ace9-3b273117f886-utilities" (OuterVolumeSpecName: "utilities") pod "14fef399-4e8f-4867-ace9-3b273117f886" (UID: "14fef399-4e8f-4867-ace9-3b273117f886"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:30.485060 master-0 kubenswrapper[35367]: I1204 12:09:30.485015 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14fef399-4e8f-4867-ace9-3b273117f886-kube-api-access-xqh49" (OuterVolumeSpecName: "kube-api-access-xqh49") pod "14fef399-4e8f-4867-ace9-3b273117f886" (UID: "14fef399-4e8f-4867-ace9-3b273117f886"). InnerVolumeSpecName "kube-api-access-xqh49". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:30.584285 master-0 kubenswrapper[35367]: I1204 12:09:30.584183 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/14fef399-4e8f-4867-ace9-3b273117f886-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:30.584285 master-0 kubenswrapper[35367]: I1204 12:09:30.584243 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xqh49\" (UniqueName: \"kubernetes.io/projected/14fef399-4e8f-4867-ace9-3b273117f886-kube-api-access-xqh49\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:30.586355 master-0 kubenswrapper[35367]: I1204 12:09:30.586317 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14fef399-4e8f-4867-ace9-3b273117f886-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "14fef399-4e8f-4867-ace9-3b273117f886" (UID: "14fef399-4e8f-4867-ace9-3b273117f886"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:30.692346 master-0 kubenswrapper[35367]: I1204 12:09:30.688372 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/14fef399-4e8f-4867-ace9-3b273117f886-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:30.697954 master-0 kubenswrapper[35367]: I1204 12:09:30.697883 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-jjfcc"] Dec 04 12:09:30.698259 master-0 kubenswrapper[35367]: I1204 12:09:30.698205 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-jjfcc" podUID="414ce51b-cd2f-4311-96e0-bd80fb0ae666" containerName="registry-server" containerID="cri-o://a95164cc8a270d05de9b2a69a6848239d05c00d5a41a825cf74d7ee6fb1794aa" gracePeriod=2 Dec 04 12:09:30.720505 master-0 kubenswrapper[35367]: I1204 12:09:30.720416 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-p5ndf"] Dec 04 12:09:30.723901 master-0 kubenswrapper[35367]: I1204 12:09:30.720748 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-p5ndf" podUID="0ed2adcc-5493-4adc-ad40-40df2b8dbd2d" containerName="registry-server" containerID="cri-o://50e4aba05a5634a6aa93e16728c33a772797be815d298cbb9c41818ca8fa4710" gracePeriod=2 Dec 04 12:09:30.799390 master-0 kubenswrapper[35367]: I1204 12:09:30.799330 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-zjmf2" Dec 04 12:09:31.071148 master-0 kubenswrapper[35367]: I1204 12:09:31.071079 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-wgn8s"] Dec 04 12:09:31.071869 master-0 kubenswrapper[35367]: I1204 12:09:31.071400 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-wgn8s" podUID="2297684c-a98b-441c-8913-b5e9f39a2570" containerName="registry-server" containerID="cri-o://67ca2c7d08b481fe515a75f9c4cd734d3a64a4b1aa833e7f445224197b4dbbad" gracePeriod=2 Dec 04 12:09:31.106181 master-0 kubenswrapper[35367]: I1204 12:09:31.105595 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-b7n8z" Dec 04 12:09:31.207184 master-0 kubenswrapper[35367]: I1204 12:09:31.207107 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96cdn\" (UniqueName: \"kubernetes.io/projected/6b275f26-6d4a-40a3-8dee-c58ae09c0263-kube-api-access-96cdn\") pod \"6b275f26-6d4a-40a3-8dee-c58ae09c0263\" (UID: \"6b275f26-6d4a-40a3-8dee-c58ae09c0263\") " Dec 04 12:09:31.207563 master-0 kubenswrapper[35367]: I1204 12:09:31.207531 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6b275f26-6d4a-40a3-8dee-c58ae09c0263-catalog-content\") pod \"6b275f26-6d4a-40a3-8dee-c58ae09c0263\" (UID: \"6b275f26-6d4a-40a3-8dee-c58ae09c0263\") " Dec 04 12:09:31.207710 master-0 kubenswrapper[35367]: I1204 12:09:31.207671 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6b275f26-6d4a-40a3-8dee-c58ae09c0263-utilities\") pod \"6b275f26-6d4a-40a3-8dee-c58ae09c0263\" (UID: \"6b275f26-6d4a-40a3-8dee-c58ae09c0263\") " Dec 04 12:09:31.208899 master-0 kubenswrapper[35367]: I1204 12:09:31.208778 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b275f26-6d4a-40a3-8dee-c58ae09c0263-utilities" (OuterVolumeSpecName: "utilities") pod "6b275f26-6d4a-40a3-8dee-c58ae09c0263" (UID: "6b275f26-6d4a-40a3-8dee-c58ae09c0263"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:31.211333 master-0 kubenswrapper[35367]: I1204 12:09:31.211256 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b275f26-6d4a-40a3-8dee-c58ae09c0263-kube-api-access-96cdn" (OuterVolumeSpecName: "kube-api-access-96cdn") pod "6b275f26-6d4a-40a3-8dee-c58ae09c0263" (UID: "6b275f26-6d4a-40a3-8dee-c58ae09c0263"). InnerVolumeSpecName "kube-api-access-96cdn". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:31.277039 master-0 kubenswrapper[35367]: I1204 12:09:31.276989 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-p5ndf" Dec 04 12:09:31.289309 master-0 kubenswrapper[35367]: I1204 12:09:31.289161 35367 generic.go:334] "Generic (PLEG): container finished" podID="6b275f26-6d4a-40a3-8dee-c58ae09c0263" containerID="5a264c088920fd153fd77df50068fc4860d60ab25b9c5b9d2310b10e10ea96b2" exitCode=0 Dec 04 12:09:31.289309 master-0 kubenswrapper[35367]: I1204 12:09:31.289284 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-b7n8z" event={"ID":"6b275f26-6d4a-40a3-8dee-c58ae09c0263","Type":"ContainerDied","Data":"5a264c088920fd153fd77df50068fc4860d60ab25b9c5b9d2310b10e10ea96b2"} Dec 04 12:09:31.289576 master-0 kubenswrapper[35367]: I1204 12:09:31.289336 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-b7n8z" event={"ID":"6b275f26-6d4a-40a3-8dee-c58ae09c0263","Type":"ContainerDied","Data":"75af2e9c043f5e8883884f2b10950069cac085e9c4ebd029a6b6ceffdabb1db1"} Dec 04 12:09:31.289576 master-0 kubenswrapper[35367]: I1204 12:09:31.289366 35367 scope.go:117] "RemoveContainer" containerID="5a264c088920fd153fd77df50068fc4860d60ab25b9c5b9d2310b10e10ea96b2" Dec 04 12:09:31.289576 master-0 kubenswrapper[35367]: I1204 12:09:31.289569 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-b7n8z" Dec 04 12:09:31.307426 master-0 kubenswrapper[35367]: I1204 12:09:31.306964 35367 generic.go:334] "Generic (PLEG): container finished" podID="2297684c-a98b-441c-8913-b5e9f39a2570" containerID="67ca2c7d08b481fe515a75f9c4cd734d3a64a4b1aa833e7f445224197b4dbbad" exitCode=0 Dec 04 12:09:31.307426 master-0 kubenswrapper[35367]: I1204 12:09:31.307045 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wgn8s" event={"ID":"2297684c-a98b-441c-8913-b5e9f39a2570","Type":"ContainerDied","Data":"67ca2c7d08b481fe515a75f9c4cd734d3a64a4b1aa833e7f445224197b4dbbad"} Dec 04 12:09:31.309293 master-0 kubenswrapper[35367]: I1204 12:09:31.308776 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0ed2adcc-5493-4adc-ad40-40df2b8dbd2d-catalog-content\") pod \"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d\" (UID: \"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d\") " Dec 04 12:09:31.309293 master-0 kubenswrapper[35367]: I1204 12:09:31.308890 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0ed2adcc-5493-4adc-ad40-40df2b8dbd2d-utilities\") pod \"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d\" (UID: \"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d\") " Dec 04 12:09:31.309293 master-0 kubenswrapper[35367]: I1204 12:09:31.308947 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6kp9\" (UniqueName: \"kubernetes.io/projected/0ed2adcc-5493-4adc-ad40-40df2b8dbd2d-kube-api-access-k6kp9\") pod \"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d\" (UID: \"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d\") " Dec 04 12:09:31.309728 master-0 kubenswrapper[35367]: I1204 12:09:31.309491 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6b275f26-6d4a-40a3-8dee-c58ae09c0263-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:31.309728 master-0 kubenswrapper[35367]: I1204 12:09:31.309522 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-96cdn\" (UniqueName: \"kubernetes.io/projected/6b275f26-6d4a-40a3-8dee-c58ae09c0263-kube-api-access-96cdn\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:31.310708 master-0 kubenswrapper[35367]: I1204 12:09:31.310542 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ed2adcc-5493-4adc-ad40-40df2b8dbd2d-utilities" (OuterVolumeSpecName: "utilities") pod "0ed2adcc-5493-4adc-ad40-40df2b8dbd2d" (UID: "0ed2adcc-5493-4adc-ad40-40df2b8dbd2d"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:31.316876 master-0 kubenswrapper[35367]: I1204 12:09:31.314962 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ed2adcc-5493-4adc-ad40-40df2b8dbd2d-kube-api-access-k6kp9" (OuterVolumeSpecName: "kube-api-access-k6kp9") pod "0ed2adcc-5493-4adc-ad40-40df2b8dbd2d" (UID: "0ed2adcc-5493-4adc-ad40-40df2b8dbd2d"). InnerVolumeSpecName "kube-api-access-k6kp9". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:31.320489 master-0 kubenswrapper[35367]: I1204 12:09:31.320428 35367 generic.go:334] "Generic (PLEG): container finished" podID="0ed2adcc-5493-4adc-ad40-40df2b8dbd2d" containerID="50e4aba05a5634a6aa93e16728c33a772797be815d298cbb9c41818ca8fa4710" exitCode=0 Dec 04 12:09:31.320604 master-0 kubenswrapper[35367]: I1204 12:09:31.320576 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-p5ndf" event={"ID":"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d","Type":"ContainerDied","Data":"50e4aba05a5634a6aa93e16728c33a772797be815d298cbb9c41818ca8fa4710"} Dec 04 12:09:31.320652 master-0 kubenswrapper[35367]: I1204 12:09:31.320618 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-p5ndf" event={"ID":"0ed2adcc-5493-4adc-ad40-40df2b8dbd2d","Type":"ContainerDied","Data":"5f9fe19663db24efaf394121fb6f74da64ea57aae9fd157ee6c61bb16926bd94"} Dec 04 12:09:31.320730 master-0 kubenswrapper[35367]: I1204 12:09:31.320709 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-p5ndf" Dec 04 12:09:31.323723 master-0 kubenswrapper[35367]: I1204 12:09:31.323686 35367 scope.go:117] "RemoveContainer" containerID="7c64074f8b89aa532f2845a13e9a98b1e20319c1ab7fae7d16023a7bcf722c5e" Dec 04 12:09:31.325097 master-0 kubenswrapper[35367]: I1204 12:09:31.325045 35367 generic.go:334] "Generic (PLEG): container finished" podID="414ce51b-cd2f-4311-96e0-bd80fb0ae666" containerID="a95164cc8a270d05de9b2a69a6848239d05c00d5a41a825cf74d7ee6fb1794aa" exitCode=0 Dec 04 12:09:31.325164 master-0 kubenswrapper[35367]: I1204 12:09:31.325126 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-jjfcc" event={"ID":"414ce51b-cd2f-4311-96e0-bd80fb0ae666","Type":"ContainerDied","Data":"a95164cc8a270d05de9b2a69a6848239d05c00d5a41a825cf74d7ee6fb1794aa"} Dec 04 12:09:31.325206 master-0 kubenswrapper[35367]: I1204 12:09:31.325152 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-gzs5w" Dec 04 12:09:31.334586 master-0 kubenswrapper[35367]: I1204 12:09:31.334522 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-7j7ql" Dec 04 12:09:31.334586 master-0 kubenswrapper[35367]: I1204 12:09:31.334585 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-7j7ql" Dec 04 12:09:31.347281 master-0 kubenswrapper[35367]: I1204 12:09:31.347223 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-jjfcc" Dec 04 12:09:31.351936 master-0 kubenswrapper[35367]: I1204 12:09:31.351846 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b275f26-6d4a-40a3-8dee-c58ae09c0263-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "6b275f26-6d4a-40a3-8dee-c58ae09c0263" (UID: "6b275f26-6d4a-40a3-8dee-c58ae09c0263"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:31.389889 master-0 kubenswrapper[35367]: I1204 12:09:31.389670 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-7j7ql" Dec 04 12:09:31.398498 master-0 kubenswrapper[35367]: I1204 12:09:31.398451 35367 scope.go:117] "RemoveContainer" containerID="f3b0f3e1337d6375a84953a5f7055f8c2ca55a1c8f46b299bff3619f11fdfe3a" Dec 04 12:09:31.412498 master-0 kubenswrapper[35367]: I1204 12:09:31.410653 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/414ce51b-cd2f-4311-96e0-bd80fb0ae666-catalog-content\") pod \"414ce51b-cd2f-4311-96e0-bd80fb0ae666\" (UID: \"414ce51b-cd2f-4311-96e0-bd80fb0ae666\") " Dec 04 12:09:31.412498 master-0 kubenswrapper[35367]: I1204 12:09:31.411020 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmlrd\" (UniqueName: \"kubernetes.io/projected/414ce51b-cd2f-4311-96e0-bd80fb0ae666-kube-api-access-bmlrd\") pod \"414ce51b-cd2f-4311-96e0-bd80fb0ae666\" (UID: \"414ce51b-cd2f-4311-96e0-bd80fb0ae666\") " Dec 04 12:09:31.412498 master-0 kubenswrapper[35367]: I1204 12:09:31.411060 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/414ce51b-cd2f-4311-96e0-bd80fb0ae666-utilities\") pod \"414ce51b-cd2f-4311-96e0-bd80fb0ae666\" (UID: \"414ce51b-cd2f-4311-96e0-bd80fb0ae666\") " Dec 04 12:09:31.412498 master-0 kubenswrapper[35367]: I1204 12:09:31.411758 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6b275f26-6d4a-40a3-8dee-c58ae09c0263-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:31.412498 master-0 kubenswrapper[35367]: I1204 12:09:31.411775 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0ed2adcc-5493-4adc-ad40-40df2b8dbd2d-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:31.412498 master-0 kubenswrapper[35367]: I1204 12:09:31.411790 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-k6kp9\" (UniqueName: \"kubernetes.io/projected/0ed2adcc-5493-4adc-ad40-40df2b8dbd2d-kube-api-access-k6kp9\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:31.414076 master-0 kubenswrapper[35367]: I1204 12:09:31.414042 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/414ce51b-cd2f-4311-96e0-bd80fb0ae666-utilities" (OuterVolumeSpecName: "utilities") pod "414ce51b-cd2f-4311-96e0-bd80fb0ae666" (UID: "414ce51b-cd2f-4311-96e0-bd80fb0ae666"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:31.418782 master-0 kubenswrapper[35367]: I1204 12:09:31.418694 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/414ce51b-cd2f-4311-96e0-bd80fb0ae666-kube-api-access-bmlrd" (OuterVolumeSpecName: "kube-api-access-bmlrd") pod "414ce51b-cd2f-4311-96e0-bd80fb0ae666" (UID: "414ce51b-cd2f-4311-96e0-bd80fb0ae666"). InnerVolumeSpecName "kube-api-access-bmlrd". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:31.424921 master-0 kubenswrapper[35367]: I1204 12:09:31.424887 35367 scope.go:117] "RemoveContainer" containerID="5a264c088920fd153fd77df50068fc4860d60ab25b9c5b9d2310b10e10ea96b2" Dec 04 12:09:31.425332 master-0 kubenswrapper[35367]: E1204 12:09:31.425284 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a264c088920fd153fd77df50068fc4860d60ab25b9c5b9d2310b10e10ea96b2\": container with ID starting with 5a264c088920fd153fd77df50068fc4860d60ab25b9c5b9d2310b10e10ea96b2 not found: ID does not exist" containerID="5a264c088920fd153fd77df50068fc4860d60ab25b9c5b9d2310b10e10ea96b2" Dec 04 12:09:31.425411 master-0 kubenswrapper[35367]: I1204 12:09:31.425327 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a264c088920fd153fd77df50068fc4860d60ab25b9c5b9d2310b10e10ea96b2"} err="failed to get container status \"5a264c088920fd153fd77df50068fc4860d60ab25b9c5b9d2310b10e10ea96b2\": rpc error: code = NotFound desc = could not find container \"5a264c088920fd153fd77df50068fc4860d60ab25b9c5b9d2310b10e10ea96b2\": container with ID starting with 5a264c088920fd153fd77df50068fc4860d60ab25b9c5b9d2310b10e10ea96b2 not found: ID does not exist" Dec 04 12:09:31.425411 master-0 kubenswrapper[35367]: I1204 12:09:31.425357 35367 scope.go:117] "RemoveContainer" containerID="7c64074f8b89aa532f2845a13e9a98b1e20319c1ab7fae7d16023a7bcf722c5e" Dec 04 12:09:31.425972 master-0 kubenswrapper[35367]: E1204 12:09:31.425936 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c64074f8b89aa532f2845a13e9a98b1e20319c1ab7fae7d16023a7bcf722c5e\": container with ID starting with 7c64074f8b89aa532f2845a13e9a98b1e20319c1ab7fae7d16023a7bcf722c5e not found: ID does not exist" containerID="7c64074f8b89aa532f2845a13e9a98b1e20319c1ab7fae7d16023a7bcf722c5e" Dec 04 12:09:31.425972 master-0 kubenswrapper[35367]: I1204 12:09:31.425987 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c64074f8b89aa532f2845a13e9a98b1e20319c1ab7fae7d16023a7bcf722c5e"} err="failed to get container status \"7c64074f8b89aa532f2845a13e9a98b1e20319c1ab7fae7d16023a7bcf722c5e\": rpc error: code = NotFound desc = could not find container \"7c64074f8b89aa532f2845a13e9a98b1e20319c1ab7fae7d16023a7bcf722c5e\": container with ID starting with 7c64074f8b89aa532f2845a13e9a98b1e20319c1ab7fae7d16023a7bcf722c5e not found: ID does not exist" Dec 04 12:09:31.425972 master-0 kubenswrapper[35367]: I1204 12:09:31.426011 35367 scope.go:117] "RemoveContainer" containerID="f3b0f3e1337d6375a84953a5f7055f8c2ca55a1c8f46b299bff3619f11fdfe3a" Dec 04 12:09:31.426289 master-0 kubenswrapper[35367]: E1204 12:09:31.426261 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3b0f3e1337d6375a84953a5f7055f8c2ca55a1c8f46b299bff3619f11fdfe3a\": container with ID starting with f3b0f3e1337d6375a84953a5f7055f8c2ca55a1c8f46b299bff3619f11fdfe3a not found: ID does not exist" containerID="f3b0f3e1337d6375a84953a5f7055f8c2ca55a1c8f46b299bff3619f11fdfe3a" Dec 04 12:09:31.426348 master-0 kubenswrapper[35367]: I1204 12:09:31.426296 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3b0f3e1337d6375a84953a5f7055f8c2ca55a1c8f46b299bff3619f11fdfe3a"} err="failed to get container status \"f3b0f3e1337d6375a84953a5f7055f8c2ca55a1c8f46b299bff3619f11fdfe3a\": rpc error: code = NotFound desc = could not find container \"f3b0f3e1337d6375a84953a5f7055f8c2ca55a1c8f46b299bff3619f11fdfe3a\": container with ID starting with f3b0f3e1337d6375a84953a5f7055f8c2ca55a1c8f46b299bff3619f11fdfe3a not found: ID does not exist" Dec 04 12:09:31.426348 master-0 kubenswrapper[35367]: I1204 12:09:31.426321 35367 scope.go:117] "RemoveContainer" containerID="50e4aba05a5634a6aa93e16728c33a772797be815d298cbb9c41818ca8fa4710" Dec 04 12:09:31.446104 master-0 kubenswrapper[35367]: I1204 12:09:31.446060 35367 scope.go:117] "RemoveContainer" containerID="9b381de18861f1e6749219437ce857d5e6e257e4af3cc8787117a9d8c0e92c73" Dec 04 12:09:31.448302 master-0 kubenswrapper[35367]: I1204 12:09:31.448250 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ed2adcc-5493-4adc-ad40-40df2b8dbd2d-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "0ed2adcc-5493-4adc-ad40-40df2b8dbd2d" (UID: "0ed2adcc-5493-4adc-ad40-40df2b8dbd2d"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:31.465877 master-0 kubenswrapper[35367]: I1204 12:09:31.465774 35367 scope.go:117] "RemoveContainer" containerID="4afbc21c1bb0947d5a69cbfecc43205e3da562612e3c78e436992e89bb32a608" Dec 04 12:09:31.490033 master-0 kubenswrapper[35367]: I1204 12:09:31.489973 35367 scope.go:117] "RemoveContainer" containerID="50e4aba05a5634a6aa93e16728c33a772797be815d298cbb9c41818ca8fa4710" Dec 04 12:09:31.490607 master-0 kubenswrapper[35367]: E1204 12:09:31.490569 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50e4aba05a5634a6aa93e16728c33a772797be815d298cbb9c41818ca8fa4710\": container with ID starting with 50e4aba05a5634a6aa93e16728c33a772797be815d298cbb9c41818ca8fa4710 not found: ID does not exist" containerID="50e4aba05a5634a6aa93e16728c33a772797be815d298cbb9c41818ca8fa4710" Dec 04 12:09:31.490667 master-0 kubenswrapper[35367]: I1204 12:09:31.490624 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50e4aba05a5634a6aa93e16728c33a772797be815d298cbb9c41818ca8fa4710"} err="failed to get container status \"50e4aba05a5634a6aa93e16728c33a772797be815d298cbb9c41818ca8fa4710\": rpc error: code = NotFound desc = could not find container \"50e4aba05a5634a6aa93e16728c33a772797be815d298cbb9c41818ca8fa4710\": container with ID starting with 50e4aba05a5634a6aa93e16728c33a772797be815d298cbb9c41818ca8fa4710 not found: ID does not exist" Dec 04 12:09:31.490667 master-0 kubenswrapper[35367]: I1204 12:09:31.490659 35367 scope.go:117] "RemoveContainer" containerID="9b381de18861f1e6749219437ce857d5e6e257e4af3cc8787117a9d8c0e92c73" Dec 04 12:09:31.491244 master-0 kubenswrapper[35367]: E1204 12:09:31.491205 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b381de18861f1e6749219437ce857d5e6e257e4af3cc8787117a9d8c0e92c73\": container with ID starting with 9b381de18861f1e6749219437ce857d5e6e257e4af3cc8787117a9d8c0e92c73 not found: ID does not exist" containerID="9b381de18861f1e6749219437ce857d5e6e257e4af3cc8787117a9d8c0e92c73" Dec 04 12:09:31.491307 master-0 kubenswrapper[35367]: I1204 12:09:31.491257 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b381de18861f1e6749219437ce857d5e6e257e4af3cc8787117a9d8c0e92c73"} err="failed to get container status \"9b381de18861f1e6749219437ce857d5e6e257e4af3cc8787117a9d8c0e92c73\": rpc error: code = NotFound desc = could not find container \"9b381de18861f1e6749219437ce857d5e6e257e4af3cc8787117a9d8c0e92c73\": container with ID starting with 9b381de18861f1e6749219437ce857d5e6e257e4af3cc8787117a9d8c0e92c73 not found: ID does not exist" Dec 04 12:09:31.491307 master-0 kubenswrapper[35367]: I1204 12:09:31.491286 35367 scope.go:117] "RemoveContainer" containerID="4afbc21c1bb0947d5a69cbfecc43205e3da562612e3c78e436992e89bb32a608" Dec 04 12:09:31.491646 master-0 kubenswrapper[35367]: E1204 12:09:31.491622 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4afbc21c1bb0947d5a69cbfecc43205e3da562612e3c78e436992e89bb32a608\": container with ID starting with 4afbc21c1bb0947d5a69cbfecc43205e3da562612e3c78e436992e89bb32a608 not found: ID does not exist" containerID="4afbc21c1bb0947d5a69cbfecc43205e3da562612e3c78e436992e89bb32a608" Dec 04 12:09:31.491704 master-0 kubenswrapper[35367]: I1204 12:09:31.491650 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4afbc21c1bb0947d5a69cbfecc43205e3da562612e3c78e436992e89bb32a608"} err="failed to get container status \"4afbc21c1bb0947d5a69cbfecc43205e3da562612e3c78e436992e89bb32a608\": rpc error: code = NotFound desc = could not find container \"4afbc21c1bb0947d5a69cbfecc43205e3da562612e3c78e436992e89bb32a608\": container with ID starting with 4afbc21c1bb0947d5a69cbfecc43205e3da562612e3c78e436992e89bb32a608 not found: ID does not exist" Dec 04 12:09:31.506388 master-0 kubenswrapper[35367]: I1204 12:09:31.506338 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-wgn8s" Dec 04 12:09:31.512940 master-0 kubenswrapper[35367]: I1204 12:09:31.512883 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2297684c-a98b-441c-8913-b5e9f39a2570-catalog-content\") pod \"2297684c-a98b-441c-8913-b5e9f39a2570\" (UID: \"2297684c-a98b-441c-8913-b5e9f39a2570\") " Dec 04 12:09:31.513328 master-0 kubenswrapper[35367]: I1204 12:09:31.512993 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2297684c-a98b-441c-8913-b5e9f39a2570-utilities\") pod \"2297684c-a98b-441c-8913-b5e9f39a2570\" (UID: \"2297684c-a98b-441c-8913-b5e9f39a2570\") " Dec 04 12:09:31.513328 master-0 kubenswrapper[35367]: I1204 12:09:31.513303 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v6c2\" (UniqueName: \"kubernetes.io/projected/2297684c-a98b-441c-8913-b5e9f39a2570-kube-api-access-4v6c2\") pod \"2297684c-a98b-441c-8913-b5e9f39a2570\" (UID: \"2297684c-a98b-441c-8913-b5e9f39a2570\") " Dec 04 12:09:31.513588 master-0 kubenswrapper[35367]: I1204 12:09:31.513556 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bmlrd\" (UniqueName: \"kubernetes.io/projected/414ce51b-cd2f-4311-96e0-bd80fb0ae666-kube-api-access-bmlrd\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:31.513588 master-0 kubenswrapper[35367]: I1204 12:09:31.513580 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/414ce51b-cd2f-4311-96e0-bd80fb0ae666-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:31.513588 master-0 kubenswrapper[35367]: I1204 12:09:31.513591 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0ed2adcc-5493-4adc-ad40-40df2b8dbd2d-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:31.514379 master-0 kubenswrapper[35367]: I1204 12:09:31.514314 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2297684c-a98b-441c-8913-b5e9f39a2570-utilities" (OuterVolumeSpecName: "utilities") pod "2297684c-a98b-441c-8913-b5e9f39a2570" (UID: "2297684c-a98b-441c-8913-b5e9f39a2570"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:31.517304 master-0 kubenswrapper[35367]: I1204 12:09:31.517037 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2297684c-a98b-441c-8913-b5e9f39a2570-kube-api-access-4v6c2" (OuterVolumeSpecName: "kube-api-access-4v6c2") pod "2297684c-a98b-441c-8913-b5e9f39a2570" (UID: "2297684c-a98b-441c-8913-b5e9f39a2570"). InnerVolumeSpecName "kube-api-access-4v6c2". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:31.521889 master-0 kubenswrapper[35367]: I1204 12:09:31.521799 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/414ce51b-cd2f-4311-96e0-bd80fb0ae666-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "414ce51b-cd2f-4311-96e0-bd80fb0ae666" (UID: "414ce51b-cd2f-4311-96e0-bd80fb0ae666"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:31.614199 master-0 kubenswrapper[35367]: I1204 12:09:31.612292 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-xgzlt"] Dec 04 12:09:31.614199 master-0 kubenswrapper[35367]: I1204 12:09:31.612636 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-xgzlt" podUID="fcfbd087-b1aa-47da-a672-cde747408887" containerName="registry-server" containerID="cri-o://c79851b6fc1af1cb4ffbee3d114e1cad62d62259087025b52fe1bb890fc3c313" gracePeriod=2 Dec 04 12:09:31.618368 master-0 kubenswrapper[35367]: I1204 12:09:31.617828 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/414ce51b-cd2f-4311-96e0-bd80fb0ae666-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:31.618368 master-0 kubenswrapper[35367]: I1204 12:09:31.617882 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2297684c-a98b-441c-8913-b5e9f39a2570-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:31.618368 master-0 kubenswrapper[35367]: I1204 12:09:31.617897 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4v6c2\" (UniqueName: \"kubernetes.io/projected/2297684c-a98b-441c-8913-b5e9f39a2570-kube-api-access-4v6c2\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:31.665433 master-0 kubenswrapper[35367]: I1204 12:09:31.663516 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2297684c-a98b-441c-8913-b5e9f39a2570-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "2297684c-a98b-441c-8913-b5e9f39a2570" (UID: "2297684c-a98b-441c-8913-b5e9f39a2570"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:31.691213 master-0 kubenswrapper[35367]: I1204 12:09:31.691138 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-gzs5w"] Dec 04 12:09:31.699433 master-0 kubenswrapper[35367]: I1204 12:09:31.699357 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-gzs5w"] Dec 04 12:09:31.720860 master-0 kubenswrapper[35367]: I1204 12:09:31.720027 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2297684c-a98b-441c-8913-b5e9f39a2570-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:31.741379 master-0 kubenswrapper[35367]: I1204 12:09:31.741314 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-p5ndf"] Dec 04 12:09:31.747259 master-0 kubenswrapper[35367]: I1204 12:09:31.747201 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-p5ndf"] Dec 04 12:09:31.761023 master-0 kubenswrapper[35367]: I1204 12:09:31.760776 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-b7n8z"] Dec 04 12:09:31.769892 master-0 kubenswrapper[35367]: I1204 12:09:31.767993 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-b7n8z"] Dec 04 12:09:31.869460 master-0 kubenswrapper[35367]: I1204 12:09:31.869317 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-v2gh5"] Dec 04 12:09:31.869664 master-0 kubenswrapper[35367]: I1204 12:09:31.869605 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-v2gh5" podUID="f4283051-9a72-4bab-b4e9-0fcff55962f9" containerName="registry-server" containerID="cri-o://e97f2b5bc3088bf8739c99d1cbca9dd4c05df8fab750e9737b9ab7e87eefb9a8" gracePeriod=2 Dec 04 12:09:32.078825 master-0 kubenswrapper[35367]: I1204 12:09:32.078759 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-xgzlt" Dec 04 12:09:32.125610 master-0 kubenswrapper[35367]: I1204 12:09:32.124944 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fcfbd087-b1aa-47da-a672-cde747408887-utilities\") pod \"fcfbd087-b1aa-47da-a672-cde747408887\" (UID: \"fcfbd087-b1aa-47da-a672-cde747408887\") " Dec 04 12:09:32.125610 master-0 kubenswrapper[35367]: I1204 12:09:32.125002 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mrw9\" (UniqueName: \"kubernetes.io/projected/fcfbd087-b1aa-47da-a672-cde747408887-kube-api-access-7mrw9\") pod \"fcfbd087-b1aa-47da-a672-cde747408887\" (UID: \"fcfbd087-b1aa-47da-a672-cde747408887\") " Dec 04 12:09:32.125610 master-0 kubenswrapper[35367]: I1204 12:09:32.125086 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fcfbd087-b1aa-47da-a672-cde747408887-catalog-content\") pod \"fcfbd087-b1aa-47da-a672-cde747408887\" (UID: \"fcfbd087-b1aa-47da-a672-cde747408887\") " Dec 04 12:09:32.126974 master-0 kubenswrapper[35367]: I1204 12:09:32.125862 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcfbd087-b1aa-47da-a672-cde747408887-utilities" (OuterVolumeSpecName: "utilities") pod "fcfbd087-b1aa-47da-a672-cde747408887" (UID: "fcfbd087-b1aa-47da-a672-cde747408887"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:32.129550 master-0 kubenswrapper[35367]: I1204 12:09:32.129471 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcfbd087-b1aa-47da-a672-cde747408887-kube-api-access-7mrw9" (OuterVolumeSpecName: "kube-api-access-7mrw9") pod "fcfbd087-b1aa-47da-a672-cde747408887" (UID: "fcfbd087-b1aa-47da-a672-cde747408887"). InnerVolumeSpecName "kube-api-access-7mrw9". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:32.227593 master-0 kubenswrapper[35367]: I1204 12:09:32.227530 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fcfbd087-b1aa-47da-a672-cde747408887-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:32.227593 master-0 kubenswrapper[35367]: I1204 12:09:32.227574 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7mrw9\" (UniqueName: \"kubernetes.io/projected/fcfbd087-b1aa-47da-a672-cde747408887-kube-api-access-7mrw9\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:32.247170 master-0 kubenswrapper[35367]: I1204 12:09:32.247103 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcfbd087-b1aa-47da-a672-cde747408887-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "fcfbd087-b1aa-47da-a672-cde747408887" (UID: "fcfbd087-b1aa-47da-a672-cde747408887"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:32.274567 master-0 kubenswrapper[35367]: I1204 12:09:32.274368 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-v2gh5" Dec 04 12:09:32.275376 master-0 kubenswrapper[35367]: I1204 12:09:32.275321 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-brsq4"] Dec 04 12:09:32.275622 master-0 kubenswrapper[35367]: I1204 12:09:32.275587 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-brsq4" podUID="6e4bb27b-25c2-4ea3-b339-11b6d962fa1d" containerName="registry-server" containerID="cri-o://91433051c4ed3dd110a118ddc2c2f17cc00879edcdb4b6552ea2da8d0bed8061" gracePeriod=2 Dec 04 12:09:32.331437 master-0 kubenswrapper[35367]: I1204 12:09:32.328903 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86p48\" (UniqueName: \"kubernetes.io/projected/f4283051-9a72-4bab-b4e9-0fcff55962f9-kube-api-access-86p48\") pod \"f4283051-9a72-4bab-b4e9-0fcff55962f9\" (UID: \"f4283051-9a72-4bab-b4e9-0fcff55962f9\") " Dec 04 12:09:32.331437 master-0 kubenswrapper[35367]: I1204 12:09:32.329009 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f4283051-9a72-4bab-b4e9-0fcff55962f9-utilities\") pod \"f4283051-9a72-4bab-b4e9-0fcff55962f9\" (UID: \"f4283051-9a72-4bab-b4e9-0fcff55962f9\") " Dec 04 12:09:32.331437 master-0 kubenswrapper[35367]: I1204 12:09:32.329236 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f4283051-9a72-4bab-b4e9-0fcff55962f9-catalog-content\") pod \"f4283051-9a72-4bab-b4e9-0fcff55962f9\" (UID: \"f4283051-9a72-4bab-b4e9-0fcff55962f9\") " Dec 04 12:09:32.331437 master-0 kubenswrapper[35367]: I1204 12:09:32.329833 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fcfbd087-b1aa-47da-a672-cde747408887-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:32.331437 master-0 kubenswrapper[35367]: I1204 12:09:32.330148 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4283051-9a72-4bab-b4e9-0fcff55962f9-utilities" (OuterVolumeSpecName: "utilities") pod "f4283051-9a72-4bab-b4e9-0fcff55962f9" (UID: "f4283051-9a72-4bab-b4e9-0fcff55962f9"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:32.333238 master-0 kubenswrapper[35367]: I1204 12:09:32.333163 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4283051-9a72-4bab-b4e9-0fcff55962f9-kube-api-access-86p48" (OuterVolumeSpecName: "kube-api-access-86p48") pod "f4283051-9a72-4bab-b4e9-0fcff55962f9" (UID: "f4283051-9a72-4bab-b4e9-0fcff55962f9"). InnerVolumeSpecName "kube-api-access-86p48". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:32.350271 master-0 kubenswrapper[35367]: I1204 12:09:32.350209 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wgn8s" event={"ID":"2297684c-a98b-441c-8913-b5e9f39a2570","Type":"ContainerDied","Data":"0fd4c5bea87c5cd3111596b9acffa2dd041a256756ba3890029ef92e6bbed72b"} Dec 04 12:09:32.350482 master-0 kubenswrapper[35367]: I1204 12:09:32.350295 35367 scope.go:117] "RemoveContainer" containerID="67ca2c7d08b481fe515a75f9c4cd734d3a64a4b1aa833e7f445224197b4dbbad" Dec 04 12:09:32.350482 master-0 kubenswrapper[35367]: I1204 12:09:32.350248 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-wgn8s" Dec 04 12:09:32.355694 master-0 kubenswrapper[35367]: I1204 12:09:32.355655 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-jjfcc" event={"ID":"414ce51b-cd2f-4311-96e0-bd80fb0ae666","Type":"ContainerDied","Data":"2898ff3dded84ce8ed2f755bef052ff36104189fdc90e461069f243458d4bdb4"} Dec 04 12:09:32.355887 master-0 kubenswrapper[35367]: I1204 12:09:32.355664 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-jjfcc" Dec 04 12:09:32.358393 master-0 kubenswrapper[35367]: I1204 12:09:32.358346 35367 generic.go:334] "Generic (PLEG): container finished" podID="fcfbd087-b1aa-47da-a672-cde747408887" containerID="c79851b6fc1af1cb4ffbee3d114e1cad62d62259087025b52fe1bb890fc3c313" exitCode=0 Dec 04 12:09:32.358485 master-0 kubenswrapper[35367]: I1204 12:09:32.358435 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-xgzlt" event={"ID":"fcfbd087-b1aa-47da-a672-cde747408887","Type":"ContainerDied","Data":"c79851b6fc1af1cb4ffbee3d114e1cad62d62259087025b52fe1bb890fc3c313"} Dec 04 12:09:32.358548 master-0 kubenswrapper[35367]: I1204 12:09:32.358518 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-xgzlt" event={"ID":"fcfbd087-b1aa-47da-a672-cde747408887","Type":"ContainerDied","Data":"85470070d3e44d1cb189b34c424383587f5a487fb0659121479c77a37a24644f"} Dec 04 12:09:32.358662 master-0 kubenswrapper[35367]: I1204 12:09:32.358635 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-xgzlt" Dec 04 12:09:32.362774 master-0 kubenswrapper[35367]: I1204 12:09:32.362742 35367 generic.go:334] "Generic (PLEG): container finished" podID="f4283051-9a72-4bab-b4e9-0fcff55962f9" containerID="e97f2b5bc3088bf8739c99d1cbca9dd4c05df8fab750e9737b9ab7e87eefb9a8" exitCode=0 Dec 04 12:09:32.362906 master-0 kubenswrapper[35367]: I1204 12:09:32.362826 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-v2gh5" Dec 04 12:09:32.362906 master-0 kubenswrapper[35367]: I1204 12:09:32.362831 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v2gh5" event={"ID":"f4283051-9a72-4bab-b4e9-0fcff55962f9","Type":"ContainerDied","Data":"e97f2b5bc3088bf8739c99d1cbca9dd4c05df8fab750e9737b9ab7e87eefb9a8"} Dec 04 12:09:32.362906 master-0 kubenswrapper[35367]: I1204 12:09:32.362899 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v2gh5" event={"ID":"f4283051-9a72-4bab-b4e9-0fcff55962f9","Type":"ContainerDied","Data":"72bff524da6626ec4dd623bf443a5b2a63c4bbd36813d294a4cc4bfb85b20411"} Dec 04 12:09:32.404731 master-0 kubenswrapper[35367]: I1204 12:09:32.403961 35367 scope.go:117] "RemoveContainer" containerID="ca0e5bea4c5c1e2d0618e56119c2b86cdbe733b6f151b73b0105174f0737c5fb" Dec 04 12:09:32.437605 master-0 kubenswrapper[35367]: I1204 12:09:32.437540 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-86p48\" (UniqueName: \"kubernetes.io/projected/f4283051-9a72-4bab-b4e9-0fcff55962f9-kube-api-access-86p48\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:32.437605 master-0 kubenswrapper[35367]: I1204 12:09:32.437595 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f4283051-9a72-4bab-b4e9-0fcff55962f9-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:32.438436 master-0 kubenswrapper[35367]: I1204 12:09:32.438405 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-7j7ql" Dec 04 12:09:32.439691 master-0 kubenswrapper[35367]: I1204 12:09:32.439649 35367 scope.go:117] "RemoveContainer" containerID="677ec065b70f155df40d70bf079febe49a4f71d0c91ebe9e4cf791321e1267ab" Dec 04 12:09:32.452756 master-0 kubenswrapper[35367]: I1204 12:09:32.452702 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-jjfcc"] Dec 04 12:09:32.453001 master-0 kubenswrapper[35367]: I1204 12:09:32.452950 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4283051-9a72-4bab-b4e9-0fcff55962f9-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "f4283051-9a72-4bab-b4e9-0fcff55962f9" (UID: "f4283051-9a72-4bab-b4e9-0fcff55962f9"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:32.463080 master-0 kubenswrapper[35367]: I1204 12:09:32.462925 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-jjfcc"] Dec 04 12:09:32.467082 master-0 kubenswrapper[35367]: I1204 12:09:32.466789 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-xgzlt"] Dec 04 12:09:32.472920 master-0 kubenswrapper[35367]: I1204 12:09:32.472878 35367 scope.go:117] "RemoveContainer" containerID="a95164cc8a270d05de9b2a69a6848239d05c00d5a41a825cf74d7ee6fb1794aa" Dec 04 12:09:32.475094 master-0 kubenswrapper[35367]: I1204 12:09:32.475067 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-xgzlt"] Dec 04 12:09:32.482400 master-0 kubenswrapper[35367]: I1204 12:09:32.482354 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-mwsqm"] Dec 04 12:09:32.482671 master-0 kubenswrapper[35367]: I1204 12:09:32.482609 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-mwsqm" podUID="5b2522d3-a2e9-435f-971f-9cc73721e99c" containerName="registry-server" containerID="cri-o://d3382182c0711e7e570d1be95249b1c4086cf837be9ff59228a2076596b4b7d6" gracePeriod=2 Dec 04 12:09:32.495565 master-0 kubenswrapper[35367]: I1204 12:09:32.495379 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-wgn8s"] Dec 04 12:09:32.497474 master-0 kubenswrapper[35367]: I1204 12:09:32.497451 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-wgn8s"] Dec 04 12:09:32.502878 master-0 kubenswrapper[35367]: I1204 12:09:32.502094 35367 scope.go:117] "RemoveContainer" containerID="164f9ed9ed9983efbca38d2d3b5ccbc5acdd215f664829c3365cb1e7705ef432" Dec 04 12:09:32.539334 master-0 kubenswrapper[35367]: I1204 12:09:32.539283 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f4283051-9a72-4bab-b4e9-0fcff55962f9-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:32.539923 master-0 kubenswrapper[35367]: I1204 12:09:32.539894 35367 scope.go:117] "RemoveContainer" containerID="24bcbe84a8dbab71fc5acc96a804e466369c5c0857fffddb8b916256d7b06f90" Dec 04 12:09:32.617773 master-0 kubenswrapper[35367]: I1204 12:09:32.617731 35367 scope.go:117] "RemoveContainer" containerID="c79851b6fc1af1cb4ffbee3d114e1cad62d62259087025b52fe1bb890fc3c313" Dec 04 12:09:32.637464 master-0 kubenswrapper[35367]: I1204 12:09:32.637326 35367 scope.go:117] "RemoveContainer" containerID="7fe2feb7cc0c1d0b73d7b7f52fee11c8c0302465a1f90aa532654e02284a5736" Dec 04 12:09:32.657491 master-0 kubenswrapper[35367]: I1204 12:09:32.656774 35367 scope.go:117] "RemoveContainer" containerID="7300347a11fb72bc40cb0d2baae59b412be23527e9e85a5b56a0470005ff4b06" Dec 04 12:09:32.675242 master-0 kubenswrapper[35367]: I1204 12:09:32.674547 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-rxp4h"] Dec 04 12:09:32.675242 master-0 kubenswrapper[35367]: I1204 12:09:32.674945 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-rxp4h" podUID="78de4935-3e4c-4f6f-bbb5-d592c35b47da" containerName="registry-server" containerID="cri-o://137da20bd4af181a38127c9a59458b71aed997c9aa122580536bf1a577381627" gracePeriod=2 Dec 04 12:09:32.681747 master-0 kubenswrapper[35367]: I1204 12:09:32.681664 35367 scope.go:117] "RemoveContainer" containerID="c79851b6fc1af1cb4ffbee3d114e1cad62d62259087025b52fe1bb890fc3c313" Dec 04 12:09:32.683470 master-0 kubenswrapper[35367]: E1204 12:09:32.682997 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c79851b6fc1af1cb4ffbee3d114e1cad62d62259087025b52fe1bb890fc3c313\": container with ID starting with c79851b6fc1af1cb4ffbee3d114e1cad62d62259087025b52fe1bb890fc3c313 not found: ID does not exist" containerID="c79851b6fc1af1cb4ffbee3d114e1cad62d62259087025b52fe1bb890fc3c313" Dec 04 12:09:32.683470 master-0 kubenswrapper[35367]: I1204 12:09:32.683065 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c79851b6fc1af1cb4ffbee3d114e1cad62d62259087025b52fe1bb890fc3c313"} err="failed to get container status \"c79851b6fc1af1cb4ffbee3d114e1cad62d62259087025b52fe1bb890fc3c313\": rpc error: code = NotFound desc = could not find container \"c79851b6fc1af1cb4ffbee3d114e1cad62d62259087025b52fe1bb890fc3c313\": container with ID starting with c79851b6fc1af1cb4ffbee3d114e1cad62d62259087025b52fe1bb890fc3c313 not found: ID does not exist" Dec 04 12:09:32.683470 master-0 kubenswrapper[35367]: I1204 12:09:32.683103 35367 scope.go:117] "RemoveContainer" containerID="7fe2feb7cc0c1d0b73d7b7f52fee11c8c0302465a1f90aa532654e02284a5736" Dec 04 12:09:32.684014 master-0 kubenswrapper[35367]: E1204 12:09:32.683970 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fe2feb7cc0c1d0b73d7b7f52fee11c8c0302465a1f90aa532654e02284a5736\": container with ID starting with 7fe2feb7cc0c1d0b73d7b7f52fee11c8c0302465a1f90aa532654e02284a5736 not found: ID does not exist" containerID="7fe2feb7cc0c1d0b73d7b7f52fee11c8c0302465a1f90aa532654e02284a5736" Dec 04 12:09:32.684096 master-0 kubenswrapper[35367]: I1204 12:09:32.684002 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fe2feb7cc0c1d0b73d7b7f52fee11c8c0302465a1f90aa532654e02284a5736"} err="failed to get container status \"7fe2feb7cc0c1d0b73d7b7f52fee11c8c0302465a1f90aa532654e02284a5736\": rpc error: code = NotFound desc = could not find container \"7fe2feb7cc0c1d0b73d7b7f52fee11c8c0302465a1f90aa532654e02284a5736\": container with ID starting with 7fe2feb7cc0c1d0b73d7b7f52fee11c8c0302465a1f90aa532654e02284a5736 not found: ID does not exist" Dec 04 12:09:32.684096 master-0 kubenswrapper[35367]: I1204 12:09:32.684045 35367 scope.go:117] "RemoveContainer" containerID="7300347a11fb72bc40cb0d2baae59b412be23527e9e85a5b56a0470005ff4b06" Dec 04 12:09:32.684364 master-0 kubenswrapper[35367]: E1204 12:09:32.684321 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7300347a11fb72bc40cb0d2baae59b412be23527e9e85a5b56a0470005ff4b06\": container with ID starting with 7300347a11fb72bc40cb0d2baae59b412be23527e9e85a5b56a0470005ff4b06 not found: ID does not exist" containerID="7300347a11fb72bc40cb0d2baae59b412be23527e9e85a5b56a0470005ff4b06" Dec 04 12:09:32.684421 master-0 kubenswrapper[35367]: I1204 12:09:32.684358 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7300347a11fb72bc40cb0d2baae59b412be23527e9e85a5b56a0470005ff4b06"} err="failed to get container status \"7300347a11fb72bc40cb0d2baae59b412be23527e9e85a5b56a0470005ff4b06\": rpc error: code = NotFound desc = could not find container \"7300347a11fb72bc40cb0d2baae59b412be23527e9e85a5b56a0470005ff4b06\": container with ID starting with 7300347a11fb72bc40cb0d2baae59b412be23527e9e85a5b56a0470005ff4b06 not found: ID does not exist" Dec 04 12:09:32.684421 master-0 kubenswrapper[35367]: I1204 12:09:32.684380 35367 scope.go:117] "RemoveContainer" containerID="e97f2b5bc3088bf8739c99d1cbca9dd4c05df8fab750e9737b9ab7e87eefb9a8" Dec 04 12:09:32.714278 master-0 kubenswrapper[35367]: I1204 12:09:32.714208 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-brsq4" Dec 04 12:09:32.720088 master-0 kubenswrapper[35367]: I1204 12:09:32.717375 35367 scope.go:117] "RemoveContainer" containerID="77e669638d1dc8570f6e947be6eec8a24399150cf79b518ab9818b5524a9d70a" Dec 04 12:09:32.720088 master-0 kubenswrapper[35367]: I1204 12:09:32.717538 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-v2gh5"] Dec 04 12:09:32.743185 master-0 kubenswrapper[35367]: I1204 12:09:32.740146 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-v2gh5"] Dec 04 12:09:32.743185 master-0 kubenswrapper[35367]: I1204 12:09:32.741664 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6e4bb27b-25c2-4ea3-b339-11b6d962fa1d-utilities\") pod \"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d\" (UID: \"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d\") " Dec 04 12:09:32.743185 master-0 kubenswrapper[35367]: I1204 12:09:32.741747 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6e4bb27b-25c2-4ea3-b339-11b6d962fa1d-catalog-content\") pod \"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d\" (UID: \"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d\") " Dec 04 12:09:32.743185 master-0 kubenswrapper[35367]: I1204 12:09:32.741859 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qmrg\" (UniqueName: \"kubernetes.io/projected/6e4bb27b-25c2-4ea3-b339-11b6d962fa1d-kube-api-access-5qmrg\") pod \"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d\" (UID: \"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d\") " Dec 04 12:09:32.743185 master-0 kubenswrapper[35367]: I1204 12:09:32.743054 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e4bb27b-25c2-4ea3-b339-11b6d962fa1d-utilities" (OuterVolumeSpecName: "utilities") pod "6e4bb27b-25c2-4ea3-b339-11b6d962fa1d" (UID: "6e4bb27b-25c2-4ea3-b339-11b6d962fa1d"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:32.745964 master-0 kubenswrapper[35367]: I1204 12:09:32.745613 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e4bb27b-25c2-4ea3-b339-11b6d962fa1d-kube-api-access-5qmrg" (OuterVolumeSpecName: "kube-api-access-5qmrg") pod "6e4bb27b-25c2-4ea3-b339-11b6d962fa1d" (UID: "6e4bb27b-25c2-4ea3-b339-11b6d962fa1d"). InnerVolumeSpecName "kube-api-access-5qmrg". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:32.758386 master-0 kubenswrapper[35367]: I1204 12:09:32.758334 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ed2adcc-5493-4adc-ad40-40df2b8dbd2d" path="/var/lib/kubelet/pods/0ed2adcc-5493-4adc-ad40-40df2b8dbd2d/volumes" Dec 04 12:09:32.759238 master-0 kubenswrapper[35367]: I1204 12:09:32.759212 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14fef399-4e8f-4867-ace9-3b273117f886" path="/var/lib/kubelet/pods/14fef399-4e8f-4867-ace9-3b273117f886/volumes" Dec 04 12:09:32.760216 master-0 kubenswrapper[35367]: I1204 12:09:32.760190 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2297684c-a98b-441c-8913-b5e9f39a2570" path="/var/lib/kubelet/pods/2297684c-a98b-441c-8913-b5e9f39a2570/volumes" Dec 04 12:09:32.761426 master-0 kubenswrapper[35367]: I1204 12:09:32.761403 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="414ce51b-cd2f-4311-96e0-bd80fb0ae666" path="/var/lib/kubelet/pods/414ce51b-cd2f-4311-96e0-bd80fb0ae666/volumes" Dec 04 12:09:32.763546 master-0 kubenswrapper[35367]: I1204 12:09:32.762095 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b275f26-6d4a-40a3-8dee-c58ae09c0263" path="/var/lib/kubelet/pods/6b275f26-6d4a-40a3-8dee-c58ae09c0263/volumes" Dec 04 12:09:32.763546 master-0 kubenswrapper[35367]: I1204 12:09:32.763370 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4283051-9a72-4bab-b4e9-0fcff55962f9" path="/var/lib/kubelet/pods/f4283051-9a72-4bab-b4e9-0fcff55962f9/volumes" Dec 04 12:09:32.764082 master-0 kubenswrapper[35367]: I1204 12:09:32.764052 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcfbd087-b1aa-47da-a672-cde747408887" path="/var/lib/kubelet/pods/fcfbd087-b1aa-47da-a672-cde747408887/volumes" Dec 04 12:09:32.808146 master-0 kubenswrapper[35367]: I1204 12:09:32.808110 35367 scope.go:117] "RemoveContainer" containerID="2453d8e49a90c4a332b0d1a1773e5eeded1fc6928741e05b8f148a051f7b3ada" Dec 04 12:09:32.829995 master-0 kubenswrapper[35367]: I1204 12:09:32.829919 35367 scope.go:117] "RemoveContainer" containerID="e97f2b5bc3088bf8739c99d1cbca9dd4c05df8fab750e9737b9ab7e87eefb9a8" Dec 04 12:09:32.830363 master-0 kubenswrapper[35367]: E1204 12:09:32.830329 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e97f2b5bc3088bf8739c99d1cbca9dd4c05df8fab750e9737b9ab7e87eefb9a8\": container with ID starting with e97f2b5bc3088bf8739c99d1cbca9dd4c05df8fab750e9737b9ab7e87eefb9a8 not found: ID does not exist" containerID="e97f2b5bc3088bf8739c99d1cbca9dd4c05df8fab750e9737b9ab7e87eefb9a8" Dec 04 12:09:32.830407 master-0 kubenswrapper[35367]: I1204 12:09:32.830370 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e97f2b5bc3088bf8739c99d1cbca9dd4c05df8fab750e9737b9ab7e87eefb9a8"} err="failed to get container status \"e97f2b5bc3088bf8739c99d1cbca9dd4c05df8fab750e9737b9ab7e87eefb9a8\": rpc error: code = NotFound desc = could not find container \"e97f2b5bc3088bf8739c99d1cbca9dd4c05df8fab750e9737b9ab7e87eefb9a8\": container with ID starting with e97f2b5bc3088bf8739c99d1cbca9dd4c05df8fab750e9737b9ab7e87eefb9a8 not found: ID does not exist" Dec 04 12:09:32.830407 master-0 kubenswrapper[35367]: I1204 12:09:32.830394 35367 scope.go:117] "RemoveContainer" containerID="77e669638d1dc8570f6e947be6eec8a24399150cf79b518ab9818b5524a9d70a" Dec 04 12:09:32.830657 master-0 kubenswrapper[35367]: E1204 12:09:32.830610 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77e669638d1dc8570f6e947be6eec8a24399150cf79b518ab9818b5524a9d70a\": container with ID starting with 77e669638d1dc8570f6e947be6eec8a24399150cf79b518ab9818b5524a9d70a not found: ID does not exist" containerID="77e669638d1dc8570f6e947be6eec8a24399150cf79b518ab9818b5524a9d70a" Dec 04 12:09:32.830657 master-0 kubenswrapper[35367]: I1204 12:09:32.830640 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77e669638d1dc8570f6e947be6eec8a24399150cf79b518ab9818b5524a9d70a"} err="failed to get container status \"77e669638d1dc8570f6e947be6eec8a24399150cf79b518ab9818b5524a9d70a\": rpc error: code = NotFound desc = could not find container \"77e669638d1dc8570f6e947be6eec8a24399150cf79b518ab9818b5524a9d70a\": container with ID starting with 77e669638d1dc8570f6e947be6eec8a24399150cf79b518ab9818b5524a9d70a not found: ID does not exist" Dec 04 12:09:32.830657 master-0 kubenswrapper[35367]: I1204 12:09:32.830654 35367 scope.go:117] "RemoveContainer" containerID="2453d8e49a90c4a332b0d1a1773e5eeded1fc6928741e05b8f148a051f7b3ada" Dec 04 12:09:32.830985 master-0 kubenswrapper[35367]: E1204 12:09:32.830958 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2453d8e49a90c4a332b0d1a1773e5eeded1fc6928741e05b8f148a051f7b3ada\": container with ID starting with 2453d8e49a90c4a332b0d1a1773e5eeded1fc6928741e05b8f148a051f7b3ada not found: ID does not exist" containerID="2453d8e49a90c4a332b0d1a1773e5eeded1fc6928741e05b8f148a051f7b3ada" Dec 04 12:09:32.831023 master-0 kubenswrapper[35367]: I1204 12:09:32.830981 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2453d8e49a90c4a332b0d1a1773e5eeded1fc6928741e05b8f148a051f7b3ada"} err="failed to get container status \"2453d8e49a90c4a332b0d1a1773e5eeded1fc6928741e05b8f148a051f7b3ada\": rpc error: code = NotFound desc = could not find container \"2453d8e49a90c4a332b0d1a1773e5eeded1fc6928741e05b8f148a051f7b3ada\": container with ID starting with 2453d8e49a90c4a332b0d1a1773e5eeded1fc6928741e05b8f148a051f7b3ada not found: ID does not exist" Dec 04 12:09:32.847011 master-0 kubenswrapper[35367]: I1204 12:09:32.846952 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5qmrg\" (UniqueName: \"kubernetes.io/projected/6e4bb27b-25c2-4ea3-b339-11b6d962fa1d-kube-api-access-5qmrg\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:32.847011 master-0 kubenswrapper[35367]: I1204 12:09:32.846990 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6e4bb27b-25c2-4ea3-b339-11b6d962fa1d-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:32.854630 master-0 kubenswrapper[35367]: I1204 12:09:32.854553 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e4bb27b-25c2-4ea3-b339-11b6d962fa1d-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "6e4bb27b-25c2-4ea3-b339-11b6d962fa1d" (UID: "6e4bb27b-25c2-4ea3-b339-11b6d962fa1d"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:32.919684 master-0 kubenswrapper[35367]: I1204 12:09:32.919545 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-mwsqm" Dec 04 12:09:32.951519 master-0 kubenswrapper[35367]: I1204 12:09:32.950370 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6e4bb27b-25c2-4ea3-b339-11b6d962fa1d-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:33.052870 master-0 kubenswrapper[35367]: I1204 12:09:33.052789 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwml4\" (UniqueName: \"kubernetes.io/projected/5b2522d3-a2e9-435f-971f-9cc73721e99c-kube-api-access-jwml4\") pod \"5b2522d3-a2e9-435f-971f-9cc73721e99c\" (UID: \"5b2522d3-a2e9-435f-971f-9cc73721e99c\") " Dec 04 12:09:33.053182 master-0 kubenswrapper[35367]: I1204 12:09:33.052896 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5b2522d3-a2e9-435f-971f-9cc73721e99c-catalog-content\") pod \"5b2522d3-a2e9-435f-971f-9cc73721e99c\" (UID: \"5b2522d3-a2e9-435f-971f-9cc73721e99c\") " Dec 04 12:09:33.053182 master-0 kubenswrapper[35367]: I1204 12:09:33.052962 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5b2522d3-a2e9-435f-971f-9cc73721e99c-utilities\") pod \"5b2522d3-a2e9-435f-971f-9cc73721e99c\" (UID: \"5b2522d3-a2e9-435f-971f-9cc73721e99c\") " Dec 04 12:09:33.054476 master-0 kubenswrapper[35367]: I1204 12:09:33.054387 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b2522d3-a2e9-435f-971f-9cc73721e99c-utilities" (OuterVolumeSpecName: "utilities") pod "5b2522d3-a2e9-435f-971f-9cc73721e99c" (UID: "5b2522d3-a2e9-435f-971f-9cc73721e99c"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:33.056287 master-0 kubenswrapper[35367]: I1204 12:09:33.056232 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b2522d3-a2e9-435f-971f-9cc73721e99c-kube-api-access-jwml4" (OuterVolumeSpecName: "kube-api-access-jwml4") pod "5b2522d3-a2e9-435f-971f-9cc73721e99c" (UID: "5b2522d3-a2e9-435f-971f-9cc73721e99c"). InnerVolumeSpecName "kube-api-access-jwml4". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:33.132768 master-0 kubenswrapper[35367]: I1204 12:09:33.132647 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-rxp4h" Dec 04 12:09:33.155245 master-0 kubenswrapper[35367]: I1204 12:09:33.155184 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5b2522d3-a2e9-435f-971f-9cc73721e99c-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:33.155245 master-0 kubenswrapper[35367]: I1204 12:09:33.155226 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jwml4\" (UniqueName: \"kubernetes.io/projected/5b2522d3-a2e9-435f-971f-9cc73721e99c-kube-api-access-jwml4\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:33.174708 master-0 kubenswrapper[35367]: I1204 12:09:33.174560 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b2522d3-a2e9-435f-971f-9cc73721e99c-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "5b2522d3-a2e9-435f-971f-9cc73721e99c" (UID: "5b2522d3-a2e9-435f-971f-9cc73721e99c"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:33.256621 master-0 kubenswrapper[35367]: I1204 12:09:33.256550 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/78de4935-3e4c-4f6f-bbb5-d592c35b47da-utilities\") pod \"78de4935-3e4c-4f6f-bbb5-d592c35b47da\" (UID: \"78de4935-3e4c-4f6f-bbb5-d592c35b47da\") " Dec 04 12:09:33.256902 master-0 kubenswrapper[35367]: I1204 12:09:33.256667 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzg6x\" (UniqueName: \"kubernetes.io/projected/78de4935-3e4c-4f6f-bbb5-d592c35b47da-kube-api-access-nzg6x\") pod \"78de4935-3e4c-4f6f-bbb5-d592c35b47da\" (UID: \"78de4935-3e4c-4f6f-bbb5-d592c35b47da\") " Dec 04 12:09:33.256902 master-0 kubenswrapper[35367]: I1204 12:09:33.256836 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/78de4935-3e4c-4f6f-bbb5-d592c35b47da-catalog-content\") pod \"78de4935-3e4c-4f6f-bbb5-d592c35b47da\" (UID: \"78de4935-3e4c-4f6f-bbb5-d592c35b47da\") " Dec 04 12:09:33.257484 master-0 kubenswrapper[35367]: I1204 12:09:33.257444 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5b2522d3-a2e9-435f-971f-9cc73721e99c-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:33.257484 master-0 kubenswrapper[35367]: I1204 12:09:33.257444 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78de4935-3e4c-4f6f-bbb5-d592c35b47da-utilities" (OuterVolumeSpecName: "utilities") pod "78de4935-3e4c-4f6f-bbb5-d592c35b47da" (UID: "78de4935-3e4c-4f6f-bbb5-d592c35b47da"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:33.260004 master-0 kubenswrapper[35367]: I1204 12:09:33.259939 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78de4935-3e4c-4f6f-bbb5-d592c35b47da-kube-api-access-nzg6x" (OuterVolumeSpecName: "kube-api-access-nzg6x") pod "78de4935-3e4c-4f6f-bbb5-d592c35b47da" (UID: "78de4935-3e4c-4f6f-bbb5-d592c35b47da"). InnerVolumeSpecName "kube-api-access-nzg6x". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:33.344305 master-0 kubenswrapper[35367]: I1204 12:09:33.342665 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Dec 04 12:09:33.359958 master-0 kubenswrapper[35367]: I1204 12:09:33.359885 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/78de4935-3e4c-4f6f-bbb5-d592c35b47da-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:33.359958 master-0 kubenswrapper[35367]: I1204 12:09:33.359947 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nzg6x\" (UniqueName: \"kubernetes.io/projected/78de4935-3e4c-4f6f-bbb5-d592c35b47da-kube-api-access-nzg6x\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:33.377369 master-0 kubenswrapper[35367]: I1204 12:09:33.377294 35367 generic.go:334] "Generic (PLEG): container finished" podID="78de4935-3e4c-4f6f-bbb5-d592c35b47da" containerID="137da20bd4af181a38127c9a59458b71aed997c9aa122580536bf1a577381627" exitCode=0 Dec 04 12:09:33.377610 master-0 kubenswrapper[35367]: I1204 12:09:33.377393 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-rxp4h" Dec 04 12:09:33.377610 master-0 kubenswrapper[35367]: I1204 12:09:33.377419 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-rxp4h" event={"ID":"78de4935-3e4c-4f6f-bbb5-d592c35b47da","Type":"ContainerDied","Data":"137da20bd4af181a38127c9a59458b71aed997c9aa122580536bf1a577381627"} Dec 04 12:09:33.377610 master-0 kubenswrapper[35367]: I1204 12:09:33.377515 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-rxp4h" event={"ID":"78de4935-3e4c-4f6f-bbb5-d592c35b47da","Type":"ContainerDied","Data":"2153fa565d5e5a981a9451ebde3da593bb6209466681123f0ffaf5d0817bfa1f"} Dec 04 12:09:33.377610 master-0 kubenswrapper[35367]: I1204 12:09:33.377548 35367 scope.go:117] "RemoveContainer" containerID="137da20bd4af181a38127c9a59458b71aed997c9aa122580536bf1a577381627" Dec 04 12:09:33.379956 master-0 kubenswrapper[35367]: I1204 12:09:33.379915 35367 generic.go:334] "Generic (PLEG): container finished" podID="6e4bb27b-25c2-4ea3-b339-11b6d962fa1d" containerID="91433051c4ed3dd110a118ddc2c2f17cc00879edcdb4b6552ea2da8d0bed8061" exitCode=0 Dec 04 12:09:33.380032 master-0 kubenswrapper[35367]: I1204 12:09:33.379997 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-brsq4" Dec 04 12:09:33.380084 master-0 kubenswrapper[35367]: I1204 12:09:33.380038 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-brsq4" event={"ID":"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d","Type":"ContainerDied","Data":"91433051c4ed3dd110a118ddc2c2f17cc00879edcdb4b6552ea2da8d0bed8061"} Dec 04 12:09:33.380120 master-0 kubenswrapper[35367]: I1204 12:09:33.380087 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-brsq4" event={"ID":"6e4bb27b-25c2-4ea3-b339-11b6d962fa1d","Type":"ContainerDied","Data":"25a3c9325feb8655e359e5fe29f659a83af096ae46a4c8fbcded7ef199a358fc"} Dec 04 12:09:33.384573 master-0 kubenswrapper[35367]: I1204 12:09:33.384510 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78de4935-3e4c-4f6f-bbb5-d592c35b47da-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "78de4935-3e4c-4f6f-bbb5-d592c35b47da" (UID: "78de4935-3e4c-4f6f-bbb5-d592c35b47da"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:33.385540 master-0 kubenswrapper[35367]: I1204 12:09:33.385472 35367 generic.go:334] "Generic (PLEG): container finished" podID="5b2522d3-a2e9-435f-971f-9cc73721e99c" containerID="d3382182c0711e7e570d1be95249b1c4086cf837be9ff59228a2076596b4b7d6" exitCode=0 Dec 04 12:09:33.385618 master-0 kubenswrapper[35367]: I1204 12:09:33.385547 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-mwsqm" event={"ID":"5b2522d3-a2e9-435f-971f-9cc73721e99c","Type":"ContainerDied","Data":"d3382182c0711e7e570d1be95249b1c4086cf837be9ff59228a2076596b4b7d6"} Dec 04 12:09:33.385662 master-0 kubenswrapper[35367]: I1204 12:09:33.385601 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-mwsqm" Dec 04 12:09:33.385693 master-0 kubenswrapper[35367]: I1204 12:09:33.385611 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-mwsqm" event={"ID":"5b2522d3-a2e9-435f-971f-9cc73721e99c","Type":"ContainerDied","Data":"9a224e4232cdaa1d99867695878c059e13a6af30eb8239b7bb49f581e178d5b8"} Dec 04 12:09:33.387230 master-0 kubenswrapper[35367]: I1204 12:09:33.387008 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="prometheus" containerID="cri-o://d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe" gracePeriod=600 Dec 04 12:09:33.387230 master-0 kubenswrapper[35367]: I1204 12:09:33.387038 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="kube-rbac-proxy" containerID="cri-o://1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4" gracePeriod=600 Dec 04 12:09:33.387230 master-0 kubenswrapper[35367]: I1204 12:09:33.387038 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="thanos-sidecar" containerID="cri-o://8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710" gracePeriod=600 Dec 04 12:09:33.387230 master-0 kubenswrapper[35367]: I1204 12:09:33.387103 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="kube-rbac-proxy-thanos" containerID="cri-o://7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af" gracePeriod=600 Dec 04 12:09:33.387230 master-0 kubenswrapper[35367]: I1204 12:09:33.387105 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="config-reloader" containerID="cri-o://279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077" gracePeriod=600 Dec 04 12:09:33.388595 master-0 kubenswrapper[35367]: I1204 12:09:33.387159 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="kube-rbac-proxy-web" containerID="cri-o://139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec" gracePeriod=600 Dec 04 12:09:33.425461 master-0 kubenswrapper[35367]: I1204 12:09:33.424924 35367 scope.go:117] "RemoveContainer" containerID="1b41d4bf52eda540862e7178b458fca8537ec72deda15b3448f09847e1e10ba2" Dec 04 12:09:33.451156 master-0 kubenswrapper[35367]: I1204 12:09:33.450948 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-mwsqm"] Dec 04 12:09:33.462145 master-0 kubenswrapper[35367]: I1204 12:09:33.462087 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-mwsqm"] Dec 04 12:09:33.467535 master-0 kubenswrapper[35367]: I1204 12:09:33.467485 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/78de4935-3e4c-4f6f-bbb5-d592c35b47da-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:33.473685 master-0 kubenswrapper[35367]: I1204 12:09:33.473181 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-brsq4"] Dec 04 12:09:33.474971 master-0 kubenswrapper[35367]: I1204 12:09:33.474931 35367 scope.go:117] "RemoveContainer" containerID="7a6b0f1a41abf6013bf44ce897eec3a5dccb1897583c77faeb409e52b30f3f94" Dec 04 12:09:33.482328 master-0 kubenswrapper[35367]: I1204 12:09:33.482198 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-brsq4"] Dec 04 12:09:33.503940 master-0 kubenswrapper[35367]: I1204 12:09:33.503140 35367 scope.go:117] "RemoveContainer" containerID="137da20bd4af181a38127c9a59458b71aed997c9aa122580536bf1a577381627" Dec 04 12:09:33.505155 master-0 kubenswrapper[35367]: E1204 12:09:33.504006 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"137da20bd4af181a38127c9a59458b71aed997c9aa122580536bf1a577381627\": container with ID starting with 137da20bd4af181a38127c9a59458b71aed997c9aa122580536bf1a577381627 not found: ID does not exist" containerID="137da20bd4af181a38127c9a59458b71aed997c9aa122580536bf1a577381627" Dec 04 12:09:33.505155 master-0 kubenswrapper[35367]: I1204 12:09:33.504045 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"137da20bd4af181a38127c9a59458b71aed997c9aa122580536bf1a577381627"} err="failed to get container status \"137da20bd4af181a38127c9a59458b71aed997c9aa122580536bf1a577381627\": rpc error: code = NotFound desc = could not find container \"137da20bd4af181a38127c9a59458b71aed997c9aa122580536bf1a577381627\": container with ID starting with 137da20bd4af181a38127c9a59458b71aed997c9aa122580536bf1a577381627 not found: ID does not exist" Dec 04 12:09:33.505155 master-0 kubenswrapper[35367]: I1204 12:09:33.504074 35367 scope.go:117] "RemoveContainer" containerID="1b41d4bf52eda540862e7178b458fca8537ec72deda15b3448f09847e1e10ba2" Dec 04 12:09:33.505155 master-0 kubenswrapper[35367]: E1204 12:09:33.504406 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b41d4bf52eda540862e7178b458fca8537ec72deda15b3448f09847e1e10ba2\": container with ID starting with 1b41d4bf52eda540862e7178b458fca8537ec72deda15b3448f09847e1e10ba2 not found: ID does not exist" containerID="1b41d4bf52eda540862e7178b458fca8537ec72deda15b3448f09847e1e10ba2" Dec 04 12:09:33.505155 master-0 kubenswrapper[35367]: I1204 12:09:33.504430 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b41d4bf52eda540862e7178b458fca8537ec72deda15b3448f09847e1e10ba2"} err="failed to get container status \"1b41d4bf52eda540862e7178b458fca8537ec72deda15b3448f09847e1e10ba2\": rpc error: code = NotFound desc = could not find container \"1b41d4bf52eda540862e7178b458fca8537ec72deda15b3448f09847e1e10ba2\": container with ID starting with 1b41d4bf52eda540862e7178b458fca8537ec72deda15b3448f09847e1e10ba2 not found: ID does not exist" Dec 04 12:09:33.505155 master-0 kubenswrapper[35367]: I1204 12:09:33.504447 35367 scope.go:117] "RemoveContainer" containerID="7a6b0f1a41abf6013bf44ce897eec3a5dccb1897583c77faeb409e52b30f3f94" Dec 04 12:09:33.505155 master-0 kubenswrapper[35367]: E1204 12:09:33.504917 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a6b0f1a41abf6013bf44ce897eec3a5dccb1897583c77faeb409e52b30f3f94\": container with ID starting with 7a6b0f1a41abf6013bf44ce897eec3a5dccb1897583c77faeb409e52b30f3f94 not found: ID does not exist" containerID="7a6b0f1a41abf6013bf44ce897eec3a5dccb1897583c77faeb409e52b30f3f94" Dec 04 12:09:33.505155 master-0 kubenswrapper[35367]: I1204 12:09:33.504969 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a6b0f1a41abf6013bf44ce897eec3a5dccb1897583c77faeb409e52b30f3f94"} err="failed to get container status \"7a6b0f1a41abf6013bf44ce897eec3a5dccb1897583c77faeb409e52b30f3f94\": rpc error: code = NotFound desc = could not find container \"7a6b0f1a41abf6013bf44ce897eec3a5dccb1897583c77faeb409e52b30f3f94\": container with ID starting with 7a6b0f1a41abf6013bf44ce897eec3a5dccb1897583c77faeb409e52b30f3f94 not found: ID does not exist" Dec 04 12:09:33.505155 master-0 kubenswrapper[35367]: I1204 12:09:33.504995 35367 scope.go:117] "RemoveContainer" containerID="91433051c4ed3dd110a118ddc2c2f17cc00879edcdb4b6552ea2da8d0bed8061" Dec 04 12:09:33.537200 master-0 kubenswrapper[35367]: I1204 12:09:33.532591 35367 scope.go:117] "RemoveContainer" containerID="399a60cb933df0ffd4914d14c11eb2d07eacf03ee64091ae18971b6d71cfee9b" Dec 04 12:09:33.555797 master-0 kubenswrapper[35367]: I1204 12:09:33.555600 35367 scope.go:117] "RemoveContainer" containerID="c66ae82599df5c75ce044d2837c9d0f5a6658490fd9c9a7e6b198bc7c8f6d0f0" Dec 04 12:09:33.651479 master-0 kubenswrapper[35367]: I1204 12:09:33.651433 35367 scope.go:117] "RemoveContainer" containerID="91433051c4ed3dd110a118ddc2c2f17cc00879edcdb4b6552ea2da8d0bed8061" Dec 04 12:09:33.651980 master-0 kubenswrapper[35367]: E1204 12:09:33.651926 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91433051c4ed3dd110a118ddc2c2f17cc00879edcdb4b6552ea2da8d0bed8061\": container with ID starting with 91433051c4ed3dd110a118ddc2c2f17cc00879edcdb4b6552ea2da8d0bed8061 not found: ID does not exist" containerID="91433051c4ed3dd110a118ddc2c2f17cc00879edcdb4b6552ea2da8d0bed8061" Dec 04 12:09:33.652078 master-0 kubenswrapper[35367]: I1204 12:09:33.651985 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91433051c4ed3dd110a118ddc2c2f17cc00879edcdb4b6552ea2da8d0bed8061"} err="failed to get container status \"91433051c4ed3dd110a118ddc2c2f17cc00879edcdb4b6552ea2da8d0bed8061\": rpc error: code = NotFound desc = could not find container \"91433051c4ed3dd110a118ddc2c2f17cc00879edcdb4b6552ea2da8d0bed8061\": container with ID starting with 91433051c4ed3dd110a118ddc2c2f17cc00879edcdb4b6552ea2da8d0bed8061 not found: ID does not exist" Dec 04 12:09:33.652078 master-0 kubenswrapper[35367]: I1204 12:09:33.652010 35367 scope.go:117] "RemoveContainer" containerID="399a60cb933df0ffd4914d14c11eb2d07eacf03ee64091ae18971b6d71cfee9b" Dec 04 12:09:33.652901 master-0 kubenswrapper[35367]: E1204 12:09:33.652406 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"399a60cb933df0ffd4914d14c11eb2d07eacf03ee64091ae18971b6d71cfee9b\": container with ID starting with 399a60cb933df0ffd4914d14c11eb2d07eacf03ee64091ae18971b6d71cfee9b not found: ID does not exist" containerID="399a60cb933df0ffd4914d14c11eb2d07eacf03ee64091ae18971b6d71cfee9b" Dec 04 12:09:33.652901 master-0 kubenswrapper[35367]: I1204 12:09:33.652426 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"399a60cb933df0ffd4914d14c11eb2d07eacf03ee64091ae18971b6d71cfee9b"} err="failed to get container status \"399a60cb933df0ffd4914d14c11eb2d07eacf03ee64091ae18971b6d71cfee9b\": rpc error: code = NotFound desc = could not find container \"399a60cb933df0ffd4914d14c11eb2d07eacf03ee64091ae18971b6d71cfee9b\": container with ID starting with 399a60cb933df0ffd4914d14c11eb2d07eacf03ee64091ae18971b6d71cfee9b not found: ID does not exist" Dec 04 12:09:33.652901 master-0 kubenswrapper[35367]: I1204 12:09:33.652440 35367 scope.go:117] "RemoveContainer" containerID="c66ae82599df5c75ce044d2837c9d0f5a6658490fd9c9a7e6b198bc7c8f6d0f0" Dec 04 12:09:33.652901 master-0 kubenswrapper[35367]: E1204 12:09:33.652736 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c66ae82599df5c75ce044d2837c9d0f5a6658490fd9c9a7e6b198bc7c8f6d0f0\": container with ID starting with c66ae82599df5c75ce044d2837c9d0f5a6658490fd9c9a7e6b198bc7c8f6d0f0 not found: ID does not exist" containerID="c66ae82599df5c75ce044d2837c9d0f5a6658490fd9c9a7e6b198bc7c8f6d0f0" Dec 04 12:09:33.652901 master-0 kubenswrapper[35367]: I1204 12:09:33.652789 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c66ae82599df5c75ce044d2837c9d0f5a6658490fd9c9a7e6b198bc7c8f6d0f0"} err="failed to get container status \"c66ae82599df5c75ce044d2837c9d0f5a6658490fd9c9a7e6b198bc7c8f6d0f0\": rpc error: code = NotFound desc = could not find container \"c66ae82599df5c75ce044d2837c9d0f5a6658490fd9c9a7e6b198bc7c8f6d0f0\": container with ID starting with c66ae82599df5c75ce044d2837c9d0f5a6658490fd9c9a7e6b198bc7c8f6d0f0 not found: ID does not exist" Dec 04 12:09:33.652901 master-0 kubenswrapper[35367]: I1204 12:09:33.652840 35367 scope.go:117] "RemoveContainer" containerID="d3382182c0711e7e570d1be95249b1c4086cf837be9ff59228a2076596b4b7d6" Dec 04 12:09:33.675632 master-0 kubenswrapper[35367]: I1204 12:09:33.675549 35367 scope.go:117] "RemoveContainer" containerID="ccbfa971ce10ce80ece76db21d329b5536317f531f46326eafb15e4b5067cc8e" Dec 04 12:09:33.722426 master-0 kubenswrapper[35367]: I1204 12:09:33.722364 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-rxp4h"] Dec 04 12:09:33.731422 master-0 kubenswrapper[35367]: I1204 12:09:33.731357 35367 scope.go:117] "RemoveContainer" containerID="9c8e124675e9725ba55a905a966d8d3ef44987fb357aee12d91d2a425dc44d00" Dec 04 12:09:33.742612 master-0 kubenswrapper[35367]: I1204 12:09:33.741640 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-rxp4h"] Dec 04 12:09:33.774792 master-0 kubenswrapper[35367]: I1204 12:09:33.774211 35367 scope.go:117] "RemoveContainer" containerID="d3382182c0711e7e570d1be95249b1c4086cf837be9ff59228a2076596b4b7d6" Dec 04 12:09:33.775385 master-0 kubenswrapper[35367]: E1204 12:09:33.775333 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3382182c0711e7e570d1be95249b1c4086cf837be9ff59228a2076596b4b7d6\": container with ID starting with d3382182c0711e7e570d1be95249b1c4086cf837be9ff59228a2076596b4b7d6 not found: ID does not exist" containerID="d3382182c0711e7e570d1be95249b1c4086cf837be9ff59228a2076596b4b7d6" Dec 04 12:09:33.775493 master-0 kubenswrapper[35367]: I1204 12:09:33.775393 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3382182c0711e7e570d1be95249b1c4086cf837be9ff59228a2076596b4b7d6"} err="failed to get container status \"d3382182c0711e7e570d1be95249b1c4086cf837be9ff59228a2076596b4b7d6\": rpc error: code = NotFound desc = could not find container \"d3382182c0711e7e570d1be95249b1c4086cf837be9ff59228a2076596b4b7d6\": container with ID starting with d3382182c0711e7e570d1be95249b1c4086cf837be9ff59228a2076596b4b7d6 not found: ID does not exist" Dec 04 12:09:33.775493 master-0 kubenswrapper[35367]: I1204 12:09:33.775429 35367 scope.go:117] "RemoveContainer" containerID="ccbfa971ce10ce80ece76db21d329b5536317f531f46326eafb15e4b5067cc8e" Dec 04 12:09:33.775951 master-0 kubenswrapper[35367]: E1204 12:09:33.775841 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccbfa971ce10ce80ece76db21d329b5536317f531f46326eafb15e4b5067cc8e\": container with ID starting with ccbfa971ce10ce80ece76db21d329b5536317f531f46326eafb15e4b5067cc8e not found: ID does not exist" containerID="ccbfa971ce10ce80ece76db21d329b5536317f531f46326eafb15e4b5067cc8e" Dec 04 12:09:33.775951 master-0 kubenswrapper[35367]: I1204 12:09:33.775872 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccbfa971ce10ce80ece76db21d329b5536317f531f46326eafb15e4b5067cc8e"} err="failed to get container status \"ccbfa971ce10ce80ece76db21d329b5536317f531f46326eafb15e4b5067cc8e\": rpc error: code = NotFound desc = could not find container \"ccbfa971ce10ce80ece76db21d329b5536317f531f46326eafb15e4b5067cc8e\": container with ID starting with ccbfa971ce10ce80ece76db21d329b5536317f531f46326eafb15e4b5067cc8e not found: ID does not exist" Dec 04 12:09:33.775951 master-0 kubenswrapper[35367]: I1204 12:09:33.775889 35367 scope.go:117] "RemoveContainer" containerID="9c8e124675e9725ba55a905a966d8d3ef44987fb357aee12d91d2a425dc44d00" Dec 04 12:09:33.776383 master-0 kubenswrapper[35367]: E1204 12:09:33.776361 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c8e124675e9725ba55a905a966d8d3ef44987fb357aee12d91d2a425dc44d00\": container with ID starting with 9c8e124675e9725ba55a905a966d8d3ef44987fb357aee12d91d2a425dc44d00 not found: ID does not exist" containerID="9c8e124675e9725ba55a905a966d8d3ef44987fb357aee12d91d2a425dc44d00" Dec 04 12:09:33.776383 master-0 kubenswrapper[35367]: I1204 12:09:33.776381 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c8e124675e9725ba55a905a966d8d3ef44987fb357aee12d91d2a425dc44d00"} err="failed to get container status \"9c8e124675e9725ba55a905a966d8d3ef44987fb357aee12d91d2a425dc44d00\": rpc error: code = NotFound desc = could not find container \"9c8e124675e9725ba55a905a966d8d3ef44987fb357aee12d91d2a425dc44d00\": container with ID starting with 9c8e124675e9725ba55a905a966d8d3ef44987fb357aee12d91d2a425dc44d00 not found: ID does not exist" Dec 04 12:09:33.902982 master-0 kubenswrapper[35367]: I1204 12:09:33.902282 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.080094 master-0 kubenswrapper[35367]: I1204 12:09:34.079392 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"136126db-b6ad-440f-8add-e9e206ec25c6\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " Dec 04 12:09:34.080094 master-0 kubenswrapper[35367]: I1204 12:09:34.079565 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/136126db-b6ad-440f-8add-e9e206ec25c6-prometheus-k8s-db\") pod \"136126db-b6ad-440f-8add-e9e206ec25c6\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " Dec 04 12:09:34.080094 master-0 kubenswrapper[35367]: I1204 12:09:34.079603 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-metrics-client-certs\") pod \"136126db-b6ad-440f-8add-e9e206ec25c6\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " Dec 04 12:09:34.080094 master-0 kubenswrapper[35367]: I1204 12:09:34.079627 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bbjd\" (UniqueName: \"kubernetes.io/projected/136126db-b6ad-440f-8add-e9e206ec25c6-kube-api-access-9bbjd\") pod \"136126db-b6ad-440f-8add-e9e206ec25c6\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " Dec 04 12:09:34.080094 master-0 kubenswrapper[35367]: I1204 12:09:34.079667 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/136126db-b6ad-440f-8add-e9e206ec25c6-tls-assets\") pod \"136126db-b6ad-440f-8add-e9e206ec25c6\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " Dec 04 12:09:34.080094 master-0 kubenswrapper[35367]: I1204 12:09:34.079712 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-configmap-kubelet-serving-ca-bundle\") pod \"136126db-b6ad-440f-8add-e9e206ec25c6\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " Dec 04 12:09:34.080094 master-0 kubenswrapper[35367]: I1204 12:09:34.079740 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-configmap-serving-certs-ca-bundle\") pod \"136126db-b6ad-440f-8add-e9e206ec25c6\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " Dec 04 12:09:34.080094 master-0 kubenswrapper[35367]: I1204 12:09:34.079775 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-grpc-tls\") pod \"136126db-b6ad-440f-8add-e9e206ec25c6\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " Dec 04 12:09:34.080094 master-0 kubenswrapper[35367]: I1204 12:09:34.079861 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-configmap-metrics-client-ca\") pod \"136126db-b6ad-440f-8add-e9e206ec25c6\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " Dec 04 12:09:34.080660 master-0 kubenswrapper[35367]: I1204 12:09:34.080490 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "136126db-b6ad-440f-8add-e9e206ec25c6" (UID: "136126db-b6ad-440f-8add-e9e206ec25c6"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:09:34.080933 master-0 kubenswrapper[35367]: I1204 12:09:34.080891 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-web-config\") pod \"136126db-b6ad-440f-8add-e9e206ec25c6\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " Dec 04 12:09:34.081069 master-0 kubenswrapper[35367]: I1204 12:09:34.081048 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-prometheus-trusted-ca-bundle\") pod \"136126db-b6ad-440f-8add-e9e206ec25c6\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " Dec 04 12:09:34.081210 master-0 kubenswrapper[35367]: I1204 12:09:34.081190 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"136126db-b6ad-440f-8add-e9e206ec25c6\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " Dec 04 12:09:34.081330 master-0 kubenswrapper[35367]: I1204 12:09:34.081309 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-prometheus-k8s-tls\") pod \"136126db-b6ad-440f-8add-e9e206ec25c6\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " Dec 04 12:09:34.081457 master-0 kubenswrapper[35367]: I1204 12:09:34.081441 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/136126db-b6ad-440f-8add-e9e206ec25c6-config-out\") pod \"136126db-b6ad-440f-8add-e9e206ec25c6\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " Dec 04 12:09:34.081579 master-0 kubenswrapper[35367]: I1204 12:09:34.081295 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136126db-b6ad-440f-8add-e9e206ec25c6-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "136126db-b6ad-440f-8add-e9e206ec25c6" (UID: "136126db-b6ad-440f-8add-e9e206ec25c6"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:34.081668 master-0 kubenswrapper[35367]: I1204 12:09:34.081648 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-kube-rbac-proxy\") pod \"136126db-b6ad-440f-8add-e9e206ec25c6\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " Dec 04 12:09:34.081778 master-0 kubenswrapper[35367]: I1204 12:09:34.081762 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-config\") pod \"136126db-b6ad-440f-8add-e9e206ec25c6\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " Dec 04 12:09:34.081945 master-0 kubenswrapper[35367]: I1204 12:09:34.081924 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-thanos-prometheus-http-client-file\") pod \"136126db-b6ad-440f-8add-e9e206ec25c6\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " Dec 04 12:09:34.082094 master-0 kubenswrapper[35367]: I1204 12:09:34.082076 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-prometheus-k8s-rulefiles-0\") pod \"136126db-b6ad-440f-8add-e9e206ec25c6\" (UID: \"136126db-b6ad-440f-8add-e9e206ec25c6\") " Dec 04 12:09:34.082484 master-0 kubenswrapper[35367]: I1204 12:09:34.082075 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "136126db-b6ad-440f-8add-e9e206ec25c6" (UID: "136126db-b6ad-440f-8add-e9e206ec25c6"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:09:34.082557 master-0 kubenswrapper[35367]: I1204 12:09:34.082119 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "136126db-b6ad-440f-8add-e9e206ec25c6" (UID: "136126db-b6ad-440f-8add-e9e206ec25c6"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:09:34.082557 master-0 kubenswrapper[35367]: I1204 12:09:34.082334 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "136126db-b6ad-440f-8add-e9e206ec25c6" (UID: "136126db-b6ad-440f-8add-e9e206ec25c6"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:09:34.082966 master-0 kubenswrapper[35367]: I1204 12:09:34.082914 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "136126db-b6ad-440f-8add-e9e206ec25c6" (UID: "136126db-b6ad-440f-8add-e9e206ec25c6"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:09:34.083199 master-0 kubenswrapper[35367]: I1204 12:09:34.083174 35367 reconciler_common.go:293] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:34.086708 master-0 kubenswrapper[35367]: I1204 12:09:34.083545 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/136126db-b6ad-440f-8add-e9e206ec25c6-kube-api-access-9bbjd" (OuterVolumeSpecName: "kube-api-access-9bbjd") pod "136126db-b6ad-440f-8add-e9e206ec25c6" (UID: "136126db-b6ad-440f-8add-e9e206ec25c6"). InnerVolumeSpecName "kube-api-access-9bbjd". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:34.086708 master-0 kubenswrapper[35367]: I1204 12:09:34.083631 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "136126db-b6ad-440f-8add-e9e206ec25c6" (UID: "136126db-b6ad-440f-8add-e9e206ec25c6"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:09:34.086708 master-0 kubenswrapper[35367]: I1204 12:09:34.083912 35367 reconciler_common.go:293] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/136126db-b6ad-440f-8add-e9e206ec25c6-prometheus-k8s-db\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:34.086708 master-0 kubenswrapper[35367]: I1204 12:09:34.083999 35367 reconciler_common.go:293] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-configmap-kubelet-serving-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:34.086708 master-0 kubenswrapper[35367]: I1204 12:09:34.084033 35367 reconciler_common.go:293] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-configmap-serving-certs-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:34.086708 master-0 kubenswrapper[35367]: I1204 12:09:34.084069 35367 reconciler_common.go:293] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-configmap-metrics-client-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:34.086708 master-0 kubenswrapper[35367]: I1204 12:09:34.084087 35367 reconciler_common.go:293] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-prometheus-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:34.086708 master-0 kubenswrapper[35367]: I1204 12:09:34.084482 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136126db-b6ad-440f-8add-e9e206ec25c6-config-out" (OuterVolumeSpecName: "config-out") pod "136126db-b6ad-440f-8add-e9e206ec25c6" (UID: "136126db-b6ad-440f-8add-e9e206ec25c6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:34.086708 master-0 kubenswrapper[35367]: I1204 12:09:34.085113 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/136126db-b6ad-440f-8add-e9e206ec25c6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "136126db-b6ad-440f-8add-e9e206ec25c6" (UID: "136126db-b6ad-440f-8add-e9e206ec25c6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:34.086708 master-0 kubenswrapper[35367]: I1204 12:09:34.086102 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "136126db-b6ad-440f-8add-e9e206ec25c6" (UID: "136126db-b6ad-440f-8add-e9e206ec25c6"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:09:34.086708 master-0 kubenswrapper[35367]: I1204 12:09:34.086348 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-2xqkk" Dec 04 12:09:34.086708 master-0 kubenswrapper[35367]: I1204 12:09:34.086160 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "136126db-b6ad-440f-8add-e9e206ec25c6" (UID: "136126db-b6ad-440f-8add-e9e206ec25c6"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:09:34.086708 master-0 kubenswrapper[35367]: I1204 12:09:34.086408 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-2xqkk" Dec 04 12:09:34.087489 master-0 kubenswrapper[35367]: I1204 12:09:34.086753 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "136126db-b6ad-440f-8add-e9e206ec25c6" (UID: "136126db-b6ad-440f-8add-e9e206ec25c6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:09:34.087489 master-0 kubenswrapper[35367]: I1204 12:09:34.087431 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "136126db-b6ad-440f-8add-e9e206ec25c6" (UID: "136126db-b6ad-440f-8add-e9e206ec25c6"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:09:34.088488 master-0 kubenswrapper[35367]: I1204 12:09:34.088452 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-config" (OuterVolumeSpecName: "config") pod "136126db-b6ad-440f-8add-e9e206ec25c6" (UID: "136126db-b6ad-440f-8add-e9e206ec25c6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:09:34.089122 master-0 kubenswrapper[35367]: I1204 12:09:34.089080 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "136126db-b6ad-440f-8add-e9e206ec25c6" (UID: "136126db-b6ad-440f-8add-e9e206ec25c6"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:09:34.089330 master-0 kubenswrapper[35367]: I1204 12:09:34.089277 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "136126db-b6ad-440f-8add-e9e206ec25c6" (UID: "136126db-b6ad-440f-8add-e9e206ec25c6"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:09:34.130364 master-0 kubenswrapper[35367]: I1204 12:09:34.130305 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-2xqkk" Dec 04 12:09:34.137876 master-0 kubenswrapper[35367]: I1204 12:09:34.134270 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-web-config" (OuterVolumeSpecName: "web-config") pod "136126db-b6ad-440f-8add-e9e206ec25c6" (UID: "136126db-b6ad-440f-8add-e9e206ec25c6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:09:34.185963 master-0 kubenswrapper[35367]: I1204 12:09:34.185888 35367 reconciler_common.go:293] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/136126db-b6ad-440f-8add-e9e206ec25c6-config-out\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:34.185963 master-0 kubenswrapper[35367]: I1204 12:09:34.185951 35367 reconciler_common.go:293] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-kube-rbac-proxy\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:34.185963 master-0 kubenswrapper[35367]: I1204 12:09:34.185967 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:34.186293 master-0 kubenswrapper[35367]: I1204 12:09:34.185981 35367 reconciler_common.go:293] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-thanos-prometheus-http-client-file\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:34.186293 master-0 kubenswrapper[35367]: I1204 12:09:34.185997 35367 reconciler_common.go:293] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/136126db-b6ad-440f-8add-e9e206ec25c6-prometheus-k8s-rulefiles-0\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:34.186293 master-0 kubenswrapper[35367]: I1204 12:09:34.186010 35367 reconciler_common.go:293] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-metrics-client-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:34.186293 master-0 kubenswrapper[35367]: I1204 12:09:34.186022 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9bbjd\" (UniqueName: \"kubernetes.io/projected/136126db-b6ad-440f-8add-e9e206ec25c6-kube-api-access-9bbjd\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:34.186293 master-0 kubenswrapper[35367]: I1204 12:09:34.186037 35367 reconciler_common.go:293] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/136126db-b6ad-440f-8add-e9e206ec25c6-tls-assets\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:34.186293 master-0 kubenswrapper[35367]: I1204 12:09:34.186048 35367 reconciler_common.go:293] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-grpc-tls\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:34.186293 master-0 kubenswrapper[35367]: I1204 12:09:34.186059 35367 reconciler_common.go:293] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-web-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:34.186293 master-0 kubenswrapper[35367]: I1204 12:09:34.186072 35367 reconciler_common.go:293] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:34.186293 master-0 kubenswrapper[35367]: I1204 12:09:34.186090 35367 reconciler_common.go:293] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/136126db-b6ad-440f-8add-e9e206ec25c6-secret-prometheus-k8s-tls\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:34.187964 master-0 kubenswrapper[35367]: I1204 12:09:34.187864 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:34.189013 master-0 kubenswrapper[35367]: I1204 12:09:34.188953 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:34.193409 master-0 kubenswrapper[35367]: I1204 12:09:34.193370 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:34.400246 master-0 kubenswrapper[35367]: I1204 12:09:34.400183 35367 generic.go:334] "Generic (PLEG): container finished" podID="136126db-b6ad-440f-8add-e9e206ec25c6" containerID="7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af" exitCode=0 Dec 04 12:09:34.400246 master-0 kubenswrapper[35367]: I1204 12:09:34.400226 35367 generic.go:334] "Generic (PLEG): container finished" podID="136126db-b6ad-440f-8add-e9e206ec25c6" containerID="1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4" exitCode=0 Dec 04 12:09:34.400246 master-0 kubenswrapper[35367]: I1204 12:09:34.400235 35367 generic.go:334] "Generic (PLEG): container finished" podID="136126db-b6ad-440f-8add-e9e206ec25c6" containerID="139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec" exitCode=0 Dec 04 12:09:34.400246 master-0 kubenswrapper[35367]: I1204 12:09:34.400245 35367 generic.go:334] "Generic (PLEG): container finished" podID="136126db-b6ad-440f-8add-e9e206ec25c6" containerID="8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710" exitCode=0 Dec 04 12:09:34.400246 master-0 kubenswrapper[35367]: I1204 12:09:34.400253 35367 generic.go:334] "Generic (PLEG): container finished" podID="136126db-b6ad-440f-8add-e9e206ec25c6" containerID="279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077" exitCode=0 Dec 04 12:09:34.400246 master-0 kubenswrapper[35367]: I1204 12:09:34.400261 35367 generic.go:334] "Generic (PLEG): container finished" podID="136126db-b6ad-440f-8add-e9e206ec25c6" containerID="d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe" exitCode=0 Dec 04 12:09:34.400634 master-0 kubenswrapper[35367]: I1204 12:09:34.400308 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136126db-b6ad-440f-8add-e9e206ec25c6","Type":"ContainerDied","Data":"7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af"} Dec 04 12:09:34.400634 master-0 kubenswrapper[35367]: I1204 12:09:34.400340 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136126db-b6ad-440f-8add-e9e206ec25c6","Type":"ContainerDied","Data":"1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4"} Dec 04 12:09:34.400634 master-0 kubenswrapper[35367]: I1204 12:09:34.400352 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136126db-b6ad-440f-8add-e9e206ec25c6","Type":"ContainerDied","Data":"139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec"} Dec 04 12:09:34.400634 master-0 kubenswrapper[35367]: I1204 12:09:34.400363 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136126db-b6ad-440f-8add-e9e206ec25c6","Type":"ContainerDied","Data":"8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710"} Dec 04 12:09:34.400634 master-0 kubenswrapper[35367]: I1204 12:09:34.400374 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136126db-b6ad-440f-8add-e9e206ec25c6","Type":"ContainerDied","Data":"279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077"} Dec 04 12:09:34.400634 master-0 kubenswrapper[35367]: I1204 12:09:34.400384 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136126db-b6ad-440f-8add-e9e206ec25c6","Type":"ContainerDied","Data":"d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe"} Dec 04 12:09:34.400634 master-0 kubenswrapper[35367]: I1204 12:09:34.400397 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136126db-b6ad-440f-8add-e9e206ec25c6","Type":"ContainerDied","Data":"8b3032b48cc2869a9eea4e05ca18a1d61a10c8efa21193017124190727356777"} Dec 04 12:09:34.400634 master-0 kubenswrapper[35367]: I1204 12:09:34.400413 35367 scope.go:117] "RemoveContainer" containerID="7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af" Dec 04 12:09:34.400859 master-0 kubenswrapper[35367]: I1204 12:09:34.400650 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.409241 master-0 kubenswrapper[35367]: I1204 12:09:34.409211 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:09:34.421352 master-0 kubenswrapper[35367]: I1204 12:09:34.420460 35367 scope.go:117] "RemoveContainer" containerID="1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4" Dec 04 12:09:34.459244 master-0 kubenswrapper[35367]: I1204 12:09:34.459139 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-2xqkk" Dec 04 12:09:34.467271 master-0 kubenswrapper[35367]: I1204 12:09:34.467072 35367 scope.go:117] "RemoveContainer" containerID="139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec" Dec 04 12:09:34.468597 master-0 kubenswrapper[35367]: I1204 12:09:34.468296 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Dec 04 12:09:34.500750 master-0 kubenswrapper[35367]: I1204 12:09:34.500582 35367 scope.go:117] "RemoveContainer" containerID="8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710" Dec 04 12:09:34.518357 master-0 kubenswrapper[35367]: I1204 12:09:34.517993 35367 scope.go:117] "RemoveContainer" containerID="279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077" Dec 04 12:09:34.534456 master-0 kubenswrapper[35367]: I1204 12:09:34.534408 35367 scope.go:117] "RemoveContainer" containerID="d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe" Dec 04 12:09:34.551660 master-0 kubenswrapper[35367]: I1204 12:09:34.551519 35367 scope.go:117] "RemoveContainer" containerID="5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6" Dec 04 12:09:34.566156 master-0 kubenswrapper[35367]: I1204 12:09:34.566095 35367 scope.go:117] "RemoveContainer" containerID="7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af" Dec 04 12:09:34.566686 master-0 kubenswrapper[35367]: E1204 12:09:34.566644 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af\": container with ID starting with 7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af not found: ID does not exist" containerID="7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af" Dec 04 12:09:34.566737 master-0 kubenswrapper[35367]: I1204 12:09:34.566689 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af"} err="failed to get container status \"7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af\": rpc error: code = NotFound desc = could not find container \"7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af\": container with ID starting with 7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af not found: ID does not exist" Dec 04 12:09:34.566737 master-0 kubenswrapper[35367]: I1204 12:09:34.566721 35367 scope.go:117] "RemoveContainer" containerID="1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4" Dec 04 12:09:34.567094 master-0 kubenswrapper[35367]: E1204 12:09:34.567049 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4\": container with ID starting with 1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4 not found: ID does not exist" containerID="1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4" Dec 04 12:09:34.567155 master-0 kubenswrapper[35367]: I1204 12:09:34.567092 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4"} err="failed to get container status \"1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4\": rpc error: code = NotFound desc = could not find container \"1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4\": container with ID starting with 1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4 not found: ID does not exist" Dec 04 12:09:34.567155 master-0 kubenswrapper[35367]: I1204 12:09:34.567111 35367 scope.go:117] "RemoveContainer" containerID="139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec" Dec 04 12:09:34.567387 master-0 kubenswrapper[35367]: E1204 12:09:34.567321 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec\": container with ID starting with 139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec not found: ID does not exist" containerID="139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec" Dec 04 12:09:34.567387 master-0 kubenswrapper[35367]: I1204 12:09:34.567355 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec"} err="failed to get container status \"139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec\": rpc error: code = NotFound desc = could not find container \"139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec\": container with ID starting with 139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec not found: ID does not exist" Dec 04 12:09:34.567387 master-0 kubenswrapper[35367]: I1204 12:09:34.567374 35367 scope.go:117] "RemoveContainer" containerID="8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710" Dec 04 12:09:34.567855 master-0 kubenswrapper[35367]: E1204 12:09:34.567610 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710\": container with ID starting with 8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710 not found: ID does not exist" containerID="8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710" Dec 04 12:09:34.567855 master-0 kubenswrapper[35367]: I1204 12:09:34.567634 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710"} err="failed to get container status \"8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710\": rpc error: code = NotFound desc = could not find container \"8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710\": container with ID starting with 8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710 not found: ID does not exist" Dec 04 12:09:34.567855 master-0 kubenswrapper[35367]: I1204 12:09:34.567650 35367 scope.go:117] "RemoveContainer" containerID="279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077" Dec 04 12:09:34.568928 master-0 kubenswrapper[35367]: E1204 12:09:34.568895 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077\": container with ID starting with 279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077 not found: ID does not exist" containerID="279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077" Dec 04 12:09:34.568997 master-0 kubenswrapper[35367]: I1204 12:09:34.568929 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077"} err="failed to get container status \"279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077\": rpc error: code = NotFound desc = could not find container \"279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077\": container with ID starting with 279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077 not found: ID does not exist" Dec 04 12:09:34.568997 master-0 kubenswrapper[35367]: I1204 12:09:34.568949 35367 scope.go:117] "RemoveContainer" containerID="d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe" Dec 04 12:09:34.569292 master-0 kubenswrapper[35367]: E1204 12:09:34.569264 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe\": container with ID starting with d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe not found: ID does not exist" containerID="d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe" Dec 04 12:09:34.569365 master-0 kubenswrapper[35367]: I1204 12:09:34.569293 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe"} err="failed to get container status \"d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe\": rpc error: code = NotFound desc = could not find container \"d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe\": container with ID starting with d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe not found: ID does not exist" Dec 04 12:09:34.569365 master-0 kubenswrapper[35367]: I1204 12:09:34.569316 35367 scope.go:117] "RemoveContainer" containerID="5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6" Dec 04 12:09:34.569685 master-0 kubenswrapper[35367]: E1204 12:09:34.569573 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6\": container with ID starting with 5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6 not found: ID does not exist" containerID="5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6" Dec 04 12:09:34.569685 master-0 kubenswrapper[35367]: I1204 12:09:34.569602 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6"} err="failed to get container status \"5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6\": rpc error: code = NotFound desc = could not find container \"5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6\": container with ID starting with 5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6 not found: ID does not exist" Dec 04 12:09:34.569685 master-0 kubenswrapper[35367]: I1204 12:09:34.569620 35367 scope.go:117] "RemoveContainer" containerID="7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af" Dec 04 12:09:34.569997 master-0 kubenswrapper[35367]: I1204 12:09:34.569896 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af"} err="failed to get container status \"7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af\": rpc error: code = NotFound desc = could not find container \"7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af\": container with ID starting with 7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af not found: ID does not exist" Dec 04 12:09:34.569997 master-0 kubenswrapper[35367]: I1204 12:09:34.569924 35367 scope.go:117] "RemoveContainer" containerID="1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4" Dec 04 12:09:34.570279 master-0 kubenswrapper[35367]: I1204 12:09:34.570225 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4"} err="failed to get container status \"1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4\": rpc error: code = NotFound desc = could not find container \"1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4\": container with ID starting with 1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4 not found: ID does not exist" Dec 04 12:09:34.570358 master-0 kubenswrapper[35367]: I1204 12:09:34.570284 35367 scope.go:117] "RemoveContainer" containerID="139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec" Dec 04 12:09:34.570583 master-0 kubenswrapper[35367]: I1204 12:09:34.570552 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec"} err="failed to get container status \"139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec\": rpc error: code = NotFound desc = could not find container \"139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec\": container with ID starting with 139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec not found: ID does not exist" Dec 04 12:09:34.570669 master-0 kubenswrapper[35367]: I1204 12:09:34.570582 35367 scope.go:117] "RemoveContainer" containerID="8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710" Dec 04 12:09:34.570867 master-0 kubenswrapper[35367]: I1204 12:09:34.570845 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710"} err="failed to get container status \"8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710\": rpc error: code = NotFound desc = could not find container \"8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710\": container with ID starting with 8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710 not found: ID does not exist" Dec 04 12:09:34.570867 master-0 kubenswrapper[35367]: I1204 12:09:34.570866 35367 scope.go:117] "RemoveContainer" containerID="279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077" Dec 04 12:09:34.571096 master-0 kubenswrapper[35367]: I1204 12:09:34.571077 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077"} err="failed to get container status \"279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077\": rpc error: code = NotFound desc = could not find container \"279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077\": container with ID starting with 279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077 not found: ID does not exist" Dec 04 12:09:34.571096 master-0 kubenswrapper[35367]: I1204 12:09:34.571094 35367 scope.go:117] "RemoveContainer" containerID="d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe" Dec 04 12:09:34.571366 master-0 kubenswrapper[35367]: I1204 12:09:34.571326 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe"} err="failed to get container status \"d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe\": rpc error: code = NotFound desc = could not find container \"d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe\": container with ID starting with d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe not found: ID does not exist" Dec 04 12:09:34.571366 master-0 kubenswrapper[35367]: I1204 12:09:34.571354 35367 scope.go:117] "RemoveContainer" containerID="5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6" Dec 04 12:09:34.571614 master-0 kubenswrapper[35367]: I1204 12:09:34.571590 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6"} err="failed to get container status \"5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6\": rpc error: code = NotFound desc = could not find container \"5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6\": container with ID starting with 5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6 not found: ID does not exist" Dec 04 12:09:34.571694 master-0 kubenswrapper[35367]: I1204 12:09:34.571614 35367 scope.go:117] "RemoveContainer" containerID="7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af" Dec 04 12:09:34.571877 master-0 kubenswrapper[35367]: I1204 12:09:34.571852 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af"} err="failed to get container status \"7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af\": rpc error: code = NotFound desc = could not find container \"7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af\": container with ID starting with 7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af not found: ID does not exist" Dec 04 12:09:34.571877 master-0 kubenswrapper[35367]: I1204 12:09:34.571871 35367 scope.go:117] "RemoveContainer" containerID="1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4" Dec 04 12:09:34.572198 master-0 kubenswrapper[35367]: I1204 12:09:34.572112 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4"} err="failed to get container status \"1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4\": rpc error: code = NotFound desc = could not find container \"1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4\": container with ID starting with 1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4 not found: ID does not exist" Dec 04 12:09:34.572198 master-0 kubenswrapper[35367]: I1204 12:09:34.572138 35367 scope.go:117] "RemoveContainer" containerID="139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec" Dec 04 12:09:34.572493 master-0 kubenswrapper[35367]: I1204 12:09:34.572460 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec"} err="failed to get container status \"139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec\": rpc error: code = NotFound desc = could not find container \"139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec\": container with ID starting with 139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec not found: ID does not exist" Dec 04 12:09:34.572493 master-0 kubenswrapper[35367]: I1204 12:09:34.572484 35367 scope.go:117] "RemoveContainer" containerID="8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710" Dec 04 12:09:34.572792 master-0 kubenswrapper[35367]: I1204 12:09:34.572761 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710"} err="failed to get container status \"8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710\": rpc error: code = NotFound desc = could not find container \"8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710\": container with ID starting with 8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710 not found: ID does not exist" Dec 04 12:09:34.572792 master-0 kubenswrapper[35367]: I1204 12:09:34.572786 35367 scope.go:117] "RemoveContainer" containerID="279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077" Dec 04 12:09:34.573212 master-0 kubenswrapper[35367]: I1204 12:09:34.573122 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077"} err="failed to get container status \"279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077\": rpc error: code = NotFound desc = could not find container \"279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077\": container with ID starting with 279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077 not found: ID does not exist" Dec 04 12:09:34.573212 master-0 kubenswrapper[35367]: I1204 12:09:34.573150 35367 scope.go:117] "RemoveContainer" containerID="d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe" Dec 04 12:09:34.573473 master-0 kubenswrapper[35367]: I1204 12:09:34.573446 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe"} err="failed to get container status \"d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe\": rpc error: code = NotFound desc = could not find container \"d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe\": container with ID starting with d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe not found: ID does not exist" Dec 04 12:09:34.573551 master-0 kubenswrapper[35367]: I1204 12:09:34.573472 35367 scope.go:117] "RemoveContainer" containerID="5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6" Dec 04 12:09:34.573845 master-0 kubenswrapper[35367]: I1204 12:09:34.573821 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6"} err="failed to get container status \"5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6\": rpc error: code = NotFound desc = could not find container \"5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6\": container with ID starting with 5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6 not found: ID does not exist" Dec 04 12:09:34.573845 master-0 kubenswrapper[35367]: I1204 12:09:34.573841 35367 scope.go:117] "RemoveContainer" containerID="7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af" Dec 04 12:09:34.574141 master-0 kubenswrapper[35367]: I1204 12:09:34.574052 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af"} err="failed to get container status \"7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af\": rpc error: code = NotFound desc = could not find container \"7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af\": container with ID starting with 7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af not found: ID does not exist" Dec 04 12:09:34.574141 master-0 kubenswrapper[35367]: I1204 12:09:34.574078 35367 scope.go:117] "RemoveContainer" containerID="1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4" Dec 04 12:09:34.574329 master-0 kubenswrapper[35367]: I1204 12:09:34.574309 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4"} err="failed to get container status \"1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4\": rpc error: code = NotFound desc = could not find container \"1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4\": container with ID starting with 1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4 not found: ID does not exist" Dec 04 12:09:34.574329 master-0 kubenswrapper[35367]: I1204 12:09:34.574327 35367 scope.go:117] "RemoveContainer" containerID="139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec" Dec 04 12:09:34.575123 master-0 kubenswrapper[35367]: I1204 12:09:34.575054 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec"} err="failed to get container status \"139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec\": rpc error: code = NotFound desc = could not find container \"139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec\": container with ID starting with 139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec not found: ID does not exist" Dec 04 12:09:34.575123 master-0 kubenswrapper[35367]: I1204 12:09:34.575115 35367 scope.go:117] "RemoveContainer" containerID="8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710" Dec 04 12:09:34.575987 master-0 kubenswrapper[35367]: I1204 12:09:34.575723 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710"} err="failed to get container status \"8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710\": rpc error: code = NotFound desc = could not find container \"8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710\": container with ID starting with 8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710 not found: ID does not exist" Dec 04 12:09:34.575987 master-0 kubenswrapper[35367]: I1204 12:09:34.575979 35367 scope.go:117] "RemoveContainer" containerID="279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077" Dec 04 12:09:34.581355 master-0 kubenswrapper[35367]: I1204 12:09:34.581270 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077"} err="failed to get container status \"279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077\": rpc error: code = NotFound desc = could not find container \"279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077\": container with ID starting with 279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077 not found: ID does not exist" Dec 04 12:09:34.581355 master-0 kubenswrapper[35367]: I1204 12:09:34.581331 35367 scope.go:117] "RemoveContainer" containerID="d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe" Dec 04 12:09:34.581899 master-0 kubenswrapper[35367]: I1204 12:09:34.581863 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe"} err="failed to get container status \"d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe\": rpc error: code = NotFound desc = could not find container \"d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe\": container with ID starting with d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe not found: ID does not exist" Dec 04 12:09:34.581899 master-0 kubenswrapper[35367]: I1204 12:09:34.581888 35367 scope.go:117] "RemoveContainer" containerID="5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6" Dec 04 12:09:34.582302 master-0 kubenswrapper[35367]: I1204 12:09:34.582243 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6"} err="failed to get container status \"5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6\": rpc error: code = NotFound desc = could not find container \"5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6\": container with ID starting with 5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6 not found: ID does not exist" Dec 04 12:09:34.582302 master-0 kubenswrapper[35367]: I1204 12:09:34.582291 35367 scope.go:117] "RemoveContainer" containerID="7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af" Dec 04 12:09:34.582584 master-0 kubenswrapper[35367]: I1204 12:09:34.582543 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af"} err="failed to get container status \"7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af\": rpc error: code = NotFound desc = could not find container \"7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af\": container with ID starting with 7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af not found: ID does not exist" Dec 04 12:09:34.582584 master-0 kubenswrapper[35367]: I1204 12:09:34.582561 35367 scope.go:117] "RemoveContainer" containerID="1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4" Dec 04 12:09:34.583983 master-0 kubenswrapper[35367]: I1204 12:09:34.582949 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4"} err="failed to get container status \"1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4\": rpc error: code = NotFound desc = could not find container \"1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4\": container with ID starting with 1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4 not found: ID does not exist" Dec 04 12:09:34.583983 master-0 kubenswrapper[35367]: I1204 12:09:34.582968 35367 scope.go:117] "RemoveContainer" containerID="139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec" Dec 04 12:09:34.585290 master-0 kubenswrapper[35367]: I1204 12:09:34.585239 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec"} err="failed to get container status \"139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec\": rpc error: code = NotFound desc = could not find container \"139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec\": container with ID starting with 139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec not found: ID does not exist" Dec 04 12:09:34.585381 master-0 kubenswrapper[35367]: I1204 12:09:34.585292 35367 scope.go:117] "RemoveContainer" containerID="8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710" Dec 04 12:09:34.590860 master-0 kubenswrapper[35367]: I1204 12:09:34.587403 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710"} err="failed to get container status \"8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710\": rpc error: code = NotFound desc = could not find container \"8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710\": container with ID starting with 8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710 not found: ID does not exist" Dec 04 12:09:34.590860 master-0 kubenswrapper[35367]: I1204 12:09:34.587474 35367 scope.go:117] "RemoveContainer" containerID="279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077" Dec 04 12:09:34.590860 master-0 kubenswrapper[35367]: I1204 12:09:34.590116 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077"} err="failed to get container status \"279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077\": rpc error: code = NotFound desc = could not find container \"279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077\": container with ID starting with 279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077 not found: ID does not exist" Dec 04 12:09:34.590860 master-0 kubenswrapper[35367]: I1204 12:09:34.590165 35367 scope.go:117] "RemoveContainer" containerID="d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe" Dec 04 12:09:34.593321 master-0 kubenswrapper[35367]: I1204 12:09:34.593217 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe"} err="failed to get container status \"d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe\": rpc error: code = NotFound desc = could not find container \"d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe\": container with ID starting with d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe not found: ID does not exist" Dec 04 12:09:34.593321 master-0 kubenswrapper[35367]: I1204 12:09:34.593263 35367 scope.go:117] "RemoveContainer" containerID="5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6" Dec 04 12:09:34.604828 master-0 kubenswrapper[35367]: I1204 12:09:34.594408 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6"} err="failed to get container status \"5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6\": rpc error: code = NotFound desc = could not find container \"5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6\": container with ID starting with 5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6 not found: ID does not exist" Dec 04 12:09:34.604828 master-0 kubenswrapper[35367]: I1204 12:09:34.594494 35367 scope.go:117] "RemoveContainer" containerID="7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af" Dec 04 12:09:34.604828 master-0 kubenswrapper[35367]: I1204 12:09:34.596795 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af"} err="failed to get container status \"7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af\": rpc error: code = NotFound desc = could not find container \"7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af\": container with ID starting with 7f5740289f7c68f19d045684f6647770f1986652e1fd04bdba6a4f8f5773e2af not found: ID does not exist" Dec 04 12:09:34.604828 master-0 kubenswrapper[35367]: I1204 12:09:34.596854 35367 scope.go:117] "RemoveContainer" containerID="1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4" Dec 04 12:09:34.607385 master-0 kubenswrapper[35367]: I1204 12:09:34.606515 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4"} err="failed to get container status \"1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4\": rpc error: code = NotFound desc = could not find container \"1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4\": container with ID starting with 1066dcb7b41233a60373dd85a5132af0e01474ef2479eb2983b6f56ea3b054e4 not found: ID does not exist" Dec 04 12:09:34.607385 master-0 kubenswrapper[35367]: I1204 12:09:34.606570 35367 scope.go:117] "RemoveContainer" containerID="139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec" Dec 04 12:09:34.607385 master-0 kubenswrapper[35367]: I1204 12:09:34.607297 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec"} err="failed to get container status \"139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec\": rpc error: code = NotFound desc = could not find container \"139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec\": container with ID starting with 139fe06cbf6f54660bf76f7c0933eaf658d868fdf1c5c037690dc5b9ec5d4fec not found: ID does not exist" Dec 04 12:09:34.607385 master-0 kubenswrapper[35367]: I1204 12:09:34.607366 35367 scope.go:117] "RemoveContainer" containerID="8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710" Dec 04 12:09:34.607791 master-0 kubenswrapper[35367]: I1204 12:09:34.607742 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710"} err="failed to get container status \"8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710\": rpc error: code = NotFound desc = could not find container \"8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710\": container with ID starting with 8767b6ba9c28a86a79762e6e874fb99a411511d452b977b25ab932cd50da4710 not found: ID does not exist" Dec 04 12:09:34.607791 master-0 kubenswrapper[35367]: I1204 12:09:34.607779 35367 scope.go:117] "RemoveContainer" containerID="279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077" Dec 04 12:09:34.617118 master-0 kubenswrapper[35367]: I1204 12:09:34.615693 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077"} err="failed to get container status \"279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077\": rpc error: code = NotFound desc = could not find container \"279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077\": container with ID starting with 279b20e0aa8f34a83cf4545254499d20a5695e147ee424bcc550fd9bba763077 not found: ID does not exist" Dec 04 12:09:34.617118 master-0 kubenswrapper[35367]: I1204 12:09:34.615753 35367 scope.go:117] "RemoveContainer" containerID="d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe" Dec 04 12:09:34.617118 master-0 kubenswrapper[35367]: I1204 12:09:34.616205 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe"} err="failed to get container status \"d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe\": rpc error: code = NotFound desc = could not find container \"d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe\": container with ID starting with d6b00af4a25bf3c99ad051aea7e45613b416415de3b42039312a2fa94a9555fe not found: ID does not exist" Dec 04 12:09:34.617118 master-0 kubenswrapper[35367]: I1204 12:09:34.616225 35367 scope.go:117] "RemoveContainer" containerID="5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6" Dec 04 12:09:34.617118 master-0 kubenswrapper[35367]: I1204 12:09:34.616487 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6"} err="failed to get container status \"5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6\": rpc error: code = NotFound desc = could not find container \"5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6\": container with ID starting with 5c36d837fb05680c602b8ddde50d527501e863a81865bee1fdfaea800c0954f6 not found: ID does not exist" Dec 04 12:09:34.618336 master-0 kubenswrapper[35367]: I1204 12:09:34.618245 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75b84c855f-2zcgd"] Dec 04 12:09:34.635082 master-0 kubenswrapper[35367]: I1204 12:09:34.635011 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: I1204 12:09:34.657993 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: E1204 12:09:34.658501 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="78de4935-3e4c-4f6f-bbb5-d592c35b47da" containerName="extract-utilities" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: I1204 12:09:34.658519 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="78de4935-3e4c-4f6f-bbb5-d592c35b47da" containerName="extract-utilities" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: E1204 12:09:34.658537 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fcfbd087-b1aa-47da-a672-cde747408887" containerName="extract-utilities" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: I1204 12:09:34.658545 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcfbd087-b1aa-47da-a672-cde747408887" containerName="extract-utilities" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: E1204 12:09:34.658559 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5b2522d3-a2e9-435f-971f-9cc73721e99c" containerName="extract-utilities" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: I1204 12:09:34.658567 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b2522d3-a2e9-435f-971f-9cc73721e99c" containerName="extract-utilities" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: E1204 12:09:34.658586 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5b2522d3-a2e9-435f-971f-9cc73721e99c" containerName="extract-content" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: I1204 12:09:34.658594 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b2522d3-a2e9-435f-971f-9cc73721e99c" containerName="extract-content" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: E1204 12:09:34.658611 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="14fef399-4e8f-4867-ace9-3b273117f886" containerName="extract-utilities" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: I1204 12:09:34.658620 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="14fef399-4e8f-4867-ace9-3b273117f886" containerName="extract-utilities" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: E1204 12:09:34.658629 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f4283051-9a72-4bab-b4e9-0fcff55962f9" containerName="registry-server" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: I1204 12:09:34.658638 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4283051-9a72-4bab-b4e9-0fcff55962f9" containerName="registry-server" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: E1204 12:09:34.658655 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2297684c-a98b-441c-8913-b5e9f39a2570" containerName="registry-server" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: I1204 12:09:34.658663 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="2297684c-a98b-441c-8913-b5e9f39a2570" containerName="registry-server" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: E1204 12:09:34.658676 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fcfbd087-b1aa-47da-a672-cde747408887" containerName="extract-content" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: I1204 12:09:34.658684 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcfbd087-b1aa-47da-a672-cde747408887" containerName="extract-content" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: E1204 12:09:34.658700 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="kube-rbac-proxy-thanos" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: I1204 12:09:34.658709 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="kube-rbac-proxy-thanos" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: E1204 12:09:34.658719 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6b275f26-6d4a-40a3-8dee-c58ae09c0263" containerName="extract-utilities" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: I1204 12:09:34.658727 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b275f26-6d4a-40a3-8dee-c58ae09c0263" containerName="extract-utilities" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: E1204 12:09:34.658739 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="kube-rbac-proxy-web" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: I1204 12:09:34.658747 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="kube-rbac-proxy-web" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: E1204 12:09:34.658762 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="78de4935-3e4c-4f6f-bbb5-d592c35b47da" containerName="extract-content" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: I1204 12:09:34.658770 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="78de4935-3e4c-4f6f-bbb5-d592c35b47da" containerName="extract-content" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: E1204 12:09:34.658788 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6b275f26-6d4a-40a3-8dee-c58ae09c0263" containerName="extract-content" Dec 04 12:09:34.658855 master-0 kubenswrapper[35367]: I1204 12:09:34.658796 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b275f26-6d4a-40a3-8dee-c58ae09c0263" containerName="extract-content" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: E1204 12:09:34.659462 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="414ce51b-cd2f-4311-96e0-bd80fb0ae666" containerName="extract-content" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: I1204 12:09:34.659476 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="414ce51b-cd2f-4311-96e0-bd80fb0ae666" containerName="extract-content" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: E1204 12:09:34.659500 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0ed2adcc-5493-4adc-ad40-40df2b8dbd2d" containerName="extract-content" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: I1204 12:09:34.659509 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ed2adcc-5493-4adc-ad40-40df2b8dbd2d" containerName="extract-content" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: E1204 12:09:34.659520 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="kube-rbac-proxy" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: I1204 12:09:34.659527 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="kube-rbac-proxy" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: E1204 12:09:34.659539 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="414ce51b-cd2f-4311-96e0-bd80fb0ae666" containerName="registry-server" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: I1204 12:09:34.659546 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="414ce51b-cd2f-4311-96e0-bd80fb0ae666" containerName="registry-server" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: E1204 12:09:34.659559 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="init-config-reloader" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: I1204 12:09:34.659567 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="init-config-reloader" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: E1204 12:09:34.659580 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="414ce51b-cd2f-4311-96e0-bd80fb0ae666" containerName="extract-utilities" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: I1204 12:09:34.659587 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="414ce51b-cd2f-4311-96e0-bd80fb0ae666" containerName="extract-utilities" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: E1204 12:09:34.659598 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="14fef399-4e8f-4867-ace9-3b273117f886" containerName="extract-content" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: I1204 12:09:34.659605 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="14fef399-4e8f-4867-ace9-3b273117f886" containerName="extract-content" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: E1204 12:09:34.659618 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2297684c-a98b-441c-8913-b5e9f39a2570" containerName="extract-utilities" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: I1204 12:09:34.659625 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="2297684c-a98b-441c-8913-b5e9f39a2570" containerName="extract-utilities" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: E1204 12:09:34.659642 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0ed2adcc-5493-4adc-ad40-40df2b8dbd2d" containerName="registry-server" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: I1204 12:09:34.659649 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ed2adcc-5493-4adc-ad40-40df2b8dbd2d" containerName="registry-server" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: E1204 12:09:34.659661 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5b2522d3-a2e9-435f-971f-9cc73721e99c" containerName="registry-server" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: I1204 12:09:34.659668 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b2522d3-a2e9-435f-971f-9cc73721e99c" containerName="registry-server" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: E1204 12:09:34.659681 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6b275f26-6d4a-40a3-8dee-c58ae09c0263" containerName="registry-server" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: I1204 12:09:34.659688 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b275f26-6d4a-40a3-8dee-c58ae09c0263" containerName="registry-server" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: E1204 12:09:34.659703 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6e4bb27b-25c2-4ea3-b339-11b6d962fa1d" containerName="extract-content" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: I1204 12:09:34.659712 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e4bb27b-25c2-4ea3-b339-11b6d962fa1d" containerName="extract-content" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: E1204 12:09:34.659724 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="prometheus" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: I1204 12:09:34.659731 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="prometheus" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: E1204 12:09:34.659740 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="thanos-sidecar" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: I1204 12:09:34.659748 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="thanos-sidecar" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: E1204 12:09:34.659758 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6e4bb27b-25c2-4ea3-b339-11b6d962fa1d" containerName="registry-server" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: I1204 12:09:34.659764 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e4bb27b-25c2-4ea3-b339-11b6d962fa1d" containerName="registry-server" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: E1204 12:09:34.659775 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="14fef399-4e8f-4867-ace9-3b273117f886" containerName="registry-server" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: I1204 12:09:34.659782 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="14fef399-4e8f-4867-ace9-3b273117f886" containerName="registry-server" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: E1204 12:09:34.659797 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f4283051-9a72-4bab-b4e9-0fcff55962f9" containerName="extract-content" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: I1204 12:09:34.659803 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4283051-9a72-4bab-b4e9-0fcff55962f9" containerName="extract-content" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: E1204 12:09:34.659900 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6e4bb27b-25c2-4ea3-b339-11b6d962fa1d" containerName="extract-utilities" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: I1204 12:09:34.659909 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e4bb27b-25c2-4ea3-b339-11b6d962fa1d" containerName="extract-utilities" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: E1204 12:09:34.659917 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="config-reloader" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: I1204 12:09:34.659923 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="config-reloader" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: E1204 12:09:34.659936 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f4283051-9a72-4bab-b4e9-0fcff55962f9" containerName="extract-utilities" Dec 04 12:09:34.659917 master-0 kubenswrapper[35367]: I1204 12:09:34.659945 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4283051-9a72-4bab-b4e9-0fcff55962f9" containerName="extract-utilities" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: E1204 12:09:34.659956 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fcfbd087-b1aa-47da-a672-cde747408887" containerName="registry-server" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: I1204 12:09:34.659962 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcfbd087-b1aa-47da-a672-cde747408887" containerName="registry-server" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: E1204 12:09:34.659971 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="78de4935-3e4c-4f6f-bbb5-d592c35b47da" containerName="registry-server" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: I1204 12:09:34.659977 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="78de4935-3e4c-4f6f-bbb5-d592c35b47da" containerName="registry-server" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: E1204 12:09:34.659990 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2297684c-a98b-441c-8913-b5e9f39a2570" containerName="extract-content" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: I1204 12:09:34.659997 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="2297684c-a98b-441c-8913-b5e9f39a2570" containerName="extract-content" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: E1204 12:09:34.660011 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0ed2adcc-5493-4adc-ad40-40df2b8dbd2d" containerName="extract-utilities" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: I1204 12:09:34.660018 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ed2adcc-5493-4adc-ad40-40df2b8dbd2d" containerName="extract-utilities" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: I1204 12:09:34.660202 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="6b275f26-6d4a-40a3-8dee-c58ae09c0263" containerName="registry-server" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: I1204 12:09:34.660221 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="f4283051-9a72-4bab-b4e9-0fcff55962f9" containerName="registry-server" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: I1204 12:09:34.660230 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="5b2522d3-a2e9-435f-971f-9cc73721e99c" containerName="registry-server" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: I1204 12:09:34.660243 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="78de4935-3e4c-4f6f-bbb5-d592c35b47da" containerName="registry-server" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: I1204 12:09:34.660254 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="kube-rbac-proxy-thanos" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: I1204 12:09:34.660270 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="2297684c-a98b-441c-8913-b5e9f39a2570" containerName="registry-server" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: I1204 12:09:34.660282 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="14fef399-4e8f-4867-ace9-3b273117f886" containerName="registry-server" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: I1204 12:09:34.660293 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="fcfbd087-b1aa-47da-a672-cde747408887" containerName="registry-server" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: I1204 12:09:34.660304 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="config-reloader" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: I1204 12:09:34.660315 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="6e4bb27b-25c2-4ea3-b339-11b6d962fa1d" containerName="registry-server" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: I1204 12:09:34.660334 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="kube-rbac-proxy-web" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: I1204 12:09:34.660352 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="prometheus" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: I1204 12:09:34.660366 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="0ed2adcc-5493-4adc-ad40-40df2b8dbd2d" containerName="registry-server" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: I1204 12:09:34.660385 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="kube-rbac-proxy" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: I1204 12:09:34.660396 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="414ce51b-cd2f-4311-96e0-bd80fb0ae666" containerName="registry-server" Dec 04 12:09:34.661226 master-0 kubenswrapper[35367]: I1204 12:09:34.660409 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" containerName="thanos-sidecar" Dec 04 12:09:34.663192 master-0 kubenswrapper[35367]: I1204 12:09:34.662692 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.672995 master-0 kubenswrapper[35367]: I1204 12:09:34.670942 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-thanos-prometheus-http-client-file" Dec 04 12:09:34.672995 master-0 kubenswrapper[35367]: I1204 12:09:34.671116 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-grpc-tls-90vge34bcmpum" Dec 04 12:09:34.672995 master-0 kubenswrapper[35367]: I1204 12:09:34.671192 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-rbac-proxy" Dec 04 12:09:34.672995 master-0 kubenswrapper[35367]: I1204 12:09:34.671200 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"serving-certs-ca-bundle" Dec 04 12:09:34.672995 master-0 kubenswrapper[35367]: I1204 12:09:34.671331 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s" Dec 04 12:09:34.672995 master-0 kubenswrapper[35367]: I1204 12:09:34.671364 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-web-config" Dec 04 12:09:34.672995 master-0 kubenswrapper[35367]: I1204 12:09:34.671450 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-tls-assets-0" Dec 04 12:09:34.672995 master-0 kubenswrapper[35367]: I1204 12:09:34.671460 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-kube-rbac-proxy-web" Dec 04 12:09:34.672995 master-0 kubenswrapper[35367]: I1204 12:09:34.671136 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-dockercfg-fcvp2" Dec 04 12:09:34.672995 master-0 kubenswrapper[35367]: I1204 12:09:34.672372 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-thanos-sidecar-tls" Dec 04 12:09:34.673502 master-0 kubenswrapper[35367]: I1204 12:09:34.673312 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"prometheus-k8s-rulefiles-0" Dec 04 12:09:34.673502 master-0 kubenswrapper[35367]: I1204 12:09:34.673391 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-tls" Dec 04 12:09:34.690586 master-0 kubenswrapper[35367]: I1204 12:09:34.690530 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"prometheus-trusted-ca-bundle" Dec 04 12:09:34.697918 master-0 kubenswrapper[35367]: I1204 12:09:34.697879 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-web-config\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.698136 master-0 kubenswrapper[35367]: I1204 12:09:34.698118 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.698221 master-0 kubenswrapper[35367]: I1204 12:09:34.698208 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.698321 master-0 kubenswrapper[35367]: I1204 12:09:34.698303 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.698399 master-0 kubenswrapper[35367]: I1204 12:09:34.698388 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.698483 master-0 kubenswrapper[35367]: I1204 12:09:34.698468 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46kmf\" (UniqueName: \"kubernetes.io/projected/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-kube-api-access-46kmf\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.698565 master-0 kubenswrapper[35367]: I1204 12:09:34.698551 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-config-out\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.698652 master-0 kubenswrapper[35367]: I1204 12:09:34.698640 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.698728 master-0 kubenswrapper[35367]: I1204 12:09:34.698715 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-config\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.698830 master-0 kubenswrapper[35367]: I1204 12:09:34.698797 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.698911 master-0 kubenswrapper[35367]: I1204 12:09:34.698898 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.698999 master-0 kubenswrapper[35367]: I1204 12:09:34.698984 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.699088 master-0 kubenswrapper[35367]: I1204 12:09:34.699076 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.699168 master-0 kubenswrapper[35367]: I1204 12:09:34.699155 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.699256 master-0 kubenswrapper[35367]: I1204 12:09:34.699242 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.699328 master-0 kubenswrapper[35367]: I1204 12:09:34.699315 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.699412 master-0 kubenswrapper[35367]: I1204 12:09:34.699399 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.699680 master-0 kubenswrapper[35367]: I1204 12:09:34.699632 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.710718 master-0 kubenswrapper[35367]: I1204 12:09:34.704444 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Dec 04 12:09:34.760532 master-0 kubenswrapper[35367]: I1204 12:09:34.759935 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="136126db-b6ad-440f-8add-e9e206ec25c6" path="/var/lib/kubelet/pods/136126db-b6ad-440f-8add-e9e206ec25c6/volumes" Dec 04 12:09:34.761289 master-0 kubenswrapper[35367]: I1204 12:09:34.761246 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b2522d3-a2e9-435f-971f-9cc73721e99c" path="/var/lib/kubelet/pods/5b2522d3-a2e9-435f-971f-9cc73721e99c/volumes" Dec 04 12:09:34.764227 master-0 kubenswrapper[35367]: I1204 12:09:34.764160 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e4bb27b-25c2-4ea3-b339-11b6d962fa1d" path="/var/lib/kubelet/pods/6e4bb27b-25c2-4ea3-b339-11b6d962fa1d/volumes" Dec 04 12:09:34.765061 master-0 kubenswrapper[35367]: I1204 12:09:34.764842 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78de4935-3e4c-4f6f-bbb5-d592c35b47da" path="/var/lib/kubelet/pods/78de4935-3e4c-4f6f-bbb5-d592c35b47da/volumes" Dec 04 12:09:34.802029 master-0 kubenswrapper[35367]: I1204 12:09:34.801919 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-web-config\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.802288 master-0 kubenswrapper[35367]: I1204 12:09:34.802044 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.802288 master-0 kubenswrapper[35367]: I1204 12:09:34.802109 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.802288 master-0 kubenswrapper[35367]: I1204 12:09:34.802153 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.802288 master-0 kubenswrapper[35367]: I1204 12:09:34.802187 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.802288 master-0 kubenswrapper[35367]: I1204 12:09:34.802240 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-46kmf\" (UniqueName: \"kubernetes.io/projected/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-kube-api-access-46kmf\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.802581 master-0 kubenswrapper[35367]: I1204 12:09:34.802390 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-config-out\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.802581 master-0 kubenswrapper[35367]: I1204 12:09:34.802455 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.802581 master-0 kubenswrapper[35367]: I1204 12:09:34.802536 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-config\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.802716 master-0 kubenswrapper[35367]: I1204 12:09:34.802616 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.802716 master-0 kubenswrapper[35367]: I1204 12:09:34.802655 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.802800 master-0 kubenswrapper[35367]: I1204 12:09:34.802751 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.802989 master-0 kubenswrapper[35367]: I1204 12:09:34.802951 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.803054 master-0 kubenswrapper[35367]: I1204 12:09:34.802992 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.803054 master-0 kubenswrapper[35367]: I1204 12:09:34.803052 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.803151 master-0 kubenswrapper[35367]: I1204 12:09:34.803089 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.803151 master-0 kubenswrapper[35367]: I1204 12:09:34.803128 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.803234 master-0 kubenswrapper[35367]: I1204 12:09:34.803209 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.803412 master-0 kubenswrapper[35367]: I1204 12:09:34.803271 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.805244 master-0 kubenswrapper[35367]: I1204 12:09:34.805177 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.805565 master-0 kubenswrapper[35367]: I1204 12:09:34.805523 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.807469 master-0 kubenswrapper[35367]: I1204 12:09:34.807420 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.807544 master-0 kubenswrapper[35367]: I1204 12:09:34.807480 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-web-config\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.808235 master-0 kubenswrapper[35367]: I1204 12:09:34.808202 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.808471 master-0 kubenswrapper[35367]: I1204 12:09:34.808432 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.808583 master-0 kubenswrapper[35367]: I1204 12:09:34.808524 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.808716 master-0 kubenswrapper[35367]: I1204 12:09:34.808680 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.810873 master-0 kubenswrapper[35367]: I1204 12:09:34.809458 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.810873 master-0 kubenswrapper[35367]: I1204 12:09:34.810457 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.810873 master-0 kubenswrapper[35367]: I1204 12:09:34.810510 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-config\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.810873 master-0 kubenswrapper[35367]: I1204 12:09:34.810787 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-config-out\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.812546 master-0 kubenswrapper[35367]: I1204 12:09:34.812490 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.815395 master-0 kubenswrapper[35367]: I1204 12:09:34.815367 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.815608 master-0 kubenswrapper[35367]: I1204 12:09:34.815575 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.817091 master-0 kubenswrapper[35367]: I1204 12:09:34.817063 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:34.824861 master-0 kubenswrapper[35367]: I1204 12:09:34.824799 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-46kmf\" (UniqueName: \"kubernetes.io/projected/58981c23-3a3a-47f3-b416-71c5b7ba2f6e-kube-api-access-46kmf\") pod \"prometheus-k8s-0\" (UID: \"58981c23-3a3a-47f3-b416-71c5b7ba2f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:35.001795 master-0 kubenswrapper[35367]: I1204 12:09:35.001669 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:35.380320 master-0 kubenswrapper[35367]: I1204 12:09:35.380224 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/installer-5-master-0"] Dec 04 12:09:35.382119 master-0 kubenswrapper[35367]: I1204 12:09:35.382058 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Dec 04 12:09:35.385875 master-0 kubenswrapper[35367]: I1204 12:09:35.385052 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager"/"installer-sa-dockercfg-vn92f" Dec 04 12:09:35.385875 master-0 kubenswrapper[35367]: I1204 12:09:35.385147 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager"/"kube-root-ca.crt" Dec 04 12:09:35.398364 master-0 kubenswrapper[35367]: I1204 12:09:35.398249 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-5-master-0"] Dec 04 12:09:35.413816 master-0 kubenswrapper[35367]: I1204 12:09:35.413711 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/308193cd-1b05-418c-87db-6b7cb0a8b92e-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"308193cd-1b05-418c-87db-6b7cb0a8b92e\") " pod="openshift-kube-controller-manager/installer-5-master-0" Dec 04 12:09:35.414361 master-0 kubenswrapper[35367]: I1204 12:09:35.414321 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/308193cd-1b05-418c-87db-6b7cb0a8b92e-var-lock\") pod \"installer-5-master-0\" (UID: \"308193cd-1b05-418c-87db-6b7cb0a8b92e\") " pod="openshift-kube-controller-manager/installer-5-master-0" Dec 04 12:09:35.414672 master-0 kubenswrapper[35367]: I1204 12:09:35.414642 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/308193cd-1b05-418c-87db-6b7cb0a8b92e-kube-api-access\") pod \"installer-5-master-0\" (UID: \"308193cd-1b05-418c-87db-6b7cb0a8b92e\") " pod="openshift-kube-controller-manager/installer-5-master-0" Dec 04 12:09:35.516638 master-0 kubenswrapper[35367]: I1204 12:09:35.516541 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/308193cd-1b05-418c-87db-6b7cb0a8b92e-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"308193cd-1b05-418c-87db-6b7cb0a8b92e\") " pod="openshift-kube-controller-manager/installer-5-master-0" Dec 04 12:09:35.516638 master-0 kubenswrapper[35367]: I1204 12:09:35.516623 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/308193cd-1b05-418c-87db-6b7cb0a8b92e-var-lock\") pod \"installer-5-master-0\" (UID: \"308193cd-1b05-418c-87db-6b7cb0a8b92e\") " pod="openshift-kube-controller-manager/installer-5-master-0" Dec 04 12:09:35.516999 master-0 kubenswrapper[35367]: I1204 12:09:35.516677 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/308193cd-1b05-418c-87db-6b7cb0a8b92e-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"308193cd-1b05-418c-87db-6b7cb0a8b92e\") " pod="openshift-kube-controller-manager/installer-5-master-0" Dec 04 12:09:35.516999 master-0 kubenswrapper[35367]: I1204 12:09:35.516801 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/308193cd-1b05-418c-87db-6b7cb0a8b92e-kube-api-access\") pod \"installer-5-master-0\" (UID: \"308193cd-1b05-418c-87db-6b7cb0a8b92e\") " pod="openshift-kube-controller-manager/installer-5-master-0" Dec 04 12:09:35.517598 master-0 kubenswrapper[35367]: I1204 12:09:35.517563 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/308193cd-1b05-418c-87db-6b7cb0a8b92e-var-lock\") pod \"installer-5-master-0\" (UID: \"308193cd-1b05-418c-87db-6b7cb0a8b92e\") " pod="openshift-kube-controller-manager/installer-5-master-0" Dec 04 12:09:35.566795 master-0 kubenswrapper[35367]: I1204 12:09:35.566735 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Dec 04 12:09:35.573547 master-0 kubenswrapper[35367]: I1204 12:09:35.572128 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/308193cd-1b05-418c-87db-6b7cb0a8b92e-kube-api-access\") pod \"installer-5-master-0\" (UID: \"308193cd-1b05-418c-87db-6b7cb0a8b92e\") " pod="openshift-kube-controller-manager/installer-5-master-0" Dec 04 12:09:35.573547 master-0 kubenswrapper[35367]: W1204 12:09:35.572848 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58981c23_3a3a_47f3_b416_71c5b7ba2f6e.slice/crio-638f4ebf0f26b1338e41181adc0376ab39e01d994fa16db7e6d3d769fff07247 WatchSource:0}: Error finding container 638f4ebf0f26b1338e41181adc0376ab39e01d994fa16db7e6d3d769fff07247: Status 404 returned error can't find the container with id 638f4ebf0f26b1338e41181adc0376ab39e01d994fa16db7e6d3d769fff07247 Dec 04 12:09:35.718921 master-0 kubenswrapper[35367]: I1204 12:09:35.718836 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Dec 04 12:09:35.941957 master-0 kubenswrapper[35367]: I1204 12:09:35.941817 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/console-6475766b4d-m2nml"] Dec 04 12:09:35.947492 master-0 kubenswrapper[35367]: I1204 12:09:35.943128 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.016861 master-0 kubenswrapper[35367]: I1204 12:09:36.016781 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6475766b4d-m2nml"] Dec 04 12:09:36.029232 master-0 kubenswrapper[35367]: I1204 12:09:36.028168 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f77f979c-d649-4b3b-8423-065f178df78a-console-oauth-config\") pod \"console-6475766b4d-m2nml\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.029232 master-0 kubenswrapper[35367]: I1204 12:09:36.028221 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsnxz\" (UniqueName: \"kubernetes.io/projected/f77f979c-d649-4b3b-8423-065f178df78a-kube-api-access-zsnxz\") pod \"console-6475766b4d-m2nml\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.029232 master-0 kubenswrapper[35367]: I1204 12:09:36.028315 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-trusted-ca-bundle\") pod \"console-6475766b4d-m2nml\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.029232 master-0 kubenswrapper[35367]: I1204 12:09:36.028339 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-console-config\") pod \"console-6475766b4d-m2nml\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.029232 master-0 kubenswrapper[35367]: I1204 12:09:36.028608 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f77f979c-d649-4b3b-8423-065f178df78a-console-serving-cert\") pod \"console-6475766b4d-m2nml\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.029232 master-0 kubenswrapper[35367]: I1204 12:09:36.028721 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-oauth-serving-cert\") pod \"console-6475766b4d-m2nml\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.029232 master-0 kubenswrapper[35367]: I1204 12:09:36.028761 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-service-ca\") pod \"console-6475766b4d-m2nml\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.131145 master-0 kubenswrapper[35367]: I1204 12:09:36.131070 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-trusted-ca-bundle\") pod \"console-6475766b4d-m2nml\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.131145 master-0 kubenswrapper[35367]: I1204 12:09:36.131151 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-console-config\") pod \"console-6475766b4d-m2nml\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.131475 master-0 kubenswrapper[35367]: I1204 12:09:36.131183 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f77f979c-d649-4b3b-8423-065f178df78a-console-serving-cert\") pod \"console-6475766b4d-m2nml\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.131475 master-0 kubenswrapper[35367]: I1204 12:09:36.131221 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-oauth-serving-cert\") pod \"console-6475766b4d-m2nml\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.132630 master-0 kubenswrapper[35367]: I1204 12:09:36.131777 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-service-ca\") pod \"console-6475766b4d-m2nml\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.132630 master-0 kubenswrapper[35367]: I1204 12:09:36.132132 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f77f979c-d649-4b3b-8423-065f178df78a-console-oauth-config\") pod \"console-6475766b4d-m2nml\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.132630 master-0 kubenswrapper[35367]: I1204 12:09:36.132156 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zsnxz\" (UniqueName: \"kubernetes.io/projected/f77f979c-d649-4b3b-8423-065f178df78a-kube-api-access-zsnxz\") pod \"console-6475766b4d-m2nml\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.132630 master-0 kubenswrapper[35367]: I1204 12:09:36.132249 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-oauth-serving-cert\") pod \"console-6475766b4d-m2nml\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.132630 master-0 kubenswrapper[35367]: I1204 12:09:36.132543 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-console-config\") pod \"console-6475766b4d-m2nml\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.133153 master-0 kubenswrapper[35367]: I1204 12:09:36.133109 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-service-ca\") pod \"console-6475766b4d-m2nml\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.133682 master-0 kubenswrapper[35367]: I1204 12:09:36.133653 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-trusted-ca-bundle\") pod \"console-6475766b4d-m2nml\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.134868 master-0 kubenswrapper[35367]: I1204 12:09:36.134836 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f77f979c-d649-4b3b-8423-065f178df78a-console-serving-cert\") pod \"console-6475766b4d-m2nml\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.135694 master-0 kubenswrapper[35367]: I1204 12:09:36.135665 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f77f979c-d649-4b3b-8423-065f178df78a-console-oauth-config\") pod \"console-6475766b4d-m2nml\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.148847 master-0 kubenswrapper[35367]: I1204 12:09:36.148751 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsnxz\" (UniqueName: \"kubernetes.io/projected/f77f979c-d649-4b3b-8423-065f178df78a-kube-api-access-zsnxz\") pod \"console-6475766b4d-m2nml\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.228139 master-0 kubenswrapper[35367]: I1204 12:09:36.228084 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-5-master-0"] Dec 04 12:09:36.343336 master-0 kubenswrapper[35367]: I1204 12:09:36.343268 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:36.459059 master-0 kubenswrapper[35367]: I1204 12:09:36.458968 35367 generic.go:334] "Generic (PLEG): container finished" podID="58981c23-3a3a-47f3-b416-71c5b7ba2f6e" containerID="ca37bebaab80595c5c4d97d53be6e6158b3cd3a7f7b172f78df53bf3348085c4" exitCode=0 Dec 04 12:09:36.460168 master-0 kubenswrapper[35367]: I1204 12:09:36.460126 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58981c23-3a3a-47f3-b416-71c5b7ba2f6e","Type":"ContainerDied","Data":"ca37bebaab80595c5c4d97d53be6e6158b3cd3a7f7b172f78df53bf3348085c4"} Dec 04 12:09:36.460223 master-0 kubenswrapper[35367]: I1204 12:09:36.460176 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58981c23-3a3a-47f3-b416-71c5b7ba2f6e","Type":"ContainerStarted","Data":"638f4ebf0f26b1338e41181adc0376ab39e01d994fa16db7e6d3d769fff07247"} Dec 04 12:09:36.468160 master-0 kubenswrapper[35367]: I1204 12:09:36.465887 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-5-master-0" event={"ID":"308193cd-1b05-418c-87db-6b7cb0a8b92e","Type":"ContainerStarted","Data":"1f0a3b8936777924f82cf472216199378ca7497c99ff2dcda7e6e598e4cdaafa"} Dec 04 12:09:36.806571 master-0 kubenswrapper[35367]: I1204 12:09:36.804704 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6475766b4d-m2nml"] Dec 04 12:09:37.477749 master-0 kubenswrapper[35367]: I1204 12:09:37.477667 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-5-master-0" event={"ID":"308193cd-1b05-418c-87db-6b7cb0a8b92e","Type":"ContainerStarted","Data":"5759d3295bcf424cfaa1522caeb55a1a95a54d20e02a6b6c4d1dda0212281d8b"} Dec 04 12:09:37.489620 master-0 kubenswrapper[35367]: I1204 12:09:37.489549 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58981c23-3a3a-47f3-b416-71c5b7ba2f6e","Type":"ContainerStarted","Data":"52a99f4a533d1c589393aa0ffec4dc068e02a4babee9897bfb776b6b94cc7432"} Dec 04 12:09:37.489620 master-0 kubenswrapper[35367]: I1204 12:09:37.489608 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58981c23-3a3a-47f3-b416-71c5b7ba2f6e","Type":"ContainerStarted","Data":"feca610dac2ce374fd4a5b775565f886ac508ab3484bfab9d60e27e28da82273"} Dec 04 12:09:37.489620 master-0 kubenswrapper[35367]: I1204 12:09:37.489619 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58981c23-3a3a-47f3-b416-71c5b7ba2f6e","Type":"ContainerStarted","Data":"0d49e04f4195e46da6978303c661f56f236856d3979c427cbe81be1319f7c0c2"} Dec 04 12:09:37.495265 master-0 kubenswrapper[35367]: I1204 12:09:37.495215 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6475766b4d-m2nml" event={"ID":"f77f979c-d649-4b3b-8423-065f178df78a","Type":"ContainerStarted","Data":"02366016008c6cba5359ad0c187422b885e7f3c0d1800817f0c8ee85ed47f48c"} Dec 04 12:09:37.495265 master-0 kubenswrapper[35367]: I1204 12:09:37.495262 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6475766b4d-m2nml" event={"ID":"f77f979c-d649-4b3b-8423-065f178df78a","Type":"ContainerStarted","Data":"92ec620207f0b0d3e0cce1705c93c09442225d3a6887aaa4c5447ca9419c76a8"} Dec 04 12:09:37.516049 master-0 kubenswrapper[35367]: I1204 12:09:37.513965 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/installer-5-master-0" podStartSLOduration=2.513941161 podStartE2EDuration="2.513941161s" podCreationTimestamp="2025-12-04 12:09:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:09:37.507018973 +0000 UTC m=+620.945080231" watchObservedRunningTime="2025-12-04 12:09:37.513941161 +0000 UTC m=+620.952002419" Dec 04 12:09:37.535626 master-0 kubenswrapper[35367]: I1204 12:09:37.535474 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6475766b4d-m2nml" podStartSLOduration=2.535445217 podStartE2EDuration="2.535445217s" podCreationTimestamp="2025-12-04 12:09:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:09:37.531620688 +0000 UTC m=+620.969681966" watchObservedRunningTime="2025-12-04 12:09:37.535445217 +0000 UTC m=+620.973506485" Dec 04 12:09:38.150372 master-0 kubenswrapper[35367]: I1204 12:09:38.150247 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-g7j5b" Dec 04 12:09:38.516539 master-0 kubenswrapper[35367]: I1204 12:09:38.516204 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58981c23-3a3a-47f3-b416-71c5b7ba2f6e","Type":"ContainerStarted","Data":"7891275186b842826b8a0ff08162a5a84605d493c046d04805d8d45118d7f660"} Dec 04 12:09:38.516539 master-0 kubenswrapper[35367]: I1204 12:09:38.516274 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58981c23-3a3a-47f3-b416-71c5b7ba2f6e","Type":"ContainerStarted","Data":"a6b8d1a6390d875d2661bfbd0023a8b0b850601c42d80fcf4fa880ec9668eec4"} Dec 04 12:09:38.516539 master-0 kubenswrapper[35367]: I1204 12:09:38.516287 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58981c23-3a3a-47f3-b416-71c5b7ba2f6e","Type":"ContainerStarted","Data":"7f736addc424b5d13a75682b82e7245ebca373ade51dc2635b87c0e557a53fa5"} Dec 04 12:09:38.553419 master-0 kubenswrapper[35367]: I1204 12:09:38.553321 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.553297758 podStartE2EDuration="4.553297758s" podCreationTimestamp="2025-12-04 12:09:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:09:38.547743843 +0000 UTC m=+621.985805121" watchObservedRunningTime="2025-12-04 12:09:38.553297758 +0000 UTC m=+621.991359016" Dec 04 12:09:39.680189 master-0 kubenswrapper[35367]: I1204 12:09:39.680127 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-fhdw5"] Dec 04 12:09:39.680754 master-0 kubenswrapper[35367]: I1204 12:09:39.680432 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-fhdw5" podUID="11c18264-a296-44af-b112-21ad216ce917" containerName="registry-server" containerID="cri-o://4c57d0f9ce18b05e0cb4b824f8cb6a475154e59ee1c527fff3db1930cc7bc930" gracePeriod=2 Dec 04 12:09:40.002850 master-0 kubenswrapper[35367]: I1204 12:09:40.002382 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:09:40.122950 master-0 kubenswrapper[35367]: I1204 12:09:40.122899 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-fhdw5" Dec 04 12:09:40.139109 master-0 kubenswrapper[35367]: I1204 12:09:40.139038 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-g7j5b"] Dec 04 12:09:40.139381 master-0 kubenswrapper[35367]: I1204 12:09:40.139324 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-g7j5b" podUID="46967266-5366-4e53-9c4d-9575e02846cb" containerName="registry-server" containerID="cri-o://b04fc8a08a419e6a27f02b0eb896686273020f4e382cc89c134f0f0c507dd793" gracePeriod=2 Dec 04 12:09:40.144866 master-0 kubenswrapper[35367]: I1204 12:09:40.144820 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/11c18264-a296-44af-b112-21ad216ce917-catalog-content\") pod \"11c18264-a296-44af-b112-21ad216ce917\" (UID: \"11c18264-a296-44af-b112-21ad216ce917\") " Dec 04 12:09:40.144948 master-0 kubenswrapper[35367]: I1204 12:09:40.144911 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/11c18264-a296-44af-b112-21ad216ce917-utilities\") pod \"11c18264-a296-44af-b112-21ad216ce917\" (UID: \"11c18264-a296-44af-b112-21ad216ce917\") " Dec 04 12:09:40.144948 master-0 kubenswrapper[35367]: I1204 12:09:40.144932 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ctmm\" (UniqueName: \"kubernetes.io/projected/11c18264-a296-44af-b112-21ad216ce917-kube-api-access-9ctmm\") pod \"11c18264-a296-44af-b112-21ad216ce917\" (UID: \"11c18264-a296-44af-b112-21ad216ce917\") " Dec 04 12:09:40.146842 master-0 kubenswrapper[35367]: I1204 12:09:40.146775 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11c18264-a296-44af-b112-21ad216ce917-utilities" (OuterVolumeSpecName: "utilities") pod "11c18264-a296-44af-b112-21ad216ce917" (UID: "11c18264-a296-44af-b112-21ad216ce917"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:40.147837 master-0 kubenswrapper[35367]: I1204 12:09:40.147793 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11c18264-a296-44af-b112-21ad216ce917-kube-api-access-9ctmm" (OuterVolumeSpecName: "kube-api-access-9ctmm") pod "11c18264-a296-44af-b112-21ad216ce917" (UID: "11c18264-a296-44af-b112-21ad216ce917"). InnerVolumeSpecName "kube-api-access-9ctmm". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:40.164350 master-0 kubenswrapper[35367]: I1204 12:09:40.164262 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11c18264-a296-44af-b112-21ad216ce917-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "11c18264-a296-44af-b112-21ad216ce917" (UID: "11c18264-a296-44af-b112-21ad216ce917"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:40.247898 master-0 kubenswrapper[35367]: I1204 12:09:40.247537 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/11c18264-a296-44af-b112-21ad216ce917-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:40.247898 master-0 kubenswrapper[35367]: I1204 12:09:40.247594 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/11c18264-a296-44af-b112-21ad216ce917-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:40.247898 master-0 kubenswrapper[35367]: I1204 12:09:40.247612 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9ctmm\" (UniqueName: \"kubernetes.io/projected/11c18264-a296-44af-b112-21ad216ce917-kube-api-access-9ctmm\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:40.270963 master-0 kubenswrapper[35367]: I1204 12:09:40.270882 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-2xqkk"] Dec 04 12:09:40.271305 master-0 kubenswrapper[35367]: I1204 12:09:40.271263 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-2xqkk" podUID="281cfff8-9bcf-4722-a10a-7872455a391f" containerName="registry-server" containerID="cri-o://d483209b49df2261128c9b7363923bbf4a7173d8b0c3e987365e70c03960b49d" gracePeriod=2 Dec 04 12:09:40.476887 master-0 kubenswrapper[35367]: I1204 12:09:40.471850 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-pdr77"] Dec 04 12:09:40.476887 master-0 kubenswrapper[35367]: I1204 12:09:40.472154 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-pdr77" podUID="16b1a088-3ac8-45f8-9f7e-504caab0307b" containerName="registry-server" containerID="cri-o://4c4c50f6ed837b50065ec95193774f36a2b50695d48f4bc50c159cabef802a01" gracePeriod=2 Dec 04 12:09:40.544711 master-0 kubenswrapper[35367]: I1204 12:09:40.544447 35367 generic.go:334] "Generic (PLEG): container finished" podID="11c18264-a296-44af-b112-21ad216ce917" containerID="4c57d0f9ce18b05e0cb4b824f8cb6a475154e59ee1c527fff3db1930cc7bc930" exitCode=0 Dec 04 12:09:40.544711 master-0 kubenswrapper[35367]: I1204 12:09:40.544714 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-fhdw5" event={"ID":"11c18264-a296-44af-b112-21ad216ce917","Type":"ContainerDied","Data":"4c57d0f9ce18b05e0cb4b824f8cb6a475154e59ee1c527fff3db1930cc7bc930"} Dec 04 12:09:40.545065 master-0 kubenswrapper[35367]: I1204 12:09:40.544743 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-fhdw5" event={"ID":"11c18264-a296-44af-b112-21ad216ce917","Type":"ContainerDied","Data":"407b41454956b16f90539f4df607f5762959b8217c8fe3b939ff9381c4e5bfed"} Dec 04 12:09:40.545065 master-0 kubenswrapper[35367]: I1204 12:09:40.544763 35367 scope.go:117] "RemoveContainer" containerID="4c57d0f9ce18b05e0cb4b824f8cb6a475154e59ee1c527fff3db1930cc7bc930" Dec 04 12:09:40.545065 master-0 kubenswrapper[35367]: I1204 12:09:40.544932 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-fhdw5" Dec 04 12:09:40.554986 master-0 kubenswrapper[35367]: I1204 12:09:40.554935 35367 generic.go:334] "Generic (PLEG): container finished" podID="281cfff8-9bcf-4722-a10a-7872455a391f" containerID="d483209b49df2261128c9b7363923bbf4a7173d8b0c3e987365e70c03960b49d" exitCode=0 Dec 04 12:09:40.555113 master-0 kubenswrapper[35367]: I1204 12:09:40.555011 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-2xqkk" event={"ID":"281cfff8-9bcf-4722-a10a-7872455a391f","Type":"ContainerDied","Data":"d483209b49df2261128c9b7363923bbf4a7173d8b0c3e987365e70c03960b49d"} Dec 04 12:09:40.557697 master-0 kubenswrapper[35367]: I1204 12:09:40.557665 35367 generic.go:334] "Generic (PLEG): container finished" podID="46967266-5366-4e53-9c4d-9575e02846cb" containerID="b04fc8a08a419e6a27f02b0eb896686273020f4e382cc89c134f0f0c507dd793" exitCode=0 Dec 04 12:09:40.557795 master-0 kubenswrapper[35367]: I1204 12:09:40.557755 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-g7j5b" event={"ID":"46967266-5366-4e53-9c4d-9575e02846cb","Type":"ContainerDied","Data":"b04fc8a08a419e6a27f02b0eb896686273020f4e382cc89c134f0f0c507dd793"} Dec 04 12:09:40.557871 master-0 kubenswrapper[35367]: I1204 12:09:40.557824 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-g7j5b" event={"ID":"46967266-5366-4e53-9c4d-9575e02846cb","Type":"ContainerDied","Data":"7d278d144ed717e636022cd2338cd424ceeb91e9836765fbc7ad8a10b2dc1694"} Dec 04 12:09:40.557871 master-0 kubenswrapper[35367]: I1204 12:09:40.557838 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d278d144ed717e636022cd2338cd424ceeb91e9836765fbc7ad8a10b2dc1694" Dec 04 12:09:40.569184 master-0 kubenswrapper[35367]: I1204 12:09:40.569144 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-g7j5b" Dec 04 12:09:40.576133 master-0 kubenswrapper[35367]: I1204 12:09:40.576085 35367 scope.go:117] "RemoveContainer" containerID="e49d5893b53eb81d7075646b4602344fd0296c3aa66518d8b31f3ccd26e49c76" Dec 04 12:09:40.616949 master-0 kubenswrapper[35367]: I1204 12:09:40.616864 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-fhdw5"] Dec 04 12:09:40.633616 master-0 kubenswrapper[35367]: I1204 12:09:40.633539 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-fhdw5"] Dec 04 12:09:40.642988 master-0 kubenswrapper[35367]: I1204 12:09:40.642930 35367 scope.go:117] "RemoveContainer" containerID="41c1158bb7fa0503998ebe02d8ac275ef6e6ed3beb50d2a6f95b7423f136e0d5" Dec 04 12:09:40.668379 master-0 kubenswrapper[35367]: I1204 12:09:40.667459 35367 scope.go:117] "RemoveContainer" containerID="4c57d0f9ce18b05e0cb4b824f8cb6a475154e59ee1c527fff3db1930cc7bc930" Dec 04 12:09:40.668379 master-0 kubenswrapper[35367]: E1204 12:09:40.668075 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c57d0f9ce18b05e0cb4b824f8cb6a475154e59ee1c527fff3db1930cc7bc930\": container with ID starting with 4c57d0f9ce18b05e0cb4b824f8cb6a475154e59ee1c527fff3db1930cc7bc930 not found: ID does not exist" containerID="4c57d0f9ce18b05e0cb4b824f8cb6a475154e59ee1c527fff3db1930cc7bc930" Dec 04 12:09:40.668379 master-0 kubenswrapper[35367]: I1204 12:09:40.668138 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c57d0f9ce18b05e0cb4b824f8cb6a475154e59ee1c527fff3db1930cc7bc930"} err="failed to get container status \"4c57d0f9ce18b05e0cb4b824f8cb6a475154e59ee1c527fff3db1930cc7bc930\": rpc error: code = NotFound desc = could not find container \"4c57d0f9ce18b05e0cb4b824f8cb6a475154e59ee1c527fff3db1930cc7bc930\": container with ID starting with 4c57d0f9ce18b05e0cb4b824f8cb6a475154e59ee1c527fff3db1930cc7bc930 not found: ID does not exist" Dec 04 12:09:40.668379 master-0 kubenswrapper[35367]: I1204 12:09:40.668225 35367 scope.go:117] "RemoveContainer" containerID="e49d5893b53eb81d7075646b4602344fd0296c3aa66518d8b31f3ccd26e49c76" Dec 04 12:09:40.668642 master-0 kubenswrapper[35367]: E1204 12:09:40.668585 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e49d5893b53eb81d7075646b4602344fd0296c3aa66518d8b31f3ccd26e49c76\": container with ID starting with e49d5893b53eb81d7075646b4602344fd0296c3aa66518d8b31f3ccd26e49c76 not found: ID does not exist" containerID="e49d5893b53eb81d7075646b4602344fd0296c3aa66518d8b31f3ccd26e49c76" Dec 04 12:09:40.668697 master-0 kubenswrapper[35367]: I1204 12:09:40.668623 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e49d5893b53eb81d7075646b4602344fd0296c3aa66518d8b31f3ccd26e49c76"} err="failed to get container status \"e49d5893b53eb81d7075646b4602344fd0296c3aa66518d8b31f3ccd26e49c76\": rpc error: code = NotFound desc = could not find container \"e49d5893b53eb81d7075646b4602344fd0296c3aa66518d8b31f3ccd26e49c76\": container with ID starting with e49d5893b53eb81d7075646b4602344fd0296c3aa66518d8b31f3ccd26e49c76 not found: ID does not exist" Dec 04 12:09:40.668697 master-0 kubenswrapper[35367]: I1204 12:09:40.668652 35367 scope.go:117] "RemoveContainer" containerID="41c1158bb7fa0503998ebe02d8ac275ef6e6ed3beb50d2a6f95b7423f136e0d5" Dec 04 12:09:40.669537 master-0 kubenswrapper[35367]: E1204 12:09:40.668940 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41c1158bb7fa0503998ebe02d8ac275ef6e6ed3beb50d2a6f95b7423f136e0d5\": container with ID starting with 41c1158bb7fa0503998ebe02d8ac275ef6e6ed3beb50d2a6f95b7423f136e0d5 not found: ID does not exist" containerID="41c1158bb7fa0503998ebe02d8ac275ef6e6ed3beb50d2a6f95b7423f136e0d5" Dec 04 12:09:40.669537 master-0 kubenswrapper[35367]: I1204 12:09:40.668970 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41c1158bb7fa0503998ebe02d8ac275ef6e6ed3beb50d2a6f95b7423f136e0d5"} err="failed to get container status \"41c1158bb7fa0503998ebe02d8ac275ef6e6ed3beb50d2a6f95b7423f136e0d5\": rpc error: code = NotFound desc = could not find container \"41c1158bb7fa0503998ebe02d8ac275ef6e6ed3beb50d2a6f95b7423f136e0d5\": container with ID starting with 41c1158bb7fa0503998ebe02d8ac275ef6e6ed3beb50d2a6f95b7423f136e0d5 not found: ID does not exist" Dec 04 12:09:40.673941 master-0 kubenswrapper[35367]: I1204 12:09:40.673899 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-7j7ql"] Dec 04 12:09:40.674192 master-0 kubenswrapper[35367]: I1204 12:09:40.674152 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-7j7ql" podUID="1cdce2be-c255-424e-8da3-7665cc617e32" containerName="registry-server" containerID="cri-o://d445fc59dd070294732be621499138e18dc0f2b923b2554aebf34d4b80035e33" gracePeriod=2 Dec 04 12:09:40.706454 master-0 kubenswrapper[35367]: I1204 12:09:40.706392 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-2xqkk" Dec 04 12:09:40.758328 master-0 kubenswrapper[35367]: I1204 12:09:40.755651 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/46967266-5366-4e53-9c4d-9575e02846cb-catalog-content\") pod \"46967266-5366-4e53-9c4d-9575e02846cb\" (UID: \"46967266-5366-4e53-9c4d-9575e02846cb\") " Dec 04 12:09:40.758328 master-0 kubenswrapper[35367]: I1204 12:09:40.755915 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spghh\" (UniqueName: \"kubernetes.io/projected/46967266-5366-4e53-9c4d-9575e02846cb-kube-api-access-spghh\") pod \"46967266-5366-4e53-9c4d-9575e02846cb\" (UID: \"46967266-5366-4e53-9c4d-9575e02846cb\") " Dec 04 12:09:40.758328 master-0 kubenswrapper[35367]: I1204 12:09:40.755991 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/46967266-5366-4e53-9c4d-9575e02846cb-utilities\") pod \"46967266-5366-4e53-9c4d-9575e02846cb\" (UID: \"46967266-5366-4e53-9c4d-9575e02846cb\") " Dec 04 12:09:40.758328 master-0 kubenswrapper[35367]: I1204 12:09:40.756816 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46967266-5366-4e53-9c4d-9575e02846cb-utilities" (OuterVolumeSpecName: "utilities") pod "46967266-5366-4e53-9c4d-9575e02846cb" (UID: "46967266-5366-4e53-9c4d-9575e02846cb"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:40.760923 master-0 kubenswrapper[35367]: I1204 12:09:40.760537 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46967266-5366-4e53-9c4d-9575e02846cb-kube-api-access-spghh" (OuterVolumeSpecName: "kube-api-access-spghh") pod "46967266-5366-4e53-9c4d-9575e02846cb" (UID: "46967266-5366-4e53-9c4d-9575e02846cb"). InnerVolumeSpecName "kube-api-access-spghh". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:40.769112 master-0 kubenswrapper[35367]: I1204 12:09:40.768974 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11c18264-a296-44af-b112-21ad216ce917" path="/var/lib/kubelet/pods/11c18264-a296-44af-b112-21ad216ce917/volumes" Dec 04 12:09:40.778703 master-0 kubenswrapper[35367]: I1204 12:09:40.778633 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46967266-5366-4e53-9c4d-9575e02846cb-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "46967266-5366-4e53-9c4d-9575e02846cb" (UID: "46967266-5366-4e53-9c4d-9575e02846cb"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:40.859138 master-0 kubenswrapper[35367]: I1204 12:09:40.858235 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/281cfff8-9bcf-4722-a10a-7872455a391f-utilities\") pod \"281cfff8-9bcf-4722-a10a-7872455a391f\" (UID: \"281cfff8-9bcf-4722-a10a-7872455a391f\") " Dec 04 12:09:40.859138 master-0 kubenswrapper[35367]: I1204 12:09:40.858307 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wql8v\" (UniqueName: \"kubernetes.io/projected/281cfff8-9bcf-4722-a10a-7872455a391f-kube-api-access-wql8v\") pod \"281cfff8-9bcf-4722-a10a-7872455a391f\" (UID: \"281cfff8-9bcf-4722-a10a-7872455a391f\") " Dec 04 12:09:40.859138 master-0 kubenswrapper[35367]: I1204 12:09:40.858352 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/281cfff8-9bcf-4722-a10a-7872455a391f-catalog-content\") pod \"281cfff8-9bcf-4722-a10a-7872455a391f\" (UID: \"281cfff8-9bcf-4722-a10a-7872455a391f\") " Dec 04 12:09:40.859490 master-0 kubenswrapper[35367]: I1204 12:09:40.859163 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/281cfff8-9bcf-4722-a10a-7872455a391f-utilities" (OuterVolumeSpecName: "utilities") pod "281cfff8-9bcf-4722-a10a-7872455a391f" (UID: "281cfff8-9bcf-4722-a10a-7872455a391f"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:40.866588 master-0 kubenswrapper[35367]: I1204 12:09:40.860542 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/46967266-5366-4e53-9c4d-9575e02846cb-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:40.866588 master-0 kubenswrapper[35367]: I1204 12:09:40.860575 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/46967266-5366-4e53-9c4d-9575e02846cb-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:40.866588 master-0 kubenswrapper[35367]: I1204 12:09:40.860585 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/281cfff8-9bcf-4722-a10a-7872455a391f-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:40.866588 master-0 kubenswrapper[35367]: I1204 12:09:40.860595 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-spghh\" (UniqueName: \"kubernetes.io/projected/46967266-5366-4e53-9c4d-9575e02846cb-kube-api-access-spghh\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:40.866588 master-0 kubenswrapper[35367]: I1204 12:09:40.865199 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/281cfff8-9bcf-4722-a10a-7872455a391f-kube-api-access-wql8v" (OuterVolumeSpecName: "kube-api-access-wql8v") pod "281cfff8-9bcf-4722-a10a-7872455a391f" (UID: "281cfff8-9bcf-4722-a10a-7872455a391f"). InnerVolumeSpecName "kube-api-access-wql8v". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:40.873603 master-0 kubenswrapper[35367]: I1204 12:09:40.873541 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-rq9mp"] Dec 04 12:09:40.873874 master-0 kubenswrapper[35367]: I1204 12:09:40.873826 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-rq9mp" podUID="e1ea6568-d279-495a-934e-f30deabcd2c9" containerName="registry-server" containerID="cri-o://511983834e9b0f278e91bcd5967e8c5b5a1cb00be72993dffae795499a8eff84" gracePeriod=2 Dec 04 12:09:40.882224 master-0 kubenswrapper[35367]: I1204 12:09:40.882160 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/281cfff8-9bcf-4722-a10a-7872455a391f-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "281cfff8-9bcf-4722-a10a-7872455a391f" (UID: "281cfff8-9bcf-4722-a10a-7872455a391f"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:40.962418 master-0 kubenswrapper[35367]: I1204 12:09:40.962341 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wql8v\" (UniqueName: \"kubernetes.io/projected/281cfff8-9bcf-4722-a10a-7872455a391f-kube-api-access-wql8v\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:40.962418 master-0 kubenswrapper[35367]: I1204 12:09:40.962408 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/281cfff8-9bcf-4722-a10a-7872455a391f-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:41.057336 master-0 kubenswrapper[35367]: I1204 12:09:41.057285 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-pdr77" Dec 04 12:09:41.088260 master-0 kubenswrapper[35367]: I1204 12:09:41.088046 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-zjmf2"] Dec 04 12:09:41.089017 master-0 kubenswrapper[35367]: I1204 12:09:41.088561 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-zjmf2" podUID="31422ce2-eae5-47fb-9c8b-7a77caa95696" containerName="registry-server" containerID="cri-o://a4f1224236144b6c7ea4099d4c5ee862fd897de816a6a8ef813fcf86f4e8b32e" gracePeriod=2 Dec 04 12:09:41.188765 master-0 kubenswrapper[35367]: I1204 12:09:41.188664 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhtm9\" (UniqueName: \"kubernetes.io/projected/16b1a088-3ac8-45f8-9f7e-504caab0307b-kube-api-access-nhtm9\") pod \"16b1a088-3ac8-45f8-9f7e-504caab0307b\" (UID: \"16b1a088-3ac8-45f8-9f7e-504caab0307b\") " Dec 04 12:09:41.189024 master-0 kubenswrapper[35367]: I1204 12:09:41.188823 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-7j7ql" Dec 04 12:09:41.189024 master-0 kubenswrapper[35367]: I1204 12:09:41.188955 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/16b1a088-3ac8-45f8-9f7e-504caab0307b-utilities\") pod \"16b1a088-3ac8-45f8-9f7e-504caab0307b\" (UID: \"16b1a088-3ac8-45f8-9f7e-504caab0307b\") " Dec 04 12:09:41.189243 master-0 kubenswrapper[35367]: I1204 12:09:41.189041 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/16b1a088-3ac8-45f8-9f7e-504caab0307b-catalog-content\") pod \"16b1a088-3ac8-45f8-9f7e-504caab0307b\" (UID: \"16b1a088-3ac8-45f8-9f7e-504caab0307b\") " Dec 04 12:09:41.190295 master-0 kubenswrapper[35367]: I1204 12:09:41.190080 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16b1a088-3ac8-45f8-9f7e-504caab0307b-utilities" (OuterVolumeSpecName: "utilities") pod "16b1a088-3ac8-45f8-9f7e-504caab0307b" (UID: "16b1a088-3ac8-45f8-9f7e-504caab0307b"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:41.190930 master-0 kubenswrapper[35367]: I1204 12:09:41.190633 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/16b1a088-3ac8-45f8-9f7e-504caab0307b-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:41.193397 master-0 kubenswrapper[35367]: I1204 12:09:41.191790 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16b1a088-3ac8-45f8-9f7e-504caab0307b-kube-api-access-nhtm9" (OuterVolumeSpecName: "kube-api-access-nhtm9") pod "16b1a088-3ac8-45f8-9f7e-504caab0307b" (UID: "16b1a088-3ac8-45f8-9f7e-504caab0307b"). InnerVolumeSpecName "kube-api-access-nhtm9". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:41.214742 master-0 kubenswrapper[35367]: I1204 12:09:41.214687 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16b1a088-3ac8-45f8-9f7e-504caab0307b-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "16b1a088-3ac8-45f8-9f7e-504caab0307b" (UID: "16b1a088-3ac8-45f8-9f7e-504caab0307b"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:41.273830 master-0 kubenswrapper[35367]: I1204 12:09:41.273735 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-ndng9"] Dec 04 12:09:41.274146 master-0 kubenswrapper[35367]: I1204 12:09:41.274096 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-ndng9" podUID="bbe68aaa-bd9b-43b9-b465-fb0c09484c64" containerName="registry-server" containerID="cri-o://8e440fe2c7b2d0aa1f6471c74036b40b7f1b7b30eb51da7ee44fec643b7dd2b4" gracePeriod=2 Dec 04 12:09:41.291636 master-0 kubenswrapper[35367]: I1204 12:09:41.291552 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc6sr\" (UniqueName: \"kubernetes.io/projected/1cdce2be-c255-424e-8da3-7665cc617e32-kube-api-access-tc6sr\") pod \"1cdce2be-c255-424e-8da3-7665cc617e32\" (UID: \"1cdce2be-c255-424e-8da3-7665cc617e32\") " Dec 04 12:09:41.291636 master-0 kubenswrapper[35367]: I1204 12:09:41.291617 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1cdce2be-c255-424e-8da3-7665cc617e32-catalog-content\") pod \"1cdce2be-c255-424e-8da3-7665cc617e32\" (UID: \"1cdce2be-c255-424e-8da3-7665cc617e32\") " Dec 04 12:09:41.291777 master-0 kubenswrapper[35367]: I1204 12:09:41.291648 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1cdce2be-c255-424e-8da3-7665cc617e32-utilities\") pod \"1cdce2be-c255-424e-8da3-7665cc617e32\" (UID: \"1cdce2be-c255-424e-8da3-7665cc617e32\") " Dec 04 12:09:41.292104 master-0 kubenswrapper[35367]: I1204 12:09:41.292072 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nhtm9\" (UniqueName: \"kubernetes.io/projected/16b1a088-3ac8-45f8-9f7e-504caab0307b-kube-api-access-nhtm9\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:41.292104 master-0 kubenswrapper[35367]: I1204 12:09:41.292091 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/16b1a088-3ac8-45f8-9f7e-504caab0307b-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:41.294082 master-0 kubenswrapper[35367]: I1204 12:09:41.294048 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cdce2be-c255-424e-8da3-7665cc617e32-utilities" (OuterVolumeSpecName: "utilities") pod "1cdce2be-c255-424e-8da3-7665cc617e32" (UID: "1cdce2be-c255-424e-8da3-7665cc617e32"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:41.295956 master-0 kubenswrapper[35367]: I1204 12:09:41.295826 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cdce2be-c255-424e-8da3-7665cc617e32-kube-api-access-tc6sr" (OuterVolumeSpecName: "kube-api-access-tc6sr") pod "1cdce2be-c255-424e-8da3-7665cc617e32" (UID: "1cdce2be-c255-424e-8da3-7665cc617e32"). InnerVolumeSpecName "kube-api-access-tc6sr". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:41.313914 master-0 kubenswrapper[35367]: I1204 12:09:41.313852 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cdce2be-c255-424e-8da3-7665cc617e32-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "1cdce2be-c255-424e-8da3-7665cc617e32" (UID: "1cdce2be-c255-424e-8da3-7665cc617e32"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:41.387741 master-0 kubenswrapper[35367]: I1204 12:09:41.387672 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-rq9mp" Dec 04 12:09:41.393749 master-0 kubenswrapper[35367]: I1204 12:09:41.393678 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tc6sr\" (UniqueName: \"kubernetes.io/projected/1cdce2be-c255-424e-8da3-7665cc617e32-kube-api-access-tc6sr\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:41.393749 master-0 kubenswrapper[35367]: I1204 12:09:41.393746 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1cdce2be-c255-424e-8da3-7665cc617e32-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:41.393967 master-0 kubenswrapper[35367]: I1204 12:09:41.393779 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1cdce2be-c255-424e-8da3-7665cc617e32-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:41.494724 master-0 kubenswrapper[35367]: I1204 12:09:41.494603 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jrch\" (UniqueName: \"kubernetes.io/projected/e1ea6568-d279-495a-934e-f30deabcd2c9-kube-api-access-7jrch\") pod \"e1ea6568-d279-495a-934e-f30deabcd2c9\" (UID: \"e1ea6568-d279-495a-934e-f30deabcd2c9\") " Dec 04 12:09:41.495007 master-0 kubenswrapper[35367]: I1204 12:09:41.494944 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e1ea6568-d279-495a-934e-f30deabcd2c9-utilities\") pod \"e1ea6568-d279-495a-934e-f30deabcd2c9\" (UID: \"e1ea6568-d279-495a-934e-f30deabcd2c9\") " Dec 04 12:09:41.495061 master-0 kubenswrapper[35367]: I1204 12:09:41.495011 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e1ea6568-d279-495a-934e-f30deabcd2c9-catalog-content\") pod \"e1ea6568-d279-495a-934e-f30deabcd2c9\" (UID: \"e1ea6568-d279-495a-934e-f30deabcd2c9\") " Dec 04 12:09:41.496211 master-0 kubenswrapper[35367]: I1204 12:09:41.496113 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1ea6568-d279-495a-934e-f30deabcd2c9-utilities" (OuterVolumeSpecName: "utilities") pod "e1ea6568-d279-495a-934e-f30deabcd2c9" (UID: "e1ea6568-d279-495a-934e-f30deabcd2c9"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:41.498721 master-0 kubenswrapper[35367]: I1204 12:09:41.498538 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1ea6568-d279-495a-934e-f30deabcd2c9-kube-api-access-7jrch" (OuterVolumeSpecName: "kube-api-access-7jrch") pod "e1ea6568-d279-495a-934e-f30deabcd2c9" (UID: "e1ea6568-d279-495a-934e-f30deabcd2c9"). InnerVolumeSpecName "kube-api-access-7jrch". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:41.525299 master-0 kubenswrapper[35367]: I1204 12:09:41.524316 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1ea6568-d279-495a-934e-f30deabcd2c9-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "e1ea6568-d279-495a-934e-f30deabcd2c9" (UID: "e1ea6568-d279-495a-934e-f30deabcd2c9"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:41.539346 master-0 kubenswrapper[35367]: I1204 12:09:41.539287 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-zjmf2" Dec 04 12:09:41.572114 master-0 kubenswrapper[35367]: I1204 12:09:41.571907 35367 generic.go:334] "Generic (PLEG): container finished" podID="16b1a088-3ac8-45f8-9f7e-504caab0307b" containerID="4c4c50f6ed837b50065ec95193774f36a2b50695d48f4bc50c159cabef802a01" exitCode=0 Dec 04 12:09:41.572114 master-0 kubenswrapper[35367]: I1204 12:09:41.572061 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-pdr77" Dec 04 12:09:41.572862 master-0 kubenswrapper[35367]: I1204 12:09:41.572071 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-pdr77" event={"ID":"16b1a088-3ac8-45f8-9f7e-504caab0307b","Type":"ContainerDied","Data":"4c4c50f6ed837b50065ec95193774f36a2b50695d48f4bc50c159cabef802a01"} Dec 04 12:09:41.572952 master-0 kubenswrapper[35367]: I1204 12:09:41.572909 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-pdr77" event={"ID":"16b1a088-3ac8-45f8-9f7e-504caab0307b","Type":"ContainerDied","Data":"f8c2319179d03d4c8d762938124afe3d50bff8e2f0dd16f408388bcdd84a22c7"} Dec 04 12:09:41.572990 master-0 kubenswrapper[35367]: I1204 12:09:41.572963 35367 scope.go:117] "RemoveContainer" containerID="4c4c50f6ed837b50065ec95193774f36a2b50695d48f4bc50c159cabef802a01" Dec 04 12:09:41.596716 master-0 kubenswrapper[35367]: I1204 12:09:41.596656 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vts8\" (UniqueName: \"kubernetes.io/projected/31422ce2-eae5-47fb-9c8b-7a77caa95696-kube-api-access-6vts8\") pod \"31422ce2-eae5-47fb-9c8b-7a77caa95696\" (UID: \"31422ce2-eae5-47fb-9c8b-7a77caa95696\") " Dec 04 12:09:41.596846 master-0 kubenswrapper[35367]: I1204 12:09:41.596751 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/31422ce2-eae5-47fb-9c8b-7a77caa95696-utilities\") pod \"31422ce2-eae5-47fb-9c8b-7a77caa95696\" (UID: \"31422ce2-eae5-47fb-9c8b-7a77caa95696\") " Dec 04 12:09:41.596962 master-0 kubenswrapper[35367]: I1204 12:09:41.596936 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/31422ce2-eae5-47fb-9c8b-7a77caa95696-catalog-content\") pod \"31422ce2-eae5-47fb-9c8b-7a77caa95696\" (UID: \"31422ce2-eae5-47fb-9c8b-7a77caa95696\") " Dec 04 12:09:41.597528 master-0 kubenswrapper[35367]: I1204 12:09:41.597478 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7jrch\" (UniqueName: \"kubernetes.io/projected/e1ea6568-d279-495a-934e-f30deabcd2c9-kube-api-access-7jrch\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:41.597528 master-0 kubenswrapper[35367]: I1204 12:09:41.597511 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e1ea6568-d279-495a-934e-f30deabcd2c9-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:41.597528 master-0 kubenswrapper[35367]: I1204 12:09:41.597528 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e1ea6568-d279-495a-934e-f30deabcd2c9-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:41.597787 master-0 kubenswrapper[35367]: I1204 12:09:41.597703 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31422ce2-eae5-47fb-9c8b-7a77caa95696-utilities" (OuterVolumeSpecName: "utilities") pod "31422ce2-eae5-47fb-9c8b-7a77caa95696" (UID: "31422ce2-eae5-47fb-9c8b-7a77caa95696"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:41.600504 master-0 kubenswrapper[35367]: I1204 12:09:41.600455 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31422ce2-eae5-47fb-9c8b-7a77caa95696-kube-api-access-6vts8" (OuterVolumeSpecName: "kube-api-access-6vts8") pod "31422ce2-eae5-47fb-9c8b-7a77caa95696" (UID: "31422ce2-eae5-47fb-9c8b-7a77caa95696"). InnerVolumeSpecName "kube-api-access-6vts8". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:41.603204 master-0 kubenswrapper[35367]: I1204 12:09:41.603141 35367 generic.go:334] "Generic (PLEG): container finished" podID="31422ce2-eae5-47fb-9c8b-7a77caa95696" containerID="a4f1224236144b6c7ea4099d4c5ee862fd897de816a6a8ef813fcf86f4e8b32e" exitCode=0 Dec 04 12:09:41.603289 master-0 kubenswrapper[35367]: I1204 12:09:41.603233 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zjmf2" event={"ID":"31422ce2-eae5-47fb-9c8b-7a77caa95696","Type":"ContainerDied","Data":"a4f1224236144b6c7ea4099d4c5ee862fd897de816a6a8ef813fcf86f4e8b32e"} Dec 04 12:09:41.603289 master-0 kubenswrapper[35367]: I1204 12:09:41.603271 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zjmf2" event={"ID":"31422ce2-eae5-47fb-9c8b-7a77caa95696","Type":"ContainerDied","Data":"dd7fe7ee1a8ce2c215ee05e3d6929c00e06eac6efc64a06d5e902647d77d3831"} Dec 04 12:09:41.603399 master-0 kubenswrapper[35367]: I1204 12:09:41.603365 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-zjmf2" Dec 04 12:09:41.607153 master-0 kubenswrapper[35367]: I1204 12:09:41.607121 35367 generic.go:334] "Generic (PLEG): container finished" podID="1cdce2be-c255-424e-8da3-7665cc617e32" containerID="d445fc59dd070294732be621499138e18dc0f2b923b2554aebf34d4b80035e33" exitCode=0 Dec 04 12:09:41.607380 master-0 kubenswrapper[35367]: I1204 12:09:41.607151 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-7j7ql" event={"ID":"1cdce2be-c255-424e-8da3-7665cc617e32","Type":"ContainerDied","Data":"d445fc59dd070294732be621499138e18dc0f2b923b2554aebf34d4b80035e33"} Dec 04 12:09:41.607380 master-0 kubenswrapper[35367]: I1204 12:09:41.607184 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-7j7ql" event={"ID":"1cdce2be-c255-424e-8da3-7665cc617e32","Type":"ContainerDied","Data":"aa5fdd9a480678147c816766be6f77442a2f35817489611c109c1332c222f2c3"} Dec 04 12:09:41.607380 master-0 kubenswrapper[35367]: I1204 12:09:41.607327 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-7j7ql" Dec 04 12:09:41.613851 master-0 kubenswrapper[35367]: I1204 12:09:41.613744 35367 scope.go:117] "RemoveContainer" containerID="ccef75c2edbcebdfe738c9fbfb89cdaaa96cfc75dcc67875b5e4179d13aeb477" Dec 04 12:09:41.631232 master-0 kubenswrapper[35367]: I1204 12:09:41.631016 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-2xqkk" event={"ID":"281cfff8-9bcf-4722-a10a-7872455a391f","Type":"ContainerDied","Data":"ff07b571c7d7f220b388132ab36e3437e0604c73d6d05ea1fc689e6735e03eac"} Dec 04 12:09:41.631232 master-0 kubenswrapper[35367]: I1204 12:09:41.631154 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-2xqkk" Dec 04 12:09:41.637204 master-0 kubenswrapper[35367]: I1204 12:09:41.636909 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31422ce2-eae5-47fb-9c8b-7a77caa95696-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "31422ce2-eae5-47fb-9c8b-7a77caa95696" (UID: "31422ce2-eae5-47fb-9c8b-7a77caa95696"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:41.640451 master-0 kubenswrapper[35367]: I1204 12:09:41.640089 35367 generic.go:334] "Generic (PLEG): container finished" podID="e1ea6568-d279-495a-934e-f30deabcd2c9" containerID="511983834e9b0f278e91bcd5967e8c5b5a1cb00be72993dffae795499a8eff84" exitCode=0 Dec 04 12:09:41.640451 master-0 kubenswrapper[35367]: I1204 12:09:41.640167 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-rq9mp" Dec 04 12:09:41.640451 master-0 kubenswrapper[35367]: I1204 12:09:41.640247 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-rq9mp" event={"ID":"e1ea6568-d279-495a-934e-f30deabcd2c9","Type":"ContainerDied","Data":"511983834e9b0f278e91bcd5967e8c5b5a1cb00be72993dffae795499a8eff84"} Dec 04 12:09:41.640451 master-0 kubenswrapper[35367]: I1204 12:09:41.640289 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-rq9mp" event={"ID":"e1ea6568-d279-495a-934e-f30deabcd2c9","Type":"ContainerDied","Data":"c70324918e4db257c76635e85a30b2cf009b8a2fee98086b59cec7a5ea4bb8a9"} Dec 04 12:09:41.647488 master-0 kubenswrapper[35367]: I1204 12:09:41.647329 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-pdr77"] Dec 04 12:09:41.650720 master-0 kubenswrapper[35367]: I1204 12:09:41.650685 35367 generic.go:334] "Generic (PLEG): container finished" podID="bbe68aaa-bd9b-43b9-b465-fb0c09484c64" containerID="8e440fe2c7b2d0aa1f6471c74036b40b7f1b7b30eb51da7ee44fec643b7dd2b4" exitCode=0 Dec 04 12:09:41.650838 master-0 kubenswrapper[35367]: I1204 12:09:41.650787 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-ndng9" event={"ID":"bbe68aaa-bd9b-43b9-b465-fb0c09484c64","Type":"ContainerDied","Data":"8e440fe2c7b2d0aa1f6471c74036b40b7f1b7b30eb51da7ee44fec643b7dd2b4"} Dec 04 12:09:41.650920 master-0 kubenswrapper[35367]: I1204 12:09:41.650834 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-g7j5b" Dec 04 12:09:41.651668 master-0 kubenswrapper[35367]: I1204 12:09:41.651645 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-pdr77"] Dec 04 12:09:41.689217 master-0 kubenswrapper[35367]: I1204 12:09:41.689123 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-7j7ql"] Dec 04 12:09:41.697963 master-0 kubenswrapper[35367]: I1204 12:09:41.695882 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-7j7ql"] Dec 04 12:09:41.699560 master-0 kubenswrapper[35367]: I1204 12:09:41.699518 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6vts8\" (UniqueName: \"kubernetes.io/projected/31422ce2-eae5-47fb-9c8b-7a77caa95696-kube-api-access-6vts8\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:41.700174 master-0 kubenswrapper[35367]: I1204 12:09:41.699567 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/31422ce2-eae5-47fb-9c8b-7a77caa95696-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:41.700174 master-0 kubenswrapper[35367]: I1204 12:09:41.699580 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/31422ce2-eae5-47fb-9c8b-7a77caa95696-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:41.707370 master-0 kubenswrapper[35367]: I1204 12:09:41.707326 35367 scope.go:117] "RemoveContainer" containerID="db691e24cab0b180f95b00877c8396a8487a3847bb967cda25f87f2f9c0feda1" Dec 04 12:09:41.708099 master-0 kubenswrapper[35367]: I1204 12:09:41.707452 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-2xqkk"] Dec 04 12:09:41.708209 master-0 kubenswrapper[35367]: I1204 12:09:41.708156 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-2xqkk"] Dec 04 12:09:41.719184 master-0 kubenswrapper[35367]: I1204 12:09:41.719111 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-g7j5b"] Dec 04 12:09:41.723233 master-0 kubenswrapper[35367]: I1204 12:09:41.723100 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-ndng9" Dec 04 12:09:41.726942 master-0 kubenswrapper[35367]: I1204 12:09:41.726562 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-g7j5b"] Dec 04 12:09:41.736627 master-0 kubenswrapper[35367]: I1204 12:09:41.736562 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-rq9mp"] Dec 04 12:09:41.743506 master-0 kubenswrapper[35367]: I1204 12:09:41.743385 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-rq9mp"] Dec 04 12:09:41.750005 master-0 kubenswrapper[35367]: I1204 12:09:41.749959 35367 scope.go:117] "RemoveContainer" containerID="4c4c50f6ed837b50065ec95193774f36a2b50695d48f4bc50c159cabef802a01" Dec 04 12:09:41.750575 master-0 kubenswrapper[35367]: E1204 12:09:41.750537 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c4c50f6ed837b50065ec95193774f36a2b50695d48f4bc50c159cabef802a01\": container with ID starting with 4c4c50f6ed837b50065ec95193774f36a2b50695d48f4bc50c159cabef802a01 not found: ID does not exist" containerID="4c4c50f6ed837b50065ec95193774f36a2b50695d48f4bc50c159cabef802a01" Dec 04 12:09:41.750647 master-0 kubenswrapper[35367]: I1204 12:09:41.750573 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c4c50f6ed837b50065ec95193774f36a2b50695d48f4bc50c159cabef802a01"} err="failed to get container status \"4c4c50f6ed837b50065ec95193774f36a2b50695d48f4bc50c159cabef802a01\": rpc error: code = NotFound desc = could not find container \"4c4c50f6ed837b50065ec95193774f36a2b50695d48f4bc50c159cabef802a01\": container with ID starting with 4c4c50f6ed837b50065ec95193774f36a2b50695d48f4bc50c159cabef802a01 not found: ID does not exist" Dec 04 12:09:41.750647 master-0 kubenswrapper[35367]: I1204 12:09:41.750600 35367 scope.go:117] "RemoveContainer" containerID="ccef75c2edbcebdfe738c9fbfb89cdaaa96cfc75dcc67875b5e4179d13aeb477" Dec 04 12:09:41.751127 master-0 kubenswrapper[35367]: E1204 12:09:41.751076 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccef75c2edbcebdfe738c9fbfb89cdaaa96cfc75dcc67875b5e4179d13aeb477\": container with ID starting with ccef75c2edbcebdfe738c9fbfb89cdaaa96cfc75dcc67875b5e4179d13aeb477 not found: ID does not exist" containerID="ccef75c2edbcebdfe738c9fbfb89cdaaa96cfc75dcc67875b5e4179d13aeb477" Dec 04 12:09:41.751212 master-0 kubenswrapper[35367]: I1204 12:09:41.751127 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccef75c2edbcebdfe738c9fbfb89cdaaa96cfc75dcc67875b5e4179d13aeb477"} err="failed to get container status \"ccef75c2edbcebdfe738c9fbfb89cdaaa96cfc75dcc67875b5e4179d13aeb477\": rpc error: code = NotFound desc = could not find container \"ccef75c2edbcebdfe738c9fbfb89cdaaa96cfc75dcc67875b5e4179d13aeb477\": container with ID starting with ccef75c2edbcebdfe738c9fbfb89cdaaa96cfc75dcc67875b5e4179d13aeb477 not found: ID does not exist" Dec 04 12:09:41.751212 master-0 kubenswrapper[35367]: I1204 12:09:41.751167 35367 scope.go:117] "RemoveContainer" containerID="db691e24cab0b180f95b00877c8396a8487a3847bb967cda25f87f2f9c0feda1" Dec 04 12:09:41.751590 master-0 kubenswrapper[35367]: E1204 12:09:41.751555 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db691e24cab0b180f95b00877c8396a8487a3847bb967cda25f87f2f9c0feda1\": container with ID starting with db691e24cab0b180f95b00877c8396a8487a3847bb967cda25f87f2f9c0feda1 not found: ID does not exist" containerID="db691e24cab0b180f95b00877c8396a8487a3847bb967cda25f87f2f9c0feda1" Dec 04 12:09:41.751639 master-0 kubenswrapper[35367]: I1204 12:09:41.751584 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db691e24cab0b180f95b00877c8396a8487a3847bb967cda25f87f2f9c0feda1"} err="failed to get container status \"db691e24cab0b180f95b00877c8396a8487a3847bb967cda25f87f2f9c0feda1\": rpc error: code = NotFound desc = could not find container \"db691e24cab0b180f95b00877c8396a8487a3847bb967cda25f87f2f9c0feda1\": container with ID starting with db691e24cab0b180f95b00877c8396a8487a3847bb967cda25f87f2f9c0feda1 not found: ID does not exist" Dec 04 12:09:41.751639 master-0 kubenswrapper[35367]: I1204 12:09:41.751600 35367 scope.go:117] "RemoveContainer" containerID="a4f1224236144b6c7ea4099d4c5ee862fd897de816a6a8ef813fcf86f4e8b32e" Dec 04 12:09:41.809502 master-0 kubenswrapper[35367]: I1204 12:09:41.804743 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/bbe68aaa-bd9b-43b9-b465-fb0c09484c64-utilities\") pod \"bbe68aaa-bd9b-43b9-b465-fb0c09484c64\" (UID: \"bbe68aaa-bd9b-43b9-b465-fb0c09484c64\") " Dec 04 12:09:41.809502 master-0 kubenswrapper[35367]: I1204 12:09:41.804872 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqkp8\" (UniqueName: \"kubernetes.io/projected/bbe68aaa-bd9b-43b9-b465-fb0c09484c64-kube-api-access-hqkp8\") pod \"bbe68aaa-bd9b-43b9-b465-fb0c09484c64\" (UID: \"bbe68aaa-bd9b-43b9-b465-fb0c09484c64\") " Dec 04 12:09:41.809502 master-0 kubenswrapper[35367]: I1204 12:09:41.804942 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/bbe68aaa-bd9b-43b9-b465-fb0c09484c64-catalog-content\") pod \"bbe68aaa-bd9b-43b9-b465-fb0c09484c64\" (UID: \"bbe68aaa-bd9b-43b9-b465-fb0c09484c64\") " Dec 04 12:09:41.809502 master-0 kubenswrapper[35367]: I1204 12:09:41.806110 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbe68aaa-bd9b-43b9-b465-fb0c09484c64-utilities" (OuterVolumeSpecName: "utilities") pod "bbe68aaa-bd9b-43b9-b465-fb0c09484c64" (UID: "bbe68aaa-bd9b-43b9-b465-fb0c09484c64"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:41.809502 master-0 kubenswrapper[35367]: I1204 12:09:41.807259 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/bbe68aaa-bd9b-43b9-b465-fb0c09484c64-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:41.810201 master-0 kubenswrapper[35367]: I1204 12:09:41.810154 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbe68aaa-bd9b-43b9-b465-fb0c09484c64-kube-api-access-hqkp8" (OuterVolumeSpecName: "kube-api-access-hqkp8") pod "bbe68aaa-bd9b-43b9-b465-fb0c09484c64" (UID: "bbe68aaa-bd9b-43b9-b465-fb0c09484c64"). InnerVolumeSpecName "kube-api-access-hqkp8". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:09:41.823190 master-0 kubenswrapper[35367]: I1204 12:09:41.823145 35367 scope.go:117] "RemoveContainer" containerID="1d17a508bbe81486fabcdc52dd4124695521fc6f724810611a1af39a7262a3e4" Dec 04 12:09:41.834697 master-0 kubenswrapper[35367]: I1204 12:09:41.834420 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbe68aaa-bd9b-43b9-b465-fb0c09484c64-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "bbe68aaa-bd9b-43b9-b465-fb0c09484c64" (UID: "bbe68aaa-bd9b-43b9-b465-fb0c09484c64"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:09:41.887982 master-0 kubenswrapper[35367]: I1204 12:09:41.887927 35367 scope.go:117] "RemoveContainer" containerID="b34d3f9ec14a37124a4ae5bce6c68a19a81cf659747228d302c387bbcdeaaf68" Dec 04 12:09:41.907249 master-0 kubenswrapper[35367]: I1204 12:09:41.907207 35367 scope.go:117] "RemoveContainer" containerID="a4f1224236144b6c7ea4099d4c5ee862fd897de816a6a8ef813fcf86f4e8b32e" Dec 04 12:09:41.907820 master-0 kubenswrapper[35367]: E1204 12:09:41.907750 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4f1224236144b6c7ea4099d4c5ee862fd897de816a6a8ef813fcf86f4e8b32e\": container with ID starting with a4f1224236144b6c7ea4099d4c5ee862fd897de816a6a8ef813fcf86f4e8b32e not found: ID does not exist" containerID="a4f1224236144b6c7ea4099d4c5ee862fd897de816a6a8ef813fcf86f4e8b32e" Dec 04 12:09:41.907879 master-0 kubenswrapper[35367]: I1204 12:09:41.907842 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4f1224236144b6c7ea4099d4c5ee862fd897de816a6a8ef813fcf86f4e8b32e"} err="failed to get container status \"a4f1224236144b6c7ea4099d4c5ee862fd897de816a6a8ef813fcf86f4e8b32e\": rpc error: code = NotFound desc = could not find container \"a4f1224236144b6c7ea4099d4c5ee862fd897de816a6a8ef813fcf86f4e8b32e\": container with ID starting with a4f1224236144b6c7ea4099d4c5ee862fd897de816a6a8ef813fcf86f4e8b32e not found: ID does not exist" Dec 04 12:09:41.907926 master-0 kubenswrapper[35367]: I1204 12:09:41.907884 35367 scope.go:117] "RemoveContainer" containerID="1d17a508bbe81486fabcdc52dd4124695521fc6f724810611a1af39a7262a3e4" Dec 04 12:09:41.908173 master-0 kubenswrapper[35367]: I1204 12:09:41.908144 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hqkp8\" (UniqueName: \"kubernetes.io/projected/bbe68aaa-bd9b-43b9-b465-fb0c09484c64-kube-api-access-hqkp8\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:41.908214 master-0 kubenswrapper[35367]: I1204 12:09:41.908172 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/bbe68aaa-bd9b-43b9-b465-fb0c09484c64-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:09:41.908428 master-0 kubenswrapper[35367]: E1204 12:09:41.908398 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d17a508bbe81486fabcdc52dd4124695521fc6f724810611a1af39a7262a3e4\": container with ID starting with 1d17a508bbe81486fabcdc52dd4124695521fc6f724810611a1af39a7262a3e4 not found: ID does not exist" containerID="1d17a508bbe81486fabcdc52dd4124695521fc6f724810611a1af39a7262a3e4" Dec 04 12:09:41.908460 master-0 kubenswrapper[35367]: I1204 12:09:41.908431 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d17a508bbe81486fabcdc52dd4124695521fc6f724810611a1af39a7262a3e4"} err="failed to get container status \"1d17a508bbe81486fabcdc52dd4124695521fc6f724810611a1af39a7262a3e4\": rpc error: code = NotFound desc = could not find container \"1d17a508bbe81486fabcdc52dd4124695521fc6f724810611a1af39a7262a3e4\": container with ID starting with 1d17a508bbe81486fabcdc52dd4124695521fc6f724810611a1af39a7262a3e4 not found: ID does not exist" Dec 04 12:09:41.908460 master-0 kubenswrapper[35367]: I1204 12:09:41.908458 35367 scope.go:117] "RemoveContainer" containerID="b34d3f9ec14a37124a4ae5bce6c68a19a81cf659747228d302c387bbcdeaaf68" Dec 04 12:09:41.908924 master-0 kubenswrapper[35367]: E1204 12:09:41.908896 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b34d3f9ec14a37124a4ae5bce6c68a19a81cf659747228d302c387bbcdeaaf68\": container with ID starting with b34d3f9ec14a37124a4ae5bce6c68a19a81cf659747228d302c387bbcdeaaf68 not found: ID does not exist" containerID="b34d3f9ec14a37124a4ae5bce6c68a19a81cf659747228d302c387bbcdeaaf68" Dec 04 12:09:41.908969 master-0 kubenswrapper[35367]: I1204 12:09:41.908920 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b34d3f9ec14a37124a4ae5bce6c68a19a81cf659747228d302c387bbcdeaaf68"} err="failed to get container status \"b34d3f9ec14a37124a4ae5bce6c68a19a81cf659747228d302c387bbcdeaaf68\": rpc error: code = NotFound desc = could not find container \"b34d3f9ec14a37124a4ae5bce6c68a19a81cf659747228d302c387bbcdeaaf68\": container with ID starting with b34d3f9ec14a37124a4ae5bce6c68a19a81cf659747228d302c387bbcdeaaf68 not found: ID does not exist" Dec 04 12:09:41.908969 master-0 kubenswrapper[35367]: I1204 12:09:41.908934 35367 scope.go:117] "RemoveContainer" containerID="d445fc59dd070294732be621499138e18dc0f2b923b2554aebf34d4b80035e33" Dec 04 12:09:41.951931 master-0 kubenswrapper[35367]: I1204 12:09:41.951665 35367 scope.go:117] "RemoveContainer" containerID="402e03d57697609d3b01efaf0af0e1c611d8547e9b1a425f786da714860851b7" Dec 04 12:09:41.972929 master-0 kubenswrapper[35367]: I1204 12:09:41.965164 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-zjmf2"] Dec 04 12:09:41.979979 master-0 kubenswrapper[35367]: I1204 12:09:41.979896 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-zjmf2"] Dec 04 12:09:41.982695 master-0 kubenswrapper[35367]: I1204 12:09:41.982649 35367 scope.go:117] "RemoveContainer" containerID="6860b209617cb69aef392f1f3f953fe3d97d2a8790f9aa8d90f5ce26fdf39029" Dec 04 12:09:42.667509 master-0 kubenswrapper[35367]: I1204 12:09:42.667437 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-ndng9" event={"ID":"bbe68aaa-bd9b-43b9-b465-fb0c09484c64","Type":"ContainerDied","Data":"4bb104d79d9e9808266124028b7630fe77f1d4e68fa1fd096fa5998fb13cc230"} Dec 04 12:09:42.667800 master-0 kubenswrapper[35367]: I1204 12:09:42.667669 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-ndng9" Dec 04 12:09:42.768970 master-0 kubenswrapper[35367]: I1204 12:09:42.765745 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16b1a088-3ac8-45f8-9f7e-504caab0307b" path="/var/lib/kubelet/pods/16b1a088-3ac8-45f8-9f7e-504caab0307b/volumes" Dec 04 12:09:42.768970 master-0 kubenswrapper[35367]: I1204 12:09:42.766632 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cdce2be-c255-424e-8da3-7665cc617e32" path="/var/lib/kubelet/pods/1cdce2be-c255-424e-8da3-7665cc617e32/volumes" Dec 04 12:09:42.768970 master-0 kubenswrapper[35367]: I1204 12:09:42.767386 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="281cfff8-9bcf-4722-a10a-7872455a391f" path="/var/lib/kubelet/pods/281cfff8-9bcf-4722-a10a-7872455a391f/volumes" Dec 04 12:09:42.768970 master-0 kubenswrapper[35367]: I1204 12:09:42.768934 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31422ce2-eae5-47fb-9c8b-7a77caa95696" path="/var/lib/kubelet/pods/31422ce2-eae5-47fb-9c8b-7a77caa95696/volumes" Dec 04 12:09:42.770084 master-0 kubenswrapper[35367]: I1204 12:09:42.769703 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46967266-5366-4e53-9c4d-9575e02846cb" path="/var/lib/kubelet/pods/46967266-5366-4e53-9c4d-9575e02846cb/volumes" Dec 04 12:09:42.770084 master-0 kubenswrapper[35367]: I1204 12:09:42.769855 35367 scope.go:117] "RemoveContainer" containerID="d445fc59dd070294732be621499138e18dc0f2b923b2554aebf34d4b80035e33" Dec 04 12:09:42.775701 master-0 kubenswrapper[35367]: I1204 12:09:42.771070 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1ea6568-d279-495a-934e-f30deabcd2c9" path="/var/lib/kubelet/pods/e1ea6568-d279-495a-934e-f30deabcd2c9/volumes" Dec 04 12:09:42.775701 master-0 kubenswrapper[35367]: E1204 12:09:42.775025 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d445fc59dd070294732be621499138e18dc0f2b923b2554aebf34d4b80035e33\": container with ID starting with d445fc59dd070294732be621499138e18dc0f2b923b2554aebf34d4b80035e33 not found: ID does not exist" containerID="d445fc59dd070294732be621499138e18dc0f2b923b2554aebf34d4b80035e33" Dec 04 12:09:42.775701 master-0 kubenswrapper[35367]: I1204 12:09:42.775111 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d445fc59dd070294732be621499138e18dc0f2b923b2554aebf34d4b80035e33"} err="failed to get container status \"d445fc59dd070294732be621499138e18dc0f2b923b2554aebf34d4b80035e33\": rpc error: code = NotFound desc = could not find container \"d445fc59dd070294732be621499138e18dc0f2b923b2554aebf34d4b80035e33\": container with ID starting with d445fc59dd070294732be621499138e18dc0f2b923b2554aebf34d4b80035e33 not found: ID does not exist" Dec 04 12:09:42.775701 master-0 kubenswrapper[35367]: I1204 12:09:42.775149 35367 scope.go:117] "RemoveContainer" containerID="402e03d57697609d3b01efaf0af0e1c611d8547e9b1a425f786da714860851b7" Dec 04 12:09:42.775701 master-0 kubenswrapper[35367]: E1204 12:09:42.775507 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"402e03d57697609d3b01efaf0af0e1c611d8547e9b1a425f786da714860851b7\": container with ID starting with 402e03d57697609d3b01efaf0af0e1c611d8547e9b1a425f786da714860851b7 not found: ID does not exist" containerID="402e03d57697609d3b01efaf0af0e1c611d8547e9b1a425f786da714860851b7" Dec 04 12:09:42.775701 master-0 kubenswrapper[35367]: I1204 12:09:42.775526 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"402e03d57697609d3b01efaf0af0e1c611d8547e9b1a425f786da714860851b7"} err="failed to get container status \"402e03d57697609d3b01efaf0af0e1c611d8547e9b1a425f786da714860851b7\": rpc error: code = NotFound desc = could not find container \"402e03d57697609d3b01efaf0af0e1c611d8547e9b1a425f786da714860851b7\": container with ID starting with 402e03d57697609d3b01efaf0af0e1c611d8547e9b1a425f786da714860851b7 not found: ID does not exist" Dec 04 12:09:42.775701 master-0 kubenswrapper[35367]: I1204 12:09:42.775540 35367 scope.go:117] "RemoveContainer" containerID="6860b209617cb69aef392f1f3f953fe3d97d2a8790f9aa8d90f5ce26fdf39029" Dec 04 12:09:42.776309 master-0 kubenswrapper[35367]: E1204 12:09:42.776277 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6860b209617cb69aef392f1f3f953fe3d97d2a8790f9aa8d90f5ce26fdf39029\": container with ID starting with 6860b209617cb69aef392f1f3f953fe3d97d2a8790f9aa8d90f5ce26fdf39029 not found: ID does not exist" containerID="6860b209617cb69aef392f1f3f953fe3d97d2a8790f9aa8d90f5ce26fdf39029" Dec 04 12:09:42.776309 master-0 kubenswrapper[35367]: I1204 12:09:42.776303 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6860b209617cb69aef392f1f3f953fe3d97d2a8790f9aa8d90f5ce26fdf39029"} err="failed to get container status \"6860b209617cb69aef392f1f3f953fe3d97d2a8790f9aa8d90f5ce26fdf39029\": rpc error: code = NotFound desc = could not find container \"6860b209617cb69aef392f1f3f953fe3d97d2a8790f9aa8d90f5ce26fdf39029\": container with ID starting with 6860b209617cb69aef392f1f3f953fe3d97d2a8790f9aa8d90f5ce26fdf39029 not found: ID does not exist" Dec 04 12:09:42.776411 master-0 kubenswrapper[35367]: I1204 12:09:42.776317 35367 scope.go:117] "RemoveContainer" containerID="d483209b49df2261128c9b7363923bbf4a7173d8b0c3e987365e70c03960b49d" Dec 04 12:09:42.790214 master-0 kubenswrapper[35367]: I1204 12:09:42.790127 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-ndng9"] Dec 04 12:09:42.805416 master-0 kubenswrapper[35367]: I1204 12:09:42.805361 35367 scope.go:117] "RemoveContainer" containerID="02344c553addbb55afd0589f27651413b9628370d880b30e6fe81db6b594d50e" Dec 04 12:09:42.807438 master-0 kubenswrapper[35367]: I1204 12:09:42.807392 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-ndng9"] Dec 04 12:09:42.840854 master-0 kubenswrapper[35367]: I1204 12:09:42.840789 35367 scope.go:117] "RemoveContainer" containerID="f5ec9ebe89d57ca803e23dce19c118023e4b418032315c6a8d863fc68b85b2f8" Dec 04 12:09:42.873058 master-0 kubenswrapper[35367]: I1204 12:09:42.872869 35367 scope.go:117] "RemoveContainer" containerID="511983834e9b0f278e91bcd5967e8c5b5a1cb00be72993dffae795499a8eff84" Dec 04 12:09:42.896338 master-0 kubenswrapper[35367]: I1204 12:09:42.896298 35367 scope.go:117] "RemoveContainer" containerID="dd51aaf518c0a113250b25734d4e0828b25139289158497c9d0bfccb124b2968" Dec 04 12:09:42.925298 master-0 kubenswrapper[35367]: I1204 12:09:42.919643 35367 scope.go:117] "RemoveContainer" containerID="4a97587d11f0377af86568f986099e538ae7d9bffc2ac645e4a6eec35b48f180" Dec 04 12:09:42.943598 master-0 kubenswrapper[35367]: I1204 12:09:42.943469 35367 scope.go:117] "RemoveContainer" containerID="511983834e9b0f278e91bcd5967e8c5b5a1cb00be72993dffae795499a8eff84" Dec 04 12:09:42.944842 master-0 kubenswrapper[35367]: E1204 12:09:42.944562 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"511983834e9b0f278e91bcd5967e8c5b5a1cb00be72993dffae795499a8eff84\": container with ID starting with 511983834e9b0f278e91bcd5967e8c5b5a1cb00be72993dffae795499a8eff84 not found: ID does not exist" containerID="511983834e9b0f278e91bcd5967e8c5b5a1cb00be72993dffae795499a8eff84" Dec 04 12:09:42.944842 master-0 kubenswrapper[35367]: I1204 12:09:42.944638 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"511983834e9b0f278e91bcd5967e8c5b5a1cb00be72993dffae795499a8eff84"} err="failed to get container status \"511983834e9b0f278e91bcd5967e8c5b5a1cb00be72993dffae795499a8eff84\": rpc error: code = NotFound desc = could not find container \"511983834e9b0f278e91bcd5967e8c5b5a1cb00be72993dffae795499a8eff84\": container with ID starting with 511983834e9b0f278e91bcd5967e8c5b5a1cb00be72993dffae795499a8eff84 not found: ID does not exist" Dec 04 12:09:42.944842 master-0 kubenswrapper[35367]: I1204 12:09:42.944681 35367 scope.go:117] "RemoveContainer" containerID="dd51aaf518c0a113250b25734d4e0828b25139289158497c9d0bfccb124b2968" Dec 04 12:09:42.945206 master-0 kubenswrapper[35367]: E1204 12:09:42.945164 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd51aaf518c0a113250b25734d4e0828b25139289158497c9d0bfccb124b2968\": container with ID starting with dd51aaf518c0a113250b25734d4e0828b25139289158497c9d0bfccb124b2968 not found: ID does not exist" containerID="dd51aaf518c0a113250b25734d4e0828b25139289158497c9d0bfccb124b2968" Dec 04 12:09:42.945269 master-0 kubenswrapper[35367]: I1204 12:09:42.945210 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd51aaf518c0a113250b25734d4e0828b25139289158497c9d0bfccb124b2968"} err="failed to get container status \"dd51aaf518c0a113250b25734d4e0828b25139289158497c9d0bfccb124b2968\": rpc error: code = NotFound desc = could not find container \"dd51aaf518c0a113250b25734d4e0828b25139289158497c9d0bfccb124b2968\": container with ID starting with dd51aaf518c0a113250b25734d4e0828b25139289158497c9d0bfccb124b2968 not found: ID does not exist" Dec 04 12:09:42.945269 master-0 kubenswrapper[35367]: I1204 12:09:42.945242 35367 scope.go:117] "RemoveContainer" containerID="4a97587d11f0377af86568f986099e538ae7d9bffc2ac645e4a6eec35b48f180" Dec 04 12:09:42.945638 master-0 kubenswrapper[35367]: E1204 12:09:42.945569 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a97587d11f0377af86568f986099e538ae7d9bffc2ac645e4a6eec35b48f180\": container with ID starting with 4a97587d11f0377af86568f986099e538ae7d9bffc2ac645e4a6eec35b48f180 not found: ID does not exist" containerID="4a97587d11f0377af86568f986099e538ae7d9bffc2ac645e4a6eec35b48f180" Dec 04 12:09:42.945638 master-0 kubenswrapper[35367]: I1204 12:09:42.945606 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a97587d11f0377af86568f986099e538ae7d9bffc2ac645e4a6eec35b48f180"} err="failed to get container status \"4a97587d11f0377af86568f986099e538ae7d9bffc2ac645e4a6eec35b48f180\": rpc error: code = NotFound desc = could not find container \"4a97587d11f0377af86568f986099e538ae7d9bffc2ac645e4a6eec35b48f180\": container with ID starting with 4a97587d11f0377af86568f986099e538ae7d9bffc2ac645e4a6eec35b48f180 not found: ID does not exist" Dec 04 12:09:42.945638 master-0 kubenswrapper[35367]: I1204 12:09:42.945630 35367 scope.go:117] "RemoveContainer" containerID="8e440fe2c7b2d0aa1f6471c74036b40b7f1b7b30eb51da7ee44fec643b7dd2b4" Dec 04 12:09:42.971404 master-0 kubenswrapper[35367]: I1204 12:09:42.971362 35367 scope.go:117] "RemoveContainer" containerID="d2fb9cc22b303926bc6b95efabbdcb1df03c7e5489e2ca96b6193492ec49a932" Dec 04 12:09:42.988324 master-0 kubenswrapper[35367]: I1204 12:09:42.988272 35367 scope.go:117] "RemoveContainer" containerID="24bc05696b06ddb6b7c3927901dc1fe286698358816837d22220571188123276" Dec 04 12:09:44.756289 master-0 kubenswrapper[35367]: I1204 12:09:44.756236 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbe68aaa-bd9b-43b9-b465-fb0c09484c64" path="/var/lib/kubelet/pods/bbe68aaa-bd9b-43b9-b465-fb0c09484c64/volumes" Dec 04 12:09:46.344397 master-0 kubenswrapper[35367]: I1204 12:09:46.344302 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:46.344397 master-0 kubenswrapper[35367]: I1204 12:09:46.344369 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:46.351361 master-0 kubenswrapper[35367]: I1204 12:09:46.351292 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:46.730349 master-0 kubenswrapper[35367]: I1204 12:09:46.730227 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:09:46.814957 master-0 kubenswrapper[35367]: I1204 12:09:46.812352 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fbd8c7bd5-6tskd"] Dec 04 12:09:59.668289 master-0 kubenswrapper[35367]: I1204 12:09:59.668191 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-console/console-75b84c855f-2zcgd" podUID="5c66df21-a05d-4cb4-91ca-59d039629f95" containerName="console" containerID="cri-o://b4f6a9dece1534cc6bed922e8202fb9f74d2f6917ddffe8c13c8b7b33f40c699" gracePeriod=15 Dec 04 12:09:59.833322 master-0 kubenswrapper[35367]: I1204 12:09:59.833250 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75b84c855f-2zcgd_5c66df21-a05d-4cb4-91ca-59d039629f95/console/0.log" Dec 04 12:09:59.833322 master-0 kubenswrapper[35367]: I1204 12:09:59.833321 35367 generic.go:334] "Generic (PLEG): container finished" podID="5c66df21-a05d-4cb4-91ca-59d039629f95" containerID="b4f6a9dece1534cc6bed922e8202fb9f74d2f6917ddffe8c13c8b7b33f40c699" exitCode=2 Dec 04 12:09:59.833595 master-0 kubenswrapper[35367]: I1204 12:09:59.833366 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b84c855f-2zcgd" event={"ID":"5c66df21-a05d-4cb4-91ca-59d039629f95","Type":"ContainerDied","Data":"b4f6a9dece1534cc6bed922e8202fb9f74d2f6917ddffe8c13c8b7b33f40c699"} Dec 04 12:10:00.142311 master-0 kubenswrapper[35367]: I1204 12:10:00.142257 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75b84c855f-2zcgd_5c66df21-a05d-4cb4-91ca-59d039629f95/console/0.log" Dec 04 12:10:00.142641 master-0 kubenswrapper[35367]: I1204 12:10:00.142336 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:10:00.268176 master-0 kubenswrapper[35367]: I1204 12:10:00.268119 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-console-config\") pod \"5c66df21-a05d-4cb4-91ca-59d039629f95\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " Dec 04 12:10:00.268447 master-0 kubenswrapper[35367]: I1204 12:10:00.268242 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-service-ca\") pod \"5c66df21-a05d-4cb4-91ca-59d039629f95\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " Dec 04 12:10:00.268447 master-0 kubenswrapper[35367]: I1204 12:10:00.268273 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c66df21-a05d-4cb4-91ca-59d039629f95-console-oauth-config\") pod \"5c66df21-a05d-4cb4-91ca-59d039629f95\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " Dec 04 12:10:00.268447 master-0 kubenswrapper[35367]: I1204 12:10:00.268322 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-trusted-ca-bundle\") pod \"5c66df21-a05d-4cb4-91ca-59d039629f95\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " Dec 04 12:10:00.268447 master-0 kubenswrapper[35367]: I1204 12:10:00.268366 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-oauth-serving-cert\") pod \"5c66df21-a05d-4cb4-91ca-59d039629f95\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " Dec 04 12:10:00.268447 master-0 kubenswrapper[35367]: I1204 12:10:00.268407 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c66df21-a05d-4cb4-91ca-59d039629f95-console-serving-cert\") pod \"5c66df21-a05d-4cb4-91ca-59d039629f95\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " Dec 04 12:10:00.268629 master-0 kubenswrapper[35367]: I1204 12:10:00.268474 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9vdp\" (UniqueName: \"kubernetes.io/projected/5c66df21-a05d-4cb4-91ca-59d039629f95-kube-api-access-p9vdp\") pod \"5c66df21-a05d-4cb4-91ca-59d039629f95\" (UID: \"5c66df21-a05d-4cb4-91ca-59d039629f95\") " Dec 04 12:10:00.269168 master-0 kubenswrapper[35367]: I1204 12:10:00.268850 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-service-ca" (OuterVolumeSpecName: "service-ca") pod "5c66df21-a05d-4cb4-91ca-59d039629f95" (UID: "5c66df21-a05d-4cb4-91ca-59d039629f95"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:10:00.269168 master-0 kubenswrapper[35367]: I1204 12:10:00.268878 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5c66df21-a05d-4cb4-91ca-59d039629f95" (UID: "5c66df21-a05d-4cb4-91ca-59d039629f95"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:10:00.269168 master-0 kubenswrapper[35367]: I1204 12:10:00.268983 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5c66df21-a05d-4cb4-91ca-59d039629f95" (UID: "5c66df21-a05d-4cb4-91ca-59d039629f95"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:10:00.270053 master-0 kubenswrapper[35367]: I1204 12:10:00.269994 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-console-config" (OuterVolumeSpecName: "console-config") pod "5c66df21-a05d-4cb4-91ca-59d039629f95" (UID: "5c66df21-a05d-4cb4-91ca-59d039629f95"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:10:00.271797 master-0 kubenswrapper[35367]: I1204 12:10:00.271728 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c66df21-a05d-4cb4-91ca-59d039629f95-kube-api-access-p9vdp" (OuterVolumeSpecName: "kube-api-access-p9vdp") pod "5c66df21-a05d-4cb4-91ca-59d039629f95" (UID: "5c66df21-a05d-4cb4-91ca-59d039629f95"). InnerVolumeSpecName "kube-api-access-p9vdp". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:10:00.271797 master-0 kubenswrapper[35367]: I1204 12:10:00.271726 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c66df21-a05d-4cb4-91ca-59d039629f95-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5c66df21-a05d-4cb4-91ca-59d039629f95" (UID: "5c66df21-a05d-4cb4-91ca-59d039629f95"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:10:00.272369 master-0 kubenswrapper[35367]: I1204 12:10:00.272294 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c66df21-a05d-4cb4-91ca-59d039629f95-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5c66df21-a05d-4cb4-91ca-59d039629f95" (UID: "5c66df21-a05d-4cb4-91ca-59d039629f95"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:10:00.370750 master-0 kubenswrapper[35367]: I1204 12:10:00.370612 35367 reconciler_common.go:293] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-oauth-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 12:10:00.370750 master-0 kubenswrapper[35367]: I1204 12:10:00.370665 35367 reconciler_common.go:293] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c66df21-a05d-4cb4-91ca-59d039629f95-console-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 12:10:00.370750 master-0 kubenswrapper[35367]: I1204 12:10:00.370679 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-p9vdp\" (UniqueName: \"kubernetes.io/projected/5c66df21-a05d-4cb4-91ca-59d039629f95-kube-api-access-p9vdp\") on node \"master-0\" DevicePath \"\"" Dec 04 12:10:00.370750 master-0 kubenswrapper[35367]: I1204 12:10:00.370692 35367 reconciler_common.go:293] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-console-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:10:00.370750 master-0 kubenswrapper[35367]: I1204 12:10:00.370704 35367 reconciler_common.go:293] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-service-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 12:10:00.370750 master-0 kubenswrapper[35367]: I1204 12:10:00.370715 35367 reconciler_common.go:293] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c66df21-a05d-4cb4-91ca-59d039629f95-console-oauth-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:10:00.370750 master-0 kubenswrapper[35367]: I1204 12:10:00.370728 35367 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c66df21-a05d-4cb4-91ca-59d039629f95-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:10:00.843004 master-0 kubenswrapper[35367]: I1204 12:10:00.842930 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75b84c855f-2zcgd_5c66df21-a05d-4cb4-91ca-59d039629f95/console/0.log" Dec 04 12:10:00.843586 master-0 kubenswrapper[35367]: I1204 12:10:00.843017 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b84c855f-2zcgd" event={"ID":"5c66df21-a05d-4cb4-91ca-59d039629f95","Type":"ContainerDied","Data":"e2c64d26b099b52412f399f7ffd182449d788319c401104c65f8413c4608c8af"} Dec 04 12:10:00.843586 master-0 kubenswrapper[35367]: I1204 12:10:00.843062 35367 scope.go:117] "RemoveContainer" containerID="b4f6a9dece1534cc6bed922e8202fb9f74d2f6917ddffe8c13c8b7b33f40c699" Dec 04 12:10:00.843586 master-0 kubenswrapper[35367]: I1204 12:10:00.843225 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b84c855f-2zcgd" Dec 04 12:10:00.872129 master-0 kubenswrapper[35367]: I1204 12:10:00.872059 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75b84c855f-2zcgd"] Dec 04 12:10:00.877619 master-0 kubenswrapper[35367]: I1204 12:10:00.877575 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75b84c855f-2zcgd"] Dec 04 12:10:02.756653 master-0 kubenswrapper[35367]: I1204 12:10:02.756595 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c66df21-a05d-4cb4-91ca-59d039629f95" path="/var/lib/kubelet/pods/5c66df21-a05d-4cb4-91ca-59d039629f95/volumes" Dec 04 12:10:09.514990 master-0 kubenswrapper[35367]: I1204 12:10:09.514906 35367 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 12:10:09.515777 master-0 kubenswrapper[35367]: I1204 12:10:09.515251 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="b44cd0a1c87587350014492d2bc077ab" containerName="cluster-policy-controller" containerID="cri-o://7f675575cba3c965d1f9b34083dc70d57869771c4340830fd96ff7e46be44567" gracePeriod=30 Dec 04 12:10:09.515777 master-0 kubenswrapper[35367]: I1204 12:10:09.515337 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="b44cd0a1c87587350014492d2bc077ab" containerName="kube-controller-manager" containerID="cri-o://e87ca3f10b069a54e1783b77fabd7eac4480fb70fe7b5031d4fc5e5b5de80aae" gracePeriod=30 Dec 04 12:10:09.515777 master-0 kubenswrapper[35367]: I1204 12:10:09.515415 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="b44cd0a1c87587350014492d2bc077ab" containerName="kube-controller-manager-recovery-controller" containerID="cri-o://ae936500a2ecbcb16991b68e1fb2a6d81ea108368e7c98a8d24a4e0249d4b678" gracePeriod=30 Dec 04 12:10:09.515777 master-0 kubenswrapper[35367]: I1204 12:10:09.515488 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="b44cd0a1c87587350014492d2bc077ab" containerName="kube-controller-manager-cert-syncer" containerID="cri-o://87cce827effecd0ad9bf56376fa0e0297a57ac12320d9c37847065d59e9f1dcb" gracePeriod=30 Dec 04 12:10:09.516464 master-0 kubenswrapper[35367]: I1204 12:10:09.516306 35367 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: E1204 12:10:09.516696 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b44cd0a1c87587350014492d2bc077ab" containerName="kube-controller-manager" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: I1204 12:10:09.516716 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="b44cd0a1c87587350014492d2bc077ab" containerName="kube-controller-manager" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: E1204 12:10:09.516733 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="281cfff8-9bcf-4722-a10a-7872455a391f" containerName="extract-utilities" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: I1204 12:10:09.516742 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="281cfff8-9bcf-4722-a10a-7872455a391f" containerName="extract-utilities" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: E1204 12:10:09.516759 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="31422ce2-eae5-47fb-9c8b-7a77caa95696" containerName="extract-utilities" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: I1204 12:10:09.516768 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="31422ce2-eae5-47fb-9c8b-7a77caa95696" containerName="extract-utilities" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: E1204 12:10:09.516777 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="46967266-5366-4e53-9c4d-9575e02846cb" containerName="extract-content" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: I1204 12:10:09.516784 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="46967266-5366-4e53-9c4d-9575e02846cb" containerName="extract-content" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: E1204 12:10:09.516822 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="11c18264-a296-44af-b112-21ad216ce917" containerName="extract-content" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: I1204 12:10:09.516830 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="11c18264-a296-44af-b112-21ad216ce917" containerName="extract-content" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: E1204 12:10:09.516842 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="46967266-5366-4e53-9c4d-9575e02846cb" containerName="extract-utilities" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: I1204 12:10:09.516848 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="46967266-5366-4e53-9c4d-9575e02846cb" containerName="extract-utilities" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: E1204 12:10:09.516860 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1cdce2be-c255-424e-8da3-7665cc617e32" containerName="extract-utilities" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: I1204 12:10:09.516865 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cdce2be-c255-424e-8da3-7665cc617e32" containerName="extract-utilities" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: E1204 12:10:09.516875 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1cdce2be-c255-424e-8da3-7665cc617e32" containerName="registry-server" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: I1204 12:10:09.516881 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cdce2be-c255-424e-8da3-7665cc617e32" containerName="registry-server" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: E1204 12:10:09.516892 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="31422ce2-eae5-47fb-9c8b-7a77caa95696" containerName="registry-server" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: I1204 12:10:09.516898 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="31422ce2-eae5-47fb-9c8b-7a77caa95696" containerName="registry-server" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: E1204 12:10:09.516906 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1cdce2be-c255-424e-8da3-7665cc617e32" containerName="extract-content" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: I1204 12:10:09.516913 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cdce2be-c255-424e-8da3-7665cc617e32" containerName="extract-content" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: E1204 12:10:09.516922 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="46967266-5366-4e53-9c4d-9575e02846cb" containerName="registry-server" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: I1204 12:10:09.516930 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="46967266-5366-4e53-9c4d-9575e02846cb" containerName="registry-server" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: E1204 12:10:09.516939 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="281cfff8-9bcf-4722-a10a-7872455a391f" containerName="registry-server" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: I1204 12:10:09.516947 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="281cfff8-9bcf-4722-a10a-7872455a391f" containerName="registry-server" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: E1204 12:10:09.516960 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e1ea6568-d279-495a-934e-f30deabcd2c9" containerName="extract-content" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: I1204 12:10:09.516969 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1ea6568-d279-495a-934e-f30deabcd2c9" containerName="extract-content" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: E1204 12:10:09.516979 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="281cfff8-9bcf-4722-a10a-7872455a391f" containerName="extract-content" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: I1204 12:10:09.516987 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="281cfff8-9bcf-4722-a10a-7872455a391f" containerName="extract-content" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: E1204 12:10:09.516996 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="11c18264-a296-44af-b112-21ad216ce917" containerName="extract-utilities" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: I1204 12:10:09.517004 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="11c18264-a296-44af-b112-21ad216ce917" containerName="extract-utilities" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: E1204 12:10:09.517015 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b44cd0a1c87587350014492d2bc077ab" containerName="cluster-policy-controller" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: I1204 12:10:09.517024 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="b44cd0a1c87587350014492d2bc077ab" containerName="cluster-policy-controller" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: E1204 12:10:09.517035 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e1ea6568-d279-495a-934e-f30deabcd2c9" containerName="registry-server" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: I1204 12:10:09.517043 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1ea6568-d279-495a-934e-f30deabcd2c9" containerName="registry-server" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: E1204 12:10:09.517058 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bbe68aaa-bd9b-43b9-b465-fb0c09484c64" containerName="extract-utilities" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: I1204 12:10:09.517066 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbe68aaa-bd9b-43b9-b465-fb0c09484c64" containerName="extract-utilities" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: E1204 12:10:09.517077 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="11c18264-a296-44af-b112-21ad216ce917" containerName="registry-server" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: I1204 12:10:09.517085 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="11c18264-a296-44af-b112-21ad216ce917" containerName="registry-server" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: E1204 12:10:09.517098 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b44cd0a1c87587350014492d2bc077ab" containerName="kube-controller-manager-cert-syncer" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: I1204 12:10:09.517115 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="b44cd0a1c87587350014492d2bc077ab" containerName="kube-controller-manager-cert-syncer" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: E1204 12:10:09.517127 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="31422ce2-eae5-47fb-9c8b-7a77caa95696" containerName="extract-content" Dec 04 12:10:09.517072 master-0 kubenswrapper[35367]: I1204 12:10:09.517135 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="31422ce2-eae5-47fb-9c8b-7a77caa95696" containerName="extract-content" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: E1204 12:10:09.517150 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="16b1a088-3ac8-45f8-9f7e-504caab0307b" containerName="extract-content" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517158 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="16b1a088-3ac8-45f8-9f7e-504caab0307b" containerName="extract-content" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: E1204 12:10:09.517176 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bbe68aaa-bd9b-43b9-b465-fb0c09484c64" containerName="extract-content" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517183 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbe68aaa-bd9b-43b9-b465-fb0c09484c64" containerName="extract-content" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: E1204 12:10:09.517196 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="16b1a088-3ac8-45f8-9f7e-504caab0307b" containerName="extract-utilities" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517203 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="16b1a088-3ac8-45f8-9f7e-504caab0307b" containerName="extract-utilities" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: E1204 12:10:09.517216 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b44cd0a1c87587350014492d2bc077ab" containerName="kube-controller-manager-recovery-controller" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517223 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="b44cd0a1c87587350014492d2bc077ab" containerName="kube-controller-manager-recovery-controller" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: E1204 12:10:09.517235 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bbe68aaa-bd9b-43b9-b465-fb0c09484c64" containerName="registry-server" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517243 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbe68aaa-bd9b-43b9-b465-fb0c09484c64" containerName="registry-server" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: E1204 12:10:09.517257 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e1ea6568-d279-495a-934e-f30deabcd2c9" containerName="extract-utilities" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517265 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1ea6568-d279-495a-934e-f30deabcd2c9" containerName="extract-utilities" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: E1204 12:10:09.517278 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5c66df21-a05d-4cb4-91ca-59d039629f95" containerName="console" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517286 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c66df21-a05d-4cb4-91ca-59d039629f95" containerName="console" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: E1204 12:10:09.517298 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="16b1a088-3ac8-45f8-9f7e-504caab0307b" containerName="registry-server" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517305 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="16b1a088-3ac8-45f8-9f7e-504caab0307b" containerName="registry-server" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517468 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="46967266-5366-4e53-9c4d-9575e02846cb" containerName="registry-server" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517503 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="b44cd0a1c87587350014492d2bc077ab" containerName="kube-controller-manager-recovery-controller" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517521 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="b44cd0a1c87587350014492d2bc077ab" containerName="kube-controller-manager-cert-syncer" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517537 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="b44cd0a1c87587350014492d2bc077ab" containerName="kube-controller-manager" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517550 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="b44cd0a1c87587350014492d2bc077ab" containerName="cluster-policy-controller" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517565 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="5c66df21-a05d-4cb4-91ca-59d039629f95" containerName="console" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517572 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="e1ea6568-d279-495a-934e-f30deabcd2c9" containerName="registry-server" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517588 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="31422ce2-eae5-47fb-9c8b-7a77caa95696" containerName="registry-server" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517605 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="bbe68aaa-bd9b-43b9-b465-fb0c09484c64" containerName="registry-server" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517625 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="11c18264-a296-44af-b112-21ad216ce917" containerName="registry-server" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517634 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="1cdce2be-c255-424e-8da3-7665cc617e32" containerName="registry-server" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517648 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="281cfff8-9bcf-4722-a10a-7872455a391f" containerName="registry-server" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517655 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="b44cd0a1c87587350014492d2bc077ab" containerName="kube-controller-manager" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517669 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="16b1a088-3ac8-45f8-9f7e-504caab0307b" containerName="registry-server" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: E1204 12:10:09.517880 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b44cd0a1c87587350014492d2bc077ab" containerName="kube-controller-manager" Dec 04 12:10:09.518714 master-0 kubenswrapper[35367]: I1204 12:10:09.517892 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="b44cd0a1c87587350014492d2bc077ab" containerName="kube-controller-manager" Dec 04 12:10:09.635545 master-0 kubenswrapper[35367]: I1204 12:10:09.635484 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/23543132d1dd3e8d58963695f9226cf1-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"23543132d1dd3e8d58963695f9226cf1\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:10:09.635977 master-0 kubenswrapper[35367]: I1204 12:10:09.635922 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/23543132d1dd3e8d58963695f9226cf1-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"23543132d1dd3e8d58963695f9226cf1\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:10:09.737550 master-0 kubenswrapper[35367]: I1204 12:10:09.737478 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/23543132d1dd3e8d58963695f9226cf1-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"23543132d1dd3e8d58963695f9226cf1\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:10:09.737728 master-0 kubenswrapper[35367]: I1204 12:10:09.737628 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/23543132d1dd3e8d58963695f9226cf1-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"23543132d1dd3e8d58963695f9226cf1\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:10:09.737779 master-0 kubenswrapper[35367]: I1204 12:10:09.737730 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/23543132d1dd3e8d58963695f9226cf1-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"23543132d1dd3e8d58963695f9226cf1\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:10:09.738177 master-0 kubenswrapper[35367]: I1204 12:10:09.737748 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/23543132d1dd3e8d58963695f9226cf1-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"23543132d1dd3e8d58963695f9226cf1\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:10:09.782283 master-0 kubenswrapper[35367]: I1204 12:10:09.782171 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_b44cd0a1c87587350014492d2bc077ab/kube-controller-manager-cert-syncer/0.log" Dec 04 12:10:09.782962 master-0 kubenswrapper[35367]: I1204 12:10:09.782933 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_b44cd0a1c87587350014492d2bc077ab/kube-controller-manager/0.log" Dec 04 12:10:09.783043 master-0 kubenswrapper[35367]: I1204 12:10:09.783020 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:10:09.787205 master-0 kubenswrapper[35367]: I1204 12:10:09.787151 35367 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" oldPodUID="b44cd0a1c87587350014492d2bc077ab" podUID="23543132d1dd3e8d58963695f9226cf1" Dec 04 12:10:09.839939 master-0 kubenswrapper[35367]: I1204 12:10:09.839829 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/b44cd0a1c87587350014492d2bc077ab-resource-dir\") pod \"b44cd0a1c87587350014492d2bc077ab\" (UID: \"b44cd0a1c87587350014492d2bc077ab\") " Dec 04 12:10:09.840178 master-0 kubenswrapper[35367]: I1204 12:10:09.840008 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b44cd0a1c87587350014492d2bc077ab-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "b44cd0a1c87587350014492d2bc077ab" (UID: "b44cd0a1c87587350014492d2bc077ab"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:10:09.840178 master-0 kubenswrapper[35367]: I1204 12:10:09.840047 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/b44cd0a1c87587350014492d2bc077ab-cert-dir\") pod \"b44cd0a1c87587350014492d2bc077ab\" (UID: \"b44cd0a1c87587350014492d2bc077ab\") " Dec 04 12:10:09.840882 master-0 kubenswrapper[35367]: I1204 12:10:09.840137 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b44cd0a1c87587350014492d2bc077ab-cert-dir" (OuterVolumeSpecName: "cert-dir") pod "b44cd0a1c87587350014492d2bc077ab" (UID: "b44cd0a1c87587350014492d2bc077ab"). InnerVolumeSpecName "cert-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:10:09.853103 master-0 kubenswrapper[35367]: I1204 12:10:09.853030 35367 reconciler_common.go:293] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/b44cd0a1c87587350014492d2bc077ab-resource-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:10:09.853103 master-0 kubenswrapper[35367]: I1204 12:10:09.853102 35367 reconciler_common.go:293] "Volume detached for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/b44cd0a1c87587350014492d2bc077ab-cert-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:10:09.924030 master-0 kubenswrapper[35367]: I1204 12:10:09.923965 35367 generic.go:334] "Generic (PLEG): container finished" podID="308193cd-1b05-418c-87db-6b7cb0a8b92e" containerID="5759d3295bcf424cfaa1522caeb55a1a95a54d20e02a6b6c4d1dda0212281d8b" exitCode=0 Dec 04 12:10:09.924292 master-0 kubenswrapper[35367]: I1204 12:10:09.924086 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-5-master-0" event={"ID":"308193cd-1b05-418c-87db-6b7cb0a8b92e","Type":"ContainerDied","Data":"5759d3295bcf424cfaa1522caeb55a1a95a54d20e02a6b6c4d1dda0212281d8b"} Dec 04 12:10:09.927681 master-0 kubenswrapper[35367]: I1204 12:10:09.927551 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_b44cd0a1c87587350014492d2bc077ab/kube-controller-manager-cert-syncer/0.log" Dec 04 12:10:09.929016 master-0 kubenswrapper[35367]: I1204 12:10:09.928977 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_b44cd0a1c87587350014492d2bc077ab/kube-controller-manager/0.log" Dec 04 12:10:09.929132 master-0 kubenswrapper[35367]: I1204 12:10:09.929041 35367 generic.go:334] "Generic (PLEG): container finished" podID="b44cd0a1c87587350014492d2bc077ab" containerID="e87ca3f10b069a54e1783b77fabd7eac4480fb70fe7b5031d4fc5e5b5de80aae" exitCode=0 Dec 04 12:10:09.929132 master-0 kubenswrapper[35367]: I1204 12:10:09.929066 35367 generic.go:334] "Generic (PLEG): container finished" podID="b44cd0a1c87587350014492d2bc077ab" containerID="ae936500a2ecbcb16991b68e1fb2a6d81ea108368e7c98a8d24a4e0249d4b678" exitCode=0 Dec 04 12:10:09.929132 master-0 kubenswrapper[35367]: I1204 12:10:09.929075 35367 generic.go:334] "Generic (PLEG): container finished" podID="b44cd0a1c87587350014492d2bc077ab" containerID="87cce827effecd0ad9bf56376fa0e0297a57ac12320d9c37847065d59e9f1dcb" exitCode=2 Dec 04 12:10:09.929132 master-0 kubenswrapper[35367]: I1204 12:10:09.929082 35367 generic.go:334] "Generic (PLEG): container finished" podID="b44cd0a1c87587350014492d2bc077ab" containerID="7f675575cba3c965d1f9b34083dc70d57869771c4340830fd96ff7e46be44567" exitCode=0 Dec 04 12:10:09.929132 master-0 kubenswrapper[35367]: I1204 12:10:09.929124 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9c547db8f3d1775c2293200cf9fba0697a05da3135db2e09fd4d6b2f71a4b96" Dec 04 12:10:09.929360 master-0 kubenswrapper[35367]: I1204 12:10:09.929138 35367 scope.go:117] "RemoveContainer" containerID="49ef9434da945c3e39895526d46f11bec0f9c0ac87b5d0b5182c9471dfcd33bb" Dec 04 12:10:09.929360 master-0 kubenswrapper[35367]: I1204 12:10:09.929175 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:10:10.061209 master-0 kubenswrapper[35367]: I1204 12:10:10.060785 35367 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" oldPodUID="b44cd0a1c87587350014492d2bc077ab" podUID="23543132d1dd3e8d58963695f9226cf1" Dec 04 12:10:10.760353 master-0 kubenswrapper[35367]: I1204 12:10:10.760298 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b44cd0a1c87587350014492d2bc077ab" path="/var/lib/kubelet/pods/b44cd0a1c87587350014492d2bc077ab/volumes" Dec 04 12:10:10.939076 master-0 kubenswrapper[35367]: I1204 12:10:10.938956 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-master-0_b44cd0a1c87587350014492d2bc077ab/kube-controller-manager-cert-syncer/0.log" Dec 04 12:10:11.261416 master-0 kubenswrapper[35367]: I1204 12:10:11.260759 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Dec 04 12:10:11.382950 master-0 kubenswrapper[35367]: I1204 12:10:11.382876 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/308193cd-1b05-418c-87db-6b7cb0a8b92e-kube-api-access\") pod \"308193cd-1b05-418c-87db-6b7cb0a8b92e\" (UID: \"308193cd-1b05-418c-87db-6b7cb0a8b92e\") " Dec 04 12:10:11.383181 master-0 kubenswrapper[35367]: I1204 12:10:11.383068 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/308193cd-1b05-418c-87db-6b7cb0a8b92e-kubelet-dir\") pod \"308193cd-1b05-418c-87db-6b7cb0a8b92e\" (UID: \"308193cd-1b05-418c-87db-6b7cb0a8b92e\") " Dec 04 12:10:11.383181 master-0 kubenswrapper[35367]: I1204 12:10:11.383163 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/308193cd-1b05-418c-87db-6b7cb0a8b92e-var-lock\") pod \"308193cd-1b05-418c-87db-6b7cb0a8b92e\" (UID: \"308193cd-1b05-418c-87db-6b7cb0a8b92e\") " Dec 04 12:10:11.383361 master-0 kubenswrapper[35367]: I1204 12:10:11.383313 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/308193cd-1b05-418c-87db-6b7cb0a8b92e-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "308193cd-1b05-418c-87db-6b7cb0a8b92e" (UID: "308193cd-1b05-418c-87db-6b7cb0a8b92e"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:10:11.383467 master-0 kubenswrapper[35367]: I1204 12:10:11.383436 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/308193cd-1b05-418c-87db-6b7cb0a8b92e-var-lock" (OuterVolumeSpecName: "var-lock") pod "308193cd-1b05-418c-87db-6b7cb0a8b92e" (UID: "308193cd-1b05-418c-87db-6b7cb0a8b92e"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:10:11.383991 master-0 kubenswrapper[35367]: I1204 12:10:11.383966 35367 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/308193cd-1b05-418c-87db-6b7cb0a8b92e-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:10:11.383991 master-0 kubenswrapper[35367]: I1204 12:10:11.383988 35367 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/308193cd-1b05-418c-87db-6b7cb0a8b92e-var-lock\") on node \"master-0\" DevicePath \"\"" Dec 04 12:10:11.385823 master-0 kubenswrapper[35367]: I1204 12:10:11.385774 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/308193cd-1b05-418c-87db-6b7cb0a8b92e-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "308193cd-1b05-418c-87db-6b7cb0a8b92e" (UID: "308193cd-1b05-418c-87db-6b7cb0a8b92e"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:10:11.486854 master-0 kubenswrapper[35367]: I1204 12:10:11.486699 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/308193cd-1b05-418c-87db-6b7cb0a8b92e-kube-api-access\") on node \"master-0\" DevicePath \"\"" Dec 04 12:10:11.860407 master-0 kubenswrapper[35367]: I1204 12:10:11.860327 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-console/console-6fbd8c7bd5-6tskd" podUID="3b9d7941-a10b-469c-bbf1-8895bd1d5a65" containerName="console" containerID="cri-o://aaba0473e24336416ab8398217fa5ab49bab5230f59b655b2eb87ae0b8988225" gracePeriod=15 Dec 04 12:10:11.950386 master-0 kubenswrapper[35367]: I1204 12:10:11.950321 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-5-master-0" event={"ID":"308193cd-1b05-418c-87db-6b7cb0a8b92e","Type":"ContainerDied","Data":"1f0a3b8936777924f82cf472216199378ca7497c99ff2dcda7e6e598e4cdaafa"} Dec 04 12:10:11.950386 master-0 kubenswrapper[35367]: I1204 12:10:11.950361 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Dec 04 12:10:11.950386 master-0 kubenswrapper[35367]: I1204 12:10:11.950369 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f0a3b8936777924f82cf472216199378ca7497c99ff2dcda7e6e598e4cdaafa" Dec 04 12:10:12.386226 master-0 kubenswrapper[35367]: I1204 12:10:12.386157 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6fbd8c7bd5-6tskd_3b9d7941-a10b-469c-bbf1-8895bd1d5a65/console/0.log" Dec 04 12:10:12.386490 master-0 kubenswrapper[35367]: I1204 12:10:12.386257 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:10:12.505179 master-0 kubenswrapper[35367]: I1204 12:10:12.505045 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-oauth-serving-cert\") pod \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " Dec 04 12:10:12.505179 master-0 kubenswrapper[35367]: I1204 12:10:12.505148 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-service-ca\") pod \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " Dec 04 12:10:12.505417 master-0 kubenswrapper[35367]: I1204 12:10:12.505229 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-console-oauth-config\") pod \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " Dec 04 12:10:12.505417 master-0 kubenswrapper[35367]: I1204 12:10:12.505302 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvwhc\" (UniqueName: \"kubernetes.io/projected/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-kube-api-access-bvwhc\") pod \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " Dec 04 12:10:12.505417 master-0 kubenswrapper[35367]: I1204 12:10:12.505385 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-console-serving-cert\") pod \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " Dec 04 12:10:12.505417 master-0 kubenswrapper[35367]: I1204 12:10:12.505409 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-trusted-ca-bundle\") pod \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " Dec 04 12:10:12.505609 master-0 kubenswrapper[35367]: I1204 12:10:12.505554 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3b9d7941-a10b-469c-bbf1-8895bd1d5a65" (UID: "3b9d7941-a10b-469c-bbf1-8895bd1d5a65"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:10:12.505749 master-0 kubenswrapper[35367]: I1204 12:10:12.505714 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-service-ca" (OuterVolumeSpecName: "service-ca") pod "3b9d7941-a10b-469c-bbf1-8895bd1d5a65" (UID: "3b9d7941-a10b-469c-bbf1-8895bd1d5a65"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:10:12.506171 master-0 kubenswrapper[35367]: I1204 12:10:12.506108 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-console-config\") pod \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\" (UID: \"3b9d7941-a10b-469c-bbf1-8895bd1d5a65\") " Dec 04 12:10:12.506295 master-0 kubenswrapper[35367]: I1204 12:10:12.506241 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3b9d7941-a10b-469c-bbf1-8895bd1d5a65" (UID: "3b9d7941-a10b-469c-bbf1-8895bd1d5a65"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:10:12.506513 master-0 kubenswrapper[35367]: I1204 12:10:12.506487 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-console-config" (OuterVolumeSpecName: "console-config") pod "3b9d7941-a10b-469c-bbf1-8895bd1d5a65" (UID: "3b9d7941-a10b-469c-bbf1-8895bd1d5a65"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:10:12.506966 master-0 kubenswrapper[35367]: I1204 12:10:12.506943 35367 reconciler_common.go:293] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-console-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:10:12.506966 master-0 kubenswrapper[35367]: I1204 12:10:12.506962 35367 reconciler_common.go:293] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-oauth-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 12:10:12.507053 master-0 kubenswrapper[35367]: I1204 12:10:12.506974 35367 reconciler_common.go:293] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-service-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 12:10:12.507053 master-0 kubenswrapper[35367]: I1204 12:10:12.506983 35367 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:10:12.508436 master-0 kubenswrapper[35367]: I1204 12:10:12.508367 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3b9d7941-a10b-469c-bbf1-8895bd1d5a65" (UID: "3b9d7941-a10b-469c-bbf1-8895bd1d5a65"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:10:12.508974 master-0 kubenswrapper[35367]: I1204 12:10:12.508931 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-kube-api-access-bvwhc" (OuterVolumeSpecName: "kube-api-access-bvwhc") pod "3b9d7941-a10b-469c-bbf1-8895bd1d5a65" (UID: "3b9d7941-a10b-469c-bbf1-8895bd1d5a65"). InnerVolumeSpecName "kube-api-access-bvwhc". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:10:12.509977 master-0 kubenswrapper[35367]: I1204 12:10:12.509940 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3b9d7941-a10b-469c-bbf1-8895bd1d5a65" (UID: "3b9d7941-a10b-469c-bbf1-8895bd1d5a65"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:10:12.608390 master-0 kubenswrapper[35367]: I1204 12:10:12.608312 35367 reconciler_common.go:293] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-console-oauth-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:10:12.608390 master-0 kubenswrapper[35367]: I1204 12:10:12.608360 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bvwhc\" (UniqueName: \"kubernetes.io/projected/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-kube-api-access-bvwhc\") on node \"master-0\" DevicePath \"\"" Dec 04 12:10:12.608390 master-0 kubenswrapper[35367]: I1204 12:10:12.608369 35367 reconciler_common.go:293] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b9d7941-a10b-469c-bbf1-8895bd1d5a65-console-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 12:10:12.968484 master-0 kubenswrapper[35367]: I1204 12:10:12.968431 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6fbd8c7bd5-6tskd_3b9d7941-a10b-469c-bbf1-8895bd1d5a65/console/0.log" Dec 04 12:10:12.969045 master-0 kubenswrapper[35367]: I1204 12:10:12.968497 35367 generic.go:334] "Generic (PLEG): container finished" podID="3b9d7941-a10b-469c-bbf1-8895bd1d5a65" containerID="aaba0473e24336416ab8398217fa5ab49bab5230f59b655b2eb87ae0b8988225" exitCode=2 Dec 04 12:10:12.969045 master-0 kubenswrapper[35367]: I1204 12:10:12.968538 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbd8c7bd5-6tskd" event={"ID":"3b9d7941-a10b-469c-bbf1-8895bd1d5a65","Type":"ContainerDied","Data":"aaba0473e24336416ab8398217fa5ab49bab5230f59b655b2eb87ae0b8988225"} Dec 04 12:10:12.969045 master-0 kubenswrapper[35367]: I1204 12:10:12.968573 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbd8c7bd5-6tskd" event={"ID":"3b9d7941-a10b-469c-bbf1-8895bd1d5a65","Type":"ContainerDied","Data":"ef04064de3a01bec26a7e66b65fd0a2cc02b3c795d73dc9d0253699f711db800"} Dec 04 12:10:12.969045 master-0 kubenswrapper[35367]: I1204 12:10:12.968596 35367 scope.go:117] "RemoveContainer" containerID="aaba0473e24336416ab8398217fa5ab49bab5230f59b655b2eb87ae0b8988225" Dec 04 12:10:12.969045 master-0 kubenswrapper[35367]: I1204 12:10:12.968626 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbd8c7bd5-6tskd" Dec 04 12:10:12.991606 master-0 kubenswrapper[35367]: I1204 12:10:12.991557 35367 scope.go:117] "RemoveContainer" containerID="aaba0473e24336416ab8398217fa5ab49bab5230f59b655b2eb87ae0b8988225" Dec 04 12:10:12.992310 master-0 kubenswrapper[35367]: E1204 12:10:12.992273 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaba0473e24336416ab8398217fa5ab49bab5230f59b655b2eb87ae0b8988225\": container with ID starting with aaba0473e24336416ab8398217fa5ab49bab5230f59b655b2eb87ae0b8988225 not found: ID does not exist" containerID="aaba0473e24336416ab8398217fa5ab49bab5230f59b655b2eb87ae0b8988225" Dec 04 12:10:12.992423 master-0 kubenswrapper[35367]: I1204 12:10:12.992347 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaba0473e24336416ab8398217fa5ab49bab5230f59b655b2eb87ae0b8988225"} err="failed to get container status \"aaba0473e24336416ab8398217fa5ab49bab5230f59b655b2eb87ae0b8988225\": rpc error: code = NotFound desc = could not find container \"aaba0473e24336416ab8398217fa5ab49bab5230f59b655b2eb87ae0b8988225\": container with ID starting with aaba0473e24336416ab8398217fa5ab49bab5230f59b655b2eb87ae0b8988225 not found: ID does not exist" Dec 04 12:10:13.000763 master-0 kubenswrapper[35367]: I1204 12:10:13.000691 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fbd8c7bd5-6tskd"] Dec 04 12:10:13.010849 master-0 kubenswrapper[35367]: I1204 12:10:13.010763 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fbd8c7bd5-6tskd"] Dec 04 12:10:14.756544 master-0 kubenswrapper[35367]: I1204 12:10:14.756447 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b9d7941-a10b-469c-bbf1-8895bd1d5a65" path="/var/lib/kubelet/pods/3b9d7941-a10b-469c-bbf1-8895bd1d5a65/volumes" Dec 04 12:10:17.553213 master-0 kubenswrapper[35367]: I1204 12:10:17.553158 35367 scope.go:117] "RemoveContainer" containerID="554bccaedbf62f7d14d08c9beb5956972b9a7502f898d20afac03c599c432afe" Dec 04 12:10:22.746855 master-0 kubenswrapper[35367]: I1204 12:10:22.746619 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:10:22.763898 master-0 kubenswrapper[35367]: I1204 12:10:22.763825 35367 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="c4167fe0-b24b-46a2-9467-da81e6122107" Dec 04 12:10:22.763898 master-0 kubenswrapper[35367]: I1204 12:10:22.763894 35367 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podUID="c4167fe0-b24b-46a2-9467-da81e6122107" Dec 04 12:10:22.782228 master-0 kubenswrapper[35367]: I1204 12:10:22.782142 35367 kubelet.go:1914] "Deleted mirror pod because it is outdated" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:10:22.782620 master-0 kubenswrapper[35367]: I1204 12:10:22.782363 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 12:10:22.790054 master-0 kubenswrapper[35367]: I1204 12:10:22.789964 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 12:10:22.797385 master-0 kubenswrapper[35367]: I1204 12:10:22.797315 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:10:22.806764 master-0 kubenswrapper[35367]: I1204 12:10:22.806653 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Dec 04 12:10:23.060751 master-0 kubenswrapper[35367]: I1204 12:10:23.060608 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"23543132d1dd3e8d58963695f9226cf1","Type":"ContainerStarted","Data":"21d45d22016a3d1f5d296beca31772f95b841f3914b44fd103b26505e9e019ca"} Dec 04 12:10:23.060751 master-0 kubenswrapper[35367]: I1204 12:10:23.060667 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"23543132d1dd3e8d58963695f9226cf1","Type":"ContainerStarted","Data":"5706fddc8d94b80158ca58637da743e963a92eabd748f42e0762e414d1dd244f"} Dec 04 12:10:24.073667 master-0 kubenswrapper[35367]: I1204 12:10:24.073601 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"23543132d1dd3e8d58963695f9226cf1","Type":"ContainerStarted","Data":"42e75b110a97be5e1bf1eef7d59ee9aec1fa4336d995193d25eb3e03ab965095"} Dec 04 12:10:24.074255 master-0 kubenswrapper[35367]: I1204 12:10:24.073685 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"23543132d1dd3e8d58963695f9226cf1","Type":"ContainerStarted","Data":"59c0ff71d5d0933b6e7a26244a99053d5839fb3bb7f7b9a4ddcf6bbe7deec8af"} Dec 04 12:10:24.074255 master-0 kubenswrapper[35367]: I1204 12:10:24.073702 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"23543132d1dd3e8d58963695f9226cf1","Type":"ContainerStarted","Data":"f7e5cace3e76e866f8c16ef672b376448d62bea3e400ab803e38ab026d77080f"} Dec 04 12:10:32.797696 master-0 kubenswrapper[35367]: I1204 12:10:32.797571 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:10:32.797696 master-0 kubenswrapper[35367]: I1204 12:10:32.797696 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:10:32.797696 master-0 kubenswrapper[35367]: I1204 12:10:32.797709 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:10:32.797696 master-0 kubenswrapper[35367]: I1204 12:10:32.797718 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:10:32.802199 master-0 kubenswrapper[35367]: I1204 12:10:32.802142 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:10:32.802447 master-0 kubenswrapper[35367]: I1204 12:10:32.802391 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:10:32.843168 master-0 kubenswrapper[35367]: I1204 12:10:32.843064 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podStartSLOduration=10.843042892 podStartE2EDuration="10.843042892s" podCreationTimestamp="2025-12-04 12:10:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:10:24.098167074 +0000 UTC m=+667.536228352" watchObservedRunningTime="2025-12-04 12:10:32.843042892 +0000 UTC m=+676.281104150" Dec 04 12:10:33.150853 master-0 kubenswrapper[35367]: I1204 12:10:33.150787 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:10:33.151341 master-0 kubenswrapper[35367]: I1204 12:10:33.151256 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Dec 04 12:10:35.002586 master-0 kubenswrapper[35367]: I1204 12:10:35.002501 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:10:35.036879 master-0 kubenswrapper[35367]: I1204 12:10:35.036799 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:10:35.192660 master-0 kubenswrapper[35367]: I1204 12:10:35.192595 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Dec 04 12:10:51.919141 master-0 kubenswrapper[35367]: I1204 12:10:51.918954 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["sushy-emulator/sushy-emulator-58f4c9b998-s5z49"] Dec 04 12:10:51.920298 master-0 kubenswrapper[35367]: E1204 12:10:51.919590 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="308193cd-1b05-418c-87db-6b7cb0a8b92e" containerName="installer" Dec 04 12:10:51.920298 master-0 kubenswrapper[35367]: I1204 12:10:51.919609 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="308193cd-1b05-418c-87db-6b7cb0a8b92e" containerName="installer" Dec 04 12:10:51.920298 master-0 kubenswrapper[35367]: E1204 12:10:51.919649 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3b9d7941-a10b-469c-bbf1-8895bd1d5a65" containerName="console" Dec 04 12:10:51.920298 master-0 kubenswrapper[35367]: I1204 12:10:51.919658 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b9d7941-a10b-469c-bbf1-8895bd1d5a65" containerName="console" Dec 04 12:10:51.920298 master-0 kubenswrapper[35367]: I1204 12:10:51.919886 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="3b9d7941-a10b-469c-bbf1-8895bd1d5a65" containerName="console" Dec 04 12:10:51.921203 master-0 kubenswrapper[35367]: I1204 12:10:51.921157 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="308193cd-1b05-418c-87db-6b7cb0a8b92e" containerName="installer" Dec 04 12:10:51.921895 master-0 kubenswrapper[35367]: I1204 12:10:51.921834 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" Dec 04 12:10:51.924371 master-0 kubenswrapper[35367]: I1204 12:10:51.924098 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"sushy-emulator"/"sushy-emulator-config" Dec 04 12:10:51.924500 master-0 kubenswrapper[35367]: I1204 12:10:51.924434 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"sushy-emulator"/"openshift-service-ca.crt" Dec 04 12:10:51.931076 master-0 kubenswrapper[35367]: I1204 12:10:51.924845 35367 reflector.go:368] Caches populated for *v1.Secret from object-"sushy-emulator"/"os-client-config" Dec 04 12:10:51.931076 master-0 kubenswrapper[35367]: I1204 12:10:51.925599 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"sushy-emulator"/"kube-root-ca.crt" Dec 04 12:10:51.938658 master-0 kubenswrapper[35367]: I1204 12:10:51.936579 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["sushy-emulator/sushy-emulator-58f4c9b998-s5z49"] Dec 04 12:10:52.022563 master-0 kubenswrapper[35367]: I1204 12:10:52.022260 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg7wh\" (UniqueName: \"kubernetes.io/projected/68867d4a-c865-4af5-aea8-12cdfe1eab01-kube-api-access-bg7wh\") pod \"sushy-emulator-58f4c9b998-s5z49\" (UID: \"68867d4a-c865-4af5-aea8-12cdfe1eab01\") " pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" Dec 04 12:10:52.022892 master-0 kubenswrapper[35367]: I1204 12:10:52.022600 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sushy-emulator-config\" (UniqueName: \"kubernetes.io/configmap/68867d4a-c865-4af5-aea8-12cdfe1eab01-sushy-emulator-config\") pod \"sushy-emulator-58f4c9b998-s5z49\" (UID: \"68867d4a-c865-4af5-aea8-12cdfe1eab01\") " pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" Dec 04 12:10:52.022892 master-0 kubenswrapper[35367]: I1204 12:10:52.022694 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-client-config\" (UniqueName: \"kubernetes.io/secret/68867d4a-c865-4af5-aea8-12cdfe1eab01-os-client-config\") pod \"sushy-emulator-58f4c9b998-s5z49\" (UID: \"68867d4a-c865-4af5-aea8-12cdfe1eab01\") " pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" Dec 04 12:10:52.124510 master-0 kubenswrapper[35367]: I1204 12:10:52.124165 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"os-client-config\" (UniqueName: \"kubernetes.io/secret/68867d4a-c865-4af5-aea8-12cdfe1eab01-os-client-config\") pod \"sushy-emulator-58f4c9b998-s5z49\" (UID: \"68867d4a-c865-4af5-aea8-12cdfe1eab01\") " pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" Dec 04 12:10:52.124510 master-0 kubenswrapper[35367]: I1204 12:10:52.124496 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bg7wh\" (UniqueName: \"kubernetes.io/projected/68867d4a-c865-4af5-aea8-12cdfe1eab01-kube-api-access-bg7wh\") pod \"sushy-emulator-58f4c9b998-s5z49\" (UID: \"68867d4a-c865-4af5-aea8-12cdfe1eab01\") " pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" Dec 04 12:10:52.124510 master-0 kubenswrapper[35367]: I1204 12:10:52.124542 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sushy-emulator-config\" (UniqueName: \"kubernetes.io/configmap/68867d4a-c865-4af5-aea8-12cdfe1eab01-sushy-emulator-config\") pod \"sushy-emulator-58f4c9b998-s5z49\" (UID: \"68867d4a-c865-4af5-aea8-12cdfe1eab01\") " pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" Dec 04 12:10:52.126516 master-0 kubenswrapper[35367]: I1204 12:10:52.126465 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sushy-emulator-config\" (UniqueName: \"kubernetes.io/configmap/68867d4a-c865-4af5-aea8-12cdfe1eab01-sushy-emulator-config\") pod \"sushy-emulator-58f4c9b998-s5z49\" (UID: \"68867d4a-c865-4af5-aea8-12cdfe1eab01\") " pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" Dec 04 12:10:52.131863 master-0 kubenswrapper[35367]: I1204 12:10:52.129929 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"os-client-config\" (UniqueName: \"kubernetes.io/secret/68867d4a-c865-4af5-aea8-12cdfe1eab01-os-client-config\") pod \"sushy-emulator-58f4c9b998-s5z49\" (UID: \"68867d4a-c865-4af5-aea8-12cdfe1eab01\") " pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" Dec 04 12:10:52.142395 master-0 kubenswrapper[35367]: I1204 12:10:52.142260 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg7wh\" (UniqueName: \"kubernetes.io/projected/68867d4a-c865-4af5-aea8-12cdfe1eab01-kube-api-access-bg7wh\") pod \"sushy-emulator-58f4c9b998-s5z49\" (UID: \"68867d4a-c865-4af5-aea8-12cdfe1eab01\") " pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" Dec 04 12:10:52.258329 master-0 kubenswrapper[35367]: I1204 12:10:52.258114 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" Dec 04 12:10:52.665736 master-0 kubenswrapper[35367]: I1204 12:10:52.665666 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["sushy-emulator/sushy-emulator-58f4c9b998-s5z49"] Dec 04 12:10:52.668391 master-0 kubenswrapper[35367]: W1204 12:10:52.668295 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68867d4a_c865_4af5_aea8_12cdfe1eab01.slice/crio-3f6452a33c60e240011bd22b807da47011c045cfafac4479c7377bbc607d5087 WatchSource:0}: Error finding container 3f6452a33c60e240011bd22b807da47011c045cfafac4479c7377bbc607d5087: Status 404 returned error can't find the container with id 3f6452a33c60e240011bd22b807da47011c045cfafac4479c7377bbc607d5087 Dec 04 12:10:52.672030 master-0 kubenswrapper[35367]: I1204 12:10:52.671917 35367 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Dec 04 12:10:53.308496 master-0 kubenswrapper[35367]: I1204 12:10:53.308403 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" event={"ID":"68867d4a-c865-4af5-aea8-12cdfe1eab01","Type":"ContainerStarted","Data":"3f6452a33c60e240011bd22b807da47011c045cfafac4479c7377bbc607d5087"} Dec 04 12:10:59.370447 master-0 kubenswrapper[35367]: I1204 12:10:59.370382 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" event={"ID":"68867d4a-c865-4af5-aea8-12cdfe1eab01","Type":"ContainerStarted","Data":"5957b2ec98e35e11b19fcc5e5fed6560a12db2d0882f0029ba4496d93d35a2e2"} Dec 04 12:11:02.258727 master-0 kubenswrapper[35367]: I1204 12:11:02.258650 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" Dec 04 12:11:02.258727 master-0 kubenswrapper[35367]: I1204 12:11:02.258729 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" Dec 04 12:11:02.268570 master-0 kubenswrapper[35367]: I1204 12:11:02.268501 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" Dec 04 12:11:02.292505 master-0 kubenswrapper[35367]: I1204 12:11:02.292392 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" podStartSLOduration=5.68579288 podStartE2EDuration="11.292368832s" podCreationTimestamp="2025-12-04 12:10:51 +0000 UTC" firstStartedPulling="2025-12-04 12:10:52.670556997 +0000 UTC m=+696.108618265" lastFinishedPulling="2025-12-04 12:10:58.277132959 +0000 UTC m=+701.715194217" observedRunningTime="2025-12-04 12:10:59.393718659 +0000 UTC m=+702.831779917" watchObservedRunningTime="2025-12-04 12:11:02.292368832 +0000 UTC m=+705.730430090" Dec 04 12:11:02.395330 master-0 kubenswrapper[35367]: I1204 12:11:02.395259 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" Dec 04 12:11:33.926558 master-0 kubenswrapper[35367]: I1204 12:11:33.923249 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t"] Dec 04 12:11:33.928535 master-0 kubenswrapper[35367]: I1204 12:11:33.928485 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t" Dec 04 12:11:33.940508 master-0 kubenswrapper[35367]: I1204 12:11:33.940400 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t"] Dec 04 12:11:34.077378 master-0 kubenswrapper[35367]: I1204 12:11:34.077319 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2871ee60-e499-4a2e-a594-6a00affd575b-bundle\") pod \"7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t\" (UID: \"2871ee60-e499-4a2e-a594-6a00affd575b\") " pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t" Dec 04 12:11:34.077622 master-0 kubenswrapper[35367]: I1204 12:11:34.077405 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l695g\" (UniqueName: \"kubernetes.io/projected/2871ee60-e499-4a2e-a594-6a00affd575b-kube-api-access-l695g\") pod \"7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t\" (UID: \"2871ee60-e499-4a2e-a594-6a00affd575b\") " pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t" Dec 04 12:11:34.077622 master-0 kubenswrapper[35367]: I1204 12:11:34.077493 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2871ee60-e499-4a2e-a594-6a00affd575b-util\") pod \"7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t\" (UID: \"2871ee60-e499-4a2e-a594-6a00affd575b\") " pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t" Dec 04 12:11:34.180132 master-0 kubenswrapper[35367]: I1204 12:11:34.180003 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2871ee60-e499-4a2e-a594-6a00affd575b-util\") pod \"7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t\" (UID: \"2871ee60-e499-4a2e-a594-6a00affd575b\") " pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t" Dec 04 12:11:34.180516 master-0 kubenswrapper[35367]: I1204 12:11:34.180481 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2871ee60-e499-4a2e-a594-6a00affd575b-bundle\") pod \"7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t\" (UID: \"2871ee60-e499-4a2e-a594-6a00affd575b\") " pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t" Dec 04 12:11:34.180666 master-0 kubenswrapper[35367]: I1204 12:11:34.180611 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2871ee60-e499-4a2e-a594-6a00affd575b-util\") pod \"7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t\" (UID: \"2871ee60-e499-4a2e-a594-6a00affd575b\") " pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t" Dec 04 12:11:34.180871 master-0 kubenswrapper[35367]: I1204 12:11:34.180844 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l695g\" (UniqueName: \"kubernetes.io/projected/2871ee60-e499-4a2e-a594-6a00affd575b-kube-api-access-l695g\") pod \"7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t\" (UID: \"2871ee60-e499-4a2e-a594-6a00affd575b\") " pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t" Dec 04 12:11:34.181149 master-0 kubenswrapper[35367]: I1204 12:11:34.181087 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2871ee60-e499-4a2e-a594-6a00affd575b-bundle\") pod \"7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t\" (UID: \"2871ee60-e499-4a2e-a594-6a00affd575b\") " pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t" Dec 04 12:11:34.200677 master-0 kubenswrapper[35367]: I1204 12:11:34.200608 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l695g\" (UniqueName: \"kubernetes.io/projected/2871ee60-e499-4a2e-a594-6a00affd575b-kube-api-access-l695g\") pod \"7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t\" (UID: \"2871ee60-e499-4a2e-a594-6a00affd575b\") " pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t" Dec 04 12:11:34.285334 master-0 kubenswrapper[35367]: I1204 12:11:34.285229 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t" Dec 04 12:11:34.712594 master-0 kubenswrapper[35367]: I1204 12:11:34.712528 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t"] Dec 04 12:11:34.717168 master-0 kubenswrapper[35367]: W1204 12:11:34.717115 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2871ee60_e499_4a2e_a594_6a00affd575b.slice/crio-4be262c5395a7c2831e21c69250348d6a07582ad8de7f7cbeb1624fad604937b WatchSource:0}: Error finding container 4be262c5395a7c2831e21c69250348d6a07582ad8de7f7cbeb1624fad604937b: Status 404 returned error can't find the container with id 4be262c5395a7c2831e21c69250348d6a07582ad8de7f7cbeb1624fad604937b Dec 04 12:11:35.665249 master-0 kubenswrapper[35367]: I1204 12:11:35.665182 35367 generic.go:334] "Generic (PLEG): container finished" podID="2871ee60-e499-4a2e-a594-6a00affd575b" containerID="97434a2e85b00727c3b9d2b048fd19eee02c15ed6aa6f71efd26425d34e6ee0d" exitCode=0 Dec 04 12:11:35.665249 master-0 kubenswrapper[35367]: I1204 12:11:35.665235 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t" event={"ID":"2871ee60-e499-4a2e-a594-6a00affd575b","Type":"ContainerDied","Data":"97434a2e85b00727c3b9d2b048fd19eee02c15ed6aa6f71efd26425d34e6ee0d"} Dec 04 12:11:35.665249 master-0 kubenswrapper[35367]: I1204 12:11:35.665261 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t" event={"ID":"2871ee60-e499-4a2e-a594-6a00affd575b","Type":"ContainerStarted","Data":"4be262c5395a7c2831e21c69250348d6a07582ad8de7f7cbeb1624fad604937b"} Dec 04 12:11:37.706402 master-0 kubenswrapper[35367]: I1204 12:11:37.706304 35367 generic.go:334] "Generic (PLEG): container finished" podID="2871ee60-e499-4a2e-a594-6a00affd575b" containerID="84720f29543b44a270e8b8366d79120191e9ee0c03d6d1c757132f2174fdb53a" exitCode=0 Dec 04 12:11:37.707879 master-0 kubenswrapper[35367]: I1204 12:11:37.706413 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t" event={"ID":"2871ee60-e499-4a2e-a594-6a00affd575b","Type":"ContainerDied","Data":"84720f29543b44a270e8b8366d79120191e9ee0c03d6d1c757132f2174fdb53a"} Dec 04 12:11:38.718758 master-0 kubenswrapper[35367]: I1204 12:11:38.718697 35367 generic.go:334] "Generic (PLEG): container finished" podID="2871ee60-e499-4a2e-a594-6a00affd575b" containerID="40a029fa494eeeac885c7accc0686989ac179afec7d86ba88201afd1b91c78bf" exitCode=0 Dec 04 12:11:38.719517 master-0 kubenswrapper[35367]: I1204 12:11:38.718760 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t" event={"ID":"2871ee60-e499-4a2e-a594-6a00affd575b","Type":"ContainerDied","Data":"40a029fa494eeeac885c7accc0686989ac179afec7d86ba88201afd1b91c78bf"} Dec 04 12:11:40.062735 master-0 kubenswrapper[35367]: I1204 12:11:40.062646 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t" Dec 04 12:11:40.180791 master-0 kubenswrapper[35367]: I1204 12:11:40.180727 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l695g\" (UniqueName: \"kubernetes.io/projected/2871ee60-e499-4a2e-a594-6a00affd575b-kube-api-access-l695g\") pod \"2871ee60-e499-4a2e-a594-6a00affd575b\" (UID: \"2871ee60-e499-4a2e-a594-6a00affd575b\") " Dec 04 12:11:40.181123 master-0 kubenswrapper[35367]: I1204 12:11:40.180843 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2871ee60-e499-4a2e-a594-6a00affd575b-util\") pod \"2871ee60-e499-4a2e-a594-6a00affd575b\" (UID: \"2871ee60-e499-4a2e-a594-6a00affd575b\") " Dec 04 12:11:40.181123 master-0 kubenswrapper[35367]: I1204 12:11:40.180871 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2871ee60-e499-4a2e-a594-6a00affd575b-bundle\") pod \"2871ee60-e499-4a2e-a594-6a00affd575b\" (UID: \"2871ee60-e499-4a2e-a594-6a00affd575b\") " Dec 04 12:11:40.182153 master-0 kubenswrapper[35367]: I1204 12:11:40.182079 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2871ee60-e499-4a2e-a594-6a00affd575b-bundle" (OuterVolumeSpecName: "bundle") pod "2871ee60-e499-4a2e-a594-6a00affd575b" (UID: "2871ee60-e499-4a2e-a594-6a00affd575b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:11:40.183861 master-0 kubenswrapper[35367]: I1204 12:11:40.183827 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2871ee60-e499-4a2e-a594-6a00affd575b-kube-api-access-l695g" (OuterVolumeSpecName: "kube-api-access-l695g") pod "2871ee60-e499-4a2e-a594-6a00affd575b" (UID: "2871ee60-e499-4a2e-a594-6a00affd575b"). InnerVolumeSpecName "kube-api-access-l695g". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:11:40.193035 master-0 kubenswrapper[35367]: I1204 12:11:40.192956 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2871ee60-e499-4a2e-a594-6a00affd575b-util" (OuterVolumeSpecName: "util") pod "2871ee60-e499-4a2e-a594-6a00affd575b" (UID: "2871ee60-e499-4a2e-a594-6a00affd575b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:11:40.283319 master-0 kubenswrapper[35367]: I1204 12:11:40.283158 35367 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2871ee60-e499-4a2e-a594-6a00affd575b-util\") on node \"master-0\" DevicePath \"\"" Dec 04 12:11:40.283319 master-0 kubenswrapper[35367]: I1204 12:11:40.283214 35367 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2871ee60-e499-4a2e-a594-6a00affd575b-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:11:40.283319 master-0 kubenswrapper[35367]: I1204 12:11:40.283233 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-l695g\" (UniqueName: \"kubernetes.io/projected/2871ee60-e499-4a2e-a594-6a00affd575b-kube-api-access-l695g\") on node \"master-0\" DevicePath \"\"" Dec 04 12:11:40.737135 master-0 kubenswrapper[35367]: I1204 12:11:40.737075 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t" event={"ID":"2871ee60-e499-4a2e-a594-6a00affd575b","Type":"ContainerDied","Data":"4be262c5395a7c2831e21c69250348d6a07582ad8de7f7cbeb1624fad604937b"} Dec 04 12:11:40.737135 master-0 kubenswrapper[35367]: I1204 12:11:40.737137 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4be262c5395a7c2831e21c69250348d6a07582ad8de7f7cbeb1624fad604937b" Dec 04 12:11:40.737438 master-0 kubenswrapper[35367]: I1204 12:11:40.737161 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/7f6062bfcf66f08711c4d599873349559e66916847a22b4b74a32f97d42bd6t" Dec 04 12:11:47.308151 master-0 kubenswrapper[35367]: I1204 12:11:47.307983 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-storage/lvms-operator-67f88ff75f-5j2p2"] Dec 04 12:11:47.308922 master-0 kubenswrapper[35367]: E1204 12:11:47.308691 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2871ee60-e499-4a2e-a594-6a00affd575b" containerName="extract" Dec 04 12:11:47.308922 master-0 kubenswrapper[35367]: I1204 12:11:47.308714 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="2871ee60-e499-4a2e-a594-6a00affd575b" containerName="extract" Dec 04 12:11:47.308922 master-0 kubenswrapper[35367]: E1204 12:11:47.308763 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2871ee60-e499-4a2e-a594-6a00affd575b" containerName="util" Dec 04 12:11:47.308922 master-0 kubenswrapper[35367]: I1204 12:11:47.308770 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="2871ee60-e499-4a2e-a594-6a00affd575b" containerName="util" Dec 04 12:11:47.308922 master-0 kubenswrapper[35367]: E1204 12:11:47.308789 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2871ee60-e499-4a2e-a594-6a00affd575b" containerName="pull" Dec 04 12:11:47.308922 master-0 kubenswrapper[35367]: I1204 12:11:47.308796 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="2871ee60-e499-4a2e-a594-6a00affd575b" containerName="pull" Dec 04 12:11:47.310453 master-0 kubenswrapper[35367]: I1204 12:11:47.310407 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="2871ee60-e499-4a2e-a594-6a00affd575b" containerName="extract" Dec 04 12:11:47.312132 master-0 kubenswrapper[35367]: I1204 12:11:47.312052 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" Dec 04 12:11:47.315156 master-0 kubenswrapper[35367]: I1204 12:11:47.315106 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-storage"/"lvms-operator-metrics-cert" Dec 04 12:11:47.315284 master-0 kubenswrapper[35367]: I1204 12:11:47.315149 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-storage"/"lvms-operator-service-cert" Dec 04 12:11:47.315357 master-0 kubenswrapper[35367]: I1204 12:11:47.315329 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-storage"/"openshift-service-ca.crt" Dec 04 12:11:47.315476 master-0 kubenswrapper[35367]: I1204 12:11:47.315434 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-storage"/"lvms-operator-webhook-server-cert" Dec 04 12:11:47.317974 master-0 kubenswrapper[35367]: I1204 12:11:47.316598 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-storage"/"kube-root-ca.crt" Dec 04 12:11:47.325085 master-0 kubenswrapper[35367]: I1204 12:11:47.325037 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2840bfad-982e-4e9a-a207-974c37e26429-webhook-cert\") pod \"lvms-operator-67f88ff75f-5j2p2\" (UID: \"2840bfad-982e-4e9a-a207-974c37e26429\") " pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" Dec 04 12:11:47.325166 master-0 kubenswrapper[35367]: I1204 12:11:47.325111 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2840bfad-982e-4e9a-a207-974c37e26429-apiservice-cert\") pod \"lvms-operator-67f88ff75f-5j2p2\" (UID: \"2840bfad-982e-4e9a-a207-974c37e26429\") " pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" Dec 04 12:11:47.325236 master-0 kubenswrapper[35367]: I1204 12:11:47.325209 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/empty-dir/2840bfad-982e-4e9a-a207-974c37e26429-socket-dir\") pod \"lvms-operator-67f88ff75f-5j2p2\" (UID: \"2840bfad-982e-4e9a-a207-974c37e26429\") " pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" Dec 04 12:11:47.325352 master-0 kubenswrapper[35367]: I1204 12:11:47.325318 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22zv9\" (UniqueName: \"kubernetes.io/projected/2840bfad-982e-4e9a-a207-974c37e26429-kube-api-access-22zv9\") pod \"lvms-operator-67f88ff75f-5j2p2\" (UID: \"2840bfad-982e-4e9a-a207-974c37e26429\") " pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" Dec 04 12:11:47.325420 master-0 kubenswrapper[35367]: I1204 12:11:47.325403 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2840bfad-982e-4e9a-a207-974c37e26429-metrics-cert\") pod \"lvms-operator-67f88ff75f-5j2p2\" (UID: \"2840bfad-982e-4e9a-a207-974c37e26429\") " pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" Dec 04 12:11:47.380144 master-0 kubenswrapper[35367]: I1204 12:11:47.379051 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-storage/lvms-operator-67f88ff75f-5j2p2"] Dec 04 12:11:47.432400 master-0 kubenswrapper[35367]: I1204 12:11:47.432323 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-22zv9\" (UniqueName: \"kubernetes.io/projected/2840bfad-982e-4e9a-a207-974c37e26429-kube-api-access-22zv9\") pod \"lvms-operator-67f88ff75f-5j2p2\" (UID: \"2840bfad-982e-4e9a-a207-974c37e26429\") " pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" Dec 04 12:11:47.432642 master-0 kubenswrapper[35367]: I1204 12:11:47.432439 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2840bfad-982e-4e9a-a207-974c37e26429-metrics-cert\") pod \"lvms-operator-67f88ff75f-5j2p2\" (UID: \"2840bfad-982e-4e9a-a207-974c37e26429\") " pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" Dec 04 12:11:47.432642 master-0 kubenswrapper[35367]: I1204 12:11:47.432554 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2840bfad-982e-4e9a-a207-974c37e26429-webhook-cert\") pod \"lvms-operator-67f88ff75f-5j2p2\" (UID: \"2840bfad-982e-4e9a-a207-974c37e26429\") " pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" Dec 04 12:11:47.432642 master-0 kubenswrapper[35367]: I1204 12:11:47.432577 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2840bfad-982e-4e9a-a207-974c37e26429-apiservice-cert\") pod \"lvms-operator-67f88ff75f-5j2p2\" (UID: \"2840bfad-982e-4e9a-a207-974c37e26429\") " pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" Dec 04 12:11:47.432642 master-0 kubenswrapper[35367]: I1204 12:11:47.432613 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/empty-dir/2840bfad-982e-4e9a-a207-974c37e26429-socket-dir\") pod \"lvms-operator-67f88ff75f-5j2p2\" (UID: \"2840bfad-982e-4e9a-a207-974c37e26429\") " pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" Dec 04 12:11:47.433703 master-0 kubenswrapper[35367]: I1204 12:11:47.433680 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/empty-dir/2840bfad-982e-4e9a-a207-974c37e26429-socket-dir\") pod \"lvms-operator-67f88ff75f-5j2p2\" (UID: \"2840bfad-982e-4e9a-a207-974c37e26429\") " pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" Dec 04 12:11:47.438378 master-0 kubenswrapper[35367]: I1204 12:11:47.438318 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2840bfad-982e-4e9a-a207-974c37e26429-apiservice-cert\") pod \"lvms-operator-67f88ff75f-5j2p2\" (UID: \"2840bfad-982e-4e9a-a207-974c37e26429\") " pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" Dec 04 12:11:47.438562 master-0 kubenswrapper[35367]: I1204 12:11:47.438497 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2840bfad-982e-4e9a-a207-974c37e26429-metrics-cert\") pod \"lvms-operator-67f88ff75f-5j2p2\" (UID: \"2840bfad-982e-4e9a-a207-974c37e26429\") " pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" Dec 04 12:11:47.439645 master-0 kubenswrapper[35367]: I1204 12:11:47.439616 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2840bfad-982e-4e9a-a207-974c37e26429-webhook-cert\") pod \"lvms-operator-67f88ff75f-5j2p2\" (UID: \"2840bfad-982e-4e9a-a207-974c37e26429\") " pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" Dec 04 12:11:47.463319 master-0 kubenswrapper[35367]: I1204 12:11:47.463262 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-22zv9\" (UniqueName: \"kubernetes.io/projected/2840bfad-982e-4e9a-a207-974c37e26429-kube-api-access-22zv9\") pod \"lvms-operator-67f88ff75f-5j2p2\" (UID: \"2840bfad-982e-4e9a-a207-974c37e26429\") " pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" Dec 04 12:11:47.629549 master-0 kubenswrapper[35367]: I1204 12:11:47.629367 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" Dec 04 12:11:48.068420 master-0 kubenswrapper[35367]: W1204 12:11:48.068358 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2840bfad_982e_4e9a_a207_974c37e26429.slice/crio-8ec82d516b4b80c73be03182152875596c80ced21a89d6c0e70f822155138ce2 WatchSource:0}: Error finding container 8ec82d516b4b80c73be03182152875596c80ced21a89d6c0e70f822155138ce2: Status 404 returned error can't find the container with id 8ec82d516b4b80c73be03182152875596c80ced21a89d6c0e70f822155138ce2 Dec 04 12:11:48.071935 master-0 kubenswrapper[35367]: I1204 12:11:48.071890 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-storage/lvms-operator-67f88ff75f-5j2p2"] Dec 04 12:11:48.809766 master-0 kubenswrapper[35367]: I1204 12:11:48.809701 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" event={"ID":"2840bfad-982e-4e9a-a207-974c37e26429","Type":"ContainerStarted","Data":"8ec82d516b4b80c73be03182152875596c80ced21a89d6c0e70f822155138ce2"} Dec 04 12:11:52.857051 master-0 kubenswrapper[35367]: I1204 12:11:52.856601 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" event={"ID":"2840bfad-982e-4e9a-a207-974c37e26429","Type":"ContainerStarted","Data":"81281c34bac966c80fb225e57ec770f132a11397500694715706d5ec488ebf39"} Dec 04 12:11:52.857051 master-0 kubenswrapper[35367]: I1204 12:11:52.857024 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" Dec 04 12:11:52.884319 master-0 kubenswrapper[35367]: I1204 12:11:52.884231 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" podStartSLOduration=1.355160584 podStartE2EDuration="5.884208578s" podCreationTimestamp="2025-12-04 12:11:47 +0000 UTC" firstStartedPulling="2025-12-04 12:11:48.071633408 +0000 UTC m=+751.509694666" lastFinishedPulling="2025-12-04 12:11:52.600681402 +0000 UTC m=+756.038742660" observedRunningTime="2025-12-04 12:11:52.88397916 +0000 UTC m=+756.322040438" watchObservedRunningTime="2025-12-04 12:11:52.884208578 +0000 UTC m=+756.322269826" Dec 04 12:11:53.871786 master-0 kubenswrapper[35367]: I1204 12:11:53.871681 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-storage/lvms-operator-67f88ff75f-5j2p2" Dec 04 12:11:58.175389 master-0 kubenswrapper[35367]: I1204 12:11:58.175102 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7"] Dec 04 12:11:58.182514 master-0 kubenswrapper[35367]: I1204 12:11:58.182443 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7" Dec 04 12:11:58.187183 master-0 kubenswrapper[35367]: I1204 12:11:58.187119 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7"] Dec 04 12:11:58.269521 master-0 kubenswrapper[35367]: I1204 12:11:58.269431 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/228ed969-25db-41fb-9c7c-18bf3c34010e-bundle\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7\" (UID: \"228ed969-25db-41fb-9c7c-18bf3c34010e\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7" Dec 04 12:11:58.269911 master-0 kubenswrapper[35367]: I1204 12:11:58.269567 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/228ed969-25db-41fb-9c7c-18bf3c34010e-util\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7\" (UID: \"228ed969-25db-41fb-9c7c-18bf3c34010e\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7" Dec 04 12:11:58.269911 master-0 kubenswrapper[35367]: I1204 12:11:58.269613 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l52c7\" (UniqueName: \"kubernetes.io/projected/228ed969-25db-41fb-9c7c-18bf3c34010e-kube-api-access-l52c7\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7\" (UID: \"228ed969-25db-41fb-9c7c-18bf3c34010e\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7" Dec 04 12:11:58.371017 master-0 kubenswrapper[35367]: I1204 12:11:58.370877 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l52c7\" (UniqueName: \"kubernetes.io/projected/228ed969-25db-41fb-9c7c-18bf3c34010e-kube-api-access-l52c7\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7\" (UID: \"228ed969-25db-41fb-9c7c-18bf3c34010e\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7" Dec 04 12:11:58.371328 master-0 kubenswrapper[35367]: I1204 12:11:58.371041 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/228ed969-25db-41fb-9c7c-18bf3c34010e-bundle\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7\" (UID: \"228ed969-25db-41fb-9c7c-18bf3c34010e\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7" Dec 04 12:11:58.371328 master-0 kubenswrapper[35367]: I1204 12:11:58.371131 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/228ed969-25db-41fb-9c7c-18bf3c34010e-util\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7\" (UID: \"228ed969-25db-41fb-9c7c-18bf3c34010e\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7" Dec 04 12:11:58.372980 master-0 kubenswrapper[35367]: I1204 12:11:58.371880 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/228ed969-25db-41fb-9c7c-18bf3c34010e-bundle\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7\" (UID: \"228ed969-25db-41fb-9c7c-18bf3c34010e\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7" Dec 04 12:11:58.372980 master-0 kubenswrapper[35367]: I1204 12:11:58.372224 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/228ed969-25db-41fb-9c7c-18bf3c34010e-util\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7\" (UID: \"228ed969-25db-41fb-9c7c-18bf3c34010e\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7" Dec 04 12:11:58.391937 master-0 kubenswrapper[35367]: I1204 12:11:58.391800 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l52c7\" (UniqueName: \"kubernetes.io/projected/228ed969-25db-41fb-9c7c-18bf3c34010e-kube-api-access-l52c7\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7\" (UID: \"228ed969-25db-41fb-9c7c-18bf3c34010e\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7" Dec 04 12:11:58.512870 master-0 kubenswrapper[35367]: I1204 12:11:58.512650 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7" Dec 04 12:11:58.992860 master-0 kubenswrapper[35367]: I1204 12:11:58.992221 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7"] Dec 04 12:11:58.993426 master-0 kubenswrapper[35367]: W1204 12:11:58.993354 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod228ed969_25db_41fb_9c7c_18bf3c34010e.slice/crio-52063dde47190b40e7a0767c7940ba0bb2d78b098310d8316d02c5e6a0a5362e WatchSource:0}: Error finding container 52063dde47190b40e7a0767c7940ba0bb2d78b098310d8316d02c5e6a0a5362e: Status 404 returned error can't find the container with id 52063dde47190b40e7a0767c7940ba0bb2d78b098310d8316d02c5e6a0a5362e Dec 04 12:11:59.116517 master-0 kubenswrapper[35367]: I1204 12:11:59.116408 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd"] Dec 04 12:11:59.118791 master-0 kubenswrapper[35367]: I1204 12:11:59.118767 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd" Dec 04 12:11:59.143044 master-0 kubenswrapper[35367]: I1204 12:11:59.142978 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd"] Dec 04 12:11:59.193827 master-0 kubenswrapper[35367]: I1204 12:11:59.193734 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-957lv\" (UniqueName: \"kubernetes.io/projected/346d8189-2229-4064-8bfd-d0994ba23f46-kube-api-access-957lv\") pod \"af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd\" (UID: \"346d8189-2229-4064-8bfd-d0994ba23f46\") " pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd" Dec 04 12:11:59.194423 master-0 kubenswrapper[35367]: I1204 12:11:59.193861 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/346d8189-2229-4064-8bfd-d0994ba23f46-util\") pod \"af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd\" (UID: \"346d8189-2229-4064-8bfd-d0994ba23f46\") " pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd" Dec 04 12:11:59.194423 master-0 kubenswrapper[35367]: I1204 12:11:59.193918 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/346d8189-2229-4064-8bfd-d0994ba23f46-bundle\") pod \"af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd\" (UID: \"346d8189-2229-4064-8bfd-d0994ba23f46\") " pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd" Dec 04 12:11:59.296161 master-0 kubenswrapper[35367]: I1204 12:11:59.295985 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/346d8189-2229-4064-8bfd-d0994ba23f46-bundle\") pod \"af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd\" (UID: \"346d8189-2229-4064-8bfd-d0994ba23f46\") " pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd" Dec 04 12:11:59.296161 master-0 kubenswrapper[35367]: I1204 12:11:59.296139 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-957lv\" (UniqueName: \"kubernetes.io/projected/346d8189-2229-4064-8bfd-d0994ba23f46-kube-api-access-957lv\") pod \"af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd\" (UID: \"346d8189-2229-4064-8bfd-d0994ba23f46\") " pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd" Dec 04 12:11:59.296495 master-0 kubenswrapper[35367]: I1204 12:11:59.296187 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/346d8189-2229-4064-8bfd-d0994ba23f46-util\") pod \"af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd\" (UID: \"346d8189-2229-4064-8bfd-d0994ba23f46\") " pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd" Dec 04 12:11:59.296671 master-0 kubenswrapper[35367]: I1204 12:11:59.296640 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/346d8189-2229-4064-8bfd-d0994ba23f46-util\") pod \"af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd\" (UID: \"346d8189-2229-4064-8bfd-d0994ba23f46\") " pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd" Dec 04 12:11:59.296741 master-0 kubenswrapper[35367]: I1204 12:11:59.296670 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/346d8189-2229-4064-8bfd-d0994ba23f46-bundle\") pod \"af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd\" (UID: \"346d8189-2229-4064-8bfd-d0994ba23f46\") " pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd" Dec 04 12:11:59.367459 master-0 kubenswrapper[35367]: I1204 12:11:59.367395 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-957lv\" (UniqueName: \"kubernetes.io/projected/346d8189-2229-4064-8bfd-d0994ba23f46-kube-api-access-957lv\") pod \"af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd\" (UID: \"346d8189-2229-4064-8bfd-d0994ba23f46\") " pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd" Dec 04 12:11:59.444709 master-0 kubenswrapper[35367]: I1204 12:11:59.444633 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd" Dec 04 12:11:59.920583 master-0 kubenswrapper[35367]: I1204 12:11:59.920435 35367 generic.go:334] "Generic (PLEG): container finished" podID="228ed969-25db-41fb-9c7c-18bf3c34010e" containerID="e083339f5dea71b3e228b62c113aa71addd5f27a1c2d8ef6c211d61844c3798a" exitCode=0 Dec 04 12:11:59.920583 master-0 kubenswrapper[35367]: I1204 12:11:59.920502 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7" event={"ID":"228ed969-25db-41fb-9c7c-18bf3c34010e","Type":"ContainerDied","Data":"e083339f5dea71b3e228b62c113aa71addd5f27a1c2d8ef6c211d61844c3798a"} Dec 04 12:11:59.920583 master-0 kubenswrapper[35367]: I1204 12:11:59.920562 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7" event={"ID":"228ed969-25db-41fb-9c7c-18bf3c34010e","Type":"ContainerStarted","Data":"52063dde47190b40e7a0767c7940ba0bb2d78b098310d8316d02c5e6a0a5362e"} Dec 04 12:12:00.061740 master-0 kubenswrapper[35367]: I1204 12:12:00.061460 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd"] Dec 04 12:12:00.070127 master-0 kubenswrapper[35367]: W1204 12:12:00.069797 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod346d8189_2229_4064_8bfd_d0994ba23f46.slice/crio-b51a7286f9e398b53702b47ce26d20adaa22bfc853e578f9b76d29fc031bd958 WatchSource:0}: Error finding container b51a7286f9e398b53702b47ce26d20adaa22bfc853e578f9b76d29fc031bd958: Status 404 returned error can't find the container with id b51a7286f9e398b53702b47ce26d20adaa22bfc853e578f9b76d29fc031bd958 Dec 04 12:12:00.572440 master-0 kubenswrapper[35367]: I1204 12:12:00.572342 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr"] Dec 04 12:12:00.574686 master-0 kubenswrapper[35367]: I1204 12:12:00.574637 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr" Dec 04 12:12:00.590080 master-0 kubenswrapper[35367]: I1204 12:12:00.589972 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr"] Dec 04 12:12:00.727011 master-0 kubenswrapper[35367]: I1204 12:12:00.726932 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzvcx\" (UniqueName: \"kubernetes.io/projected/be33b87d-7dde-4fc9-88a3-d580004cb9c7-kube-api-access-zzvcx\") pod \"5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr\" (UID: \"be33b87d-7dde-4fc9-88a3-d580004cb9c7\") " pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr" Dec 04 12:12:00.727253 master-0 kubenswrapper[35367]: I1204 12:12:00.727132 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be33b87d-7dde-4fc9-88a3-d580004cb9c7-util\") pod \"5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr\" (UID: \"be33b87d-7dde-4fc9-88a3-d580004cb9c7\") " pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr" Dec 04 12:12:00.727253 master-0 kubenswrapper[35367]: I1204 12:12:00.727166 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be33b87d-7dde-4fc9-88a3-d580004cb9c7-bundle\") pod \"5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr\" (UID: \"be33b87d-7dde-4fc9-88a3-d580004cb9c7\") " pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr" Dec 04 12:12:00.828473 master-0 kubenswrapper[35367]: I1204 12:12:00.828320 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be33b87d-7dde-4fc9-88a3-d580004cb9c7-util\") pod \"5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr\" (UID: \"be33b87d-7dde-4fc9-88a3-d580004cb9c7\") " pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr" Dec 04 12:12:00.828473 master-0 kubenswrapper[35367]: I1204 12:12:00.828408 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be33b87d-7dde-4fc9-88a3-d580004cb9c7-bundle\") pod \"5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr\" (UID: \"be33b87d-7dde-4fc9-88a3-d580004cb9c7\") " pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr" Dec 04 12:12:00.828957 master-0 kubenswrapper[35367]: I1204 12:12:00.828905 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zzvcx\" (UniqueName: \"kubernetes.io/projected/be33b87d-7dde-4fc9-88a3-d580004cb9c7-kube-api-access-zzvcx\") pod \"5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr\" (UID: \"be33b87d-7dde-4fc9-88a3-d580004cb9c7\") " pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr" Dec 04 12:12:00.829383 master-0 kubenswrapper[35367]: I1204 12:12:00.829272 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be33b87d-7dde-4fc9-88a3-d580004cb9c7-bundle\") pod \"5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr\" (UID: \"be33b87d-7dde-4fc9-88a3-d580004cb9c7\") " pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr" Dec 04 12:12:00.829917 master-0 kubenswrapper[35367]: I1204 12:12:00.829754 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be33b87d-7dde-4fc9-88a3-d580004cb9c7-util\") pod \"5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr\" (UID: \"be33b87d-7dde-4fc9-88a3-d580004cb9c7\") " pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr" Dec 04 12:12:00.846480 master-0 kubenswrapper[35367]: I1204 12:12:00.846427 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzvcx\" (UniqueName: \"kubernetes.io/projected/be33b87d-7dde-4fc9-88a3-d580004cb9c7-kube-api-access-zzvcx\") pod \"5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr\" (UID: \"be33b87d-7dde-4fc9-88a3-d580004cb9c7\") " pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr" Dec 04 12:12:00.893361 master-0 kubenswrapper[35367]: I1204 12:12:00.893285 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr" Dec 04 12:12:00.939015 master-0 kubenswrapper[35367]: I1204 12:12:00.938940 35367 generic.go:334] "Generic (PLEG): container finished" podID="346d8189-2229-4064-8bfd-d0994ba23f46" containerID="1376c50df2bd431f46d7bd6d88efe0ebd31e137cbbfa3376b02fcea37cabda8a" exitCode=0 Dec 04 12:12:00.939015 master-0 kubenswrapper[35367]: I1204 12:12:00.939003 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd" event={"ID":"346d8189-2229-4064-8bfd-d0994ba23f46","Type":"ContainerDied","Data":"1376c50df2bd431f46d7bd6d88efe0ebd31e137cbbfa3376b02fcea37cabda8a"} Dec 04 12:12:00.939381 master-0 kubenswrapper[35367]: I1204 12:12:00.939054 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd" event={"ID":"346d8189-2229-4064-8bfd-d0994ba23f46","Type":"ContainerStarted","Data":"b51a7286f9e398b53702b47ce26d20adaa22bfc853e578f9b76d29fc031bd958"} Dec 04 12:12:01.367737 master-0 kubenswrapper[35367]: I1204 12:12:01.367617 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr"] Dec 04 12:12:01.370903 master-0 kubenswrapper[35367]: W1204 12:12:01.370778 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe33b87d_7dde_4fc9_88a3_d580004cb9c7.slice/crio-09657ee7370b989501bf6aeaaa68c6597517044e09acd9f75f5481b269053244 WatchSource:0}: Error finding container 09657ee7370b989501bf6aeaaa68c6597517044e09acd9f75f5481b269053244: Status 404 returned error can't find the container with id 09657ee7370b989501bf6aeaaa68c6597517044e09acd9f75f5481b269053244 Dec 04 12:12:01.952070 master-0 kubenswrapper[35367]: I1204 12:12:01.951854 35367 generic.go:334] "Generic (PLEG): container finished" podID="be33b87d-7dde-4fc9-88a3-d580004cb9c7" containerID="2e4d79f166f5999caaef9a7ed92a117a942e5b0641feb82b4145dcb0d90b58bd" exitCode=0 Dec 04 12:12:01.952070 master-0 kubenswrapper[35367]: I1204 12:12:01.951916 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr" event={"ID":"be33b87d-7dde-4fc9-88a3-d580004cb9c7","Type":"ContainerDied","Data":"2e4d79f166f5999caaef9a7ed92a117a942e5b0641feb82b4145dcb0d90b58bd"} Dec 04 12:12:01.952070 master-0 kubenswrapper[35367]: I1204 12:12:01.951943 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr" event={"ID":"be33b87d-7dde-4fc9-88a3-d580004cb9c7","Type":"ContainerStarted","Data":"09657ee7370b989501bf6aeaaa68c6597517044e09acd9f75f5481b269053244"} Dec 04 12:12:04.980561 master-0 kubenswrapper[35367]: I1204 12:12:04.980446 35367 generic.go:334] "Generic (PLEG): container finished" podID="346d8189-2229-4064-8bfd-d0994ba23f46" containerID="26e09cdb7c79e6944180dc2e7508acc5cacca1cae7c21d198b7cdadde423da65" exitCode=0 Dec 04 12:12:04.981355 master-0 kubenswrapper[35367]: I1204 12:12:04.980633 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd" event={"ID":"346d8189-2229-4064-8bfd-d0994ba23f46","Type":"ContainerDied","Data":"26e09cdb7c79e6944180dc2e7508acc5cacca1cae7c21d198b7cdadde423da65"} Dec 04 12:12:04.985998 master-0 kubenswrapper[35367]: I1204 12:12:04.985784 35367 generic.go:334] "Generic (PLEG): container finished" podID="be33b87d-7dde-4fc9-88a3-d580004cb9c7" containerID="71dea9a2ecb4169b5db9c33f82223fbc4d3b5ad53afc6538ead746c7708906c8" exitCode=0 Dec 04 12:12:04.985998 master-0 kubenswrapper[35367]: I1204 12:12:04.985894 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr" event={"ID":"be33b87d-7dde-4fc9-88a3-d580004cb9c7","Type":"ContainerDied","Data":"71dea9a2ecb4169b5db9c33f82223fbc4d3b5ad53afc6538ead746c7708906c8"} Dec 04 12:12:04.988983 master-0 kubenswrapper[35367]: I1204 12:12:04.988856 35367 generic.go:334] "Generic (PLEG): container finished" podID="228ed969-25db-41fb-9c7c-18bf3c34010e" containerID="66cb73e11fa268377180a60bfeb0b1970b5c40e2dbf11f408b73ad9d81d41718" exitCode=0 Dec 04 12:12:04.989142 master-0 kubenswrapper[35367]: I1204 12:12:04.988942 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7" event={"ID":"228ed969-25db-41fb-9c7c-18bf3c34010e","Type":"ContainerDied","Data":"66cb73e11fa268377180a60bfeb0b1970b5c40e2dbf11f408b73ad9d81d41718"} Dec 04 12:12:06.000541 master-0 kubenswrapper[35367]: I1204 12:12:06.000457 35367 generic.go:334] "Generic (PLEG): container finished" podID="228ed969-25db-41fb-9c7c-18bf3c34010e" containerID="2b1529e1a1ec19c3e3dcda04e93ff6d8e430d1f07429d0cb967f8022c23f7dd1" exitCode=0 Dec 04 12:12:06.001507 master-0 kubenswrapper[35367]: I1204 12:12:06.000495 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7" event={"ID":"228ed969-25db-41fb-9c7c-18bf3c34010e","Type":"ContainerDied","Data":"2b1529e1a1ec19c3e3dcda04e93ff6d8e430d1f07429d0cb967f8022c23f7dd1"} Dec 04 12:12:06.003588 master-0 kubenswrapper[35367]: I1204 12:12:06.003557 35367 generic.go:334] "Generic (PLEG): container finished" podID="346d8189-2229-4064-8bfd-d0994ba23f46" containerID="e6a5a0769c981f69f5472f48c852cf46d2b84a4fe47052cc3c967f988a8d2ecc" exitCode=0 Dec 04 12:12:06.003946 master-0 kubenswrapper[35367]: I1204 12:12:06.003602 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd" event={"ID":"346d8189-2229-4064-8bfd-d0994ba23f46","Type":"ContainerDied","Data":"e6a5a0769c981f69f5472f48c852cf46d2b84a4fe47052cc3c967f988a8d2ecc"} Dec 04 12:12:06.005884 master-0 kubenswrapper[35367]: I1204 12:12:06.005859 35367 generic.go:334] "Generic (PLEG): container finished" podID="be33b87d-7dde-4fc9-88a3-d580004cb9c7" containerID="7741ec98c437f65a50eb1c5ab2125a3e2a6c3544f54600b3fdd2c906af431cf3" exitCode=0 Dec 04 12:12:06.005970 master-0 kubenswrapper[35367]: I1204 12:12:06.005892 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr" event={"ID":"be33b87d-7dde-4fc9-88a3-d580004cb9c7","Type":"ContainerDied","Data":"7741ec98c437f65a50eb1c5ab2125a3e2a6c3544f54600b3fdd2c906af431cf3"} Dec 04 12:12:07.424075 master-0 kubenswrapper[35367]: I1204 12:12:07.422132 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd" Dec 04 12:12:07.531984 master-0 kubenswrapper[35367]: I1204 12:12:07.531938 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr" Dec 04 12:12:07.540842 master-0 kubenswrapper[35367]: I1204 12:12:07.540785 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7" Dec 04 12:12:07.563944 master-0 kubenswrapper[35367]: I1204 12:12:07.563876 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/346d8189-2229-4064-8bfd-d0994ba23f46-bundle\") pod \"346d8189-2229-4064-8bfd-d0994ba23f46\" (UID: \"346d8189-2229-4064-8bfd-d0994ba23f46\") " Dec 04 12:12:07.564349 master-0 kubenswrapper[35367]: I1204 12:12:07.564329 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-957lv\" (UniqueName: \"kubernetes.io/projected/346d8189-2229-4064-8bfd-d0994ba23f46-kube-api-access-957lv\") pod \"346d8189-2229-4064-8bfd-d0994ba23f46\" (UID: \"346d8189-2229-4064-8bfd-d0994ba23f46\") " Dec 04 12:12:07.564518 master-0 kubenswrapper[35367]: I1204 12:12:07.564503 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/346d8189-2229-4064-8bfd-d0994ba23f46-util\") pod \"346d8189-2229-4064-8bfd-d0994ba23f46\" (UID: \"346d8189-2229-4064-8bfd-d0994ba23f46\") " Dec 04 12:12:07.565424 master-0 kubenswrapper[35367]: I1204 12:12:07.565379 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/346d8189-2229-4064-8bfd-d0994ba23f46-bundle" (OuterVolumeSpecName: "bundle") pod "346d8189-2229-4064-8bfd-d0994ba23f46" (UID: "346d8189-2229-4064-8bfd-d0994ba23f46"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:12:07.567865 master-0 kubenswrapper[35367]: I1204 12:12:07.567756 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/346d8189-2229-4064-8bfd-d0994ba23f46-kube-api-access-957lv" (OuterVolumeSpecName: "kube-api-access-957lv") pod "346d8189-2229-4064-8bfd-d0994ba23f46" (UID: "346d8189-2229-4064-8bfd-d0994ba23f46"). InnerVolumeSpecName "kube-api-access-957lv". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:12:07.574657 master-0 kubenswrapper[35367]: I1204 12:12:07.574557 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/346d8189-2229-4064-8bfd-d0994ba23f46-util" (OuterVolumeSpecName: "util") pod "346d8189-2229-4064-8bfd-d0994ba23f46" (UID: "346d8189-2229-4064-8bfd-d0994ba23f46"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:12:07.666764 master-0 kubenswrapper[35367]: I1204 12:12:07.666667 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/228ed969-25db-41fb-9c7c-18bf3c34010e-util\") pod \"228ed969-25db-41fb-9c7c-18bf3c34010e\" (UID: \"228ed969-25db-41fb-9c7c-18bf3c34010e\") " Dec 04 12:12:07.667032 master-0 kubenswrapper[35367]: I1204 12:12:07.666870 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be33b87d-7dde-4fc9-88a3-d580004cb9c7-bundle\") pod \"be33b87d-7dde-4fc9-88a3-d580004cb9c7\" (UID: \"be33b87d-7dde-4fc9-88a3-d580004cb9c7\") " Dec 04 12:12:07.667032 master-0 kubenswrapper[35367]: I1204 12:12:07.666949 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be33b87d-7dde-4fc9-88a3-d580004cb9c7-util\") pod \"be33b87d-7dde-4fc9-88a3-d580004cb9c7\" (UID: \"be33b87d-7dde-4fc9-88a3-d580004cb9c7\") " Dec 04 12:12:07.667032 master-0 kubenswrapper[35367]: I1204 12:12:07.666990 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/228ed969-25db-41fb-9c7c-18bf3c34010e-bundle\") pod \"228ed969-25db-41fb-9c7c-18bf3c34010e\" (UID: \"228ed969-25db-41fb-9c7c-18bf3c34010e\") " Dec 04 12:12:07.667189 master-0 kubenswrapper[35367]: I1204 12:12:07.667048 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l52c7\" (UniqueName: \"kubernetes.io/projected/228ed969-25db-41fb-9c7c-18bf3c34010e-kube-api-access-l52c7\") pod \"228ed969-25db-41fb-9c7c-18bf3c34010e\" (UID: \"228ed969-25db-41fb-9c7c-18bf3c34010e\") " Dec 04 12:12:07.667189 master-0 kubenswrapper[35367]: I1204 12:12:07.667106 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzvcx\" (UniqueName: \"kubernetes.io/projected/be33b87d-7dde-4fc9-88a3-d580004cb9c7-kube-api-access-zzvcx\") pod \"be33b87d-7dde-4fc9-88a3-d580004cb9c7\" (UID: \"be33b87d-7dde-4fc9-88a3-d580004cb9c7\") " Dec 04 12:12:07.667627 master-0 kubenswrapper[35367]: I1204 12:12:07.667493 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-957lv\" (UniqueName: \"kubernetes.io/projected/346d8189-2229-4064-8bfd-d0994ba23f46-kube-api-access-957lv\") on node \"master-0\" DevicePath \"\"" Dec 04 12:12:07.667707 master-0 kubenswrapper[35367]: I1204 12:12:07.667643 35367 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/346d8189-2229-4064-8bfd-d0994ba23f46-util\") on node \"master-0\" DevicePath \"\"" Dec 04 12:12:07.667707 master-0 kubenswrapper[35367]: I1204 12:12:07.667664 35367 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/346d8189-2229-4064-8bfd-d0994ba23f46-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:12:07.667707 master-0 kubenswrapper[35367]: I1204 12:12:07.667651 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be33b87d-7dde-4fc9-88a3-d580004cb9c7-bundle" (OuterVolumeSpecName: "bundle") pod "be33b87d-7dde-4fc9-88a3-d580004cb9c7" (UID: "be33b87d-7dde-4fc9-88a3-d580004cb9c7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:12:07.668127 master-0 kubenswrapper[35367]: I1204 12:12:07.668084 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228ed969-25db-41fb-9c7c-18bf3c34010e-bundle" (OuterVolumeSpecName: "bundle") pod "228ed969-25db-41fb-9c7c-18bf3c34010e" (UID: "228ed969-25db-41fb-9c7c-18bf3c34010e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:12:07.670662 master-0 kubenswrapper[35367]: I1204 12:12:07.670583 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be33b87d-7dde-4fc9-88a3-d580004cb9c7-kube-api-access-zzvcx" (OuterVolumeSpecName: "kube-api-access-zzvcx") pod "be33b87d-7dde-4fc9-88a3-d580004cb9c7" (UID: "be33b87d-7dde-4fc9-88a3-d580004cb9c7"). InnerVolumeSpecName "kube-api-access-zzvcx". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:12:07.670748 master-0 kubenswrapper[35367]: I1204 12:12:07.670670 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/228ed969-25db-41fb-9c7c-18bf3c34010e-kube-api-access-l52c7" (OuterVolumeSpecName: "kube-api-access-l52c7") pod "228ed969-25db-41fb-9c7c-18bf3c34010e" (UID: "228ed969-25db-41fb-9c7c-18bf3c34010e"). InnerVolumeSpecName "kube-api-access-l52c7". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:12:07.678620 master-0 kubenswrapper[35367]: I1204 12:12:07.678557 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228ed969-25db-41fb-9c7c-18bf3c34010e-util" (OuterVolumeSpecName: "util") pod "228ed969-25db-41fb-9c7c-18bf3c34010e" (UID: "228ed969-25db-41fb-9c7c-18bf3c34010e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:12:07.679825 master-0 kubenswrapper[35367]: I1204 12:12:07.679706 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be33b87d-7dde-4fc9-88a3-d580004cb9c7-util" (OuterVolumeSpecName: "util") pod "be33b87d-7dde-4fc9-88a3-d580004cb9c7" (UID: "be33b87d-7dde-4fc9-88a3-d580004cb9c7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:12:07.770239 master-0 kubenswrapper[35367]: I1204 12:12:07.770102 35367 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/228ed969-25db-41fb-9c7c-18bf3c34010e-util\") on node \"master-0\" DevicePath \"\"" Dec 04 12:12:07.770239 master-0 kubenswrapper[35367]: I1204 12:12:07.770253 35367 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be33b87d-7dde-4fc9-88a3-d580004cb9c7-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:12:07.770239 master-0 kubenswrapper[35367]: I1204 12:12:07.770265 35367 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be33b87d-7dde-4fc9-88a3-d580004cb9c7-util\") on node \"master-0\" DevicePath \"\"" Dec 04 12:12:07.770718 master-0 kubenswrapper[35367]: I1204 12:12:07.770308 35367 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/228ed969-25db-41fb-9c7c-18bf3c34010e-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:12:07.770718 master-0 kubenswrapper[35367]: I1204 12:12:07.770322 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-l52c7\" (UniqueName: \"kubernetes.io/projected/228ed969-25db-41fb-9c7c-18bf3c34010e-kube-api-access-l52c7\") on node \"master-0\" DevicePath \"\"" Dec 04 12:12:07.770718 master-0 kubenswrapper[35367]: I1204 12:12:07.770340 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zzvcx\" (UniqueName: \"kubernetes.io/projected/be33b87d-7dde-4fc9-88a3-d580004cb9c7-kube-api-access-zzvcx\") on node \"master-0\" DevicePath \"\"" Dec 04 12:12:08.026473 master-0 kubenswrapper[35367]: I1204 12:12:08.026250 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7" event={"ID":"228ed969-25db-41fb-9c7c-18bf3c34010e","Type":"ContainerDied","Data":"52063dde47190b40e7a0767c7940ba0bb2d78b098310d8316d02c5e6a0a5362e"} Dec 04 12:12:08.026473 master-0 kubenswrapper[35367]: I1204 12:12:08.026309 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52063dde47190b40e7a0767c7940ba0bb2d78b098310d8316d02c5e6a0a5362e" Dec 04 12:12:08.026473 master-0 kubenswrapper[35367]: I1204 12:12:08.026373 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931ag6hs7" Dec 04 12:12:08.029964 master-0 kubenswrapper[35367]: I1204 12:12:08.029939 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd" Dec 04 12:12:08.030126 master-0 kubenswrapper[35367]: I1204 12:12:08.029949 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af69698b82fdf008f5ff9e195cf808a654240e16b13dcd924b74994f83265nd" event={"ID":"346d8189-2229-4064-8bfd-d0994ba23f46","Type":"ContainerDied","Data":"b51a7286f9e398b53702b47ce26d20adaa22bfc853e578f9b76d29fc031bd958"} Dec 04 12:12:08.030126 master-0 kubenswrapper[35367]: I1204 12:12:08.029995 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b51a7286f9e398b53702b47ce26d20adaa22bfc853e578f9b76d29fc031bd958" Dec 04 12:12:08.032622 master-0 kubenswrapper[35367]: I1204 12:12:08.032585 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr" event={"ID":"be33b87d-7dde-4fc9-88a3-d580004cb9c7","Type":"ContainerDied","Data":"09657ee7370b989501bf6aeaaa68c6597517044e09acd9f75f5481b269053244"} Dec 04 12:12:08.032763 master-0 kubenswrapper[35367]: I1204 12:12:08.032627 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09657ee7370b989501bf6aeaaa68c6597517044e09acd9f75f5481b269053244" Dec 04 12:12:08.032763 master-0 kubenswrapper[35367]: I1204 12:12:08.032705 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/5064f9f8917b246f69f5d7fc025e7e6c34236c02bca31167615d38212fzc2gr" Dec 04 12:12:12.291218 master-0 kubenswrapper[35367]: I1204 12:12:12.291044 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57"] Dec 04 12:12:12.292102 master-0 kubenswrapper[35367]: E1204 12:12:12.291513 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="228ed969-25db-41fb-9c7c-18bf3c34010e" containerName="extract" Dec 04 12:12:12.292102 master-0 kubenswrapper[35367]: I1204 12:12:12.291531 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="228ed969-25db-41fb-9c7c-18bf3c34010e" containerName="extract" Dec 04 12:12:12.292102 master-0 kubenswrapper[35367]: E1204 12:12:12.291559 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="228ed969-25db-41fb-9c7c-18bf3c34010e" containerName="util" Dec 04 12:12:12.292102 master-0 kubenswrapper[35367]: I1204 12:12:12.291565 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="228ed969-25db-41fb-9c7c-18bf3c34010e" containerName="util" Dec 04 12:12:12.292102 master-0 kubenswrapper[35367]: E1204 12:12:12.291574 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="228ed969-25db-41fb-9c7c-18bf3c34010e" containerName="pull" Dec 04 12:12:12.292102 master-0 kubenswrapper[35367]: I1204 12:12:12.291580 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="228ed969-25db-41fb-9c7c-18bf3c34010e" containerName="pull" Dec 04 12:12:12.292102 master-0 kubenswrapper[35367]: E1204 12:12:12.291591 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="be33b87d-7dde-4fc9-88a3-d580004cb9c7" containerName="pull" Dec 04 12:12:12.292102 master-0 kubenswrapper[35367]: I1204 12:12:12.291597 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="be33b87d-7dde-4fc9-88a3-d580004cb9c7" containerName="pull" Dec 04 12:12:12.292102 master-0 kubenswrapper[35367]: E1204 12:12:12.291612 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="be33b87d-7dde-4fc9-88a3-d580004cb9c7" containerName="extract" Dec 04 12:12:12.292102 master-0 kubenswrapper[35367]: I1204 12:12:12.291618 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="be33b87d-7dde-4fc9-88a3-d580004cb9c7" containerName="extract" Dec 04 12:12:12.292102 master-0 kubenswrapper[35367]: E1204 12:12:12.291633 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="346d8189-2229-4064-8bfd-d0994ba23f46" containerName="pull" Dec 04 12:12:12.292102 master-0 kubenswrapper[35367]: I1204 12:12:12.291640 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="346d8189-2229-4064-8bfd-d0994ba23f46" containerName="pull" Dec 04 12:12:12.292102 master-0 kubenswrapper[35367]: E1204 12:12:12.291653 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="be33b87d-7dde-4fc9-88a3-d580004cb9c7" containerName="util" Dec 04 12:12:12.292102 master-0 kubenswrapper[35367]: I1204 12:12:12.291659 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="be33b87d-7dde-4fc9-88a3-d580004cb9c7" containerName="util" Dec 04 12:12:12.292102 master-0 kubenswrapper[35367]: E1204 12:12:12.291671 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="346d8189-2229-4064-8bfd-d0994ba23f46" containerName="util" Dec 04 12:12:12.292102 master-0 kubenswrapper[35367]: I1204 12:12:12.291676 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="346d8189-2229-4064-8bfd-d0994ba23f46" containerName="util" Dec 04 12:12:12.292102 master-0 kubenswrapper[35367]: E1204 12:12:12.291691 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="346d8189-2229-4064-8bfd-d0994ba23f46" containerName="extract" Dec 04 12:12:12.292102 master-0 kubenswrapper[35367]: I1204 12:12:12.291696 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="346d8189-2229-4064-8bfd-d0994ba23f46" containerName="extract" Dec 04 12:12:12.292102 master-0 kubenswrapper[35367]: I1204 12:12:12.291856 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="346d8189-2229-4064-8bfd-d0994ba23f46" containerName="extract" Dec 04 12:12:12.292102 master-0 kubenswrapper[35367]: I1204 12:12:12.291869 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="be33b87d-7dde-4fc9-88a3-d580004cb9c7" containerName="extract" Dec 04 12:12:12.292102 master-0 kubenswrapper[35367]: I1204 12:12:12.291882 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="228ed969-25db-41fb-9c7c-18bf3c34010e" containerName="extract" Dec 04 12:12:12.293088 master-0 kubenswrapper[35367]: I1204 12:12:12.293045 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57" Dec 04 12:12:12.354947 master-0 kubenswrapper[35367]: I1204 12:12:12.354862 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57"] Dec 04 12:12:12.365853 master-0 kubenswrapper[35367]: I1204 12:12:12.365773 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b374233-5f6b-4003-8332-5aedeb729ca1-util\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57\" (UID: \"9b374233-5f6b-4003-8332-5aedeb729ca1\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57" Dec 04 12:12:12.366360 master-0 kubenswrapper[35367]: I1204 12:12:12.366307 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnl5x\" (UniqueName: \"kubernetes.io/projected/9b374233-5f6b-4003-8332-5aedeb729ca1-kube-api-access-lnl5x\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57\" (UID: \"9b374233-5f6b-4003-8332-5aedeb729ca1\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57" Dec 04 12:12:12.366595 master-0 kubenswrapper[35367]: I1204 12:12:12.366572 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b374233-5f6b-4003-8332-5aedeb729ca1-bundle\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57\" (UID: \"9b374233-5f6b-4003-8332-5aedeb729ca1\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57" Dec 04 12:12:12.470330 master-0 kubenswrapper[35367]: I1204 12:12:12.468520 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b374233-5f6b-4003-8332-5aedeb729ca1-util\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57\" (UID: \"9b374233-5f6b-4003-8332-5aedeb729ca1\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57" Dec 04 12:12:12.470330 master-0 kubenswrapper[35367]: I1204 12:12:12.468676 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lnl5x\" (UniqueName: \"kubernetes.io/projected/9b374233-5f6b-4003-8332-5aedeb729ca1-kube-api-access-lnl5x\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57\" (UID: \"9b374233-5f6b-4003-8332-5aedeb729ca1\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57" Dec 04 12:12:12.470330 master-0 kubenswrapper[35367]: I1204 12:12:12.468900 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b374233-5f6b-4003-8332-5aedeb729ca1-bundle\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57\" (UID: \"9b374233-5f6b-4003-8332-5aedeb729ca1\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57" Dec 04 12:12:12.470330 master-0 kubenswrapper[35367]: I1204 12:12:12.469487 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b374233-5f6b-4003-8332-5aedeb729ca1-bundle\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57\" (UID: \"9b374233-5f6b-4003-8332-5aedeb729ca1\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57" Dec 04 12:12:12.470330 master-0 kubenswrapper[35367]: I1204 12:12:12.469543 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b374233-5f6b-4003-8332-5aedeb729ca1-util\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57\" (UID: \"9b374233-5f6b-4003-8332-5aedeb729ca1\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57" Dec 04 12:12:12.490147 master-0 kubenswrapper[35367]: I1204 12:12:12.490069 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnl5x\" (UniqueName: \"kubernetes.io/projected/9b374233-5f6b-4003-8332-5aedeb729ca1-kube-api-access-lnl5x\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57\" (UID: \"9b374233-5f6b-4003-8332-5aedeb729ca1\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57" Dec 04 12:12:12.610989 master-0 kubenswrapper[35367]: I1204 12:12:12.610917 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57" Dec 04 12:12:12.657940 master-0 kubenswrapper[35367]: I1204 12:12:12.657370 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-x7xmj"] Dec 04 12:12:12.659291 master-0 kubenswrapper[35367]: I1204 12:12:12.659272 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-x7xmj" Dec 04 12:12:12.665265 master-0 kubenswrapper[35367]: I1204 12:12:12.665238 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"cert-manager-operator"/"openshift-service-ca.crt" Dec 04 12:12:12.665481 master-0 kubenswrapper[35367]: I1204 12:12:12.665433 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"cert-manager-operator"/"kube-root-ca.crt" Dec 04 12:12:12.725013 master-0 kubenswrapper[35367]: I1204 12:12:12.722988 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-x7xmj"] Dec 04 12:12:12.775834 master-0 kubenswrapper[35367]: I1204 12:12:12.775116 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8ssw\" (UniqueName: \"kubernetes.io/projected/1521be65-d977-4f7c-945f-c14c51177cc1-kube-api-access-z8ssw\") pod \"cert-manager-operator-controller-manager-64cf6dff88-x7xmj\" (UID: \"1521be65-d977-4f7c-945f-c14c51177cc1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-x7xmj" Dec 04 12:12:12.775834 master-0 kubenswrapper[35367]: I1204 12:12:12.775276 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1521be65-d977-4f7c-945f-c14c51177cc1-tmp\") pod \"cert-manager-operator-controller-manager-64cf6dff88-x7xmj\" (UID: \"1521be65-d977-4f7c-945f-c14c51177cc1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-x7xmj" Dec 04 12:12:12.878167 master-0 kubenswrapper[35367]: I1204 12:12:12.877918 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1521be65-d977-4f7c-945f-c14c51177cc1-tmp\") pod \"cert-manager-operator-controller-manager-64cf6dff88-x7xmj\" (UID: \"1521be65-d977-4f7c-945f-c14c51177cc1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-x7xmj" Dec 04 12:12:12.878596 master-0 kubenswrapper[35367]: I1204 12:12:12.878547 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1521be65-d977-4f7c-945f-c14c51177cc1-tmp\") pod \"cert-manager-operator-controller-manager-64cf6dff88-x7xmj\" (UID: \"1521be65-d977-4f7c-945f-c14c51177cc1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-x7xmj" Dec 04 12:12:12.878681 master-0 kubenswrapper[35367]: I1204 12:12:12.878622 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z8ssw\" (UniqueName: \"kubernetes.io/projected/1521be65-d977-4f7c-945f-c14c51177cc1-kube-api-access-z8ssw\") pod \"cert-manager-operator-controller-manager-64cf6dff88-x7xmj\" (UID: \"1521be65-d977-4f7c-945f-c14c51177cc1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-x7xmj" Dec 04 12:12:12.931773 master-0 kubenswrapper[35367]: I1204 12:12:12.931734 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8ssw\" (UniqueName: \"kubernetes.io/projected/1521be65-d977-4f7c-945f-c14c51177cc1-kube-api-access-z8ssw\") pod \"cert-manager-operator-controller-manager-64cf6dff88-x7xmj\" (UID: \"1521be65-d977-4f7c-945f-c14c51177cc1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-x7xmj" Dec 04 12:12:13.013436 master-0 kubenswrapper[35367]: I1204 12:12:13.013332 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-x7xmj" Dec 04 12:12:13.245441 master-0 kubenswrapper[35367]: I1204 12:12:13.245396 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57"] Dec 04 12:12:13.529127 master-0 kubenswrapper[35367]: I1204 12:12:13.527366 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-x7xmj"] Dec 04 12:12:13.529127 master-0 kubenswrapper[35367]: W1204 12:12:13.528943 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1521be65_d977_4f7c_945f_c14c51177cc1.slice/crio-fcc9c54afc34221ad47669f4212242cb4e378df00e52a415ce3392967f20483f WatchSource:0}: Error finding container fcc9c54afc34221ad47669f4212242cb4e378df00e52a415ce3392967f20483f: Status 404 returned error can't find the container with id fcc9c54afc34221ad47669f4212242cb4e378df00e52a415ce3392967f20483f Dec 04 12:12:14.115838 master-0 kubenswrapper[35367]: I1204 12:12:14.115740 35367 generic.go:334] "Generic (PLEG): container finished" podID="9b374233-5f6b-4003-8332-5aedeb729ca1" containerID="398d281c2a26fbef4a3684ab5f9da651a58688b49790edcc81a651b67570da82" exitCode=0 Dec 04 12:12:14.116098 master-0 kubenswrapper[35367]: I1204 12:12:14.115881 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57" event={"ID":"9b374233-5f6b-4003-8332-5aedeb729ca1","Type":"ContainerDied","Data":"398d281c2a26fbef4a3684ab5f9da651a58688b49790edcc81a651b67570da82"} Dec 04 12:12:14.116098 master-0 kubenswrapper[35367]: I1204 12:12:14.115920 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57" event={"ID":"9b374233-5f6b-4003-8332-5aedeb729ca1","Type":"ContainerStarted","Data":"b5194298d04df998cd275b0a8750f2b3a49f6c4c2f45e3bf788f59fc2c639241"} Dec 04 12:12:14.119720 master-0 kubenswrapper[35367]: I1204 12:12:14.119684 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-x7xmj" event={"ID":"1521be65-d977-4f7c-945f-c14c51177cc1","Type":"ContainerStarted","Data":"fcc9c54afc34221ad47669f4212242cb4e378df00e52a415ce3392967f20483f"} Dec 04 12:12:17.150781 master-0 kubenswrapper[35367]: I1204 12:12:17.150702 35367 generic.go:334] "Generic (PLEG): container finished" podID="9b374233-5f6b-4003-8332-5aedeb729ca1" containerID="fa6ecd7a2d98f9fdd09dff98ae20674b3f7d264dd42939bd700689b652845c85" exitCode=0 Dec 04 12:12:17.150781 master-0 kubenswrapper[35367]: I1204 12:12:17.150766 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57" event={"ID":"9b374233-5f6b-4003-8332-5aedeb729ca1","Type":"ContainerDied","Data":"fa6ecd7a2d98f9fdd09dff98ae20674b3f7d264dd42939bd700689b652845c85"} Dec 04 12:12:17.858153 master-0 kubenswrapper[35367]: I1204 12:12:17.857179 35367 scope.go:117] "RemoveContainer" containerID="0e3fb5e9fe4481e5a52c8778d150f0c86ce142116f508b1439fac0aa3de5e005" Dec 04 12:12:18.161863 master-0 kubenswrapper[35367]: I1204 12:12:18.161735 35367 generic.go:334] "Generic (PLEG): container finished" podID="9b374233-5f6b-4003-8332-5aedeb729ca1" containerID="e08f288fbaddcfb1987be4d6e206eecb058418b09e2d46fcdbc93f5fbdf97c98" exitCode=0 Dec 04 12:12:18.161863 master-0 kubenswrapper[35367]: I1204 12:12:18.161793 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57" event={"ID":"9b374233-5f6b-4003-8332-5aedeb729ca1","Type":"ContainerDied","Data":"e08f288fbaddcfb1987be4d6e206eecb058418b09e2d46fcdbc93f5fbdf97c98"} Dec 04 12:12:21.527280 master-0 kubenswrapper[35367]: I1204 12:12:21.527189 35367 scope.go:117] "RemoveContainer" containerID="c5c1336556cbcb95165f1f102bb4eac819f4ced445d9c55a6a1d6f55ca3e40fa" Dec 04 12:12:21.567867 master-0 kubenswrapper[35367]: I1204 12:12:21.567790 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57" Dec 04 12:12:21.670280 master-0 kubenswrapper[35367]: I1204 12:12:21.670194 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnl5x\" (UniqueName: \"kubernetes.io/projected/9b374233-5f6b-4003-8332-5aedeb729ca1-kube-api-access-lnl5x\") pod \"9b374233-5f6b-4003-8332-5aedeb729ca1\" (UID: \"9b374233-5f6b-4003-8332-5aedeb729ca1\") " Dec 04 12:12:21.670628 master-0 kubenswrapper[35367]: I1204 12:12:21.670315 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b374233-5f6b-4003-8332-5aedeb729ca1-util\") pod \"9b374233-5f6b-4003-8332-5aedeb729ca1\" (UID: \"9b374233-5f6b-4003-8332-5aedeb729ca1\") " Dec 04 12:12:21.670628 master-0 kubenswrapper[35367]: I1204 12:12:21.670364 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b374233-5f6b-4003-8332-5aedeb729ca1-bundle\") pod \"9b374233-5f6b-4003-8332-5aedeb729ca1\" (UID: \"9b374233-5f6b-4003-8332-5aedeb729ca1\") " Dec 04 12:12:21.673001 master-0 kubenswrapper[35367]: I1204 12:12:21.672935 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b374233-5f6b-4003-8332-5aedeb729ca1-bundle" (OuterVolumeSpecName: "bundle") pod "9b374233-5f6b-4003-8332-5aedeb729ca1" (UID: "9b374233-5f6b-4003-8332-5aedeb729ca1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:12:21.673438 master-0 kubenswrapper[35367]: I1204 12:12:21.673396 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b374233-5f6b-4003-8332-5aedeb729ca1-kube-api-access-lnl5x" (OuterVolumeSpecName: "kube-api-access-lnl5x") pod "9b374233-5f6b-4003-8332-5aedeb729ca1" (UID: "9b374233-5f6b-4003-8332-5aedeb729ca1"). InnerVolumeSpecName "kube-api-access-lnl5x". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:12:21.681410 master-0 kubenswrapper[35367]: I1204 12:12:21.681334 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b374233-5f6b-4003-8332-5aedeb729ca1-util" (OuterVolumeSpecName: "util") pod "9b374233-5f6b-4003-8332-5aedeb729ca1" (UID: "9b374233-5f6b-4003-8332-5aedeb729ca1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:12:21.772668 master-0 kubenswrapper[35367]: I1204 12:12:21.772502 35367 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b374233-5f6b-4003-8332-5aedeb729ca1-util\") on node \"master-0\" DevicePath \"\"" Dec 04 12:12:21.772668 master-0 kubenswrapper[35367]: I1204 12:12:21.772562 35367 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b374233-5f6b-4003-8332-5aedeb729ca1-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:12:21.772668 master-0 kubenswrapper[35367]: I1204 12:12:21.772576 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lnl5x\" (UniqueName: \"kubernetes.io/projected/9b374233-5f6b-4003-8332-5aedeb729ca1-kube-api-access-lnl5x\") on node \"master-0\" DevicePath \"\"" Dec 04 12:12:22.250716 master-0 kubenswrapper[35367]: I1204 12:12:22.250608 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57" event={"ID":"9b374233-5f6b-4003-8332-5aedeb729ca1","Type":"ContainerDied","Data":"b5194298d04df998cd275b0a8750f2b3a49f6c4c2f45e3bf788f59fc2c639241"} Dec 04 12:12:22.250716 master-0 kubenswrapper[35367]: I1204 12:12:22.250690 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5194298d04df998cd275b0a8750f2b3a49f6c4c2f45e3bf788f59fc2c639241" Dec 04 12:12:22.251046 master-0 kubenswrapper[35367]: I1204 12:12:22.250769 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c921049l57" Dec 04 12:12:23.259839 master-0 kubenswrapper[35367]: I1204 12:12:23.259760 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-x7xmj" event={"ID":"1521be65-d977-4f7c-945f-c14c51177cc1","Type":"ContainerStarted","Data":"76bdb457181990e1cdfbe31fab3ffb12ec122e11d019ae8140a40aa965681bd9"} Dec 04 12:12:25.836344 master-0 kubenswrapper[35367]: I1204 12:12:25.836245 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-x7xmj" podStartSLOduration=5.157645254 podStartE2EDuration="13.83622378s" podCreationTimestamp="2025-12-04 12:12:12 +0000 UTC" firstStartedPulling="2025-12-04 12:12:13.532340112 +0000 UTC m=+776.970401370" lastFinishedPulling="2025-12-04 12:12:22.210918638 +0000 UTC m=+785.648979896" observedRunningTime="2025-12-04 12:12:23.486854795 +0000 UTC m=+786.924916063" watchObservedRunningTime="2025-12-04 12:12:25.83622378 +0000 UTC m=+789.274285048" Dec 04 12:12:25.841585 master-0 kubenswrapper[35367]: I1204 12:12:25.841502 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-f4fb5df64-42npf"] Dec 04 12:12:25.841945 master-0 kubenswrapper[35367]: E1204 12:12:25.841917 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9b374233-5f6b-4003-8332-5aedeb729ca1" containerName="util" Dec 04 12:12:25.841945 master-0 kubenswrapper[35367]: I1204 12:12:25.841936 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b374233-5f6b-4003-8332-5aedeb729ca1" containerName="util" Dec 04 12:12:25.842089 master-0 kubenswrapper[35367]: E1204 12:12:25.841960 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9b374233-5f6b-4003-8332-5aedeb729ca1" containerName="pull" Dec 04 12:12:25.842089 master-0 kubenswrapper[35367]: I1204 12:12:25.841968 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b374233-5f6b-4003-8332-5aedeb729ca1" containerName="pull" Dec 04 12:12:25.842089 master-0 kubenswrapper[35367]: E1204 12:12:25.841984 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9b374233-5f6b-4003-8332-5aedeb729ca1" containerName="extract" Dec 04 12:12:25.842089 master-0 kubenswrapper[35367]: I1204 12:12:25.841992 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b374233-5f6b-4003-8332-5aedeb729ca1" containerName="extract" Dec 04 12:12:25.842278 master-0 kubenswrapper[35367]: I1204 12:12:25.842139 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="9b374233-5f6b-4003-8332-5aedeb729ca1" containerName="extract" Dec 04 12:12:25.842753 master-0 kubenswrapper[35367]: I1204 12:12:25.842724 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-f4fb5df64-42npf" Dec 04 12:12:25.849863 master-0 kubenswrapper[35367]: I1204 12:12:25.849784 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"cert-manager"/"openshift-service-ca.crt" Dec 04 12:12:25.850123 master-0 kubenswrapper[35367]: I1204 12:12:25.849946 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"cert-manager"/"kube-root-ca.crt" Dec 04 12:12:25.873279 master-0 kubenswrapper[35367]: I1204 12:12:25.873209 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-f4fb5df64-42npf"] Dec 04 12:12:25.981924 master-0 kubenswrapper[35367]: I1204 12:12:25.979724 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ee63d3e-4191-4b3c-83c2-e2d38c50bcf0-bound-sa-token\") pod \"cert-manager-webhook-f4fb5df64-42npf\" (UID: \"6ee63d3e-4191-4b3c-83c2-e2d38c50bcf0\") " pod="cert-manager/cert-manager-webhook-f4fb5df64-42npf" Dec 04 12:12:25.981924 master-0 kubenswrapper[35367]: I1204 12:12:25.979838 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmcvf\" (UniqueName: \"kubernetes.io/projected/6ee63d3e-4191-4b3c-83c2-e2d38c50bcf0-kube-api-access-tmcvf\") pod \"cert-manager-webhook-f4fb5df64-42npf\" (UID: \"6ee63d3e-4191-4b3c-83c2-e2d38c50bcf0\") " pod="cert-manager/cert-manager-webhook-f4fb5df64-42npf" Dec 04 12:12:26.082671 master-0 kubenswrapper[35367]: I1204 12:12:26.082588 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ee63d3e-4191-4b3c-83c2-e2d38c50bcf0-bound-sa-token\") pod \"cert-manager-webhook-f4fb5df64-42npf\" (UID: \"6ee63d3e-4191-4b3c-83c2-e2d38c50bcf0\") " pod="cert-manager/cert-manager-webhook-f4fb5df64-42npf" Dec 04 12:12:26.082991 master-0 kubenswrapper[35367]: I1204 12:12:26.082922 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tmcvf\" (UniqueName: \"kubernetes.io/projected/6ee63d3e-4191-4b3c-83c2-e2d38c50bcf0-kube-api-access-tmcvf\") pod \"cert-manager-webhook-f4fb5df64-42npf\" (UID: \"6ee63d3e-4191-4b3c-83c2-e2d38c50bcf0\") " pod="cert-manager/cert-manager-webhook-f4fb5df64-42npf" Dec 04 12:12:26.106788 master-0 kubenswrapper[35367]: I1204 12:12:26.106661 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmcvf\" (UniqueName: \"kubernetes.io/projected/6ee63d3e-4191-4b3c-83c2-e2d38c50bcf0-kube-api-access-tmcvf\") pod \"cert-manager-webhook-f4fb5df64-42npf\" (UID: \"6ee63d3e-4191-4b3c-83c2-e2d38c50bcf0\") " pod="cert-manager/cert-manager-webhook-f4fb5df64-42npf" Dec 04 12:12:26.111404 master-0 kubenswrapper[35367]: I1204 12:12:26.111349 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ee63d3e-4191-4b3c-83c2-e2d38c50bcf0-bound-sa-token\") pod \"cert-manager-webhook-f4fb5df64-42npf\" (UID: \"6ee63d3e-4191-4b3c-83c2-e2d38c50bcf0\") " pod="cert-manager/cert-manager-webhook-f4fb5df64-42npf" Dec 04 12:12:26.172672 master-0 kubenswrapper[35367]: I1204 12:12:26.172602 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-f4fb5df64-42npf" Dec 04 12:12:26.662301 master-0 kubenswrapper[35367]: I1204 12:12:26.659224 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-f4fb5df64-42npf"] Dec 04 12:12:26.662301 master-0 kubenswrapper[35367]: W1204 12:12:26.661624 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ee63d3e_4191_4b3c_83c2_e2d38c50bcf0.slice/crio-70256ab81de5e509ab57c87073833390293404d0ac73a3efd585ef9aa84f939f WatchSource:0}: Error finding container 70256ab81de5e509ab57c87073833390293404d0ac73a3efd585ef9aa84f939f: Status 404 returned error can't find the container with id 70256ab81de5e509ab57c87073833390293404d0ac73a3efd585ef9aa84f939f Dec 04 12:12:27.016424 master-0 kubenswrapper[35367]: I1204 12:12:27.016283 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-operator-5b5b58f5c8-kv2p5"] Dec 04 12:12:27.018409 master-0 kubenswrapper[35367]: I1204 12:12:27.017742 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-operator-5b5b58f5c8-kv2p5" Dec 04 12:12:27.021506 master-0 kubenswrapper[35367]: I1204 12:12:27.021450 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-nmstate"/"kube-root-ca.crt" Dec 04 12:12:27.024604 master-0 kubenswrapper[35367]: I1204 12:12:27.023113 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-nmstate"/"openshift-service-ca.crt" Dec 04 12:12:27.093551 master-0 kubenswrapper[35367]: I1204 12:12:27.093477 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-operator-5b5b58f5c8-kv2p5"] Dec 04 12:12:27.217332 master-0 kubenswrapper[35367]: I1204 12:12:27.217245 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pptn\" (UniqueName: \"kubernetes.io/projected/c45c5482-cbe4-4d60-b484-e99f18925788-kube-api-access-8pptn\") pod \"nmstate-operator-5b5b58f5c8-kv2p5\" (UID: \"c45c5482-cbe4-4d60-b484-e99f18925788\") " pod="openshift-nmstate/nmstate-operator-5b5b58f5c8-kv2p5" Dec 04 12:12:27.316961 master-0 kubenswrapper[35367]: I1204 12:12:27.316871 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-f4fb5df64-42npf" event={"ID":"6ee63d3e-4191-4b3c-83c2-e2d38c50bcf0","Type":"ContainerStarted","Data":"70256ab81de5e509ab57c87073833390293404d0ac73a3efd585ef9aa84f939f"} Dec 04 12:12:27.319550 master-0 kubenswrapper[35367]: I1204 12:12:27.319483 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8pptn\" (UniqueName: \"kubernetes.io/projected/c45c5482-cbe4-4d60-b484-e99f18925788-kube-api-access-8pptn\") pod \"nmstate-operator-5b5b58f5c8-kv2p5\" (UID: \"c45c5482-cbe4-4d60-b484-e99f18925788\") " pod="openshift-nmstate/nmstate-operator-5b5b58f5c8-kv2p5" Dec 04 12:12:27.342012 master-0 kubenswrapper[35367]: I1204 12:12:27.341963 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pptn\" (UniqueName: \"kubernetes.io/projected/c45c5482-cbe4-4d60-b484-e99f18925788-kube-api-access-8pptn\") pod \"nmstate-operator-5b5b58f5c8-kv2p5\" (UID: \"c45c5482-cbe4-4d60-b484-e99f18925788\") " pod="openshift-nmstate/nmstate-operator-5b5b58f5c8-kv2p5" Dec 04 12:12:27.342534 master-0 kubenswrapper[35367]: I1204 12:12:27.342378 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-operator-5b5b58f5c8-kv2p5" Dec 04 12:12:27.771758 master-0 kubenswrapper[35367]: I1204 12:12:27.763669 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-operator-5b5b58f5c8-kv2p5"] Dec 04 12:12:28.341927 master-0 kubenswrapper[35367]: I1204 12:12:28.334035 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-operator-5b5b58f5c8-kv2p5" event={"ID":"c45c5482-cbe4-4d60-b484-e99f18925788","Type":"ContainerStarted","Data":"c23097988748c193ec9962e1b655d25761f962e249de8288bd71090ca406d3d1"} Dec 04 12:12:29.937284 master-0 kubenswrapper[35367]: I1204 12:12:29.937198 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-855d9ccff4-lh4km"] Dec 04 12:12:29.938355 master-0 kubenswrapper[35367]: I1204 12:12:29.938267 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-855d9ccff4-lh4km" Dec 04 12:12:30.000295 master-0 kubenswrapper[35367]: I1204 12:12:29.999495 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-855d9ccff4-lh4km"] Dec 04 12:12:30.098675 master-0 kubenswrapper[35367]: I1204 12:12:30.098586 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cpzl\" (UniqueName: \"kubernetes.io/projected/df3010d8-f616-45da-8182-972499fa7ea2-kube-api-access-5cpzl\") pod \"cert-manager-cainjector-855d9ccff4-lh4km\" (UID: \"df3010d8-f616-45da-8182-972499fa7ea2\") " pod="cert-manager/cert-manager-cainjector-855d9ccff4-lh4km" Dec 04 12:12:30.098675 master-0 kubenswrapper[35367]: I1204 12:12:30.098658 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df3010d8-f616-45da-8182-972499fa7ea2-bound-sa-token\") pod \"cert-manager-cainjector-855d9ccff4-lh4km\" (UID: \"df3010d8-f616-45da-8182-972499fa7ea2\") " pod="cert-manager/cert-manager-cainjector-855d9ccff4-lh4km" Dec 04 12:12:30.202258 master-0 kubenswrapper[35367]: I1204 12:12:30.201075 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5cpzl\" (UniqueName: \"kubernetes.io/projected/df3010d8-f616-45da-8182-972499fa7ea2-kube-api-access-5cpzl\") pod \"cert-manager-cainjector-855d9ccff4-lh4km\" (UID: \"df3010d8-f616-45da-8182-972499fa7ea2\") " pod="cert-manager/cert-manager-cainjector-855d9ccff4-lh4km" Dec 04 12:12:30.202258 master-0 kubenswrapper[35367]: I1204 12:12:30.201159 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df3010d8-f616-45da-8182-972499fa7ea2-bound-sa-token\") pod \"cert-manager-cainjector-855d9ccff4-lh4km\" (UID: \"df3010d8-f616-45da-8182-972499fa7ea2\") " pod="cert-manager/cert-manager-cainjector-855d9ccff4-lh4km" Dec 04 12:12:30.225682 master-0 kubenswrapper[35367]: I1204 12:12:30.225576 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cpzl\" (UniqueName: \"kubernetes.io/projected/df3010d8-f616-45da-8182-972499fa7ea2-kube-api-access-5cpzl\") pod \"cert-manager-cainjector-855d9ccff4-lh4km\" (UID: \"df3010d8-f616-45da-8182-972499fa7ea2\") " pod="cert-manager/cert-manager-cainjector-855d9ccff4-lh4km" Dec 04 12:12:30.229534 master-0 kubenswrapper[35367]: I1204 12:12:30.229452 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df3010d8-f616-45da-8182-972499fa7ea2-bound-sa-token\") pod \"cert-manager-cainjector-855d9ccff4-lh4km\" (UID: \"df3010d8-f616-45da-8182-972499fa7ea2\") " pod="cert-manager/cert-manager-cainjector-855d9ccff4-lh4km" Dec 04 12:12:30.256563 master-0 kubenswrapper[35367]: I1204 12:12:30.256493 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-855d9ccff4-lh4km" Dec 04 12:12:34.667324 master-0 kubenswrapper[35367]: I1204 12:12:34.666855 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v"] Dec 04 12:12:34.672903 master-0 kubenswrapper[35367]: I1204 12:12:34.672857 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" Dec 04 12:12:34.688833 master-0 kubenswrapper[35367]: I1204 12:12:34.686539 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"metallb-system"/"kube-root-ca.crt" Dec 04 12:12:34.688833 master-0 kubenswrapper[35367]: I1204 12:12:34.686797 35367 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-operator-webhook-server-cert" Dec 04 12:12:34.688833 master-0 kubenswrapper[35367]: I1204 12:12:34.687026 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"metallb-system"/"openshift-service-ca.crt" Dec 04 12:12:34.688833 master-0 kubenswrapper[35367]: I1204 12:12:34.687181 35367 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-operator-controller-manager-service-cert" Dec 04 12:12:34.721197 master-0 kubenswrapper[35367]: I1204 12:12:34.716561 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v"] Dec 04 12:12:34.848861 master-0 kubenswrapper[35367]: I1204 12:12:34.847860 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/70729025-94a7-4a9b-98b8-e68b73d59a3e-apiservice-cert\") pod \"metallb-operator-controller-manager-6f8cddc44c-f979v\" (UID: \"70729025-94a7-4a9b-98b8-e68b73d59a3e\") " pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" Dec 04 12:12:34.848861 master-0 kubenswrapper[35367]: I1204 12:12:34.847942 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k26hd\" (UniqueName: \"kubernetes.io/projected/70729025-94a7-4a9b-98b8-e68b73d59a3e-kube-api-access-k26hd\") pod \"metallb-operator-controller-manager-6f8cddc44c-f979v\" (UID: \"70729025-94a7-4a9b-98b8-e68b73d59a3e\") " pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" Dec 04 12:12:34.848861 master-0 kubenswrapper[35367]: I1204 12:12:34.848003 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/70729025-94a7-4a9b-98b8-e68b73d59a3e-webhook-cert\") pod \"metallb-operator-controller-manager-6f8cddc44c-f979v\" (UID: \"70729025-94a7-4a9b-98b8-e68b73d59a3e\") " pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" Dec 04 12:12:34.949917 master-0 kubenswrapper[35367]: I1204 12:12:34.949281 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/70729025-94a7-4a9b-98b8-e68b73d59a3e-apiservice-cert\") pod \"metallb-operator-controller-manager-6f8cddc44c-f979v\" (UID: \"70729025-94a7-4a9b-98b8-e68b73d59a3e\") " pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" Dec 04 12:12:34.949917 master-0 kubenswrapper[35367]: I1204 12:12:34.949345 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k26hd\" (UniqueName: \"kubernetes.io/projected/70729025-94a7-4a9b-98b8-e68b73d59a3e-kube-api-access-k26hd\") pod \"metallb-operator-controller-manager-6f8cddc44c-f979v\" (UID: \"70729025-94a7-4a9b-98b8-e68b73d59a3e\") " pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" Dec 04 12:12:34.949917 master-0 kubenswrapper[35367]: I1204 12:12:34.949411 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/70729025-94a7-4a9b-98b8-e68b73d59a3e-webhook-cert\") pod \"metallb-operator-controller-manager-6f8cddc44c-f979v\" (UID: \"70729025-94a7-4a9b-98b8-e68b73d59a3e\") " pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" Dec 04 12:12:34.959948 master-0 kubenswrapper[35367]: I1204 12:12:34.952742 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/70729025-94a7-4a9b-98b8-e68b73d59a3e-apiservice-cert\") pod \"metallb-operator-controller-manager-6f8cddc44c-f979v\" (UID: \"70729025-94a7-4a9b-98b8-e68b73d59a3e\") " pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" Dec 04 12:12:34.959948 master-0 kubenswrapper[35367]: I1204 12:12:34.954380 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/70729025-94a7-4a9b-98b8-e68b73d59a3e-webhook-cert\") pod \"metallb-operator-controller-manager-6f8cddc44c-f979v\" (UID: \"70729025-94a7-4a9b-98b8-e68b73d59a3e\") " pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" Dec 04 12:12:36.073851 master-0 kubenswrapper[35367]: I1204 12:12:36.073437 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k26hd\" (UniqueName: \"kubernetes.io/projected/70729025-94a7-4a9b-98b8-e68b73d59a3e-kube-api-access-k26hd\") pod \"metallb-operator-controller-manager-6f8cddc44c-f979v\" (UID: \"70729025-94a7-4a9b-98b8-e68b73d59a3e\") " pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" Dec 04 12:12:36.269601 master-0 kubenswrapper[35367]: I1204 12:12:36.269550 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" Dec 04 12:12:37.123264 master-0 kubenswrapper[35367]: I1204 12:12:37.122826 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/metallb-operator-webhook-server-567cbcbb98-h2n4q"] Dec 04 12:12:37.125481 master-0 kubenswrapper[35367]: I1204 12:12:37.125452 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-webhook-server-567cbcbb98-h2n4q" Dec 04 12:12:37.127797 master-0 kubenswrapper[35367]: I1204 12:12:37.127737 35367 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-webhook-cert" Dec 04 12:12:37.128010 master-0 kubenswrapper[35367]: I1204 12:12:37.127870 35367 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-operator-webhook-server-service-cert" Dec 04 12:12:37.306403 master-0 kubenswrapper[35367]: I1204 12:12:37.293496 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpd6w\" (UniqueName: \"kubernetes.io/projected/89355b8e-cca3-4c80-a9da-8834812d73e6-kube-api-access-bpd6w\") pod \"metallb-operator-webhook-server-567cbcbb98-h2n4q\" (UID: \"89355b8e-cca3-4c80-a9da-8834812d73e6\") " pod="metallb-system/metallb-operator-webhook-server-567cbcbb98-h2n4q" Dec 04 12:12:37.306403 master-0 kubenswrapper[35367]: I1204 12:12:37.293678 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89355b8e-cca3-4c80-a9da-8834812d73e6-webhook-cert\") pod \"metallb-operator-webhook-server-567cbcbb98-h2n4q\" (UID: \"89355b8e-cca3-4c80-a9da-8834812d73e6\") " pod="metallb-system/metallb-operator-webhook-server-567cbcbb98-h2n4q" Dec 04 12:12:37.306403 master-0 kubenswrapper[35367]: I1204 12:12:37.293730 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/89355b8e-cca3-4c80-a9da-8834812d73e6-apiservice-cert\") pod \"metallb-operator-webhook-server-567cbcbb98-h2n4q\" (UID: \"89355b8e-cca3-4c80-a9da-8834812d73e6\") " pod="metallb-system/metallb-operator-webhook-server-567cbcbb98-h2n4q" Dec 04 12:12:37.367106 master-0 kubenswrapper[35367]: I1204 12:12:37.365953 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-webhook-server-567cbcbb98-h2n4q"] Dec 04 12:12:37.406862 master-0 kubenswrapper[35367]: I1204 12:12:37.400884 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-86cb77c54b-db45f"] Dec 04 12:12:37.406862 master-0 kubenswrapper[35367]: I1204 12:12:37.402395 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-86cb77c54b-db45f" Dec 04 12:12:37.406862 master-0 kubenswrapper[35367]: I1204 12:12:37.404153 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bpd6w\" (UniqueName: \"kubernetes.io/projected/89355b8e-cca3-4c80-a9da-8834812d73e6-kube-api-access-bpd6w\") pod \"metallb-operator-webhook-server-567cbcbb98-h2n4q\" (UID: \"89355b8e-cca3-4c80-a9da-8834812d73e6\") " pod="metallb-system/metallb-operator-webhook-server-567cbcbb98-h2n4q" Dec 04 12:12:37.406862 master-0 kubenswrapper[35367]: I1204 12:12:37.404272 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89355b8e-cca3-4c80-a9da-8834812d73e6-webhook-cert\") pod \"metallb-operator-webhook-server-567cbcbb98-h2n4q\" (UID: \"89355b8e-cca3-4c80-a9da-8834812d73e6\") " pod="metallb-system/metallb-operator-webhook-server-567cbcbb98-h2n4q" Dec 04 12:12:37.406862 master-0 kubenswrapper[35367]: I1204 12:12:37.404302 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/89355b8e-cca3-4c80-a9da-8834812d73e6-apiservice-cert\") pod \"metallb-operator-webhook-server-567cbcbb98-h2n4q\" (UID: \"89355b8e-cca3-4c80-a9da-8834812d73e6\") " pod="metallb-system/metallb-operator-webhook-server-567cbcbb98-h2n4q" Dec 04 12:12:37.410118 master-0 kubenswrapper[35367]: I1204 12:12:37.408569 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-86cb77c54b-db45f"] Dec 04 12:12:37.432902 master-0 kubenswrapper[35367]: I1204 12:12:37.411056 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89355b8e-cca3-4c80-a9da-8834812d73e6-webhook-cert\") pod \"metallb-operator-webhook-server-567cbcbb98-h2n4q\" (UID: \"89355b8e-cca3-4c80-a9da-8834812d73e6\") " pod="metallb-system/metallb-operator-webhook-server-567cbcbb98-h2n4q" Dec 04 12:12:37.432902 master-0 kubenswrapper[35367]: I1204 12:12:37.413473 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/89355b8e-cca3-4c80-a9da-8834812d73e6-apiservice-cert\") pod \"metallb-operator-webhook-server-567cbcbb98-h2n4q\" (UID: \"89355b8e-cca3-4c80-a9da-8834812d73e6\") " pod="metallb-system/metallb-operator-webhook-server-567cbcbb98-h2n4q" Dec 04 12:12:37.522855 master-0 kubenswrapper[35367]: I1204 12:12:37.513184 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6b26\" (UniqueName: \"kubernetes.io/projected/128bacca-6d0f-48a8-82d4-4a036c315b22-kube-api-access-q6b26\") pod \"cert-manager-86cb77c54b-db45f\" (UID: \"128bacca-6d0f-48a8-82d4-4a036c315b22\") " pod="cert-manager/cert-manager-86cb77c54b-db45f" Dec 04 12:12:37.522855 master-0 kubenswrapper[35367]: I1204 12:12:37.513649 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/128bacca-6d0f-48a8-82d4-4a036c315b22-bound-sa-token\") pod \"cert-manager-86cb77c54b-db45f\" (UID: \"128bacca-6d0f-48a8-82d4-4a036c315b22\") " pod="cert-manager/cert-manager-86cb77c54b-db45f" Dec 04 12:12:37.620521 master-0 kubenswrapper[35367]: I1204 12:12:37.620469 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/128bacca-6d0f-48a8-82d4-4a036c315b22-bound-sa-token\") pod \"cert-manager-86cb77c54b-db45f\" (UID: \"128bacca-6d0f-48a8-82d4-4a036c315b22\") " pod="cert-manager/cert-manager-86cb77c54b-db45f" Dec 04 12:12:37.620859 master-0 kubenswrapper[35367]: I1204 12:12:37.620842 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q6b26\" (UniqueName: \"kubernetes.io/projected/128bacca-6d0f-48a8-82d4-4a036c315b22-kube-api-access-q6b26\") pod \"cert-manager-86cb77c54b-db45f\" (UID: \"128bacca-6d0f-48a8-82d4-4a036c315b22\") " pod="cert-manager/cert-manager-86cb77c54b-db45f" Dec 04 12:12:37.686848 master-0 kubenswrapper[35367]: I1204 12:12:37.683777 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpd6w\" (UniqueName: \"kubernetes.io/projected/89355b8e-cca3-4c80-a9da-8834812d73e6-kube-api-access-bpd6w\") pod \"metallb-operator-webhook-server-567cbcbb98-h2n4q\" (UID: \"89355b8e-cca3-4c80-a9da-8834812d73e6\") " pod="metallb-system/metallb-operator-webhook-server-567cbcbb98-h2n4q" Dec 04 12:12:37.741864 master-0 kubenswrapper[35367]: I1204 12:12:37.741818 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/128bacca-6d0f-48a8-82d4-4a036c315b22-bound-sa-token\") pod \"cert-manager-86cb77c54b-db45f\" (UID: \"128bacca-6d0f-48a8-82d4-4a036c315b22\") " pod="cert-manager/cert-manager-86cb77c54b-db45f" Dec 04 12:12:37.753561 master-0 kubenswrapper[35367]: I1204 12:12:37.753515 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6b26\" (UniqueName: \"kubernetes.io/projected/128bacca-6d0f-48a8-82d4-4a036c315b22-kube-api-access-q6b26\") pod \"cert-manager-86cb77c54b-db45f\" (UID: \"128bacca-6d0f-48a8-82d4-4a036c315b22\") " pod="cert-manager/cert-manager-86cb77c54b-db45f" Dec 04 12:12:37.761674 master-0 kubenswrapper[35367]: I1204 12:12:37.761567 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-webhook-server-567cbcbb98-h2n4q" Dec 04 12:12:37.765908 master-0 kubenswrapper[35367]: I1204 12:12:37.765703 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-855d9ccff4-lh4km"] Dec 04 12:12:37.865845 master-0 kubenswrapper[35367]: I1204 12:12:37.861970 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-86cb77c54b-db45f" Dec 04 12:12:37.883472 master-0 kubenswrapper[35367]: I1204 12:12:37.882928 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v"] Dec 04 12:12:38.509382 master-0 kubenswrapper[35367]: I1204 12:12:38.509220 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-855d9ccff4-lh4km" event={"ID":"df3010d8-f616-45da-8182-972499fa7ea2","Type":"ContainerStarted","Data":"138de5ce3b5efecfb789948e9945b1704d734ed4ec1555a4fb5f32404db17ac3"} Dec 04 12:12:38.509382 master-0 kubenswrapper[35367]: I1204 12:12:38.509298 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-855d9ccff4-lh4km" event={"ID":"df3010d8-f616-45da-8182-972499fa7ea2","Type":"ContainerStarted","Data":"61a8a9c346d57efdc5b35e22e528efa3248b93f138b601069141700308e4b0f1"} Dec 04 12:12:38.523360 master-0 kubenswrapper[35367]: I1204 12:12:38.523048 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" event={"ID":"70729025-94a7-4a9b-98b8-e68b73d59a3e","Type":"ContainerStarted","Data":"5590d41db51524a15e3f3d2701e3c66120ad4f89831dee4a993a1fb3cfe4e506"} Dec 04 12:12:38.537922 master-0 kubenswrapper[35367]: I1204 12:12:38.537843 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-operator-5b5b58f5c8-kv2p5" event={"ID":"c45c5482-cbe4-4d60-b484-e99f18925788","Type":"ContainerStarted","Data":"7dfad0eab22caedbddeb31a094015df3abf2ad80789a7bc33c28295ff7e24175"} Dec 04 12:12:38.540067 master-0 kubenswrapper[35367]: I1204 12:12:38.539996 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-f4fb5df64-42npf" event={"ID":"6ee63d3e-4191-4b3c-83c2-e2d38c50bcf0","Type":"ContainerStarted","Data":"852178fa237f2ad0bce2cd40d22715c90c835e664cd9b0bba86468773e4e3948"} Dec 04 12:12:38.540483 master-0 kubenswrapper[35367]: I1204 12:12:38.540452 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="cert-manager/cert-manager-webhook-f4fb5df64-42npf" Dec 04 12:12:41.147520 master-0 kubenswrapper[35367]: I1204 12:12:41.146678 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-webhook-server-567cbcbb98-h2n4q"] Dec 04 12:12:41.566547 master-0 kubenswrapper[35367]: I1204 12:12:41.566463 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-webhook-server-567cbcbb98-h2n4q" event={"ID":"89355b8e-cca3-4c80-a9da-8834812d73e6","Type":"ContainerStarted","Data":"48aac9b179be36d746638c95ee98c04e928d617a617f3316a8d6023b6ac2ce53"} Dec 04 12:12:45.224831 master-0 kubenswrapper[35367]: I1204 12:12:45.215105 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-86cb77c54b-db45f"] Dec 04 12:12:45.232840 master-0 kubenswrapper[35367]: I1204 12:12:45.228967 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-855d9ccff4-lh4km" podStartSLOduration=16.228940276 podStartE2EDuration="16.228940276s" podCreationTimestamp="2025-12-04 12:12:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:12:45.204072602 +0000 UTC m=+808.642133870" watchObservedRunningTime="2025-12-04 12:12:45.228940276 +0000 UTC m=+808.667001534" Dec 04 12:12:45.609629 master-0 kubenswrapper[35367]: I1204 12:12:45.609561 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-86cb77c54b-db45f" event={"ID":"128bacca-6d0f-48a8-82d4-4a036c315b22","Type":"ContainerStarted","Data":"a2f6da7d57255e34301704bc01e475c926f17867f9e80c56018aa5ab69c14d4a"} Dec 04 12:12:45.860045 master-0 kubenswrapper[35367]: I1204 12:12:45.859798 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-operator-5b5b58f5c8-kv2p5" podStartSLOduration=10.560325195 podStartE2EDuration="19.85977847s" podCreationTimestamp="2025-12-04 12:12:26 +0000 UTC" firstStartedPulling="2025-12-04 12:12:27.77055621 +0000 UTC m=+791.208617468" lastFinishedPulling="2025-12-04 12:12:37.070009485 +0000 UTC m=+800.508070743" observedRunningTime="2025-12-04 12:12:45.859054217 +0000 UTC m=+809.297115495" watchObservedRunningTime="2025-12-04 12:12:45.85977847 +0000 UTC m=+809.297839748" Dec 04 12:12:46.176884 master-0 kubenswrapper[35367]: I1204 12:12:46.176740 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-f4fb5df64-42npf" Dec 04 12:12:46.662865 master-0 kubenswrapper[35367]: I1204 12:12:46.659001 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-86cb77c54b-db45f" event={"ID":"128bacca-6d0f-48a8-82d4-4a036c315b22","Type":"ContainerStarted","Data":"c81083583817bae1adbb3eba3bab90a936bfe353c7fe4ee9f427af514269d544"} Dec 04 12:12:47.898637 master-0 kubenswrapper[35367]: I1204 12:12:47.895739 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-f4fb5df64-42npf" podStartSLOduration=12.46920633 podStartE2EDuration="22.895716475s" podCreationTimestamp="2025-12-04 12:12:25 +0000 UTC" firstStartedPulling="2025-12-04 12:12:26.666349301 +0000 UTC m=+790.104410559" lastFinishedPulling="2025-12-04 12:12:37.092859446 +0000 UTC m=+800.530920704" observedRunningTime="2025-12-04 12:12:46.552231938 +0000 UTC m=+809.990293196" watchObservedRunningTime="2025-12-04 12:12:47.895716475 +0000 UTC m=+811.333777733" Dec 04 12:12:48.522827 master-0 kubenswrapper[35367]: I1204 12:12:48.522154 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-86cb77c54b-db45f" podStartSLOduration=11.522133259 podStartE2EDuration="11.522133259s" podCreationTimestamp="2025-12-04 12:12:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:12:48.441866597 +0000 UTC m=+811.879927845" watchObservedRunningTime="2025-12-04 12:12:48.522133259 +0000 UTC m=+811.960194517" Dec 04 12:12:51.707128 master-0 kubenswrapper[35367]: I1204 12:12:51.707036 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-webhook-server-567cbcbb98-h2n4q" event={"ID":"89355b8e-cca3-4c80-a9da-8834812d73e6","Type":"ContainerStarted","Data":"e664864e7ecc62a00aaa494225196359634c77b9fb1656164931451ba4ea384b"} Dec 04 12:12:51.707774 master-0 kubenswrapper[35367]: I1204 12:12:51.707196 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/metallb-operator-webhook-server-567cbcbb98-h2n4q" Dec 04 12:12:51.709350 master-0 kubenswrapper[35367]: I1204 12:12:51.709247 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" event={"ID":"70729025-94a7-4a9b-98b8-e68b73d59a3e","Type":"ContainerStarted","Data":"25fd0707b23306a2945597f4d91087157d1e67a9d1035042878e9983a95dace6"} Dec 04 12:12:51.709606 master-0 kubenswrapper[35367]: I1204 12:12:51.709362 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" Dec 04 12:12:52.440799 master-0 kubenswrapper[35367]: I1204 12:12:52.440695 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/metallb-operator-webhook-server-567cbcbb98-h2n4q" podStartSLOduration=5.663843944 podStartE2EDuration="15.440665972s" podCreationTimestamp="2025-12-04 12:12:37 +0000 UTC" firstStartedPulling="2025-12-04 12:12:41.165335326 +0000 UTC m=+804.603396584" lastFinishedPulling="2025-12-04 12:12:50.942157354 +0000 UTC m=+814.380218612" observedRunningTime="2025-12-04 12:12:52.440639381 +0000 UTC m=+815.878700639" watchObservedRunningTime="2025-12-04 12:12:52.440665972 +0000 UTC m=+815.878727230" Dec 04 12:12:52.473983 master-0 kubenswrapper[35367]: I1204 12:12:52.473902 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" podStartSLOduration=5.515685249 podStartE2EDuration="18.473880471s" podCreationTimestamp="2025-12-04 12:12:34 +0000 UTC" firstStartedPulling="2025-12-04 12:12:37.948909125 +0000 UTC m=+801.386970383" lastFinishedPulling="2025-12-04 12:12:50.907104347 +0000 UTC m=+814.345165605" observedRunningTime="2025-12-04 12:12:52.469966957 +0000 UTC m=+815.908028215" watchObservedRunningTime="2025-12-04 12:12:52.473880471 +0000 UTC m=+815.911941729" Dec 04 12:12:54.360337 master-0 kubenswrapper[35367]: I1204 12:12:54.360262 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operators/obo-prometheus-operator-668cf9dfbb-tllrd"] Dec 04 12:12:54.362479 master-0 kubenswrapper[35367]: I1204 12:12:54.362455 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-tllrd" Dec 04 12:12:54.365367 master-0 kubenswrapper[35367]: I1204 12:12:54.365340 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operators"/"openshift-service-ca.crt" Dec 04 12:12:54.365660 master-0 kubenswrapper[35367]: I1204 12:12:54.365544 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operators"/"kube-root-ca.crt" Dec 04 12:12:54.402973 master-0 kubenswrapper[35367]: I1204 12:12:54.402901 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-668cf9dfbb-tllrd"] Dec 04 12:12:54.416517 master-0 kubenswrapper[35367]: I1204 12:12:54.416424 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l5m7\" (UniqueName: \"kubernetes.io/projected/a7eadd3e-77a5-47bc-9ea2-0e35dc665a94-kube-api-access-5l5m7\") pod \"obo-prometheus-operator-668cf9dfbb-tllrd\" (UID: \"a7eadd3e-77a5-47bc-9ea2-0e35dc665a94\") " pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-tllrd" Dec 04 12:12:54.518289 master-0 kubenswrapper[35367]: I1204 12:12:54.518177 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5l5m7\" (UniqueName: \"kubernetes.io/projected/a7eadd3e-77a5-47bc-9ea2-0e35dc665a94-kube-api-access-5l5m7\") pod \"obo-prometheus-operator-668cf9dfbb-tllrd\" (UID: \"a7eadd3e-77a5-47bc-9ea2-0e35dc665a94\") " pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-tllrd" Dec 04 12:12:54.531029 master-0 kubenswrapper[35367]: I1204 12:12:54.528300 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-ckdnn"] Dec 04 12:12:54.531029 master-0 kubenswrapper[35367]: I1204 12:12:54.529548 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-ckdnn" Dec 04 12:12:54.539920 master-0 kubenswrapper[35367]: I1204 12:12:54.537408 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operators"/"obo-prometheus-operator-admission-webhook-service-cert" Dec 04 12:12:54.597843 master-0 kubenswrapper[35367]: I1204 12:12:54.597440 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l5m7\" (UniqueName: \"kubernetes.io/projected/a7eadd3e-77a5-47bc-9ea2-0e35dc665a94-kube-api-access-5l5m7\") pod \"obo-prometheus-operator-668cf9dfbb-tllrd\" (UID: \"a7eadd3e-77a5-47bc-9ea2-0e35dc665a94\") " pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-tllrd" Dec 04 12:12:54.602829 master-0 kubenswrapper[35367]: I1204 12:12:54.600503 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-ckdnn"] Dec 04 12:12:54.617578 master-0 kubenswrapper[35367]: I1204 12:12:54.611833 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-jqkr2"] Dec 04 12:12:54.617578 master-0 kubenswrapper[35367]: I1204 12:12:54.613186 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-jqkr2" Dec 04 12:12:54.621082 master-0 kubenswrapper[35367]: I1204 12:12:54.620799 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f992933-87cb-4792-9a97-4716a126127a-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-74c6d8bb8-ckdnn\" (UID: \"4f992933-87cb-4792-9a97-4716a126127a\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-ckdnn" Dec 04 12:12:54.621082 master-0 kubenswrapper[35367]: I1204 12:12:54.621031 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4f992933-87cb-4792-9a97-4716a126127a-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-74c6d8bb8-ckdnn\" (UID: \"4f992933-87cb-4792-9a97-4716a126127a\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-ckdnn" Dec 04 12:12:54.650651 master-0 kubenswrapper[35367]: I1204 12:12:54.650279 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-jqkr2"] Dec 04 12:12:54.738833 master-0 kubenswrapper[35367]: I1204 12:12:54.731332 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-tllrd" Dec 04 12:12:54.738833 master-0 kubenswrapper[35367]: I1204 12:12:54.732235 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e19e0431-0bfc-4cd6-88f2-6134c4ba083c-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-74c6d8bb8-jqkr2\" (UID: \"e19e0431-0bfc-4cd6-88f2-6134c4ba083c\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-jqkr2" Dec 04 12:12:54.738833 master-0 kubenswrapper[35367]: I1204 12:12:54.732304 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e19e0431-0bfc-4cd6-88f2-6134c4ba083c-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-74c6d8bb8-jqkr2\" (UID: \"e19e0431-0bfc-4cd6-88f2-6134c4ba083c\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-jqkr2" Dec 04 12:12:54.738833 master-0 kubenswrapper[35367]: I1204 12:12:54.732354 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4f992933-87cb-4792-9a97-4716a126127a-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-74c6d8bb8-ckdnn\" (UID: \"4f992933-87cb-4792-9a97-4716a126127a\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-ckdnn" Dec 04 12:12:54.738833 master-0 kubenswrapper[35367]: I1204 12:12:54.732398 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f992933-87cb-4792-9a97-4716a126127a-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-74c6d8bb8-ckdnn\" (UID: \"4f992933-87cb-4792-9a97-4716a126127a\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-ckdnn" Dec 04 12:12:54.738833 master-0 kubenswrapper[35367]: I1204 12:12:54.736162 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f992933-87cb-4792-9a97-4716a126127a-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-74c6d8bb8-ckdnn\" (UID: \"4f992933-87cb-4792-9a97-4716a126127a\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-ckdnn" Dec 04 12:12:54.746873 master-0 kubenswrapper[35367]: I1204 12:12:54.746827 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4f992933-87cb-4792-9a97-4716a126127a-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-74c6d8bb8-ckdnn\" (UID: \"4f992933-87cb-4792-9a97-4716a126127a\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-ckdnn" Dec 04 12:12:54.845693 master-0 kubenswrapper[35367]: I1204 12:12:54.835542 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e19e0431-0bfc-4cd6-88f2-6134c4ba083c-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-74c6d8bb8-jqkr2\" (UID: \"e19e0431-0bfc-4cd6-88f2-6134c4ba083c\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-jqkr2" Dec 04 12:12:54.845693 master-0 kubenswrapper[35367]: I1204 12:12:54.835618 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e19e0431-0bfc-4cd6-88f2-6134c4ba083c-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-74c6d8bb8-jqkr2\" (UID: \"e19e0431-0bfc-4cd6-88f2-6134c4ba083c\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-jqkr2" Dec 04 12:12:54.845693 master-0 kubenswrapper[35367]: I1204 12:12:54.840774 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e19e0431-0bfc-4cd6-88f2-6134c4ba083c-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-74c6d8bb8-jqkr2\" (UID: \"e19e0431-0bfc-4cd6-88f2-6134c4ba083c\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-jqkr2" Dec 04 12:12:54.845693 master-0 kubenswrapper[35367]: I1204 12:12:54.841031 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e19e0431-0bfc-4cd6-88f2-6134c4ba083c-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-74c6d8bb8-jqkr2\" (UID: \"e19e0431-0bfc-4cd6-88f2-6134c4ba083c\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-jqkr2" Dec 04 12:12:54.845693 master-0 kubenswrapper[35367]: I1204 12:12:54.845179 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operators/observability-operator-d8bb48f5d-wc4bd"] Dec 04 12:12:54.852241 master-0 kubenswrapper[35367]: I1204 12:12:54.847847 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/observability-operator-d8bb48f5d-wc4bd" Dec 04 12:12:54.853259 master-0 kubenswrapper[35367]: I1204 12:12:54.853215 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operators"/"observability-operator-tls" Dec 04 12:12:54.860624 master-0 kubenswrapper[35367]: I1204 12:12:54.860553 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-ckdnn" Dec 04 12:12:54.893024 master-0 kubenswrapper[35367]: I1204 12:12:54.889641 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/observability-operator-d8bb48f5d-wc4bd"] Dec 04 12:12:54.946730 master-0 kubenswrapper[35367]: I1204 12:12:54.939342 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"observability-operator-tls\" (UniqueName: \"kubernetes.io/secret/51333f41-5d03-4876-b2c8-b85051c901ca-observability-operator-tls\") pod \"observability-operator-d8bb48f5d-wc4bd\" (UID: \"51333f41-5d03-4876-b2c8-b85051c901ca\") " pod="openshift-operators/observability-operator-d8bb48f5d-wc4bd" Dec 04 12:12:54.946730 master-0 kubenswrapper[35367]: I1204 12:12:54.939427 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8l6l\" (UniqueName: \"kubernetes.io/projected/51333f41-5d03-4876-b2c8-b85051c901ca-kube-api-access-m8l6l\") pod \"observability-operator-d8bb48f5d-wc4bd\" (UID: \"51333f41-5d03-4876-b2c8-b85051c901ca\") " pod="openshift-operators/observability-operator-d8bb48f5d-wc4bd" Dec 04 12:12:54.967882 master-0 kubenswrapper[35367]: I1204 12:12:54.964180 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-jqkr2" Dec 04 12:12:54.989831 master-0 kubenswrapper[35367]: I1204 12:12:54.985047 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operators/perses-operator-5446b9c989-mcgjr"] Dec 04 12:12:54.989831 master-0 kubenswrapper[35367]: I1204 12:12:54.986402 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/perses-operator-5446b9c989-mcgjr" Dec 04 12:12:55.059950 master-0 kubenswrapper[35367]: I1204 12:12:55.059706 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"observability-operator-tls\" (UniqueName: \"kubernetes.io/secret/51333f41-5d03-4876-b2c8-b85051c901ca-observability-operator-tls\") pod \"observability-operator-d8bb48f5d-wc4bd\" (UID: \"51333f41-5d03-4876-b2c8-b85051c901ca\") " pod="openshift-operators/observability-operator-d8bb48f5d-wc4bd" Dec 04 12:12:55.059950 master-0 kubenswrapper[35367]: I1204 12:12:55.059785 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m8l6l\" (UniqueName: \"kubernetes.io/projected/51333f41-5d03-4876-b2c8-b85051c901ca-kube-api-access-m8l6l\") pod \"observability-operator-d8bb48f5d-wc4bd\" (UID: \"51333f41-5d03-4876-b2c8-b85051c901ca\") " pod="openshift-operators/observability-operator-d8bb48f5d-wc4bd" Dec 04 12:12:55.059950 master-0 kubenswrapper[35367]: I1204 12:12:55.059880 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5906d5c-316e-4cce-bbfa-53c92aca7420-openshift-service-ca\") pod \"perses-operator-5446b9c989-mcgjr\" (UID: \"c5906d5c-316e-4cce-bbfa-53c92aca7420\") " pod="openshift-operators/perses-operator-5446b9c989-mcgjr" Dec 04 12:12:55.059950 master-0 kubenswrapper[35367]: I1204 12:12:55.059932 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfmdt\" (UniqueName: \"kubernetes.io/projected/c5906d5c-316e-4cce-bbfa-53c92aca7420-kube-api-access-xfmdt\") pod \"perses-operator-5446b9c989-mcgjr\" (UID: \"c5906d5c-316e-4cce-bbfa-53c92aca7420\") " pod="openshift-operators/perses-operator-5446b9c989-mcgjr" Dec 04 12:12:55.069163 master-0 kubenswrapper[35367]: I1204 12:12:55.069111 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"observability-operator-tls\" (UniqueName: \"kubernetes.io/secret/51333f41-5d03-4876-b2c8-b85051c901ca-observability-operator-tls\") pod \"observability-operator-d8bb48f5d-wc4bd\" (UID: \"51333f41-5d03-4876-b2c8-b85051c901ca\") " pod="openshift-operators/observability-operator-d8bb48f5d-wc4bd" Dec 04 12:12:55.142857 master-0 kubenswrapper[35367]: I1204 12:12:55.141496 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8l6l\" (UniqueName: \"kubernetes.io/projected/51333f41-5d03-4876-b2c8-b85051c901ca-kube-api-access-m8l6l\") pod \"observability-operator-d8bb48f5d-wc4bd\" (UID: \"51333f41-5d03-4876-b2c8-b85051c901ca\") " pod="openshift-operators/observability-operator-d8bb48f5d-wc4bd" Dec 04 12:12:55.155519 master-0 kubenswrapper[35367]: I1204 12:12:55.148448 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/perses-operator-5446b9c989-mcgjr"] Dec 04 12:12:55.162824 master-0 kubenswrapper[35367]: I1204 12:12:55.162681 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5906d5c-316e-4cce-bbfa-53c92aca7420-openshift-service-ca\") pod \"perses-operator-5446b9c989-mcgjr\" (UID: \"c5906d5c-316e-4cce-bbfa-53c92aca7420\") " pod="openshift-operators/perses-operator-5446b9c989-mcgjr" Dec 04 12:12:55.163047 master-0 kubenswrapper[35367]: I1204 12:12:55.162858 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xfmdt\" (UniqueName: \"kubernetes.io/projected/c5906d5c-316e-4cce-bbfa-53c92aca7420-kube-api-access-xfmdt\") pod \"perses-operator-5446b9c989-mcgjr\" (UID: \"c5906d5c-316e-4cce-bbfa-53c92aca7420\") " pod="openshift-operators/perses-operator-5446b9c989-mcgjr" Dec 04 12:12:55.168509 master-0 kubenswrapper[35367]: I1204 12:12:55.168441 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5906d5c-316e-4cce-bbfa-53c92aca7420-openshift-service-ca\") pod \"perses-operator-5446b9c989-mcgjr\" (UID: \"c5906d5c-316e-4cce-bbfa-53c92aca7420\") " pod="openshift-operators/perses-operator-5446b9c989-mcgjr" Dec 04 12:12:55.207587 master-0 kubenswrapper[35367]: I1204 12:12:55.207521 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfmdt\" (UniqueName: \"kubernetes.io/projected/c5906d5c-316e-4cce-bbfa-53c92aca7420-kube-api-access-xfmdt\") pod \"perses-operator-5446b9c989-mcgjr\" (UID: \"c5906d5c-316e-4cce-bbfa-53c92aca7420\") " pod="openshift-operators/perses-operator-5446b9c989-mcgjr" Dec 04 12:12:55.236656 master-0 kubenswrapper[35367]: I1204 12:12:55.230647 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/observability-operator-d8bb48f5d-wc4bd" Dec 04 12:12:55.374771 master-0 kubenswrapper[35367]: I1204 12:12:55.373904 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/perses-operator-5446b9c989-mcgjr" Dec 04 12:12:55.588438 master-0 kubenswrapper[35367]: I1204 12:12:55.588364 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-668cf9dfbb-tllrd"] Dec 04 12:12:55.594709 master-0 kubenswrapper[35367]: I1204 12:12:55.594631 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-ckdnn"] Dec 04 12:12:55.696877 master-0 kubenswrapper[35367]: I1204 12:12:55.696826 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-jqkr2"] Dec 04 12:12:55.706267 master-0 kubenswrapper[35367]: I1204 12:12:55.704325 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/perses-operator-5446b9c989-mcgjr"] Dec 04 12:12:55.748953 master-0 kubenswrapper[35367]: I1204 12:12:55.748904 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/observability-operator-d8bb48f5d-wc4bd"] Dec 04 12:12:55.771657 master-0 kubenswrapper[35367]: I1204 12:12:55.771598 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/perses-operator-5446b9c989-mcgjr" event={"ID":"c5906d5c-316e-4cce-bbfa-53c92aca7420","Type":"ContainerStarted","Data":"3842a1e4e8ea72450f16f91be7eadedf0f2fdb9c4a776b6e968acdb6a28260c8"} Dec 04 12:12:55.773335 master-0 kubenswrapper[35367]: I1204 12:12:55.773273 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-jqkr2" event={"ID":"e19e0431-0bfc-4cd6-88f2-6134c4ba083c","Type":"ContainerStarted","Data":"bf7498f5aace81a5c066b21b7a4c05ec4f1d2ca7a4d24ea25f0c905301a061fe"} Dec 04 12:12:55.774559 master-0 kubenswrapper[35367]: I1204 12:12:55.774529 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-tllrd" event={"ID":"a7eadd3e-77a5-47bc-9ea2-0e35dc665a94","Type":"ContainerStarted","Data":"506ef74144a3202d2ac5069a82f9cc642667b3b21958ea3526953c77c95e5bac"} Dec 04 12:12:55.775774 master-0 kubenswrapper[35367]: I1204 12:12:55.775726 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/observability-operator-d8bb48f5d-wc4bd" event={"ID":"51333f41-5d03-4876-b2c8-b85051c901ca","Type":"ContainerStarted","Data":"69e3c7d7c6409923ffa719d95620ed0693a21a2ed6390e371af749277847c00c"} Dec 04 12:12:55.776942 master-0 kubenswrapper[35367]: I1204 12:12:55.776908 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-ckdnn" event={"ID":"4f992933-87cb-4792-9a97-4716a126127a","Type":"ContainerStarted","Data":"47b3cc48a6102d83076c503aaa226a7f461baeff66df81c86f0d27765d93fe5b"} Dec 04 12:13:06.904207 master-0 kubenswrapper[35367]: I1204 12:13:06.904151 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-jqkr2" event={"ID":"e19e0431-0bfc-4cd6-88f2-6134c4ba083c","Type":"ContainerStarted","Data":"10921e9af559c878eda57645e3443f2e12037dd305edfcaa8c0c179e2607503e"} Dec 04 12:13:06.923580 master-0 kubenswrapper[35367]: I1204 12:13:06.923484 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-tllrd" event={"ID":"a7eadd3e-77a5-47bc-9ea2-0e35dc665a94","Type":"ContainerStarted","Data":"eaf32aba61aaef548ecbd81b6d2a04ce0d1b62125069497f347491a2cbff9cc0"} Dec 04 12:13:06.947930 master-0 kubenswrapper[35367]: I1204 12:13:06.946083 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/observability-operator-d8bb48f5d-wc4bd" event={"ID":"51333f41-5d03-4876-b2c8-b85051c901ca","Type":"ContainerStarted","Data":"e644b1fd5be2a148a04823eb514130fb5507ec019015e1b8d189946355854d67"} Dec 04 12:13:06.947930 master-0 kubenswrapper[35367]: I1204 12:13:06.947541 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operators/observability-operator-d8bb48f5d-wc4bd" Dec 04 12:13:06.957444 master-0 kubenswrapper[35367]: I1204 12:13:06.957361 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-ckdnn" event={"ID":"4f992933-87cb-4792-9a97-4716a126127a","Type":"ContainerStarted","Data":"e7fa04506cee5a23af520a8ebc9be66d731b4855ea8e9345f5bdfb532a255a42"} Dec 04 12:13:06.962920 master-0 kubenswrapper[35367]: I1204 12:13:06.961775 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/observability-operator-d8bb48f5d-wc4bd" Dec 04 12:13:06.972531 master-0 kubenswrapper[35367]: I1204 12:13:06.972442 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/perses-operator-5446b9c989-mcgjr" event={"ID":"c5906d5c-316e-4cce-bbfa-53c92aca7420","Type":"ContainerStarted","Data":"4a98aeafc1c4f519da488689038281b560ca6afadc27714fedfd72fc0a11c7b3"} Dec 04 12:13:06.973074 master-0 kubenswrapper[35367]: I1204 12:13:06.973030 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operators/perses-operator-5446b9c989-mcgjr" Dec 04 12:13:07.039841 master-0 kubenswrapper[35367]: I1204 12:13:07.038955 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/observability-operator-d8bb48f5d-wc4bd" podStartSLOduration=2.37964868 podStartE2EDuration="13.038932348s" podCreationTimestamp="2025-12-04 12:12:54 +0000 UTC" firstStartedPulling="2025-12-04 12:12:55.749644123 +0000 UTC m=+819.187705381" lastFinishedPulling="2025-12-04 12:13:06.408927791 +0000 UTC m=+829.846989049" observedRunningTime="2025-12-04 12:13:07.018549495 +0000 UTC m=+830.456610753" watchObservedRunningTime="2025-12-04 12:13:07.038932348 +0000 UTC m=+830.476993616" Dec 04 12:13:07.059830 master-0 kubenswrapper[35367]: I1204 12:13:07.057353 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-jqkr2" podStartSLOduration=2.496156816 podStartE2EDuration="13.057323868s" podCreationTimestamp="2025-12-04 12:12:54 +0000 UTC" firstStartedPulling="2025-12-04 12:12:55.701968799 +0000 UTC m=+819.140030057" lastFinishedPulling="2025-12-04 12:13:06.263135841 +0000 UTC m=+829.701197109" observedRunningTime="2025-12-04 12:13:06.961155924 +0000 UTC m=+830.399217182" watchObservedRunningTime="2025-12-04 12:13:07.057323868 +0000 UTC m=+830.495385136" Dec 04 12:13:07.107832 master-0 kubenswrapper[35367]: I1204 12:13:07.104913 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/obo-prometheus-operator-admission-webhook-74c6d8bb8-ckdnn" podStartSLOduration=2.495751002 podStartE2EDuration="13.104888318s" podCreationTimestamp="2025-12-04 12:12:54 +0000 UTC" firstStartedPulling="2025-12-04 12:12:55.654254443 +0000 UTC m=+819.092315701" lastFinishedPulling="2025-12-04 12:13:06.263391759 +0000 UTC m=+829.701453017" observedRunningTime="2025-12-04 12:13:07.078659512 +0000 UTC m=+830.516720760" watchObservedRunningTime="2025-12-04 12:13:07.104888318 +0000 UTC m=+830.542949587" Dec 04 12:13:07.140345 master-0 kubenswrapper[35367]: I1204 12:13:07.140184 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/perses-operator-5446b9c989-mcgjr" podStartSLOduration=2.605385021 podStartE2EDuration="13.140161912s" podCreationTimestamp="2025-12-04 12:12:54 +0000 UTC" firstStartedPulling="2025-12-04 12:12:55.732830922 +0000 UTC m=+819.170892170" lastFinishedPulling="2025-12-04 12:13:06.267607803 +0000 UTC m=+829.705669061" observedRunningTime="2025-12-04 12:13:07.13886038 +0000 UTC m=+830.576921648" watchObservedRunningTime="2025-12-04 12:13:07.140161912 +0000 UTC m=+830.578223170" Dec 04 12:13:07.768050 master-0 kubenswrapper[35367]: I1204 12:13:07.768008 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/metallb-operator-webhook-server-567cbcbb98-h2n4q" Dec 04 12:13:08.019914 master-0 kubenswrapper[35367]: I1204 12:13:08.019200 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-tllrd" podStartSLOduration=3.301917308 podStartE2EDuration="14.019177236s" podCreationTimestamp="2025-12-04 12:12:54 +0000 UTC" firstStartedPulling="2025-12-04 12:12:55.652759535 +0000 UTC m=+819.090820793" lastFinishedPulling="2025-12-04 12:13:06.370019463 +0000 UTC m=+829.808080721" observedRunningTime="2025-12-04 12:13:08.015296683 +0000 UTC m=+831.453357951" watchObservedRunningTime="2025-12-04 12:13:08.019177236 +0000 UTC m=+831.457238494" Dec 04 12:13:15.377299 master-0 kubenswrapper[35367]: I1204 12:13:15.377217 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/perses-operator-5446b9c989-mcgjr" Dec 04 12:13:21.609018 master-0 kubenswrapper[35367]: I1204 12:13:21.608943 35367 scope.go:117] "RemoveContainer" containerID="7f675575cba3c965d1f9b34083dc70d57869771c4340830fd96ff7e46be44567" Dec 04 12:13:21.627239 master-0 kubenswrapper[35367]: I1204 12:13:21.627169 35367 scope.go:117] "RemoveContainer" containerID="87cce827effecd0ad9bf56376fa0e0297a57ac12320d9c37847065d59e9f1dcb" Dec 04 12:13:21.646361 master-0 kubenswrapper[35367]: I1204 12:13:21.646307 35367 scope.go:117] "RemoveContainer" containerID="ae936500a2ecbcb16991b68e1fb2a6d81ea108368e7c98a8d24a4e0249d4b678" Dec 04 12:13:26.274198 master-0 kubenswrapper[35367]: I1204 12:13:26.274068 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" Dec 04 12:13:32.790663 master-0 kubenswrapper[35367]: I1204 12:13:32.790599 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/frr-k8s-webhook-server-7fcb986d4-hfnqb"] Dec 04 12:13:32.791786 master-0 kubenswrapper[35367]: I1204 12:13:32.791750 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/frr-k8s-ckzx9"] Dec 04 12:13:32.792343 master-0 kubenswrapper[35367]: I1204 12:13:32.792240 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-hfnqb" Dec 04 12:13:32.796341 master-0 kubenswrapper[35367]: I1204 12:13:32.796205 35367 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"frr-k8s-webhook-server-cert" Dec 04 12:13:32.802384 master-0 kubenswrapper[35367]: I1204 12:13:32.802090 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/frr-k8s-webhook-server-7fcb986d4-hfnqb"] Dec 04 12:13:32.802384 master-0 kubenswrapper[35367]: I1204 12:13:32.802273 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:32.805576 master-0 kubenswrapper[35367]: I1204 12:13:32.805446 35367 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"frr-k8s-certs-secret" Dec 04 12:13:32.806940 master-0 kubenswrapper[35367]: I1204 12:13:32.806884 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"metallb-system"/"frr-startup" Dec 04 12:13:32.877410 master-0 kubenswrapper[35367]: I1204 12:13:32.877311 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"reloader\" (UniqueName: \"kubernetes.io/empty-dir/4e0c1dd6-ebe9-4ba0-b204-7ebde784706d-reloader\") pod \"frr-k8s-ckzx9\" (UID: \"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d\") " pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:32.877978 master-0 kubenswrapper[35367]: I1204 12:13:32.877918 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/077af73f-4190-4c72-b167-9cc36f6482df-cert\") pod \"frr-k8s-webhook-server-7fcb986d4-hfnqb\" (UID: \"077af73f-4190-4c72-b167-9cc36f6482df\") " pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-hfnqb" Dec 04 12:13:32.878126 master-0 kubenswrapper[35367]: I1204 12:13:32.878092 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"frr-startup\" (UniqueName: \"kubernetes.io/configmap/4e0c1dd6-ebe9-4ba0-b204-7ebde784706d-frr-startup\") pod \"frr-k8s-ckzx9\" (UID: \"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d\") " pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:32.878195 master-0 kubenswrapper[35367]: I1204 12:13:32.878130 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6tmr\" (UniqueName: \"kubernetes.io/projected/4e0c1dd6-ebe9-4ba0-b204-7ebde784706d-kube-api-access-p6tmr\") pod \"frr-k8s-ckzx9\" (UID: \"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d\") " pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:32.878195 master-0 kubenswrapper[35367]: I1204 12:13:32.878175 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"frr-conf\" (UniqueName: \"kubernetes.io/empty-dir/4e0c1dd6-ebe9-4ba0-b204-7ebde784706d-frr-conf\") pod \"frr-k8s-ckzx9\" (UID: \"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d\") " pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:32.879141 master-0 kubenswrapper[35367]: I1204 12:13:32.878406 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e0c1dd6-ebe9-4ba0-b204-7ebde784706d-metrics-certs\") pod \"frr-k8s-ckzx9\" (UID: \"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d\") " pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:32.879220 master-0 kubenswrapper[35367]: I1204 12:13:32.879182 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-684xh\" (UniqueName: \"kubernetes.io/projected/077af73f-4190-4c72-b167-9cc36f6482df-kube-api-access-684xh\") pod \"frr-k8s-webhook-server-7fcb986d4-hfnqb\" (UID: \"077af73f-4190-4c72-b167-9cc36f6482df\") " pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-hfnqb" Dec 04 12:13:32.879262 master-0 kubenswrapper[35367]: I1204 12:13:32.879254 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"frr-sockets\" (UniqueName: \"kubernetes.io/empty-dir/4e0c1dd6-ebe9-4ba0-b204-7ebde784706d-frr-sockets\") pod \"frr-k8s-ckzx9\" (UID: \"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d\") " pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:32.879755 master-0 kubenswrapper[35367]: I1204 12:13:32.879687 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/empty-dir/4e0c1dd6-ebe9-4ba0-b204-7ebde784706d-metrics\") pod \"frr-k8s-ckzx9\" (UID: \"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d\") " pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:32.981855 master-0 kubenswrapper[35367]: I1204 12:13:32.981769 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"reloader\" (UniqueName: \"kubernetes.io/empty-dir/4e0c1dd6-ebe9-4ba0-b204-7ebde784706d-reloader\") pod \"frr-k8s-ckzx9\" (UID: \"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d\") " pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:32.982220 master-0 kubenswrapper[35367]: I1204 12:13:32.982135 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/077af73f-4190-4c72-b167-9cc36f6482df-cert\") pod \"frr-k8s-webhook-server-7fcb986d4-hfnqb\" (UID: \"077af73f-4190-4c72-b167-9cc36f6482df\") " pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-hfnqb" Dec 04 12:13:32.982279 master-0 kubenswrapper[35367]: I1204 12:13:32.982259 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"frr-startup\" (UniqueName: \"kubernetes.io/configmap/4e0c1dd6-ebe9-4ba0-b204-7ebde784706d-frr-startup\") pod \"frr-k8s-ckzx9\" (UID: \"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d\") " pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:32.982326 master-0 kubenswrapper[35367]: I1204 12:13:32.982294 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p6tmr\" (UniqueName: \"kubernetes.io/projected/4e0c1dd6-ebe9-4ba0-b204-7ebde784706d-kube-api-access-p6tmr\") pod \"frr-k8s-ckzx9\" (UID: \"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d\") " pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:32.982370 master-0 kubenswrapper[35367]: E1204 12:13:32.982317 35367 secret.go:189] Couldn't get secret metallb-system/frr-k8s-webhook-server-cert: secret "frr-k8s-webhook-server-cert" not found Dec 04 12:13:32.982370 master-0 kubenswrapper[35367]: I1204 12:13:32.982339 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"frr-conf\" (UniqueName: \"kubernetes.io/empty-dir/4e0c1dd6-ebe9-4ba0-b204-7ebde784706d-frr-conf\") pod \"frr-k8s-ckzx9\" (UID: \"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d\") " pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:32.982455 master-0 kubenswrapper[35367]: E1204 12:13:32.982401 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/077af73f-4190-4c72-b167-9cc36f6482df-cert podName:077af73f-4190-4c72-b167-9cc36f6482df nodeName:}" failed. No retries permitted until 2025-12-04 12:13:33.482377861 +0000 UTC m=+856.920439129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/077af73f-4190-4c72-b167-9cc36f6482df-cert") pod "frr-k8s-webhook-server-7fcb986d4-hfnqb" (UID: "077af73f-4190-4c72-b167-9cc36f6482df") : secret "frr-k8s-webhook-server-cert" not found Dec 04 12:13:32.982455 master-0 kubenswrapper[35367]: I1204 12:13:32.982428 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e0c1dd6-ebe9-4ba0-b204-7ebde784706d-metrics-certs\") pod \"frr-k8s-ckzx9\" (UID: \"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d\") " pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:32.982455 master-0 kubenswrapper[35367]: I1204 12:13:32.982426 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"reloader\" (UniqueName: \"kubernetes.io/empty-dir/4e0c1dd6-ebe9-4ba0-b204-7ebde784706d-reloader\") pod \"frr-k8s-ckzx9\" (UID: \"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d\") " pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:32.982591 master-0 kubenswrapper[35367]: I1204 12:13:32.982466 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-684xh\" (UniqueName: \"kubernetes.io/projected/077af73f-4190-4c72-b167-9cc36f6482df-kube-api-access-684xh\") pod \"frr-k8s-webhook-server-7fcb986d4-hfnqb\" (UID: \"077af73f-4190-4c72-b167-9cc36f6482df\") " pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-hfnqb" Dec 04 12:13:32.982591 master-0 kubenswrapper[35367]: I1204 12:13:32.982549 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"frr-sockets\" (UniqueName: \"kubernetes.io/empty-dir/4e0c1dd6-ebe9-4ba0-b204-7ebde784706d-frr-sockets\") pod \"frr-k8s-ckzx9\" (UID: \"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d\") " pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:32.982678 master-0 kubenswrapper[35367]: I1204 12:13:32.982644 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/empty-dir/4e0c1dd6-ebe9-4ba0-b204-7ebde784706d-metrics\") pod \"frr-k8s-ckzx9\" (UID: \"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d\") " pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:32.982895 master-0 kubenswrapper[35367]: I1204 12:13:32.982860 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"frr-conf\" (UniqueName: \"kubernetes.io/empty-dir/4e0c1dd6-ebe9-4ba0-b204-7ebde784706d-frr-conf\") pod \"frr-k8s-ckzx9\" (UID: \"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d\") " pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:32.983204 master-0 kubenswrapper[35367]: I1204 12:13:32.983168 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics\" (UniqueName: \"kubernetes.io/empty-dir/4e0c1dd6-ebe9-4ba0-b204-7ebde784706d-metrics\") pod \"frr-k8s-ckzx9\" (UID: \"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d\") " pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:32.983267 master-0 kubenswrapper[35367]: I1204 12:13:32.983232 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"frr-sockets\" (UniqueName: \"kubernetes.io/empty-dir/4e0c1dd6-ebe9-4ba0-b204-7ebde784706d-frr-sockets\") pod \"frr-k8s-ckzx9\" (UID: \"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d\") " pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:32.986303 master-0 kubenswrapper[35367]: I1204 12:13:32.986187 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"frr-startup\" (UniqueName: \"kubernetes.io/configmap/4e0c1dd6-ebe9-4ba0-b204-7ebde784706d-frr-startup\") pod \"frr-k8s-ckzx9\" (UID: \"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d\") " pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:32.988491 master-0 kubenswrapper[35367]: I1204 12:13:32.988423 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e0c1dd6-ebe9-4ba0-b204-7ebde784706d-metrics-certs\") pod \"frr-k8s-ckzx9\" (UID: \"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d\") " pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:33.124740 master-0 kubenswrapper[35367]: I1204 12:13:33.124666 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-684xh\" (UniqueName: \"kubernetes.io/projected/077af73f-4190-4c72-b167-9cc36f6482df-kube-api-access-684xh\") pod \"frr-k8s-webhook-server-7fcb986d4-hfnqb\" (UID: \"077af73f-4190-4c72-b167-9cc36f6482df\") " pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-hfnqb" Dec 04 12:13:33.128707 master-0 kubenswrapper[35367]: I1204 12:13:33.128651 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6tmr\" (UniqueName: \"kubernetes.io/projected/4e0c1dd6-ebe9-4ba0-b204-7ebde784706d-kube-api-access-p6tmr\") pod \"frr-k8s-ckzx9\" (UID: \"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d\") " pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:33.133211 master-0 kubenswrapper[35367]: I1204 12:13:33.133132 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:33.302977 master-0 kubenswrapper[35367]: I1204 12:13:33.301659 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/speaker-868rl"] Dec 04 12:13:33.303722 master-0 kubenswrapper[35367]: I1204 12:13:33.303688 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/speaker-868rl" Dec 04 12:13:33.308195 master-0 kubenswrapper[35367]: I1204 12:13:33.306959 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"metallb-system"/"metallb-excludel2" Dec 04 12:13:33.308195 master-0 kubenswrapper[35367]: I1204 12:13:33.307275 35367 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-memberlist" Dec 04 12:13:33.308195 master-0 kubenswrapper[35367]: I1204 12:13:33.307410 35367 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"speaker-certs-secret" Dec 04 12:13:33.317777 master-0 kubenswrapper[35367]: I1204 12:13:33.317520 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/controller-f8648f98b-v2fsc"] Dec 04 12:13:33.319775 master-0 kubenswrapper[35367]: I1204 12:13:33.319728 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/controller-f8648f98b-v2fsc" Dec 04 12:13:33.330011 master-0 kubenswrapper[35367]: I1204 12:13:33.329951 35367 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"controller-certs-secret" Dec 04 12:13:33.330270 master-0 kubenswrapper[35367]: I1204 12:13:33.330170 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/controller-f8648f98b-v2fsc"] Dec 04 12:13:33.400929 master-0 kubenswrapper[35367]: I1204 12:13:33.399680 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw72g\" (UniqueName: \"kubernetes.io/projected/197979ad-247d-457f-9529-63bcb6ce15c0-kube-api-access-rw72g\") pod \"controller-f8648f98b-v2fsc\" (UID: \"197979ad-247d-457f-9529-63bcb6ce15c0\") " pod="metallb-system/controller-f8648f98b-v2fsc" Dec 04 12:13:33.400929 master-0 kubenswrapper[35367]: I1204 12:13:33.399788 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/197979ad-247d-457f-9529-63bcb6ce15c0-metrics-certs\") pod \"controller-f8648f98b-v2fsc\" (UID: \"197979ad-247d-457f-9529-63bcb6ce15c0\") " pod="metallb-system/controller-f8648f98b-v2fsc" Dec 04 12:13:33.400929 master-0 kubenswrapper[35367]: I1204 12:13:33.399865 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bh67\" (UniqueName: \"kubernetes.io/projected/e044043e-2b10-4c93-89bb-2610a5793e69-kube-api-access-6bh67\") pod \"speaker-868rl\" (UID: \"e044043e-2b10-4c93-89bb-2610a5793e69\") " pod="metallb-system/speaker-868rl" Dec 04 12:13:33.400929 master-0 kubenswrapper[35367]: I1204 12:13:33.399904 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metallb-excludel2\" (UniqueName: \"kubernetes.io/configmap/e044043e-2b10-4c93-89bb-2610a5793e69-metallb-excludel2\") pod \"speaker-868rl\" (UID: \"e044043e-2b10-4c93-89bb-2610a5793e69\") " pod="metallb-system/speaker-868rl" Dec 04 12:13:33.400929 master-0 kubenswrapper[35367]: I1204 12:13:33.399953 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/e044043e-2b10-4c93-89bb-2610a5793e69-memberlist\") pod \"speaker-868rl\" (UID: \"e044043e-2b10-4c93-89bb-2610a5793e69\") " pod="metallb-system/speaker-868rl" Dec 04 12:13:33.400929 master-0 kubenswrapper[35367]: I1204 12:13:33.399972 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/197979ad-247d-457f-9529-63bcb6ce15c0-cert\") pod \"controller-f8648f98b-v2fsc\" (UID: \"197979ad-247d-457f-9529-63bcb6ce15c0\") " pod="metallb-system/controller-f8648f98b-v2fsc" Dec 04 12:13:33.400929 master-0 kubenswrapper[35367]: I1204 12:13:33.399995 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e044043e-2b10-4c93-89bb-2610a5793e69-metrics-certs\") pod \"speaker-868rl\" (UID: \"e044043e-2b10-4c93-89bb-2610a5793e69\") " pod="metallb-system/speaker-868rl" Dec 04 12:13:33.501918 master-0 kubenswrapper[35367]: I1204 12:13:33.501844 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/e044043e-2b10-4c93-89bb-2610a5793e69-memberlist\") pod \"speaker-868rl\" (UID: \"e044043e-2b10-4c93-89bb-2610a5793e69\") " pod="metallb-system/speaker-868rl" Dec 04 12:13:33.501918 master-0 kubenswrapper[35367]: I1204 12:13:33.501910 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/197979ad-247d-457f-9529-63bcb6ce15c0-cert\") pod \"controller-f8648f98b-v2fsc\" (UID: \"197979ad-247d-457f-9529-63bcb6ce15c0\") " pod="metallb-system/controller-f8648f98b-v2fsc" Dec 04 12:13:33.502227 master-0 kubenswrapper[35367]: E1204 12:13:33.502086 35367 secret.go:189] Couldn't get secret metallb-system/metallb-memberlist: secret "metallb-memberlist" not found Dec 04 12:13:33.502227 master-0 kubenswrapper[35367]: I1204 12:13:33.502127 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e044043e-2b10-4c93-89bb-2610a5793e69-metrics-certs\") pod \"speaker-868rl\" (UID: \"e044043e-2b10-4c93-89bb-2610a5793e69\") " pod="metallb-system/speaker-868rl" Dec 04 12:13:33.502227 master-0 kubenswrapper[35367]: E1204 12:13:33.502195 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e044043e-2b10-4c93-89bb-2610a5793e69-memberlist podName:e044043e-2b10-4c93-89bb-2610a5793e69 nodeName:}" failed. No retries permitted until 2025-12-04 12:13:34.00216686 +0000 UTC m=+857.440228108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "memberlist" (UniqueName: "kubernetes.io/secret/e044043e-2b10-4c93-89bb-2610a5793e69-memberlist") pod "speaker-868rl" (UID: "e044043e-2b10-4c93-89bb-2610a5793e69") : secret "metallb-memberlist" not found Dec 04 12:13:33.502344 master-0 kubenswrapper[35367]: I1204 12:13:33.502289 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rw72g\" (UniqueName: \"kubernetes.io/projected/197979ad-247d-457f-9529-63bcb6ce15c0-kube-api-access-rw72g\") pod \"controller-f8648f98b-v2fsc\" (UID: \"197979ad-247d-457f-9529-63bcb6ce15c0\") " pod="metallb-system/controller-f8648f98b-v2fsc" Dec 04 12:13:33.502396 master-0 kubenswrapper[35367]: I1204 12:13:33.502363 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/077af73f-4190-4c72-b167-9cc36f6482df-cert\") pod \"frr-k8s-webhook-server-7fcb986d4-hfnqb\" (UID: \"077af73f-4190-4c72-b167-9cc36f6482df\") " pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-hfnqb" Dec 04 12:13:33.502448 master-0 kubenswrapper[35367]: I1204 12:13:33.502427 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/197979ad-247d-457f-9529-63bcb6ce15c0-metrics-certs\") pod \"controller-f8648f98b-v2fsc\" (UID: \"197979ad-247d-457f-9529-63bcb6ce15c0\") " pod="metallb-system/controller-f8648f98b-v2fsc" Dec 04 12:13:33.502548 master-0 kubenswrapper[35367]: I1204 12:13:33.502519 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6bh67\" (UniqueName: \"kubernetes.io/projected/e044043e-2b10-4c93-89bb-2610a5793e69-kube-api-access-6bh67\") pod \"speaker-868rl\" (UID: \"e044043e-2b10-4c93-89bb-2610a5793e69\") " pod="metallb-system/speaker-868rl" Dec 04 12:13:33.502606 master-0 kubenswrapper[35367]: I1204 12:13:33.502563 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metallb-excludel2\" (UniqueName: \"kubernetes.io/configmap/e044043e-2b10-4c93-89bb-2610a5793e69-metallb-excludel2\") pod \"speaker-868rl\" (UID: \"e044043e-2b10-4c93-89bb-2610a5793e69\") " pod="metallb-system/speaker-868rl" Dec 04 12:13:33.503515 master-0 kubenswrapper[35367]: I1204 12:13:33.503484 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metallb-excludel2\" (UniqueName: \"kubernetes.io/configmap/e044043e-2b10-4c93-89bb-2610a5793e69-metallb-excludel2\") pod \"speaker-868rl\" (UID: \"e044043e-2b10-4c93-89bb-2610a5793e69\") " pod="metallb-system/speaker-868rl" Dec 04 12:13:33.505520 master-0 kubenswrapper[35367]: I1204 12:13:33.505485 35367 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-webhook-cert" Dec 04 12:13:33.506231 master-0 kubenswrapper[35367]: I1204 12:13:33.505920 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e044043e-2b10-4c93-89bb-2610a5793e69-metrics-certs\") pod \"speaker-868rl\" (UID: \"e044043e-2b10-4c93-89bb-2610a5793e69\") " pod="metallb-system/speaker-868rl" Dec 04 12:13:33.507657 master-0 kubenswrapper[35367]: I1204 12:13:33.507442 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/077af73f-4190-4c72-b167-9cc36f6482df-cert\") pod \"frr-k8s-webhook-server-7fcb986d4-hfnqb\" (UID: \"077af73f-4190-4c72-b167-9cc36f6482df\") " pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-hfnqb" Dec 04 12:13:33.520998 master-0 kubenswrapper[35367]: I1204 12:13:33.520926 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/197979ad-247d-457f-9529-63bcb6ce15c0-cert\") pod \"controller-f8648f98b-v2fsc\" (UID: \"197979ad-247d-457f-9529-63bcb6ce15c0\") " pod="metallb-system/controller-f8648f98b-v2fsc" Dec 04 12:13:33.523572 master-0 kubenswrapper[35367]: I1204 12:13:33.523522 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw72g\" (UniqueName: \"kubernetes.io/projected/197979ad-247d-457f-9529-63bcb6ce15c0-kube-api-access-rw72g\") pod \"controller-f8648f98b-v2fsc\" (UID: \"197979ad-247d-457f-9529-63bcb6ce15c0\") " pod="metallb-system/controller-f8648f98b-v2fsc" Dec 04 12:13:33.524058 master-0 kubenswrapper[35367]: I1204 12:13:33.523863 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/197979ad-247d-457f-9529-63bcb6ce15c0-metrics-certs\") pod \"controller-f8648f98b-v2fsc\" (UID: \"197979ad-247d-457f-9529-63bcb6ce15c0\") " pod="metallb-system/controller-f8648f98b-v2fsc" Dec 04 12:13:33.524581 master-0 kubenswrapper[35367]: I1204 12:13:33.524561 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bh67\" (UniqueName: \"kubernetes.io/projected/e044043e-2b10-4c93-89bb-2610a5793e69-kube-api-access-6bh67\") pod \"speaker-868rl\" (UID: \"e044043e-2b10-4c93-89bb-2610a5793e69\") " pod="metallb-system/speaker-868rl" Dec 04 12:13:33.645175 master-0 kubenswrapper[35367]: I1204 12:13:33.645067 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/controller-f8648f98b-v2fsc" Dec 04 12:13:33.722452 master-0 kubenswrapper[35367]: I1204 12:13:33.722293 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-hfnqb" Dec 04 12:13:34.018400 master-0 kubenswrapper[35367]: I1204 12:13:34.018197 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/e044043e-2b10-4c93-89bb-2610a5793e69-memberlist\") pod \"speaker-868rl\" (UID: \"e044043e-2b10-4c93-89bb-2610a5793e69\") " pod="metallb-system/speaker-868rl" Dec 04 12:13:34.018943 master-0 kubenswrapper[35367]: E1204 12:13:34.018438 35367 secret.go:189] Couldn't get secret metallb-system/metallb-memberlist: secret "metallb-memberlist" not found Dec 04 12:13:34.018943 master-0 kubenswrapper[35367]: E1204 12:13:34.018548 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e044043e-2b10-4c93-89bb-2610a5793e69-memberlist podName:e044043e-2b10-4c93-89bb-2610a5793e69 nodeName:}" failed. No retries permitted until 2025-12-04 12:13:35.018507562 +0000 UTC m=+858.456568820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "memberlist" (UniqueName: "kubernetes.io/secret/e044043e-2b10-4c93-89bb-2610a5793e69-memberlist") pod "speaker-868rl" (UID: "e044043e-2b10-4c93-89bb-2610a5793e69") : secret "metallb-memberlist" not found Dec 04 12:13:34.221496 master-0 kubenswrapper[35367]: I1204 12:13:34.221432 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-ckzx9" event={"ID":"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d","Type":"ContainerStarted","Data":"d672322961f0924a6b24e6a09868d348479377a8e0d307804979a83b454fe0eb"} Dec 04 12:13:35.035908 master-0 kubenswrapper[35367]: I1204 12:13:35.035830 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/e044043e-2b10-4c93-89bb-2610a5793e69-memberlist\") pod \"speaker-868rl\" (UID: \"e044043e-2b10-4c93-89bb-2610a5793e69\") " pod="metallb-system/speaker-868rl" Dec 04 12:13:35.036564 master-0 kubenswrapper[35367]: E1204 12:13:35.036059 35367 secret.go:189] Couldn't get secret metallb-system/metallb-memberlist: secret "metallb-memberlist" not found Dec 04 12:13:35.036564 master-0 kubenswrapper[35367]: E1204 12:13:35.036110 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e044043e-2b10-4c93-89bb-2610a5793e69-memberlist podName:e044043e-2b10-4c93-89bb-2610a5793e69 nodeName:}" failed. No retries permitted until 2025-12-04 12:13:37.036093077 +0000 UTC m=+860.474154335 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "memberlist" (UniqueName: "kubernetes.io/secret/e044043e-2b10-4c93-89bb-2610a5793e69-memberlist") pod "speaker-868rl" (UID: "e044043e-2b10-4c93-89bb-2610a5793e69") : secret "metallb-memberlist" not found Dec 04 12:13:36.502424 master-0 kubenswrapper[35367]: I1204 12:13:36.502122 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/frr-k8s-webhook-server-7fcb986d4-hfnqb"] Dec 04 12:13:36.537587 master-0 kubenswrapper[35367]: I1204 12:13:36.536325 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/controller-f8648f98b-v2fsc"] Dec 04 12:13:37.092710 master-0 kubenswrapper[35367]: I1204 12:13:37.092647 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/e044043e-2b10-4c93-89bb-2610a5793e69-memberlist\") pod \"speaker-868rl\" (UID: \"e044043e-2b10-4c93-89bb-2610a5793e69\") " pod="metallb-system/speaker-868rl" Dec 04 12:13:37.117930 master-0 kubenswrapper[35367]: I1204 12:13:37.117015 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/e044043e-2b10-4c93-89bb-2610a5793e69-memberlist\") pod \"speaker-868rl\" (UID: \"e044043e-2b10-4c93-89bb-2610a5793e69\") " pod="metallb-system/speaker-868rl" Dec 04 12:13:37.230323 master-0 kubenswrapper[35367]: I1204 12:13:37.229496 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/speaker-868rl" Dec 04 12:13:37.258660 master-0 kubenswrapper[35367]: I1204 12:13:37.258564 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-hfnqb" event={"ID":"077af73f-4190-4c72-b167-9cc36f6482df","Type":"ContainerStarted","Data":"47210f5ba8e2ceec4eb2a04192355bf9bd61282232df283f7b4c66dd22d722bb"} Dec 04 12:13:37.270825 master-0 kubenswrapper[35367]: I1204 12:13:37.270720 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/controller-f8648f98b-v2fsc" event={"ID":"197979ad-247d-457f-9529-63bcb6ce15c0","Type":"ContainerStarted","Data":"7648107a93a270c05f52713039ec2ddd974046db8510e4371c25d4388259006f"} Dec 04 12:13:37.270936 master-0 kubenswrapper[35367]: I1204 12:13:37.270844 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/controller-f8648f98b-v2fsc" event={"ID":"197979ad-247d-457f-9529-63bcb6ce15c0","Type":"ContainerStarted","Data":"f53d50daa6f7d6b60011887e5776f257b969e7c9b0ccd4aa9037758e89b9b5b4"} Dec 04 12:13:37.283061 master-0 kubenswrapper[35367]: I1204 12:13:37.283006 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-metrics-7f946cbc9-xmkjr"] Dec 04 12:13:37.285596 master-0 kubenswrapper[35367]: I1204 12:13:37.285566 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-metrics-7f946cbc9-xmkjr" Dec 04 12:13:37.321458 master-0 kubenswrapper[35367]: I1204 12:13:37.321261 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-webhook-5f6d4c5ccb-zg9dh"] Dec 04 12:13:37.322619 master-0 kubenswrapper[35367]: I1204 12:13:37.322591 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-zg9dh" Dec 04 12:13:37.334084 master-0 kubenswrapper[35367]: I1204 12:13:37.333999 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-metrics-7f946cbc9-xmkjr"] Dec 04 12:13:37.334084 master-0 kubenswrapper[35367]: I1204 12:13:37.334061 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-nmstate"/"openshift-nmstate-webhook" Dec 04 12:13:37.354006 master-0 kubenswrapper[35367]: I1204 12:13:37.353817 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-webhook-5f6d4c5ccb-zg9dh"] Dec 04 12:13:37.363654 master-0 kubenswrapper[35367]: I1204 12:13:37.363576 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-handler-qthsq"] Dec 04 12:13:37.365603 master-0 kubenswrapper[35367]: I1204 12:13:37.365568 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-handler-qthsq" Dec 04 12:13:37.403419 master-0 kubenswrapper[35367]: I1204 12:13:37.403316 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-999t2\" (UniqueName: \"kubernetes.io/projected/d492b639-676b-4f37-b2b9-3d7578cb6066-kube-api-access-999t2\") pod \"nmstate-metrics-7f946cbc9-xmkjr\" (UID: \"d492b639-676b-4f37-b2b9-3d7578cb6066\") " pod="openshift-nmstate/nmstate-metrics-7f946cbc9-xmkjr" Dec 04 12:13:37.403419 master-0 kubenswrapper[35367]: I1204 12:13:37.403420 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/a7c48154-d095-44b4-9a06-cce86f50ddde-tls-key-pair\") pod \"nmstate-webhook-5f6d4c5ccb-zg9dh\" (UID: \"a7c48154-d095-44b4-9a06-cce86f50ddde\") " pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-zg9dh" Dec 04 12:13:37.403986 master-0 kubenswrapper[35367]: I1204 12:13:37.403765 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tslz\" (UniqueName: \"kubernetes.io/projected/a7c48154-d095-44b4-9a06-cce86f50ddde-kube-api-access-7tslz\") pod \"nmstate-webhook-5f6d4c5ccb-zg9dh\" (UID: \"a7c48154-d095-44b4-9a06-cce86f50ddde\") " pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-zg9dh" Dec 04 12:13:37.505737 master-0 kubenswrapper[35367]: I1204 12:13:37.505663 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nmstate-lock\" (UniqueName: \"kubernetes.io/host-path/405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8-nmstate-lock\") pod \"nmstate-handler-qthsq\" (UID: \"405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8\") " pod="openshift-nmstate/nmstate-handler-qthsq" Dec 04 12:13:37.506666 master-0 kubenswrapper[35367]: I1204 12:13:37.506372 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7tslz\" (UniqueName: \"kubernetes.io/projected/a7c48154-d095-44b4-9a06-cce86f50ddde-kube-api-access-7tslz\") pod \"nmstate-webhook-5f6d4c5ccb-zg9dh\" (UID: \"a7c48154-d095-44b4-9a06-cce86f50ddde\") " pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-zg9dh" Dec 04 12:13:37.506666 master-0 kubenswrapper[35367]: I1204 12:13:37.506426 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovs-socket\" (UniqueName: \"kubernetes.io/host-path/405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8-ovs-socket\") pod \"nmstate-handler-qthsq\" (UID: \"405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8\") " pod="openshift-nmstate/nmstate-handler-qthsq" Dec 04 12:13:37.506666 master-0 kubenswrapper[35367]: I1204 12:13:37.506465 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw4wz\" (UniqueName: \"kubernetes.io/projected/405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8-kube-api-access-nw4wz\") pod \"nmstate-handler-qthsq\" (UID: \"405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8\") " pod="openshift-nmstate/nmstate-handler-qthsq" Dec 04 12:13:37.506666 master-0 kubenswrapper[35367]: I1204 12:13:37.506484 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus-socket\" (UniqueName: \"kubernetes.io/host-path/405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8-dbus-socket\") pod \"nmstate-handler-qthsq\" (UID: \"405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8\") " pod="openshift-nmstate/nmstate-handler-qthsq" Dec 04 12:13:37.506666 master-0 kubenswrapper[35367]: I1204 12:13:37.506517 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-999t2\" (UniqueName: \"kubernetes.io/projected/d492b639-676b-4f37-b2b9-3d7578cb6066-kube-api-access-999t2\") pod \"nmstate-metrics-7f946cbc9-xmkjr\" (UID: \"d492b639-676b-4f37-b2b9-3d7578cb6066\") " pod="openshift-nmstate/nmstate-metrics-7f946cbc9-xmkjr" Dec 04 12:13:37.506666 master-0 kubenswrapper[35367]: I1204 12:13:37.506559 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/a7c48154-d095-44b4-9a06-cce86f50ddde-tls-key-pair\") pod \"nmstate-webhook-5f6d4c5ccb-zg9dh\" (UID: \"a7c48154-d095-44b4-9a06-cce86f50ddde\") " pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-zg9dh" Dec 04 12:13:37.506994 master-0 kubenswrapper[35367]: E1204 12:13:37.506687 35367 secret.go:189] Couldn't get secret openshift-nmstate/openshift-nmstate-webhook: secret "openshift-nmstate-webhook" not found Dec 04 12:13:37.506994 master-0 kubenswrapper[35367]: E1204 12:13:37.506739 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7c48154-d095-44b4-9a06-cce86f50ddde-tls-key-pair podName:a7c48154-d095-44b4-9a06-cce86f50ddde nodeName:}" failed. No retries permitted until 2025-12-04 12:13:38.006720957 +0000 UTC m=+861.444782215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-key-pair" (UniqueName: "kubernetes.io/secret/a7c48154-d095-44b4-9a06-cce86f50ddde-tls-key-pair") pod "nmstate-webhook-5f6d4c5ccb-zg9dh" (UID: "a7c48154-d095-44b4-9a06-cce86f50ddde") : secret "openshift-nmstate-webhook" not found Dec 04 12:13:37.608722 master-0 kubenswrapper[35367]: I1204 12:13:37.608664 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nw4wz\" (UniqueName: \"kubernetes.io/projected/405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8-kube-api-access-nw4wz\") pod \"nmstate-handler-qthsq\" (UID: \"405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8\") " pod="openshift-nmstate/nmstate-handler-qthsq" Dec 04 12:13:37.609032 master-0 kubenswrapper[35367]: I1204 12:13:37.608914 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dbus-socket\" (UniqueName: \"kubernetes.io/host-path/405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8-dbus-socket\") pod \"nmstate-handler-qthsq\" (UID: \"405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8\") " pod="openshift-nmstate/nmstate-handler-qthsq" Dec 04 12:13:37.609164 master-0 kubenswrapper[35367]: I1204 12:13:37.609109 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dbus-socket\" (UniqueName: \"kubernetes.io/host-path/405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8-dbus-socket\") pod \"nmstate-handler-qthsq\" (UID: \"405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8\") " pod="openshift-nmstate/nmstate-handler-qthsq" Dec 04 12:13:37.609297 master-0 kubenswrapper[35367]: I1204 12:13:37.609282 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nmstate-lock\" (UniqueName: \"kubernetes.io/host-path/405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8-nmstate-lock\") pod \"nmstate-handler-qthsq\" (UID: \"405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8\") " pod="openshift-nmstate/nmstate-handler-qthsq" Dec 04 12:13:37.609407 master-0 kubenswrapper[35367]: I1204 12:13:37.609384 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nmstate-lock\" (UniqueName: \"kubernetes.io/host-path/405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8-nmstate-lock\") pod \"nmstate-handler-qthsq\" (UID: \"405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8\") " pod="openshift-nmstate/nmstate-handler-qthsq" Dec 04 12:13:37.609694 master-0 kubenswrapper[35367]: I1204 12:13:37.609651 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovs-socket\" (UniqueName: \"kubernetes.io/host-path/405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8-ovs-socket\") pod \"nmstate-handler-qthsq\" (UID: \"405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8\") " pod="openshift-nmstate/nmstate-handler-qthsq" Dec 04 12:13:37.609742 master-0 kubenswrapper[35367]: I1204 12:13:37.609707 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovs-socket\" (UniqueName: \"kubernetes.io/host-path/405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8-ovs-socket\") pod \"nmstate-handler-qthsq\" (UID: \"405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8\") " pod="openshift-nmstate/nmstate-handler-qthsq" Dec 04 12:13:37.961080 master-0 kubenswrapper[35367]: I1204 12:13:37.960994 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw4wz\" (UniqueName: \"kubernetes.io/projected/405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8-kube-api-access-nw4wz\") pod \"nmstate-handler-qthsq\" (UID: \"405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8\") " pod="openshift-nmstate/nmstate-handler-qthsq" Dec 04 12:13:37.966280 master-0 kubenswrapper[35367]: I1204 12:13:37.966233 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tslz\" (UniqueName: \"kubernetes.io/projected/a7c48154-d095-44b4-9a06-cce86f50ddde-kube-api-access-7tslz\") pod \"nmstate-webhook-5f6d4c5ccb-zg9dh\" (UID: \"a7c48154-d095-44b4-9a06-cce86f50ddde\") " pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-zg9dh" Dec 04 12:13:37.985841 master-0 kubenswrapper[35367]: I1204 12:13:37.984145 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-999t2\" (UniqueName: \"kubernetes.io/projected/d492b639-676b-4f37-b2b9-3d7578cb6066-kube-api-access-999t2\") pod \"nmstate-metrics-7f946cbc9-xmkjr\" (UID: \"d492b639-676b-4f37-b2b9-3d7578cb6066\") " pod="openshift-nmstate/nmstate-metrics-7f946cbc9-xmkjr" Dec 04 12:13:37.997213 master-0 kubenswrapper[35367]: I1204 12:13:37.997146 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-handler-qthsq" Dec 04 12:13:38.020283 master-0 kubenswrapper[35367]: I1204 12:13:38.018171 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/a7c48154-d095-44b4-9a06-cce86f50ddde-tls-key-pair\") pod \"nmstate-webhook-5f6d4c5ccb-zg9dh\" (UID: \"a7c48154-d095-44b4-9a06-cce86f50ddde\") " pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-zg9dh" Dec 04 12:13:38.023239 master-0 kubenswrapper[35367]: I1204 12:13:38.023200 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/a7c48154-d095-44b4-9a06-cce86f50ddde-tls-key-pair\") pod \"nmstate-webhook-5f6d4c5ccb-zg9dh\" (UID: \"a7c48154-d095-44b4-9a06-cce86f50ddde\") " pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-zg9dh" Dec 04 12:13:38.238652 master-0 kubenswrapper[35367]: I1204 12:13:38.238560 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-metrics-7f946cbc9-xmkjr" Dec 04 12:13:38.280338 master-0 kubenswrapper[35367]: I1204 12:13:38.280256 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/speaker-868rl" event={"ID":"e044043e-2b10-4c93-89bb-2610a5793e69","Type":"ContainerStarted","Data":"f1f57f048a3a315f90c15553c4de88d5af210f6e5152c31f8c9bfedc13537e15"} Dec 04 12:13:38.280338 master-0 kubenswrapper[35367]: I1204 12:13:38.280325 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/speaker-868rl" event={"ID":"e044043e-2b10-4c93-89bb-2610a5793e69","Type":"ContainerStarted","Data":"14fec6c7290774353c67e5493fed6be0402cbf8bd6a6430bd278789a58a7cb4f"} Dec 04 12:13:38.281406 master-0 kubenswrapper[35367]: I1204 12:13:38.281354 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-handler-qthsq" event={"ID":"405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8","Type":"ContainerStarted","Data":"4565a787bba39a9980596f051c4b4070b59bcc5c9fa4a67c5b2004ee34d1916a"} Dec 04 12:13:38.287599 master-0 kubenswrapper[35367]: I1204 12:13:38.287539 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-zg9dh" Dec 04 12:13:38.415613 master-0 kubenswrapper[35367]: I1204 12:13:38.415540 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-console-plugin-7fbb5f6569-gdhpp"] Dec 04 12:13:38.417144 master-0 kubenswrapper[35367]: I1204 12:13:38.417111 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-gdhpp" Dec 04 12:13:38.419724 master-0 kubenswrapper[35367]: I1204 12:13:38.419691 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-nmstate"/"plugin-serving-cert" Dec 04 12:13:38.419989 master-0 kubenswrapper[35367]: I1204 12:13:38.419961 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-nmstate"/"nginx-conf" Dec 04 12:13:38.433208 master-0 kubenswrapper[35367]: I1204 12:13:38.433160 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-console-plugin-7fbb5f6569-gdhpp"] Dec 04 12:13:38.532964 master-0 kubenswrapper[35367]: I1204 12:13:38.532136 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b8a1f199-55e6-45e6-8451-93e73b5b35fd-nginx-conf\") pod \"nmstate-console-plugin-7fbb5f6569-gdhpp\" (UID: \"b8a1f199-55e6-45e6-8451-93e73b5b35fd\") " pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-gdhpp" Dec 04 12:13:38.532964 master-0 kubenswrapper[35367]: I1204 12:13:38.532250 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfc5b\" (UniqueName: \"kubernetes.io/projected/b8a1f199-55e6-45e6-8451-93e73b5b35fd-kube-api-access-xfc5b\") pod \"nmstate-console-plugin-7fbb5f6569-gdhpp\" (UID: \"b8a1f199-55e6-45e6-8451-93e73b5b35fd\") " pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-gdhpp" Dec 04 12:13:38.532964 master-0 kubenswrapper[35367]: I1204 12:13:38.532330 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8a1f199-55e6-45e6-8451-93e73b5b35fd-plugin-serving-cert\") pod \"nmstate-console-plugin-7fbb5f6569-gdhpp\" (UID: \"b8a1f199-55e6-45e6-8451-93e73b5b35fd\") " pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-gdhpp" Dec 04 12:13:38.634268 master-0 kubenswrapper[35367]: I1204 12:13:38.634199 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xfc5b\" (UniqueName: \"kubernetes.io/projected/b8a1f199-55e6-45e6-8451-93e73b5b35fd-kube-api-access-xfc5b\") pod \"nmstate-console-plugin-7fbb5f6569-gdhpp\" (UID: \"b8a1f199-55e6-45e6-8451-93e73b5b35fd\") " pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-gdhpp" Dec 04 12:13:38.634512 master-0 kubenswrapper[35367]: I1204 12:13:38.634372 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8a1f199-55e6-45e6-8451-93e73b5b35fd-plugin-serving-cert\") pod \"nmstate-console-plugin-7fbb5f6569-gdhpp\" (UID: \"b8a1f199-55e6-45e6-8451-93e73b5b35fd\") " pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-gdhpp" Dec 04 12:13:38.634512 master-0 kubenswrapper[35367]: I1204 12:13:38.634452 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b8a1f199-55e6-45e6-8451-93e73b5b35fd-nginx-conf\") pod \"nmstate-console-plugin-7fbb5f6569-gdhpp\" (UID: \"b8a1f199-55e6-45e6-8451-93e73b5b35fd\") " pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-gdhpp" Dec 04 12:13:38.647064 master-0 kubenswrapper[35367]: I1204 12:13:38.636546 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b8a1f199-55e6-45e6-8451-93e73b5b35fd-nginx-conf\") pod \"nmstate-console-plugin-7fbb5f6569-gdhpp\" (UID: \"b8a1f199-55e6-45e6-8451-93e73b5b35fd\") " pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-gdhpp" Dec 04 12:13:38.647064 master-0 kubenswrapper[35367]: I1204 12:13:38.642270 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8a1f199-55e6-45e6-8451-93e73b5b35fd-plugin-serving-cert\") pod \"nmstate-console-plugin-7fbb5f6569-gdhpp\" (UID: \"b8a1f199-55e6-45e6-8451-93e73b5b35fd\") " pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-gdhpp" Dec 04 12:13:38.906005 master-0 kubenswrapper[35367]: I1204 12:13:38.905949 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfc5b\" (UniqueName: \"kubernetes.io/projected/b8a1f199-55e6-45e6-8451-93e73b5b35fd-kube-api-access-xfc5b\") pod \"nmstate-console-plugin-7fbb5f6569-gdhpp\" (UID: \"b8a1f199-55e6-45e6-8451-93e73b5b35fd\") " pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-gdhpp" Dec 04 12:13:39.035095 master-0 kubenswrapper[35367]: I1204 12:13:39.035033 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-webhook-5f6d4c5ccb-zg9dh"] Dec 04 12:13:39.037680 master-0 kubenswrapper[35367]: I1204 12:13:39.037635 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-gdhpp" Dec 04 12:13:39.053846 master-0 kubenswrapper[35367]: I1204 12:13:39.053043 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/console-648b6fc966-ml84x"] Dec 04 12:13:39.056041 master-0 kubenswrapper[35367]: I1204 12:13:39.056003 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.068218 master-0 kubenswrapper[35367]: I1204 12:13:39.068153 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648b6fc966-ml84x"] Dec 04 12:13:39.141458 master-0 kubenswrapper[35367]: I1204 12:13:39.141400 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-metrics-7f946cbc9-xmkjr"] Dec 04 12:13:39.142685 master-0 kubenswrapper[35367]: I1204 12:13:39.142667 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6lt9\" (UniqueName: \"kubernetes.io/projected/899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b-kube-api-access-m6lt9\") pod \"console-648b6fc966-ml84x\" (UID: \"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b\") " pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.142787 master-0 kubenswrapper[35367]: I1204 12:13:39.142770 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b-console-serving-cert\") pod \"console-648b6fc966-ml84x\" (UID: \"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b\") " pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.142907 master-0 kubenswrapper[35367]: I1204 12:13:39.142891 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b-service-ca\") pod \"console-648b6fc966-ml84x\" (UID: \"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b\") " pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.143194 master-0 kubenswrapper[35367]: I1204 12:13:39.143136 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b-oauth-serving-cert\") pod \"console-648b6fc966-ml84x\" (UID: \"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b\") " pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.144846 master-0 kubenswrapper[35367]: I1204 12:13:39.144247 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b-console-config\") pod \"console-648b6fc966-ml84x\" (UID: \"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b\") " pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.145081 master-0 kubenswrapper[35367]: I1204 12:13:39.145049 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b-console-oauth-config\") pod \"console-648b6fc966-ml84x\" (UID: \"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b\") " pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.147265 master-0 kubenswrapper[35367]: I1204 12:13:39.147093 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b-trusted-ca-bundle\") pod \"console-648b6fc966-ml84x\" (UID: \"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b\") " pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.251752 master-0 kubenswrapper[35367]: I1204 12:13:39.251672 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b-console-oauth-config\") pod \"console-648b6fc966-ml84x\" (UID: \"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b\") " pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.252040 master-0 kubenswrapper[35367]: I1204 12:13:39.251824 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b-trusted-ca-bundle\") pod \"console-648b6fc966-ml84x\" (UID: \"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b\") " pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.252040 master-0 kubenswrapper[35367]: I1204 12:13:39.251870 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m6lt9\" (UniqueName: \"kubernetes.io/projected/899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b-kube-api-access-m6lt9\") pod \"console-648b6fc966-ml84x\" (UID: \"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b\") " pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.252040 master-0 kubenswrapper[35367]: I1204 12:13:39.251890 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b-console-serving-cert\") pod \"console-648b6fc966-ml84x\" (UID: \"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b\") " pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.252040 master-0 kubenswrapper[35367]: I1204 12:13:39.251926 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b-service-ca\") pod \"console-648b6fc966-ml84x\" (UID: \"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b\") " pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.252040 master-0 kubenswrapper[35367]: I1204 12:13:39.251969 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b-oauth-serving-cert\") pod \"console-648b6fc966-ml84x\" (UID: \"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b\") " pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.252040 master-0 kubenswrapper[35367]: I1204 12:13:39.252006 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b-console-config\") pod \"console-648b6fc966-ml84x\" (UID: \"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b\") " pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.253863 master-0 kubenswrapper[35367]: I1204 12:13:39.253741 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b-service-ca\") pod \"console-648b6fc966-ml84x\" (UID: \"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b\") " pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.254425 master-0 kubenswrapper[35367]: I1204 12:13:39.254189 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b-oauth-serving-cert\") pod \"console-648b6fc966-ml84x\" (UID: \"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b\") " pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.254425 master-0 kubenswrapper[35367]: I1204 12:13:39.254337 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b-console-config\") pod \"console-648b6fc966-ml84x\" (UID: \"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b\") " pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.254766 master-0 kubenswrapper[35367]: I1204 12:13:39.254722 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b-trusted-ca-bundle\") pod \"console-648b6fc966-ml84x\" (UID: \"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b\") " pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.255972 master-0 kubenswrapper[35367]: I1204 12:13:39.255923 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b-console-oauth-config\") pod \"console-648b6fc966-ml84x\" (UID: \"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b\") " pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.260387 master-0 kubenswrapper[35367]: I1204 12:13:39.260329 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b-console-serving-cert\") pod \"console-648b6fc966-ml84x\" (UID: \"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b\") " pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.271063 master-0 kubenswrapper[35367]: I1204 12:13:39.271013 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6lt9\" (UniqueName: \"kubernetes.io/projected/899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b-kube-api-access-m6lt9\") pod \"console-648b6fc966-ml84x\" (UID: \"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b\") " pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.297683 master-0 kubenswrapper[35367]: I1204 12:13:39.296916 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/controller-f8648f98b-v2fsc" event={"ID":"197979ad-247d-457f-9529-63bcb6ce15c0","Type":"ContainerStarted","Data":"da7eee702a37314778dbd53d8601012aef1f62172e7ee6bf4ce4af594003d3e5"} Dec 04 12:13:39.297683 master-0 kubenswrapper[35367]: I1204 12:13:39.297096 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/controller-f8648f98b-v2fsc" Dec 04 12:13:39.299383 master-0 kubenswrapper[35367]: I1204 12:13:39.299326 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-metrics-7f946cbc9-xmkjr" event={"ID":"d492b639-676b-4f37-b2b9-3d7578cb6066","Type":"ContainerStarted","Data":"1d296a8abf4038ad5d7d680469ffdccc62abb024a53296e035989d250bd43d4e"} Dec 04 12:13:39.301797 master-0 kubenswrapper[35367]: I1204 12:13:39.301766 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-zg9dh" event={"ID":"a7c48154-d095-44b4-9a06-cce86f50ddde","Type":"ContainerStarted","Data":"ec5ad37ea5f823b32f9f5464ab34bf336c5c1cb4aace4e250d7b9e897742cb96"} Dec 04 12:13:39.331908 master-0 kubenswrapper[35367]: I1204 12:13:39.331799 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/controller-f8648f98b-v2fsc" podStartSLOduration=4.831395421 podStartE2EDuration="6.331779259s" podCreationTimestamp="2025-12-04 12:13:33 +0000 UTC" firstStartedPulling="2025-12-04 12:13:36.917376864 +0000 UTC m=+860.355438122" lastFinishedPulling="2025-12-04 12:13:38.417760702 +0000 UTC m=+861.855821960" observedRunningTime="2025-12-04 12:13:39.322446135 +0000 UTC m=+862.760507393" watchObservedRunningTime="2025-12-04 12:13:39.331779259 +0000 UTC m=+862.769840517" Dec 04 12:13:39.408341 master-0 kubenswrapper[35367]: I1204 12:13:39.408282 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:39.661562 master-0 kubenswrapper[35367]: I1204 12:13:39.661496 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-console-plugin-7fbb5f6569-gdhpp"] Dec 04 12:13:39.663853 master-0 kubenswrapper[35367]: W1204 12:13:39.663771 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8a1f199_55e6_45e6_8451_93e73b5b35fd.slice/crio-b0fa79d8baaed7e81eac174896b4609f6abf5b2fc934a98f20a6082e01689afb WatchSource:0}: Error finding container b0fa79d8baaed7e81eac174896b4609f6abf5b2fc934a98f20a6082e01689afb: Status 404 returned error can't find the container with id b0fa79d8baaed7e81eac174896b4609f6abf5b2fc934a98f20a6082e01689afb Dec 04 12:13:40.311087 master-0 kubenswrapper[35367]: I1204 12:13:40.310991 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-gdhpp" event={"ID":"b8a1f199-55e6-45e6-8451-93e73b5b35fd","Type":"ContainerStarted","Data":"b0fa79d8baaed7e81eac174896b4609f6abf5b2fc934a98f20a6082e01689afb"} Dec 04 12:13:40.313282 master-0 kubenswrapper[35367]: I1204 12:13:40.313220 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/speaker-868rl" event={"ID":"e044043e-2b10-4c93-89bb-2610a5793e69","Type":"ContainerStarted","Data":"1aec46d8d3c06f17d3c1416adc493e2bf5937d72418358e13f1027d5c15c902c"} Dec 04 12:13:41.324842 master-0 kubenswrapper[35367]: I1204 12:13:41.324696 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/speaker-868rl" Dec 04 12:13:43.786431 master-0 kubenswrapper[35367]: I1204 12:13:43.785889 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648b6fc966-ml84x"] Dec 04 12:13:43.792871 master-0 kubenswrapper[35367]: I1204 12:13:43.791964 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/speaker-868rl" podStartSLOduration=9.689493077 podStartE2EDuration="10.791938251s" podCreationTimestamp="2025-12-04 12:13:33 +0000 UTC" firstStartedPulling="2025-12-04 12:13:37.933793171 +0000 UTC m=+861.371854429" lastFinishedPulling="2025-12-04 12:13:39.036238345 +0000 UTC m=+862.474299603" observedRunningTime="2025-12-04 12:13:43.772922681 +0000 UTC m=+867.210983959" watchObservedRunningTime="2025-12-04 12:13:43.791938251 +0000 UTC m=+867.229999519" Dec 04 12:13:47.233989 master-0 kubenswrapper[35367]: I1204 12:13:47.233900 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/speaker-868rl" Dec 04 12:13:51.202635 master-0 kubenswrapper[35367]: W1204 12:13:51.202557 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod899bfa0e_c00b_43ff_9aaf_87d6b61b2a3b.slice/crio-27e6a7fb6a3d9554486171b1f5441e2bee006485ae9c2fd0a71d87cf3bd0dbbc WatchSource:0}: Error finding container 27e6a7fb6a3d9554486171b1f5441e2bee006485ae9c2fd0a71d87cf3bd0dbbc: Status 404 returned error can't find the container with id 27e6a7fb6a3d9554486171b1f5441e2bee006485ae9c2fd0a71d87cf3bd0dbbc Dec 04 12:13:51.445858 master-0 kubenswrapper[35367]: I1204 12:13:51.445766 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648b6fc966-ml84x" event={"ID":"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b","Type":"ContainerStarted","Data":"27e6a7fb6a3d9554486171b1f5441e2bee006485ae9c2fd0a71d87cf3bd0dbbc"} Dec 04 12:13:52.455285 master-0 kubenswrapper[35367]: I1204 12:13:52.455213 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648b6fc966-ml84x" event={"ID":"899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b","Type":"ContainerStarted","Data":"38017119aaabbd60063d0b58b7c992b68196c51fbd7ae20b4249efbc668c2681"} Dec 04 12:13:52.457191 master-0 kubenswrapper[35367]: I1204 12:13:52.457151 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-hfnqb" event={"ID":"077af73f-4190-4c72-b167-9cc36f6482df","Type":"ContainerStarted","Data":"b27b1a168725bab6c1507c09abad46d222995266b61ea8d2536820b20807c66c"} Dec 04 12:13:52.457340 master-0 kubenswrapper[35367]: I1204 12:13:52.457302 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-hfnqb" Dec 04 12:13:52.460591 master-0 kubenswrapper[35367]: I1204 12:13:52.459559 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-metrics-7f946cbc9-xmkjr" event={"ID":"d492b639-676b-4f37-b2b9-3d7578cb6066","Type":"ContainerStarted","Data":"cc6ddda935822d44aefc4920bbac02150deea406b54851a08468d7de872c35f5"} Dec 04 12:13:52.460591 master-0 kubenswrapper[35367]: I1204 12:13:52.459592 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-metrics-7f946cbc9-xmkjr" event={"ID":"d492b639-676b-4f37-b2b9-3d7578cb6066","Type":"ContainerStarted","Data":"bd804ee7805e3e7a1e09cb47829418757ed85364fdf1e2b0b93afd4d217bfc30"} Dec 04 12:13:52.462580 master-0 kubenswrapper[35367]: I1204 12:13:52.462451 35367 generic.go:334] "Generic (PLEG): container finished" podID="4e0c1dd6-ebe9-4ba0-b204-7ebde784706d" containerID="d744b3649e4679e17bc2a44ba594189b9b6924bf0a0486f786d218d0ee468661" exitCode=0 Dec 04 12:13:52.462580 master-0 kubenswrapper[35367]: I1204 12:13:52.462547 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-ckzx9" event={"ID":"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d","Type":"ContainerDied","Data":"d744b3649e4679e17bc2a44ba594189b9b6924bf0a0486f786d218d0ee468661"} Dec 04 12:13:52.465055 master-0 kubenswrapper[35367]: I1204 12:13:52.465017 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-handler-qthsq" event={"ID":"405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8","Type":"ContainerStarted","Data":"279c591fc1fd2e1ab1907762b1507cb4f2bc18b456fe49498377da0a33420448"} Dec 04 12:13:52.465302 master-0 kubenswrapper[35367]: I1204 12:13:52.465287 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-nmstate/nmstate-handler-qthsq" Dec 04 12:13:52.470409 master-0 kubenswrapper[35367]: I1204 12:13:52.470098 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-zg9dh" event={"ID":"a7c48154-d095-44b4-9a06-cce86f50ddde","Type":"ContainerStarted","Data":"f2b7aaa2a272256917de4dd7fa33e97f13809077769092615786408e314eea9f"} Dec 04 12:13:52.470972 master-0 kubenswrapper[35367]: I1204 12:13:52.470919 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-zg9dh" Dec 04 12:13:52.482177 master-0 kubenswrapper[35367]: I1204 12:13:52.482088 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-648b6fc966-ml84x" podStartSLOduration=14.482063012 podStartE2EDuration="14.482063012s" podCreationTimestamp="2025-12-04 12:13:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:13:52.477956142 +0000 UTC m=+875.916017400" watchObservedRunningTime="2025-12-04 12:13:52.482063012 +0000 UTC m=+875.920124280" Dec 04 12:13:52.513736 master-0 kubenswrapper[35367]: I1204 12:13:52.513606 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-hfnqb" podStartSLOduration=5.673577722 podStartE2EDuration="20.513580836s" podCreationTimestamp="2025-12-04 12:13:32 +0000 UTC" firstStartedPulling="2025-12-04 12:13:36.520413988 +0000 UTC m=+859.958475236" lastFinishedPulling="2025-12-04 12:13:51.360417092 +0000 UTC m=+874.798478350" observedRunningTime="2025-12-04 12:13:52.50041544 +0000 UTC m=+875.938476708" watchObservedRunningTime="2025-12-04 12:13:52.513580836 +0000 UTC m=+875.951642094" Dec 04 12:13:52.551751 master-0 kubenswrapper[35367]: I1204 12:13:52.551590 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-metrics-7f946cbc9-xmkjr" podStartSLOduration=3.345189703 podStartE2EDuration="15.551564304s" podCreationTimestamp="2025-12-04 12:13:37 +0000 UTC" firstStartedPulling="2025-12-04 12:13:39.155833938 +0000 UTC m=+862.593895196" lastFinishedPulling="2025-12-04 12:13:51.362208539 +0000 UTC m=+874.800269797" observedRunningTime="2025-12-04 12:13:52.547469335 +0000 UTC m=+875.985530603" watchObservedRunningTime="2025-12-04 12:13:52.551564304 +0000 UTC m=+875.989625562" Dec 04 12:13:52.575199 master-0 kubenswrapper[35367]: I1204 12:13:52.573872 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-handler-qthsq" podStartSLOduration=2.266934904 podStartE2EDuration="15.573855038s" podCreationTimestamp="2025-12-04 12:13:37 +0000 UTC" firstStartedPulling="2025-12-04 12:13:38.035202691 +0000 UTC m=+861.473263949" lastFinishedPulling="2025-12-04 12:13:51.342122825 +0000 UTC m=+874.780184083" observedRunningTime="2025-12-04 12:13:52.571341858 +0000 UTC m=+876.009403126" watchObservedRunningTime="2025-12-04 12:13:52.573855038 +0000 UTC m=+876.011916296" Dec 04 12:13:52.597333 master-0 kubenswrapper[35367]: I1204 12:13:52.597250 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-zg9dh" podStartSLOduration=3.223391961 podStartE2EDuration="15.597227595s" podCreationTimestamp="2025-12-04 12:13:37 +0000 UTC" firstStartedPulling="2025-12-04 12:13:39.034440958 +0000 UTC m=+862.472502216" lastFinishedPulling="2025-12-04 12:13:51.408276592 +0000 UTC m=+874.846337850" observedRunningTime="2025-12-04 12:13:52.594071276 +0000 UTC m=+876.032132544" watchObservedRunningTime="2025-12-04 12:13:52.597227595 +0000 UTC m=+876.035288853" Dec 04 12:13:53.499108 master-0 kubenswrapper[35367]: I1204 12:13:53.499041 35367 generic.go:334] "Generic (PLEG): container finished" podID="4e0c1dd6-ebe9-4ba0-b204-7ebde784706d" containerID="e2bb28696a35af891fbfca2df850a98fb2cde07bbbdb9729b9a2184ddfdb3a3a" exitCode=0 Dec 04 12:13:53.499959 master-0 kubenswrapper[35367]: I1204 12:13:53.499142 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-ckzx9" event={"ID":"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d","Type":"ContainerDied","Data":"e2bb28696a35af891fbfca2df850a98fb2cde07bbbdb9729b9a2184ddfdb3a3a"} Dec 04 12:13:53.502486 master-0 kubenswrapper[35367]: I1204 12:13:53.502384 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-gdhpp" event={"ID":"b8a1f199-55e6-45e6-8451-93e73b5b35fd","Type":"ContainerStarted","Data":"f628c91fd6e56b68a3ccad826565cbd5b914d90052c4fbb016c4156948e3bdf3"} Dec 04 12:13:53.650823 master-0 kubenswrapper[35367]: I1204 12:13:53.650729 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/controller-f8648f98b-v2fsc" Dec 04 12:13:53.684175 master-0 kubenswrapper[35367]: I1204 12:13:53.684077 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-console-plugin-7fbb5f6569-gdhpp" podStartSLOduration=2.959381581 podStartE2EDuration="15.684051375s" podCreationTimestamp="2025-12-04 12:13:38 +0000 UTC" firstStartedPulling="2025-12-04 12:13:39.668273086 +0000 UTC m=+863.106334334" lastFinishedPulling="2025-12-04 12:13:52.39294287 +0000 UTC m=+875.831004128" observedRunningTime="2025-12-04 12:13:53.677046004 +0000 UTC m=+877.115107282" watchObservedRunningTime="2025-12-04 12:13:53.684051375 +0000 UTC m=+877.122112633" Dec 04 12:13:54.513263 master-0 kubenswrapper[35367]: I1204 12:13:54.513212 35367 generic.go:334] "Generic (PLEG): container finished" podID="4e0c1dd6-ebe9-4ba0-b204-7ebde784706d" containerID="bf83cd0d6a6292f372bb7fdf5f869bb1f1167a8904431b902963375ddf78705f" exitCode=0 Dec 04 12:13:54.513933 master-0 kubenswrapper[35367]: I1204 12:13:54.513267 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-ckzx9" event={"ID":"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d","Type":"ContainerDied","Data":"bf83cd0d6a6292f372bb7fdf5f869bb1f1167a8904431b902963375ddf78705f"} Dec 04 12:13:55.528452 master-0 kubenswrapper[35367]: I1204 12:13:55.528392 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-ckzx9" event={"ID":"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d","Type":"ContainerStarted","Data":"51f52dd2d907bb20345073329e6338552da328bc9e6212004d746c7e31191b7d"} Dec 04 12:13:55.528452 master-0 kubenswrapper[35367]: I1204 12:13:55.528447 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-ckzx9" event={"ID":"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d","Type":"ContainerStarted","Data":"a5b114da7c12847474ba82ad3c42fd1e220504a287c39db07bab372e6e6e729b"} Dec 04 12:13:55.528452 master-0 kubenswrapper[35367]: I1204 12:13:55.528460 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-ckzx9" event={"ID":"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d","Type":"ContainerStarted","Data":"a2d0b7598adc397e7db59a37ce94bf4425d8d9d6061a9035fb8dbc4f0b32c6c6"} Dec 04 12:13:55.529049 master-0 kubenswrapper[35367]: I1204 12:13:55.528470 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-ckzx9" event={"ID":"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d","Type":"ContainerStarted","Data":"60607cd629ea6ba5a93120b6f1c5de75fd9a6081b87e1cb6aded848d7293c409"} Dec 04 12:13:55.529049 master-0 kubenswrapper[35367]: I1204 12:13:55.528482 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-ckzx9" event={"ID":"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d","Type":"ContainerStarted","Data":"6bf131d126b107a2ce3cc2dcf71af6cd852fbb59a27188933ccf9a7036ff4b01"} Dec 04 12:13:56.541920 master-0 kubenswrapper[35367]: I1204 12:13:56.541847 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-ckzx9" event={"ID":"4e0c1dd6-ebe9-4ba0-b204-7ebde784706d","Type":"ContainerStarted","Data":"a4f64d271bd848ed41fd25b4af28b20d3230f3e4a287ec0b4631575d2904b4df"} Dec 04 12:13:56.542612 master-0 kubenswrapper[35367]: I1204 12:13:56.542155 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:56.578530 master-0 kubenswrapper[35367]: I1204 12:13:56.578412 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/frr-k8s-ckzx9" podStartSLOduration=6.574778735 podStartE2EDuration="24.578387793s" podCreationTimestamp="2025-12-04 12:13:32 +0000 UTC" firstStartedPulling="2025-12-04 12:13:33.35856343 +0000 UTC m=+856.796624688" lastFinishedPulling="2025-12-04 12:13:51.362172488 +0000 UTC m=+874.800233746" observedRunningTime="2025-12-04 12:13:56.568766389 +0000 UTC m=+880.006827657" watchObservedRunningTime="2025-12-04 12:13:56.578387793 +0000 UTC m=+880.016449051" Dec 04 12:13:58.025069 master-0 kubenswrapper[35367]: I1204 12:13:58.024993 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-nmstate/nmstate-handler-qthsq" Dec 04 12:13:58.134149 master-0 kubenswrapper[35367]: I1204 12:13:58.134018 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:58.173966 master-0 kubenswrapper[35367]: I1204 12:13:58.173890 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:13:59.408845 master-0 kubenswrapper[35367]: I1204 12:13:59.408558 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:59.408845 master-0 kubenswrapper[35367]: I1204 12:13:59.408637 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:59.415996 master-0 kubenswrapper[35367]: I1204 12:13:59.415920 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:59.573699 master-0 kubenswrapper[35367]: I1204 12:13:59.573641 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-648b6fc966-ml84x" Dec 04 12:13:59.653005 master-0 kubenswrapper[35367]: I1204 12:13:59.652921 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6475766b4d-m2nml"] Dec 04 12:14:03.733513 master-0 kubenswrapper[35367]: I1204 12:14:03.733457 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/frr-k8s-webhook-server-7fcb986d4-hfnqb" Dec 04 12:14:08.293459 master-0 kubenswrapper[35367]: I1204 12:14:08.293389 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-nmstate/nmstate-webhook-5f6d4c5ccb-zg9dh" Dec 04 12:14:13.139108 master-0 kubenswrapper[35367]: I1204 12:14:13.139048 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/frr-k8s-ckzx9" Dec 04 12:14:14.897222 master-0 kubenswrapper[35367]: I1204 12:14:14.897130 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-storage/vg-manager-d999v"] Dec 04 12:14:14.898732 master-0 kubenswrapper[35367]: I1204 12:14:14.898688 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:14.901340 master-0 kubenswrapper[35367]: I1204 12:14:14.901230 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-storage"/"vg-manager-metrics-cert" Dec 04 12:14:14.918253 master-0 kubenswrapper[35367]: I1204 12:14:14.917614 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-storage/vg-manager-d999v"] Dec 04 12:14:15.058912 master-0 kubenswrapper[35367]: I1204 12:14:15.058842 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-volumes-dir\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-pod-volumes-dir\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.059212 master-0 kubenswrapper[35367]: I1204 12:14:15.058932 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-udev\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-run-udev\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.059212 master-0 kubenswrapper[35367]: I1204 12:14:15.058975 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-registration-dir\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.059212 master-0 kubenswrapper[35367]: I1204 12:14:15.059023 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-plugin-dir\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-node-plugin-dir\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.059212 master-0 kubenswrapper[35367]: I1204 12:14:15.059061 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"file-lock-dir\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-file-lock-dir\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.059212 master-0 kubenswrapper[35367]: I1204 12:14:15.059090 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/708aeade-86c4-4031-845c-f00fb04ed257-metrics-cert\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.059212 master-0 kubenswrapper[35367]: I1204 12:14:15.059117 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkxxj\" (UniqueName: \"kubernetes.io/projected/708aeade-86c4-4031-845c-f00fb04ed257-kube-api-access-lkxxj\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.059514 master-0 kubenswrapper[35367]: I1204 12:14:15.059314 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-sys\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.059663 master-0 kubenswrapper[35367]: I1204 12:14:15.059626 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-device-dir\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.059712 master-0 kubenswrapper[35367]: I1204 12:14:15.059694 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lvmd-config\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-lvmd-config\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.059763 master-0 kubenswrapper[35367]: I1204 12:14:15.059720 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"csi-plugin-dir\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-csi-plugin-dir\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.162252 master-0 kubenswrapper[35367]: I1204 12:14:15.162014 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-sys\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.162252 master-0 kubenswrapper[35367]: I1204 12:14:15.162149 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-sys\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.162252 master-0 kubenswrapper[35367]: I1204 12:14:15.162141 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-device-dir\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.162705 master-0 kubenswrapper[35367]: I1204 12:14:15.162275 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-device-dir\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.162705 master-0 kubenswrapper[35367]: I1204 12:14:15.162380 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lvmd-config\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-lvmd-config\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.162705 master-0 kubenswrapper[35367]: I1204 12:14:15.162535 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"csi-plugin-dir\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-csi-plugin-dir\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.162914 master-0 kubenswrapper[35367]: I1204 12:14:15.162797 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-volumes-dir\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-pod-volumes-dir\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.162972 master-0 kubenswrapper[35367]: I1204 12:14:15.162937 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-udev\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-run-udev\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.163062 master-0 kubenswrapper[35367]: I1204 12:14:15.163027 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-registration-dir\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.163366 master-0 kubenswrapper[35367]: I1204 12:14:15.163219 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-plugin-dir\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-node-plugin-dir\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.163366 master-0 kubenswrapper[35367]: I1204 12:14:15.163350 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"file-lock-dir\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-file-lock-dir\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.163787 master-0 kubenswrapper[35367]: I1204 12:14:15.163406 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/708aeade-86c4-4031-845c-f00fb04ed257-metrics-cert\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.163787 master-0 kubenswrapper[35367]: I1204 12:14:15.163451 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lkxxj\" (UniqueName: \"kubernetes.io/projected/708aeade-86c4-4031-845c-f00fb04ed257-kube-api-access-lkxxj\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.165290 master-0 kubenswrapper[35367]: I1204 12:14:15.165166 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lvmd-config\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-lvmd-config\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.165578 master-0 kubenswrapper[35367]: I1204 12:14:15.165550 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"csi-plugin-dir\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-csi-plugin-dir\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.165743 master-0 kubenswrapper[35367]: I1204 12:14:15.165631 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-volumes-dir\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-pod-volumes-dir\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.165743 master-0 kubenswrapper[35367]: I1204 12:14:15.165682 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-udev\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-run-udev\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.165855 master-0 kubenswrapper[35367]: I1204 12:14:15.165756 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-registration-dir\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.165968 master-0 kubenswrapper[35367]: I1204 12:14:15.165941 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-plugin-dir\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-node-plugin-dir\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.166271 master-0 kubenswrapper[35367]: I1204 12:14:15.166244 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"file-lock-dir\" (UniqueName: \"kubernetes.io/host-path/708aeade-86c4-4031-845c-f00fb04ed257-file-lock-dir\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.170546 master-0 kubenswrapper[35367]: I1204 12:14:15.170488 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/708aeade-86c4-4031-845c-f00fb04ed257-metrics-cert\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.184400 master-0 kubenswrapper[35367]: I1204 12:14:15.184317 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkxxj\" (UniqueName: \"kubernetes.io/projected/708aeade-86c4-4031-845c-f00fb04ed257-kube-api-access-lkxxj\") pod \"vg-manager-d999v\" (UID: \"708aeade-86c4-4031-845c-f00fb04ed257\") " pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.217595 master-0 kubenswrapper[35367]: I1204 12:14:15.217509 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:15.754736 master-0 kubenswrapper[35367]: I1204 12:14:15.754608 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-storage/vg-manager-d999v"] Dec 04 12:14:16.734715 master-0 kubenswrapper[35367]: I1204 12:14:16.734597 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-storage/vg-manager-d999v" event={"ID":"708aeade-86c4-4031-845c-f00fb04ed257","Type":"ContainerStarted","Data":"812bac2df22d608f53ec6908364582c926b9fa78cd9dc70adda9fe0c3dc7b8ff"} Dec 04 12:14:16.734715 master-0 kubenswrapper[35367]: I1204 12:14:16.734709 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-storage/vg-manager-d999v" event={"ID":"708aeade-86c4-4031-845c-f00fb04ed257","Type":"ContainerStarted","Data":"302080ec61a7e0b8d487d4ddfbd9b7b8fb840df46d3086c58526fd3e33756718"} Dec 04 12:14:16.772142 master-0 kubenswrapper[35367]: I1204 12:14:16.771951 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-storage/vg-manager-d999v" podStartSLOduration=2.7719313100000003 podStartE2EDuration="2.77193131s" podCreationTimestamp="2025-12-04 12:14:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:14:16.768593093 +0000 UTC m=+900.206654381" watchObservedRunningTime="2025-12-04 12:14:16.77193131 +0000 UTC m=+900.209992568" Dec 04 12:14:18.756496 master-0 kubenswrapper[35367]: I1204 12:14:18.756345 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-storage_vg-manager-d999v_708aeade-86c4-4031-845c-f00fb04ed257/vg-manager/0.log" Dec 04 12:14:18.756496 master-0 kubenswrapper[35367]: I1204 12:14:18.756407 35367 generic.go:334] "Generic (PLEG): container finished" podID="708aeade-86c4-4031-845c-f00fb04ed257" containerID="812bac2df22d608f53ec6908364582c926b9fa78cd9dc70adda9fe0c3dc7b8ff" exitCode=1 Dec 04 12:14:18.758144 master-0 kubenswrapper[35367]: I1204 12:14:18.758069 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-storage/vg-manager-d999v" event={"ID":"708aeade-86c4-4031-845c-f00fb04ed257","Type":"ContainerDied","Data":"812bac2df22d608f53ec6908364582c926b9fa78cd9dc70adda9fe0c3dc7b8ff"} Dec 04 12:14:18.758933 master-0 kubenswrapper[35367]: I1204 12:14:18.758896 35367 scope.go:117] "RemoveContainer" containerID="812bac2df22d608f53ec6908364582c926b9fa78cd9dc70adda9fe0c3dc7b8ff" Dec 04 12:14:19.146389 master-0 kubenswrapper[35367]: I1204 12:14:19.146294 35367 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/topolvm.io-reg.sock" Dec 04 12:14:19.445820 master-0 kubenswrapper[35367]: I1204 12:14:19.445591 35367 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/topolvm.io-reg.sock","Timestamp":"2025-12-04T12:14:19.146347522Z","Handler":null,"Name":""} Dec 04 12:14:19.448271 master-0 kubenswrapper[35367]: I1204 12:14:19.448230 35367 csi_plugin.go:100] kubernetes.io/csi: Trying to validate a new CSI Driver with name: topolvm.io endpoint: /var/lib/kubelet/plugins/topolvm.io/node/csi-topolvm.sock versions: 1.0.0 Dec 04 12:14:19.448372 master-0 kubenswrapper[35367]: I1204 12:14:19.448319 35367 csi_plugin.go:113] kubernetes.io/csi: Register new plugin with name: topolvm.io at endpoint: /var/lib/kubelet/plugins/topolvm.io/node/csi-topolvm.sock Dec 04 12:14:19.793012 master-0 kubenswrapper[35367]: I1204 12:14:19.792039 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-storage_vg-manager-d999v_708aeade-86c4-4031-845c-f00fb04ed257/vg-manager/0.log" Dec 04 12:14:19.793012 master-0 kubenswrapper[35367]: I1204 12:14:19.792154 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-storage/vg-manager-d999v" event={"ID":"708aeade-86c4-4031-845c-f00fb04ed257","Type":"ContainerStarted","Data":"049c9c840a603583f6a995b7f4332a6e338e3d86e79ff1efd1db4cae8de3a996"} Dec 04 12:14:21.688134 master-0 kubenswrapper[35367]: I1204 12:14:21.688064 35367 scope.go:117] "RemoveContainer" containerID="e87ca3f10b069a54e1783b77fabd7eac4480fb70fe7b5031d4fc5e5b5de80aae" Dec 04 12:14:22.247611 master-0 kubenswrapper[35367]: I1204 12:14:22.247509 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-index-jg8xj"] Dec 04 12:14:22.250883 master-0 kubenswrapper[35367]: I1204 12:14:22.250792 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-jg8xj" Dec 04 12:14:22.254815 master-0 kubenswrapper[35367]: I1204 12:14:22.254745 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-operators"/"kube-root-ca.crt" Dec 04 12:14:22.255102 master-0 kubenswrapper[35367]: I1204 12:14:22.254961 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-operators"/"openshift-service-ca.crt" Dec 04 12:14:22.273646 master-0 kubenswrapper[35367]: I1204 12:14:22.273595 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-index-jg8xj"] Dec 04 12:14:22.349841 master-0 kubenswrapper[35367]: I1204 12:14:22.348942 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pplxf\" (UniqueName: \"kubernetes.io/projected/ebfb33ee-ee02-4120-bda7-a46817342ef2-kube-api-access-pplxf\") pod \"openstack-operator-index-jg8xj\" (UID: \"ebfb33ee-ee02-4120-bda7-a46817342ef2\") " pod="openstack-operators/openstack-operator-index-jg8xj" Dec 04 12:14:22.462830 master-0 kubenswrapper[35367]: I1204 12:14:22.460376 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pplxf\" (UniqueName: \"kubernetes.io/projected/ebfb33ee-ee02-4120-bda7-a46817342ef2-kube-api-access-pplxf\") pod \"openstack-operator-index-jg8xj\" (UID: \"ebfb33ee-ee02-4120-bda7-a46817342ef2\") " pod="openstack-operators/openstack-operator-index-jg8xj" Dec 04 12:14:22.494834 master-0 kubenswrapper[35367]: I1204 12:14:22.493824 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pplxf\" (UniqueName: \"kubernetes.io/projected/ebfb33ee-ee02-4120-bda7-a46817342ef2-kube-api-access-pplxf\") pod \"openstack-operator-index-jg8xj\" (UID: \"ebfb33ee-ee02-4120-bda7-a46817342ef2\") " pod="openstack-operators/openstack-operator-index-jg8xj" Dec 04 12:14:22.583903 master-0 kubenswrapper[35367]: I1204 12:14:22.583846 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-jg8xj" Dec 04 12:14:23.321599 master-0 kubenswrapper[35367]: I1204 12:14:23.319058 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-index-jg8xj"] Dec 04 12:14:23.831070 master-0 kubenswrapper[35367]: I1204 12:14:23.830981 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-jg8xj" event={"ID":"ebfb33ee-ee02-4120-bda7-a46817342ef2","Type":"ContainerStarted","Data":"e90a20c032d0a6b5fff469c4bd73f4dcd88477f7a82cea44985ad29e67ac7f2d"} Dec 04 12:14:24.705980 master-0 kubenswrapper[35367]: I1204 12:14:24.705184 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-console/console-6475766b4d-m2nml" podUID="f77f979c-d649-4b3b-8423-065f178df78a" containerName="console" containerID="cri-o://02366016008c6cba5359ad0c187422b885e7f3c0d1800817f0c8ee85ed47f48c" gracePeriod=15 Dec 04 12:14:24.843464 master-0 kubenswrapper[35367]: I1204 12:14:24.843367 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6475766b4d-m2nml_f77f979c-d649-4b3b-8423-065f178df78a/console/0.log" Dec 04 12:14:24.843610 master-0 kubenswrapper[35367]: I1204 12:14:24.843513 35367 generic.go:334] "Generic (PLEG): container finished" podID="f77f979c-d649-4b3b-8423-065f178df78a" containerID="02366016008c6cba5359ad0c187422b885e7f3c0d1800817f0c8ee85ed47f48c" exitCode=2 Dec 04 12:14:24.843694 master-0 kubenswrapper[35367]: I1204 12:14:24.843606 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6475766b4d-m2nml" event={"ID":"f77f979c-d649-4b3b-8423-065f178df78a","Type":"ContainerDied","Data":"02366016008c6cba5359ad0c187422b885e7f3c0d1800817f0c8ee85ed47f48c"} Dec 04 12:14:25.203358 master-0 kubenswrapper[35367]: I1204 12:14:25.203294 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6475766b4d-m2nml_f77f979c-d649-4b3b-8423-065f178df78a/console/0.log" Dec 04 12:14:25.203656 master-0 kubenswrapper[35367]: I1204 12:14:25.203389 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:14:25.218696 master-0 kubenswrapper[35367]: I1204 12:14:25.218627 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:25.222380 master-0 kubenswrapper[35367]: I1204 12:14:25.222328 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:25.337595 master-0 kubenswrapper[35367]: I1204 12:14:25.337522 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-trusted-ca-bundle\") pod \"f77f979c-d649-4b3b-8423-065f178df78a\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " Dec 04 12:14:25.337595 master-0 kubenswrapper[35367]: I1204 12:14:25.337588 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-oauth-serving-cert\") pod \"f77f979c-d649-4b3b-8423-065f178df78a\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " Dec 04 12:14:25.337961 master-0 kubenswrapper[35367]: I1204 12:14:25.337660 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsnxz\" (UniqueName: \"kubernetes.io/projected/f77f979c-d649-4b3b-8423-065f178df78a-kube-api-access-zsnxz\") pod \"f77f979c-d649-4b3b-8423-065f178df78a\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " Dec 04 12:14:25.337961 master-0 kubenswrapper[35367]: I1204 12:14:25.337709 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f77f979c-d649-4b3b-8423-065f178df78a-console-serving-cert\") pod \"f77f979c-d649-4b3b-8423-065f178df78a\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " Dec 04 12:14:25.337961 master-0 kubenswrapper[35367]: I1204 12:14:25.337784 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-service-ca\") pod \"f77f979c-d649-4b3b-8423-065f178df78a\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " Dec 04 12:14:25.337961 master-0 kubenswrapper[35367]: I1204 12:14:25.337948 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-console-config\") pod \"f77f979c-d649-4b3b-8423-065f178df78a\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " Dec 04 12:14:25.338238 master-0 kubenswrapper[35367]: I1204 12:14:25.338006 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f77f979c-d649-4b3b-8423-065f178df78a-console-oauth-config\") pod \"f77f979c-d649-4b3b-8423-065f178df78a\" (UID: \"f77f979c-d649-4b3b-8423-065f178df78a\") " Dec 04 12:14:25.339340 master-0 kubenswrapper[35367]: I1204 12:14:25.339302 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f77f979c-d649-4b3b-8423-065f178df78a" (UID: "f77f979c-d649-4b3b-8423-065f178df78a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:14:25.339865 master-0 kubenswrapper[35367]: I1204 12:14:25.339789 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f77f979c-d649-4b3b-8423-065f178df78a" (UID: "f77f979c-d649-4b3b-8423-065f178df78a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:14:25.341305 master-0 kubenswrapper[35367]: I1204 12:14:25.341215 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-console-config" (OuterVolumeSpecName: "console-config") pod "f77f979c-d649-4b3b-8423-065f178df78a" (UID: "f77f979c-d649-4b3b-8423-065f178df78a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:14:25.341716 master-0 kubenswrapper[35367]: I1204 12:14:25.341369 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-service-ca" (OuterVolumeSpecName: "service-ca") pod "f77f979c-d649-4b3b-8423-065f178df78a" (UID: "f77f979c-d649-4b3b-8423-065f178df78a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:14:25.343156 master-0 kubenswrapper[35367]: I1204 12:14:25.343115 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f77f979c-d649-4b3b-8423-065f178df78a-kube-api-access-zsnxz" (OuterVolumeSpecName: "kube-api-access-zsnxz") pod "f77f979c-d649-4b3b-8423-065f178df78a" (UID: "f77f979c-d649-4b3b-8423-065f178df78a"). InnerVolumeSpecName "kube-api-access-zsnxz". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:14:25.356944 master-0 kubenswrapper[35367]: I1204 12:14:25.356858 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f77f979c-d649-4b3b-8423-065f178df78a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f77f979c-d649-4b3b-8423-065f178df78a" (UID: "f77f979c-d649-4b3b-8423-065f178df78a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:14:25.357284 master-0 kubenswrapper[35367]: I1204 12:14:25.356997 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f77f979c-d649-4b3b-8423-065f178df78a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f77f979c-d649-4b3b-8423-065f178df78a" (UID: "f77f979c-d649-4b3b-8423-065f178df78a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:14:25.441312 master-0 kubenswrapper[35367]: I1204 12:14:25.441089 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zsnxz\" (UniqueName: \"kubernetes.io/projected/f77f979c-d649-4b3b-8423-065f178df78a-kube-api-access-zsnxz\") on node \"master-0\" DevicePath \"\"" Dec 04 12:14:25.441312 master-0 kubenswrapper[35367]: I1204 12:14:25.441175 35367 reconciler_common.go:293] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f77f979c-d649-4b3b-8423-065f178df78a-console-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 12:14:25.441312 master-0 kubenswrapper[35367]: I1204 12:14:25.441194 35367 reconciler_common.go:293] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-service-ca\") on node \"master-0\" DevicePath \"\"" Dec 04 12:14:25.441312 master-0 kubenswrapper[35367]: I1204 12:14:25.441206 35367 reconciler_common.go:293] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-console-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:14:25.441312 master-0 kubenswrapper[35367]: I1204 12:14:25.441225 35367 reconciler_common.go:293] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f77f979c-d649-4b3b-8423-065f178df78a-console-oauth-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:14:25.441312 master-0 kubenswrapper[35367]: I1204 12:14:25.441240 35367 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:14:25.441312 master-0 kubenswrapper[35367]: I1204 12:14:25.441255 35367 reconciler_common.go:293] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f77f979c-d649-4b3b-8423-065f178df78a-oauth-serving-cert\") on node \"master-0\" DevicePath \"\"" Dec 04 12:14:25.858143 master-0 kubenswrapper[35367]: I1204 12:14:25.858082 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6475766b4d-m2nml_f77f979c-d649-4b3b-8423-065f178df78a/console/0.log" Dec 04 12:14:25.859098 master-0 kubenswrapper[35367]: I1204 12:14:25.858207 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6475766b4d-m2nml" event={"ID":"f77f979c-d649-4b3b-8423-065f178df78a","Type":"ContainerDied","Data":"92ec620207f0b0d3e0cce1705c93c09442225d3a6887aaa4c5447ca9419c76a8"} Dec 04 12:14:25.859098 master-0 kubenswrapper[35367]: I1204 12:14:25.858473 35367 scope.go:117] "RemoveContainer" containerID="02366016008c6cba5359ad0c187422b885e7f3c0d1800817f0c8ee85ed47f48c" Dec 04 12:14:25.859098 master-0 kubenswrapper[35367]: I1204 12:14:25.858477 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6475766b4d-m2nml" Dec 04 12:14:25.863024 master-0 kubenswrapper[35367]: I1204 12:14:25.862957 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-jg8xj" event={"ID":"ebfb33ee-ee02-4120-bda7-a46817342ef2","Type":"ContainerStarted","Data":"f894db9a13a9679c12ed9237f139d7934c234ba1c75a9dd6e817d815eaf41a20"} Dec 04 12:14:25.863099 master-0 kubenswrapper[35367]: I1204 12:14:25.863053 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:25.863141 master-0 kubenswrapper[35367]: I1204 12:14:25.863106 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-storage/vg-manager-d999v" Dec 04 12:14:26.014003 master-0 kubenswrapper[35367]: I1204 12:14:26.013495 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-index-jg8xj" podStartSLOduration=2.458882458 podStartE2EDuration="4.013461202s" podCreationTimestamp="2025-12-04 12:14:22 +0000 UTC" firstStartedPulling="2025-12-04 12:14:23.329493438 +0000 UTC m=+906.767554686" lastFinishedPulling="2025-12-04 12:14:24.884072172 +0000 UTC m=+908.322133430" observedRunningTime="2025-12-04 12:14:25.977253144 +0000 UTC m=+909.415314402" watchObservedRunningTime="2025-12-04 12:14:26.013461202 +0000 UTC m=+909.451522460" Dec 04 12:14:26.031936 master-0 kubenswrapper[35367]: I1204 12:14:26.031876 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6475766b4d-m2nml"] Dec 04 12:14:26.038516 master-0 kubenswrapper[35367]: I1204 12:14:26.038464 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6475766b4d-m2nml"] Dec 04 12:14:26.759972 master-0 kubenswrapper[35367]: I1204 12:14:26.759875 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f77f979c-d649-4b3b-8423-065f178df78a" path="/var/lib/kubelet/pods/f77f979c-d649-4b3b-8423-065f178df78a/volumes" Dec 04 12:14:32.585040 master-0 kubenswrapper[35367]: I1204 12:14:32.584972 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/openstack-operator-index-jg8xj" Dec 04 12:14:32.585848 master-0 kubenswrapper[35367]: I1204 12:14:32.585831 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/openstack-operator-index-jg8xj" Dec 04 12:14:32.623331 master-0 kubenswrapper[35367]: I1204 12:14:32.622841 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/openstack-operator-index-jg8xj" Dec 04 12:14:32.961376 master-0 kubenswrapper[35367]: I1204 12:14:32.961233 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-operator-index-jg8xj" Dec 04 12:14:34.435046 master-0 kubenswrapper[35367]: I1204 12:14:34.434953 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj"] Dec 04 12:14:34.437457 master-0 kubenswrapper[35367]: E1204 12:14:34.435522 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f77f979c-d649-4b3b-8423-065f178df78a" containerName="console" Dec 04 12:14:34.437457 master-0 kubenswrapper[35367]: I1204 12:14:34.435540 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f77f979c-d649-4b3b-8423-065f178df78a" containerName="console" Dec 04 12:14:34.437457 master-0 kubenswrapper[35367]: I1204 12:14:34.435780 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="f77f979c-d649-4b3b-8423-065f178df78a" containerName="console" Dec 04 12:14:34.437457 master-0 kubenswrapper[35367]: I1204 12:14:34.437205 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj" Dec 04 12:14:34.457852 master-0 kubenswrapper[35367]: I1204 12:14:34.457762 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj"] Dec 04 12:14:34.519332 master-0 kubenswrapper[35367]: I1204 12:14:34.519209 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2a10c48-e236-4e54-8e4a-d3c5af9164b5-bundle\") pod \"917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj\" (UID: \"e2a10c48-e236-4e54-8e4a-d3c5af9164b5\") " pod="openstack-operators/917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj" Dec 04 12:14:34.519697 master-0 kubenswrapper[35367]: I1204 12:14:34.519513 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2a10c48-e236-4e54-8e4a-d3c5af9164b5-util\") pod \"917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj\" (UID: \"e2a10c48-e236-4e54-8e4a-d3c5af9164b5\") " pod="openstack-operators/917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj" Dec 04 12:14:34.519938 master-0 kubenswrapper[35367]: I1204 12:14:34.519900 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpzxc\" (UniqueName: \"kubernetes.io/projected/e2a10c48-e236-4e54-8e4a-d3c5af9164b5-kube-api-access-bpzxc\") pod \"917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj\" (UID: \"e2a10c48-e236-4e54-8e4a-d3c5af9164b5\") " pod="openstack-operators/917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj" Dec 04 12:14:34.622707 master-0 kubenswrapper[35367]: I1204 12:14:34.622590 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2a10c48-e236-4e54-8e4a-d3c5af9164b5-bundle\") pod \"917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj\" (UID: \"e2a10c48-e236-4e54-8e4a-d3c5af9164b5\") " pod="openstack-operators/917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj" Dec 04 12:14:34.623260 master-0 kubenswrapper[35367]: I1204 12:14:34.623238 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2a10c48-e236-4e54-8e4a-d3c5af9164b5-util\") pod \"917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj\" (UID: \"e2a10c48-e236-4e54-8e4a-d3c5af9164b5\") " pod="openstack-operators/917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj" Dec 04 12:14:34.623427 master-0 kubenswrapper[35367]: I1204 12:14:34.623408 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bpzxc\" (UniqueName: \"kubernetes.io/projected/e2a10c48-e236-4e54-8e4a-d3c5af9164b5-kube-api-access-bpzxc\") pod \"917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj\" (UID: \"e2a10c48-e236-4e54-8e4a-d3c5af9164b5\") " pod="openstack-operators/917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj" Dec 04 12:14:34.623909 master-0 kubenswrapper[35367]: I1204 12:14:34.623863 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2a10c48-e236-4e54-8e4a-d3c5af9164b5-util\") pod \"917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj\" (UID: \"e2a10c48-e236-4e54-8e4a-d3c5af9164b5\") " pod="openstack-operators/917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj" Dec 04 12:14:34.625014 master-0 kubenswrapper[35367]: I1204 12:14:34.624944 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2a10c48-e236-4e54-8e4a-d3c5af9164b5-bundle\") pod \"917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj\" (UID: \"e2a10c48-e236-4e54-8e4a-d3c5af9164b5\") " pod="openstack-operators/917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj" Dec 04 12:14:34.641907 master-0 kubenswrapper[35367]: I1204 12:14:34.641791 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpzxc\" (UniqueName: \"kubernetes.io/projected/e2a10c48-e236-4e54-8e4a-d3c5af9164b5-kube-api-access-bpzxc\") pod \"917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj\" (UID: \"e2a10c48-e236-4e54-8e4a-d3c5af9164b5\") " pod="openstack-operators/917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj" Dec 04 12:14:34.760272 master-0 kubenswrapper[35367]: I1204 12:14:34.759833 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj" Dec 04 12:14:35.256296 master-0 kubenswrapper[35367]: I1204 12:14:35.256235 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj"] Dec 04 12:14:35.259577 master-0 kubenswrapper[35367]: W1204 12:14:35.259516 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2a10c48_e236_4e54_8e4a_d3c5af9164b5.slice/crio-ee232bcdb339f17b876576dc1d81382859831b308160e259b4968064cbd80361 WatchSource:0}: Error finding container ee232bcdb339f17b876576dc1d81382859831b308160e259b4968064cbd80361: Status 404 returned error can't find the container with id ee232bcdb339f17b876576dc1d81382859831b308160e259b4968064cbd80361 Dec 04 12:14:35.970701 master-0 kubenswrapper[35367]: I1204 12:14:35.970628 35367 generic.go:334] "Generic (PLEG): container finished" podID="e2a10c48-e236-4e54-8e4a-d3c5af9164b5" containerID="dcac3f24c035624312b6961ac256e1ee31d8639d1312936a6f31314eb0e02cd0" exitCode=0 Dec 04 12:14:35.971345 master-0 kubenswrapper[35367]: I1204 12:14:35.970736 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj" event={"ID":"e2a10c48-e236-4e54-8e4a-d3c5af9164b5","Type":"ContainerDied","Data":"dcac3f24c035624312b6961ac256e1ee31d8639d1312936a6f31314eb0e02cd0"} Dec 04 12:14:35.971345 master-0 kubenswrapper[35367]: I1204 12:14:35.970919 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj" event={"ID":"e2a10c48-e236-4e54-8e4a-d3c5af9164b5","Type":"ContainerStarted","Data":"ee232bcdb339f17b876576dc1d81382859831b308160e259b4968064cbd80361"} Dec 04 12:14:38.008125 master-0 kubenswrapper[35367]: I1204 12:14:38.008060 35367 generic.go:334] "Generic (PLEG): container finished" podID="e2a10c48-e236-4e54-8e4a-d3c5af9164b5" containerID="c3d984ea3b4cc38c04790b074647f5d6bbc73e3d6250a72394db8a89784c8403" exitCode=0 Dec 04 12:14:38.009060 master-0 kubenswrapper[35367]: I1204 12:14:38.008196 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj" event={"ID":"e2a10c48-e236-4e54-8e4a-d3c5af9164b5","Type":"ContainerDied","Data":"c3d984ea3b4cc38c04790b074647f5d6bbc73e3d6250a72394db8a89784c8403"} Dec 04 12:14:39.021889 master-0 kubenswrapper[35367]: I1204 12:14:39.021774 35367 generic.go:334] "Generic (PLEG): container finished" podID="e2a10c48-e236-4e54-8e4a-d3c5af9164b5" containerID="0085748fc27fc638bff386e819266301830e918484e619876e5ac42942a013b0" exitCode=0 Dec 04 12:14:39.022644 master-0 kubenswrapper[35367]: I1204 12:14:39.021898 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj" event={"ID":"e2a10c48-e236-4e54-8e4a-d3c5af9164b5","Type":"ContainerDied","Data":"0085748fc27fc638bff386e819266301830e918484e619876e5ac42942a013b0"} Dec 04 12:14:40.483723 master-0 kubenswrapper[35367]: I1204 12:14:40.483659 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj" Dec 04 12:14:40.560108 master-0 kubenswrapper[35367]: I1204 12:14:40.560050 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2a10c48-e236-4e54-8e4a-d3c5af9164b5-util\") pod \"e2a10c48-e236-4e54-8e4a-d3c5af9164b5\" (UID: \"e2a10c48-e236-4e54-8e4a-d3c5af9164b5\") " Dec 04 12:14:40.560606 master-0 kubenswrapper[35367]: I1204 12:14:40.560579 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2a10c48-e236-4e54-8e4a-d3c5af9164b5-bundle\") pod \"e2a10c48-e236-4e54-8e4a-d3c5af9164b5\" (UID: \"e2a10c48-e236-4e54-8e4a-d3c5af9164b5\") " Dec 04 12:14:40.560737 master-0 kubenswrapper[35367]: I1204 12:14:40.560723 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpzxc\" (UniqueName: \"kubernetes.io/projected/e2a10c48-e236-4e54-8e4a-d3c5af9164b5-kube-api-access-bpzxc\") pod \"e2a10c48-e236-4e54-8e4a-d3c5af9164b5\" (UID: \"e2a10c48-e236-4e54-8e4a-d3c5af9164b5\") " Dec 04 12:14:40.561867 master-0 kubenswrapper[35367]: I1204 12:14:40.561789 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2a10c48-e236-4e54-8e4a-d3c5af9164b5-bundle" (OuterVolumeSpecName: "bundle") pod "e2a10c48-e236-4e54-8e4a-d3c5af9164b5" (UID: "e2a10c48-e236-4e54-8e4a-d3c5af9164b5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:14:40.574857 master-0 kubenswrapper[35367]: I1204 12:14:40.574772 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2a10c48-e236-4e54-8e4a-d3c5af9164b5-util" (OuterVolumeSpecName: "util") pod "e2a10c48-e236-4e54-8e4a-d3c5af9164b5" (UID: "e2a10c48-e236-4e54-8e4a-d3c5af9164b5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:14:40.580507 master-0 kubenswrapper[35367]: I1204 12:14:40.580426 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2a10c48-e236-4e54-8e4a-d3c5af9164b5-kube-api-access-bpzxc" (OuterVolumeSpecName: "kube-api-access-bpzxc") pod "e2a10c48-e236-4e54-8e4a-d3c5af9164b5" (UID: "e2a10c48-e236-4e54-8e4a-d3c5af9164b5"). InnerVolumeSpecName "kube-api-access-bpzxc". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:14:40.663085 master-0 kubenswrapper[35367]: I1204 12:14:40.662916 35367 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2a10c48-e236-4e54-8e4a-d3c5af9164b5-util\") on node \"master-0\" DevicePath \"\"" Dec 04 12:14:40.663085 master-0 kubenswrapper[35367]: I1204 12:14:40.662973 35367 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2a10c48-e236-4e54-8e4a-d3c5af9164b5-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:14:40.663085 master-0 kubenswrapper[35367]: I1204 12:14:40.662986 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bpzxc\" (UniqueName: \"kubernetes.io/projected/e2a10c48-e236-4e54-8e4a-d3c5af9164b5-kube-api-access-bpzxc\") on node \"master-0\" DevicePath \"\"" Dec 04 12:14:41.054433 master-0 kubenswrapper[35367]: I1204 12:14:41.054169 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj" event={"ID":"e2a10c48-e236-4e54-8e4a-d3c5af9164b5","Type":"ContainerDied","Data":"ee232bcdb339f17b876576dc1d81382859831b308160e259b4968064cbd80361"} Dec 04 12:14:41.054433 master-0 kubenswrapper[35367]: I1204 12:14:41.054238 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee232bcdb339f17b876576dc1d81382859831b308160e259b4968064cbd80361" Dec 04 12:14:41.054433 master-0 kubenswrapper[35367]: I1204 12:14:41.054415 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj" Dec 04 12:14:48.855321 master-0 kubenswrapper[35367]: I1204 12:14:48.855190 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-controller-operator-55b6fb9447-zn55t"] Dec 04 12:14:48.856138 master-0 kubenswrapper[35367]: E1204 12:14:48.855733 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e2a10c48-e236-4e54-8e4a-d3c5af9164b5" containerName="extract" Dec 04 12:14:48.856138 master-0 kubenswrapper[35367]: I1204 12:14:48.855755 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2a10c48-e236-4e54-8e4a-d3c5af9164b5" containerName="extract" Dec 04 12:14:48.856138 master-0 kubenswrapper[35367]: E1204 12:14:48.855787 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e2a10c48-e236-4e54-8e4a-d3c5af9164b5" containerName="util" Dec 04 12:14:48.856138 master-0 kubenswrapper[35367]: I1204 12:14:48.855796 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2a10c48-e236-4e54-8e4a-d3c5af9164b5" containerName="util" Dec 04 12:14:48.856138 master-0 kubenswrapper[35367]: E1204 12:14:48.855827 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e2a10c48-e236-4e54-8e4a-d3c5af9164b5" containerName="pull" Dec 04 12:14:48.856138 master-0 kubenswrapper[35367]: I1204 12:14:48.855839 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2a10c48-e236-4e54-8e4a-d3c5af9164b5" containerName="pull" Dec 04 12:14:48.856138 master-0 kubenswrapper[35367]: I1204 12:14:48.856127 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="e2a10c48-e236-4e54-8e4a-d3c5af9164b5" containerName="extract" Dec 04 12:14:48.857014 master-0 kubenswrapper[35367]: I1204 12:14:48.856979 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-55b6fb9447-zn55t" Dec 04 12:14:48.897190 master-0 kubenswrapper[35367]: I1204 12:14:48.897118 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-55b6fb9447-zn55t"] Dec 04 12:14:48.940447 master-0 kubenswrapper[35367]: I1204 12:14:48.940314 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2mnp\" (UniqueName: \"kubernetes.io/projected/4d429cd7-573d-4c85-a27d-be742ae2e801-kube-api-access-h2mnp\") pod \"openstack-operator-controller-operator-55b6fb9447-zn55t\" (UID: \"4d429cd7-573d-4c85-a27d-be742ae2e801\") " pod="openstack-operators/openstack-operator-controller-operator-55b6fb9447-zn55t" Dec 04 12:14:49.042365 master-0 kubenswrapper[35367]: I1204 12:14:49.042260 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h2mnp\" (UniqueName: \"kubernetes.io/projected/4d429cd7-573d-4c85-a27d-be742ae2e801-kube-api-access-h2mnp\") pod \"openstack-operator-controller-operator-55b6fb9447-zn55t\" (UID: \"4d429cd7-573d-4c85-a27d-be742ae2e801\") " pod="openstack-operators/openstack-operator-controller-operator-55b6fb9447-zn55t" Dec 04 12:14:49.082264 master-0 kubenswrapper[35367]: I1204 12:14:49.082198 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2mnp\" (UniqueName: \"kubernetes.io/projected/4d429cd7-573d-4c85-a27d-be742ae2e801-kube-api-access-h2mnp\") pod \"openstack-operator-controller-operator-55b6fb9447-zn55t\" (UID: \"4d429cd7-573d-4c85-a27d-be742ae2e801\") " pod="openstack-operators/openstack-operator-controller-operator-55b6fb9447-zn55t" Dec 04 12:14:49.184759 master-0 kubenswrapper[35367]: I1204 12:14:49.184564 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-55b6fb9447-zn55t" Dec 04 12:14:49.901088 master-0 kubenswrapper[35367]: I1204 12:14:49.900981 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-55b6fb9447-zn55t"] Dec 04 12:14:50.154330 master-0 kubenswrapper[35367]: I1204 12:14:50.153028 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-55b6fb9447-zn55t" event={"ID":"4d429cd7-573d-4c85-a27d-be742ae2e801","Type":"ContainerStarted","Data":"7bfaa53791499a53375d50337476bec49b0e6cf4f001a94e0ac5451937d2c5ed"} Dec 04 12:14:58.259965 master-0 kubenswrapper[35367]: I1204 12:14:58.259897 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-55b6fb9447-zn55t" event={"ID":"4d429cd7-573d-4c85-a27d-be742ae2e801","Type":"ContainerStarted","Data":"839fb26aeea441059ffe04a14a030bd9068c38619679bff874cfca71e2db01df"} Dec 04 12:14:58.260635 master-0 kubenswrapper[35367]: I1204 12:14:58.260123 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/openstack-operator-controller-operator-55b6fb9447-zn55t" Dec 04 12:14:58.309325 master-0 kubenswrapper[35367]: I1204 12:14:58.307587 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-controller-operator-55b6fb9447-zn55t" podStartSLOduration=3.088478993 podStartE2EDuration="10.307561645s" podCreationTimestamp="2025-12-04 12:14:48 +0000 UTC" firstStartedPulling="2025-12-04 12:14:49.90390862 +0000 UTC m=+933.341969878" lastFinishedPulling="2025-12-04 12:14:57.122991272 +0000 UTC m=+940.561052530" observedRunningTime="2025-12-04 12:14:58.297735861 +0000 UTC m=+941.735797119" watchObservedRunningTime="2025-12-04 12:14:58.307561645 +0000 UTC m=+941.745622903" Dec 04 12:15:00.674756 master-0 kubenswrapper[35367]: I1204 12:15:00.674675 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29414175-675jb"] Dec 04 12:15:00.676030 master-0 kubenswrapper[35367]: I1204 12:15:00.675999 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29414175-675jb" Dec 04 12:15:00.680088 master-0 kubenswrapper[35367]: I1204 12:15:00.679935 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"collect-profiles-config" Dec 04 12:15:00.680088 master-0 kubenswrapper[35367]: I1204 12:15:00.679971 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"collect-profiles-dockercfg-hd7lj" Dec 04 12:15:00.704834 master-0 kubenswrapper[35367]: I1204 12:15:00.703617 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29414175-675jb"] Dec 04 12:15:00.832018 master-0 kubenswrapper[35367]: I1204 12:15:00.831921 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/c68bdab4-36d4-44b6-af6d-82096848971f-secret-volume\") pod \"collect-profiles-29414175-675jb\" (UID: \"c68bdab4-36d4-44b6-af6d-82096848971f\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414175-675jb" Dec 04 12:15:00.832018 master-0 kubenswrapper[35367]: I1204 12:15:00.831990 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgq6p\" (UniqueName: \"kubernetes.io/projected/c68bdab4-36d4-44b6-af6d-82096848971f-kube-api-access-lgq6p\") pod \"collect-profiles-29414175-675jb\" (UID: \"c68bdab4-36d4-44b6-af6d-82096848971f\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414175-675jb" Dec 04 12:15:00.832357 master-0 kubenswrapper[35367]: I1204 12:15:00.832053 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c68bdab4-36d4-44b6-af6d-82096848971f-config-volume\") pod \"collect-profiles-29414175-675jb\" (UID: \"c68bdab4-36d4-44b6-af6d-82096848971f\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414175-675jb" Dec 04 12:15:00.934398 master-0 kubenswrapper[35367]: I1204 12:15:00.934211 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/c68bdab4-36d4-44b6-af6d-82096848971f-secret-volume\") pod \"collect-profiles-29414175-675jb\" (UID: \"c68bdab4-36d4-44b6-af6d-82096848971f\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414175-675jb" Dec 04 12:15:00.934398 master-0 kubenswrapper[35367]: I1204 12:15:00.934319 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lgq6p\" (UniqueName: \"kubernetes.io/projected/c68bdab4-36d4-44b6-af6d-82096848971f-kube-api-access-lgq6p\") pod \"collect-profiles-29414175-675jb\" (UID: \"c68bdab4-36d4-44b6-af6d-82096848971f\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414175-675jb" Dec 04 12:15:00.934398 master-0 kubenswrapper[35367]: I1204 12:15:00.934389 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c68bdab4-36d4-44b6-af6d-82096848971f-config-volume\") pod \"collect-profiles-29414175-675jb\" (UID: \"c68bdab4-36d4-44b6-af6d-82096848971f\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414175-675jb" Dec 04 12:15:00.935619 master-0 kubenswrapper[35367]: I1204 12:15:00.935579 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c68bdab4-36d4-44b6-af6d-82096848971f-config-volume\") pod \"collect-profiles-29414175-675jb\" (UID: \"c68bdab4-36d4-44b6-af6d-82096848971f\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414175-675jb" Dec 04 12:15:00.938534 master-0 kubenswrapper[35367]: I1204 12:15:00.938467 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/c68bdab4-36d4-44b6-af6d-82096848971f-secret-volume\") pod \"collect-profiles-29414175-675jb\" (UID: \"c68bdab4-36d4-44b6-af6d-82096848971f\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414175-675jb" Dec 04 12:15:01.357708 master-0 kubenswrapper[35367]: I1204 12:15:01.357405 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgq6p\" (UniqueName: \"kubernetes.io/projected/c68bdab4-36d4-44b6-af6d-82096848971f-kube-api-access-lgq6p\") pod \"collect-profiles-29414175-675jb\" (UID: \"c68bdab4-36d4-44b6-af6d-82096848971f\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414175-675jb" Dec 04 12:15:01.613145 master-0 kubenswrapper[35367]: I1204 12:15:01.611754 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29414175-675jb" Dec 04 12:15:02.324616 master-0 kubenswrapper[35367]: I1204 12:15:02.324533 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29414175-675jb"] Dec 04 12:15:02.368959 master-0 kubenswrapper[35367]: I1204 12:15:02.368851 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29414175-675jb" event={"ID":"c68bdab4-36d4-44b6-af6d-82096848971f","Type":"ContainerStarted","Data":"95aa69e51b435b1e056554ec239b9f71de890ba331d7783305714395a41bb609"} Dec 04 12:15:03.380903 master-0 kubenswrapper[35367]: I1204 12:15:03.380835 35367 generic.go:334] "Generic (PLEG): container finished" podID="c68bdab4-36d4-44b6-af6d-82096848971f" containerID="0d5ee769a7fee195d3cd3cdd4f65c6fdd4eb1b19ab478a3e252d232ca2ba3e8f" exitCode=0 Dec 04 12:15:03.380903 master-0 kubenswrapper[35367]: I1204 12:15:03.380906 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29414175-675jb" event={"ID":"c68bdab4-36d4-44b6-af6d-82096848971f","Type":"ContainerDied","Data":"0d5ee769a7fee195d3cd3cdd4f65c6fdd4eb1b19ab478a3e252d232ca2ba3e8f"} Dec 04 12:15:04.762906 master-0 kubenswrapper[35367]: I1204 12:15:04.762791 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29414175-675jb" Dec 04 12:15:04.924611 master-0 kubenswrapper[35367]: I1204 12:15:04.924428 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgq6p\" (UniqueName: \"kubernetes.io/projected/c68bdab4-36d4-44b6-af6d-82096848971f-kube-api-access-lgq6p\") pod \"c68bdab4-36d4-44b6-af6d-82096848971f\" (UID: \"c68bdab4-36d4-44b6-af6d-82096848971f\") " Dec 04 12:15:04.924611 master-0 kubenswrapper[35367]: I1204 12:15:04.924535 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/c68bdab4-36d4-44b6-af6d-82096848971f-secret-volume\") pod \"c68bdab4-36d4-44b6-af6d-82096848971f\" (UID: \"c68bdab4-36d4-44b6-af6d-82096848971f\") " Dec 04 12:15:04.925307 master-0 kubenswrapper[35367]: I1204 12:15:04.925266 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c68bdab4-36d4-44b6-af6d-82096848971f-config-volume\") pod \"c68bdab4-36d4-44b6-af6d-82096848971f\" (UID: \"c68bdab4-36d4-44b6-af6d-82096848971f\") " Dec 04 12:15:04.926024 master-0 kubenswrapper[35367]: I1204 12:15:04.925948 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c68bdab4-36d4-44b6-af6d-82096848971f-config-volume" (OuterVolumeSpecName: "config-volume") pod "c68bdab4-36d4-44b6-af6d-82096848971f" (UID: "c68bdab4-36d4-44b6-af6d-82096848971f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:15:04.926399 master-0 kubenswrapper[35367]: I1204 12:15:04.926340 35367 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c68bdab4-36d4-44b6-af6d-82096848971f-config-volume\") on node \"master-0\" DevicePath \"\"" Dec 04 12:15:04.928851 master-0 kubenswrapper[35367]: I1204 12:15:04.928744 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c68bdab4-36d4-44b6-af6d-82096848971f-kube-api-access-lgq6p" (OuterVolumeSpecName: "kube-api-access-lgq6p") pod "c68bdab4-36d4-44b6-af6d-82096848971f" (UID: "c68bdab4-36d4-44b6-af6d-82096848971f"). InnerVolumeSpecName "kube-api-access-lgq6p". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:15:04.929248 master-0 kubenswrapper[35367]: I1204 12:15:04.929170 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c68bdab4-36d4-44b6-af6d-82096848971f-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "c68bdab4-36d4-44b6-af6d-82096848971f" (UID: "c68bdab4-36d4-44b6-af6d-82096848971f"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:15:05.029033 master-0 kubenswrapper[35367]: I1204 12:15:05.028755 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lgq6p\" (UniqueName: \"kubernetes.io/projected/c68bdab4-36d4-44b6-af6d-82096848971f-kube-api-access-lgq6p\") on node \"master-0\" DevicePath \"\"" Dec 04 12:15:05.029033 master-0 kubenswrapper[35367]: I1204 12:15:05.029001 35367 reconciler_common.go:293] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/c68bdab4-36d4-44b6-af6d-82096848971f-secret-volume\") on node \"master-0\" DevicePath \"\"" Dec 04 12:15:05.403338 master-0 kubenswrapper[35367]: I1204 12:15:05.403265 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29414175-675jb" event={"ID":"c68bdab4-36d4-44b6-af6d-82096848971f","Type":"ContainerDied","Data":"95aa69e51b435b1e056554ec239b9f71de890ba331d7783305714395a41bb609"} Dec 04 12:15:05.403338 master-0 kubenswrapper[35367]: I1204 12:15:05.403335 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95aa69e51b435b1e056554ec239b9f71de890ba331d7783305714395a41bb609" Dec 04 12:15:05.403667 master-0 kubenswrapper[35367]: I1204 12:15:05.403402 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29414175-675jb" Dec 04 12:15:09.190131 master-0 kubenswrapper[35367]: I1204 12:15:09.190040 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-operator-controller-operator-55b6fb9447-zn55t" Dec 04 12:15:12.036826 master-0 kubenswrapper[35367]: I1204 12:15:12.036652 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-controller-operator-589d7b4556-d9qth"] Dec 04 12:15:12.037387 master-0 kubenswrapper[35367]: E1204 12:15:12.037124 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c68bdab4-36d4-44b6-af6d-82096848971f" containerName="collect-profiles" Dec 04 12:15:12.037387 master-0 kubenswrapper[35367]: I1204 12:15:12.037141 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="c68bdab4-36d4-44b6-af6d-82096848971f" containerName="collect-profiles" Dec 04 12:15:12.037485 master-0 kubenswrapper[35367]: I1204 12:15:12.037397 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="c68bdab4-36d4-44b6-af6d-82096848971f" containerName="collect-profiles" Dec 04 12:15:12.038569 master-0 kubenswrapper[35367]: I1204 12:15:12.038528 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-589d7b4556-d9qth" Dec 04 12:15:12.072785 master-0 kubenswrapper[35367]: I1204 12:15:12.072714 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-589d7b4556-d9qth"] Dec 04 12:15:12.131198 master-0 kubenswrapper[35367]: I1204 12:15:12.121220 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hnzx\" (UniqueName: \"kubernetes.io/projected/4c573a28-fafe-4a4c-9dff-c51bd3c4519c-kube-api-access-5hnzx\") pod \"openstack-operator-controller-operator-589d7b4556-d9qth\" (UID: \"4c573a28-fafe-4a4c-9dff-c51bd3c4519c\") " pod="openstack-operators/openstack-operator-controller-operator-589d7b4556-d9qth" Dec 04 12:15:12.222150 master-0 kubenswrapper[35367]: I1204 12:15:12.222092 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5hnzx\" (UniqueName: \"kubernetes.io/projected/4c573a28-fafe-4a4c-9dff-c51bd3c4519c-kube-api-access-5hnzx\") pod \"openstack-operator-controller-operator-589d7b4556-d9qth\" (UID: \"4c573a28-fafe-4a4c-9dff-c51bd3c4519c\") " pod="openstack-operators/openstack-operator-controller-operator-589d7b4556-d9qth" Dec 04 12:15:12.242433 master-0 kubenswrapper[35367]: I1204 12:15:12.242318 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hnzx\" (UniqueName: \"kubernetes.io/projected/4c573a28-fafe-4a4c-9dff-c51bd3c4519c-kube-api-access-5hnzx\") pod \"openstack-operator-controller-operator-589d7b4556-d9qth\" (UID: \"4c573a28-fafe-4a4c-9dff-c51bd3c4519c\") " pod="openstack-operators/openstack-operator-controller-operator-589d7b4556-d9qth" Dec 04 12:15:12.357840 master-0 kubenswrapper[35367]: I1204 12:15:12.357730 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-589d7b4556-d9qth" Dec 04 12:15:12.981445 master-0 kubenswrapper[35367]: I1204 12:15:12.981350 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-589d7b4556-d9qth"] Dec 04 12:15:12.982198 master-0 kubenswrapper[35367]: W1204 12:15:12.982130 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c573a28_fafe_4a4c_9dff_c51bd3c4519c.slice/crio-19c1fe6bad039d8428279e50d5566caf61ce83cbf61e5926ea57b62d88db5527 WatchSource:0}: Error finding container 19c1fe6bad039d8428279e50d5566caf61ce83cbf61e5926ea57b62d88db5527: Status 404 returned error can't find the container with id 19c1fe6bad039d8428279e50d5566caf61ce83cbf61e5926ea57b62d88db5527 Dec 04 12:15:13.493847 master-0 kubenswrapper[35367]: I1204 12:15:13.493773 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-589d7b4556-d9qth" event={"ID":"4c573a28-fafe-4a4c-9dff-c51bd3c4519c","Type":"ContainerStarted","Data":"4d44a67c1a8630b3c3a81724fd09c604bd967aa050b597cdd3892f5ecd20df23"} Dec 04 12:15:13.493847 master-0 kubenswrapper[35367]: I1204 12:15:13.493847 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-589d7b4556-d9qth" event={"ID":"4c573a28-fafe-4a4c-9dff-c51bd3c4519c","Type":"ContainerStarted","Data":"19c1fe6bad039d8428279e50d5566caf61ce83cbf61e5926ea57b62d88db5527"} Dec 04 12:15:13.494556 master-0 kubenswrapper[35367]: I1204 12:15:13.494120 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/openstack-operator-controller-operator-589d7b4556-d9qth" Dec 04 12:15:13.534777 master-0 kubenswrapper[35367]: I1204 12:15:13.534668 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-controller-operator-589d7b4556-d9qth" podStartSLOduration=2.534643573 podStartE2EDuration="2.534643573s" podCreationTimestamp="2025-12-04 12:15:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:15:13.531796052 +0000 UTC m=+956.969857330" watchObservedRunningTime="2025-12-04 12:15:13.534643573 +0000 UTC m=+956.972704831" Dec 04 12:15:21.782671 master-0 kubenswrapper[35367]: I1204 12:15:21.782574 35367 scope.go:117] "RemoveContainer" containerID="13599e6553dc2db648ff80f480ffab8f464630bd915ce19f875791f6c4bca59b" Dec 04 12:15:21.818637 master-0 kubenswrapper[35367]: I1204 12:15:21.818576 35367 scope.go:117] "RemoveContainer" containerID="80075ccf80a901ff3c2063889175ff290fa865853a873b055cff5eba73a5b2bf" Dec 04 12:15:21.867845 master-0 kubenswrapper[35367]: I1204 12:15:21.867296 35367 scope.go:117] "RemoveContainer" containerID="2fec0147f28de4ddeaa1abd5cf2aca66cb69d36b1c5e9cf3708b03d0119ba17b" Dec 04 12:15:21.911217 master-0 kubenswrapper[35367]: I1204 12:15:21.907321 35367 scope.go:117] "RemoveContainer" containerID="bce8e1e916fdd0eba6d72fd0da23146eebd0364aa97651c210b7b133c583d3dd" Dec 04 12:15:22.361346 master-0 kubenswrapper[35367]: I1204 12:15:22.361270 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-operator-controller-operator-589d7b4556-d9qth" Dec 04 12:15:22.608998 master-0 kubenswrapper[35367]: I1204 12:15:22.607655 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-55b6fb9447-zn55t"] Dec 04 12:15:22.608998 master-0 kubenswrapper[35367]: I1204 12:15:22.607966 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/openstack-operator-controller-operator-55b6fb9447-zn55t" podUID="4d429cd7-573d-4c85-a27d-be742ae2e801" containerName="operator" containerID="cri-o://839fb26aeea441059ffe04a14a030bd9068c38619679bff874cfca71e2db01df" gracePeriod=10 Dec 04 12:15:23.106923 master-0 kubenswrapper[35367]: I1204 12:15:23.106376 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-55b6fb9447-zn55t" Dec 04 12:15:23.193828 master-0 kubenswrapper[35367]: I1204 12:15:23.193755 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2mnp\" (UniqueName: \"kubernetes.io/projected/4d429cd7-573d-4c85-a27d-be742ae2e801-kube-api-access-h2mnp\") pod \"4d429cd7-573d-4c85-a27d-be742ae2e801\" (UID: \"4d429cd7-573d-4c85-a27d-be742ae2e801\") " Dec 04 12:15:23.197058 master-0 kubenswrapper[35367]: I1204 12:15:23.196966 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d429cd7-573d-4c85-a27d-be742ae2e801-kube-api-access-h2mnp" (OuterVolumeSpecName: "kube-api-access-h2mnp") pod "4d429cd7-573d-4c85-a27d-be742ae2e801" (UID: "4d429cd7-573d-4c85-a27d-be742ae2e801"). InnerVolumeSpecName "kube-api-access-h2mnp". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:15:23.296856 master-0 kubenswrapper[35367]: I1204 12:15:23.296580 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-h2mnp\" (UniqueName: \"kubernetes.io/projected/4d429cd7-573d-4c85-a27d-be742ae2e801-kube-api-access-h2mnp\") on node \"master-0\" DevicePath \"\"" Dec 04 12:15:23.601467 master-0 kubenswrapper[35367]: I1204 12:15:23.601404 35367 generic.go:334] "Generic (PLEG): container finished" podID="4d429cd7-573d-4c85-a27d-be742ae2e801" containerID="839fb26aeea441059ffe04a14a030bd9068c38619679bff874cfca71e2db01df" exitCode=0 Dec 04 12:15:23.601467 master-0 kubenswrapper[35367]: I1204 12:15:23.601457 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-55b6fb9447-zn55t" event={"ID":"4d429cd7-573d-4c85-a27d-be742ae2e801","Type":"ContainerDied","Data":"839fb26aeea441059ffe04a14a030bd9068c38619679bff874cfca71e2db01df"} Dec 04 12:15:23.601757 master-0 kubenswrapper[35367]: I1204 12:15:23.601498 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-55b6fb9447-zn55t" Dec 04 12:15:23.601757 master-0 kubenswrapper[35367]: I1204 12:15:23.601529 35367 scope.go:117] "RemoveContainer" containerID="839fb26aeea441059ffe04a14a030bd9068c38619679bff874cfca71e2db01df" Dec 04 12:15:23.601757 master-0 kubenswrapper[35367]: I1204 12:15:23.601512 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-55b6fb9447-zn55t" event={"ID":"4d429cd7-573d-4c85-a27d-be742ae2e801","Type":"ContainerDied","Data":"7bfaa53791499a53375d50337476bec49b0e6cf4f001a94e0ac5451937d2c5ed"} Dec 04 12:15:23.640243 master-0 kubenswrapper[35367]: I1204 12:15:23.640198 35367 scope.go:117] "RemoveContainer" containerID="839fb26aeea441059ffe04a14a030bd9068c38619679bff874cfca71e2db01df" Dec 04 12:15:23.640820 master-0 kubenswrapper[35367]: E1204 12:15:23.640764 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"839fb26aeea441059ffe04a14a030bd9068c38619679bff874cfca71e2db01df\": container with ID starting with 839fb26aeea441059ffe04a14a030bd9068c38619679bff874cfca71e2db01df not found: ID does not exist" containerID="839fb26aeea441059ffe04a14a030bd9068c38619679bff874cfca71e2db01df" Dec 04 12:15:23.640913 master-0 kubenswrapper[35367]: I1204 12:15:23.640828 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"839fb26aeea441059ffe04a14a030bd9068c38619679bff874cfca71e2db01df"} err="failed to get container status \"839fb26aeea441059ffe04a14a030bd9068c38619679bff874cfca71e2db01df\": rpc error: code = NotFound desc = could not find container \"839fb26aeea441059ffe04a14a030bd9068c38619679bff874cfca71e2db01df\": container with ID starting with 839fb26aeea441059ffe04a14a030bd9068c38619679bff874cfca71e2db01df not found: ID does not exist" Dec 04 12:15:23.664714 master-0 kubenswrapper[35367]: I1204 12:15:23.664648 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-55b6fb9447-zn55t"] Dec 04 12:15:23.673429 master-0 kubenswrapper[35367]: I1204 12:15:23.673362 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-55b6fb9447-zn55t"] Dec 04 12:15:24.760673 master-0 kubenswrapper[35367]: I1204 12:15:24.760598 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d429cd7-573d-4c85-a27d-be742ae2e801" path="/var/lib/kubelet/pods/4d429cd7-573d-4c85-a27d-be742ae2e801/volumes" Dec 04 12:16:22.085608 master-0 kubenswrapper[35367]: I1204 12:16:22.057722 35367 scope.go:117] "RemoveContainer" containerID="d13e573f6ba1085dc6e76880131407aa69cb3887e24318480bcd5c4bf129fdac" Dec 04 12:16:22.125764 master-0 kubenswrapper[35367]: I1204 12:16:22.125683 35367 scope.go:117] "RemoveContainer" containerID="b04fc8a08a419e6a27f02b0eb896686273020f4e382cc89c134f0f0c507dd793" Dec 04 12:16:31.153937 master-0 kubenswrapper[35367]: I1204 12:16:31.153864 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/barbican-operator-controller-manager-5cd89994b5-974hd"] Dec 04 12:16:31.155372 master-0 kubenswrapper[35367]: E1204 12:16:31.155342 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4d429cd7-573d-4c85-a27d-be742ae2e801" containerName="operator" Dec 04 12:16:31.155494 master-0 kubenswrapper[35367]: I1204 12:16:31.155480 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d429cd7-573d-4c85-a27d-be742ae2e801" containerName="operator" Dec 04 12:16:31.155930 master-0 kubenswrapper[35367]: I1204 12:16:31.155911 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="4d429cd7-573d-4c85-a27d-be742ae2e801" containerName="operator" Dec 04 12:16:31.159305 master-0 kubenswrapper[35367]: I1204 12:16:31.159256 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-974hd" Dec 04 12:16:31.168314 master-0 kubenswrapper[35367]: I1204 12:16:31.168249 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-5cd89994b5-974hd"] Dec 04 12:16:31.185178 master-0 kubenswrapper[35367]: I1204 12:16:31.185115 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/cinder-operator-controller-manager-f8856dd79-mfhwn"] Dec 04 12:16:31.216910 master-0 kubenswrapper[35367]: I1204 12:16:31.214848 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/designate-operator-controller-manager-84bc9f68f5-jjlq7"] Dec 04 12:16:31.216910 master-0 kubenswrapper[35367]: I1204 12:16:31.216867 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-jjlq7" Dec 04 12:16:31.217279 master-0 kubenswrapper[35367]: I1204 12:16:31.217126 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-mfhwn" Dec 04 12:16:31.250962 master-0 kubenswrapper[35367]: I1204 12:16:31.250335 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/cinder-operator-controller-manager-f8856dd79-mfhwn"] Dec 04 12:16:31.268425 master-0 kubenswrapper[35367]: I1204 12:16:31.268348 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbt6g\" (UniqueName: \"kubernetes.io/projected/8b2beff3-c98e-40a9-b02f-4bc0be3f246d-kube-api-access-xbt6g\") pod \"designate-operator-controller-manager-84bc9f68f5-jjlq7\" (UID: \"8b2beff3-c98e-40a9-b02f-4bc0be3f246d\") " pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-jjlq7" Dec 04 12:16:31.268630 master-0 kubenswrapper[35367]: I1204 12:16:31.268429 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzmk6\" (UniqueName: \"kubernetes.io/projected/52816b97-42b0-4b68-b094-4227045f15e9-kube-api-access-kzmk6\") pod \"barbican-operator-controller-manager-5cd89994b5-974hd\" (UID: \"52816b97-42b0-4b68-b094-4227045f15e9\") " pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-974hd" Dec 04 12:16:31.268630 master-0 kubenswrapper[35367]: I1204 12:16:31.268525 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86d5w\" (UniqueName: \"kubernetes.io/projected/c8387f48-c8e5-4e93-9f95-ef081bd895f7-kube-api-access-86d5w\") pod \"cinder-operator-controller-manager-f8856dd79-mfhwn\" (UID: \"c8387f48-c8e5-4e93-9f95-ef081bd895f7\") " pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-mfhwn" Dec 04 12:16:31.289086 master-0 kubenswrapper[35367]: I1204 12:16:31.287031 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/designate-operator-controller-manager-84bc9f68f5-jjlq7"] Dec 04 12:16:31.303911 master-0 kubenswrapper[35367]: I1204 12:16:31.303797 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/glance-operator-controller-manager-78cd4f7769-58c6v"] Dec 04 12:16:31.305795 master-0 kubenswrapper[35367]: I1204 12:16:31.305733 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-58c6v" Dec 04 12:16:31.350105 master-0 kubenswrapper[35367]: I1204 12:16:31.350016 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/glance-operator-controller-manager-78cd4f7769-58c6v"] Dec 04 12:16:31.368795 master-0 kubenswrapper[35367]: I1204 12:16:31.366831 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/heat-operator-controller-manager-7fd96594c7-xnrjg"] Dec 04 12:16:31.370184 master-0 kubenswrapper[35367]: I1204 12:16:31.369924 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-xnrjg" Dec 04 12:16:31.374479 master-0 kubenswrapper[35367]: I1204 12:16:31.374304 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xbt6g\" (UniqueName: \"kubernetes.io/projected/8b2beff3-c98e-40a9-b02f-4bc0be3f246d-kube-api-access-xbt6g\") pod \"designate-operator-controller-manager-84bc9f68f5-jjlq7\" (UID: \"8b2beff3-c98e-40a9-b02f-4bc0be3f246d\") " pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-jjlq7" Dec 04 12:16:31.374479 master-0 kubenswrapper[35367]: I1204 12:16:31.374409 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4579g\" (UniqueName: \"kubernetes.io/projected/4c0b68d8-54cd-4caa-8045-4eebdf756bdc-kube-api-access-4579g\") pod \"glance-operator-controller-manager-78cd4f7769-58c6v\" (UID: \"4c0b68d8-54cd-4caa-8045-4eebdf756bdc\") " pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-58c6v" Dec 04 12:16:31.374479 master-0 kubenswrapper[35367]: I1204 12:16:31.374450 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kzmk6\" (UniqueName: \"kubernetes.io/projected/52816b97-42b0-4b68-b094-4227045f15e9-kube-api-access-kzmk6\") pod \"barbican-operator-controller-manager-5cd89994b5-974hd\" (UID: \"52816b97-42b0-4b68-b094-4227045f15e9\") " pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-974hd" Dec 04 12:16:31.387990 master-0 kubenswrapper[35367]: I1204 12:16:31.374558 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-86d5w\" (UniqueName: \"kubernetes.io/projected/c8387f48-c8e5-4e93-9f95-ef081bd895f7-kube-api-access-86d5w\") pod \"cinder-operator-controller-manager-f8856dd79-mfhwn\" (UID: \"c8387f48-c8e5-4e93-9f95-ef081bd895f7\") " pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-mfhwn" Dec 04 12:16:31.405042 master-0 kubenswrapper[35367]: I1204 12:16:31.401136 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/horizon-operator-controller-manager-f6cc97788-dtxsw"] Dec 04 12:16:31.408902 master-0 kubenswrapper[35367]: I1204 12:16:31.408849 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-dtxsw" Dec 04 12:16:31.412408 master-0 kubenswrapper[35367]: I1204 12:16:31.412374 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-86d5w\" (UniqueName: \"kubernetes.io/projected/c8387f48-c8e5-4e93-9f95-ef081bd895f7-kube-api-access-86d5w\") pod \"cinder-operator-controller-manager-f8856dd79-mfhwn\" (UID: \"c8387f48-c8e5-4e93-9f95-ef081bd895f7\") " pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-mfhwn" Dec 04 12:16:31.416715 master-0 kubenswrapper[35367]: I1204 12:16:31.416659 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbt6g\" (UniqueName: \"kubernetes.io/projected/8b2beff3-c98e-40a9-b02f-4bc0be3f246d-kube-api-access-xbt6g\") pod \"designate-operator-controller-manager-84bc9f68f5-jjlq7\" (UID: \"8b2beff3-c98e-40a9-b02f-4bc0be3f246d\") " pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-jjlq7" Dec 04 12:16:31.416931 master-0 kubenswrapper[35367]: I1204 12:16:31.416872 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzmk6\" (UniqueName: \"kubernetes.io/projected/52816b97-42b0-4b68-b094-4227045f15e9-kube-api-access-kzmk6\") pod \"barbican-operator-controller-manager-5cd89994b5-974hd\" (UID: \"52816b97-42b0-4b68-b094-4227045f15e9\") " pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-974hd" Dec 04 12:16:31.446400 master-0 kubenswrapper[35367]: I1204 12:16:31.444281 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/heat-operator-controller-manager-7fd96594c7-xnrjg"] Dec 04 12:16:31.460164 master-0 kubenswrapper[35367]: I1204 12:16:31.459293 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-f6cc97788-dtxsw"] Dec 04 12:16:31.472216 master-0 kubenswrapper[35367]: I1204 12:16:31.472163 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s"] Dec 04 12:16:31.474131 master-0 kubenswrapper[35367]: I1204 12:16:31.474003 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s" Dec 04 12:16:31.481433 master-0 kubenswrapper[35367]: I1204 12:16:31.476643 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8dvs\" (UniqueName: \"kubernetes.io/projected/999f0b7d-c17f-4181-b5bc-d380540d456b-kube-api-access-m8dvs\") pod \"horizon-operator-controller-manager-f6cc97788-dtxsw\" (UID: \"999f0b7d-c17f-4181-b5bc-d380540d456b\") " pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-dtxsw" Dec 04 12:16:31.481433 master-0 kubenswrapper[35367]: I1204 12:16:31.476756 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4579g\" (UniqueName: \"kubernetes.io/projected/4c0b68d8-54cd-4caa-8045-4eebdf756bdc-kube-api-access-4579g\") pod \"glance-operator-controller-manager-78cd4f7769-58c6v\" (UID: \"4c0b68d8-54cd-4caa-8045-4eebdf756bdc\") " pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-58c6v" Dec 04 12:16:31.481433 master-0 kubenswrapper[35367]: I1204 12:16:31.476846 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69p48\" (UniqueName: \"kubernetes.io/projected/cc133071-6e0d-4b0d-bcb4-d6864efdb0ef-kube-api-access-69p48\") pod \"heat-operator-controller-manager-7fd96594c7-xnrjg\" (UID: \"cc133071-6e0d-4b0d-bcb4-d6864efdb0ef\") " pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-xnrjg" Dec 04 12:16:31.481433 master-0 kubenswrapper[35367]: I1204 12:16:31.480633 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"infra-operator-webhook-server-cert" Dec 04 12:16:31.527866 master-0 kubenswrapper[35367]: I1204 12:16:31.525746 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4579g\" (UniqueName: \"kubernetes.io/projected/4c0b68d8-54cd-4caa-8045-4eebdf756bdc-kube-api-access-4579g\") pod \"glance-operator-controller-manager-78cd4f7769-58c6v\" (UID: \"4c0b68d8-54cd-4caa-8045-4eebdf756bdc\") " pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-58c6v" Dec 04 12:16:31.534501 master-0 kubenswrapper[35367]: I1204 12:16:31.534427 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s"] Dec 04 12:16:31.551885 master-0 kubenswrapper[35367]: I1204 12:16:31.542403 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-974hd" Dec 04 12:16:31.584846 master-0 kubenswrapper[35367]: I1204 12:16:31.563594 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/ironic-operator-controller-manager-7c9bfd6967-782xf"] Dec 04 12:16:31.584846 master-0 kubenswrapper[35367]: I1204 12:16:31.566588 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-782xf" Dec 04 12:16:31.584846 master-0 kubenswrapper[35367]: I1204 12:16:31.575674 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-jjlq7" Dec 04 12:16:31.584846 master-0 kubenswrapper[35367]: I1204 12:16:31.580639 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m8dvs\" (UniqueName: \"kubernetes.io/projected/999f0b7d-c17f-4181-b5bc-d380540d456b-kube-api-access-m8dvs\") pod \"horizon-operator-controller-manager-f6cc97788-dtxsw\" (UID: \"999f0b7d-c17f-4181-b5bc-d380540d456b\") " pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-dtxsw" Dec 04 12:16:31.584846 master-0 kubenswrapper[35367]: I1204 12:16:31.580707 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51d21c61-912d-477f-a586-2bcb537015f0-cert\") pod \"infra-operator-controller-manager-7d9c9d7fd8-f228s\" (UID: \"51d21c61-912d-477f-a586-2bcb537015f0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s" Dec 04 12:16:31.584846 master-0 kubenswrapper[35367]: I1204 12:16:31.581197 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-69p48\" (UniqueName: \"kubernetes.io/projected/cc133071-6e0d-4b0d-bcb4-d6864efdb0ef-kube-api-access-69p48\") pod \"heat-operator-controller-manager-7fd96594c7-xnrjg\" (UID: \"cc133071-6e0d-4b0d-bcb4-d6864efdb0ef\") " pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-xnrjg" Dec 04 12:16:31.584846 master-0 kubenswrapper[35367]: I1204 12:16:31.581305 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5q5q\" (UniqueName: \"kubernetes.io/projected/51d21c61-912d-477f-a586-2bcb537015f0-kube-api-access-l5q5q\") pod \"infra-operator-controller-manager-7d9c9d7fd8-f228s\" (UID: \"51d21c61-912d-477f-a586-2bcb537015f0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s" Dec 04 12:16:31.633151 master-0 kubenswrapper[35367]: I1204 12:16:31.632215 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-mfhwn" Dec 04 12:16:31.646976 master-0 kubenswrapper[35367]: I1204 12:16:31.638374 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-69p48\" (UniqueName: \"kubernetes.io/projected/cc133071-6e0d-4b0d-bcb4-d6864efdb0ef-kube-api-access-69p48\") pod \"heat-operator-controller-manager-7fd96594c7-xnrjg\" (UID: \"cc133071-6e0d-4b0d-bcb4-d6864efdb0ef\") " pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-xnrjg" Dec 04 12:16:31.646976 master-0 kubenswrapper[35367]: I1204 12:16:31.638393 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8dvs\" (UniqueName: \"kubernetes.io/projected/999f0b7d-c17f-4181-b5bc-d380540d456b-kube-api-access-m8dvs\") pod \"horizon-operator-controller-manager-f6cc97788-dtxsw\" (UID: \"999f0b7d-c17f-4181-b5bc-d380540d456b\") " pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-dtxsw" Dec 04 12:16:31.646976 master-0 kubenswrapper[35367]: I1204 12:16:31.642721 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ironic-operator-controller-manager-7c9bfd6967-782xf"] Dec 04 12:16:31.657849 master-0 kubenswrapper[35367]: I1204 12:16:31.657576 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-58c6v" Dec 04 12:16:31.694830 master-0 kubenswrapper[35367]: I1204 12:16:31.683165 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l5q5q\" (UniqueName: \"kubernetes.io/projected/51d21c61-912d-477f-a586-2bcb537015f0-kube-api-access-l5q5q\") pod \"infra-operator-controller-manager-7d9c9d7fd8-f228s\" (UID: \"51d21c61-912d-477f-a586-2bcb537015f0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s" Dec 04 12:16:31.694830 master-0 kubenswrapper[35367]: I1204 12:16:31.683266 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58g4n\" (UniqueName: \"kubernetes.io/projected/5ef048b0-c28e-455e-af91-337c8cb37aba-kube-api-access-58g4n\") pod \"ironic-operator-controller-manager-7c9bfd6967-782xf\" (UID: \"5ef048b0-c28e-455e-af91-337c8cb37aba\") " pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-782xf" Dec 04 12:16:31.694830 master-0 kubenswrapper[35367]: I1204 12:16:31.683374 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51d21c61-912d-477f-a586-2bcb537015f0-cert\") pod \"infra-operator-controller-manager-7d9c9d7fd8-f228s\" (UID: \"51d21c61-912d-477f-a586-2bcb537015f0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s" Dec 04 12:16:31.694830 master-0 kubenswrapper[35367]: E1204 12:16:31.683624 35367 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Dec 04 12:16:31.694830 master-0 kubenswrapper[35367]: E1204 12:16:31.683697 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51d21c61-912d-477f-a586-2bcb537015f0-cert podName:51d21c61-912d-477f-a586-2bcb537015f0 nodeName:}" failed. No retries permitted until 2025-12-04 12:16:32.183675536 +0000 UTC m=+1035.621736794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/51d21c61-912d-477f-a586-2bcb537015f0-cert") pod "infra-operator-controller-manager-7d9c9d7fd8-f228s" (UID: "51d21c61-912d-477f-a586-2bcb537015f0") : secret "infra-operator-webhook-server-cert" not found Dec 04 12:16:31.706842 master-0 kubenswrapper[35367]: I1204 12:16:31.700000 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-bpmdw"] Dec 04 12:16:31.706842 master-0 kubenswrapper[35367]: I1204 12:16:31.702385 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-bpmdw" Dec 04 12:16:31.712829 master-0 kubenswrapper[35367]: I1204 12:16:31.711011 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-bpmdw"] Dec 04 12:16:31.745165 master-0 kubenswrapper[35367]: I1204 12:16:31.735904 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/manila-operator-controller-manager-56f9fbf74b-hq5jr"] Dec 04 12:16:31.745165 master-0 kubenswrapper[35367]: I1204 12:16:31.738768 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-hq5jr" Dec 04 12:16:31.769187 master-0 kubenswrapper[35367]: I1204 12:16:31.765263 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5q5q\" (UniqueName: \"kubernetes.io/projected/51d21c61-912d-477f-a586-2bcb537015f0-kube-api-access-l5q5q\") pod \"infra-operator-controller-manager-7d9c9d7fd8-f228s\" (UID: \"51d21c61-912d-477f-a586-2bcb537015f0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s" Dec 04 12:16:31.802832 master-0 kubenswrapper[35367]: I1204 12:16:31.791764 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj9p2\" (UniqueName: \"kubernetes.io/projected/5cf205b8-6eb2-4125-940c-ac798d0a9fcd-kube-api-access-kj9p2\") pod \"manila-operator-controller-manager-56f9fbf74b-hq5jr\" (UID: \"5cf205b8-6eb2-4125-940c-ac798d0a9fcd\") " pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-hq5jr" Dec 04 12:16:31.802832 master-0 kubenswrapper[35367]: I1204 12:16:31.791878 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-58g4n\" (UniqueName: \"kubernetes.io/projected/5ef048b0-c28e-455e-af91-337c8cb37aba-kube-api-access-58g4n\") pod \"ironic-operator-controller-manager-7c9bfd6967-782xf\" (UID: \"5ef048b0-c28e-455e-af91-337c8cb37aba\") " pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-782xf" Dec 04 12:16:31.802832 master-0 kubenswrapper[35367]: I1204 12:16:31.791970 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjxf4\" (UniqueName: \"kubernetes.io/projected/2bd1182d-69fc-4e8b-a066-1b90a559a37e-kube-api-access-cjxf4\") pod \"keystone-operator-controller-manager-58b8dcc5fb-bpmdw\" (UID: \"2bd1182d-69fc-4e8b-a066-1b90a559a37e\") " pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-bpmdw" Dec 04 12:16:31.828542 master-0 kubenswrapper[35367]: I1204 12:16:31.815570 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-xnrjg" Dec 04 12:16:31.828542 master-0 kubenswrapper[35367]: I1204 12:16:31.819904 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/manila-operator-controller-manager-56f9fbf74b-hq5jr"] Dec 04 12:16:31.835893 master-0 kubenswrapper[35367]: I1204 12:16:31.835712 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-647d75769b-8dqxm"] Dec 04 12:16:31.838283 master-0 kubenswrapper[35367]: I1204 12:16:31.837748 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-8dqxm" Dec 04 12:16:31.839383 master-0 kubenswrapper[35367]: I1204 12:16:31.839322 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-647d75769b-8dqxm"] Dec 04 12:16:31.936885 master-0 kubenswrapper[35367]: I1204 12:16:31.848491 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-4jl24"] Dec 04 12:16:31.936885 master-0 kubenswrapper[35367]: I1204 12:16:31.851586 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-4jl24" Dec 04 12:16:31.936885 master-0 kubenswrapper[35367]: I1204 12:16:31.869571 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-4jl24"] Dec 04 12:16:31.944910 master-0 kubenswrapper[35367]: I1204 12:16:31.944844 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-dtxsw" Dec 04 12:16:31.953405 master-0 kubenswrapper[35367]: I1204 12:16:31.952002 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kj9p2\" (UniqueName: \"kubernetes.io/projected/5cf205b8-6eb2-4125-940c-ac798d0a9fcd-kube-api-access-kj9p2\") pod \"manila-operator-controller-manager-56f9fbf74b-hq5jr\" (UID: \"5cf205b8-6eb2-4125-940c-ac798d0a9fcd\") " pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-hq5jr" Dec 04 12:16:31.953405 master-0 kubenswrapper[35367]: I1204 12:16:31.952220 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cjxf4\" (UniqueName: \"kubernetes.io/projected/2bd1182d-69fc-4e8b-a066-1b90a559a37e-kube-api-access-cjxf4\") pod \"keystone-operator-controller-manager-58b8dcc5fb-bpmdw\" (UID: \"2bd1182d-69fc-4e8b-a066-1b90a559a37e\") " pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-bpmdw" Dec 04 12:16:31.953405 master-0 kubenswrapper[35367]: I1204 12:16:31.952749 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4dvq\" (UniqueName: \"kubernetes.io/projected/2e7741e9-d8cb-46a0-ae9e-f6fc948cd05e-kube-api-access-b4dvq\") pod \"mariadb-operator-controller-manager-647d75769b-8dqxm\" (UID: \"2e7741e9-d8cb-46a0-ae9e-f6fc948cd05e\") " pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-8dqxm" Dec 04 12:16:31.977768 master-0 kubenswrapper[35367]: I1204 12:16:31.977704 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-58g4n\" (UniqueName: \"kubernetes.io/projected/5ef048b0-c28e-455e-af91-337c8cb37aba-kube-api-access-58g4n\") pod \"ironic-operator-controller-manager-7c9bfd6967-782xf\" (UID: \"5ef048b0-c28e-455e-af91-337c8cb37aba\") " pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-782xf" Dec 04 12:16:31.981950 master-0 kubenswrapper[35367]: I1204 12:16:31.981878 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj9p2\" (UniqueName: \"kubernetes.io/projected/5cf205b8-6eb2-4125-940c-ac798d0a9fcd-kube-api-access-kj9p2\") pod \"manila-operator-controller-manager-56f9fbf74b-hq5jr\" (UID: \"5cf205b8-6eb2-4125-940c-ac798d0a9fcd\") " pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-hq5jr" Dec 04 12:16:32.045102 master-0 kubenswrapper[35367]: I1204 12:16:32.024251 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/nova-operator-controller-manager-865fc86d5b-fd78q"] Dec 04 12:16:32.045102 master-0 kubenswrapper[35367]: I1204 12:16:32.027031 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-fd78q" Dec 04 12:16:32.045102 master-0 kubenswrapper[35367]: I1204 12:16:32.037640 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-782xf" Dec 04 12:16:32.045102 master-0 kubenswrapper[35367]: I1204 12:16:32.037990 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/nova-operator-controller-manager-865fc86d5b-fd78q"] Dec 04 12:16:32.049562 master-0 kubenswrapper[35367]: I1204 12:16:32.049240 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz"] Dec 04 12:16:32.051761 master-0 kubenswrapper[35367]: I1204 12:16:32.051710 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" Dec 04 12:16:32.054291 master-0 kubenswrapper[35367]: I1204 12:16:32.054235 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcdwr\" (UniqueName: \"kubernetes.io/projected/e16e68f5-a79c-4a58-82e8-bd8b713f038d-kube-api-access-kcdwr\") pod \"neutron-operator-controller-manager-7cdd6b54fb-4jl24\" (UID: \"e16e68f5-a79c-4a58-82e8-bd8b713f038d\") " pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-4jl24" Dec 04 12:16:32.054509 master-0 kubenswrapper[35367]: I1204 12:16:32.054470 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b4dvq\" (UniqueName: \"kubernetes.io/projected/2e7741e9-d8cb-46a0-ae9e-f6fc948cd05e-kube-api-access-b4dvq\") pod \"mariadb-operator-controller-manager-647d75769b-8dqxm\" (UID: \"2e7741e9-d8cb-46a0-ae9e-f6fc948cd05e\") " pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-8dqxm" Dec 04 12:16:32.077310 master-0 kubenswrapper[35367]: I1204 12:16:32.062056 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz"] Dec 04 12:16:32.092565 master-0 kubenswrapper[35367]: I1204 12:16:32.085862 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4dvq\" (UniqueName: \"kubernetes.io/projected/2e7741e9-d8cb-46a0-ae9e-f6fc948cd05e-kube-api-access-b4dvq\") pod \"mariadb-operator-controller-manager-647d75769b-8dqxm\" (UID: \"2e7741e9-d8cb-46a0-ae9e-f6fc948cd05e\") " pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-8dqxm" Dec 04 12:16:32.092565 master-0 kubenswrapper[35367]: I1204 12:16:32.090379 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjxf4\" (UniqueName: \"kubernetes.io/projected/2bd1182d-69fc-4e8b-a066-1b90a559a37e-kube-api-access-cjxf4\") pod \"keystone-operator-controller-manager-58b8dcc5fb-bpmdw\" (UID: \"2bd1182d-69fc-4e8b-a066-1b90a559a37e\") " pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-bpmdw" Dec 04 12:16:32.110785 master-0 kubenswrapper[35367]: I1204 12:16:32.109909 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr"] Dec 04 12:16:32.111608 master-0 kubenswrapper[35367]: I1204 12:16:32.111564 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr"] Dec 04 12:16:32.111696 master-0 kubenswrapper[35367]: I1204 12:16:32.111669 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" Dec 04 12:16:32.122205 master-0 kubenswrapper[35367]: I1204 12:16:32.117206 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"openstack-baremetal-operator-webhook-server-cert" Dec 04 12:16:32.122205 master-0 kubenswrapper[35367]: I1204 12:16:32.121951 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/ovn-operator-controller-manager-647f96877-75x24"] Dec 04 12:16:32.122205 master-0 kubenswrapper[35367]: I1204 12:16:32.122069 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-hq5jr" Dec 04 12:16:32.139010 master-0 kubenswrapper[35367]: I1204 12:16:32.138927 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ovn-operator-controller-manager-647f96877-75x24" Dec 04 12:16:32.139265 master-0 kubenswrapper[35367]: I1204 12:16:32.139118 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/placement-operator-controller-manager-6b64f6f645-rddjv"] Dec 04 12:16:32.141874 master-0 kubenswrapper[35367]: I1204 12:16:32.141597 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-rddjv" Dec 04 12:16:32.154990 master-0 kubenswrapper[35367]: I1204 12:16:32.153992 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ovn-operator-controller-manager-647f96877-75x24"] Dec 04 12:16:32.157467 master-0 kubenswrapper[35367]: I1204 12:16:32.157415 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhh4n\" (UniqueName: \"kubernetes.io/projected/8beee1a8-f0f8-4694-9268-2975634b957f-kube-api-access-nhh4n\") pod \"nova-operator-controller-manager-865fc86d5b-fd78q\" (UID: \"8beee1a8-f0f8-4694-9268-2975634b957f\") " pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-fd78q" Dec 04 12:16:32.157588 master-0 kubenswrapper[35367]: I1204 12:16:32.157470 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmjnw\" (UniqueName: \"kubernetes.io/projected/f922e155-4868-4b3d-957c-2dd92adaa421-kube-api-access-hmjnw\") pod \"octavia-operator-controller-manager-845b79dc4f-rs4fz\" (UID: \"f922e155-4868-4b3d-957c-2dd92adaa421\") " pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" Dec 04 12:16:32.157588 master-0 kubenswrapper[35367]: I1204 12:16:32.157529 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kcdwr\" (UniqueName: \"kubernetes.io/projected/e16e68f5-a79c-4a58-82e8-bd8b713f038d-kube-api-access-kcdwr\") pod \"neutron-operator-controller-manager-7cdd6b54fb-4jl24\" (UID: \"e16e68f5-a79c-4a58-82e8-bd8b713f038d\") " pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-4jl24" Dec 04 12:16:32.163312 master-0 kubenswrapper[35367]: I1204 12:16:32.157626 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmbx7\" (UniqueName: \"kubernetes.io/projected/630b55ba-da80-4068-8496-ba94b5b904dd-kube-api-access-fmbx7\") pod \"openstack-baremetal-operator-controller-manager-6f998f5746f9gjr\" (UID: \"630b55ba-da80-4068-8496-ba94b5b904dd\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" Dec 04 12:16:32.163312 master-0 kubenswrapper[35367]: I1204 12:16:32.157671 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/630b55ba-da80-4068-8496-ba94b5b904dd-cert\") pod \"openstack-baremetal-operator-controller-manager-6f998f5746f9gjr\" (UID: \"630b55ba-da80-4068-8496-ba94b5b904dd\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" Dec 04 12:16:32.168377 master-0 kubenswrapper[35367]: I1204 12:16:32.168256 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/placement-operator-controller-manager-6b64f6f645-rddjv"] Dec 04 12:16:32.187305 master-0 kubenswrapper[35367]: I1204 12:16:32.187170 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-8dqxm" Dec 04 12:16:32.196886 master-0 kubenswrapper[35367]: I1204 12:16:32.196826 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/swift-operator-controller-manager-696b999796-p6w8q"] Dec 04 12:16:32.199238 master-0 kubenswrapper[35367]: I1204 12:16:32.199182 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/swift-operator-controller-manager-696b999796-p6w8q" Dec 04 12:16:32.215086 master-0 kubenswrapper[35367]: I1204 12:16:32.214964 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcdwr\" (UniqueName: \"kubernetes.io/projected/e16e68f5-a79c-4a58-82e8-bd8b713f038d-kube-api-access-kcdwr\") pod \"neutron-operator-controller-manager-7cdd6b54fb-4jl24\" (UID: \"e16e68f5-a79c-4a58-82e8-bd8b713f038d\") " pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-4jl24" Dec 04 12:16:32.239412 master-0 kubenswrapper[35367]: I1204 12:16:32.239225 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/swift-operator-controller-manager-696b999796-p6w8q"] Dec 04 12:16:32.252625 master-0 kubenswrapper[35367]: I1204 12:16:32.252570 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-tfj67"] Dec 04 12:16:32.255055 master-0 kubenswrapper[35367]: I1204 12:16:32.255018 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-tfj67" Dec 04 12:16:32.259557 master-0 kubenswrapper[35367]: I1204 12:16:32.259290 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fmbx7\" (UniqueName: \"kubernetes.io/projected/630b55ba-da80-4068-8496-ba94b5b904dd-kube-api-access-fmbx7\") pod \"openstack-baremetal-operator-controller-manager-6f998f5746f9gjr\" (UID: \"630b55ba-da80-4068-8496-ba94b5b904dd\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" Dec 04 12:16:32.259557 master-0 kubenswrapper[35367]: I1204 12:16:32.259357 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvftz\" (UniqueName: \"kubernetes.io/projected/6e86224d-4627-446e-8adb-3dfcac8c5f1d-kube-api-access-vvftz\") pod \"ovn-operator-controller-manager-647f96877-75x24\" (UID: \"6e86224d-4627-446e-8adb-3dfcac8c5f1d\") " pod="openstack-operators/ovn-operator-controller-manager-647f96877-75x24" Dec 04 12:16:32.259557 master-0 kubenswrapper[35367]: I1204 12:16:32.259399 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/630b55ba-da80-4068-8496-ba94b5b904dd-cert\") pod \"openstack-baremetal-operator-controller-manager-6f998f5746f9gjr\" (UID: \"630b55ba-da80-4068-8496-ba94b5b904dd\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" Dec 04 12:16:32.259557 master-0 kubenswrapper[35367]: I1204 12:16:32.259435 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-242dc\" (UniqueName: \"kubernetes.io/projected/df328c4b-0c79-4c10-868e-7e1529b7d915-kube-api-access-242dc\") pod \"placement-operator-controller-manager-6b64f6f645-rddjv\" (UID: \"df328c4b-0c79-4c10-868e-7e1529b7d915\") " pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-rddjv" Dec 04 12:16:32.259557 master-0 kubenswrapper[35367]: I1204 12:16:32.259476 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51d21c61-912d-477f-a586-2bcb537015f0-cert\") pod \"infra-operator-controller-manager-7d9c9d7fd8-f228s\" (UID: \"51d21c61-912d-477f-a586-2bcb537015f0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s" Dec 04 12:16:32.259953 master-0 kubenswrapper[35367]: I1204 12:16:32.259574 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nhh4n\" (UniqueName: \"kubernetes.io/projected/8beee1a8-f0f8-4694-9268-2975634b957f-kube-api-access-nhh4n\") pod \"nova-operator-controller-manager-865fc86d5b-fd78q\" (UID: \"8beee1a8-f0f8-4694-9268-2975634b957f\") " pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-fd78q" Dec 04 12:16:32.259953 master-0 kubenswrapper[35367]: I1204 12:16:32.259611 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hmjnw\" (UniqueName: \"kubernetes.io/projected/f922e155-4868-4b3d-957c-2dd92adaa421-kube-api-access-hmjnw\") pod \"octavia-operator-controller-manager-845b79dc4f-rs4fz\" (UID: \"f922e155-4868-4b3d-957c-2dd92adaa421\") " pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" Dec 04 12:16:32.259953 master-0 kubenswrapper[35367]: I1204 12:16:32.259658 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx6nx\" (UniqueName: \"kubernetes.io/projected/562a0e89-0415-487b-9521-7b6b9cfd2900-kube-api-access-qx6nx\") pod \"swift-operator-controller-manager-696b999796-p6w8q\" (UID: \"562a0e89-0415-487b-9521-7b6b9cfd2900\") " pod="openstack-operators/swift-operator-controller-manager-696b999796-p6w8q" Dec 04 12:16:32.260536 master-0 kubenswrapper[35367]: E1204 12:16:32.260497 35367 secret.go:189] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 12:16:32.260614 master-0 kubenswrapper[35367]: E1204 12:16:32.260557 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/630b55ba-da80-4068-8496-ba94b5b904dd-cert podName:630b55ba-da80-4068-8496-ba94b5b904dd nodeName:}" failed. No retries permitted until 2025-12-04 12:16:32.760537245 +0000 UTC m=+1036.198598523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/630b55ba-da80-4068-8496-ba94b5b904dd-cert") pod "openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" (UID: "630b55ba-da80-4068-8496-ba94b5b904dd") : secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 12:16:32.260694 master-0 kubenswrapper[35367]: E1204 12:16:32.260615 35367 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Dec 04 12:16:32.260694 master-0 kubenswrapper[35367]: E1204 12:16:32.260638 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51d21c61-912d-477f-a586-2bcb537015f0-cert podName:51d21c61-912d-477f-a586-2bcb537015f0 nodeName:}" failed. No retries permitted until 2025-12-04 12:16:33.260630588 +0000 UTC m=+1036.698691846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/51d21c61-912d-477f-a586-2bcb537015f0-cert") pod "infra-operator-controller-manager-7d9c9d7fd8-f228s" (UID: "51d21c61-912d-477f-a586-2bcb537015f0") : secret "infra-operator-webhook-server-cert" not found Dec 04 12:16:32.328281 master-0 kubenswrapper[35367]: I1204 12:16:32.284920 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-tfj67"] Dec 04 12:16:32.328281 master-0 kubenswrapper[35367]: I1204 12:16:32.290886 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/test-operator-controller-manager-57dfcdd5b8-twtzz"] Dec 04 12:16:32.328281 master-0 kubenswrapper[35367]: I1204 12:16:32.291428 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-4jl24" Dec 04 12:16:32.328281 master-0 kubenswrapper[35367]: I1204 12:16:32.293120 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-twtzz" Dec 04 12:16:32.328281 master-0 kubenswrapper[35367]: I1204 12:16:32.311380 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/test-operator-controller-manager-57dfcdd5b8-twtzz"] Dec 04 12:16:32.328281 master-0 kubenswrapper[35367]: I1204 12:16:32.321530 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/watcher-operator-controller-manager-6b9b669fdb-jsphj"] Dec 04 12:16:32.328281 master-0 kubenswrapper[35367]: I1204 12:16:32.324029 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-jsphj" Dec 04 12:16:32.335257 master-0 kubenswrapper[35367]: I1204 12:16:32.334911 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/watcher-operator-controller-manager-6b9b669fdb-jsphj"] Dec 04 12:16:32.353887 master-0 kubenswrapper[35367]: I1204 12:16:32.350279 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-bpmdw" Dec 04 12:16:32.387580 master-0 kubenswrapper[35367]: I1204 12:16:32.367334 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrs7x\" (UniqueName: \"kubernetes.io/projected/76310716-4fa1-4845-b419-b69491ce14a9-kube-api-access-zrs7x\") pod \"test-operator-controller-manager-57dfcdd5b8-twtzz\" (UID: \"76310716-4fa1-4845-b419-b69491ce14a9\") " pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-twtzz" Dec 04 12:16:32.387580 master-0 kubenswrapper[35367]: I1204 12:16:32.367553 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn8tz\" (UniqueName: \"kubernetes.io/projected/9faf72f1-4e12-4790-8fdc-ee65a67f3598-kube-api-access-mn8tz\") pod \"telemetry-operator-controller-manager-7b5867bfc7-tfj67\" (UID: \"9faf72f1-4e12-4790-8fdc-ee65a67f3598\") " pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-tfj67" Dec 04 12:16:32.387580 master-0 kubenswrapper[35367]: I1204 12:16:32.367638 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qx6nx\" (UniqueName: \"kubernetes.io/projected/562a0e89-0415-487b-9521-7b6b9cfd2900-kube-api-access-qx6nx\") pod \"swift-operator-controller-manager-696b999796-p6w8q\" (UID: \"562a0e89-0415-487b-9521-7b6b9cfd2900\") " pod="openstack-operators/swift-operator-controller-manager-696b999796-p6w8q" Dec 04 12:16:32.387580 master-0 kubenswrapper[35367]: I1204 12:16:32.387204 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vvftz\" (UniqueName: \"kubernetes.io/projected/6e86224d-4627-446e-8adb-3dfcac8c5f1d-kube-api-access-vvftz\") pod \"ovn-operator-controller-manager-647f96877-75x24\" (UID: \"6e86224d-4627-446e-8adb-3dfcac8c5f1d\") " pod="openstack-operators/ovn-operator-controller-manager-647f96877-75x24" Dec 04 12:16:32.387580 master-0 kubenswrapper[35367]: I1204 12:16:32.387352 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-242dc\" (UniqueName: \"kubernetes.io/projected/df328c4b-0c79-4c10-868e-7e1529b7d915-kube-api-access-242dc\") pod \"placement-operator-controller-manager-6b64f6f645-rddjv\" (UID: \"df328c4b-0c79-4c10-868e-7e1529b7d915\") " pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-rddjv" Dec 04 12:16:32.393851 master-0 kubenswrapper[35367]: I1204 12:16:32.389087 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhh4n\" (UniqueName: \"kubernetes.io/projected/8beee1a8-f0f8-4694-9268-2975634b957f-kube-api-access-nhh4n\") pod \"nova-operator-controller-manager-865fc86d5b-fd78q\" (UID: \"8beee1a8-f0f8-4694-9268-2975634b957f\") " pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-fd78q" Dec 04 12:16:32.393851 master-0 kubenswrapper[35367]: I1204 12:16:32.390039 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmbx7\" (UniqueName: \"kubernetes.io/projected/630b55ba-da80-4068-8496-ba94b5b904dd-kube-api-access-fmbx7\") pod \"openstack-baremetal-operator-controller-manager-6f998f5746f9gjr\" (UID: \"630b55ba-da80-4068-8496-ba94b5b904dd\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" Dec 04 12:16:32.452760 master-0 kubenswrapper[35367]: I1204 12:16:32.427038 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmjnw\" (UniqueName: \"kubernetes.io/projected/f922e155-4868-4b3d-957c-2dd92adaa421-kube-api-access-hmjnw\") pod \"octavia-operator-controller-manager-845b79dc4f-rs4fz\" (UID: \"f922e155-4868-4b3d-957c-2dd92adaa421\") " pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" Dec 04 12:16:32.477736 master-0 kubenswrapper[35367]: I1204 12:16:32.461101 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvftz\" (UniqueName: \"kubernetes.io/projected/6e86224d-4627-446e-8adb-3dfcac8c5f1d-kube-api-access-vvftz\") pod \"ovn-operator-controller-manager-647f96877-75x24\" (UID: \"6e86224d-4627-446e-8adb-3dfcac8c5f1d\") " pod="openstack-operators/ovn-operator-controller-manager-647f96877-75x24" Dec 04 12:16:32.477736 master-0 kubenswrapper[35367]: I1204 12:16:32.473792 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-242dc\" (UniqueName: \"kubernetes.io/projected/df328c4b-0c79-4c10-868e-7e1529b7d915-kube-api-access-242dc\") pod \"placement-operator-controller-manager-6b64f6f645-rddjv\" (UID: \"df328c4b-0c79-4c10-868e-7e1529b7d915\") " pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-rddjv" Dec 04 12:16:32.532515 master-0 kubenswrapper[35367]: I1204 12:16:32.478993 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx6nx\" (UniqueName: \"kubernetes.io/projected/562a0e89-0415-487b-9521-7b6b9cfd2900-kube-api-access-qx6nx\") pod \"swift-operator-controller-manager-696b999796-p6w8q\" (UID: \"562a0e89-0415-487b-9521-7b6b9cfd2900\") " pod="openstack-operators/swift-operator-controller-manager-696b999796-p6w8q" Dec 04 12:16:32.532515 master-0 kubenswrapper[35367]: I1204 12:16:32.498008 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zrs7x\" (UniqueName: \"kubernetes.io/projected/76310716-4fa1-4845-b419-b69491ce14a9-kube-api-access-zrs7x\") pod \"test-operator-controller-manager-57dfcdd5b8-twtzz\" (UID: \"76310716-4fa1-4845-b419-b69491ce14a9\") " pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-twtzz" Dec 04 12:16:32.532515 master-0 kubenswrapper[35367]: I1204 12:16:32.498094 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mn8tz\" (UniqueName: \"kubernetes.io/projected/9faf72f1-4e12-4790-8fdc-ee65a67f3598-kube-api-access-mn8tz\") pod \"telemetry-operator-controller-manager-7b5867bfc7-tfj67\" (UID: \"9faf72f1-4e12-4790-8fdc-ee65a67f3598\") " pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-tfj67" Dec 04 12:16:32.532515 master-0 kubenswrapper[35367]: I1204 12:16:32.498184 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt94t\" (UniqueName: \"kubernetes.io/projected/66974e9b-e7c0-4f10-9123-a6817ae99df0-kube-api-access-nt94t\") pod \"watcher-operator-controller-manager-6b9b669fdb-jsphj\" (UID: \"66974e9b-e7c0-4f10-9123-a6817ae99df0\") " pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-jsphj" Dec 04 12:16:32.532515 master-0 kubenswrapper[35367]: I1204 12:16:32.527107 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ovn-operator-controller-manager-647f96877-75x24" Dec 04 12:16:32.544076 master-0 kubenswrapper[35367]: I1204 12:16:32.543977 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-rddjv" Dec 04 12:16:32.559179 master-0 kubenswrapper[35367]: I1204 12:16:32.559118 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/swift-operator-controller-manager-696b999796-p6w8q" Dec 04 12:16:32.581646 master-0 kubenswrapper[35367]: I1204 12:16:32.581495 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn8tz\" (UniqueName: \"kubernetes.io/projected/9faf72f1-4e12-4790-8fdc-ee65a67f3598-kube-api-access-mn8tz\") pod \"telemetry-operator-controller-manager-7b5867bfc7-tfj67\" (UID: \"9faf72f1-4e12-4790-8fdc-ee65a67f3598\") " pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-tfj67" Dec 04 12:16:32.582533 master-0 kubenswrapper[35367]: I1204 12:16:32.582491 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrs7x\" (UniqueName: \"kubernetes.io/projected/76310716-4fa1-4845-b419-b69491ce14a9-kube-api-access-zrs7x\") pod \"test-operator-controller-manager-57dfcdd5b8-twtzz\" (UID: \"76310716-4fa1-4845-b419-b69491ce14a9\") " pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-twtzz" Dec 04 12:16:32.798298 master-0 kubenswrapper[35367]: I1204 12:16:32.798057 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" Dec 04 12:16:32.802491 master-0 kubenswrapper[35367]: I1204 12:16:32.799654 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-fd78q" Dec 04 12:16:32.809454 master-0 kubenswrapper[35367]: I1204 12:16:32.809332 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-twtzz" Dec 04 12:16:32.814372 master-0 kubenswrapper[35367]: I1204 12:16:32.813798 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-tfj67" Dec 04 12:16:32.826511 master-0 kubenswrapper[35367]: I1204 12:16:32.826242 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nt94t\" (UniqueName: \"kubernetes.io/projected/66974e9b-e7c0-4f10-9123-a6817ae99df0-kube-api-access-nt94t\") pod \"watcher-operator-controller-manager-6b9b669fdb-jsphj\" (UID: \"66974e9b-e7c0-4f10-9123-a6817ae99df0\") " pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-jsphj" Dec 04 12:16:32.831719 master-0 kubenswrapper[35367]: I1204 12:16:32.827713 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/630b55ba-da80-4068-8496-ba94b5b904dd-cert\") pod \"openstack-baremetal-operator-controller-manager-6f998f5746f9gjr\" (UID: \"630b55ba-da80-4068-8496-ba94b5b904dd\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" Dec 04 12:16:32.831719 master-0 kubenswrapper[35367]: E1204 12:16:32.830690 35367 secret.go:189] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 12:16:32.831719 master-0 kubenswrapper[35367]: E1204 12:16:32.831031 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/630b55ba-da80-4068-8496-ba94b5b904dd-cert podName:630b55ba-da80-4068-8496-ba94b5b904dd nodeName:}" failed. No retries permitted until 2025-12-04 12:16:33.830954978 +0000 UTC m=+1037.269016246 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/630b55ba-da80-4068-8496-ba94b5b904dd-cert") pod "openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" (UID: "630b55ba-da80-4068-8496-ba94b5b904dd") : secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 12:16:33.279011 master-0 kubenswrapper[35367]: I1204 12:16:33.278350 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51d21c61-912d-477f-a586-2bcb537015f0-cert\") pod \"infra-operator-controller-manager-7d9c9d7fd8-f228s\" (UID: \"51d21c61-912d-477f-a586-2bcb537015f0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s" Dec 04 12:16:33.279011 master-0 kubenswrapper[35367]: E1204 12:16:33.278827 35367 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Dec 04 12:16:33.279011 master-0 kubenswrapper[35367]: E1204 12:16:33.278899 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51d21c61-912d-477f-a586-2bcb537015f0-cert podName:51d21c61-912d-477f-a586-2bcb537015f0 nodeName:}" failed. No retries permitted until 2025-12-04 12:16:35.278879677 +0000 UTC m=+1038.716940935 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/51d21c61-912d-477f-a586-2bcb537015f0-cert") pod "infra-operator-controller-manager-7d9c9d7fd8-f228s" (UID: "51d21c61-912d-477f-a586-2bcb537015f0") : secret "infra-operator-webhook-server-cert" not found Dec 04 12:16:33.989710 master-0 kubenswrapper[35367]: I1204 12:16:33.989470 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/630b55ba-da80-4068-8496-ba94b5b904dd-cert\") pod \"openstack-baremetal-operator-controller-manager-6f998f5746f9gjr\" (UID: \"630b55ba-da80-4068-8496-ba94b5b904dd\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" Dec 04 12:16:33.991096 master-0 kubenswrapper[35367]: E1204 12:16:33.990370 35367 secret.go:189] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 12:16:33.991096 master-0 kubenswrapper[35367]: E1204 12:16:33.990499 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/630b55ba-da80-4068-8496-ba94b5b904dd-cert podName:630b55ba-da80-4068-8496-ba94b5b904dd nodeName:}" failed. No retries permitted until 2025-12-04 12:16:35.99047035 +0000 UTC m=+1039.428531608 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/630b55ba-da80-4068-8496-ba94b5b904dd-cert") pod "openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" (UID: "630b55ba-da80-4068-8496-ba94b5b904dd") : secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 12:16:34.053273 master-0 kubenswrapper[35367]: I1204 12:16:34.052778 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-5cd89994b5-974hd"] Dec 04 12:16:34.082998 master-0 kubenswrapper[35367]: I1204 12:16:34.082132 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt94t\" (UniqueName: \"kubernetes.io/projected/66974e9b-e7c0-4f10-9123-a6817ae99df0-kube-api-access-nt94t\") pod \"watcher-operator-controller-manager-6b9b669fdb-jsphj\" (UID: \"66974e9b-e7c0-4f10-9123-a6817ae99df0\") " pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-jsphj" Dec 04 12:16:34.214123 master-0 kubenswrapper[35367]: I1204 12:16:34.210866 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-jsphj" Dec 04 12:16:34.290969 master-0 kubenswrapper[35367]: W1204 12:16:34.277956 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52816b97_42b0_4b68_b094_4227045f15e9.slice/crio-263e6af1cb50f08a7cda510f7fdfc83da7af9d2964b1c9628d58351a195aee11 WatchSource:0}: Error finding container 263e6af1cb50f08a7cda510f7fdfc83da7af9d2964b1c9628d58351a195aee11: Status 404 returned error can't find the container with id 263e6af1cb50f08a7cda510f7fdfc83da7af9d2964b1c9628d58351a195aee11 Dec 04 12:16:34.290969 master-0 kubenswrapper[35367]: I1204 12:16:34.290188 35367 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Dec 04 12:16:34.443480 master-0 kubenswrapper[35367]: I1204 12:16:34.442910 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj"] Dec 04 12:16:34.445707 master-0 kubenswrapper[35367]: I1204 12:16:34.444727 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:16:34.447067 master-0 kubenswrapper[35367]: I1204 12:16:34.447011 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-974hd" event={"ID":"52816b97-42b0-4b68-b094-4227045f15e9","Type":"ContainerStarted","Data":"263e6af1cb50f08a7cda510f7fdfc83da7af9d2964b1c9628d58351a195aee11"} Dec 04 12:16:34.450362 master-0 kubenswrapper[35367]: I1204 12:16:34.450319 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"metrics-server-cert" Dec 04 12:16:34.450592 master-0 kubenswrapper[35367]: I1204 12:16:34.450575 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"webhook-server-cert" Dec 04 12:16:34.514668 master-0 kubenswrapper[35367]: I1204 12:16:34.512887 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-metrics-certs\") pod \"openstack-operator-controller-manager-599cfccd85-dgvwj\" (UID: \"31c4a06b-1baa-47a3-8d51-b2127c215fe8\") " pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:16:34.514668 master-0 kubenswrapper[35367]: I1204 12:16:34.513025 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxjgh\" (UniqueName: \"kubernetes.io/projected/31c4a06b-1baa-47a3-8d51-b2127c215fe8-kube-api-access-qxjgh\") pod \"openstack-operator-controller-manager-599cfccd85-dgvwj\" (UID: \"31c4a06b-1baa-47a3-8d51-b2127c215fe8\") " pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:16:34.514668 master-0 kubenswrapper[35367]: I1204 12:16:34.513221 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-webhook-certs\") pod \"openstack-operator-controller-manager-599cfccd85-dgvwj\" (UID: \"31c4a06b-1baa-47a3-8d51-b2127c215fe8\") " pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:16:34.535721 master-0 kubenswrapper[35367]: I1204 12:16:34.532792 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj"] Dec 04 12:16:34.619613 master-0 kubenswrapper[35367]: I1204 12:16:34.619187 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-metrics-certs\") pod \"openstack-operator-controller-manager-599cfccd85-dgvwj\" (UID: \"31c4a06b-1baa-47a3-8d51-b2127c215fe8\") " pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:16:34.619613 master-0 kubenswrapper[35367]: I1204 12:16:34.619260 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qxjgh\" (UniqueName: \"kubernetes.io/projected/31c4a06b-1baa-47a3-8d51-b2127c215fe8-kube-api-access-qxjgh\") pod \"openstack-operator-controller-manager-599cfccd85-dgvwj\" (UID: \"31c4a06b-1baa-47a3-8d51-b2127c215fe8\") " pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:16:34.619781 master-0 kubenswrapper[35367]: I1204 12:16:34.619746 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-webhook-certs\") pod \"openstack-operator-controller-manager-599cfccd85-dgvwj\" (UID: \"31c4a06b-1baa-47a3-8d51-b2127c215fe8\") " pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:16:34.639562 master-0 kubenswrapper[35367]: E1204 12:16:34.620035 35367 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Dec 04 12:16:34.639562 master-0 kubenswrapper[35367]: E1204 12:16:34.620118 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-webhook-certs podName:31c4a06b-1baa-47a3-8d51-b2127c215fe8 nodeName:}" failed. No retries permitted until 2025-12-04 12:16:35.120096235 +0000 UTC m=+1038.558157493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-webhook-certs") pod "openstack-operator-controller-manager-599cfccd85-dgvwj" (UID: "31c4a06b-1baa-47a3-8d51-b2127c215fe8") : secret "webhook-server-cert" not found Dec 04 12:16:34.639562 master-0 kubenswrapper[35367]: E1204 12:16:34.620291 35367 secret.go:189] Couldn't get secret openstack-operators/metrics-server-cert: secret "metrics-server-cert" not found Dec 04 12:16:34.639562 master-0 kubenswrapper[35367]: E1204 12:16:34.620322 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-metrics-certs podName:31c4a06b-1baa-47a3-8d51-b2127c215fe8 nodeName:}" failed. No retries permitted until 2025-12-04 12:16:35.120311421 +0000 UTC m=+1038.558372679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-metrics-certs") pod "openstack-operator-controller-manager-599cfccd85-dgvwj" (UID: "31c4a06b-1baa-47a3-8d51-b2127c215fe8") : secret "metrics-server-cert" not found Dec 04 12:16:35.150707 master-0 kubenswrapper[35367]: I1204 12:16:35.150629 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-metrics-certs\") pod \"openstack-operator-controller-manager-599cfccd85-dgvwj\" (UID: \"31c4a06b-1baa-47a3-8d51-b2127c215fe8\") " pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:16:35.151016 master-0 kubenswrapper[35367]: I1204 12:16:35.150780 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-webhook-certs\") pod \"openstack-operator-controller-manager-599cfccd85-dgvwj\" (UID: \"31c4a06b-1baa-47a3-8d51-b2127c215fe8\") " pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:16:35.151016 master-0 kubenswrapper[35367]: E1204 12:16:35.150935 35367 secret.go:189] Couldn't get secret openstack-operators/metrics-server-cert: secret "metrics-server-cert" not found Dec 04 12:16:35.151129 master-0 kubenswrapper[35367]: E1204 12:16:35.151068 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-metrics-certs podName:31c4a06b-1baa-47a3-8d51-b2127c215fe8 nodeName:}" failed. No retries permitted until 2025-12-04 12:16:36.151041726 +0000 UTC m=+1039.589103024 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-metrics-certs") pod "openstack-operator-controller-manager-599cfccd85-dgvwj" (UID: "31c4a06b-1baa-47a3-8d51-b2127c215fe8") : secret "metrics-server-cert" not found Dec 04 12:16:35.151129 master-0 kubenswrapper[35367]: E1204 12:16:35.151086 35367 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Dec 04 12:16:35.151235 master-0 kubenswrapper[35367]: E1204 12:16:35.151164 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-webhook-certs podName:31c4a06b-1baa-47a3-8d51-b2127c215fe8 nodeName:}" failed. No retries permitted until 2025-12-04 12:16:36.151140199 +0000 UTC m=+1039.589201507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-webhook-certs") pod "openstack-operator-controller-manager-599cfccd85-dgvwj" (UID: "31c4a06b-1baa-47a3-8d51-b2127c215fe8") : secret "webhook-server-cert" not found Dec 04 12:16:35.358768 master-0 kubenswrapper[35367]: I1204 12:16:35.357614 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51d21c61-912d-477f-a586-2bcb537015f0-cert\") pod \"infra-operator-controller-manager-7d9c9d7fd8-f228s\" (UID: \"51d21c61-912d-477f-a586-2bcb537015f0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s" Dec 04 12:16:35.361422 master-0 kubenswrapper[35367]: E1204 12:16:35.360235 35367 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Dec 04 12:16:35.361422 master-0 kubenswrapper[35367]: E1204 12:16:35.360348 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51d21c61-912d-477f-a586-2bcb537015f0-cert podName:51d21c61-912d-477f-a586-2bcb537015f0 nodeName:}" failed. No retries permitted until 2025-12-04 12:16:39.360322452 +0000 UTC m=+1042.798383700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/51d21c61-912d-477f-a586-2bcb537015f0-cert") pod "infra-operator-controller-manager-7d9c9d7fd8-f228s" (UID: "51d21c61-912d-477f-a586-2bcb537015f0") : secret "infra-operator-webhook-server-cert" not found Dec 04 12:16:35.379628 master-0 kubenswrapper[35367]: I1204 12:16:35.379566 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxjgh\" (UniqueName: \"kubernetes.io/projected/31c4a06b-1baa-47a3-8d51-b2127c215fe8-kube-api-access-qxjgh\") pod \"openstack-operator-controller-manager-599cfccd85-dgvwj\" (UID: \"31c4a06b-1baa-47a3-8d51-b2127c215fe8\") " pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:16:35.420583 master-0 kubenswrapper[35367]: I1204 12:16:35.420285 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/glance-operator-controller-manager-78cd4f7769-58c6v"] Dec 04 12:16:35.437246 master-0 kubenswrapper[35367]: I1204 12:16:35.432954 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/cinder-operator-controller-manager-f8856dd79-mfhwn"] Dec 04 12:16:35.437246 master-0 kubenswrapper[35367]: W1204 12:16:35.434189 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8387f48_c8e5_4e93_9f95_ef081bd895f7.slice/crio-ed0ebcb859a592c29e805b2d1be03635f143ad8e959fa91a1611da390d74a7f2 WatchSource:0}: Error finding container ed0ebcb859a592c29e805b2d1be03635f143ad8e959fa91a1611da390d74a7f2: Status 404 returned error can't find the container with id ed0ebcb859a592c29e805b2d1be03635f143ad8e959fa91a1611da390d74a7f2 Dec 04 12:16:35.479664 master-0 kubenswrapper[35367]: I1204 12:16:35.479446 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-f6cc97788-dtxsw"] Dec 04 12:16:35.492397 master-0 kubenswrapper[35367]: I1204 12:16:35.491898 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-58c6v" event={"ID":"4c0b68d8-54cd-4caa-8045-4eebdf756bdc","Type":"ContainerStarted","Data":"93724b0b18ae5a3cb1579bcbdf93e4609e9b70fd1561ec648598e79281308161"} Dec 04 12:16:35.495187 master-0 kubenswrapper[35367]: I1204 12:16:35.494830 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-mfhwn" event={"ID":"c8387f48-c8e5-4e93-9f95-ef081bd895f7","Type":"ContainerStarted","Data":"ed0ebcb859a592c29e805b2d1be03635f143ad8e959fa91a1611da390d74a7f2"} Dec 04 12:16:35.736119 master-0 kubenswrapper[35367]: I1204 12:16:35.736037 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/designate-operator-controller-manager-84bc9f68f5-jjlq7"] Dec 04 12:16:35.756122 master-0 kubenswrapper[35367]: I1204 12:16:35.756044 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-tfj67"] Dec 04 12:16:35.783075 master-0 kubenswrapper[35367]: I1204 12:16:35.782996 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/manila-operator-controller-manager-56f9fbf74b-hq5jr"] Dec 04 12:16:35.987957 master-0 kubenswrapper[35367]: I1204 12:16:35.987894 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-4jl24"] Dec 04 12:16:36.006119 master-0 kubenswrapper[35367]: I1204 12:16:36.005978 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/heat-operator-controller-manager-7fd96594c7-xnrjg"] Dec 04 12:16:36.020413 master-0 kubenswrapper[35367]: I1204 12:16:36.020291 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/nova-operator-controller-manager-865fc86d5b-fd78q"] Dec 04 12:16:36.039040 master-0 kubenswrapper[35367]: I1204 12:16:36.038986 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ironic-operator-controller-manager-7c9bfd6967-782xf"] Dec 04 12:16:36.098014 master-0 kubenswrapper[35367]: I1204 12:16:36.096959 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/630b55ba-da80-4068-8496-ba94b5b904dd-cert\") pod \"openstack-baremetal-operator-controller-manager-6f998f5746f9gjr\" (UID: \"630b55ba-da80-4068-8496-ba94b5b904dd\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" Dec 04 12:16:36.098014 master-0 kubenswrapper[35367]: E1204 12:16:36.097146 35367 secret.go:189] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 12:16:36.098014 master-0 kubenswrapper[35367]: E1204 12:16:36.097202 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/630b55ba-da80-4068-8496-ba94b5b904dd-cert podName:630b55ba-da80-4068-8496-ba94b5b904dd nodeName:}" failed. No retries permitted until 2025-12-04 12:16:40.097182832 +0000 UTC m=+1043.535244090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/630b55ba-da80-4068-8496-ba94b5b904dd-cert") pod "openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" (UID: "630b55ba-da80-4068-8496-ba94b5b904dd") : secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 12:16:36.202842 master-0 kubenswrapper[35367]: I1204 12:16:36.201328 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-metrics-certs\") pod \"openstack-operator-controller-manager-599cfccd85-dgvwj\" (UID: \"31c4a06b-1baa-47a3-8d51-b2127c215fe8\") " pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:16:36.202842 master-0 kubenswrapper[35367]: I1204 12:16:36.202787 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-webhook-certs\") pod \"openstack-operator-controller-manager-599cfccd85-dgvwj\" (UID: \"31c4a06b-1baa-47a3-8d51-b2127c215fe8\") " pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:16:36.203260 master-0 kubenswrapper[35367]: E1204 12:16:36.203224 35367 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Dec 04 12:16:36.203327 master-0 kubenswrapper[35367]: E1204 12:16:36.203307 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-webhook-certs podName:31c4a06b-1baa-47a3-8d51-b2127c215fe8 nodeName:}" failed. No retries permitted until 2025-12-04 12:16:38.203284111 +0000 UTC m=+1041.641345369 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-webhook-certs") pod "openstack-operator-controller-manager-599cfccd85-dgvwj" (UID: "31c4a06b-1baa-47a3-8d51-b2127c215fe8") : secret "webhook-server-cert" not found Dec 04 12:16:36.207761 master-0 kubenswrapper[35367]: E1204 12:16:36.203375 35367 secret.go:189] Couldn't get secret openstack-operators/metrics-server-cert: secret "metrics-server-cert" not found Dec 04 12:16:36.207761 master-0 kubenswrapper[35367]: E1204 12:16:36.203408 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-metrics-certs podName:31c4a06b-1baa-47a3-8d51-b2127c215fe8 nodeName:}" failed. No retries permitted until 2025-12-04 12:16:38.203398985 +0000 UTC m=+1041.641460243 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-metrics-certs") pod "openstack-operator-controller-manager-599cfccd85-dgvwj" (UID: "31c4a06b-1baa-47a3-8d51-b2127c215fe8") : secret "metrics-server-cert" not found Dec 04 12:16:36.258828 master-0 kubenswrapper[35367]: I1204 12:16:36.250181 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-647d75769b-8dqxm"] Dec 04 12:16:36.264368 master-0 kubenswrapper[35367]: W1204 12:16:36.261772 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf328c4b_0c79_4c10_868e_7e1529b7d915.slice/crio-434e82c536dc2adbfa7833696c20e9c07fbcbd8cdc3f94db4a7c34fa4fa56fb8 WatchSource:0}: Error finding container 434e82c536dc2adbfa7833696c20e9c07fbcbd8cdc3f94db4a7c34fa4fa56fb8: Status 404 returned error can't find the container with id 434e82c536dc2adbfa7833696c20e9c07fbcbd8cdc3f94db4a7c34fa4fa56fb8 Dec 04 12:16:36.264368 master-0 kubenswrapper[35367]: W1204 12:16:36.263234 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bd1182d_69fc_4e8b_a066_1b90a559a37e.slice/crio-16a9b3a9c100980eae0ea86d6582b520173f3d65ccdfd75b708d5bea8964715c WatchSource:0}: Error finding container 16a9b3a9c100980eae0ea86d6582b520173f3d65ccdfd75b708d5bea8964715c: Status 404 returned error can't find the container with id 16a9b3a9c100980eae0ea86d6582b520173f3d65ccdfd75b708d5bea8964715c Dec 04 12:16:36.269749 master-0 kubenswrapper[35367]: E1204 12:16:36.269658 35367 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/placement-operator@sha256:d29650b006da97eb9178fcc58f2eb9fead8c2b414fac18f86a3c3a1507488c4f,Command:[/manager],Args:[--leader-elect --health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:50,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:30,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:10,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},EnvVar{Name:METRICS_CERTS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-242dc,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod placement-operator-controller-manager-6b64f6f645-rddjv_openstack-operators(df328c4b-0c79-4c10-868e-7e1529b7d915): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Dec 04 12:16:36.269898 master-0 kubenswrapper[35367]: E1204 12:16:36.269788 35367 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/keystone-operator@sha256:72ad6517987f674af0d0ae092cbb874aeae909c8b8b60188099c311762ebc8f7,Command:[/manager],Args:[--leader-elect --health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:50,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:30,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:10,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},EnvVar{Name:METRICS_CERTS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-cjxf4,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod keystone-operator-controller-manager-58b8dcc5fb-bpmdw_openstack-operators(2bd1182d-69fc-4e8b-a066-1b90a559a37e): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Dec 04 12:16:36.275318 master-0 kubenswrapper[35367]: E1204 12:16:36.272024 35367 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:kube-rbac-proxy,Image:quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0,Command:[],Args:[--secure-listen-address=0.0.0.0:8443 --upstream=http://127.0.0.1:8080/ --logtostderr=true --v=0],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:8443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Requests:ResourceList{cpu: {{5 -3} {} 5m DecimalSI},memory: {{67108864 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-cjxf4,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod keystone-operator-controller-manager-58b8dcc5fb-bpmdw_openstack-operators(2bd1182d-69fc-4e8b-a066-1b90a559a37e): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Dec 04 12:16:36.275318 master-0 kubenswrapper[35367]: I1204 12:16:36.273319 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-bpmdw"] Dec 04 12:16:36.275318 master-0 kubenswrapper[35367]: E1204 12:16:36.273683 35367 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:kube-rbac-proxy,Image:quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0,Command:[],Args:[--secure-listen-address=0.0.0.0:8443 --upstream=http://127.0.0.1:8080/ --logtostderr=true --v=0],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:8443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Requests:ResourceList{cpu: {{5 -3} {} 5m DecimalSI},memory: {{67108864 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-242dc,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod placement-operator-controller-manager-6b64f6f645-rddjv_openstack-operators(df328c4b-0c79-4c10-868e-7e1529b7d915): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Dec 04 12:16:36.275318 master-0 kubenswrapper[35367]: E1204 12:16:36.273320 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy\" with ErrImagePull: \"pull QPS exceeded\"]" pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-bpmdw" podUID="2bd1182d-69fc-4e8b-a066-1b90a559a37e" Dec 04 12:16:36.275318 master-0 kubenswrapper[35367]: E1204 12:16:36.275033 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy\" with ErrImagePull: \"pull QPS exceeded\"]" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-rddjv" podUID="df328c4b-0c79-4c10-868e-7e1529b7d915" Dec 04 12:16:36.293506 master-0 kubenswrapper[35367]: W1204 12:16:36.293419 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf922e155_4868_4b3d_957c_2dd92adaa421.slice/crio-1a1a1915ab5ba20c0b0be8f01f8d70b9551620a9e2e97ddb76f922934333e08c WatchSource:0}: Error finding container 1a1a1915ab5ba20c0b0be8f01f8d70b9551620a9e2e97ddb76f922934333e08c: Status 404 returned error can't find the container with id 1a1a1915ab5ba20c0b0be8f01f8d70b9551620a9e2e97ddb76f922934333e08c Dec 04 12:16:36.294372 master-0 kubenswrapper[35367]: I1204 12:16:36.294319 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/placement-operator-controller-manager-6b64f6f645-rddjv"] Dec 04 12:16:36.296273 master-0 kubenswrapper[35367]: E1204 12:16:36.296180 35367 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/octavia-operator@sha256:d9a3694865a7d54ee96397add18c3898886e98d079aa20876a0f4de1fa7a7168,Command:[/manager],Args:[--leader-elect --health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:50,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:30,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:10,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},EnvVar{Name:METRICS_CERTS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-hmjnw,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod octavia-operator-controller-manager-845b79dc4f-rs4fz_openstack-operators(f922e155-4868-4b3d-957c-2dd92adaa421): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Dec 04 12:16:36.298356 master-0 kubenswrapper[35367]: E1204 12:16:36.298309 35367 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:kube-rbac-proxy,Image:quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0,Command:[],Args:[--secure-listen-address=0.0.0.0:8443 --upstream=http://127.0.0.1:8080/ --logtostderr=true --v=0],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:8443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Requests:ResourceList{cpu: {{5 -3} {} 5m DecimalSI},memory: {{67108864 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-hmjnw,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod octavia-operator-controller-manager-845b79dc4f-rs4fz_openstack-operators(f922e155-4868-4b3d-957c-2dd92adaa421): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Dec 04 12:16:36.299524 master-0 kubenswrapper[35367]: E1204 12:16:36.299466 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy\" with ErrImagePull: \"pull QPS exceeded\"]" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" podUID="f922e155-4868-4b3d-957c-2dd92adaa421" Dec 04 12:16:36.303464 master-0 kubenswrapper[35367]: I1204 12:16:36.303395 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ovn-operator-controller-manager-647f96877-75x24"] Dec 04 12:16:36.312445 master-0 kubenswrapper[35367]: I1204 12:16:36.312349 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/test-operator-controller-manager-57dfcdd5b8-twtzz"] Dec 04 12:16:36.332020 master-0 kubenswrapper[35367]: I1204 12:16:36.330840 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/swift-operator-controller-manager-696b999796-p6w8q"] Dec 04 12:16:36.351002 master-0 kubenswrapper[35367]: W1204 12:16:36.349330 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66974e9b_e7c0_4f10_9123_a6817ae99df0.slice/crio-40be68220f97f2d3f4cd422716aa903a41ee2482cf90ed7e794895e85276853b WatchSource:0}: Error finding container 40be68220f97f2d3f4cd422716aa903a41ee2482cf90ed7e794895e85276853b: Status 404 returned error can't find the container with id 40be68220f97f2d3f4cd422716aa903a41ee2482cf90ed7e794895e85276853b Dec 04 12:16:36.355449 master-0 kubenswrapper[35367]: E1204 12:16:36.355227 35367 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/watcher-operator@sha256:9aa8c03633e4b934c57868c1660acf47e7d386ac86bcb344df262c9ad76b8621,Command:[/manager],Args:[--leader-elect --health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:50,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:30,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:10,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},EnvVar{Name:METRICS_CERTS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-nt94t,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod watcher-operator-controller-manager-6b9b669fdb-jsphj_openstack-operators(66974e9b-e7c0-4f10-9123-a6817ae99df0): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Dec 04 12:16:36.357581 master-0 kubenswrapper[35367]: E1204 12:16:36.357475 35367 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:kube-rbac-proxy,Image:quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0,Command:[],Args:[--secure-listen-address=0.0.0.0:8443 --upstream=http://127.0.0.1:8080/ --logtostderr=true --v=0],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:8443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Requests:ResourceList{cpu: {{5 -3} {} 5m DecimalSI},memory: {{67108864 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-nt94t,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod watcher-operator-controller-manager-6b9b669fdb-jsphj_openstack-operators(66974e9b-e7c0-4f10-9123-a6817ae99df0): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Dec 04 12:16:36.359555 master-0 kubenswrapper[35367]: E1204 12:16:36.358971 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy\" with ErrImagePull: \"pull QPS exceeded\"]" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-jsphj" podUID="66974e9b-e7c0-4f10-9123-a6817ae99df0" Dec 04 12:16:36.363719 master-0 kubenswrapper[35367]: I1204 12:16:36.361169 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-94dl9"] Dec 04 12:16:36.363719 master-0 kubenswrapper[35367]: I1204 12:16:36.363133 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-94dl9" Dec 04 12:16:36.373324 master-0 kubenswrapper[35367]: I1204 12:16:36.373237 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz"] Dec 04 12:16:36.381533 master-0 kubenswrapper[35367]: I1204 12:16:36.381455 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-94dl9"] Dec 04 12:16:36.391223 master-0 kubenswrapper[35367]: I1204 12:16:36.391129 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/watcher-operator-controller-manager-6b9b669fdb-jsphj"] Dec 04 12:16:36.407408 master-0 kubenswrapper[35367]: I1204 12:16:36.407278 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bfmq\" (UniqueName: \"kubernetes.io/projected/0c15399c-01fa-4f9d-a60d-da38611e976a-kube-api-access-4bfmq\") pod \"rabbitmq-cluster-operator-manager-78955d896f-94dl9\" (UID: \"0c15399c-01fa-4f9d-a60d-da38611e976a\") " pod="openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-94dl9" Dec 04 12:16:36.510433 master-0 kubenswrapper[35367]: I1204 12:16:36.510268 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4bfmq\" (UniqueName: \"kubernetes.io/projected/0c15399c-01fa-4f9d-a60d-da38611e976a-kube-api-access-4bfmq\") pod \"rabbitmq-cluster-operator-manager-78955d896f-94dl9\" (UID: \"0c15399c-01fa-4f9d-a60d-da38611e976a\") " pod="openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-94dl9" Dec 04 12:16:36.511776 master-0 kubenswrapper[35367]: I1204 12:16:36.511714 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-4jl24" event={"ID":"e16e68f5-a79c-4a58-82e8-bd8b713f038d","Type":"ContainerStarted","Data":"35b595633420f7a01f4480f0ec8980144698cc3d6e56db9c41275c075fcd0145"} Dec 04 12:16:36.515721 master-0 kubenswrapper[35367]: I1204 12:16:36.515610 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-bpmdw" event={"ID":"2bd1182d-69fc-4e8b-a066-1b90a559a37e","Type":"ContainerStarted","Data":"16a9b3a9c100980eae0ea86d6582b520173f3d65ccdfd75b708d5bea8964715c"} Dec 04 12:16:36.518250 master-0 kubenswrapper[35367]: E1204 12:16:36.518202 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/keystone-operator@sha256:72ad6517987f674af0d0ae092cbb874aeae909c8b8b60188099c311762ebc8f7\\\"\", failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"]" pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-bpmdw" podUID="2bd1182d-69fc-4e8b-a066-1b90a559a37e" Dec 04 12:16:36.518514 master-0 kubenswrapper[35367]: I1204 12:16:36.518473 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-dtxsw" event={"ID":"999f0b7d-c17f-4181-b5bc-d380540d456b","Type":"ContainerStarted","Data":"66fff7ec93ba491f613467e78fa550ef08b1e3a56dc4a1be6581fda4715d07d3"} Dec 04 12:16:36.520168 master-0 kubenswrapper[35367]: I1204 12:16:36.520107 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ovn-operator-controller-manager-647f96877-75x24" event={"ID":"6e86224d-4627-446e-8adb-3dfcac8c5f1d","Type":"ContainerStarted","Data":"5c512f75371aa66282993ed0f69d0676bf9fec3430a32c022763843fe5662549"} Dec 04 12:16:36.521962 master-0 kubenswrapper[35367]: I1204 12:16:36.521875 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-jsphj" event={"ID":"66974e9b-e7c0-4f10-9123-a6817ae99df0","Type":"ContainerStarted","Data":"40be68220f97f2d3f4cd422716aa903a41ee2482cf90ed7e794895e85276853b"} Dec 04 12:16:36.523336 master-0 kubenswrapper[35367]: I1204 12:16:36.523264 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-782xf" event={"ID":"5ef048b0-c28e-455e-af91-337c8cb37aba","Type":"ContainerStarted","Data":"1fd9ec21364a4675ac410d943f99b60760f4383af5b14bed970f3154adbd792c"} Dec 04 12:16:36.525716 master-0 kubenswrapper[35367]: E1204 12:16:36.524964 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/watcher-operator@sha256:9aa8c03633e4b934c57868c1660acf47e7d386ac86bcb344df262c9ad76b8621\\\"\", failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"]" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-jsphj" podUID="66974e9b-e7c0-4f10-9123-a6817ae99df0" Dec 04 12:16:36.525909 master-0 kubenswrapper[35367]: I1204 12:16:36.525866 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/swift-operator-controller-manager-696b999796-p6w8q" event={"ID":"562a0e89-0415-487b-9521-7b6b9cfd2900","Type":"ContainerStarted","Data":"f915cc4ba0164c4d01301b4be661e9a612a3439ce407360acfd0823f4ea2e2fd"} Dec 04 12:16:36.527353 master-0 kubenswrapper[35367]: I1204 12:16:36.527268 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-fd78q" event={"ID":"8beee1a8-f0f8-4694-9268-2975634b957f","Type":"ContainerStarted","Data":"97a7d97eec84374caaf1410f1e8c9ceaa0c1b6cef3a57efcf0afc5765c0800c3"} Dec 04 12:16:36.528991 master-0 kubenswrapper[35367]: I1204 12:16:36.528904 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-hq5jr" event={"ID":"5cf205b8-6eb2-4125-940c-ac798d0a9fcd","Type":"ContainerStarted","Data":"669044ddb6d45be1b5883479a169aee33b8699f96320aa6b6203fbd7baf627b1"} Dec 04 12:16:36.533832 master-0 kubenswrapper[35367]: I1204 12:16:36.533666 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-jjlq7" event={"ID":"8b2beff3-c98e-40a9-b02f-4bc0be3f246d","Type":"ContainerStarted","Data":"30e5a7c262966f2b62434ed005e95edf087940efbe9e940c760bd60af487a532"} Dec 04 12:16:36.536927 master-0 kubenswrapper[35367]: I1204 12:16:36.536839 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-xnrjg" event={"ID":"cc133071-6e0d-4b0d-bcb4-d6864efdb0ef","Type":"ContainerStarted","Data":"5db31ff8efeb7d460394aff3553742fb0145d95ef10c9493d8cbe6ecff6ab90c"} Dec 04 12:16:36.539290 master-0 kubenswrapper[35367]: I1204 12:16:36.539148 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-twtzz" event={"ID":"76310716-4fa1-4845-b419-b69491ce14a9","Type":"ContainerStarted","Data":"d48f0453257d1e77e35ff90ebeb7d81f8f130090fb7764f2a14f037e295f7def"} Dec 04 12:16:36.540883 master-0 kubenswrapper[35367]: I1204 12:16:36.540781 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" event={"ID":"f922e155-4868-4b3d-957c-2dd92adaa421","Type":"ContainerStarted","Data":"1a1a1915ab5ba20c0b0be8f01f8d70b9551620a9e2e97ddb76f922934333e08c"} Dec 04 12:16:36.544283 master-0 kubenswrapper[35367]: I1204 12:16:36.544192 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-tfj67" event={"ID":"9faf72f1-4e12-4790-8fdc-ee65a67f3598","Type":"ContainerStarted","Data":"cf6eae3789e16667a3280e940a9e879fa38a839dc845e7edf0e208142a021dc3"} Dec 04 12:16:36.544283 master-0 kubenswrapper[35367]: E1204 12:16:36.544203 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/octavia-operator@sha256:d9a3694865a7d54ee96397add18c3898886e98d079aa20876a0f4de1fa7a7168\\\"\", failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"]" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" podUID="f922e155-4868-4b3d-957c-2dd92adaa421" Dec 04 12:16:36.546638 master-0 kubenswrapper[35367]: I1204 12:16:36.546487 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-8dqxm" event={"ID":"2e7741e9-d8cb-46a0-ae9e-f6fc948cd05e","Type":"ContainerStarted","Data":"a3e4efabe67ff15f1095b8411537c6e055076015f01b737034ccdef78c1e022a"} Dec 04 12:16:36.549469 master-0 kubenswrapper[35367]: I1204 12:16:36.549398 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-rddjv" event={"ID":"df328c4b-0c79-4c10-868e-7e1529b7d915","Type":"ContainerStarted","Data":"434e82c536dc2adbfa7833696c20e9c07fbcbd8cdc3f94db4a7c34fa4fa56fb8"} Dec 04 12:16:36.553682 master-0 kubenswrapper[35367]: E1204 12:16:36.553597 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/placement-operator@sha256:d29650b006da97eb9178fcc58f2eb9fead8c2b414fac18f86a3c3a1507488c4f\\\"\", failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"]" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-rddjv" podUID="df328c4b-0c79-4c10-868e-7e1529b7d915" Dec 04 12:16:37.184317 master-0 kubenswrapper[35367]: I1204 12:16:37.184223 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bfmq\" (UniqueName: \"kubernetes.io/projected/0c15399c-01fa-4f9d-a60d-da38611e976a-kube-api-access-4bfmq\") pod \"rabbitmq-cluster-operator-manager-78955d896f-94dl9\" (UID: \"0c15399c-01fa-4f9d-a60d-da38611e976a\") " pod="openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-94dl9" Dec 04 12:16:37.301635 master-0 kubenswrapper[35367]: I1204 12:16:37.301545 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-94dl9" Dec 04 12:16:37.563350 master-0 kubenswrapper[35367]: E1204 12:16:37.563268 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/watcher-operator@sha256:9aa8c03633e4b934c57868c1660acf47e7d386ac86bcb344df262c9ad76b8621\\\"\", failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"]" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-jsphj" podUID="66974e9b-e7c0-4f10-9123-a6817ae99df0" Dec 04 12:16:37.563794 master-0 kubenswrapper[35367]: E1204 12:16:37.563335 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/placement-operator@sha256:d29650b006da97eb9178fcc58f2eb9fead8c2b414fac18f86a3c3a1507488c4f\\\"\", failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"]" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-rddjv" podUID="df328c4b-0c79-4c10-868e-7e1529b7d915" Dec 04 12:16:37.564100 master-0 kubenswrapper[35367]: E1204 12:16:37.563875 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/octavia-operator@sha256:d9a3694865a7d54ee96397add18c3898886e98d079aa20876a0f4de1fa7a7168\\\"\", failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"]" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" podUID="f922e155-4868-4b3d-957c-2dd92adaa421" Dec 04 12:16:37.566473 master-0 kubenswrapper[35367]: E1204 12:16:37.566403 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/keystone-operator@sha256:72ad6517987f674af0d0ae092cbb874aeae909c8b8b60188099c311762ebc8f7\\\"\", failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"]" pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-bpmdw" podUID="2bd1182d-69fc-4e8b-a066-1b90a559a37e" Dec 04 12:16:38.262171 master-0 kubenswrapper[35367]: I1204 12:16:38.262081 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-webhook-certs\") pod \"openstack-operator-controller-manager-599cfccd85-dgvwj\" (UID: \"31c4a06b-1baa-47a3-8d51-b2127c215fe8\") " pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:16:38.262439 master-0 kubenswrapper[35367]: I1204 12:16:38.262410 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-metrics-certs\") pod \"openstack-operator-controller-manager-599cfccd85-dgvwj\" (UID: \"31c4a06b-1baa-47a3-8d51-b2127c215fe8\") " pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:16:38.262491 master-0 kubenswrapper[35367]: E1204 12:16:38.262396 35367 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Dec 04 12:16:38.262567 master-0 kubenswrapper[35367]: E1204 12:16:38.262537 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-webhook-certs podName:31c4a06b-1baa-47a3-8d51-b2127c215fe8 nodeName:}" failed. No retries permitted until 2025-12-04 12:16:42.262517445 +0000 UTC m=+1045.700578703 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-webhook-certs") pod "openstack-operator-controller-manager-599cfccd85-dgvwj" (UID: "31c4a06b-1baa-47a3-8d51-b2127c215fe8") : secret "webhook-server-cert" not found Dec 04 12:16:38.262818 master-0 kubenswrapper[35367]: E1204 12:16:38.262735 35367 secret.go:189] Couldn't get secret openstack-operators/metrics-server-cert: secret "metrics-server-cert" not found Dec 04 12:16:38.262954 master-0 kubenswrapper[35367]: E1204 12:16:38.262927 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-metrics-certs podName:31c4a06b-1baa-47a3-8d51-b2127c215fe8 nodeName:}" failed. No retries permitted until 2025-12-04 12:16:42.262856736 +0000 UTC m=+1045.700918044 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-metrics-certs") pod "openstack-operator-controller-manager-599cfccd85-dgvwj" (UID: "31c4a06b-1baa-47a3-8d51-b2127c215fe8") : secret "metrics-server-cert" not found Dec 04 12:16:39.405368 master-0 kubenswrapper[35367]: I1204 12:16:39.405093 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51d21c61-912d-477f-a586-2bcb537015f0-cert\") pod \"infra-operator-controller-manager-7d9c9d7fd8-f228s\" (UID: \"51d21c61-912d-477f-a586-2bcb537015f0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s" Dec 04 12:16:39.405368 master-0 kubenswrapper[35367]: E1204 12:16:39.405350 35367 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Dec 04 12:16:39.406042 master-0 kubenswrapper[35367]: E1204 12:16:39.405456 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51d21c61-912d-477f-a586-2bcb537015f0-cert podName:51d21c61-912d-477f-a586-2bcb537015f0 nodeName:}" failed. No retries permitted until 2025-12-04 12:16:47.405435718 +0000 UTC m=+1050.843496976 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/51d21c61-912d-477f-a586-2bcb537015f0-cert") pod "infra-operator-controller-manager-7d9c9d7fd8-f228s" (UID: "51d21c61-912d-477f-a586-2bcb537015f0") : secret "infra-operator-webhook-server-cert" not found Dec 04 12:16:40.142977 master-0 kubenswrapper[35367]: I1204 12:16:40.141545 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/630b55ba-da80-4068-8496-ba94b5b904dd-cert\") pod \"openstack-baremetal-operator-controller-manager-6f998f5746f9gjr\" (UID: \"630b55ba-da80-4068-8496-ba94b5b904dd\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" Dec 04 12:16:40.142977 master-0 kubenswrapper[35367]: E1204 12:16:40.141994 35367 secret.go:189] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 12:16:40.142977 master-0 kubenswrapper[35367]: E1204 12:16:40.142062 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/630b55ba-da80-4068-8496-ba94b5b904dd-cert podName:630b55ba-da80-4068-8496-ba94b5b904dd nodeName:}" failed. No retries permitted until 2025-12-04 12:16:48.142042759 +0000 UTC m=+1051.580104017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/630b55ba-da80-4068-8496-ba94b5b904dd-cert") pod "openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" (UID: "630b55ba-da80-4068-8496-ba94b5b904dd") : secret "openstack-baremetal-operator-webhook-server-cert" not found Dec 04 12:16:42.317196 master-0 kubenswrapper[35367]: I1204 12:16:42.316976 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-metrics-certs\") pod \"openstack-operator-controller-manager-599cfccd85-dgvwj\" (UID: \"31c4a06b-1baa-47a3-8d51-b2127c215fe8\") " pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:16:42.317196 master-0 kubenswrapper[35367]: I1204 12:16:42.317142 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-webhook-certs\") pod \"openstack-operator-controller-manager-599cfccd85-dgvwj\" (UID: \"31c4a06b-1baa-47a3-8d51-b2127c215fe8\") " pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:16:42.317886 master-0 kubenswrapper[35367]: E1204 12:16:42.317420 35367 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Dec 04 12:16:42.317886 master-0 kubenswrapper[35367]: E1204 12:16:42.317495 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-webhook-certs podName:31c4a06b-1baa-47a3-8d51-b2127c215fe8 nodeName:}" failed. No retries permitted until 2025-12-04 12:16:50.317474906 +0000 UTC m=+1053.755536174 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-webhook-certs") pod "openstack-operator-controller-manager-599cfccd85-dgvwj" (UID: "31c4a06b-1baa-47a3-8d51-b2127c215fe8") : secret "webhook-server-cert" not found Dec 04 12:16:42.317886 master-0 kubenswrapper[35367]: E1204 12:16:42.317755 35367 secret.go:189] Couldn't get secret openstack-operators/metrics-server-cert: secret "metrics-server-cert" not found Dec 04 12:16:42.317886 master-0 kubenswrapper[35367]: E1204 12:16:42.317874 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-metrics-certs podName:31c4a06b-1baa-47a3-8d51-b2127c215fe8 nodeName:}" failed. No retries permitted until 2025-12-04 12:16:50.317847868 +0000 UTC m=+1053.755909156 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-metrics-certs") pod "openstack-operator-controller-manager-599cfccd85-dgvwj" (UID: "31c4a06b-1baa-47a3-8d51-b2127c215fe8") : secret "metrics-server-cert" not found Dec 04 12:16:45.539335 master-0 kubenswrapper[35367]: I1204 12:16:45.539193 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-94dl9"] Dec 04 12:16:47.476979 master-0 kubenswrapper[35367]: I1204 12:16:47.476878 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51d21c61-912d-477f-a586-2bcb537015f0-cert\") pod \"infra-operator-controller-manager-7d9c9d7fd8-f228s\" (UID: \"51d21c61-912d-477f-a586-2bcb537015f0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s" Dec 04 12:16:47.480325 master-0 kubenswrapper[35367]: I1204 12:16:47.480285 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51d21c61-912d-477f-a586-2bcb537015f0-cert\") pod \"infra-operator-controller-manager-7d9c9d7fd8-f228s\" (UID: \"51d21c61-912d-477f-a586-2bcb537015f0\") " pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s" Dec 04 12:16:47.587057 master-0 kubenswrapper[35367]: I1204 12:16:47.586950 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s" Dec 04 12:16:48.230609 master-0 kubenswrapper[35367]: I1204 12:16:48.230519 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/630b55ba-da80-4068-8496-ba94b5b904dd-cert\") pod \"openstack-baremetal-operator-controller-manager-6f998f5746f9gjr\" (UID: \"630b55ba-da80-4068-8496-ba94b5b904dd\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" Dec 04 12:16:48.235048 master-0 kubenswrapper[35367]: I1204 12:16:48.234967 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/630b55ba-da80-4068-8496-ba94b5b904dd-cert\") pod \"openstack-baremetal-operator-controller-manager-6f998f5746f9gjr\" (UID: \"630b55ba-da80-4068-8496-ba94b5b904dd\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" Dec 04 12:16:48.359262 master-0 kubenswrapper[35367]: I1204 12:16:48.359159 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" Dec 04 12:16:50.009031 master-0 kubenswrapper[35367]: I1204 12:16:50.008903 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-94dl9" event={"ID":"0c15399c-01fa-4f9d-a60d-da38611e976a","Type":"ContainerStarted","Data":"396d59e0af9abfe950137885e024f3cb22d90773d42412a4680546aa137948ca"} Dec 04 12:16:50.379926 master-0 kubenswrapper[35367]: I1204 12:16:50.379851 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-metrics-certs\") pod \"openstack-operator-controller-manager-599cfccd85-dgvwj\" (UID: \"31c4a06b-1baa-47a3-8d51-b2127c215fe8\") " pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:16:50.380285 master-0 kubenswrapper[35367]: I1204 12:16:50.380190 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-webhook-certs\") pod \"openstack-operator-controller-manager-599cfccd85-dgvwj\" (UID: \"31c4a06b-1baa-47a3-8d51-b2127c215fe8\") " pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:16:50.383906 master-0 kubenswrapper[35367]: I1204 12:16:50.383871 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-metrics-certs\") pod \"openstack-operator-controller-manager-599cfccd85-dgvwj\" (UID: \"31c4a06b-1baa-47a3-8d51-b2127c215fe8\") " pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:16:50.384478 master-0 kubenswrapper[35367]: I1204 12:16:50.384428 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/31c4a06b-1baa-47a3-8d51-b2127c215fe8-webhook-certs\") pod \"openstack-operator-controller-manager-599cfccd85-dgvwj\" (UID: \"31c4a06b-1baa-47a3-8d51-b2127c215fe8\") " pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:16:50.537712 master-0 kubenswrapper[35367]: I1204 12:16:50.537638 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:17:29.650025 master-0 kubenswrapper[35367]: I1204 12:17:29.649955 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr"] Dec 04 12:17:30.686539 master-0 kubenswrapper[35367]: W1204 12:17:30.686472 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod630b55ba_da80_4068_8496_ba94b5b904dd.slice/crio-3d82505715e1c305e69e7f4a823bce54630a2097ef4d9dbcdcd329dd6863fd75 WatchSource:0}: Error finding container 3d82505715e1c305e69e7f4a823bce54630a2097ef4d9dbcdcd329dd6863fd75: Status 404 returned error can't find the container with id 3d82505715e1c305e69e7f4a823bce54630a2097ef4d9dbcdcd329dd6863fd75 Dec 04 12:17:31.245872 master-0 kubenswrapper[35367]: I1204 12:17:31.244867 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj"] Dec 04 12:17:31.272267 master-0 kubenswrapper[35367]: I1204 12:17:31.272207 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s"] Dec 04 12:17:31.285406 master-0 kubenswrapper[35367]: W1204 12:17:31.285336 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c4a06b_1baa_47a3_8d51_b2127c215fe8.slice/crio-bfef224e29bf5ba81e9e9f3e64e4ba0c6162d4d2335bbfa986925b77d80f0ac4 WatchSource:0}: Error finding container bfef224e29bf5ba81e9e9f3e64e4ba0c6162d4d2335bbfa986925b77d80f0ac4: Status 404 returned error can't find the container with id bfef224e29bf5ba81e9e9f3e64e4ba0c6162d4d2335bbfa986925b77d80f0ac4 Dec 04 12:17:31.285921 master-0 kubenswrapper[35367]: W1204 12:17:31.285638 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51d21c61_912d_477f_a586_2bcb537015f0.slice/crio-f61460feb5f54c5a4924acd16d747e8099d3922c62614fd5050271a7e7995a71 WatchSource:0}: Error finding container f61460feb5f54c5a4924acd16d747e8099d3922c62614fd5050271a7e7995a71: Status 404 returned error can't find the container with id f61460feb5f54c5a4924acd16d747e8099d3922c62614fd5050271a7e7995a71 Dec 04 12:17:31.702293 master-0 kubenswrapper[35367]: I1204 12:17:31.687744 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" event={"ID":"31c4a06b-1baa-47a3-8d51-b2127c215fe8","Type":"ContainerStarted","Data":"bfef224e29bf5ba81e9e9f3e64e4ba0c6162d4d2335bbfa986925b77d80f0ac4"} Dec 04 12:17:31.702293 master-0 kubenswrapper[35367]: I1204 12:17:31.689856 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s" event={"ID":"51d21c61-912d-477f-a586-2bcb537015f0","Type":"ContainerStarted","Data":"f61460feb5f54c5a4924acd16d747e8099d3922c62614fd5050271a7e7995a71"} Dec 04 12:17:31.702293 master-0 kubenswrapper[35367]: I1204 12:17:31.691700 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-jjlq7" event={"ID":"8b2beff3-c98e-40a9-b02f-4bc0be3f246d","Type":"ContainerStarted","Data":"cacd4ba6bb519a435d2312e6607b06a2706c0044db7d724a4e2f58cdb358beb1"} Dec 04 12:17:31.702293 master-0 kubenswrapper[35367]: I1204 12:17:31.698189 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" event={"ID":"630b55ba-da80-4068-8496-ba94b5b904dd","Type":"ContainerStarted","Data":"3d82505715e1c305e69e7f4a823bce54630a2097ef4d9dbcdcd329dd6863fd75"} Dec 04 12:17:31.741416 master-0 kubenswrapper[35367]: I1204 12:17:31.714694 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-974hd" event={"ID":"52816b97-42b0-4b68-b094-4227045f15e9","Type":"ContainerStarted","Data":"5c2af0308aed007cf1dee97ba2d7d57112dc3df2ffa891841fbd1e91201570c0"} Dec 04 12:17:31.741416 master-0 kubenswrapper[35367]: I1204 12:17:31.724649 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-58c6v" event={"ID":"4c0b68d8-54cd-4caa-8045-4eebdf756bdc","Type":"ContainerStarted","Data":"917406f4f675ef8ecb0f90c1920b05ebf46d76d93f24b3054f0a0cb346e70b2f"} Dec 04 12:17:31.748898 master-0 kubenswrapper[35367]: I1204 12:17:31.745385 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-twtzz" event={"ID":"76310716-4fa1-4845-b419-b69491ce14a9","Type":"ContainerStarted","Data":"be7a226490ed06fdc692b623778454025329276df427a5fe625461c922992afd"} Dec 04 12:17:31.757636 master-0 kubenswrapper[35367]: I1204 12:17:31.757565 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-mfhwn" event={"ID":"c8387f48-c8e5-4e93-9f95-ef081bd895f7","Type":"ContainerStarted","Data":"49c8e91388c7fed0904ac0c0b6f3fc449633eee0c3c25139cdbc398c3140f6f5"} Dec 04 12:17:31.768090 master-0 kubenswrapper[35367]: I1204 12:17:31.767958 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-8dqxm" event={"ID":"2e7741e9-d8cb-46a0-ae9e-f6fc948cd05e","Type":"ContainerStarted","Data":"3bb3bb90146d58292d0cc73a8b45cab14ba2aa2e597a94531d4155bd996e1f45"} Dec 04 12:17:31.770907 master-0 kubenswrapper[35367]: I1204 12:17:31.770843 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-dtxsw" event={"ID":"999f0b7d-c17f-4181-b5bc-d380540d456b","Type":"ContainerStarted","Data":"06d51b5ba8390b1fe53bddd0e96576a2e1199fea8bd245aeb32808f625ed52e1"} Dec 04 12:17:31.773326 master-0 kubenswrapper[35367]: I1204 12:17:31.773252 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-hq5jr" event={"ID":"5cf205b8-6eb2-4125-940c-ac798d0a9fcd","Type":"ContainerStarted","Data":"3235b84ebf0cbd7b555f520fe1b8e08125ccfb87876aa0e3f49c2ec30d1c0692"} Dec 04 12:17:31.809835 master-0 kubenswrapper[35367]: I1204 12:17:31.806490 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-xnrjg" event={"ID":"cc133071-6e0d-4b0d-bcb4-d6864efdb0ef","Type":"ContainerStarted","Data":"ec8365e675d0c018bc4c515638d15a7cf07af4b3abf184e2a20c67ae0594c9d9"} Dec 04 12:17:32.482425 master-0 kubenswrapper[35367]: E1204 12:17:32.482338 35367 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:kube-rbac-proxy,Image:quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0,Command:[],Args:[--secure-listen-address=0.0.0.0:8443 --upstream=http://127.0.0.1:8080/ --logtostderr=true --v=0],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:8443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Requests:ResourceList{cpu: {{5 -3} {} 5m DecimalSI},memory: {{67108864 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-242dc,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod placement-operator-controller-manager-6b64f6f645-rddjv_openstack-operators(df328c4b-0c79-4c10-868e-7e1529b7d915): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Dec 04 12:17:32.482602 master-0 kubenswrapper[35367]: E1204 12:17:32.482547 35367 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:kube-rbac-proxy,Image:quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0,Command:[],Args:[--secure-listen-address=0.0.0.0:8443 --upstream=http://127.0.0.1:8080/ --logtostderr=true --v=0],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:8443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Requests:ResourceList{cpu: {{5 -3} {} 5m DecimalSI},memory: {{67108864 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-kcdwr,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod neutron-operator-controller-manager-7cdd6b54fb-4jl24_openstack-operators(e16e68f5-a79c-4a58-82e8-bd8b713f038d): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Dec 04 12:17:32.489492 master-0 kubenswrapper[35367]: E1204 12:17:32.485731 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-4jl24" podUID="e16e68f5-a79c-4a58-82e8-bd8b713f038d" Dec 04 12:17:32.489492 master-0 kubenswrapper[35367]: E1204 12:17:32.485752 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-rddjv" podUID="df328c4b-0c79-4c10-868e-7e1529b7d915" Dec 04 12:17:32.615092 master-0 kubenswrapper[35367]: E1204 12:17:32.606351 35367 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:kube-rbac-proxy,Image:quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0,Command:[],Args:[--secure-listen-address=0.0.0.0:8443 --upstream=http://127.0.0.1:8080/ --logtostderr=true --v=0],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:8443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Requests:ResourceList{cpu: {{5 -3} {} 5m DecimalSI},memory: {{67108864 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-hmjnw,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod octavia-operator-controller-manager-845b79dc4f-rs4fz_openstack-operators(f922e155-4868-4b3d-957c-2dd92adaa421): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Dec 04 12:17:32.615092 master-0 kubenswrapper[35367]: E1204 12:17:32.613001 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" podUID="f922e155-4868-4b3d-957c-2dd92adaa421" Dec 04 12:17:33.032385 master-0 kubenswrapper[35367]: I1204 12:17:33.032175 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-rddjv" event={"ID":"df328c4b-0c79-4c10-868e-7e1529b7d915","Type":"ContainerStarted","Data":"59c1c3b6b01385f1afa3c6054af5b6a6ae42a5a57190f7d72ab1a49899969ba9"} Dec 04 12:17:33.039900 master-0 kubenswrapper[35367]: I1204 12:17:33.034470 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-rddjv" Dec 04 12:17:33.043273 master-0 kubenswrapper[35367]: E1204 12:17:33.043193 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-rddjv" podUID="df328c4b-0c79-4c10-868e-7e1529b7d915" Dec 04 12:17:33.067450 master-0 kubenswrapper[35367]: I1204 12:17:33.066786 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/swift-operator-controller-manager-696b999796-p6w8q" event={"ID":"562a0e89-0415-487b-9521-7b6b9cfd2900","Type":"ContainerStarted","Data":"4098d8dafb894829457cd0b28955ae4c81a08fa5ec58cc8cc0a19ed7952b06c3"} Dec 04 12:17:33.108271 master-0 kubenswrapper[35367]: I1204 12:17:33.108150 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-782xf" event={"ID":"5ef048b0-c28e-455e-af91-337c8cb37aba","Type":"ContainerStarted","Data":"5d597bcf197360112fe44412b130410f21a52740d04ba5c62d8783b1bab83ff3"} Dec 04 12:17:33.142318 master-0 kubenswrapper[35367]: I1204 12:17:33.142237 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-94dl9" event={"ID":"0c15399c-01fa-4f9d-a60d-da38611e976a","Type":"ContainerStarted","Data":"a45ad534b98c55de4a4031b0cd7f542448f430569b1f3a9f545173e554764d46"} Dec 04 12:17:33.206266 master-0 kubenswrapper[35367]: I1204 12:17:33.158728 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ovn-operator-controller-manager-647f96877-75x24" event={"ID":"6e86224d-4627-446e-8adb-3dfcac8c5f1d","Type":"ContainerStarted","Data":"d17bb538bd13db2547323d2597e930a1d9711e38edd62ea9f0091e0c2af2ad96"} Dec 04 12:17:33.206266 master-0 kubenswrapper[35367]: I1204 12:17:33.160597 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-jsphj" event={"ID":"66974e9b-e7c0-4f10-9123-a6817ae99df0","Type":"ContainerStarted","Data":"1f0547cfd29be9df11080ac7e42d4976a1b1be15186864c100269c217d590238"} Dec 04 12:17:33.206266 master-0 kubenswrapper[35367]: I1204 12:17:33.162039 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" event={"ID":"31c4a06b-1baa-47a3-8d51-b2127c215fe8","Type":"ContainerStarted","Data":"9daae1d8aecb4b7d7b802cf0fd36dcf0067e1c4fe723e4c91b2189fa19150c4e"} Dec 04 12:17:33.206266 master-0 kubenswrapper[35367]: I1204 12:17:33.163084 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:17:33.206266 master-0 kubenswrapper[35367]: I1204 12:17:33.164690 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-4jl24" event={"ID":"e16e68f5-a79c-4a58-82e8-bd8b713f038d","Type":"ContainerStarted","Data":"c7a8fa1e9991c8c427e7176ed7543d406eff5ecdf6f911df949c7ef67262a1d8"} Dec 04 12:17:33.206266 master-0 kubenswrapper[35367]: I1204 12:17:33.164938 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-4jl24" Dec 04 12:17:33.206266 master-0 kubenswrapper[35367]: E1204 12:17:33.165853 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"" pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-4jl24" podUID="e16e68f5-a79c-4a58-82e8-bd8b713f038d" Dec 04 12:17:33.206266 master-0 kubenswrapper[35367]: I1204 12:17:33.166482 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-fd78q" event={"ID":"8beee1a8-f0f8-4694-9268-2975634b957f","Type":"ContainerStarted","Data":"e80e37b804d92b0e65900ceb4538dfc4ad351784daa6d22f0c9faafbb71c0053"} Dec 04 12:17:33.206266 master-0 kubenswrapper[35367]: I1204 12:17:33.168410 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-bpmdw" event={"ID":"2bd1182d-69fc-4e8b-a066-1b90a559a37e","Type":"ContainerStarted","Data":"12408aa9dd28981c287d30f029e9d85bbcb51c874214d8122c844db992422724"} Dec 04 12:17:33.206266 master-0 kubenswrapper[35367]: I1204 12:17:33.170293 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" event={"ID":"f922e155-4868-4b3d-957c-2dd92adaa421","Type":"ContainerStarted","Data":"90598967cb5f323c40c181c55529bcd2536f694a55d8b85dab6737fb8b1afae3"} Dec 04 12:17:33.206266 master-0 kubenswrapper[35367]: I1204 12:17:33.171020 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" Dec 04 12:17:33.206266 master-0 kubenswrapper[35367]: E1204 12:17:33.172203 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" podUID="f922e155-4868-4b3d-957c-2dd92adaa421" Dec 04 12:17:33.206266 master-0 kubenswrapper[35367]: I1204 12:17:33.172975 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-tfj67" event={"ID":"9faf72f1-4e12-4790-8fdc-ee65a67f3598","Type":"ContainerStarted","Data":"6fd132e759a00e5c01983712f15b42756faaba3b3ee8ecc5a7e5d033521b508b"} Dec 04 12:17:34.188929 master-0 kubenswrapper[35367]: E1204 12:17:34.188534 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" podUID="f922e155-4868-4b3d-957c-2dd92adaa421" Dec 04 12:17:34.188929 master-0 kubenswrapper[35367]: E1204 12:17:34.188554 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-rddjv" podUID="df328c4b-0c79-4c10-868e-7e1529b7d915" Dec 04 12:17:34.188929 master-0 kubenswrapper[35367]: E1204 12:17:34.188600 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"" pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-4jl24" podUID="e16e68f5-a79c-4a58-82e8-bd8b713f038d" Dec 04 12:17:36.586575 master-0 kubenswrapper[35367]: I1204 12:17:36.586467 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/rabbitmq-cluster-operator-manager-78955d896f-94dl9" podStartSLOduration=19.814372825 podStartE2EDuration="1m1.586444253s" podCreationTimestamp="2025-12-04 12:16:35 +0000 UTC" firstStartedPulling="2025-12-04 12:16:49.215378448 +0000 UTC m=+1052.653439706" lastFinishedPulling="2025-12-04 12:17:30.987449876 +0000 UTC m=+1094.425511134" observedRunningTime="2025-12-04 12:17:35.823869772 +0000 UTC m=+1099.261931030" watchObservedRunningTime="2025-12-04 12:17:36.586444253 +0000 UTC m=+1100.024505511" Dec 04 12:17:36.588430 master-0 kubenswrapper[35367]: I1204 12:17:36.588348 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" podStartSLOduration=62.588337234 podStartE2EDuration="1m2.588337234s" podCreationTimestamp="2025-12-04 12:16:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:17:36.574875323 +0000 UTC m=+1100.012936601" watchObservedRunningTime="2025-12-04 12:17:36.588337234 +0000 UTC m=+1100.026398492" Dec 04 12:17:40.544959 master-0 kubenswrapper[35367]: I1204 12:17:40.544886 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-operator-controller-manager-599cfccd85-dgvwj" Dec 04 12:17:42.296534 master-0 kubenswrapper[35367]: I1204 12:17:42.296456 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-4jl24" Dec 04 12:17:42.304176 master-0 kubenswrapper[35367]: E1204 12:17:42.304089 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"" pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-4jl24" podUID="e16e68f5-a79c-4a58-82e8-bd8b713f038d" Dec 04 12:17:42.562741 master-0 kubenswrapper[35367]: I1204 12:17:42.562656 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-rddjv" Dec 04 12:17:42.565821 master-0 kubenswrapper[35367]: E1204 12:17:42.565746 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-rddjv" podUID="df328c4b-0c79-4c10-868e-7e1529b7d915" Dec 04 12:17:42.824913 master-0 kubenswrapper[35367]: I1204 12:17:42.821454 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" Dec 04 12:17:42.828828 master-0 kubenswrapper[35367]: E1204 12:17:42.827184 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/kube-rbac-proxy:v0.16.0\\\"\"" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" podUID="f922e155-4868-4b3d-957c-2dd92adaa421" Dec 04 12:18:06.270588 master-0 kubenswrapper[35367]: I1204 12:18:06.270439 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" podUID="70729025-94a7-4a9b-98b8-e68b73d59a3e" containerName="manager" probeResult="failure" output="Get \"http://10.128.0.151:8080/readyz\": dial tcp 10.128.0.151:8080: connect: connection refused" Dec 04 12:18:07.659101 master-0 kubenswrapper[35367]: I1204 12:18:07.659024 35367 generic.go:334] "Generic (PLEG): container finished" podID="70729025-94a7-4a9b-98b8-e68b73d59a3e" containerID="25fd0707b23306a2945597f4d91087157d1e67a9d1035042878e9983a95dace6" exitCode=1 Dec 04 12:18:07.660170 master-0 kubenswrapper[35367]: I1204 12:18:07.659182 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" event={"ID":"70729025-94a7-4a9b-98b8-e68b73d59a3e","Type":"ContainerDied","Data":"25fd0707b23306a2945597f4d91087157d1e67a9d1035042878e9983a95dace6"} Dec 04 12:18:07.660383 master-0 kubenswrapper[35367]: I1204 12:18:07.660248 35367 scope.go:117] "RemoveContainer" containerID="25fd0707b23306a2945597f4d91087157d1e67a9d1035042878e9983a95dace6" Dec 04 12:18:07.662047 master-0 kubenswrapper[35367]: I1204 12:18:07.661995 35367 generic.go:334] "Generic (PLEG): container finished" podID="76310716-4fa1-4845-b419-b69491ce14a9" containerID="be7a226490ed06fdc692b623778454025329276df427a5fe625461c922992afd" exitCode=1 Dec 04 12:18:07.662169 master-0 kubenswrapper[35367]: I1204 12:18:07.662106 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-twtzz" event={"ID":"76310716-4fa1-4845-b419-b69491ce14a9","Type":"ContainerDied","Data":"be7a226490ed06fdc692b623778454025329276df427a5fe625461c922992afd"} Dec 04 12:18:07.664306 master-0 kubenswrapper[35367]: I1204 12:18:07.664258 35367 generic.go:334] "Generic (PLEG): container finished" podID="5ef048b0-c28e-455e-af91-337c8cb37aba" containerID="5d597bcf197360112fe44412b130410f21a52740d04ba5c62d8783b1bab83ff3" exitCode=1 Dec 04 12:18:07.664404 master-0 kubenswrapper[35367]: I1204 12:18:07.664336 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-782xf" event={"ID":"5ef048b0-c28e-455e-af91-337c8cb37aba","Type":"ContainerDied","Data":"5d597bcf197360112fe44412b130410f21a52740d04ba5c62d8783b1bab83ff3"} Dec 04 12:18:07.666601 master-0 kubenswrapper[35367]: I1204 12:18:07.666567 35367 generic.go:334] "Generic (PLEG): container finished" podID="f922e155-4868-4b3d-957c-2dd92adaa421" containerID="90598967cb5f323c40c181c55529bcd2536f694a55d8b85dab6737fb8b1afae3" exitCode=1 Dec 04 12:18:07.666601 master-0 kubenswrapper[35367]: I1204 12:18:07.666595 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" event={"ID":"f922e155-4868-4b3d-957c-2dd92adaa421","Type":"ContainerDied","Data":"90598967cb5f323c40c181c55529bcd2536f694a55d8b85dab6737fb8b1afae3"} Dec 04 12:18:11.710907 master-0 kubenswrapper[35367]: I1204 12:18:11.710829 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" event={"ID":"630b55ba-da80-4068-8496-ba94b5b904dd","Type":"ContainerStarted","Data":"0c9d99cb7c25404173eb616ee09980d57672f91609e0133ac41cdc4cfe44e651"} Dec 04 12:18:11.715781 master-0 kubenswrapper[35367]: I1204 12:18:11.715674 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" event={"ID":"70729025-94a7-4a9b-98b8-e68b73d59a3e","Type":"ContainerStarted","Data":"c4ef5c9e77d9b4d351a7451edd42d6437538f743695bc8a683308a0e8573a0cb"} Dec 04 12:18:11.717655 master-0 kubenswrapper[35367]: I1204 12:18:11.716735 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" Dec 04 12:18:11.720098 master-0 kubenswrapper[35367]: I1204 12:18:11.720043 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s" event={"ID":"51d21c61-912d-477f-a586-2bcb537015f0","Type":"ContainerStarted","Data":"d392260adfc31e4e58675395aa0367749ec76f971c5d3cc0414285416a0be456"} Dec 04 12:18:12.767512 master-0 kubenswrapper[35367]: I1204 12:18:12.767444 35367 scope.go:117] "RemoveContainer" containerID="be7a226490ed06fdc692b623778454025329276df427a5fe625461c922992afd" Dec 04 12:18:12.773189 master-0 kubenswrapper[35367]: I1204 12:18:12.772988 35367 scope.go:117] "RemoveContainer" containerID="5d597bcf197360112fe44412b130410f21a52740d04ba5c62d8783b1bab83ff3" Dec 04 12:18:12.797359 master-0 kubenswrapper[35367]: I1204 12:18:12.797268 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-twtzz" event={"ID":"76310716-4fa1-4845-b419-b69491ce14a9","Type":"ContainerStarted","Data":"4e412f162f54718a664370d8be7ee6d6d0eaa2e45912e418b6ed145ffff20f83"} Dec 04 12:18:12.797359 master-0 kubenswrapper[35367]: I1204 12:18:12.797326 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-782xf" event={"ID":"5ef048b0-c28e-455e-af91-337c8cb37aba","Type":"ContainerStarted","Data":"969b5f18b5233264c2465557c49b56e08e65c83e60452b11959237a0928b9fec"} Dec 04 12:18:12.797359 master-0 kubenswrapper[35367]: I1204 12:18:12.797339 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-bpmdw" event={"ID":"2bd1182d-69fc-4e8b-a066-1b90a559a37e","Type":"ContainerStarted","Data":"a4e014e05ce7b68db3ab5b7dd0572218a7ce58fdef3d276d40d7146104a81f9c"} Dec 04 12:18:12.800455 master-0 kubenswrapper[35367]: I1204 12:18:12.800386 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-bpmdw" Dec 04 12:18:12.817315 master-0 kubenswrapper[35367]: I1204 12:18:12.815968 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-twtzz" Dec 04 12:18:12.826117 master-0 kubenswrapper[35367]: I1204 12:18:12.820551 35367 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-twtzz" Dec 04 12:18:12.826117 master-0 kubenswrapper[35367]: I1204 12:18:12.821021 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-bpmdw" Dec 04 12:18:12.826117 master-0 kubenswrapper[35367]: I1204 12:18:12.821159 35367 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" podUID="f922e155-4868-4b3d-957c-2dd92adaa421" containerName="manager" probeResult="failure" output="Get \"http://10.128.0.184:8081/healthz\": dial tcp 10.128.0.184:8081: connect: connection refused" Dec 04 12:18:12.826117 master-0 kubenswrapper[35367]: I1204 12:18:12.821550 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" podUID="f922e155-4868-4b3d-957c-2dd92adaa421" containerName="manager" probeResult="failure" output="Get \"http://10.128.0.184:8081/readyz\": dial tcp 10.128.0.184:8081: connect: connection refused" Dec 04 12:18:12.826847 master-0 kubenswrapper[35367]: I1204 12:18:12.826763 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" event={"ID":"f922e155-4868-4b3d-957c-2dd92adaa421","Type":"ContainerStarted","Data":"fa5506df6d322e336fed27775dd3d8683dfbcd763810e95770e7c90213d59c89"} Dec 04 12:18:12.827692 master-0 kubenswrapper[35367]: I1204 12:18:12.827652 35367 scope.go:117] "RemoveContainer" containerID="90598967cb5f323c40c181c55529bcd2536f694a55d8b85dab6737fb8b1afae3" Dec 04 12:18:12.861756 master-0 kubenswrapper[35367]: I1204 12:18:12.861692 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-dtxsw" event={"ID":"999f0b7d-c17f-4181-b5bc-d380540d456b","Type":"ContainerStarted","Data":"cffe93ab6de6bd3856d17f57534bab516cb2380bd481ec405755467d7c5fcf8a"} Dec 04 12:18:12.863300 master-0 kubenswrapper[35367]: I1204 12:18:12.863220 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-dtxsw" Dec 04 12:18:12.870353 master-0 kubenswrapper[35367]: I1204 12:18:12.870171 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-dtxsw" Dec 04 12:18:12.898859 master-0 kubenswrapper[35367]: I1204 12:18:12.896253 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ovn-operator-controller-manager-647f96877-75x24" event={"ID":"6e86224d-4627-446e-8adb-3dfcac8c5f1d","Type":"ContainerStarted","Data":"b45ba48491c92abd98e8fd640b8a3822e2904bf2ca43ff467c821beda2a84edb"} Dec 04 12:18:12.898859 master-0 kubenswrapper[35367]: I1204 12:18:12.896762 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/ovn-operator-controller-manager-647f96877-75x24" Dec 04 12:18:12.906425 master-0 kubenswrapper[35367]: I1204 12:18:12.904090 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/ovn-operator-controller-manager-647f96877-75x24" Dec 04 12:18:12.910855 master-0 kubenswrapper[35367]: I1204 12:18:12.907579 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-rddjv" event={"ID":"df328c4b-0c79-4c10-868e-7e1529b7d915","Type":"ContainerStarted","Data":"54b4701912a377d58dca3da5cdf6f61440116d75fb4217a0070ada86c9f83e1f"} Dec 04 12:18:12.914841 master-0 kubenswrapper[35367]: I1204 12:18:12.912702 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/keystone-operator-controller-manager-58b8dcc5fb-bpmdw" podStartSLOduration=7.379372199 podStartE2EDuration="1m41.912662828s" podCreationTimestamp="2025-12-04 12:16:31 +0000 UTC" firstStartedPulling="2025-12-04 12:16:36.26961821 +0000 UTC m=+1039.707679468" lastFinishedPulling="2025-12-04 12:18:10.802908829 +0000 UTC m=+1134.240970097" observedRunningTime="2025-12-04 12:18:12.865868222 +0000 UTC m=+1136.303929490" watchObservedRunningTime="2025-12-04 12:18:12.912662828 +0000 UTC m=+1136.350724086" Dec 04 12:18:12.914841 master-0 kubenswrapper[35367]: I1204 12:18:12.914634 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-4jl24" event={"ID":"e16e68f5-a79c-4a58-82e8-bd8b713f038d","Type":"ContainerStarted","Data":"467e8bb1d51634c2da1f1c8edac360dd1a287ee0799a985998e257fa6f318559"} Dec 04 12:18:12.921846 master-0 kubenswrapper[35367]: I1204 12:18:12.920969 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-mfhwn" event={"ID":"c8387f48-c8e5-4e93-9f95-ef081bd895f7","Type":"ContainerStarted","Data":"1ba6866fa547ba34c67ed8bbaf75b15495320298c7ba391718c8a788c8c11522"} Dec 04 12:18:12.923969 master-0 kubenswrapper[35367]: I1204 12:18:12.923024 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-mfhwn" Dec 04 12:18:12.936138 master-0 kubenswrapper[35367]: I1204 12:18:12.935650 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-tfj67" event={"ID":"9faf72f1-4e12-4790-8fdc-ee65a67f3598","Type":"ContainerStarted","Data":"c402a92a4ffa6169ba9a32cdfd4811502a87854f10bc8f821a302e3f3588079a"} Dec 04 12:18:12.938898 master-0 kubenswrapper[35367]: I1204 12:18:12.938840 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-tfj67" Dec 04 12:18:12.947845 master-0 kubenswrapper[35367]: I1204 12:18:12.943271 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-mfhwn" Dec 04 12:18:12.948275 master-0 kubenswrapper[35367]: I1204 12:18:12.947988 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-tfj67" Dec 04 12:18:12.964846 master-0 kubenswrapper[35367]: I1204 12:18:12.962434 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-xnrjg" event={"ID":"cc133071-6e0d-4b0d-bcb4-d6864efdb0ef","Type":"ContainerStarted","Data":"5efc98c869d69bc095a86f618fedc3c0240f7bdc1d2b22a1828fa784a98f105d"} Dec 04 12:18:12.964846 master-0 kubenswrapper[35367]: I1204 12:18:12.963459 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-xnrjg" Dec 04 12:18:12.971840 master-0 kubenswrapper[35367]: I1204 12:18:12.968744 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-xnrjg" Dec 04 12:18:12.971840 master-0 kubenswrapper[35367]: I1204 12:18:12.970419 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" event={"ID":"630b55ba-da80-4068-8496-ba94b5b904dd","Type":"ContainerStarted","Data":"f8ce914bf1ca5448759c553f117e54ea8210dbe343399ca48d6681e2aed85caf"} Dec 04 12:18:12.971840 master-0 kubenswrapper[35367]: I1204 12:18:12.970775 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" Dec 04 12:18:13.008300 master-0 kubenswrapper[35367]: I1204 12:18:13.008202 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/cinder-operator-controller-manager-f8856dd79-mfhwn" podStartSLOduration=6.378908688 podStartE2EDuration="1m42.008174359s" podCreationTimestamp="2025-12-04 12:16:31 +0000 UTC" firstStartedPulling="2025-12-04 12:16:35.438929773 +0000 UTC m=+1038.876991031" lastFinishedPulling="2025-12-04 12:18:11.068195444 +0000 UTC m=+1134.506256702" observedRunningTime="2025-12-04 12:18:12.979704039 +0000 UTC m=+1136.417765297" watchObservedRunningTime="2025-12-04 12:18:13.008174359 +0000 UTC m=+1136.446235617" Dec 04 12:18:13.033072 master-0 kubenswrapper[35367]: I1204 12:18:13.031688 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/placement-operator-controller-manager-6b64f6f645-rddjv" podStartSLOduration=7.480106247 podStartE2EDuration="1m42.031660939s" podCreationTimestamp="2025-12-04 12:16:31 +0000 UTC" firstStartedPulling="2025-12-04 12:16:36.268552846 +0000 UTC m=+1039.706614104" lastFinishedPulling="2025-12-04 12:18:10.820107538 +0000 UTC m=+1134.258168796" observedRunningTime="2025-12-04 12:18:13.014962315 +0000 UTC m=+1136.453023583" watchObservedRunningTime="2025-12-04 12:18:13.031660939 +0000 UTC m=+1136.469722197" Dec 04 12:18:13.067159 master-0 kubenswrapper[35367]: I1204 12:18:13.067029 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/horizon-operator-controller-manager-f6cc97788-dtxsw" podStartSLOduration=5.509788063 podStartE2EDuration="1m42.066994748s" podCreationTimestamp="2025-12-04 12:16:31 +0000 UTC" firstStartedPulling="2025-12-04 12:16:35.490247423 +0000 UTC m=+1038.928308691" lastFinishedPulling="2025-12-04 12:18:12.047454118 +0000 UTC m=+1135.485515376" observedRunningTime="2025-12-04 12:18:13.060467429 +0000 UTC m=+1136.498528697" watchObservedRunningTime="2025-12-04 12:18:13.066994748 +0000 UTC m=+1136.505056016" Dec 04 12:18:13.310558 master-0 kubenswrapper[35367]: I1204 12:18:13.308635 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/ovn-operator-controller-manager-647f96877-75x24" podStartSLOduration=7.9133642680000005 podStartE2EDuration="1m42.308605016s" podCreationTimestamp="2025-12-04 12:16:31 +0000 UTC" firstStartedPulling="2025-12-04 12:16:36.251823132 +0000 UTC m=+1039.689884390" lastFinishedPulling="2025-12-04 12:18:10.64706388 +0000 UTC m=+1134.085125138" observedRunningTime="2025-12-04 12:18:13.302709887 +0000 UTC m=+1136.740771145" watchObservedRunningTime="2025-12-04 12:18:13.308605016 +0000 UTC m=+1136.746666274" Dec 04 12:18:13.438929 master-0 kubenswrapper[35367]: I1204 12:18:13.438702 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/neutron-operator-controller-manager-7cdd6b54fb-4jl24" podStartSLOduration=7.671685028 podStartE2EDuration="1m42.438674742s" podCreationTimestamp="2025-12-04 12:16:31 +0000 UTC" firstStartedPulling="2025-12-04 12:16:36.053520257 +0000 UTC m=+1039.491581515" lastFinishedPulling="2025-12-04 12:18:10.820509971 +0000 UTC m=+1134.258571229" observedRunningTime="2025-12-04 12:18:13.386221036 +0000 UTC m=+1136.824282324" watchObservedRunningTime="2025-12-04 12:18:13.438674742 +0000 UTC m=+1136.876736000" Dec 04 12:18:13.574844 master-0 kubenswrapper[35367]: I1204 12:18:13.559592 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" podStartSLOduration=79.885595769 podStartE2EDuration="1m42.559568464s" podCreationTimestamp="2025-12-04 12:16:31 +0000 UTC" firstStartedPulling="2025-12-04 12:17:30.692905568 +0000 UTC m=+1094.130966826" lastFinishedPulling="2025-12-04 12:17:53.366878273 +0000 UTC m=+1116.804939521" observedRunningTime="2025-12-04 12:18:13.551868967 +0000 UTC m=+1136.989930245" watchObservedRunningTime="2025-12-04 12:18:13.559568464 +0000 UTC m=+1136.997629742" Dec 04 12:18:13.657157 master-0 kubenswrapper[35367]: I1204 12:18:13.654336 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/heat-operator-controller-manager-7fd96594c7-xnrjg" podStartSLOduration=8.305310039 podStartE2EDuration="1m42.65430713s" podCreationTimestamp="2025-12-04 12:16:31 +0000 UTC" firstStartedPulling="2025-12-04 12:16:36.100225049 +0000 UTC m=+1039.538286307" lastFinishedPulling="2025-12-04 12:18:10.44922214 +0000 UTC m=+1133.887283398" observedRunningTime="2025-12-04 12:18:13.616173681 +0000 UTC m=+1137.054234959" watchObservedRunningTime="2025-12-04 12:18:13.65430713 +0000 UTC m=+1137.092368388" Dec 04 12:18:13.746959 master-0 kubenswrapper[35367]: I1204 12:18:13.746699 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/telemetry-operator-controller-manager-7b5867bfc7-tfj67" podStartSLOduration=7.689752314 podStartE2EDuration="1m42.746669761s" podCreationTimestamp="2025-12-04 12:16:31 +0000 UTC" firstStartedPulling="2025-12-04 12:16:35.746709165 +0000 UTC m=+1039.184770423" lastFinishedPulling="2025-12-04 12:18:10.803626612 +0000 UTC m=+1134.241687870" observedRunningTime="2025-12-04 12:18:13.687548182 +0000 UTC m=+1137.125609450" watchObservedRunningTime="2025-12-04 12:18:13.746669761 +0000 UTC m=+1137.184731019" Dec 04 12:18:13.999726 master-0 kubenswrapper[35367]: I1204 12:18:13.999588 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-jsphj" event={"ID":"66974e9b-e7c0-4f10-9123-a6817ae99df0","Type":"ContainerStarted","Data":"95f0d560281772430bf6a8dcf9e16198fa65aac4be8eb8376403a86fa7760075"} Dec 04 12:18:14.013127 master-0 kubenswrapper[35367]: I1204 12:18:14.000305 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-jsphj" Dec 04 12:18:14.013127 master-0 kubenswrapper[35367]: I1204 12:18:14.012640 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-jsphj" Dec 04 12:18:14.027835 master-0 kubenswrapper[35367]: I1204 12:18:14.023278 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/swift-operator-controller-manager-696b999796-p6w8q" event={"ID":"562a0e89-0415-487b-9521-7b6b9cfd2900","Type":"ContainerStarted","Data":"bb5a0621dd579b15ea6ed5131b1ea8cf968a484444e5612bb0206bb71e309db3"} Dec 04 12:18:14.027835 master-0 kubenswrapper[35367]: I1204 12:18:14.025313 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/swift-operator-controller-manager-696b999796-p6w8q" Dec 04 12:18:14.044851 master-0 kubenswrapper[35367]: I1204 12:18:14.038996 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/swift-operator-controller-manager-696b999796-p6w8q" Dec 04 12:18:14.083836 master-0 kubenswrapper[35367]: I1204 12:18:14.073722 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s" event={"ID":"51d21c61-912d-477f-a586-2bcb537015f0","Type":"ContainerStarted","Data":"274cb4bb5811a7afaa1450c1caec886670e87b7c9249c6d5b803062096851ed3"} Dec 04 12:18:14.083836 master-0 kubenswrapper[35367]: I1204 12:18:14.075433 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/watcher-operator-controller-manager-6b9b669fdb-jsphj" podStartSLOduration=6.387426317 podStartE2EDuration="1m42.075418673s" podCreationTimestamp="2025-12-04 12:16:32 +0000 UTC" firstStartedPulling="2025-12-04 12:16:36.355032229 +0000 UTC m=+1039.793093487" lastFinishedPulling="2025-12-04 12:18:12.043024585 +0000 UTC m=+1135.481085843" observedRunningTime="2025-12-04 12:18:14.049526066 +0000 UTC m=+1137.487587334" watchObservedRunningTime="2025-12-04 12:18:14.075418673 +0000 UTC m=+1137.513479941" Dec 04 12:18:14.092840 master-0 kubenswrapper[35367]: I1204 12:18:14.090790 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-8dqxm" event={"ID":"2e7741e9-d8cb-46a0-ae9e-f6fc948cd05e","Type":"ContainerStarted","Data":"44e4d44acbf40d831f7e918b6bae02b4982d6202ffc903b42212df26a9986fd6"} Dec 04 12:18:14.092840 master-0 kubenswrapper[35367]: I1204 12:18:14.090878 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-8dqxm" Dec 04 12:18:14.103840 master-0 kubenswrapper[35367]: I1204 12:18:14.094736 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-8dqxm" Dec 04 12:18:14.127912 master-0 kubenswrapper[35367]: I1204 12:18:14.121995 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/swift-operator-controller-manager-696b999796-p6w8q" podStartSLOduration=8.003319211 podStartE2EDuration="1m43.12196705s" podCreationTimestamp="2025-12-04 12:16:31 +0000 UTC" firstStartedPulling="2025-12-04 12:16:36.252017318 +0000 UTC m=+1039.690078586" lastFinishedPulling="2025-12-04 12:18:11.370665167 +0000 UTC m=+1134.808726425" observedRunningTime="2025-12-04 12:18:14.114487201 +0000 UTC m=+1137.552548459" watchObservedRunningTime="2025-12-04 12:18:14.12196705 +0000 UTC m=+1137.560028308" Dec 04 12:18:14.291197 master-0 kubenswrapper[35367]: I1204 12:18:14.290282 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s" podStartSLOduration=64.427711486 podStartE2EDuration="1m43.290254917s" podCreationTimestamp="2025-12-04 12:16:31 +0000 UTC" firstStartedPulling="2025-12-04 12:17:31.292732189 +0000 UTC m=+1094.730793447" lastFinishedPulling="2025-12-04 12:18:10.15527562 +0000 UTC m=+1133.593336878" observedRunningTime="2025-12-04 12:18:14.271511797 +0000 UTC m=+1137.709573055" watchObservedRunningTime="2025-12-04 12:18:14.290254917 +0000 UTC m=+1137.728316185" Dec 04 12:18:14.355659 master-0 kubenswrapper[35367]: I1204 12:18:14.354667 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-controller-manager-647d75769b-8dqxm" podStartSLOduration=8.760818702 podStartE2EDuration="1m43.354644354s" podCreationTimestamp="2025-12-04 12:16:31 +0000 UTC" firstStartedPulling="2025-12-04 12:16:36.256409438 +0000 UTC m=+1039.694470696" lastFinishedPulling="2025-12-04 12:18:10.85023509 +0000 UTC m=+1134.288296348" observedRunningTime="2025-12-04 12:18:14.353496796 +0000 UTC m=+1137.791558064" watchObservedRunningTime="2025-12-04 12:18:14.354644354 +0000 UTC m=+1137.792705612" Dec 04 12:18:15.128643 master-0 kubenswrapper[35367]: I1204 12:18:15.128544 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-974hd" event={"ID":"52816b97-42b0-4b68-b094-4227045f15e9","Type":"ContainerStarted","Data":"0e74b7afddcfa95eff766847836e7522749559c3a37007633eb8fe979c493724"} Dec 04 12:18:15.130928 master-0 kubenswrapper[35367]: I1204 12:18:15.130733 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-974hd" Dec 04 12:18:15.137365 master-0 kubenswrapper[35367]: I1204 12:18:15.137297 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-974hd" Dec 04 12:18:15.141563 master-0 kubenswrapper[35367]: I1204 12:18:15.141060 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-twtzz" event={"ID":"76310716-4fa1-4845-b419-b69491ce14a9","Type":"ContainerStarted","Data":"1810741097cc4d62ca56a86b7fef1771b198848c148c8fd9961e3f6c55f23753"} Dec 04 12:18:15.141888 master-0 kubenswrapper[35367]: I1204 12:18:15.141677 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-twtzz" Dec 04 12:18:15.162062 master-0 kubenswrapper[35367]: I1204 12:18:15.161330 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-782xf" event={"ID":"5ef048b0-c28e-455e-af91-337c8cb37aba","Type":"ContainerStarted","Data":"77ccd0ff21b469cd3ef52379e9a575fa30438e50343f4c55a818173ea67b9da1"} Dec 04 12:18:15.165201 master-0 kubenswrapper[35367]: I1204 12:18:15.162638 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-782xf" Dec 04 12:18:15.179183 master-0 kubenswrapper[35367]: I1204 12:18:15.178709 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-fd78q" event={"ID":"8beee1a8-f0f8-4694-9268-2975634b957f","Type":"ContainerStarted","Data":"f3069d37d5066db6b58a683e194610208943394c61e1f4185f7f4c9099031255"} Dec 04 12:18:15.181006 master-0 kubenswrapper[35367]: I1204 12:18:15.180798 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-fd78q" Dec 04 12:18:15.183279 master-0 kubenswrapper[35367]: I1204 12:18:15.183188 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/barbican-operator-controller-manager-5cd89994b5-974hd" podStartSLOduration=5.9397056169999995 podStartE2EDuration="1m44.183166642s" podCreationTimestamp="2025-12-04 12:16:31 +0000 UTC" firstStartedPulling="2025-12-04 12:16:34.290109452 +0000 UTC m=+1037.728170710" lastFinishedPulling="2025-12-04 12:18:12.533570477 +0000 UTC m=+1135.971631735" observedRunningTime="2025-12-04 12:18:15.178374708 +0000 UTC m=+1138.616435966" watchObservedRunningTime="2025-12-04 12:18:15.183166642 +0000 UTC m=+1138.621227900" Dec 04 12:18:15.191520 master-0 kubenswrapper[35367]: I1204 12:18:15.191431 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-fd78q" Dec 04 12:18:15.193473 master-0 kubenswrapper[35367]: I1204 12:18:15.193417 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" event={"ID":"f922e155-4868-4b3d-957c-2dd92adaa421","Type":"ContainerStarted","Data":"f5a38f9048578eb389a763a41d3316ab84cb6dae05ef6fab2b314fbbd32992f0"} Dec 04 12:18:15.193626 master-0 kubenswrapper[35367]: I1204 12:18:15.193508 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" Dec 04 12:18:15.210143 master-0 kubenswrapper[35367]: I1204 12:18:15.208220 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-hq5jr" event={"ID":"5cf205b8-6eb2-4125-940c-ac798d0a9fcd","Type":"ContainerStarted","Data":"f23178e81da86a917ceee6dd5faf8f6e60f63a7ecd0119edffc90f25345dbbe2"} Dec 04 12:18:15.211599 master-0 kubenswrapper[35367]: I1204 12:18:15.211254 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-hq5jr" Dec 04 12:18:15.216426 master-0 kubenswrapper[35367]: I1204 12:18:15.213173 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-hq5jr" Dec 04 12:18:15.228626 master-0 kubenswrapper[35367]: I1204 12:18:15.226852 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-jjlq7" event={"ID":"8b2beff3-c98e-40a9-b02f-4bc0be3f246d","Type":"ContainerStarted","Data":"5b591232c13348bb65896ca2e01baaf928d9801b429e191c1c443236dd2cb869"} Dec 04 12:18:15.228626 master-0 kubenswrapper[35367]: I1204 12:18:15.228565 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-jjlq7" Dec 04 12:18:15.232738 master-0 kubenswrapper[35367]: I1204 12:18:15.232519 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-58c6v" event={"ID":"4c0b68d8-54cd-4caa-8045-4eebdf756bdc","Type":"ContainerStarted","Data":"099b593045edd9ba7625ccd44a9aee02409eacd031e78d78d1a4139c0353c08c"} Dec 04 12:18:15.234590 master-0 kubenswrapper[35367]: I1204 12:18:15.234522 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-jjlq7" Dec 04 12:18:15.234590 master-0 kubenswrapper[35367]: I1204 12:18:15.234556 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s" Dec 04 12:18:15.296447 master-0 kubenswrapper[35367]: I1204 12:18:15.296321 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-782xf" podStartSLOduration=9.57969718 podStartE2EDuration="1m44.296295245s" podCreationTimestamp="2025-12-04 12:16:31 +0000 UTC" firstStartedPulling="2025-12-04 12:16:36.082289006 +0000 UTC m=+1039.520350264" lastFinishedPulling="2025-12-04 12:18:10.798887071 +0000 UTC m=+1134.236948329" observedRunningTime="2025-12-04 12:18:15.286641887 +0000 UTC m=+1138.724703165" watchObservedRunningTime="2025-12-04 12:18:15.296295245 +0000 UTC m=+1138.734356503" Dec 04 12:18:15.396938 master-0 kubenswrapper[35367]: I1204 12:18:15.392588 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-twtzz" podStartSLOduration=9.760036278 podStartE2EDuration="1m43.392560071s" podCreationTimestamp="2025-12-04 12:16:32 +0000 UTC" firstStartedPulling="2025-12-04 12:16:36.250372785 +0000 UTC m=+1039.688434043" lastFinishedPulling="2025-12-04 12:18:09.882896578 +0000 UTC m=+1133.320957836" observedRunningTime="2025-12-04 12:18:15.384027838 +0000 UTC m=+1138.822089116" watchObservedRunningTime="2025-12-04 12:18:15.392560071 +0000 UTC m=+1138.830621329" Dec 04 12:18:15.463271 master-0 kubenswrapper[35367]: I1204 12:18:15.462025 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/manila-operator-controller-manager-56f9fbf74b-hq5jr" podStartSLOduration=7.595066029 podStartE2EDuration="1m44.462000969s" podCreationTimestamp="2025-12-04 12:16:31 +0000 UTC" firstStartedPulling="2025-12-04 12:16:35.73622478 +0000 UTC m=+1039.174286038" lastFinishedPulling="2025-12-04 12:18:12.60315972 +0000 UTC m=+1136.041220978" observedRunningTime="2025-12-04 12:18:15.452470025 +0000 UTC m=+1138.890531293" watchObservedRunningTime="2025-12-04 12:18:15.462000969 +0000 UTC m=+1138.900062227" Dec 04 12:18:15.638851 master-0 kubenswrapper[35367]: I1204 12:18:15.638622 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-58c6v" podStartSLOduration=7.494185297 podStartE2EDuration="1m44.63858862s" podCreationTimestamp="2025-12-04 12:16:31 +0000 UTC" firstStartedPulling="2025-12-04 12:16:35.410841166 +0000 UTC m=+1038.848902424" lastFinishedPulling="2025-12-04 12:18:12.555244489 +0000 UTC m=+1135.993305747" observedRunningTime="2025-12-04 12:18:15.622065903 +0000 UTC m=+1139.060127171" watchObservedRunningTime="2025-12-04 12:18:15.63858862 +0000 UTC m=+1139.076649898" Dec 04 12:18:15.669190 master-0 kubenswrapper[35367]: I1204 12:18:15.668952 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/nova-operator-controller-manager-865fc86d5b-fd78q" podStartSLOduration=8.187910488 podStartE2EDuration="1m44.668925529s" podCreationTimestamp="2025-12-04 12:16:31 +0000 UTC" firstStartedPulling="2025-12-04 12:16:36.09996271 +0000 UTC m=+1039.538023968" lastFinishedPulling="2025-12-04 12:18:12.580977741 +0000 UTC m=+1136.019039009" observedRunningTime="2025-12-04 12:18:15.657949689 +0000 UTC m=+1139.096010957" watchObservedRunningTime="2025-12-04 12:18:15.668925529 +0000 UTC m=+1139.106986787" Dec 04 12:18:15.873270 master-0 kubenswrapper[35367]: I1204 12:18:15.872260 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" podStartSLOduration=10.348970638 podStartE2EDuration="1m44.872230185s" podCreationTimestamp="2025-12-04 12:16:31 +0000 UTC" firstStartedPulling="2025-12-04 12:16:36.295986553 +0000 UTC m=+1039.734047841" lastFinishedPulling="2025-12-04 12:18:10.81924613 +0000 UTC m=+1134.257307388" observedRunningTime="2025-12-04 12:18:15.827366161 +0000 UTC m=+1139.265427429" watchObservedRunningTime="2025-12-04 12:18:15.872230185 +0000 UTC m=+1139.310291443" Dec 04 12:18:15.895885 master-0 kubenswrapper[35367]: I1204 12:18:15.895768 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/designate-operator-controller-manager-84bc9f68f5-jjlq7" podStartSLOduration=8.57833903 podStartE2EDuration="1m44.895745965s" podCreationTimestamp="2025-12-04 12:16:31 +0000 UTC" firstStartedPulling="2025-12-04 12:16:35.749334549 +0000 UTC m=+1039.187395807" lastFinishedPulling="2025-12-04 12:18:12.066741484 +0000 UTC m=+1135.504802742" observedRunningTime="2025-12-04 12:18:15.875475578 +0000 UTC m=+1139.313536836" watchObservedRunningTime="2025-12-04 12:18:15.895745965 +0000 UTC m=+1139.333807223" Dec 04 12:18:16.242891 master-0 kubenswrapper[35367]: I1204 12:18:16.242083 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-58c6v" Dec 04 12:18:16.246395 master-0 kubenswrapper[35367]: I1204 12:18:16.246348 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/glance-operator-controller-manager-78cd4f7769-58c6v" Dec 04 12:18:16.248964 master-0 kubenswrapper[35367]: I1204 12:18:16.248915 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/infra-operator-controller-manager-7d9c9d7fd8-f228s" Dec 04 12:18:18.366446 master-0 kubenswrapper[35367]: I1204 12:18:18.366370 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6f998f5746f9gjr" Dec 04 12:18:22.041695 master-0 kubenswrapper[35367]: I1204 12:18:22.041626 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/ironic-operator-controller-manager-7c9bfd6967-782xf" Dec 04 12:18:22.820780 master-0 kubenswrapper[35367]: I1204 12:18:22.820705 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/octavia-operator-controller-manager-845b79dc4f-rs4fz" Dec 04 12:18:22.821139 master-0 kubenswrapper[35367]: I1204 12:18:22.821074 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/test-operator-controller-manager-57dfcdd5b8-twtzz" Dec 04 12:18:46.274005 master-0 kubenswrapper[35367]: I1204 12:18:46.273949 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" Dec 04 12:19:08.543902 master-0 kubenswrapper[35367]: I1204 12:19:08.541519 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-knvdv"] Dec 04 12:19:08.544999 master-0 kubenswrapper[35367]: I1204 12:19:08.544405 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-knvdv" Dec 04 12:19:08.585974 master-0 kubenswrapper[35367]: I1204 12:19:08.583425 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-knvdv"] Dec 04 12:19:08.597456 master-0 kubenswrapper[35367]: I1204 12:19:08.595576 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6zsm\" (UniqueName: \"kubernetes.io/projected/d581de33-736d-45d7-9aa4-4b2650b877c1-kube-api-access-l6zsm\") pod \"certified-operators-knvdv\" (UID: \"d581de33-736d-45d7-9aa4-4b2650b877c1\") " pod="openshift-marketplace/certified-operators-knvdv" Dec 04 12:19:08.597456 master-0 kubenswrapper[35367]: I1204 12:19:08.595757 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d581de33-736d-45d7-9aa4-4b2650b877c1-catalog-content\") pod \"certified-operators-knvdv\" (UID: \"d581de33-736d-45d7-9aa4-4b2650b877c1\") " pod="openshift-marketplace/certified-operators-knvdv" Dec 04 12:19:08.597456 master-0 kubenswrapper[35367]: I1204 12:19:08.595863 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d581de33-736d-45d7-9aa4-4b2650b877c1-utilities\") pod \"certified-operators-knvdv\" (UID: \"d581de33-736d-45d7-9aa4-4b2650b877c1\") " pod="openshift-marketplace/certified-operators-knvdv" Dec 04 12:19:08.698853 master-0 kubenswrapper[35367]: I1204 12:19:08.698322 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l6zsm\" (UniqueName: \"kubernetes.io/projected/d581de33-736d-45d7-9aa4-4b2650b877c1-kube-api-access-l6zsm\") pod \"certified-operators-knvdv\" (UID: \"d581de33-736d-45d7-9aa4-4b2650b877c1\") " pod="openshift-marketplace/certified-operators-knvdv" Dec 04 12:19:08.698853 master-0 kubenswrapper[35367]: I1204 12:19:08.698551 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d581de33-736d-45d7-9aa4-4b2650b877c1-catalog-content\") pod \"certified-operators-knvdv\" (UID: \"d581de33-736d-45d7-9aa4-4b2650b877c1\") " pod="openshift-marketplace/certified-operators-knvdv" Dec 04 12:19:08.698853 master-0 kubenswrapper[35367]: I1204 12:19:08.698656 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d581de33-736d-45d7-9aa4-4b2650b877c1-utilities\") pod \"certified-operators-knvdv\" (UID: \"d581de33-736d-45d7-9aa4-4b2650b877c1\") " pod="openshift-marketplace/certified-operators-knvdv" Dec 04 12:19:08.699873 master-0 kubenswrapper[35367]: I1204 12:19:08.699447 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d581de33-736d-45d7-9aa4-4b2650b877c1-utilities\") pod \"certified-operators-knvdv\" (UID: \"d581de33-736d-45d7-9aa4-4b2650b877c1\") " pod="openshift-marketplace/certified-operators-knvdv" Dec 04 12:19:08.701344 master-0 kubenswrapper[35367]: I1204 12:19:08.700441 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d581de33-736d-45d7-9aa4-4b2650b877c1-catalog-content\") pod \"certified-operators-knvdv\" (UID: \"d581de33-736d-45d7-9aa4-4b2650b877c1\") " pod="openshift-marketplace/certified-operators-knvdv" Dec 04 12:19:08.732093 master-0 kubenswrapper[35367]: I1204 12:19:08.732033 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6zsm\" (UniqueName: \"kubernetes.io/projected/d581de33-736d-45d7-9aa4-4b2650b877c1-kube-api-access-l6zsm\") pod \"certified-operators-knvdv\" (UID: \"d581de33-736d-45d7-9aa4-4b2650b877c1\") " pod="openshift-marketplace/certified-operators-knvdv" Dec 04 12:19:08.878163 master-0 kubenswrapper[35367]: I1204 12:19:08.878096 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-knvdv" Dec 04 12:19:09.525991 master-0 kubenswrapper[35367]: I1204 12:19:09.525926 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-knvdv"] Dec 04 12:19:09.871658 master-0 kubenswrapper[35367]: I1204 12:19:09.871486 35367 generic.go:334] "Generic (PLEG): container finished" podID="d581de33-736d-45d7-9aa4-4b2650b877c1" containerID="e8f3b78d0c428bbda2173ee844447dc39118602d81b87dff3d042bdc76b5be35" exitCode=0 Dec 04 12:19:09.871658 master-0 kubenswrapper[35367]: I1204 12:19:09.871556 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-knvdv" event={"ID":"d581de33-736d-45d7-9aa4-4b2650b877c1","Type":"ContainerDied","Data":"e8f3b78d0c428bbda2173ee844447dc39118602d81b87dff3d042bdc76b5be35"} Dec 04 12:19:09.871658 master-0 kubenswrapper[35367]: I1204 12:19:09.871629 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-knvdv" event={"ID":"d581de33-736d-45d7-9aa4-4b2650b877c1","Type":"ContainerStarted","Data":"c4114c9de9bfc935b8414b17c8af267eef683a868fa7d9617b731fc0beab384a"} Dec 04 12:19:11.897346 master-0 kubenswrapper[35367]: I1204 12:19:11.897272 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-knvdv" event={"ID":"d581de33-736d-45d7-9aa4-4b2650b877c1","Type":"ContainerStarted","Data":"e9231a51cae02c359a864b0d6d19ac4d33d0f2564c9fabffd91661fd8140488f"} Dec 04 12:19:12.911838 master-0 kubenswrapper[35367]: I1204 12:19:12.911759 35367 generic.go:334] "Generic (PLEG): container finished" podID="d581de33-736d-45d7-9aa4-4b2650b877c1" containerID="e9231a51cae02c359a864b0d6d19ac4d33d0f2564c9fabffd91661fd8140488f" exitCode=0 Dec 04 12:19:12.911838 master-0 kubenswrapper[35367]: I1204 12:19:12.911845 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-knvdv" event={"ID":"d581de33-736d-45d7-9aa4-4b2650b877c1","Type":"ContainerDied","Data":"e9231a51cae02c359a864b0d6d19ac4d33d0f2564c9fabffd91661fd8140488f"} Dec 04 12:19:13.927140 master-0 kubenswrapper[35367]: I1204 12:19:13.927070 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-knvdv" event={"ID":"d581de33-736d-45d7-9aa4-4b2650b877c1","Type":"ContainerStarted","Data":"8d968eab6c75603b4e854b28890f964bb5ffe410c769453cab14bdc3ce1bff36"} Dec 04 12:19:13.955332 master-0 kubenswrapper[35367]: I1204 12:19:13.955232 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-knvdv" podStartSLOduration=2.531931748 podStartE2EDuration="5.95520851s" podCreationTimestamp="2025-12-04 12:19:08 +0000 UTC" firstStartedPulling="2025-12-04 12:19:09.875400158 +0000 UTC m=+1193.313461416" lastFinishedPulling="2025-12-04 12:19:13.29867692 +0000 UTC m=+1196.736738178" observedRunningTime="2025-12-04 12:19:13.950882904 +0000 UTC m=+1197.388944162" watchObservedRunningTime="2025-12-04 12:19:13.95520851 +0000 UTC m=+1197.393269768" Dec 04 12:19:14.553428 master-0 kubenswrapper[35367]: I1204 12:19:14.548393 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-5dbfd7c4bf-vkd6n"] Dec 04 12:19:14.553428 master-0 kubenswrapper[35367]: I1204 12:19:14.550872 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-5dbfd7c4bf-vkd6n" Dec 04 12:19:14.553428 master-0 kubenswrapper[35367]: I1204 12:19:14.553220 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"openshift-service-ca.crt" Dec 04 12:19:14.553976 master-0 kubenswrapper[35367]: I1204 12:19:14.553444 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"kube-root-ca.crt" Dec 04 12:19:14.553976 master-0 kubenswrapper[35367]: I1204 12:19:14.553695 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns" Dec 04 12:19:14.564819 master-0 kubenswrapper[35367]: I1204 12:19:14.564561 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-5dbfd7c4bf-vkd6n"] Dec 04 12:19:14.642919 master-0 kubenswrapper[35367]: I1204 12:19:14.642850 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-75d7c5dbd7-cfxqx"] Dec 04 12:19:14.648408 master-0 kubenswrapper[35367]: I1204 12:19:14.648341 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-75d7c5dbd7-cfxqx" Dec 04 12:19:14.651321 master-0 kubenswrapper[35367]: I1204 12:19:14.651266 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns-svc" Dec 04 12:19:14.653606 master-0 kubenswrapper[35367]: I1204 12:19:14.653521 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-75d7c5dbd7-cfxqx"] Dec 04 12:19:14.731728 master-0 kubenswrapper[35367]: I1204 12:19:14.731286 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/daccfe35-6818-404b-a6fa-0a41c1b0c7ec-dns-svc\") pod \"dnsmasq-dns-75d7c5dbd7-cfxqx\" (UID: \"daccfe35-6818-404b-a6fa-0a41c1b0c7ec\") " pod="openstack/dnsmasq-dns-75d7c5dbd7-cfxqx" Dec 04 12:19:14.731980 master-0 kubenswrapper[35367]: I1204 12:19:14.731779 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/daccfe35-6818-404b-a6fa-0a41c1b0c7ec-config\") pod \"dnsmasq-dns-75d7c5dbd7-cfxqx\" (UID: \"daccfe35-6818-404b-a6fa-0a41c1b0c7ec\") " pod="openstack/dnsmasq-dns-75d7c5dbd7-cfxqx" Dec 04 12:19:14.731980 master-0 kubenswrapper[35367]: I1204 12:19:14.731861 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stzdl\" (UniqueName: \"kubernetes.io/projected/f058b868-204d-40a3-8746-e46d9ee199e8-kube-api-access-stzdl\") pod \"dnsmasq-dns-5dbfd7c4bf-vkd6n\" (UID: \"f058b868-204d-40a3-8746-e46d9ee199e8\") " pod="openstack/dnsmasq-dns-5dbfd7c4bf-vkd6n" Dec 04 12:19:14.731980 master-0 kubenswrapper[35367]: I1204 12:19:14.731927 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f058b868-204d-40a3-8746-e46d9ee199e8-config\") pod \"dnsmasq-dns-5dbfd7c4bf-vkd6n\" (UID: \"f058b868-204d-40a3-8746-e46d9ee199e8\") " pod="openstack/dnsmasq-dns-5dbfd7c4bf-vkd6n" Dec 04 12:19:14.732143 master-0 kubenswrapper[35367]: I1204 12:19:14.731987 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dkdx\" (UniqueName: \"kubernetes.io/projected/daccfe35-6818-404b-a6fa-0a41c1b0c7ec-kube-api-access-2dkdx\") pod \"dnsmasq-dns-75d7c5dbd7-cfxqx\" (UID: \"daccfe35-6818-404b-a6fa-0a41c1b0c7ec\") " pod="openstack/dnsmasq-dns-75d7c5dbd7-cfxqx" Dec 04 12:19:14.833862 master-0 kubenswrapper[35367]: I1204 12:19:14.833760 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/daccfe35-6818-404b-a6fa-0a41c1b0c7ec-dns-svc\") pod \"dnsmasq-dns-75d7c5dbd7-cfxqx\" (UID: \"daccfe35-6818-404b-a6fa-0a41c1b0c7ec\") " pod="openstack/dnsmasq-dns-75d7c5dbd7-cfxqx" Dec 04 12:19:14.833862 master-0 kubenswrapper[35367]: I1204 12:19:14.833873 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/daccfe35-6818-404b-a6fa-0a41c1b0c7ec-config\") pod \"dnsmasq-dns-75d7c5dbd7-cfxqx\" (UID: \"daccfe35-6818-404b-a6fa-0a41c1b0c7ec\") " pod="openstack/dnsmasq-dns-75d7c5dbd7-cfxqx" Dec 04 12:19:14.834176 master-0 kubenswrapper[35367]: I1204 12:19:14.833908 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-stzdl\" (UniqueName: \"kubernetes.io/projected/f058b868-204d-40a3-8746-e46d9ee199e8-kube-api-access-stzdl\") pod \"dnsmasq-dns-5dbfd7c4bf-vkd6n\" (UID: \"f058b868-204d-40a3-8746-e46d9ee199e8\") " pod="openstack/dnsmasq-dns-5dbfd7c4bf-vkd6n" Dec 04 12:19:14.834176 master-0 kubenswrapper[35367]: I1204 12:19:14.833956 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f058b868-204d-40a3-8746-e46d9ee199e8-config\") pod \"dnsmasq-dns-5dbfd7c4bf-vkd6n\" (UID: \"f058b868-204d-40a3-8746-e46d9ee199e8\") " pod="openstack/dnsmasq-dns-5dbfd7c4bf-vkd6n" Dec 04 12:19:14.834176 master-0 kubenswrapper[35367]: I1204 12:19:14.834000 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2dkdx\" (UniqueName: \"kubernetes.io/projected/daccfe35-6818-404b-a6fa-0a41c1b0c7ec-kube-api-access-2dkdx\") pod \"dnsmasq-dns-75d7c5dbd7-cfxqx\" (UID: \"daccfe35-6818-404b-a6fa-0a41c1b0c7ec\") " pod="openstack/dnsmasq-dns-75d7c5dbd7-cfxqx" Dec 04 12:19:14.835431 master-0 kubenswrapper[35367]: I1204 12:19:14.835395 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/daccfe35-6818-404b-a6fa-0a41c1b0c7ec-dns-svc\") pod \"dnsmasq-dns-75d7c5dbd7-cfxqx\" (UID: \"daccfe35-6818-404b-a6fa-0a41c1b0c7ec\") " pod="openstack/dnsmasq-dns-75d7c5dbd7-cfxqx" Dec 04 12:19:14.835513 master-0 kubenswrapper[35367]: I1204 12:19:14.835478 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f058b868-204d-40a3-8746-e46d9ee199e8-config\") pod \"dnsmasq-dns-5dbfd7c4bf-vkd6n\" (UID: \"f058b868-204d-40a3-8746-e46d9ee199e8\") " pod="openstack/dnsmasq-dns-5dbfd7c4bf-vkd6n" Dec 04 12:19:14.836573 master-0 kubenswrapper[35367]: I1204 12:19:14.836151 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/daccfe35-6818-404b-a6fa-0a41c1b0c7ec-config\") pod \"dnsmasq-dns-75d7c5dbd7-cfxqx\" (UID: \"daccfe35-6818-404b-a6fa-0a41c1b0c7ec\") " pod="openstack/dnsmasq-dns-75d7c5dbd7-cfxqx" Dec 04 12:19:14.853829 master-0 kubenswrapper[35367]: I1204 12:19:14.853387 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-stzdl\" (UniqueName: \"kubernetes.io/projected/f058b868-204d-40a3-8746-e46d9ee199e8-kube-api-access-stzdl\") pod \"dnsmasq-dns-5dbfd7c4bf-vkd6n\" (UID: \"f058b868-204d-40a3-8746-e46d9ee199e8\") " pod="openstack/dnsmasq-dns-5dbfd7c4bf-vkd6n" Dec 04 12:19:14.857825 master-0 kubenswrapper[35367]: I1204 12:19:14.856215 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dkdx\" (UniqueName: \"kubernetes.io/projected/daccfe35-6818-404b-a6fa-0a41c1b0c7ec-kube-api-access-2dkdx\") pod \"dnsmasq-dns-75d7c5dbd7-cfxqx\" (UID: \"daccfe35-6818-404b-a6fa-0a41c1b0c7ec\") " pod="openstack/dnsmasq-dns-75d7c5dbd7-cfxqx" Dec 04 12:19:14.883450 master-0 kubenswrapper[35367]: I1204 12:19:14.883377 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-5dbfd7c4bf-vkd6n" Dec 04 12:19:14.981594 master-0 kubenswrapper[35367]: I1204 12:19:14.981493 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-75d7c5dbd7-cfxqx" Dec 04 12:19:15.963090 master-0 kubenswrapper[35367]: I1204 12:19:15.962786 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-5dbfd7c4bf-vkd6n"] Dec 04 12:19:16.023847 master-0 kubenswrapper[35367]: I1204 12:19:16.023723 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-5dbfd7c4bf-vkd6n" event={"ID":"f058b868-204d-40a3-8746-e46d9ee199e8","Type":"ContainerStarted","Data":"7b83b6b6e7b1f025a95f3ab69941a18a14da2efd4d63807c7652b56098efcc6e"} Dec 04 12:19:16.109537 master-0 kubenswrapper[35367]: I1204 12:19:16.109454 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-75d7c5dbd7-cfxqx"] Dec 04 12:19:16.112642 master-0 kubenswrapper[35367]: W1204 12:19:16.112563 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddaccfe35_6818_404b_a6fa_0a41c1b0c7ec.slice/crio-94a5c25f6ca0aa384a52f5d355195236ff3909d09b53e472774680de009aeb51 WatchSource:0}: Error finding container 94a5c25f6ca0aa384a52f5d355195236ff3909d09b53e472774680de009aeb51: Status 404 returned error can't find the container with id 94a5c25f6ca0aa384a52f5d355195236ff3909d09b53e472774680de009aeb51 Dec 04 12:19:16.510838 master-0 kubenswrapper[35367]: I1204 12:19:16.510232 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-5dbfd7c4bf-vkd6n"] Dec 04 12:19:16.549193 master-0 kubenswrapper[35367]: I1204 12:19:16.549127 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-6f856ff86c-vmt85"] Dec 04 12:19:16.551393 master-0 kubenswrapper[35367]: I1204 12:19:16.551346 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" Dec 04 12:19:16.564899 master-0 kubenswrapper[35367]: I1204 12:19:16.564774 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-6f856ff86c-vmt85"] Dec 04 12:19:16.732974 master-0 kubenswrapper[35367]: I1204 12:19:16.732893 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/de7522fa-385c-448e-8eaf-d238973fda1b-dns-svc\") pod \"dnsmasq-dns-6f856ff86c-vmt85\" (UID: \"de7522fa-385c-448e-8eaf-d238973fda1b\") " pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" Dec 04 12:19:16.733217 master-0 kubenswrapper[35367]: I1204 12:19:16.732991 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvhgp\" (UniqueName: \"kubernetes.io/projected/de7522fa-385c-448e-8eaf-d238973fda1b-kube-api-access-lvhgp\") pod \"dnsmasq-dns-6f856ff86c-vmt85\" (UID: \"de7522fa-385c-448e-8eaf-d238973fda1b\") " pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" Dec 04 12:19:16.733217 master-0 kubenswrapper[35367]: I1204 12:19:16.733043 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de7522fa-385c-448e-8eaf-d238973fda1b-config\") pod \"dnsmasq-dns-6f856ff86c-vmt85\" (UID: \"de7522fa-385c-448e-8eaf-d238973fda1b\") " pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" Dec 04 12:19:16.834757 master-0 kubenswrapper[35367]: I1204 12:19:16.834647 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de7522fa-385c-448e-8eaf-d238973fda1b-config\") pod \"dnsmasq-dns-6f856ff86c-vmt85\" (UID: \"de7522fa-385c-448e-8eaf-d238973fda1b\") " pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" Dec 04 12:19:16.835153 master-0 kubenswrapper[35367]: I1204 12:19:16.834823 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/de7522fa-385c-448e-8eaf-d238973fda1b-dns-svc\") pod \"dnsmasq-dns-6f856ff86c-vmt85\" (UID: \"de7522fa-385c-448e-8eaf-d238973fda1b\") " pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" Dec 04 12:19:16.835153 master-0 kubenswrapper[35367]: I1204 12:19:16.834900 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lvhgp\" (UniqueName: \"kubernetes.io/projected/de7522fa-385c-448e-8eaf-d238973fda1b-kube-api-access-lvhgp\") pod \"dnsmasq-dns-6f856ff86c-vmt85\" (UID: \"de7522fa-385c-448e-8eaf-d238973fda1b\") " pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" Dec 04 12:19:16.836640 master-0 kubenswrapper[35367]: I1204 12:19:16.836592 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/de7522fa-385c-448e-8eaf-d238973fda1b-dns-svc\") pod \"dnsmasq-dns-6f856ff86c-vmt85\" (UID: \"de7522fa-385c-448e-8eaf-d238973fda1b\") " pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" Dec 04 12:19:16.837169 master-0 kubenswrapper[35367]: I1204 12:19:16.837105 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de7522fa-385c-448e-8eaf-d238973fda1b-config\") pod \"dnsmasq-dns-6f856ff86c-vmt85\" (UID: \"de7522fa-385c-448e-8eaf-d238973fda1b\") " pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" Dec 04 12:19:16.955753 master-0 kubenswrapper[35367]: I1204 12:19:16.955703 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvhgp\" (UniqueName: \"kubernetes.io/projected/de7522fa-385c-448e-8eaf-d238973fda1b-kube-api-access-lvhgp\") pod \"dnsmasq-dns-6f856ff86c-vmt85\" (UID: \"de7522fa-385c-448e-8eaf-d238973fda1b\") " pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" Dec 04 12:19:17.049844 master-0 kubenswrapper[35367]: I1204 12:19:17.048100 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-75d7c5dbd7-cfxqx" event={"ID":"daccfe35-6818-404b-a6fa-0a41c1b0c7ec","Type":"ContainerStarted","Data":"94a5c25f6ca0aa384a52f5d355195236ff3909d09b53e472774680de009aeb51"} Dec 04 12:19:17.224065 master-0 kubenswrapper[35367]: I1204 12:19:17.223792 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" Dec 04 12:19:17.917381 master-0 kubenswrapper[35367]: I1204 12:19:17.914905 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-826mk"] Dec 04 12:19:17.959649 master-0 kubenswrapper[35367]: I1204 12:19:17.930010 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-826mk" Dec 04 12:19:18.002618 master-0 kubenswrapper[35367]: I1204 12:19:18.000993 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2brd5\" (UniqueName: \"kubernetes.io/projected/016cf101-1d70-4d15-8857-5a92f2f8ce64-kube-api-access-2brd5\") pod \"redhat-operators-826mk\" (UID: \"016cf101-1d70-4d15-8857-5a92f2f8ce64\") " pod="openshift-marketplace/redhat-operators-826mk" Dec 04 12:19:18.002618 master-0 kubenswrapper[35367]: I1204 12:19:18.001090 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/016cf101-1d70-4d15-8857-5a92f2f8ce64-utilities\") pod \"redhat-operators-826mk\" (UID: \"016cf101-1d70-4d15-8857-5a92f2f8ce64\") " pod="openshift-marketplace/redhat-operators-826mk" Dec 04 12:19:18.002618 master-0 kubenswrapper[35367]: I1204 12:19:18.001254 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/016cf101-1d70-4d15-8857-5a92f2f8ce64-catalog-content\") pod \"redhat-operators-826mk\" (UID: \"016cf101-1d70-4d15-8857-5a92f2f8ce64\") " pod="openshift-marketplace/redhat-operators-826mk" Dec 04 12:19:18.113921 master-0 kubenswrapper[35367]: I1204 12:19:18.111008 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2brd5\" (UniqueName: \"kubernetes.io/projected/016cf101-1d70-4d15-8857-5a92f2f8ce64-kube-api-access-2brd5\") pod \"redhat-operators-826mk\" (UID: \"016cf101-1d70-4d15-8857-5a92f2f8ce64\") " pod="openshift-marketplace/redhat-operators-826mk" Dec 04 12:19:18.113921 master-0 kubenswrapper[35367]: I1204 12:19:18.111094 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/016cf101-1d70-4d15-8857-5a92f2f8ce64-utilities\") pod \"redhat-operators-826mk\" (UID: \"016cf101-1d70-4d15-8857-5a92f2f8ce64\") " pod="openshift-marketplace/redhat-operators-826mk" Dec 04 12:19:18.113921 master-0 kubenswrapper[35367]: I1204 12:19:18.111213 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/016cf101-1d70-4d15-8857-5a92f2f8ce64-catalog-content\") pod \"redhat-operators-826mk\" (UID: \"016cf101-1d70-4d15-8857-5a92f2f8ce64\") " pod="openshift-marketplace/redhat-operators-826mk" Dec 04 12:19:18.113921 master-0 kubenswrapper[35367]: I1204 12:19:18.111769 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/016cf101-1d70-4d15-8857-5a92f2f8ce64-catalog-content\") pod \"redhat-operators-826mk\" (UID: \"016cf101-1d70-4d15-8857-5a92f2f8ce64\") " pod="openshift-marketplace/redhat-operators-826mk" Dec 04 12:19:18.113921 master-0 kubenswrapper[35367]: I1204 12:19:18.112309 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/016cf101-1d70-4d15-8857-5a92f2f8ce64-utilities\") pod \"redhat-operators-826mk\" (UID: \"016cf101-1d70-4d15-8857-5a92f2f8ce64\") " pod="openshift-marketplace/redhat-operators-826mk" Dec 04 12:19:18.145848 master-0 kubenswrapper[35367]: I1204 12:19:18.145744 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2brd5\" (UniqueName: \"kubernetes.io/projected/016cf101-1d70-4d15-8857-5a92f2f8ce64-kube-api-access-2brd5\") pod \"redhat-operators-826mk\" (UID: \"016cf101-1d70-4d15-8857-5a92f2f8ce64\") " pod="openshift-marketplace/redhat-operators-826mk" Dec 04 12:19:18.152117 master-0 kubenswrapper[35367]: I1204 12:19:18.151791 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" event={"ID":"de7522fa-385c-448e-8eaf-d238973fda1b","Type":"ContainerStarted","Data":"1e0b6a441b76d8f596faacb78609367f5921d9a27f5366fa29e2d1f6ccc50ab0"} Dec 04 12:19:18.179075 master-0 kubenswrapper[35367]: I1204 12:19:18.178943 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-826mk"] Dec 04 12:19:18.259529 master-0 kubenswrapper[35367]: I1204 12:19:18.259389 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-826mk" Dec 04 12:19:18.287895 master-0 kubenswrapper[35367]: I1204 12:19:18.268720 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-6f856ff86c-vmt85"] Dec 04 12:19:18.370901 master-0 kubenswrapper[35367]: I1204 12:19:18.368849 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-75d7c5dbd7-cfxqx"] Dec 04 12:19:18.561918 master-0 kubenswrapper[35367]: I1204 12:19:18.552019 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-658bb5765c-fp46q"] Dec 04 12:19:18.561918 master-0 kubenswrapper[35367]: I1204 12:19:18.554545 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-658bb5765c-fp46q" Dec 04 12:19:18.615838 master-0 kubenswrapper[35367]: I1204 12:19:18.608512 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-658bb5765c-fp46q"] Dec 04 12:19:18.654630 master-0 kubenswrapper[35367]: I1204 12:19:18.654548 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn9sn\" (UniqueName: \"kubernetes.io/projected/6a88e1d8-2084-49c9-a30a-f3bf7464b104-kube-api-access-gn9sn\") pod \"dnsmasq-dns-658bb5765c-fp46q\" (UID: \"6a88e1d8-2084-49c9-a30a-f3bf7464b104\") " pod="openstack/dnsmasq-dns-658bb5765c-fp46q" Dec 04 12:19:18.654913 master-0 kubenswrapper[35367]: I1204 12:19:18.654701 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a88e1d8-2084-49c9-a30a-f3bf7464b104-config\") pod \"dnsmasq-dns-658bb5765c-fp46q\" (UID: \"6a88e1d8-2084-49c9-a30a-f3bf7464b104\") " pod="openstack/dnsmasq-dns-658bb5765c-fp46q" Dec 04 12:19:18.654913 master-0 kubenswrapper[35367]: I1204 12:19:18.654827 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/6a88e1d8-2084-49c9-a30a-f3bf7464b104-dns-svc\") pod \"dnsmasq-dns-658bb5765c-fp46q\" (UID: \"6a88e1d8-2084-49c9-a30a-f3bf7464b104\") " pod="openstack/dnsmasq-dns-658bb5765c-fp46q" Dec 04 12:19:18.769354 master-0 kubenswrapper[35367]: I1204 12:19:18.769122 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a88e1d8-2084-49c9-a30a-f3bf7464b104-config\") pod \"dnsmasq-dns-658bb5765c-fp46q\" (UID: \"6a88e1d8-2084-49c9-a30a-f3bf7464b104\") " pod="openstack/dnsmasq-dns-658bb5765c-fp46q" Dec 04 12:19:18.770800 master-0 kubenswrapper[35367]: I1204 12:19:18.770739 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a88e1d8-2084-49c9-a30a-f3bf7464b104-config\") pod \"dnsmasq-dns-658bb5765c-fp46q\" (UID: \"6a88e1d8-2084-49c9-a30a-f3bf7464b104\") " pod="openstack/dnsmasq-dns-658bb5765c-fp46q" Dec 04 12:19:18.771641 master-0 kubenswrapper[35367]: I1204 12:19:18.771564 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/6a88e1d8-2084-49c9-a30a-f3bf7464b104-dns-svc\") pod \"dnsmasq-dns-658bb5765c-fp46q\" (UID: \"6a88e1d8-2084-49c9-a30a-f3bf7464b104\") " pod="openstack/dnsmasq-dns-658bb5765c-fp46q" Dec 04 12:19:18.771887 master-0 kubenswrapper[35367]: I1204 12:19:18.771851 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gn9sn\" (UniqueName: \"kubernetes.io/projected/6a88e1d8-2084-49c9-a30a-f3bf7464b104-kube-api-access-gn9sn\") pod \"dnsmasq-dns-658bb5765c-fp46q\" (UID: \"6a88e1d8-2084-49c9-a30a-f3bf7464b104\") " pod="openstack/dnsmasq-dns-658bb5765c-fp46q" Dec 04 12:19:18.774429 master-0 kubenswrapper[35367]: I1204 12:19:18.774289 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/6a88e1d8-2084-49c9-a30a-f3bf7464b104-dns-svc\") pod \"dnsmasq-dns-658bb5765c-fp46q\" (UID: \"6a88e1d8-2084-49c9-a30a-f3bf7464b104\") " pod="openstack/dnsmasq-dns-658bb5765c-fp46q" Dec 04 12:19:18.797662 master-0 kubenswrapper[35367]: I1204 12:19:18.797531 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn9sn\" (UniqueName: \"kubernetes.io/projected/6a88e1d8-2084-49c9-a30a-f3bf7464b104-kube-api-access-gn9sn\") pod \"dnsmasq-dns-658bb5765c-fp46q\" (UID: \"6a88e1d8-2084-49c9-a30a-f3bf7464b104\") " pod="openstack/dnsmasq-dns-658bb5765c-fp46q" Dec 04 12:19:18.828151 master-0 kubenswrapper[35367]: I1204 12:19:18.827995 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-658bb5765c-fp46q" Dec 04 12:19:19.172388 master-0 kubenswrapper[35367]: I1204 12:19:19.172255 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-knvdv" Dec 04 12:19:19.173235 master-0 kubenswrapper[35367]: I1204 12:19:19.173182 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-knvdv" Dec 04 12:19:19.356201 master-0 kubenswrapper[35367]: I1204 12:19:19.356059 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-knvdv" Dec 04 12:19:20.801736 master-0 kubenswrapper[35367]: I1204 12:19:20.801676 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-knvdv" Dec 04 12:19:21.366597 master-0 kubenswrapper[35367]: I1204 12:19:21.366516 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-826mk"] Dec 04 12:19:21.392591 master-0 kubenswrapper[35367]: I1204 12:19:21.392472 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-658bb5765c-fp46q"] Dec 04 12:19:21.420844 master-0 kubenswrapper[35367]: W1204 12:19:21.420767 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod016cf101_1d70_4d15_8857_5a92f2f8ce64.slice/crio-5a075f7e0a534833157e4c0230fd9b54139a57f216c8aa51d67bbb2410350951 WatchSource:0}: Error finding container 5a075f7e0a534833157e4c0230fd9b54139a57f216c8aa51d67bbb2410350951: Status 404 returned error can't find the container with id 5a075f7e0a534833157e4c0230fd9b54139a57f216c8aa51d67bbb2410350951 Dec 04 12:19:21.642844 master-0 kubenswrapper[35367]: I1204 12:19:21.642478 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-knvdv"] Dec 04 12:19:21.870077 master-0 kubenswrapper[35367]: I1204 12:19:21.869962 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-826mk" event={"ID":"016cf101-1d70-4d15-8857-5a92f2f8ce64","Type":"ContainerStarted","Data":"5a075f7e0a534833157e4c0230fd9b54139a57f216c8aa51d67bbb2410350951"} Dec 04 12:19:21.907133 master-0 kubenswrapper[35367]: I1204 12:19:21.874112 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-658bb5765c-fp46q" event={"ID":"6a88e1d8-2084-49c9-a30a-f3bf7464b104","Type":"ContainerStarted","Data":"5d66313d0fa406d22063cad97f989eaff2191fdd647bf2573baca50b506ba14f"} Dec 04 12:19:22.960527 master-0 kubenswrapper[35367]: I1204 12:19:22.956055 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-knvdv" podUID="d581de33-736d-45d7-9aa4-4b2650b877c1" containerName="registry-server" containerID="cri-o://8d968eab6c75603b4e854b28890f964bb5ffe410c769453cab14bdc3ce1bff36" gracePeriod=2 Dec 04 12:19:23.181790 master-0 kubenswrapper[35367]: I1204 12:19:23.181608 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/memcached-0"] Dec 04 12:19:23.191921 master-0 kubenswrapper[35367]: I1204 12:19:23.190054 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/memcached-0" Dec 04 12:19:23.194054 master-0 kubenswrapper[35367]: I1204 12:19:23.193987 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/memcached-0"] Dec 04 12:19:23.205438 master-0 kubenswrapper[35367]: I1204 12:19:23.195857 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"memcached-config-data" Dec 04 12:19:23.205438 master-0 kubenswrapper[35367]: I1204 12:19:23.197044 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-memcached-svc" Dec 04 12:19:23.209433 master-0 kubenswrapper[35367]: I1204 12:19:23.207173 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"combined-ca-bundle" Dec 04 12:19:23.298002 master-0 kubenswrapper[35367]: I1204 12:19:23.297918 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/1146115a-813a-4194-a69c-443d773cec5a-memcached-tls-certs\") pod \"memcached-0\" (UID: \"1146115a-813a-4194-a69c-443d773cec5a\") " pod="openstack/memcached-0" Dec 04 12:19:23.300731 master-0 kubenswrapper[35367]: I1204 12:19:23.299588 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/1146115a-813a-4194-a69c-443d773cec5a-config-data\") pod \"memcached-0\" (UID: \"1146115a-813a-4194-a69c-443d773cec5a\") " pod="openstack/memcached-0" Dec 04 12:19:23.305491 master-0 kubenswrapper[35367]: I1204 12:19:23.305389 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1146115a-813a-4194-a69c-443d773cec5a-combined-ca-bundle\") pod \"memcached-0\" (UID: \"1146115a-813a-4194-a69c-443d773cec5a\") " pod="openstack/memcached-0" Dec 04 12:19:23.305751 master-0 kubenswrapper[35367]: I1204 12:19:23.305568 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/1146115a-813a-4194-a69c-443d773cec5a-kolla-config\") pod \"memcached-0\" (UID: \"1146115a-813a-4194-a69c-443d773cec5a\") " pod="openstack/memcached-0" Dec 04 12:19:23.305751 master-0 kubenswrapper[35367]: I1204 12:19:23.305647 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkwb9\" (UniqueName: \"kubernetes.io/projected/1146115a-813a-4194-a69c-443d773cec5a-kube-api-access-xkwb9\") pod \"memcached-0\" (UID: \"1146115a-813a-4194-a69c-443d773cec5a\") " pod="openstack/memcached-0" Dec 04 12:19:23.430891 master-0 kubenswrapper[35367]: I1204 12:19:23.427062 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xkwb9\" (UniqueName: \"kubernetes.io/projected/1146115a-813a-4194-a69c-443d773cec5a-kube-api-access-xkwb9\") pod \"memcached-0\" (UID: \"1146115a-813a-4194-a69c-443d773cec5a\") " pod="openstack/memcached-0" Dec 04 12:19:23.430891 master-0 kubenswrapper[35367]: I1204 12:19:23.427289 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/1146115a-813a-4194-a69c-443d773cec5a-memcached-tls-certs\") pod \"memcached-0\" (UID: \"1146115a-813a-4194-a69c-443d773cec5a\") " pod="openstack/memcached-0" Dec 04 12:19:23.430891 master-0 kubenswrapper[35367]: I1204 12:19:23.427364 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/1146115a-813a-4194-a69c-443d773cec5a-config-data\") pod \"memcached-0\" (UID: \"1146115a-813a-4194-a69c-443d773cec5a\") " pod="openstack/memcached-0" Dec 04 12:19:23.430891 master-0 kubenswrapper[35367]: I1204 12:19:23.427419 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1146115a-813a-4194-a69c-443d773cec5a-combined-ca-bundle\") pod \"memcached-0\" (UID: \"1146115a-813a-4194-a69c-443d773cec5a\") " pod="openstack/memcached-0" Dec 04 12:19:23.430891 master-0 kubenswrapper[35367]: I1204 12:19:23.427495 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/1146115a-813a-4194-a69c-443d773cec5a-kolla-config\") pod \"memcached-0\" (UID: \"1146115a-813a-4194-a69c-443d773cec5a\") " pod="openstack/memcached-0" Dec 04 12:19:23.433015 master-0 kubenswrapper[35367]: I1204 12:19:23.429276 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/1146115a-813a-4194-a69c-443d773cec5a-kolla-config\") pod \"memcached-0\" (UID: \"1146115a-813a-4194-a69c-443d773cec5a\") " pod="openstack/memcached-0" Dec 04 12:19:23.433015 master-0 kubenswrapper[35367]: I1204 12:19:23.429373 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/1146115a-813a-4194-a69c-443d773cec5a-config-data\") pod \"memcached-0\" (UID: \"1146115a-813a-4194-a69c-443d773cec5a\") " pod="openstack/memcached-0" Dec 04 12:19:23.433925 master-0 kubenswrapper[35367]: I1204 12:19:23.433865 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/1146115a-813a-4194-a69c-443d773cec5a-memcached-tls-certs\") pod \"memcached-0\" (UID: \"1146115a-813a-4194-a69c-443d773cec5a\") " pod="openstack/memcached-0" Dec 04 12:19:23.511831 master-0 kubenswrapper[35367]: I1204 12:19:23.511406 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkwb9\" (UniqueName: \"kubernetes.io/projected/1146115a-813a-4194-a69c-443d773cec5a-kube-api-access-xkwb9\") pod \"memcached-0\" (UID: \"1146115a-813a-4194-a69c-443d773cec5a\") " pod="openstack/memcached-0" Dec 04 12:19:23.533076 master-0 kubenswrapper[35367]: I1204 12:19:23.532550 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1146115a-813a-4194-a69c-443d773cec5a-combined-ca-bundle\") pod \"memcached-0\" (UID: \"1146115a-813a-4194-a69c-443d773cec5a\") " pod="openstack/memcached-0" Dec 04 12:19:23.589319 master-0 kubenswrapper[35367]: I1204 12:19:23.589231 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/memcached-0" Dec 04 12:19:24.042775 master-0 kubenswrapper[35367]: I1204 12:19:24.042690 35367 generic.go:334] "Generic (PLEG): container finished" podID="016cf101-1d70-4d15-8857-5a92f2f8ce64" containerID="6af4102a269ba8ce881b84ec7ef09bdfbc86009ebe270fe64af09c0978b51ba6" exitCode=0 Dec 04 12:19:24.042775 master-0 kubenswrapper[35367]: I1204 12:19:24.042776 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-826mk" event={"ID":"016cf101-1d70-4d15-8857-5a92f2f8ce64","Type":"ContainerDied","Data":"6af4102a269ba8ce881b84ec7ef09bdfbc86009ebe270fe64af09c0978b51ba6"} Dec 04 12:19:24.058368 master-0 kubenswrapper[35367]: I1204 12:19:24.058315 35367 generic.go:334] "Generic (PLEG): container finished" podID="d581de33-736d-45d7-9aa4-4b2650b877c1" containerID="8d968eab6c75603b4e854b28890f964bb5ffe410c769453cab14bdc3ce1bff36" exitCode=0 Dec 04 12:19:24.058506 master-0 kubenswrapper[35367]: I1204 12:19:24.058388 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-knvdv" event={"ID":"d581de33-736d-45d7-9aa4-4b2650b877c1","Type":"ContainerDied","Data":"8d968eab6c75603b4e854b28890f964bb5ffe410c769453cab14bdc3ce1bff36"} Dec 04 12:19:24.152496 master-0 kubenswrapper[35367]: I1204 12:19:24.151611 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-knvdv" Dec 04 12:19:24.334749 master-0 kubenswrapper[35367]: I1204 12:19:24.333307 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d581de33-736d-45d7-9aa4-4b2650b877c1-utilities\") pod \"d581de33-736d-45d7-9aa4-4b2650b877c1\" (UID: \"d581de33-736d-45d7-9aa4-4b2650b877c1\") " Dec 04 12:19:24.336408 master-0 kubenswrapper[35367]: I1204 12:19:24.334814 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6zsm\" (UniqueName: \"kubernetes.io/projected/d581de33-736d-45d7-9aa4-4b2650b877c1-kube-api-access-l6zsm\") pod \"d581de33-736d-45d7-9aa4-4b2650b877c1\" (UID: \"d581de33-736d-45d7-9aa4-4b2650b877c1\") " Dec 04 12:19:24.336408 master-0 kubenswrapper[35367]: I1204 12:19:24.334679 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d581de33-736d-45d7-9aa4-4b2650b877c1-utilities" (OuterVolumeSpecName: "utilities") pod "d581de33-736d-45d7-9aa4-4b2650b877c1" (UID: "d581de33-736d-45d7-9aa4-4b2650b877c1"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:19:24.336408 master-0 kubenswrapper[35367]: I1204 12:19:24.335106 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d581de33-736d-45d7-9aa4-4b2650b877c1-catalog-content\") pod \"d581de33-736d-45d7-9aa4-4b2650b877c1\" (UID: \"d581de33-736d-45d7-9aa4-4b2650b877c1\") " Dec 04 12:19:24.336408 master-0 kubenswrapper[35367]: I1204 12:19:24.336339 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d581de33-736d-45d7-9aa4-4b2650b877c1-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:19:24.387135 master-0 kubenswrapper[35367]: I1204 12:19:24.351691 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d581de33-736d-45d7-9aa4-4b2650b877c1-kube-api-access-l6zsm" (OuterVolumeSpecName: "kube-api-access-l6zsm") pod "d581de33-736d-45d7-9aa4-4b2650b877c1" (UID: "d581de33-736d-45d7-9aa4-4b2650b877c1"). InnerVolumeSpecName "kube-api-access-l6zsm". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:19:24.411347 master-0 kubenswrapper[35367]: I1204 12:19:24.411030 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d581de33-736d-45d7-9aa4-4b2650b877c1-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "d581de33-736d-45d7-9aa4-4b2650b877c1" (UID: "d581de33-736d-45d7-9aa4-4b2650b877c1"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:19:24.439217 master-0 kubenswrapper[35367]: I1204 12:19:24.438987 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d581de33-736d-45d7-9aa4-4b2650b877c1-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:19:24.439217 master-0 kubenswrapper[35367]: I1204 12:19:24.439093 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-l6zsm\" (UniqueName: \"kubernetes.io/projected/d581de33-736d-45d7-9aa4-4b2650b877c1-kube-api-access-l6zsm\") on node \"master-0\" DevicePath \"\"" Dec 04 12:19:25.072041 master-0 kubenswrapper[35367]: I1204 12:19:25.068912 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/memcached-0"] Dec 04 12:19:25.080948 master-0 kubenswrapper[35367]: W1204 12:19:25.072401 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1146115a_813a_4194_a69c_443d773cec5a.slice/crio-1054e3852fb6ca227a3274ce6215d23a3b9efe0ab6e7b5ef92ecb09459bad00d WatchSource:0}: Error finding container 1054e3852fb6ca227a3274ce6215d23a3b9efe0ab6e7b5ef92ecb09459bad00d: Status 404 returned error can't find the container with id 1054e3852fb6ca227a3274ce6215d23a3b9efe0ab6e7b5ef92ecb09459bad00d Dec 04 12:19:25.119432 master-0 kubenswrapper[35367]: I1204 12:19:25.118361 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-knvdv" event={"ID":"d581de33-736d-45d7-9aa4-4b2650b877c1","Type":"ContainerDied","Data":"c4114c9de9bfc935b8414b17c8af267eef683a868fa7d9617b731fc0beab384a"} Dec 04 12:19:25.119432 master-0 kubenswrapper[35367]: I1204 12:19:25.118432 35367 scope.go:117] "RemoveContainer" containerID="8d968eab6c75603b4e854b28890f964bb5ffe410c769453cab14bdc3ce1bff36" Dec 04 12:19:25.119432 master-0 kubenswrapper[35367]: I1204 12:19:25.118603 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-knvdv" Dec 04 12:19:25.158450 master-0 kubenswrapper[35367]: I1204 12:19:25.158410 35367 scope.go:117] "RemoveContainer" containerID="e9231a51cae02c359a864b0d6d19ac4d33d0f2564c9fabffd91661fd8140488f" Dec 04 12:19:25.357952 master-0 kubenswrapper[35367]: I1204 12:19:25.357592 35367 scope.go:117] "RemoveContainer" containerID="e8f3b78d0c428bbda2173ee844447dc39118602d81b87dff3d042bdc76b5be35" Dec 04 12:19:25.426991 master-0 kubenswrapper[35367]: I1204 12:19:25.425894 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-knvdv"] Dec 04 12:19:25.446157 master-0 kubenswrapper[35367]: I1204 12:19:25.446078 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-knvdv"] Dec 04 12:19:26.153885 master-0 kubenswrapper[35367]: I1204 12:19:26.153716 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/rabbitmq-server-0"] Dec 04 12:19:26.155286 master-0 kubenswrapper[35367]: E1204 12:19:26.155251 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d581de33-736d-45d7-9aa4-4b2650b877c1" containerName="extract-utilities" Dec 04 12:19:26.155365 master-0 kubenswrapper[35367]: I1204 12:19:26.155288 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="d581de33-736d-45d7-9aa4-4b2650b877c1" containerName="extract-utilities" Dec 04 12:19:26.155365 master-0 kubenswrapper[35367]: E1204 12:19:26.155347 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d581de33-736d-45d7-9aa4-4b2650b877c1" containerName="extract-content" Dec 04 12:19:26.155365 master-0 kubenswrapper[35367]: I1204 12:19:26.155354 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="d581de33-736d-45d7-9aa4-4b2650b877c1" containerName="extract-content" Dec 04 12:19:26.155463 master-0 kubenswrapper[35367]: E1204 12:19:26.155416 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d581de33-736d-45d7-9aa4-4b2650b877c1" containerName="registry-server" Dec 04 12:19:26.155463 master-0 kubenswrapper[35367]: I1204 12:19:26.155424 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="d581de33-736d-45d7-9aa4-4b2650b877c1" containerName="registry-server" Dec 04 12:19:26.156009 master-0 kubenswrapper[35367]: I1204 12:19:26.155981 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="d581de33-736d-45d7-9aa4-4b2650b877c1" containerName="registry-server" Dec 04 12:19:26.169884 master-0 kubenswrapper[35367]: I1204 12:19:26.169716 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.174379 master-0 kubenswrapper[35367]: I1204 12:19:26.174318 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"rabbitmq-server-conf" Dec 04 12:19:26.176954 master-0 kubenswrapper[35367]: I1204 12:19:26.175479 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"rabbitmq-erlang-cookie" Dec 04 12:19:26.176954 master-0 kubenswrapper[35367]: I1204 12:19:26.176631 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"rabbitmq-default-user" Dec 04 12:19:26.177666 master-0 kubenswrapper[35367]: I1204 12:19:26.177650 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-rabbitmq-svc" Dec 04 12:19:26.178042 master-0 kubenswrapper[35367]: I1204 12:19:26.178028 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"rabbitmq-plugins-conf" Dec 04 12:19:26.178297 master-0 kubenswrapper[35367]: I1204 12:19:26.178284 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"rabbitmq-config-data" Dec 04 12:19:26.216266 master-0 kubenswrapper[35367]: I1204 12:19:26.191051 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/memcached-0" event={"ID":"1146115a-813a-4194-a69c-443d773cec5a","Type":"ContainerStarted","Data":"1054e3852fb6ca227a3274ce6215d23a3b9efe0ab6e7b5ef92ecb09459bad00d"} Dec 04 12:19:26.258075 master-0 kubenswrapper[35367]: I1204 12:19:26.257986 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/rabbitmq-server-0"] Dec 04 12:19:26.335151 master-0 kubenswrapper[35367]: I1204 12:19:26.335102 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/f78e6ce3-d552-4b22-8bb1-002996379ed1-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.335819 master-0 kubenswrapper[35367]: I1204 12:19:26.335790 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/f78e6ce3-d552-4b22-8bb1-002996379ed1-server-conf\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.335930 master-0 kubenswrapper[35367]: I1204 12:19:26.335913 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4cln\" (UniqueName: \"kubernetes.io/projected/f78e6ce3-d552-4b22-8bb1-002996379ed1-kube-api-access-t4cln\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.336047 master-0 kubenswrapper[35367]: I1204 12:19:26.336027 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/f78e6ce3-d552-4b22-8bb1-002996379ed1-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.336134 master-0 kubenswrapper[35367]: I1204 12:19:26.336115 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/f78e6ce3-d552-4b22-8bb1-002996379ed1-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.336223 master-0 kubenswrapper[35367]: I1204 12:19:26.336209 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/f78e6ce3-d552-4b22-8bb1-002996379ed1-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.336329 master-0 kubenswrapper[35367]: I1204 12:19:26.336315 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/f78e6ce3-d552-4b22-8bb1-002996379ed1-pod-info\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.336511 master-0 kubenswrapper[35367]: I1204 12:19:26.336494 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/f78e6ce3-d552-4b22-8bb1-002996379ed1-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.336636 master-0 kubenswrapper[35367]: I1204 12:19:26.336618 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/f78e6ce3-d552-4b22-8bb1-002996379ed1-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.336757 master-0 kubenswrapper[35367]: I1204 12:19:26.336738 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f78e6ce3-d552-4b22-8bb1-002996379ed1-config-data\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.336957 master-0 kubenswrapper[35367]: I1204 12:19:26.336933 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-236356d7-e264-4b7f-9420-c84069f25bfc\" (UniqueName: \"kubernetes.io/csi/topolvm.io^8005b5e4-8135-483c-a4b8-fd20dd63feaa\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.439635 master-0 kubenswrapper[35367]: I1204 12:19:26.439250 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/f78e6ce3-d552-4b22-8bb1-002996379ed1-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.439635 master-0 kubenswrapper[35367]: I1204 12:19:26.439456 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/f78e6ce3-d552-4b22-8bb1-002996379ed1-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.439635 master-0 kubenswrapper[35367]: I1204 12:19:26.439565 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f78e6ce3-d552-4b22-8bb1-002996379ed1-config-data\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.440128 master-0 kubenswrapper[35367]: I1204 12:19:26.439821 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/f78e6ce3-d552-4b22-8bb1-002996379ed1-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.440128 master-0 kubenswrapper[35367]: I1204 12:19:26.439883 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/f78e6ce3-d552-4b22-8bb1-002996379ed1-server-conf\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.440128 master-0 kubenswrapper[35367]: I1204 12:19:26.439940 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t4cln\" (UniqueName: \"kubernetes.io/projected/f78e6ce3-d552-4b22-8bb1-002996379ed1-kube-api-access-t4cln\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.440277 master-0 kubenswrapper[35367]: I1204 12:19:26.440112 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/f78e6ce3-d552-4b22-8bb1-002996379ed1-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.440277 master-0 kubenswrapper[35367]: I1204 12:19:26.440231 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/f78e6ce3-d552-4b22-8bb1-002996379ed1-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.440517 master-0 kubenswrapper[35367]: I1204 12:19:26.440292 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/f78e6ce3-d552-4b22-8bb1-002996379ed1-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.440517 master-0 kubenswrapper[35367]: I1204 12:19:26.440342 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/f78e6ce3-d552-4b22-8bb1-002996379ed1-pod-info\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.441780 master-0 kubenswrapper[35367]: I1204 12:19:26.441285 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/f78e6ce3-d552-4b22-8bb1-002996379ed1-server-conf\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.442231 master-0 kubenswrapper[35367]: I1204 12:19:26.442153 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/f78e6ce3-d552-4b22-8bb1-002996379ed1-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.442753 master-0 kubenswrapper[35367]: I1204 12:19:26.442637 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/f78e6ce3-d552-4b22-8bb1-002996379ed1-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.443429 master-0 kubenswrapper[35367]: I1204 12:19:26.443381 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/f78e6ce3-d552-4b22-8bb1-002996379ed1-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.444266 master-0 kubenswrapper[35367]: I1204 12:19:26.444237 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f78e6ce3-d552-4b22-8bb1-002996379ed1-config-data\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.449713 master-0 kubenswrapper[35367]: I1204 12:19:26.449613 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/f78e6ce3-d552-4b22-8bb1-002996379ed1-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.450417 master-0 kubenswrapper[35367]: I1204 12:19:26.450350 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/f78e6ce3-d552-4b22-8bb1-002996379ed1-pod-info\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.456688 master-0 kubenswrapper[35367]: I1204 12:19:26.456597 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/f78e6ce3-d552-4b22-8bb1-002996379ed1-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.494094 master-0 kubenswrapper[35367]: I1204 12:19:26.494030 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/f78e6ce3-d552-4b22-8bb1-002996379ed1-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:26.792323 master-0 kubenswrapper[35367]: I1204 12:19:26.792148 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d581de33-736d-45d7-9aa4-4b2650b877c1" path="/var/lib/kubelet/pods/d581de33-736d-45d7-9aa4-4b2650b877c1/volumes" Dec 04 12:19:27.893416 master-0 kubenswrapper[35367]: I1204 12:19:27.893327 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/rabbitmq-cell1-server-0"] Dec 04 12:19:27.896474 master-0 kubenswrapper[35367]: I1204 12:19:27.896422 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:27.898872 master-0 kubenswrapper[35367]: I1204 12:19:27.898727 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"rabbitmq-cell1-plugins-conf" Dec 04 12:19:27.900391 master-0 kubenswrapper[35367]: I1204 12:19:27.899288 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-rabbitmq-cell1-svc" Dec 04 12:19:27.900391 master-0 kubenswrapper[35367]: I1204 12:19:27.899629 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"rabbitmq-cell1-config-data" Dec 04 12:19:27.900391 master-0 kubenswrapper[35367]: I1204 12:19:27.899830 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"rabbitmq-cell1-server-conf" Dec 04 12:19:27.900391 master-0 kubenswrapper[35367]: I1204 12:19:27.900164 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"rabbitmq-cell1-erlang-cookie" Dec 04 12:19:27.900391 master-0 kubenswrapper[35367]: I1204 12:19:27.900237 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"rabbitmq-cell1-default-user" Dec 04 12:19:29.060231 master-0 kubenswrapper[35367]: I1204 12:19:29.060161 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/rabbitmq-cell1-server-0"] Dec 04 12:19:29.146606 master-0 kubenswrapper[35367]: I1204 12:19:29.146531 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-236356d7-e264-4b7f-9420-c84069f25bfc\" (UniqueName: \"kubernetes.io/csi/topolvm.io^8005b5e4-8135-483c-a4b8-fd20dd63feaa\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:29.149283 master-0 kubenswrapper[35367]: I1204 12:19:29.149248 35367 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 12:19:29.149388 master-0 kubenswrapper[35367]: I1204 12:19:29.149282 35367 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-236356d7-e264-4b7f-9420-c84069f25bfc\" (UniqueName: \"kubernetes.io/csi/topolvm.io^8005b5e4-8135-483c-a4b8-fd20dd63feaa\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/264b527e6f4040bd1a9dc47a94205df9fb023f310da86604cb266f2a052433dd/globalmount\"" pod="openstack/rabbitmq-server-0" Dec 04 12:19:29.388211 master-0 kubenswrapper[35367]: I1204 12:19:29.388073 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4cln\" (UniqueName: \"kubernetes.io/projected/f78e6ce3-d552-4b22-8bb1-002996379ed1-kube-api-access-t4cln\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:29.469955 master-0 kubenswrapper[35367]: I1204 12:19:29.469895 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.470343 master-0 kubenswrapper[35367]: I1204 12:19:29.470317 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.470540 master-0 kubenswrapper[35367]: I1204 12:19:29.470520 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc5dh\" (UniqueName: \"kubernetes.io/projected/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-kube-api-access-sc5dh\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.470651 master-0 kubenswrapper[35367]: I1204 12:19:29.470632 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.470758 master-0 kubenswrapper[35367]: I1204 12:19:29.470740 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.470951 master-0 kubenswrapper[35367]: I1204 12:19:29.470929 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-be83dc65-d5e1-48b7-ba65-15262ec95939\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c4e3677d-88cd-4b99-bec2-1915d13ae406\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.471100 master-0 kubenswrapper[35367]: I1204 12:19:29.471081 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.471331 master-0 kubenswrapper[35367]: I1204 12:19:29.471307 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.471569 master-0 kubenswrapper[35367]: I1204 12:19:29.471537 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.471703 master-0 kubenswrapper[35367]: I1204 12:19:29.471679 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.472121 master-0 kubenswrapper[35367]: I1204 12:19:29.472092 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.574936 master-0 kubenswrapper[35367]: I1204 12:19:29.574827 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.575255 master-0 kubenswrapper[35367]: I1204 12:19:29.574950 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.575255 master-0 kubenswrapper[35367]: I1204 12:19:29.574998 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.575255 master-0 kubenswrapper[35367]: I1204 12:19:29.575071 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.575255 master-0 kubenswrapper[35367]: I1204 12:19:29.575120 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.575255 master-0 kubenswrapper[35367]: I1204 12:19:29.575197 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sc5dh\" (UniqueName: \"kubernetes.io/projected/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-kube-api-access-sc5dh\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.575255 master-0 kubenswrapper[35367]: I1204 12:19:29.575224 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.575255 master-0 kubenswrapper[35367]: I1204 12:19:29.575248 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.576279 master-0 kubenswrapper[35367]: I1204 12:19:29.575312 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-be83dc65-d5e1-48b7-ba65-15262ec95939\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c4e3677d-88cd-4b99-bec2-1915d13ae406\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.576279 master-0 kubenswrapper[35367]: I1204 12:19:29.575350 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.576279 master-0 kubenswrapper[35367]: I1204 12:19:29.575478 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.576279 master-0 kubenswrapper[35367]: I1204 12:19:29.576133 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.577382 master-0 kubenswrapper[35367]: I1204 12:19:29.577279 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.578745 master-0 kubenswrapper[35367]: I1204 12:19:29.578685 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.579854 master-0 kubenswrapper[35367]: I1204 12:19:29.579832 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.580123 master-0 kubenswrapper[35367]: I1204 12:19:29.580095 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.581555 master-0 kubenswrapper[35367]: I1204 12:19:29.581529 35367 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 12:19:29.581653 master-0 kubenswrapper[35367]: I1204 12:19:29.581569 35367 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-be83dc65-d5e1-48b7-ba65-15262ec95939\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c4e3677d-88cd-4b99-bec2-1915d13ae406\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/59774c65298a97281a97e8fb38f7876be4dc263370ae80d64ca4986e63365502/globalmount\"" pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.583632 master-0 kubenswrapper[35367]: I1204 12:19:29.583584 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.584713 master-0 kubenswrapper[35367]: I1204 12:19:29.584607 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.584713 master-0 kubenswrapper[35367]: I1204 12:19:29.584626 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.585326 master-0 kubenswrapper[35367]: I1204 12:19:29.585209 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.737316 master-0 kubenswrapper[35367]: I1204 12:19:29.737156 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/openstack-galera-0"] Dec 04 12:19:29.752910 master-0 kubenswrapper[35367]: I1204 12:19:29.752853 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc5dh\" (UniqueName: \"kubernetes.io/projected/9e325c88-55d0-4cb0-8f32-bccf8a0fbdda-kube-api-access-sc5dh\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:29.760412 master-0 kubenswrapper[35367]: I1204 12:19:29.760311 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/openstack-galera-0" Dec 04 12:19:29.764479 master-0 kubenswrapper[35367]: I1204 12:19:29.764435 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-galera-openstack-svc" Dec 04 12:19:29.766352 master-0 kubenswrapper[35367]: I1204 12:19:29.765697 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"openstack-scripts" Dec 04 12:19:29.766352 master-0 kubenswrapper[35367]: I1204 12:19:29.766175 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"openstack-config-data" Dec 04 12:19:29.806728 master-0 kubenswrapper[35367]: I1204 12:19:29.806661 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/openstack-galera-0"] Dec 04 12:19:29.902493 master-0 kubenswrapper[35367]: I1204 12:19:29.902121 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/96661f30-6623-4f69-909f-635dbd957e21-config-data-generated\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:29.902493 master-0 kubenswrapper[35367]: I1204 12:19:29.902221 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/96661f30-6623-4f69-909f-635dbd957e21-config-data-default\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:29.902493 master-0 kubenswrapper[35367]: I1204 12:19:29.902294 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/96661f30-6623-4f69-909f-635dbd957e21-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:29.902493 master-0 kubenswrapper[35367]: I1204 12:19:29.902318 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96661f30-6623-4f69-909f-635dbd957e21-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:29.902493 master-0 kubenswrapper[35367]: I1204 12:19:29.902342 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b3c11f1a-400c-42f4-859b-266aabab922b\" (UniqueName: \"kubernetes.io/csi/topolvm.io^d5efc9ba-1901-4681-a93c-6a8f9f8280d5\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:29.902493 master-0 kubenswrapper[35367]: I1204 12:19:29.902533 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4b8g\" (UniqueName: \"kubernetes.io/projected/96661f30-6623-4f69-909f-635dbd957e21-kube-api-access-g4b8g\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:29.905855 master-0 kubenswrapper[35367]: I1204 12:19:29.905292 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/96661f30-6623-4f69-909f-635dbd957e21-operator-scripts\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:29.905855 master-0 kubenswrapper[35367]: I1204 12:19:29.905349 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/96661f30-6623-4f69-909f-635dbd957e21-kolla-config\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:30.012025 master-0 kubenswrapper[35367]: I1204 12:19:30.011824 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-g4b8g\" (UniqueName: \"kubernetes.io/projected/96661f30-6623-4f69-909f-635dbd957e21-kube-api-access-g4b8g\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:30.012297 master-0 kubenswrapper[35367]: I1204 12:19:30.012060 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/96661f30-6623-4f69-909f-635dbd957e21-operator-scripts\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:30.012297 master-0 kubenswrapper[35367]: I1204 12:19:30.012087 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/96661f30-6623-4f69-909f-635dbd957e21-kolla-config\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:30.012297 master-0 kubenswrapper[35367]: I1204 12:19:30.012171 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/96661f30-6623-4f69-909f-635dbd957e21-config-data-generated\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:30.012297 master-0 kubenswrapper[35367]: I1204 12:19:30.012210 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/96661f30-6623-4f69-909f-635dbd957e21-config-data-default\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:30.012297 master-0 kubenswrapper[35367]: I1204 12:19:30.012265 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/96661f30-6623-4f69-909f-635dbd957e21-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:30.012553 master-0 kubenswrapper[35367]: I1204 12:19:30.012325 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96661f30-6623-4f69-909f-635dbd957e21-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:30.012553 master-0 kubenswrapper[35367]: I1204 12:19:30.012353 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-b3c11f1a-400c-42f4-859b-266aabab922b\" (UniqueName: \"kubernetes.io/csi/topolvm.io^d5efc9ba-1901-4681-a93c-6a8f9f8280d5\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:30.012943 master-0 kubenswrapper[35367]: I1204 12:19:30.012884 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/96661f30-6623-4f69-909f-635dbd957e21-config-data-generated\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:30.014537 master-0 kubenswrapper[35367]: I1204 12:19:30.014488 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/96661f30-6623-4f69-909f-635dbd957e21-operator-scripts\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:30.015157 master-0 kubenswrapper[35367]: I1204 12:19:30.015120 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/96661f30-6623-4f69-909f-635dbd957e21-kolla-config\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:30.019112 master-0 kubenswrapper[35367]: I1204 12:19:30.019000 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/96661f30-6623-4f69-909f-635dbd957e21-config-data-default\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:30.023060 master-0 kubenswrapper[35367]: I1204 12:19:30.022948 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/96661f30-6623-4f69-909f-635dbd957e21-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:30.023424 master-0 kubenswrapper[35367]: I1204 12:19:30.023152 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96661f30-6623-4f69-909f-635dbd957e21-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:30.023662 master-0 kubenswrapper[35367]: I1204 12:19:30.023595 35367 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 12:19:30.023749 master-0 kubenswrapper[35367]: I1204 12:19:30.023672 35367 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-b3c11f1a-400c-42f4-859b-266aabab922b\" (UniqueName: \"kubernetes.io/csi/topolvm.io^d5efc9ba-1901-4681-a93c-6a8f9f8280d5\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/fcee50f158c8478b79782231b1d56ec3c6c3490e86f9fb2aed313697c44bfa0e/globalmount\"" pod="openstack/openstack-galera-0" Dec 04 12:19:30.048443 master-0 kubenswrapper[35367]: I1204 12:19:30.048094 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4b8g\" (UniqueName: \"kubernetes.io/projected/96661f30-6623-4f69-909f-635dbd957e21-kube-api-access-g4b8g\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:30.287104 master-0 kubenswrapper[35367]: I1204 12:19:30.286880 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovn-controller-sm45t"] Dec 04 12:19:30.289580 master-0 kubenswrapper[35367]: I1204 12:19:30.289497 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.293561 master-0 kubenswrapper[35367]: I1204 12:19:30.293339 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ovncontroller-ovndbs" Dec 04 12:19:30.293725 master-0 kubenswrapper[35367]: I1204 12:19:30.293663 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovncontroller-scripts" Dec 04 12:19:30.426188 master-0 kubenswrapper[35367]: I1204 12:19:30.425464 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2cf9c09-b934-4bc5-babf-9ed4469aa5a0-combined-ca-bundle\") pod \"ovn-controller-sm45t\" (UID: \"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0\") " pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.426188 master-0 kubenswrapper[35367]: I1204 12:19:30.425573 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2cf9c09-b934-4bc5-babf-9ed4469aa5a0-ovn-controller-tls-certs\") pod \"ovn-controller-sm45t\" (UID: \"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0\") " pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.426188 master-0 kubenswrapper[35367]: I1204 12:19:30.425794 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a2cf9c09-b934-4bc5-babf-9ed4469aa5a0-scripts\") pod \"ovn-controller-sm45t\" (UID: \"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0\") " pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.426188 master-0 kubenswrapper[35367]: I1204 12:19:30.425914 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/a2cf9c09-b934-4bc5-babf-9ed4469aa5a0-var-log-ovn\") pod \"ovn-controller-sm45t\" (UID: \"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0\") " pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.426188 master-0 kubenswrapper[35367]: I1204 12:19:30.425987 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwwq6\" (UniqueName: \"kubernetes.io/projected/a2cf9c09-b934-4bc5-babf-9ed4469aa5a0-kube-api-access-gwwq6\") pod \"ovn-controller-sm45t\" (UID: \"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0\") " pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.426188 master-0 kubenswrapper[35367]: I1204 12:19:30.426055 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/a2cf9c09-b934-4bc5-babf-9ed4469aa5a0-var-run\") pod \"ovn-controller-sm45t\" (UID: \"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0\") " pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.426188 master-0 kubenswrapper[35367]: I1204 12:19:30.426093 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2cf9c09-b934-4bc5-babf-9ed4469aa5a0-var-run-ovn\") pod \"ovn-controller-sm45t\" (UID: \"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0\") " pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.435253 master-0 kubenswrapper[35367]: I1204 12:19:30.435168 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovn-controller-ovs-dwktl"] Dec 04 12:19:30.438468 master-0 kubenswrapper[35367]: I1204 12:19:30.438380 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:19:30.476783 master-0 kubenswrapper[35367]: I1204 12:19:30.476700 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-sm45t"] Dec 04 12:19:30.512357 master-0 kubenswrapper[35367]: I1204 12:19:30.512291 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-ovs-dwktl"] Dec 04 12:19:30.528186 master-0 kubenswrapper[35367]: I1204 12:19:30.528107 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/fbb3336e-2fa8-42f1-9501-39ac668b6b84-var-lib\") pod \"ovn-controller-ovs-dwktl\" (UID: \"fbb3336e-2fa8-42f1-9501-39ac668b6b84\") " pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:19:30.528489 master-0 kubenswrapper[35367]: I1204 12:19:30.528260 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/fbb3336e-2fa8-42f1-9501-39ac668b6b84-etc-ovs\") pod \"ovn-controller-ovs-dwktl\" (UID: \"fbb3336e-2fa8-42f1-9501-39ac668b6b84\") " pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:19:30.528489 master-0 kubenswrapper[35367]: I1204 12:19:30.528317 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a2cf9c09-b934-4bc5-babf-9ed4469aa5a0-scripts\") pod \"ovn-controller-sm45t\" (UID: \"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0\") " pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.528489 master-0 kubenswrapper[35367]: I1204 12:19:30.528350 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/a2cf9c09-b934-4bc5-babf-9ed4469aa5a0-var-log-ovn\") pod \"ovn-controller-sm45t\" (UID: \"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0\") " pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.528489 master-0 kubenswrapper[35367]: I1204 12:19:30.528393 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gwwq6\" (UniqueName: \"kubernetes.io/projected/a2cf9c09-b934-4bc5-babf-9ed4469aa5a0-kube-api-access-gwwq6\") pod \"ovn-controller-sm45t\" (UID: \"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0\") " pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.528489 master-0 kubenswrapper[35367]: I1204 12:19:30.528452 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/a2cf9c09-b934-4bc5-babf-9ed4469aa5a0-var-run\") pod \"ovn-controller-sm45t\" (UID: \"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0\") " pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.528489 master-0 kubenswrapper[35367]: I1204 12:19:30.528484 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/fbb3336e-2fa8-42f1-9501-39ac668b6b84-var-run\") pod \"ovn-controller-ovs-dwktl\" (UID: \"fbb3336e-2fa8-42f1-9501-39ac668b6b84\") " pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:19:30.528775 master-0 kubenswrapper[35367]: I1204 12:19:30.528517 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2cf9c09-b934-4bc5-babf-9ed4469aa5a0-var-run-ovn\") pod \"ovn-controller-sm45t\" (UID: \"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0\") " pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.528775 master-0 kubenswrapper[35367]: I1204 12:19:30.528578 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2cf9c09-b934-4bc5-babf-9ed4469aa5a0-combined-ca-bundle\") pod \"ovn-controller-sm45t\" (UID: \"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0\") " pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.528775 master-0 kubenswrapper[35367]: I1204 12:19:30.528638 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2cf9c09-b934-4bc5-babf-9ed4469aa5a0-ovn-controller-tls-certs\") pod \"ovn-controller-sm45t\" (UID: \"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0\") " pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.528775 master-0 kubenswrapper[35367]: I1204 12:19:30.528673 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/fbb3336e-2fa8-42f1-9501-39ac668b6b84-var-log\") pod \"ovn-controller-ovs-dwktl\" (UID: \"fbb3336e-2fa8-42f1-9501-39ac668b6b84\") " pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:19:30.528775 master-0 kubenswrapper[35367]: I1204 12:19:30.528701 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhfxh\" (UniqueName: \"kubernetes.io/projected/fbb3336e-2fa8-42f1-9501-39ac668b6b84-kube-api-access-vhfxh\") pod \"ovn-controller-ovs-dwktl\" (UID: \"fbb3336e-2fa8-42f1-9501-39ac668b6b84\") " pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:19:30.528775 master-0 kubenswrapper[35367]: I1204 12:19:30.528747 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fbb3336e-2fa8-42f1-9501-39ac668b6b84-scripts\") pod \"ovn-controller-ovs-dwktl\" (UID: \"fbb3336e-2fa8-42f1-9501-39ac668b6b84\") " pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:19:30.530557 master-0 kubenswrapper[35367]: I1204 12:19:30.529773 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/a2cf9c09-b934-4bc5-babf-9ed4469aa5a0-var-log-ovn\") pod \"ovn-controller-sm45t\" (UID: \"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0\") " pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.530557 master-0 kubenswrapper[35367]: I1204 12:19:30.529928 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2cf9c09-b934-4bc5-babf-9ed4469aa5a0-var-run-ovn\") pod \"ovn-controller-sm45t\" (UID: \"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0\") " pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.530557 master-0 kubenswrapper[35367]: I1204 12:19:30.530067 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/a2cf9c09-b934-4bc5-babf-9ed4469aa5a0-var-run\") pod \"ovn-controller-sm45t\" (UID: \"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0\") " pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.532590 master-0 kubenswrapper[35367]: I1204 12:19:30.532540 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a2cf9c09-b934-4bc5-babf-9ed4469aa5a0-scripts\") pod \"ovn-controller-sm45t\" (UID: \"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0\") " pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.534838 master-0 kubenswrapper[35367]: I1204 12:19:30.534422 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2cf9c09-b934-4bc5-babf-9ed4469aa5a0-ovn-controller-tls-certs\") pod \"ovn-controller-sm45t\" (UID: \"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0\") " pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.550222 master-0 kubenswrapper[35367]: I1204 12:19:30.550102 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2cf9c09-b934-4bc5-babf-9ed4469aa5a0-combined-ca-bundle\") pod \"ovn-controller-sm45t\" (UID: \"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0\") " pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.553066 master-0 kubenswrapper[35367]: I1204 12:19:30.551431 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwwq6\" (UniqueName: \"kubernetes.io/projected/a2cf9c09-b934-4bc5-babf-9ed4469aa5a0-kube-api-access-gwwq6\") pod \"ovn-controller-sm45t\" (UID: \"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0\") " pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.729236 master-0 kubenswrapper[35367]: I1204 12:19:30.631106 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/fbb3336e-2fa8-42f1-9501-39ac668b6b84-var-lib\") pod \"ovn-controller-ovs-dwktl\" (UID: \"fbb3336e-2fa8-42f1-9501-39ac668b6b84\") " pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:19:30.729236 master-0 kubenswrapper[35367]: I1204 12:19:30.631251 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/fbb3336e-2fa8-42f1-9501-39ac668b6b84-etc-ovs\") pod \"ovn-controller-ovs-dwktl\" (UID: \"fbb3336e-2fa8-42f1-9501-39ac668b6b84\") " pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:19:30.729236 master-0 kubenswrapper[35367]: I1204 12:19:30.631352 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/fbb3336e-2fa8-42f1-9501-39ac668b6b84-var-run\") pod \"ovn-controller-ovs-dwktl\" (UID: \"fbb3336e-2fa8-42f1-9501-39ac668b6b84\") " pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:19:30.729236 master-0 kubenswrapper[35367]: I1204 12:19:30.631436 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/fbb3336e-2fa8-42f1-9501-39ac668b6b84-var-log\") pod \"ovn-controller-ovs-dwktl\" (UID: \"fbb3336e-2fa8-42f1-9501-39ac668b6b84\") " pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:19:30.729236 master-0 kubenswrapper[35367]: I1204 12:19:30.631470 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vhfxh\" (UniqueName: \"kubernetes.io/projected/fbb3336e-2fa8-42f1-9501-39ac668b6b84-kube-api-access-vhfxh\") pod \"ovn-controller-ovs-dwktl\" (UID: \"fbb3336e-2fa8-42f1-9501-39ac668b6b84\") " pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:19:30.729236 master-0 kubenswrapper[35367]: I1204 12:19:30.631524 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fbb3336e-2fa8-42f1-9501-39ac668b6b84-scripts\") pod \"ovn-controller-ovs-dwktl\" (UID: \"fbb3336e-2fa8-42f1-9501-39ac668b6b84\") " pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:19:30.729236 master-0 kubenswrapper[35367]: I1204 12:19:30.633486 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/fbb3336e-2fa8-42f1-9501-39ac668b6b84-var-lib\") pod \"ovn-controller-ovs-dwktl\" (UID: \"fbb3336e-2fa8-42f1-9501-39ac668b6b84\") " pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:19:30.729236 master-0 kubenswrapper[35367]: I1204 12:19:30.633801 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/fbb3336e-2fa8-42f1-9501-39ac668b6b84-etc-ovs\") pod \"ovn-controller-ovs-dwktl\" (UID: \"fbb3336e-2fa8-42f1-9501-39ac668b6b84\") " pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:19:30.729236 master-0 kubenswrapper[35367]: I1204 12:19:30.633918 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/fbb3336e-2fa8-42f1-9501-39ac668b6b84-var-run\") pod \"ovn-controller-ovs-dwktl\" (UID: \"fbb3336e-2fa8-42f1-9501-39ac668b6b84\") " pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:19:30.729236 master-0 kubenswrapper[35367]: I1204 12:19:30.634039 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/fbb3336e-2fa8-42f1-9501-39ac668b6b84-var-log\") pod \"ovn-controller-ovs-dwktl\" (UID: \"fbb3336e-2fa8-42f1-9501-39ac668b6b84\") " pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:19:30.729236 master-0 kubenswrapper[35367]: I1204 12:19:30.634256 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fbb3336e-2fa8-42f1-9501-39ac668b6b84-scripts\") pod \"ovn-controller-ovs-dwktl\" (UID: \"fbb3336e-2fa8-42f1-9501-39ac668b6b84\") " pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:19:30.729236 master-0 kubenswrapper[35367]: I1204 12:19:30.725758 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-sm45t" Dec 04 12:19:30.757564 master-0 kubenswrapper[35367]: I1204 12:19:30.757505 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhfxh\" (UniqueName: \"kubernetes.io/projected/fbb3336e-2fa8-42f1-9501-39ac668b6b84-kube-api-access-vhfxh\") pod \"ovn-controller-ovs-dwktl\" (UID: \"fbb3336e-2fa8-42f1-9501-39ac668b6b84\") " pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:19:30.778454 master-0 kubenswrapper[35367]: I1204 12:19:30.775904 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:19:31.476552 master-0 kubenswrapper[35367]: I1204 12:19:31.476439 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-236356d7-e264-4b7f-9420-c84069f25bfc\" (UniqueName: \"kubernetes.io/csi/topolvm.io^8005b5e4-8135-483c-a4b8-fd20dd63feaa\") pod \"rabbitmq-server-0\" (UID: \"f78e6ce3-d552-4b22-8bb1-002996379ed1\") " pod="openstack/rabbitmq-server-0" Dec 04 12:19:31.646512 master-0 kubenswrapper[35367]: I1204 12:19:31.646440 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/rabbitmq-server-0" Dec 04 12:19:32.451447 master-0 kubenswrapper[35367]: I1204 12:19:32.444060 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-4gtrh"] Dec 04 12:19:32.451447 master-0 kubenswrapper[35367]: I1204 12:19:32.450576 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-4gtrh" Dec 04 12:19:32.460466 master-0 kubenswrapper[35367]: I1204 12:19:32.460384 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-4gtrh"] Dec 04 12:19:32.588547 master-0 kubenswrapper[35367]: I1204 12:19:32.588460 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7b68ab26-0f7d-486e-9387-b08478d63900-catalog-content\") pod \"community-operators-4gtrh\" (UID: \"7b68ab26-0f7d-486e-9387-b08478d63900\") " pod="openshift-marketplace/community-operators-4gtrh" Dec 04 12:19:32.589241 master-0 kubenswrapper[35367]: I1204 12:19:32.588679 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kz5s\" (UniqueName: \"kubernetes.io/projected/7b68ab26-0f7d-486e-9387-b08478d63900-kube-api-access-8kz5s\") pod \"community-operators-4gtrh\" (UID: \"7b68ab26-0f7d-486e-9387-b08478d63900\") " pod="openshift-marketplace/community-operators-4gtrh" Dec 04 12:19:32.589241 master-0 kubenswrapper[35367]: I1204 12:19:32.588709 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7b68ab26-0f7d-486e-9387-b08478d63900-utilities\") pod \"community-operators-4gtrh\" (UID: \"7b68ab26-0f7d-486e-9387-b08478d63900\") " pod="openshift-marketplace/community-operators-4gtrh" Dec 04 12:19:32.700848 master-0 kubenswrapper[35367]: I1204 12:19:32.691446 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7b68ab26-0f7d-486e-9387-b08478d63900-utilities\") pod \"community-operators-4gtrh\" (UID: \"7b68ab26-0f7d-486e-9387-b08478d63900\") " pod="openshift-marketplace/community-operators-4gtrh" Dec 04 12:19:32.700848 master-0 kubenswrapper[35367]: I1204 12:19:32.691536 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8kz5s\" (UniqueName: \"kubernetes.io/projected/7b68ab26-0f7d-486e-9387-b08478d63900-kube-api-access-8kz5s\") pod \"community-operators-4gtrh\" (UID: \"7b68ab26-0f7d-486e-9387-b08478d63900\") " pod="openshift-marketplace/community-operators-4gtrh" Dec 04 12:19:32.700848 master-0 kubenswrapper[35367]: I1204 12:19:32.691601 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7b68ab26-0f7d-486e-9387-b08478d63900-catalog-content\") pod \"community-operators-4gtrh\" (UID: \"7b68ab26-0f7d-486e-9387-b08478d63900\") " pod="openshift-marketplace/community-operators-4gtrh" Dec 04 12:19:32.700848 master-0 kubenswrapper[35367]: I1204 12:19:32.693075 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7b68ab26-0f7d-486e-9387-b08478d63900-utilities\") pod \"community-operators-4gtrh\" (UID: \"7b68ab26-0f7d-486e-9387-b08478d63900\") " pod="openshift-marketplace/community-operators-4gtrh" Dec 04 12:19:32.700848 master-0 kubenswrapper[35367]: I1204 12:19:32.693134 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7b68ab26-0f7d-486e-9387-b08478d63900-catalog-content\") pod \"community-operators-4gtrh\" (UID: \"7b68ab26-0f7d-486e-9387-b08478d63900\") " pod="openshift-marketplace/community-operators-4gtrh" Dec 04 12:19:32.719845 master-0 kubenswrapper[35367]: I1204 12:19:32.712363 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kz5s\" (UniqueName: \"kubernetes.io/projected/7b68ab26-0f7d-486e-9387-b08478d63900-kube-api-access-8kz5s\") pod \"community-operators-4gtrh\" (UID: \"7b68ab26-0f7d-486e-9387-b08478d63900\") " pod="openshift-marketplace/community-operators-4gtrh" Dec 04 12:19:32.792713 master-0 kubenswrapper[35367]: I1204 12:19:32.791401 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-4gtrh" Dec 04 12:19:32.974924 master-0 kubenswrapper[35367]: I1204 12:19:32.972982 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-be83dc65-d5e1-48b7-ba65-15262ec95939\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c4e3677d-88cd-4b99-bec2-1915d13ae406\") pod \"rabbitmq-cell1-server-0\" (UID: \"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda\") " pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:33.024835 master-0 kubenswrapper[35367]: I1204 12:19:33.024461 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:19:33.541524 master-0 kubenswrapper[35367]: I1204 12:19:33.541445 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/openstack-cell1-galera-0"] Dec 04 12:19:33.550642 master-0 kubenswrapper[35367]: I1204 12:19:33.550566 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.558832 master-0 kubenswrapper[35367]: I1204 12:19:33.558750 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"openstack-cell1-scripts" Dec 04 12:19:33.562840 master-0 kubenswrapper[35367]: I1204 12:19:33.559554 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"openstack-cell1-config-data" Dec 04 12:19:33.562840 master-0 kubenswrapper[35367]: I1204 12:19:33.559829 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-galera-openstack-cell1-svc" Dec 04 12:19:33.615292 master-0 kubenswrapper[35367]: I1204 12:19:33.614482 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/openstack-cell1-galera-0"] Dec 04 12:19:33.708784 master-0 kubenswrapper[35367]: I1204 12:19:33.708690 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6c3fcc02-a129-4a9a-be2e-124ba02b13df-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.708784 master-0 kubenswrapper[35367]: I1204 12:19:33.708825 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/6c3fcc02-a129-4a9a-be2e-124ba02b13df-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.709543 master-0 kubenswrapper[35367]: I1204 12:19:33.708956 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c3fcc02-a129-4a9a-be2e-124ba02b13df-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.709543 master-0 kubenswrapper[35367]: I1204 12:19:33.709012 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/6c3fcc02-a129-4a9a-be2e-124ba02b13df-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.709543 master-0 kubenswrapper[35367]: I1204 12:19:33.709049 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-2674d199-28a8-49ba-95f4-0791ecc2d4cf\" (UniqueName: \"kubernetes.io/csi/topolvm.io^7fa27783-1570-44a1-a4e8-b8b1330b6290\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.709543 master-0 kubenswrapper[35367]: I1204 12:19:33.709073 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rq2w\" (UniqueName: \"kubernetes.io/projected/6c3fcc02-a129-4a9a-be2e-124ba02b13df-kube-api-access-4rq2w\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.709543 master-0 kubenswrapper[35367]: I1204 12:19:33.709098 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c3fcc02-a129-4a9a-be2e-124ba02b13df-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.709543 master-0 kubenswrapper[35367]: I1204 12:19:33.709145 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/6c3fcc02-a129-4a9a-be2e-124ba02b13df-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.811291 master-0 kubenswrapper[35367]: I1204 12:19:33.811209 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c3fcc02-a129-4a9a-be2e-124ba02b13df-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.811615 master-0 kubenswrapper[35367]: I1204 12:19:33.811335 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/6c3fcc02-a129-4a9a-be2e-124ba02b13df-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.811615 master-0 kubenswrapper[35367]: I1204 12:19:33.811390 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-2674d199-28a8-49ba-95f4-0791ecc2d4cf\" (UniqueName: \"kubernetes.io/csi/topolvm.io^7fa27783-1570-44a1-a4e8-b8b1330b6290\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.811615 master-0 kubenswrapper[35367]: I1204 12:19:33.811421 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4rq2w\" (UniqueName: \"kubernetes.io/projected/6c3fcc02-a129-4a9a-be2e-124ba02b13df-kube-api-access-4rq2w\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.812495 master-0 kubenswrapper[35367]: I1204 12:19:33.812061 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c3fcc02-a129-4a9a-be2e-124ba02b13df-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.812495 master-0 kubenswrapper[35367]: I1204 12:19:33.812273 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/6c3fcc02-a129-4a9a-be2e-124ba02b13df-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.812495 master-0 kubenswrapper[35367]: I1204 12:19:33.812456 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6c3fcc02-a129-4a9a-be2e-124ba02b13df-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.812665 master-0 kubenswrapper[35367]: I1204 12:19:33.812537 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/6c3fcc02-a129-4a9a-be2e-124ba02b13df-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.813386 master-0 kubenswrapper[35367]: I1204 12:19:33.812819 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/6c3fcc02-a129-4a9a-be2e-124ba02b13df-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.813386 master-0 kubenswrapper[35367]: I1204 12:19:33.813127 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/6c3fcc02-a129-4a9a-be2e-124ba02b13df-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.813926 master-0 kubenswrapper[35367]: I1204 12:19:33.813890 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/6c3fcc02-a129-4a9a-be2e-124ba02b13df-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.815917 master-0 kubenswrapper[35367]: I1204 12:19:33.815852 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6c3fcc02-a129-4a9a-be2e-124ba02b13df-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.816767 master-0 kubenswrapper[35367]: I1204 12:19:33.816583 35367 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 12:19:33.816767 master-0 kubenswrapper[35367]: I1204 12:19:33.816652 35367 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-2674d199-28a8-49ba-95f4-0791ecc2d4cf\" (UniqueName: \"kubernetes.io/csi/topolvm.io^7fa27783-1570-44a1-a4e8-b8b1330b6290\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/51dcf3836e391c50cd89f385dee38cef7e3017572458831fdca46e5bb319b0b1/globalmount\"" pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.816767 master-0 kubenswrapper[35367]: I1204 12:19:33.816705 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c3fcc02-a129-4a9a-be2e-124ba02b13df-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.823829 master-0 kubenswrapper[35367]: I1204 12:19:33.823387 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c3fcc02-a129-4a9a-be2e-124ba02b13df-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:33.841065 master-0 kubenswrapper[35367]: I1204 12:19:33.840982 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rq2w\" (UniqueName: \"kubernetes.io/projected/6c3fcc02-a129-4a9a-be2e-124ba02b13df-kube-api-access-4rq2w\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:35.167758 master-0 kubenswrapper[35367]: I1204 12:19:35.167079 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-b3c11f1a-400c-42f4-859b-266aabab922b\" (UniqueName: \"kubernetes.io/csi/topolvm.io^d5efc9ba-1901-4681-a93c-6a8f9f8280d5\") pod \"openstack-galera-0\" (UID: \"96661f30-6623-4f69-909f-635dbd957e21\") " pod="openstack/openstack-galera-0" Dec 04 12:19:35.223931 master-0 kubenswrapper[35367]: I1204 12:19:35.223763 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/openstack-galera-0" Dec 04 12:19:35.897465 master-0 kubenswrapper[35367]: I1204 12:19:35.897385 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovsdbserver-nb-0"] Dec 04 12:19:35.900072 master-0 kubenswrapper[35367]: I1204 12:19:35.900026 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:35.903690 master-0 kubenswrapper[35367]: I1204 12:19:35.903605 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ovndbcluster-nb-ovndbs" Dec 04 12:19:35.903794 master-0 kubenswrapper[35367]: I1204 12:19:35.903713 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovndbcluster-nb-config" Dec 04 12:19:35.905296 master-0 kubenswrapper[35367]: I1204 12:19:35.905272 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ovn-metrics" Dec 04 12:19:35.905574 master-0 kubenswrapper[35367]: I1204 12:19:35.905549 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovndbcluster-nb-scripts" Dec 04 12:19:35.913564 master-0 kubenswrapper[35367]: I1204 12:19:35.911294 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovsdbserver-nb-0"] Dec 04 12:19:36.110382 master-0 kubenswrapper[35367]: I1204 12:19:36.110326 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmctx\" (UniqueName: \"kubernetes.io/projected/67ab881b-4808-40bf-9d90-ac6dbb435b5d-kube-api-access-hmctx\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.110723 master-0 kubenswrapper[35367]: I1204 12:19:36.110700 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-e865b26a-c850-4fb0-99c8-f0f93b185988\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c4987f96-3bb1-4038-831c-b103787aced8\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.110884 master-0 kubenswrapper[35367]: I1204 12:19:36.110863 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67ab881b-4808-40bf-9d90-ac6dbb435b5d-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.110996 master-0 kubenswrapper[35367]: I1204 12:19:36.110979 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/67ab881b-4808-40bf-9d90-ac6dbb435b5d-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.111159 master-0 kubenswrapper[35367]: I1204 12:19:36.111141 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/67ab881b-4808-40bf-9d90-ac6dbb435b5d-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.111291 master-0 kubenswrapper[35367]: I1204 12:19:36.111275 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/67ab881b-4808-40bf-9d90-ac6dbb435b5d-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.111453 master-0 kubenswrapper[35367]: I1204 12:19:36.111433 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/67ab881b-4808-40bf-9d90-ac6dbb435b5d-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.111946 master-0 kubenswrapper[35367]: I1204 12:19:36.111873 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67ab881b-4808-40bf-9d90-ac6dbb435b5d-config\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.214979 master-0 kubenswrapper[35367]: I1204 12:19:36.214277 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/67ab881b-4808-40bf-9d90-ac6dbb435b5d-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.215713 master-0 kubenswrapper[35367]: I1204 12:19:36.214914 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/67ab881b-4808-40bf-9d90-ac6dbb435b5d-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.215713 master-0 kubenswrapper[35367]: I1204 12:19:36.215487 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67ab881b-4808-40bf-9d90-ac6dbb435b5d-config\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.215713 master-0 kubenswrapper[35367]: I1204 12:19:36.215536 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hmctx\" (UniqueName: \"kubernetes.io/projected/67ab881b-4808-40bf-9d90-ac6dbb435b5d-kube-api-access-hmctx\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.215713 master-0 kubenswrapper[35367]: I1204 12:19:36.215590 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-e865b26a-c850-4fb0-99c8-f0f93b185988\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c4987f96-3bb1-4038-831c-b103787aced8\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.215713 master-0 kubenswrapper[35367]: I1204 12:19:36.215636 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67ab881b-4808-40bf-9d90-ac6dbb435b5d-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.215713 master-0 kubenswrapper[35367]: I1204 12:19:36.215661 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/67ab881b-4808-40bf-9d90-ac6dbb435b5d-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.216071 master-0 kubenswrapper[35367]: I1204 12:19:36.215717 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/67ab881b-4808-40bf-9d90-ac6dbb435b5d-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.216071 master-0 kubenswrapper[35367]: I1204 12:19:36.215764 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/67ab881b-4808-40bf-9d90-ac6dbb435b5d-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.218081 master-0 kubenswrapper[35367]: I1204 12:19:36.218038 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67ab881b-4808-40bf-9d90-ac6dbb435b5d-config\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.218506 master-0 kubenswrapper[35367]: I1204 12:19:36.218481 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/67ab881b-4808-40bf-9d90-ac6dbb435b5d-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.219950 master-0 kubenswrapper[35367]: I1204 12:19:36.219927 35367 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 12:19:36.220119 master-0 kubenswrapper[35367]: I1204 12:19:36.220091 35367 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-e865b26a-c850-4fb0-99c8-f0f93b185988\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c4987f96-3bb1-4038-831c-b103787aced8\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/75c1c9a699eb1fb853e1c82d3a6005a3666fbb8229c092b244f5afdb370d02f0/globalmount\"" pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.220954 master-0 kubenswrapper[35367]: I1204 12:19:36.220916 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/67ab881b-4808-40bf-9d90-ac6dbb435b5d-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.222824 master-0 kubenswrapper[35367]: I1204 12:19:36.222180 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67ab881b-4808-40bf-9d90-ac6dbb435b5d-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.222824 master-0 kubenswrapper[35367]: I1204 12:19:36.222745 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/67ab881b-4808-40bf-9d90-ac6dbb435b5d-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.235151 master-0 kubenswrapper[35367]: I1204 12:19:36.235079 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmctx\" (UniqueName: \"kubernetes.io/projected/67ab881b-4808-40bf-9d90-ac6dbb435b5d-kube-api-access-hmctx\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:36.478316 master-0 kubenswrapper[35367]: I1204 12:19:36.478207 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-2674d199-28a8-49ba-95f4-0791ecc2d4cf\" (UniqueName: \"kubernetes.io/csi/topolvm.io^7fa27783-1570-44a1-a4e8-b8b1330b6290\") pod \"openstack-cell1-galera-0\" (UID: \"6c3fcc02-a129-4a9a-be2e-124ba02b13df\") " pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:36.629581 master-0 kubenswrapper[35367]: I1204 12:19:36.629490 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/openstack-cell1-galera-0" Dec 04 12:19:37.928236 master-0 kubenswrapper[35367]: I1204 12:19:37.928136 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-e865b26a-c850-4fb0-99c8-f0f93b185988\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c4987f96-3bb1-4038-831c-b103787aced8\") pod \"ovsdbserver-nb-0\" (UID: \"67ab881b-4808-40bf-9d90-ac6dbb435b5d\") " pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:38.034051 master-0 kubenswrapper[35367]: I1204 12:19:38.033957 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovsdbserver-nb-0" Dec 04 12:19:38.817101 master-0 kubenswrapper[35367]: I1204 12:19:38.816859 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/rabbitmq-server-0"] Dec 04 12:19:39.910592 master-0 kubenswrapper[35367]: I1204 12:19:39.910439 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovsdbserver-sb-0"] Dec 04 12:19:39.912553 master-0 kubenswrapper[35367]: I1204 12:19:39.912497 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:39.914991 master-0 kubenswrapper[35367]: I1204 12:19:39.914952 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovndbcluster-sb-scripts" Dec 04 12:19:39.915163 master-0 kubenswrapper[35367]: I1204 12:19:39.915020 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovndbcluster-sb-config" Dec 04 12:19:39.915163 master-0 kubenswrapper[35367]: I1204 12:19:39.914951 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ovndbcluster-sb-ovndbs" Dec 04 12:19:39.938828 master-0 kubenswrapper[35367]: I1204 12:19:39.936158 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovsdbserver-sb-0"] Dec 04 12:19:40.032837 master-0 kubenswrapper[35367]: I1204 12:19:40.032136 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb36e050-9d39-4b4e-bf1b-3a817c24f625-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.032837 master-0 kubenswrapper[35367]: I1204 12:19:40.032259 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxcls\" (UniqueName: \"kubernetes.io/projected/bb36e050-9d39-4b4e-bf1b-3a817c24f625-kube-api-access-zxcls\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.032837 master-0 kubenswrapper[35367]: I1204 12:19:40.032345 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb36e050-9d39-4b4e-bf1b-3a817c24f625-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.032837 master-0 kubenswrapper[35367]: I1204 12:19:40.032435 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-94163735-a017-46d7-a76f-50b481cb56b2\" (UniqueName: \"kubernetes.io/csi/topolvm.io^1c97dbe6-fec5-4c6d-8227-917cf4cb4b25\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.032837 master-0 kubenswrapper[35367]: I1204 12:19:40.032543 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/bb36e050-9d39-4b4e-bf1b-3a817c24f625-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.032837 master-0 kubenswrapper[35367]: I1204 12:19:40.032665 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb36e050-9d39-4b4e-bf1b-3a817c24f625-config\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.033387 master-0 kubenswrapper[35367]: I1204 12:19:40.032866 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/bb36e050-9d39-4b4e-bf1b-3a817c24f625-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.033387 master-0 kubenswrapper[35367]: I1204 12:19:40.033027 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb36e050-9d39-4b4e-bf1b-3a817c24f625-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.138414 master-0 kubenswrapper[35367]: I1204 12:19:40.137051 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/bb36e050-9d39-4b4e-bf1b-3a817c24f625-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.138414 master-0 kubenswrapper[35367]: I1204 12:19:40.137883 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb36e050-9d39-4b4e-bf1b-3a817c24f625-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.138761 master-0 kubenswrapper[35367]: I1204 12:19:40.138527 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb36e050-9d39-4b4e-bf1b-3a817c24f625-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.138761 master-0 kubenswrapper[35367]: I1204 12:19:40.138680 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zxcls\" (UniqueName: \"kubernetes.io/projected/bb36e050-9d39-4b4e-bf1b-3a817c24f625-kube-api-access-zxcls\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.142286 master-0 kubenswrapper[35367]: I1204 12:19:40.139323 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb36e050-9d39-4b4e-bf1b-3a817c24f625-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.143096 master-0 kubenswrapper[35367]: I1204 12:19:40.142770 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-94163735-a017-46d7-a76f-50b481cb56b2\" (UniqueName: \"kubernetes.io/csi/topolvm.io^1c97dbe6-fec5-4c6d-8227-917cf4cb4b25\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.143096 master-0 kubenswrapper[35367]: I1204 12:19:40.142942 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/bb36e050-9d39-4b4e-bf1b-3a817c24f625-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.143096 master-0 kubenswrapper[35367]: I1204 12:19:40.142987 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb36e050-9d39-4b4e-bf1b-3a817c24f625-config\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.145340 master-0 kubenswrapper[35367]: I1204 12:19:40.145294 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/bb36e050-9d39-4b4e-bf1b-3a817c24f625-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.146106 master-0 kubenswrapper[35367]: I1204 12:19:40.145624 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb36e050-9d39-4b4e-bf1b-3a817c24f625-config\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.150201 master-0 kubenswrapper[35367]: I1204 12:19:40.146899 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/bb36e050-9d39-4b4e-bf1b-3a817c24f625-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.151508 master-0 kubenswrapper[35367]: I1204 12:19:40.151421 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb36e050-9d39-4b4e-bf1b-3a817c24f625-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.155994 master-0 kubenswrapper[35367]: I1204 12:19:40.155947 35367 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 12:19:40.156187 master-0 kubenswrapper[35367]: I1204 12:19:40.156069 35367 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-94163735-a017-46d7-a76f-50b481cb56b2\" (UniqueName: \"kubernetes.io/csi/topolvm.io^1c97dbe6-fec5-4c6d-8227-917cf4cb4b25\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/7a2b77229080b7a2c868329804078dc66704a61b3b4994f5b78c83a62e729227/globalmount\"" pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.157975 master-0 kubenswrapper[35367]: I1204 12:19:40.157892 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb36e050-9d39-4b4e-bf1b-3a817c24f625-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.160234 master-0 kubenswrapper[35367]: I1204 12:19:40.160181 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb36e050-9d39-4b4e-bf1b-3a817c24f625-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:40.164246 master-0 kubenswrapper[35367]: I1204 12:19:40.164159 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxcls\" (UniqueName: \"kubernetes.io/projected/bb36e050-9d39-4b4e-bf1b-3a817c24f625-kube-api-access-zxcls\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:42.577369 master-0 kubenswrapper[35367]: I1204 12:19:42.577289 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-94163735-a017-46d7-a76f-50b481cb56b2\" (UniqueName: \"kubernetes.io/csi/topolvm.io^1c97dbe6-fec5-4c6d-8227-917cf4cb4b25\") pod \"ovsdbserver-sb-0\" (UID: \"bb36e050-9d39-4b4e-bf1b-3a817c24f625\") " pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:42.653228 master-0 kubenswrapper[35367]: I1204 12:19:42.653131 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovsdbserver-sb-0" Dec 04 12:19:47.157912 master-0 kubenswrapper[35367]: I1204 12:19:47.157746 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-server-0" event={"ID":"f78e6ce3-d552-4b22-8bb1-002996379ed1","Type":"ContainerStarted","Data":"4d37075b2000e9638793c0b5df95f1912a698e24bab73747d6057b6751558b13"} Dec 04 12:19:49.202850 master-0 kubenswrapper[35367]: I1204 12:19:49.196765 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-826mk" event={"ID":"016cf101-1d70-4d15-8857-5a92f2f8ce64","Type":"ContainerStarted","Data":"f91800dcbf53e9546a85d5dae57bc62c600b2ac2e96c0d947fcac2fbbaf60d89"} Dec 04 12:19:49.203959 master-0 kubenswrapper[35367]: I1204 12:19:49.203862 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-4gtrh"] Dec 04 12:19:49.222358 master-0 kubenswrapper[35367]: I1204 12:19:49.214572 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-75d7c5dbd7-cfxqx" podUID="daccfe35-6818-404b-a6fa-0a41c1b0c7ec" containerName="init" containerID="cri-o://a913222148543b38b0b1e0fb13995110b0cb0450311b12a46bad5c5ba04ceaf2" gracePeriod=10 Dec 04 12:19:49.222358 master-0 kubenswrapper[35367]: I1204 12:19:49.214711 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-75d7c5dbd7-cfxqx" event={"ID":"daccfe35-6818-404b-a6fa-0a41c1b0c7ec","Type":"ContainerStarted","Data":"a913222148543b38b0b1e0fb13995110b0cb0450311b12a46bad5c5ba04ceaf2"} Dec 04 12:19:49.223916 master-0 kubenswrapper[35367]: I1204 12:19:49.223765 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-5dbfd7c4bf-vkd6n" event={"ID":"f058b868-204d-40a3-8746-e46d9ee199e8","Type":"ContainerStarted","Data":"737a3e5d99b701abcef2a1686d63f845e4a845d8c267354c0e619af5e3a610d3"} Dec 04 12:19:49.230681 master-0 kubenswrapper[35367]: I1204 12:19:49.230628 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" event={"ID":"de7522fa-385c-448e-8eaf-d238973fda1b","Type":"ContainerStarted","Data":"54202e38bf767954f4a21b35d1bd07db05bdf657942a3567bcbb967dd996584a"} Dec 04 12:19:49.236113 master-0 kubenswrapper[35367]: I1204 12:19:49.236044 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/memcached-0" event={"ID":"1146115a-813a-4194-a69c-443d773cec5a","Type":"ContainerStarted","Data":"c798ff5ccfbb2d3c9a04b3ddddda360f14ffb6b520975efa07bb29a9f7b5bed1"} Dec 04 12:19:49.236240 master-0 kubenswrapper[35367]: I1204 12:19:49.236140 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/memcached-0" Dec 04 12:19:49.264906 master-0 kubenswrapper[35367]: I1204 12:19:49.262210 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-sm45t"] Dec 04 12:19:49.723260 master-0 kubenswrapper[35367]: E1204 12:19:49.723097 35367 log.go:32] "CreateContainer in sandbox from runtime service failed" err=< Dec 04 12:19:49.723260 master-0 kubenswrapper[35367]: rpc error: code = Unknown desc = container create failed: mount `/var/lib/kubelet/pods/de7522fa-385c-448e-8eaf-d238973fda1b/volume-subpaths/dns-svc/dnsmasq-dns/1` to `etc/dnsmasq.d/hosts/dns-svc`: No such file or directory Dec 04 12:19:49.723260 master-0 kubenswrapper[35367]: > podSandboxID="1e0b6a441b76d8f596faacb78609367f5921d9a27f5366fa29e2d1f6ccc50ab0" Dec 04 12:19:49.723680 master-0 kubenswrapper[35367]: E1204 12:19:49.723617 35367 kuberuntime_manager.go:1274] "Unhandled Error" err=< Dec 04 12:19:49.723680 master-0 kubenswrapper[35367]: container &Container{Name:dnsmasq-dns,Image:quay.io/podified-antelope-centos9/openstack-neutron-server@sha256:42f5663a161307156673f86e5eaad59f842a4bf25824f48008e69ab18e4ba792,Command:[/bin/bash],Args:[-c dnsmasq --interface=* --conf-dir=/etc/dnsmasq.d --hostsdir=/etc/dnsmasq.d/hosts --keep-in-foreground --log-debug --bind-interfaces --listen-address=$(POD_IP) --port 5353 --log-facility=- --no-hosts --domain-needed --no-resolv --bogus-priv --log-queries],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:CONFIG_HASH,Value:nbchf8h696h5ffh5cdh585hc5hbfh597h58dhfh554h67bh9bh5c9hfch7dh5fbhbbh567h78h669hf8h65dh55dh588h5ddh88h694h669h95h8q,ValueFrom:nil,},EnvVar{Name:POD_IP,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:status.podIP,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/etc/dnsmasq.d/config.cfg,SubPath:dns,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:dns-svc,ReadOnly:true,MountPath:/etc/dnsmasq.d/hosts/dns-svc,SubPath:dns-svc,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-lvhgp,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:nil,TCPSocket:&TCPSocketAction{Port:{0 5353 },Host:,},GRPC:nil,},InitialDelaySeconds:3,TimeoutSeconds:5,PeriodSeconds:3,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:nil,TCPSocket:&TCPSocketAction{Port:{0 5353 },Host:,},GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:5,PeriodSeconds:5,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000800000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod dnsmasq-dns-6f856ff86c-vmt85_openstack(de7522fa-385c-448e-8eaf-d238973fda1b): CreateContainerError: container create failed: mount `/var/lib/kubelet/pods/de7522fa-385c-448e-8eaf-d238973fda1b/volume-subpaths/dns-svc/dnsmasq-dns/1` to `etc/dnsmasq.d/hosts/dns-svc`: No such file or directory Dec 04 12:19:49.723680 master-0 kubenswrapper[35367]: > logger="UnhandledError" Dec 04 12:19:49.725681 master-0 kubenswrapper[35367]: E1204 12:19:49.725605 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dnsmasq-dns\" with CreateContainerError: \"container create failed: mount `/var/lib/kubelet/pods/de7522fa-385c-448e-8eaf-d238973fda1b/volume-subpaths/dns-svc/dnsmasq-dns/1` to `etc/dnsmasq.d/hosts/dns-svc`: No such file or directory\\n\"" pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" podUID="de7522fa-385c-448e-8eaf-d238973fda1b" Dec 04 12:19:49.775060 master-0 kubenswrapper[35367]: I1204 12:19:49.775007 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-5dbfd7c4bf-vkd6n" Dec 04 12:19:49.883884 master-0 kubenswrapper[35367]: I1204 12:19:49.883825 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f058b868-204d-40a3-8746-e46d9ee199e8-config\") pod \"f058b868-204d-40a3-8746-e46d9ee199e8\" (UID: \"f058b868-204d-40a3-8746-e46d9ee199e8\") " Dec 04 12:19:49.884186 master-0 kubenswrapper[35367]: I1204 12:19:49.884083 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stzdl\" (UniqueName: \"kubernetes.io/projected/f058b868-204d-40a3-8746-e46d9ee199e8-kube-api-access-stzdl\") pod \"f058b868-204d-40a3-8746-e46d9ee199e8\" (UID: \"f058b868-204d-40a3-8746-e46d9ee199e8\") " Dec 04 12:19:49.961033 master-0 kubenswrapper[35367]: I1204 12:19:49.960954 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/openstack-galera-0"] Dec 04 12:19:49.983854 master-0 kubenswrapper[35367]: I1204 12:19:49.971507 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f058b868-204d-40a3-8746-e46d9ee199e8-kube-api-access-stzdl" (OuterVolumeSpecName: "kube-api-access-stzdl") pod "f058b868-204d-40a3-8746-e46d9ee199e8" (UID: "f058b868-204d-40a3-8746-e46d9ee199e8"). InnerVolumeSpecName "kube-api-access-stzdl". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:19:50.019320 master-0 kubenswrapper[35367]: I1204 12:19:50.019094 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f058b868-204d-40a3-8746-e46d9ee199e8-config" (OuterVolumeSpecName: "config") pod "f058b868-204d-40a3-8746-e46d9ee199e8" (UID: "f058b868-204d-40a3-8746-e46d9ee199e8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:19:50.020748 master-0 kubenswrapper[35367]: I1204 12:19:50.020576 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f058b868-204d-40a3-8746-e46d9ee199e8-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:19:50.020748 master-0 kubenswrapper[35367]: I1204 12:19:50.020611 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-stzdl\" (UniqueName: \"kubernetes.io/projected/f058b868-204d-40a3-8746-e46d9ee199e8-kube-api-access-stzdl\") on node \"master-0\" DevicePath \"\"" Dec 04 12:19:50.159639 master-0 kubenswrapper[35367]: I1204 12:19:50.159456 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/memcached-0" podStartSLOduration=4.044128693 podStartE2EDuration="27.159422949s" podCreationTimestamp="2025-12-04 12:19:23 +0000 UTC" firstStartedPulling="2025-12-04 12:19:25.08934035 +0000 UTC m=+1208.527401598" lastFinishedPulling="2025-12-04 12:19:48.204634596 +0000 UTC m=+1231.642695854" observedRunningTime="2025-12-04 12:19:49.854631435 +0000 UTC m=+1233.292692693" watchObservedRunningTime="2025-12-04 12:19:50.159422949 +0000 UTC m=+1233.597484207" Dec 04 12:19:50.187649 master-0 kubenswrapper[35367]: I1204 12:19:50.187582 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/openstack-cell1-galera-0"] Dec 04 12:19:50.260024 master-0 kubenswrapper[35367]: I1204 12:19:50.259981 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/rabbitmq-cell1-server-0"] Dec 04 12:19:50.261679 master-0 kubenswrapper[35367]: I1204 12:19:50.261094 35367 generic.go:334] "Generic (PLEG): container finished" podID="de7522fa-385c-448e-8eaf-d238973fda1b" containerID="54202e38bf767954f4a21b35d1bd07db05bdf657942a3567bcbb967dd996584a" exitCode=0 Dec 04 12:19:50.261679 master-0 kubenswrapper[35367]: I1204 12:19:50.261285 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" event={"ID":"de7522fa-385c-448e-8eaf-d238973fda1b","Type":"ContainerDied","Data":"54202e38bf767954f4a21b35d1bd07db05bdf657942a3567bcbb967dd996584a"} Dec 04 12:19:50.266482 master-0 kubenswrapper[35367]: I1204 12:19:50.266242 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-galera-0" event={"ID":"96661f30-6623-4f69-909f-635dbd957e21","Type":"ContainerStarted","Data":"1d1164513f250ca30cd34b18e43480b3c23ed642a6789fa3084754472bac5fd8"} Dec 04 12:19:50.318547 master-0 kubenswrapper[35367]: I1204 12:19:50.315327 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-cell1-server-0" event={"ID":"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda","Type":"ContainerStarted","Data":"11764bed6ac7889b872cf53be32bfa0908be772e6f5c6ccc8365130b84f271a2"} Dec 04 12:19:50.320035 master-0 kubenswrapper[35367]: I1204 12:19:50.319969 35367 generic.go:334] "Generic (PLEG): container finished" podID="6a88e1d8-2084-49c9-a30a-f3bf7464b104" containerID="afc6f7b800f4487330bfbae59e7ef61902e013ed0ea9fdfba64f618bb4d23a22" exitCode=0 Dec 04 12:19:50.322468 master-0 kubenswrapper[35367]: I1204 12:19:50.321392 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-658bb5765c-fp46q" event={"ID":"6a88e1d8-2084-49c9-a30a-f3bf7464b104","Type":"ContainerDied","Data":"afc6f7b800f4487330bfbae59e7ef61902e013ed0ea9fdfba64f618bb4d23a22"} Dec 04 12:19:50.325564 master-0 kubenswrapper[35367]: I1204 12:19:50.325525 35367 generic.go:334] "Generic (PLEG): container finished" podID="7b68ab26-0f7d-486e-9387-b08478d63900" containerID="4b7ed1289466c679078759ba8957f82cefcd05463c79e069357738299dd8ef20" exitCode=0 Dec 04 12:19:50.325695 master-0 kubenswrapper[35367]: I1204 12:19:50.325663 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4gtrh" event={"ID":"7b68ab26-0f7d-486e-9387-b08478d63900","Type":"ContainerDied","Data":"4b7ed1289466c679078759ba8957f82cefcd05463c79e069357738299dd8ef20"} Dec 04 12:19:50.325752 master-0 kubenswrapper[35367]: I1204 12:19:50.325703 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4gtrh" event={"ID":"7b68ab26-0f7d-486e-9387-b08478d63900","Type":"ContainerStarted","Data":"ce4f122a2122dab0056b5b3878f5038ee006240207988b74e1b1dadbe0382ba1"} Dec 04 12:19:50.330391 master-0 kubenswrapper[35367]: I1204 12:19:50.330305 35367 generic.go:334] "Generic (PLEG): container finished" podID="daccfe35-6818-404b-a6fa-0a41c1b0c7ec" containerID="a913222148543b38b0b1e0fb13995110b0cb0450311b12a46bad5c5ba04ceaf2" exitCode=0 Dec 04 12:19:50.330590 master-0 kubenswrapper[35367]: I1204 12:19:50.330499 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-75d7c5dbd7-cfxqx" event={"ID":"daccfe35-6818-404b-a6fa-0a41c1b0c7ec","Type":"ContainerDied","Data":"a913222148543b38b0b1e0fb13995110b0cb0450311b12a46bad5c5ba04ceaf2"} Dec 04 12:19:50.330650 master-0 kubenswrapper[35367]: I1204 12:19:50.330598 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-75d7c5dbd7-cfxqx" event={"ID":"daccfe35-6818-404b-a6fa-0a41c1b0c7ec","Type":"ContainerDied","Data":"94a5c25f6ca0aa384a52f5d355195236ff3909d09b53e472774680de009aeb51"} Dec 04 12:19:50.330650 master-0 kubenswrapper[35367]: I1204 12:19:50.330620 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94a5c25f6ca0aa384a52f5d355195236ff3909d09b53e472774680de009aeb51" Dec 04 12:19:50.341223 master-0 kubenswrapper[35367]: I1204 12:19:50.339666 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-5dbfd7c4bf-vkd6n" event={"ID":"f058b868-204d-40a3-8746-e46d9ee199e8","Type":"ContainerDied","Data":"737a3e5d99b701abcef2a1686d63f845e4a845d8c267354c0e619af5e3a610d3"} Dec 04 12:19:50.341223 master-0 kubenswrapper[35367]: I1204 12:19:50.339762 35367 scope.go:117] "RemoveContainer" containerID="737a3e5d99b701abcef2a1686d63f845e4a845d8c267354c0e619af5e3a610d3" Dec 04 12:19:50.341223 master-0 kubenswrapper[35367]: I1204 12:19:50.339623 35367 generic.go:334] "Generic (PLEG): container finished" podID="f058b868-204d-40a3-8746-e46d9ee199e8" containerID="737a3e5d99b701abcef2a1686d63f845e4a845d8c267354c0e619af5e3a610d3" exitCode=0 Dec 04 12:19:50.341223 master-0 kubenswrapper[35367]: I1204 12:19:50.339833 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-5dbfd7c4bf-vkd6n" Dec 04 12:19:50.341223 master-0 kubenswrapper[35367]: I1204 12:19:50.340064 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-5dbfd7c4bf-vkd6n" event={"ID":"f058b868-204d-40a3-8746-e46d9ee199e8","Type":"ContainerDied","Data":"7b83b6b6e7b1f025a95f3ab69941a18a14da2efd4d63807c7652b56098efcc6e"} Dec 04 12:19:50.343295 master-0 kubenswrapper[35367]: I1204 12:19:50.342839 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-75d7c5dbd7-cfxqx" Dec 04 12:19:50.345194 master-0 kubenswrapper[35367]: I1204 12:19:50.345115 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-cell1-galera-0" event={"ID":"6c3fcc02-a129-4a9a-be2e-124ba02b13df","Type":"ContainerStarted","Data":"93680d1db3c89a06b9cc6407142ba1fd9f7daa9a8f8418d82d39c60bf16fe75b"} Dec 04 12:19:50.351235 master-0 kubenswrapper[35367]: I1204 12:19:50.348900 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-ovs-dwktl"] Dec 04 12:19:50.353401 master-0 kubenswrapper[35367]: I1204 12:19:50.353346 35367 generic.go:334] "Generic (PLEG): container finished" podID="016cf101-1d70-4d15-8857-5a92f2f8ce64" containerID="f91800dcbf53e9546a85d5dae57bc62c600b2ac2e96c0d947fcac2fbbaf60d89" exitCode=0 Dec 04 12:19:50.353507 master-0 kubenswrapper[35367]: I1204 12:19:50.353462 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-826mk" event={"ID":"016cf101-1d70-4d15-8857-5a92f2f8ce64","Type":"ContainerDied","Data":"f91800dcbf53e9546a85d5dae57bc62c600b2ac2e96c0d947fcac2fbbaf60d89"} Dec 04 12:19:50.368041 master-0 kubenswrapper[35367]: I1204 12:19:50.367991 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-sm45t" event={"ID":"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0","Type":"ContainerStarted","Data":"c2f08223c6e8f21167e517a21c6bff2e470f55f0b8f0e5a7033a7a6b3aafa8b5"} Dec 04 12:19:50.399384 master-0 kubenswrapper[35367]: I1204 12:19:50.399326 35367 scope.go:117] "RemoveContainer" containerID="737a3e5d99b701abcef2a1686d63f845e4a845d8c267354c0e619af5e3a610d3" Dec 04 12:19:50.401058 master-0 kubenswrapper[35367]: E1204 12:19:50.400452 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"737a3e5d99b701abcef2a1686d63f845e4a845d8c267354c0e619af5e3a610d3\": container with ID starting with 737a3e5d99b701abcef2a1686d63f845e4a845d8c267354c0e619af5e3a610d3 not found: ID does not exist" containerID="737a3e5d99b701abcef2a1686d63f845e4a845d8c267354c0e619af5e3a610d3" Dec 04 12:19:50.401514 master-0 kubenswrapper[35367]: I1204 12:19:50.401347 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737a3e5d99b701abcef2a1686d63f845e4a845d8c267354c0e619af5e3a610d3"} err="failed to get container status \"737a3e5d99b701abcef2a1686d63f845e4a845d8c267354c0e619af5e3a610d3\": rpc error: code = NotFound desc = could not find container \"737a3e5d99b701abcef2a1686d63f845e4a845d8c267354c0e619af5e3a610d3\": container with ID starting with 737a3e5d99b701abcef2a1686d63f845e4a845d8c267354c0e619af5e3a610d3 not found: ID does not exist" Dec 04 12:19:50.459106 master-0 kubenswrapper[35367]: I1204 12:19:50.459053 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dkdx\" (UniqueName: \"kubernetes.io/projected/daccfe35-6818-404b-a6fa-0a41c1b0c7ec-kube-api-access-2dkdx\") pod \"daccfe35-6818-404b-a6fa-0a41c1b0c7ec\" (UID: \"daccfe35-6818-404b-a6fa-0a41c1b0c7ec\") " Dec 04 12:19:50.459331 master-0 kubenswrapper[35367]: I1204 12:19:50.459193 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/daccfe35-6818-404b-a6fa-0a41c1b0c7ec-dns-svc\") pod \"daccfe35-6818-404b-a6fa-0a41c1b0c7ec\" (UID: \"daccfe35-6818-404b-a6fa-0a41c1b0c7ec\") " Dec 04 12:19:50.459331 master-0 kubenswrapper[35367]: I1204 12:19:50.459253 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/daccfe35-6818-404b-a6fa-0a41c1b0c7ec-config\") pod \"daccfe35-6818-404b-a6fa-0a41c1b0c7ec\" (UID: \"daccfe35-6818-404b-a6fa-0a41c1b0c7ec\") " Dec 04 12:19:50.463268 master-0 kubenswrapper[35367]: I1204 12:19:50.463204 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daccfe35-6818-404b-a6fa-0a41c1b0c7ec-kube-api-access-2dkdx" (OuterVolumeSpecName: "kube-api-access-2dkdx") pod "daccfe35-6818-404b-a6fa-0a41c1b0c7ec" (UID: "daccfe35-6818-404b-a6fa-0a41c1b0c7ec"). InnerVolumeSpecName "kube-api-access-2dkdx". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:19:50.486969 master-0 kubenswrapper[35367]: I1204 12:19:50.486572 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daccfe35-6818-404b-a6fa-0a41c1b0c7ec-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "daccfe35-6818-404b-a6fa-0a41c1b0c7ec" (UID: "daccfe35-6818-404b-a6fa-0a41c1b0c7ec"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:19:50.491507 master-0 kubenswrapper[35367]: I1204 12:19:50.491347 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daccfe35-6818-404b-a6fa-0a41c1b0c7ec-config" (OuterVolumeSpecName: "config") pod "daccfe35-6818-404b-a6fa-0a41c1b0c7ec" (UID: "daccfe35-6818-404b-a6fa-0a41c1b0c7ec"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:19:50.561727 master-0 kubenswrapper[35367]: I1204 12:19:50.561665 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2dkdx\" (UniqueName: \"kubernetes.io/projected/daccfe35-6818-404b-a6fa-0a41c1b0c7ec-kube-api-access-2dkdx\") on node \"master-0\" DevicePath \"\"" Dec 04 12:19:50.561727 master-0 kubenswrapper[35367]: I1204 12:19:50.561711 35367 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/daccfe35-6818-404b-a6fa-0a41c1b0c7ec-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 12:19:50.561727 master-0 kubenswrapper[35367]: I1204 12:19:50.561725 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/daccfe35-6818-404b-a6fa-0a41c1b0c7ec-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:19:50.763321 master-0 kubenswrapper[35367]: I1204 12:19:50.763259 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-5dbfd7c4bf-vkd6n"] Dec 04 12:19:50.790269 master-0 kubenswrapper[35367]: I1204 12:19:50.790180 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovsdbserver-nb-0"] Dec 04 12:19:50.807107 master-0 kubenswrapper[35367]: I1204 12:19:50.807015 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-5dbfd7c4bf-vkd6n"] Dec 04 12:19:51.033981 master-0 kubenswrapper[35367]: I1204 12:19:51.033625 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovsdbserver-sb-0"] Dec 04 12:19:51.386416 master-0 kubenswrapper[35367]: I1204 12:19:51.386340 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" event={"ID":"de7522fa-385c-448e-8eaf-d238973fda1b","Type":"ContainerStarted","Data":"bb89134b4191e77993a03338b84e78042d2d21b0539752c5453e9eb4cb379d24"} Dec 04 12:19:51.386975 master-0 kubenswrapper[35367]: I1204 12:19:51.386683 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" Dec 04 12:19:51.389891 master-0 kubenswrapper[35367]: I1204 12:19:51.389656 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-ovs-dwktl" event={"ID":"fbb3336e-2fa8-42f1-9501-39ac668b6b84","Type":"ContainerStarted","Data":"0110ed9eb5996c12b09815a61945d10b40bebc0e841dfd239669821255ca78f1"} Dec 04 12:19:51.395062 master-0 kubenswrapper[35367]: I1204 12:19:51.394920 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-658bb5765c-fp46q" event={"ID":"6a88e1d8-2084-49c9-a30a-f3bf7464b104","Type":"ContainerStarted","Data":"b2ec9d3e5687c1eedf0fb014c3ec7581d1b7d6a7de84cc3be719e2f052d2e220"} Dec 04 12:19:51.395062 master-0 kubenswrapper[35367]: I1204 12:19:51.395035 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-658bb5765c-fp46q" Dec 04 12:19:51.397019 master-0 kubenswrapper[35367]: I1204 12:19:51.396970 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-75d7c5dbd7-cfxqx" Dec 04 12:19:51.417728 master-0 kubenswrapper[35367]: I1204 12:19:51.417577 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" podStartSLOduration=4.778099549 podStartE2EDuration="35.417533315s" podCreationTimestamp="2025-12-04 12:19:16 +0000 UTC" firstStartedPulling="2025-12-04 12:19:18.066332443 +0000 UTC m=+1201.504393701" lastFinishedPulling="2025-12-04 12:19:48.705766209 +0000 UTC m=+1232.143827467" observedRunningTime="2025-12-04 12:19:51.416353948 +0000 UTC m=+1234.854415216" watchObservedRunningTime="2025-12-04 12:19:51.417533315 +0000 UTC m=+1234.855594583" Dec 04 12:19:51.525636 master-0 kubenswrapper[35367]: I1204 12:19:51.525537 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-75d7c5dbd7-cfxqx"] Dec 04 12:19:51.547231 master-0 kubenswrapper[35367]: I1204 12:19:51.547059 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-75d7c5dbd7-cfxqx"] Dec 04 12:19:51.558071 master-0 kubenswrapper[35367]: I1204 12:19:51.557954 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-658bb5765c-fp46q" podStartSLOduration=5.76617593 podStartE2EDuration="33.557927088s" podCreationTimestamp="2025-12-04 12:19:18 +0000 UTC" firstStartedPulling="2025-12-04 12:19:21.580437804 +0000 UTC m=+1205.018499062" lastFinishedPulling="2025-12-04 12:19:49.372188962 +0000 UTC m=+1232.810250220" observedRunningTime="2025-12-04 12:19:51.510892254 +0000 UTC m=+1234.948953532" watchObservedRunningTime="2025-12-04 12:19:51.557927088 +0000 UTC m=+1234.995988346" Dec 04 12:19:52.767909 master-0 kubenswrapper[35367]: I1204 12:19:52.767843 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daccfe35-6818-404b-a6fa-0a41c1b0c7ec" path="/var/lib/kubelet/pods/daccfe35-6818-404b-a6fa-0a41c1b0c7ec/volumes" Dec 04 12:19:52.768583 master-0 kubenswrapper[35367]: I1204 12:19:52.768558 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f058b868-204d-40a3-8746-e46d9ee199e8" path="/var/lib/kubelet/pods/f058b868-204d-40a3-8746-e46d9ee199e8/volumes" Dec 04 12:19:56.635901 master-0 kubenswrapper[35367]: W1204 12:19:56.635789 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67ab881b_4808_40bf_9d90_ac6dbb435b5d.slice/crio-85cbee02d826f4115722db1f857a43db19fec9e486ee29c5cef248e1bed016ad WatchSource:0}: Error finding container 85cbee02d826f4115722db1f857a43db19fec9e486ee29c5cef248e1bed016ad: Status 404 returned error can't find the container with id 85cbee02d826f4115722db1f857a43db19fec9e486ee29c5cef248e1bed016ad Dec 04 12:19:56.638004 master-0 kubenswrapper[35367]: W1204 12:19:56.637925 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb36e050_9d39_4b4e_bf1b_3a817c24f625.slice/crio-da6a79b64328910b8781291f72861ece7809548411ebab82ae3368c62dc54c3a WatchSource:0}: Error finding container da6a79b64328910b8781291f72861ece7809548411ebab82ae3368c62dc54c3a: Status 404 returned error can't find the container with id da6a79b64328910b8781291f72861ece7809548411ebab82ae3368c62dc54c3a Dec 04 12:19:57.225090 master-0 kubenswrapper[35367]: I1204 12:19:57.225016 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" Dec 04 12:19:57.563690 master-0 kubenswrapper[35367]: I1204 12:19:57.563619 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovsdbserver-nb-0" event={"ID":"67ab881b-4808-40bf-9d90-ac6dbb435b5d","Type":"ContainerStarted","Data":"85cbee02d826f4115722db1f857a43db19fec9e486ee29c5cef248e1bed016ad"} Dec 04 12:19:57.566221 master-0 kubenswrapper[35367]: I1204 12:19:57.566082 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovsdbserver-sb-0" event={"ID":"bb36e050-9d39-4b4e-bf1b-3a817c24f625","Type":"ContainerStarted","Data":"da6a79b64328910b8781291f72861ece7809548411ebab82ae3368c62dc54c3a"} Dec 04 12:19:58.583839 master-0 kubenswrapper[35367]: I1204 12:19:58.583772 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-sm45t" event={"ID":"a2cf9c09-b934-4bc5-babf-9ed4469aa5a0","Type":"ContainerStarted","Data":"6b551e0676a131b16d0ab8f7c8ade9aff03f7fd8caad32d58586067df8b5248f"} Dec 04 12:19:58.587256 master-0 kubenswrapper[35367]: I1204 12:19:58.587175 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ovn-controller-sm45t" Dec 04 12:19:58.591051 master-0 kubenswrapper[35367]: I1204 12:19:58.590997 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/memcached-0" Dec 04 12:19:58.592745 master-0 kubenswrapper[35367]: I1204 12:19:58.592685 35367 generic.go:334] "Generic (PLEG): container finished" podID="7b68ab26-0f7d-486e-9387-b08478d63900" containerID="fe60b3931768c3022896c329d67d0f1f627d6b792e38177e92f5391538a88d51" exitCode=0 Dec 04 12:19:58.592896 master-0 kubenswrapper[35367]: I1204 12:19:58.592787 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4gtrh" event={"ID":"7b68ab26-0f7d-486e-9387-b08478d63900","Type":"ContainerDied","Data":"fe60b3931768c3022896c329d67d0f1f627d6b792e38177e92f5391538a88d51"} Dec 04 12:19:58.597398 master-0 kubenswrapper[35367]: I1204 12:19:58.597310 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-cell1-galera-0" event={"ID":"6c3fcc02-a129-4a9a-be2e-124ba02b13df","Type":"ContainerStarted","Data":"944ceff451543b8a9342ce3771e9f9a63e623b818af8785a631abb50fe3a6af4"} Dec 04 12:19:58.600411 master-0 kubenswrapper[35367]: I1204 12:19:58.600366 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-ovs-dwktl" event={"ID":"fbb3336e-2fa8-42f1-9501-39ac668b6b84","Type":"ContainerStarted","Data":"38c60cd19b48ea599b6a6be308067fc5a84c9824fe01f90c241e4021ad60335b"} Dec 04 12:19:58.603512 master-0 kubenswrapper[35367]: I1204 12:19:58.603474 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-galera-0" event={"ID":"96661f30-6623-4f69-909f-635dbd957e21","Type":"ContainerStarted","Data":"581ecfb7e7168c227994493d6a6b83e823619b9721f21a304cefa9df560e895f"} Dec 04 12:19:58.608367 master-0 kubenswrapper[35367]: I1204 12:19:58.608319 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-826mk" event={"ID":"016cf101-1d70-4d15-8857-5a92f2f8ce64","Type":"ContainerStarted","Data":"b5af7a5feaf30ce83d475e8091698d0378d0476a6b00439ad363d4fc4f8b0068"} Dec 04 12:19:58.627007 master-0 kubenswrapper[35367]: I1204 12:19:58.626860 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ovn-controller-sm45t" podStartSLOduration=20.690725366 podStartE2EDuration="28.626784024s" podCreationTimestamp="2025-12-04 12:19:30 +0000 UTC" firstStartedPulling="2025-12-04 12:19:49.219963705 +0000 UTC m=+1232.658024963" lastFinishedPulling="2025-12-04 12:19:57.156022363 +0000 UTC m=+1240.594083621" observedRunningTime="2025-12-04 12:19:58.614092142 +0000 UTC m=+1242.052153420" watchObservedRunningTime="2025-12-04 12:19:58.626784024 +0000 UTC m=+1242.064845292" Dec 04 12:19:58.774830 master-0 kubenswrapper[35367]: I1204 12:19:58.774622 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-826mk" podStartSLOduration=8.663297724 podStartE2EDuration="41.774596321s" podCreationTimestamp="2025-12-04 12:19:17 +0000 UTC" firstStartedPulling="2025-12-04 12:19:24.045079507 +0000 UTC m=+1207.483140765" lastFinishedPulling="2025-12-04 12:19:57.156378104 +0000 UTC m=+1240.594439362" observedRunningTime="2025-12-04 12:19:58.759180284 +0000 UTC m=+1242.197241552" watchObservedRunningTime="2025-12-04 12:19:58.774596321 +0000 UTC m=+1242.212657579" Dec 04 12:19:58.831236 master-0 kubenswrapper[35367]: I1204 12:19:58.829962 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-658bb5765c-fp46q" Dec 04 12:19:58.913587 master-0 kubenswrapper[35367]: I1204 12:19:58.913215 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-6f856ff86c-vmt85"] Dec 04 12:19:58.913822 master-0 kubenswrapper[35367]: I1204 12:19:58.913613 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" podUID="de7522fa-385c-448e-8eaf-d238973fda1b" containerName="dnsmasq-dns" containerID="cri-o://bb89134b4191e77993a03338b84e78042d2d21b0539752c5453e9eb4cb379d24" gracePeriod=10 Dec 04 12:19:59.653332 master-0 kubenswrapper[35367]: I1204 12:19:59.653131 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-server-0" event={"ID":"f78e6ce3-d552-4b22-8bb1-002996379ed1","Type":"ContainerStarted","Data":"b5d8a7ca11fd06d9854a891d43533844b44383041d9d1eb2db7bd126ac9cf64d"} Dec 04 12:19:59.660568 master-0 kubenswrapper[35367]: I1204 12:19:59.660460 35367 generic.go:334] "Generic (PLEG): container finished" podID="fbb3336e-2fa8-42f1-9501-39ac668b6b84" containerID="38c60cd19b48ea599b6a6be308067fc5a84c9824fe01f90c241e4021ad60335b" exitCode=0 Dec 04 12:19:59.660844 master-0 kubenswrapper[35367]: I1204 12:19:59.660673 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-ovs-dwktl" event={"ID":"fbb3336e-2fa8-42f1-9501-39ac668b6b84","Type":"ContainerDied","Data":"38c60cd19b48ea599b6a6be308067fc5a84c9824fe01f90c241e4021ad60335b"} Dec 04 12:19:59.666782 master-0 kubenswrapper[35367]: I1204 12:19:59.666694 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-cell1-server-0" event={"ID":"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda","Type":"ContainerStarted","Data":"33b1f531d3180cc1d7842d75ef339a5ac26ba1932a9030d7d1e4ad74b66b3aed"} Dec 04 12:19:59.672682 master-0 kubenswrapper[35367]: I1204 12:19:59.672621 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4gtrh" event={"ID":"7b68ab26-0f7d-486e-9387-b08478d63900","Type":"ContainerStarted","Data":"af334c209a4e4c293c11c291a7435400798c8e198522b00522a9c52c308282c1"} Dec 04 12:19:59.691856 master-0 kubenswrapper[35367]: I1204 12:19:59.691731 35367 generic.go:334] "Generic (PLEG): container finished" podID="de7522fa-385c-448e-8eaf-d238973fda1b" containerID="bb89134b4191e77993a03338b84e78042d2d21b0539752c5453e9eb4cb379d24" exitCode=0 Dec 04 12:19:59.692242 master-0 kubenswrapper[35367]: I1204 12:19:59.691840 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" event={"ID":"de7522fa-385c-448e-8eaf-d238973fda1b","Type":"ContainerDied","Data":"bb89134b4191e77993a03338b84e78042d2d21b0539752c5453e9eb4cb379d24"} Dec 04 12:19:59.696271 master-0 kubenswrapper[35367]: I1204 12:19:59.696195 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovsdbserver-nb-0" event={"ID":"67ab881b-4808-40bf-9d90-ac6dbb435b5d","Type":"ContainerStarted","Data":"4ef67218f1a4a526d690852d170909723a44f112554800f6308936be139d9095"} Dec 04 12:19:59.702455 master-0 kubenswrapper[35367]: I1204 12:19:59.702391 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovsdbserver-sb-0" event={"ID":"bb36e050-9d39-4b4e-bf1b-3a817c24f625","Type":"ContainerStarted","Data":"3e5264c814175aff5b7c53989a3489e4381c0c9b992b7803111ccc0d5451116e"} Dec 04 12:20:00.001539 master-0 kubenswrapper[35367]: I1204 12:19:59.998286 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-4gtrh" podStartSLOduration=19.294814401 podStartE2EDuration="27.998254809s" podCreationTimestamp="2025-12-04 12:19:32 +0000 UTC" firstStartedPulling="2025-12-04 12:19:50.339550377 +0000 UTC m=+1233.777611635" lastFinishedPulling="2025-12-04 12:19:59.042990785 +0000 UTC m=+1242.481052043" observedRunningTime="2025-12-04 12:19:59.995514402 +0000 UTC m=+1243.433575670" watchObservedRunningTime="2025-12-04 12:19:59.998254809 +0000 UTC m=+1243.436316077" Dec 04 12:20:00.193593 master-0 kubenswrapper[35367]: I1204 12:20:00.193528 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" Dec 04 12:20:00.245031 master-0 kubenswrapper[35367]: I1204 12:20:00.244867 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/de7522fa-385c-448e-8eaf-d238973fda1b-dns-svc\") pod \"de7522fa-385c-448e-8eaf-d238973fda1b\" (UID: \"de7522fa-385c-448e-8eaf-d238973fda1b\") " Dec 04 12:20:00.245031 master-0 kubenswrapper[35367]: I1204 12:20:00.244979 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de7522fa-385c-448e-8eaf-d238973fda1b-config\") pod \"de7522fa-385c-448e-8eaf-d238973fda1b\" (UID: \"de7522fa-385c-448e-8eaf-d238973fda1b\") " Dec 04 12:20:00.245296 master-0 kubenswrapper[35367]: I1204 12:20:00.245148 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvhgp\" (UniqueName: \"kubernetes.io/projected/de7522fa-385c-448e-8eaf-d238973fda1b-kube-api-access-lvhgp\") pod \"de7522fa-385c-448e-8eaf-d238973fda1b\" (UID: \"de7522fa-385c-448e-8eaf-d238973fda1b\") " Dec 04 12:20:00.251745 master-0 kubenswrapper[35367]: I1204 12:20:00.251526 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de7522fa-385c-448e-8eaf-d238973fda1b-kube-api-access-lvhgp" (OuterVolumeSpecName: "kube-api-access-lvhgp") pod "de7522fa-385c-448e-8eaf-d238973fda1b" (UID: "de7522fa-385c-448e-8eaf-d238973fda1b"). InnerVolumeSpecName "kube-api-access-lvhgp". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:20:00.308868 master-0 kubenswrapper[35367]: I1204 12:20:00.308590 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de7522fa-385c-448e-8eaf-d238973fda1b-config" (OuterVolumeSpecName: "config") pod "de7522fa-385c-448e-8eaf-d238973fda1b" (UID: "de7522fa-385c-448e-8eaf-d238973fda1b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:00.311672 master-0 kubenswrapper[35367]: I1204 12:20:00.311592 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de7522fa-385c-448e-8eaf-d238973fda1b-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "de7522fa-385c-448e-8eaf-d238973fda1b" (UID: "de7522fa-385c-448e-8eaf-d238973fda1b"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:00.348408 master-0 kubenswrapper[35367]: I1204 12:20:00.348322 35367 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/de7522fa-385c-448e-8eaf-d238973fda1b-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:00.348408 master-0 kubenswrapper[35367]: I1204 12:20:00.348409 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de7522fa-385c-448e-8eaf-d238973fda1b-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:00.348408 master-0 kubenswrapper[35367]: I1204 12:20:00.348432 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lvhgp\" (UniqueName: \"kubernetes.io/projected/de7522fa-385c-448e-8eaf-d238973fda1b-kube-api-access-lvhgp\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:00.733437 master-0 kubenswrapper[35367]: I1204 12:20:00.733376 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" Dec 04 12:20:00.738008 master-0 kubenswrapper[35367]: I1204 12:20:00.737945 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-6f856ff86c-vmt85" event={"ID":"de7522fa-385c-448e-8eaf-d238973fda1b","Type":"ContainerDied","Data":"1e0b6a441b76d8f596faacb78609367f5921d9a27f5366fa29e2d1f6ccc50ab0"} Dec 04 12:20:00.738220 master-0 kubenswrapper[35367]: I1204 12:20:00.738020 35367 scope.go:117] "RemoveContainer" containerID="bb89134b4191e77993a03338b84e78042d2d21b0539752c5453e9eb4cb379d24" Dec 04 12:20:00.767454 master-0 kubenswrapper[35367]: I1204 12:20:00.767375 35367 scope.go:117] "RemoveContainer" containerID="54202e38bf767954f4a21b35d1bd07db05bdf657942a3567bcbb967dd996584a" Dec 04 12:20:02.761120 master-0 kubenswrapper[35367]: I1204 12:20:02.761018 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-ovs-dwktl" event={"ID":"fbb3336e-2fa8-42f1-9501-39ac668b6b84","Type":"ContainerStarted","Data":"f6c7afffdf04fb31adca24e1c9fd2f72bb8093b1f9962079114624b546e01ca4"} Dec 04 12:20:02.793024 master-0 kubenswrapper[35367]: I1204 12:20:02.792930 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-4gtrh" Dec 04 12:20:02.793827 master-0 kubenswrapper[35367]: I1204 12:20:02.793783 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-4gtrh" Dec 04 12:20:02.852520 master-0 kubenswrapper[35367]: I1204 12:20:02.852379 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-4gtrh" Dec 04 12:20:04.837106 master-0 kubenswrapper[35367]: I1204 12:20:04.837039 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-4gtrh" Dec 04 12:20:08.260956 master-0 kubenswrapper[35367]: I1204 12:20:08.260775 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-826mk" Dec 04 12:20:08.260956 master-0 kubenswrapper[35367]: I1204 12:20:08.260977 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-826mk" Dec 04 12:20:08.311041 master-0 kubenswrapper[35367]: I1204 12:20:08.310934 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-826mk" Dec 04 12:20:08.885822 master-0 kubenswrapper[35367]: I1204 12:20:08.885730 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-826mk" Dec 04 12:20:09.887213 master-0 kubenswrapper[35367]: I1204 12:20:09.887088 35367 generic.go:334] "Generic (PLEG): container finished" podID="96661f30-6623-4f69-909f-635dbd957e21" containerID="581ecfb7e7168c227994493d6a6b83e823619b9721f21a304cefa9df560e895f" exitCode=0 Dec 04 12:20:09.887213 master-0 kubenswrapper[35367]: I1204 12:20:09.887214 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-galera-0" event={"ID":"96661f30-6623-4f69-909f-635dbd957e21","Type":"ContainerDied","Data":"581ecfb7e7168c227994493d6a6b83e823619b9721f21a304cefa9df560e895f"} Dec 04 12:20:09.893731 master-0 kubenswrapper[35367]: I1204 12:20:09.893672 35367 generic.go:334] "Generic (PLEG): container finished" podID="6c3fcc02-a129-4a9a-be2e-124ba02b13df" containerID="944ceff451543b8a9342ce3771e9f9a63e623b818af8785a631abb50fe3a6af4" exitCode=0 Dec 04 12:20:09.893911 master-0 kubenswrapper[35367]: I1204 12:20:09.893761 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-cell1-galera-0" event={"ID":"6c3fcc02-a129-4a9a-be2e-124ba02b13df","Type":"ContainerDied","Data":"944ceff451543b8a9342ce3771e9f9a63e623b818af8785a631abb50fe3a6af4"} Dec 04 12:20:09.905675 master-0 kubenswrapper[35367]: I1204 12:20:09.905605 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-ovs-dwktl" event={"ID":"fbb3336e-2fa8-42f1-9501-39ac668b6b84","Type":"ContainerStarted","Data":"91d2d330da736f3f1195391bd7c12998b9879bbc5861302e83a639fc0050b421"} Dec 04 12:20:10.917559 master-0 kubenswrapper[35367]: I1204 12:20:10.917479 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:20:11.929617 master-0 kubenswrapper[35367]: I1204 12:20:11.929515 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:20:13.953227 master-0 kubenswrapper[35367]: I1204 12:20:13.953151 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-galera-0" event={"ID":"96661f30-6623-4f69-909f-635dbd957e21","Type":"ContainerStarted","Data":"0d4ed6086a45db1b73c3df1ddafafa579640444e1bf2f92dedde0f02645b9870"} Dec 04 12:20:13.955739 master-0 kubenswrapper[35367]: I1204 12:20:13.955712 35367 generic.go:334] "Generic (PLEG): container finished" podID="70729025-94a7-4a9b-98b8-e68b73d59a3e" containerID="c4ef5c9e77d9b4d351a7451edd42d6437538f743695bc8a683308a0e8573a0cb" exitCode=1 Dec 04 12:20:13.955827 master-0 kubenswrapper[35367]: I1204 12:20:13.955769 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" event={"ID":"70729025-94a7-4a9b-98b8-e68b73d59a3e","Type":"ContainerDied","Data":"c4ef5c9e77d9b4d351a7451edd42d6437538f743695bc8a683308a0e8573a0cb"} Dec 04 12:20:13.955869 master-0 kubenswrapper[35367]: I1204 12:20:13.955831 35367 scope.go:117] "RemoveContainer" containerID="25fd0707b23306a2945597f4d91087157d1e67a9d1035042878e9983a95dace6" Dec 04 12:20:13.956529 master-0 kubenswrapper[35367]: I1204 12:20:13.956507 35367 scope.go:117] "RemoveContainer" containerID="c4ef5c9e77d9b4d351a7451edd42d6437538f743695bc8a683308a0e8573a0cb" Dec 04 12:20:13.956913 master-0 kubenswrapper[35367]: E1204 12:20:13.956751 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=metallb-operator-controller-manager-6f8cddc44c-f979v_metallb-system(70729025-94a7-4a9b-98b8-e68b73d59a3e)\"" pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" podUID="70729025-94a7-4a9b-98b8-e68b73d59a3e" Dec 04 12:20:13.959080 master-0 kubenswrapper[35367]: I1204 12:20:13.958997 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-cell1-galera-0" event={"ID":"6c3fcc02-a129-4a9a-be2e-124ba02b13df","Type":"ContainerStarted","Data":"b611b3c5a07b2d3aec84ed42543b8b038dbf482f131c55366e34708484297530"} Dec 04 12:20:16.270721 master-0 kubenswrapper[35367]: I1204 12:20:16.270638 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" Dec 04 12:20:16.271674 master-0 kubenswrapper[35367]: I1204 12:20:16.271635 35367 scope.go:117] "RemoveContainer" containerID="c4ef5c9e77d9b4d351a7451edd42d6437538f743695bc8a683308a0e8573a0cb" Dec 04 12:20:16.272001 master-0 kubenswrapper[35367]: E1204 12:20:16.271963 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=metallb-operator-controller-manager-6f8cddc44c-f979v_metallb-system(70729025-94a7-4a9b-98b8-e68b73d59a3e)\"" pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" podUID="70729025-94a7-4a9b-98b8-e68b73d59a3e" Dec 04 12:20:17.738310 master-0 kubenswrapper[35367]: I1204 12:20:17.738259 35367 trace.go:236] Trace[1205202854]: "Calculate volume metrics of persistence for pod openstack/rabbitmq-server-0" (04-Dec-2025 12:20:16.732) (total time: 1005ms): Dec 04 12:20:17.738310 master-0 kubenswrapper[35367]: Trace[1205202854]: [1.005779008s] [1.005779008s] END Dec 04 12:20:22.383309 master-0 kubenswrapper[35367]: I1204 12:20:22.383208 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-6f856ff86c-vmt85"] Dec 04 12:20:22.445864 master-0 kubenswrapper[35367]: I1204 12:20:22.444762 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-6f856ff86c-vmt85"] Dec 04 12:20:22.764003 master-0 kubenswrapper[35367]: I1204 12:20:22.763106 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de7522fa-385c-448e-8eaf-d238973fda1b" path="/var/lib/kubelet/pods/de7522fa-385c-448e-8eaf-d238973fda1b/volumes" Dec 04 12:20:23.009856 master-0 kubenswrapper[35367]: I1204 12:20:23.008423 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-9mxhg"] Dec 04 12:20:23.014072 master-0 kubenswrapper[35367]: E1204 12:20:23.013570 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f058b868-204d-40a3-8746-e46d9ee199e8" containerName="init" Dec 04 12:20:23.014072 master-0 kubenswrapper[35367]: I1204 12:20:23.013631 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f058b868-204d-40a3-8746-e46d9ee199e8" containerName="init" Dec 04 12:20:23.014072 master-0 kubenswrapper[35367]: E1204 12:20:23.013679 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de7522fa-385c-448e-8eaf-d238973fda1b" containerName="dnsmasq-dns" Dec 04 12:20:23.014072 master-0 kubenswrapper[35367]: I1204 12:20:23.013693 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="de7522fa-385c-448e-8eaf-d238973fda1b" containerName="dnsmasq-dns" Dec 04 12:20:23.014072 master-0 kubenswrapper[35367]: E1204 12:20:23.013709 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="daccfe35-6818-404b-a6fa-0a41c1b0c7ec" containerName="init" Dec 04 12:20:23.014072 master-0 kubenswrapper[35367]: I1204 12:20:23.013721 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="daccfe35-6818-404b-a6fa-0a41c1b0c7ec" containerName="init" Dec 04 12:20:23.014072 master-0 kubenswrapper[35367]: E1204 12:20:23.013731 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de7522fa-385c-448e-8eaf-d238973fda1b" containerName="init" Dec 04 12:20:23.014072 master-0 kubenswrapper[35367]: I1204 12:20:23.013739 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="de7522fa-385c-448e-8eaf-d238973fda1b" containerName="init" Dec 04 12:20:23.014072 master-0 kubenswrapper[35367]: I1204 12:20:23.014071 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="daccfe35-6818-404b-a6fa-0a41c1b0c7ec" containerName="init" Dec 04 12:20:23.014510 master-0 kubenswrapper[35367]: I1204 12:20:23.014101 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="de7522fa-385c-448e-8eaf-d238973fda1b" containerName="dnsmasq-dns" Dec 04 12:20:23.014510 master-0 kubenswrapper[35367]: I1204 12:20:23.014125 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="f058b868-204d-40a3-8746-e46d9ee199e8" containerName="init" Dec 04 12:20:23.016521 master-0 kubenswrapper[35367]: I1204 12:20:23.016429 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-9mxhg" Dec 04 12:20:23.078594 master-0 kubenswrapper[35367]: I1204 12:20:23.071118 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-9mxhg"] Dec 04 12:20:23.102562 master-0 kubenswrapper[35367]: I1204 12:20:23.102341 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovn-controller-metrics-ksjdz"] Dec 04 12:20:23.104491 master-0 kubenswrapper[35367]: I1204 12:20:23.104433 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-metrics-ksjdz" Dec 04 12:20:23.107789 master-0 kubenswrapper[35367]: I1204 12:20:23.107610 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovncontroller-metrics-config" Dec 04 12:20:23.132141 master-0 kubenswrapper[35367]: I1204 12:20:23.132038 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-metrics-ksjdz"] Dec 04 12:20:23.227263 master-0 kubenswrapper[35367]: I1204 12:20:23.227173 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crw2q\" (UniqueName: \"kubernetes.io/projected/24a330c4-2fb4-4f90-b4bc-4b1241c01a11-kube-api-access-crw2q\") pod \"redhat-marketplace-9mxhg\" (UID: \"24a330c4-2fb4-4f90-b4bc-4b1241c01a11\") " pod="openshift-marketplace/redhat-marketplace-9mxhg" Dec 04 12:20:23.227626 master-0 kubenswrapper[35367]: I1204 12:20:23.227329 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/289e5588-4158-47ce-b822-3b5e41037598-ovn-rundir\") pod \"ovn-controller-metrics-ksjdz\" (UID: \"289e5588-4158-47ce-b822-3b5e41037598\") " pod="openstack/ovn-controller-metrics-ksjdz" Dec 04 12:20:23.227626 master-0 kubenswrapper[35367]: I1204 12:20:23.227407 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/24a330c4-2fb4-4f90-b4bc-4b1241c01a11-catalog-content\") pod \"redhat-marketplace-9mxhg\" (UID: \"24a330c4-2fb4-4f90-b4bc-4b1241c01a11\") " pod="openshift-marketplace/redhat-marketplace-9mxhg" Dec 04 12:20:23.227626 master-0 kubenswrapper[35367]: I1204 12:20:23.227506 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/24a330c4-2fb4-4f90-b4bc-4b1241c01a11-utilities\") pod \"redhat-marketplace-9mxhg\" (UID: \"24a330c4-2fb4-4f90-b4bc-4b1241c01a11\") " pod="openshift-marketplace/redhat-marketplace-9mxhg" Dec 04 12:20:23.227626 master-0 kubenswrapper[35367]: I1204 12:20:23.227557 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/289e5588-4158-47ce-b822-3b5e41037598-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-ksjdz\" (UID: \"289e5588-4158-47ce-b822-3b5e41037598\") " pod="openstack/ovn-controller-metrics-ksjdz" Dec 04 12:20:23.227835 master-0 kubenswrapper[35367]: I1204 12:20:23.227631 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/289e5588-4158-47ce-b822-3b5e41037598-config\") pod \"ovn-controller-metrics-ksjdz\" (UID: \"289e5588-4158-47ce-b822-3b5e41037598\") " pod="openstack/ovn-controller-metrics-ksjdz" Dec 04 12:20:23.227835 master-0 kubenswrapper[35367]: I1204 12:20:23.227728 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/289e5588-4158-47ce-b822-3b5e41037598-ovs-rundir\") pod \"ovn-controller-metrics-ksjdz\" (UID: \"289e5588-4158-47ce-b822-3b5e41037598\") " pod="openstack/ovn-controller-metrics-ksjdz" Dec 04 12:20:23.227953 master-0 kubenswrapper[35367]: I1204 12:20:23.227832 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/289e5588-4158-47ce-b822-3b5e41037598-combined-ca-bundle\") pod \"ovn-controller-metrics-ksjdz\" (UID: \"289e5588-4158-47ce-b822-3b5e41037598\") " pod="openstack/ovn-controller-metrics-ksjdz" Dec 04 12:20:23.229602 master-0 kubenswrapper[35367]: I1204 12:20:23.229525 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnc9b\" (UniqueName: \"kubernetes.io/projected/289e5588-4158-47ce-b822-3b5e41037598-kube-api-access-vnc9b\") pod \"ovn-controller-metrics-ksjdz\" (UID: \"289e5588-4158-47ce-b822-3b5e41037598\") " pod="openstack/ovn-controller-metrics-ksjdz" Dec 04 12:20:23.332614 master-0 kubenswrapper[35367]: I1204 12:20:23.332320 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/289e5588-4158-47ce-b822-3b5e41037598-ovn-rundir\") pod \"ovn-controller-metrics-ksjdz\" (UID: \"289e5588-4158-47ce-b822-3b5e41037598\") " pod="openstack/ovn-controller-metrics-ksjdz" Dec 04 12:20:23.332909 master-0 kubenswrapper[35367]: I1204 12:20:23.332530 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/289e5588-4158-47ce-b822-3b5e41037598-ovn-rundir\") pod \"ovn-controller-metrics-ksjdz\" (UID: \"289e5588-4158-47ce-b822-3b5e41037598\") " pod="openstack/ovn-controller-metrics-ksjdz" Dec 04 12:20:23.332909 master-0 kubenswrapper[35367]: I1204 12:20:23.332696 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/24a330c4-2fb4-4f90-b4bc-4b1241c01a11-catalog-content\") pod \"redhat-marketplace-9mxhg\" (UID: \"24a330c4-2fb4-4f90-b4bc-4b1241c01a11\") " pod="openshift-marketplace/redhat-marketplace-9mxhg" Dec 04 12:20:23.333331 master-0 kubenswrapper[35367]: I1204 12:20:23.332793 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/24a330c4-2fb4-4f90-b4bc-4b1241c01a11-utilities\") pod \"redhat-marketplace-9mxhg\" (UID: \"24a330c4-2fb4-4f90-b4bc-4b1241c01a11\") " pod="openshift-marketplace/redhat-marketplace-9mxhg" Dec 04 12:20:23.335062 master-0 kubenswrapper[35367]: I1204 12:20:23.333366 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/289e5588-4158-47ce-b822-3b5e41037598-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-ksjdz\" (UID: \"289e5588-4158-47ce-b822-3b5e41037598\") " pod="openstack/ovn-controller-metrics-ksjdz" Dec 04 12:20:23.335062 master-0 kubenswrapper[35367]: I1204 12:20:23.334001 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/289e5588-4158-47ce-b822-3b5e41037598-config\") pod \"ovn-controller-metrics-ksjdz\" (UID: \"289e5588-4158-47ce-b822-3b5e41037598\") " pod="openstack/ovn-controller-metrics-ksjdz" Dec 04 12:20:23.335062 master-0 kubenswrapper[35367]: I1204 12:20:23.333295 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/24a330c4-2fb4-4f90-b4bc-4b1241c01a11-utilities\") pod \"redhat-marketplace-9mxhg\" (UID: \"24a330c4-2fb4-4f90-b4bc-4b1241c01a11\") " pod="openshift-marketplace/redhat-marketplace-9mxhg" Dec 04 12:20:23.335062 master-0 kubenswrapper[35367]: I1204 12:20:23.334063 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/289e5588-4158-47ce-b822-3b5e41037598-ovs-rundir\") pod \"ovn-controller-metrics-ksjdz\" (UID: \"289e5588-4158-47ce-b822-3b5e41037598\") " pod="openstack/ovn-controller-metrics-ksjdz" Dec 04 12:20:23.335062 master-0 kubenswrapper[35367]: I1204 12:20:23.334129 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/289e5588-4158-47ce-b822-3b5e41037598-combined-ca-bundle\") pod \"ovn-controller-metrics-ksjdz\" (UID: \"289e5588-4158-47ce-b822-3b5e41037598\") " pod="openstack/ovn-controller-metrics-ksjdz" Dec 04 12:20:23.335062 master-0 kubenswrapper[35367]: I1204 12:20:23.334283 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vnc9b\" (UniqueName: \"kubernetes.io/projected/289e5588-4158-47ce-b822-3b5e41037598-kube-api-access-vnc9b\") pod \"ovn-controller-metrics-ksjdz\" (UID: \"289e5588-4158-47ce-b822-3b5e41037598\") " pod="openstack/ovn-controller-metrics-ksjdz" Dec 04 12:20:23.335062 master-0 kubenswrapper[35367]: I1204 12:20:23.334339 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-crw2q\" (UniqueName: \"kubernetes.io/projected/24a330c4-2fb4-4f90-b4bc-4b1241c01a11-kube-api-access-crw2q\") pod \"redhat-marketplace-9mxhg\" (UID: \"24a330c4-2fb4-4f90-b4bc-4b1241c01a11\") " pod="openshift-marketplace/redhat-marketplace-9mxhg" Dec 04 12:20:23.335062 master-0 kubenswrapper[35367]: I1204 12:20:23.334724 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/289e5588-4158-47ce-b822-3b5e41037598-config\") pod \"ovn-controller-metrics-ksjdz\" (UID: \"289e5588-4158-47ce-b822-3b5e41037598\") " pod="openstack/ovn-controller-metrics-ksjdz" Dec 04 12:20:23.335062 master-0 kubenswrapper[35367]: I1204 12:20:23.334886 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/289e5588-4158-47ce-b822-3b5e41037598-ovs-rundir\") pod \"ovn-controller-metrics-ksjdz\" (UID: \"289e5588-4158-47ce-b822-3b5e41037598\") " pod="openstack/ovn-controller-metrics-ksjdz" Dec 04 12:20:23.335062 master-0 kubenswrapper[35367]: I1204 12:20:23.333266 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/24a330c4-2fb4-4f90-b4bc-4b1241c01a11-catalog-content\") pod \"redhat-marketplace-9mxhg\" (UID: \"24a330c4-2fb4-4f90-b4bc-4b1241c01a11\") " pod="openshift-marketplace/redhat-marketplace-9mxhg" Dec 04 12:20:23.336933 master-0 kubenswrapper[35367]: I1204 12:20:23.336894 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/289e5588-4158-47ce-b822-3b5e41037598-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-ksjdz\" (UID: \"289e5588-4158-47ce-b822-3b5e41037598\") " pod="openstack/ovn-controller-metrics-ksjdz" Dec 04 12:20:23.338461 master-0 kubenswrapper[35367]: I1204 12:20:23.338413 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/289e5588-4158-47ce-b822-3b5e41037598-combined-ca-bundle\") pod \"ovn-controller-metrics-ksjdz\" (UID: \"289e5588-4158-47ce-b822-3b5e41037598\") " pod="openstack/ovn-controller-metrics-ksjdz" Dec 04 12:20:24.313851 master-0 kubenswrapper[35367]: I1204 12:20:24.309540 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/openstack-galera-0" podStartSLOduration=56.181651846 podStartE2EDuration="1m3.309506464s" podCreationTimestamp="2025-12-04 12:19:21 +0000 UTC" firstStartedPulling="2025-12-04 12:19:50.076894644 +0000 UTC m=+1233.514955902" lastFinishedPulling="2025-12-04 12:19:57.204749252 +0000 UTC m=+1240.642810520" observedRunningTime="2025-12-04 12:20:24.284787924 +0000 UTC m=+1267.722849182" watchObservedRunningTime="2025-12-04 12:20:24.309506464 +0000 UTC m=+1267.747567722" Dec 04 12:20:24.322226 master-0 kubenswrapper[35367]: I1204 12:20:24.322165 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-crw2q\" (UniqueName: \"kubernetes.io/projected/24a330c4-2fb4-4f90-b4bc-4b1241c01a11-kube-api-access-crw2q\") pod \"redhat-marketplace-9mxhg\" (UID: \"24a330c4-2fb4-4f90-b4bc-4b1241c01a11\") " pod="openshift-marketplace/redhat-marketplace-9mxhg" Dec 04 12:20:24.587539 master-0 kubenswrapper[35367]: I1204 12:20:24.587311 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-9mxhg" Dec 04 12:20:25.225516 master-0 kubenswrapper[35367]: I1204 12:20:25.224874 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/openstack-galera-0" Dec 04 12:20:25.225516 master-0 kubenswrapper[35367]: I1204 12:20:25.224980 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/openstack-galera-0" Dec 04 12:20:25.623945 master-0 kubenswrapper[35367]: I1204 12:20:25.623880 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnc9b\" (UniqueName: \"kubernetes.io/projected/289e5588-4158-47ce-b822-3b5e41037598-kube-api-access-vnc9b\") pod \"ovn-controller-metrics-ksjdz\" (UID: \"289e5588-4158-47ce-b822-3b5e41037598\") " pod="openstack/ovn-controller-metrics-ksjdz" Dec 04 12:20:25.696464 master-0 kubenswrapper[35367]: I1204 12:20:25.696377 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-9mxhg"] Dec 04 12:20:25.833625 master-0 kubenswrapper[35367]: I1204 12:20:25.833534 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-metrics-ksjdz" Dec 04 12:20:26.258331 master-0 kubenswrapper[35367]: W1204 12:20:26.258265 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a330c4_2fb4_4f90_b4bc_4b1241c01a11.slice/crio-d05376109fc9168774cf67e06c726d8ae8eacf031137d9fd185e9f4ca66211c5 WatchSource:0}: Error finding container d05376109fc9168774cf67e06c726d8ae8eacf031137d9fd185e9f4ca66211c5: Status 404 returned error can't find the container with id d05376109fc9168774cf67e06c726d8ae8eacf031137d9fd185e9f4ca66211c5 Dec 04 12:20:26.630027 master-0 kubenswrapper[35367]: I1204 12:20:26.629917 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/openstack-cell1-galera-0" Dec 04 12:20:26.630027 master-0 kubenswrapper[35367]: I1204 12:20:26.630014 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/openstack-cell1-galera-0" Dec 04 12:20:27.139133 master-0 kubenswrapper[35367]: I1204 12:20:27.139061 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-9mxhg" event={"ID":"24a330c4-2fb4-4f90-b4bc-4b1241c01a11","Type":"ContainerStarted","Data":"d05376109fc9168774cf67e06c726d8ae8eacf031137d9fd185e9f4ca66211c5"} Dec 04 12:20:28.089839 master-0 kubenswrapper[35367]: I1204 12:20:28.079707 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-8b5f79d6c-7cz4c"] Dec 04 12:20:28.092115 master-0 kubenswrapper[35367]: I1204 12:20:28.092076 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-8b5f79d6c-7cz4c" Dec 04 12:20:28.149208 master-0 kubenswrapper[35367]: I1204 12:20:28.149104 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp99b\" (UniqueName: \"kubernetes.io/projected/82ef57ba-2c60-4caf-90d3-915b399a1a2c-kube-api-access-hp99b\") pod \"dnsmasq-dns-8b5f79d6c-7cz4c\" (UID: \"82ef57ba-2c60-4caf-90d3-915b399a1a2c\") " pod="openstack/dnsmasq-dns-8b5f79d6c-7cz4c" Dec 04 12:20:28.149499 master-0 kubenswrapper[35367]: I1204 12:20:28.149446 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/82ef57ba-2c60-4caf-90d3-915b399a1a2c-config\") pod \"dnsmasq-dns-8b5f79d6c-7cz4c\" (UID: \"82ef57ba-2c60-4caf-90d3-915b399a1a2c\") " pod="openstack/dnsmasq-dns-8b5f79d6c-7cz4c" Dec 04 12:20:28.149499 master-0 kubenswrapper[35367]: I1204 12:20:28.149487 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/82ef57ba-2c60-4caf-90d3-915b399a1a2c-dns-svc\") pod \"dnsmasq-dns-8b5f79d6c-7cz4c\" (UID: \"82ef57ba-2c60-4caf-90d3-915b399a1a2c\") " pod="openstack/dnsmasq-dns-8b5f79d6c-7cz4c" Dec 04 12:20:28.151870 master-0 kubenswrapper[35367]: I1204 12:20:28.151798 35367 generic.go:334] "Generic (PLEG): container finished" podID="24a330c4-2fb4-4f90-b4bc-4b1241c01a11" containerID="65f24d1ddec010883dcdf33298ea5eacd5491583bcffb78d6a5a07451f97bd81" exitCode=0 Dec 04 12:20:28.152007 master-0 kubenswrapper[35367]: I1204 12:20:28.151871 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-9mxhg" event={"ID":"24a330c4-2fb4-4f90-b4bc-4b1241c01a11","Type":"ContainerDied","Data":"65f24d1ddec010883dcdf33298ea5eacd5491583bcffb78d6a5a07451f97bd81"} Dec 04 12:20:28.153947 master-0 kubenswrapper[35367]: I1204 12:20:28.153900 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovsdbserver-nb-0" event={"ID":"67ab881b-4808-40bf-9d90-ac6dbb435b5d","Type":"ContainerStarted","Data":"9e9fc4972870c29b24a9915222d818f642718ec610485a06e64cd388c867c108"} Dec 04 12:20:28.231093 master-0 kubenswrapper[35367]: I1204 12:20:28.231034 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-4gtrh"] Dec 04 12:20:28.231348 master-0 kubenswrapper[35367]: I1204 12:20:28.231315 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-4gtrh" podUID="7b68ab26-0f7d-486e-9387-b08478d63900" containerName="registry-server" containerID="cri-o://af334c209a4e4c293c11c291a7435400798c8e198522b00522a9c52c308282c1" gracePeriod=2 Dec 04 12:20:28.251462 master-0 kubenswrapper[35367]: I1204 12:20:28.251388 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/82ef57ba-2c60-4caf-90d3-915b399a1a2c-config\") pod \"dnsmasq-dns-8b5f79d6c-7cz4c\" (UID: \"82ef57ba-2c60-4caf-90d3-915b399a1a2c\") " pod="openstack/dnsmasq-dns-8b5f79d6c-7cz4c" Dec 04 12:20:28.251752 master-0 kubenswrapper[35367]: I1204 12:20:28.251486 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/82ef57ba-2c60-4caf-90d3-915b399a1a2c-dns-svc\") pod \"dnsmasq-dns-8b5f79d6c-7cz4c\" (UID: \"82ef57ba-2c60-4caf-90d3-915b399a1a2c\") " pod="openstack/dnsmasq-dns-8b5f79d6c-7cz4c" Dec 04 12:20:28.251752 master-0 kubenswrapper[35367]: I1204 12:20:28.251664 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hp99b\" (UniqueName: \"kubernetes.io/projected/82ef57ba-2c60-4caf-90d3-915b399a1a2c-kube-api-access-hp99b\") pod \"dnsmasq-dns-8b5f79d6c-7cz4c\" (UID: \"82ef57ba-2c60-4caf-90d3-915b399a1a2c\") " pod="openstack/dnsmasq-dns-8b5f79d6c-7cz4c" Dec 04 12:20:28.253213 master-0 kubenswrapper[35367]: I1204 12:20:28.253164 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/82ef57ba-2c60-4caf-90d3-915b399a1a2c-config\") pod \"dnsmasq-dns-8b5f79d6c-7cz4c\" (UID: \"82ef57ba-2c60-4caf-90d3-915b399a1a2c\") " pod="openstack/dnsmasq-dns-8b5f79d6c-7cz4c" Dec 04 12:20:28.256179 master-0 kubenswrapper[35367]: I1204 12:20:28.256044 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/82ef57ba-2c60-4caf-90d3-915b399a1a2c-dns-svc\") pod \"dnsmasq-dns-8b5f79d6c-7cz4c\" (UID: \"82ef57ba-2c60-4caf-90d3-915b399a1a2c\") " pod="openstack/dnsmasq-dns-8b5f79d6c-7cz4c" Dec 04 12:20:28.289380 master-0 kubenswrapper[35367]: I1204 12:20:28.282031 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-metrics-ksjdz"] Dec 04 12:20:28.349652 master-0 kubenswrapper[35367]: I1204 12:20:28.349480 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-8b5f79d6c-7cz4c"] Dec 04 12:20:28.359428 master-0 kubenswrapper[35367]: I1204 12:20:28.359325 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/openstack-cell1-galera-0" podStartSLOduration=59.318487521 podStartE2EDuration="1m6.359302701s" podCreationTimestamp="2025-12-04 12:19:22 +0000 UTC" firstStartedPulling="2025-12-04 12:19:50.080522538 +0000 UTC m=+1233.518583796" lastFinishedPulling="2025-12-04 12:19:57.121337718 +0000 UTC m=+1240.559398976" observedRunningTime="2025-12-04 12:20:28.247146309 +0000 UTC m=+1271.685207577" watchObservedRunningTime="2025-12-04 12:20:28.359302701 +0000 UTC m=+1271.797363949" Dec 04 12:20:28.368366 master-0 kubenswrapper[35367]: I1204 12:20:28.368231 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp99b\" (UniqueName: \"kubernetes.io/projected/82ef57ba-2c60-4caf-90d3-915b399a1a2c-kube-api-access-hp99b\") pod \"dnsmasq-dns-8b5f79d6c-7cz4c\" (UID: \"82ef57ba-2c60-4caf-90d3-915b399a1a2c\") " pod="openstack/dnsmasq-dns-8b5f79d6c-7cz4c" Dec 04 12:20:28.412112 master-0 kubenswrapper[35367]: I1204 12:20:28.409978 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-8b5f79d6c-7cz4c" Dec 04 12:20:28.560265 master-0 kubenswrapper[35367]: I1204 12:20:28.560097 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ovn-controller-ovs-dwktl" podStartSLOduration=51.661027788 podStartE2EDuration="58.56006924s" podCreationTimestamp="2025-12-04 12:19:30 +0000 UTC" firstStartedPulling="2025-12-04 12:19:50.25697317 +0000 UTC m=+1233.695034418" lastFinishedPulling="2025-12-04 12:19:57.156014612 +0000 UTC m=+1240.594075870" observedRunningTime="2025-12-04 12:20:28.444727768 +0000 UTC m=+1271.882789026" watchObservedRunningTime="2025-12-04 12:20:28.56006924 +0000 UTC m=+1271.998130488" Dec 04 12:20:28.697264 master-0 kubenswrapper[35367]: I1204 12:20:28.696306 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-826mk"] Dec 04 12:20:28.708581 master-0 kubenswrapper[35367]: I1204 12:20:28.707774 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-826mk" podUID="016cf101-1d70-4d15-8857-5a92f2f8ce64" containerName="registry-server" containerID="cri-o://b5af7a5feaf30ce83d475e8091698d0378d0476a6b00439ad363d4fc4f8b0068" gracePeriod=2 Dec 04 12:20:28.826254 master-0 kubenswrapper[35367]: I1204 12:20:28.813127 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ovsdbserver-nb-0" podStartSLOduration=29.483130066 podStartE2EDuration="59.813099139s" podCreationTimestamp="2025-12-04 12:19:29 +0000 UTC" firstStartedPulling="2025-12-04 12:19:56.637992485 +0000 UTC m=+1240.076053743" lastFinishedPulling="2025-12-04 12:20:26.967961558 +0000 UTC m=+1270.406022816" observedRunningTime="2025-12-04 12:20:28.627124827 +0000 UTC m=+1272.065186085" watchObservedRunningTime="2025-12-04 12:20:28.813099139 +0000 UTC m=+1272.251160397" Dec 04 12:20:28.884097 master-0 kubenswrapper[35367]: I1204 12:20:28.884036 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-8b5f79d6c-7cz4c"] Dec 04 12:20:28.887786 master-0 kubenswrapper[35367]: I1204 12:20:28.887733 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-574b77955f-hl9sw"] Dec 04 12:20:28.894183 master-0 kubenswrapper[35367]: I1204 12:20:28.894070 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-574b77955f-hl9sw" Dec 04 12:20:28.903294 master-0 kubenswrapper[35367]: I1204 12:20:28.902355 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovsdbserver-nb" Dec 04 12:20:28.916071 master-0 kubenswrapper[35367]: I1204 12:20:28.915316 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-574b77955f-hl9sw"] Dec 04 12:20:29.025546 master-0 kubenswrapper[35367]: I1204 12:20:29.025483 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-574b77955f-hl9sw"] Dec 04 12:20:29.037013 master-0 kubenswrapper[35367]: I1204 12:20:29.036942 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/ovsdbserver-nb-0" Dec 04 12:20:29.037830 master-0 kubenswrapper[35367]: E1204 12:20:29.037759 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[config dns-svc kube-api-access-4cccj ovsdbserver-nb], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack/dnsmasq-dns-574b77955f-hl9sw" podUID="c01c84d4-6af8-42c5-adc0-79e4207144f9" Dec 04 12:20:29.078541 master-0 kubenswrapper[35367]: I1204 12:20:29.077977 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/c01c84d4-6af8-42c5-adc0-79e4207144f9-dns-svc\") pod \"dnsmasq-dns-574b77955f-hl9sw\" (UID: \"c01c84d4-6af8-42c5-adc0-79e4207144f9\") " pod="openstack/dnsmasq-dns-574b77955f-hl9sw" Dec 04 12:20:29.078541 master-0 kubenswrapper[35367]: I1204 12:20:29.078136 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/c01c84d4-6af8-42c5-adc0-79e4207144f9-ovsdbserver-nb\") pod \"dnsmasq-dns-574b77955f-hl9sw\" (UID: \"c01c84d4-6af8-42c5-adc0-79e4207144f9\") " pod="openstack/dnsmasq-dns-574b77955f-hl9sw" Dec 04 12:20:29.078541 master-0 kubenswrapper[35367]: I1204 12:20:29.078168 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cccj\" (UniqueName: \"kubernetes.io/projected/c01c84d4-6af8-42c5-adc0-79e4207144f9-kube-api-access-4cccj\") pod \"dnsmasq-dns-574b77955f-hl9sw\" (UID: \"c01c84d4-6af8-42c5-adc0-79e4207144f9\") " pod="openstack/dnsmasq-dns-574b77955f-hl9sw" Dec 04 12:20:29.078541 master-0 kubenswrapper[35367]: I1204 12:20:29.078233 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c01c84d4-6af8-42c5-adc0-79e4207144f9-config\") pod \"dnsmasq-dns-574b77955f-hl9sw\" (UID: \"c01c84d4-6af8-42c5-adc0-79e4207144f9\") " pod="openstack/dnsmasq-dns-574b77955f-hl9sw" Dec 04 12:20:29.166284 master-0 kubenswrapper[35367]: I1204 12:20:29.166179 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/ovsdbserver-nb-0" Dec 04 12:20:29.177898 master-0 kubenswrapper[35367]: I1204 12:20:29.177823 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-7d4d74cb79-bk5n5"] Dec 04 12:20:29.180102 master-0 kubenswrapper[35367]: I1204 12:20:29.180058 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" Dec 04 12:20:29.183080 master-0 kubenswrapper[35367]: I1204 12:20:29.182992 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/c01c84d4-6af8-42c5-adc0-79e4207144f9-ovsdbserver-nb\") pod \"dnsmasq-dns-574b77955f-hl9sw\" (UID: \"c01c84d4-6af8-42c5-adc0-79e4207144f9\") " pod="openstack/dnsmasq-dns-574b77955f-hl9sw" Dec 04 12:20:29.183080 master-0 kubenswrapper[35367]: I1204 12:20:29.183042 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4cccj\" (UniqueName: \"kubernetes.io/projected/c01c84d4-6af8-42c5-adc0-79e4207144f9-kube-api-access-4cccj\") pod \"dnsmasq-dns-574b77955f-hl9sw\" (UID: \"c01c84d4-6af8-42c5-adc0-79e4207144f9\") " pod="openstack/dnsmasq-dns-574b77955f-hl9sw" Dec 04 12:20:29.183246 master-0 kubenswrapper[35367]: I1204 12:20:29.183110 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c01c84d4-6af8-42c5-adc0-79e4207144f9-config\") pod \"dnsmasq-dns-574b77955f-hl9sw\" (UID: \"c01c84d4-6af8-42c5-adc0-79e4207144f9\") " pod="openstack/dnsmasq-dns-574b77955f-hl9sw" Dec 04 12:20:29.183246 master-0 kubenswrapper[35367]: I1204 12:20:29.183177 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/c01c84d4-6af8-42c5-adc0-79e4207144f9-dns-svc\") pod \"dnsmasq-dns-574b77955f-hl9sw\" (UID: \"c01c84d4-6af8-42c5-adc0-79e4207144f9\") " pod="openstack/dnsmasq-dns-574b77955f-hl9sw" Dec 04 12:20:29.184296 master-0 kubenswrapper[35367]: I1204 12:20:29.184254 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/c01c84d4-6af8-42c5-adc0-79e4207144f9-dns-svc\") pod \"dnsmasq-dns-574b77955f-hl9sw\" (UID: \"c01c84d4-6af8-42c5-adc0-79e4207144f9\") " pod="openstack/dnsmasq-dns-574b77955f-hl9sw" Dec 04 12:20:29.184996 master-0 kubenswrapper[35367]: I1204 12:20:29.184893 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/c01c84d4-6af8-42c5-adc0-79e4207144f9-ovsdbserver-nb\") pod \"dnsmasq-dns-574b77955f-hl9sw\" (UID: \"c01c84d4-6af8-42c5-adc0-79e4207144f9\") " pod="openstack/dnsmasq-dns-574b77955f-hl9sw" Dec 04 12:20:29.188231 master-0 kubenswrapper[35367]: I1204 12:20:29.187843 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c01c84d4-6af8-42c5-adc0-79e4207144f9-config\") pod \"dnsmasq-dns-574b77955f-hl9sw\" (UID: \"c01c84d4-6af8-42c5-adc0-79e4207144f9\") " pod="openstack/dnsmasq-dns-574b77955f-hl9sw" Dec 04 12:20:29.188231 master-0 kubenswrapper[35367]: I1204 12:20:29.188207 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovsdbserver-sb" Dec 04 12:20:29.217662 master-0 kubenswrapper[35367]: I1204 12:20:29.217547 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovsdbserver-sb-0" event={"ID":"bb36e050-9d39-4b4e-bf1b-3a817c24f625","Type":"ContainerStarted","Data":"630774088c93b8a6a931d1cb0cd58908767ce6a2b81264e020845e348b835139"} Dec 04 12:20:29.227147 master-0 kubenswrapper[35367]: I1204 12:20:29.226220 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cccj\" (UniqueName: \"kubernetes.io/projected/c01c84d4-6af8-42c5-adc0-79e4207144f9-kube-api-access-4cccj\") pod \"dnsmasq-dns-574b77955f-hl9sw\" (UID: \"c01c84d4-6af8-42c5-adc0-79e4207144f9\") " pod="openstack/dnsmasq-dns-574b77955f-hl9sw" Dec 04 12:20:29.276636 master-0 kubenswrapper[35367]: I1204 12:20:29.276574 35367 generic.go:334] "Generic (PLEG): container finished" podID="016cf101-1d70-4d15-8857-5a92f2f8ce64" containerID="b5af7a5feaf30ce83d475e8091698d0378d0476a6b00439ad363d4fc4f8b0068" exitCode=0 Dec 04 12:20:29.276871 master-0 kubenswrapper[35367]: I1204 12:20:29.276695 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-826mk" event={"ID":"016cf101-1d70-4d15-8857-5a92f2f8ce64","Type":"ContainerDied","Data":"b5af7a5feaf30ce83d475e8091698d0378d0476a6b00439ad363d4fc4f8b0068"} Dec 04 12:20:29.281481 master-0 kubenswrapper[35367]: I1204 12:20:29.281246 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-metrics-ksjdz" event={"ID":"289e5588-4158-47ce-b822-3b5e41037598","Type":"ContainerStarted","Data":"149e101c688e6f63724b4f5a677111e843bfddfe2d26d0fe67b0ccb3fc903cf5"} Dec 04 12:20:29.287864 master-0 kubenswrapper[35367]: I1204 12:20:29.287751 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-ovsdbserver-nb\") pod \"dnsmasq-dns-7d4d74cb79-bk5n5\" (UID: \"ecf9a649-68f2-4c6f-9460-3a48dc075245\") " pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" Dec 04 12:20:29.288061 master-0 kubenswrapper[35367]: I1204 12:20:29.287942 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-ovsdbserver-sb\") pod \"dnsmasq-dns-7d4d74cb79-bk5n5\" (UID: \"ecf9a649-68f2-4c6f-9460-3a48dc075245\") " pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" Dec 04 12:20:29.290093 master-0 kubenswrapper[35367]: I1204 12:20:29.289928 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8wht\" (UniqueName: \"kubernetes.io/projected/ecf9a649-68f2-4c6f-9460-3a48dc075245-kube-api-access-h8wht\") pod \"dnsmasq-dns-7d4d74cb79-bk5n5\" (UID: \"ecf9a649-68f2-4c6f-9460-3a48dc075245\") " pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" Dec 04 12:20:29.290093 master-0 kubenswrapper[35367]: I1204 12:20:29.290025 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-config\") pod \"dnsmasq-dns-7d4d74cb79-bk5n5\" (UID: \"ecf9a649-68f2-4c6f-9460-3a48dc075245\") " pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" Dec 04 12:20:29.290244 master-0 kubenswrapper[35367]: I1204 12:20:29.290148 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-dns-svc\") pod \"dnsmasq-dns-7d4d74cb79-bk5n5\" (UID: \"ecf9a649-68f2-4c6f-9460-3a48dc075245\") " pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" Dec 04 12:20:29.328025 master-0 kubenswrapper[35367]: I1204 12:20:29.319345 35367 generic.go:334] "Generic (PLEG): container finished" podID="7b68ab26-0f7d-486e-9387-b08478d63900" containerID="af334c209a4e4c293c11c291a7435400798c8e198522b00522a9c52c308282c1" exitCode=0 Dec 04 12:20:29.328025 master-0 kubenswrapper[35367]: I1204 12:20:29.319497 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-574b77955f-hl9sw" Dec 04 12:20:29.328025 master-0 kubenswrapper[35367]: I1204 12:20:29.322439 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-7d4d74cb79-bk5n5"] Dec 04 12:20:29.328025 master-0 kubenswrapper[35367]: I1204 12:20:29.322480 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4gtrh" event={"ID":"7b68ab26-0f7d-486e-9387-b08478d63900","Type":"ContainerDied","Data":"af334c209a4e4c293c11c291a7435400798c8e198522b00522a9c52c308282c1"} Dec 04 12:20:29.328025 master-0 kubenswrapper[35367]: I1204 12:20:29.322516 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ovsdbserver-nb-0" Dec 04 12:20:29.392474 master-0 kubenswrapper[35367]: I1204 12:20:29.392370 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-ovsdbserver-sb\") pod \"dnsmasq-dns-7d4d74cb79-bk5n5\" (UID: \"ecf9a649-68f2-4c6f-9460-3a48dc075245\") " pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" Dec 04 12:20:29.392712 master-0 kubenswrapper[35367]: I1204 12:20:29.392567 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h8wht\" (UniqueName: \"kubernetes.io/projected/ecf9a649-68f2-4c6f-9460-3a48dc075245-kube-api-access-h8wht\") pod \"dnsmasq-dns-7d4d74cb79-bk5n5\" (UID: \"ecf9a649-68f2-4c6f-9460-3a48dc075245\") " pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" Dec 04 12:20:29.392712 master-0 kubenswrapper[35367]: I1204 12:20:29.392635 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-config\") pod \"dnsmasq-dns-7d4d74cb79-bk5n5\" (UID: \"ecf9a649-68f2-4c6f-9460-3a48dc075245\") " pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" Dec 04 12:20:29.392977 master-0 kubenswrapper[35367]: I1204 12:20:29.392728 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-dns-svc\") pod \"dnsmasq-dns-7d4d74cb79-bk5n5\" (UID: \"ecf9a649-68f2-4c6f-9460-3a48dc075245\") " pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" Dec 04 12:20:29.393137 master-0 kubenswrapper[35367]: I1204 12:20:29.393061 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-ovsdbserver-nb\") pod \"dnsmasq-dns-7d4d74cb79-bk5n5\" (UID: \"ecf9a649-68f2-4c6f-9460-3a48dc075245\") " pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" Dec 04 12:20:29.395053 master-0 kubenswrapper[35367]: I1204 12:20:29.394970 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-config\") pod \"dnsmasq-dns-7d4d74cb79-bk5n5\" (UID: \"ecf9a649-68f2-4c6f-9460-3a48dc075245\") " pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" Dec 04 12:20:29.395287 master-0 kubenswrapper[35367]: I1204 12:20:29.395226 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-ovsdbserver-nb\") pod \"dnsmasq-dns-7d4d74cb79-bk5n5\" (UID: \"ecf9a649-68f2-4c6f-9460-3a48dc075245\") " pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" Dec 04 12:20:29.395287 master-0 kubenswrapper[35367]: I1204 12:20:29.395236 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-ovsdbserver-sb\") pod \"dnsmasq-dns-7d4d74cb79-bk5n5\" (UID: \"ecf9a649-68f2-4c6f-9460-3a48dc075245\") " pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" Dec 04 12:20:29.396749 master-0 kubenswrapper[35367]: I1204 12:20:29.396060 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-dns-svc\") pod \"dnsmasq-dns-7d4d74cb79-bk5n5\" (UID: \"ecf9a649-68f2-4c6f-9460-3a48dc075245\") " pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" Dec 04 12:20:29.418235 master-0 kubenswrapper[35367]: I1204 12:20:29.417798 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8wht\" (UniqueName: \"kubernetes.io/projected/ecf9a649-68f2-4c6f-9460-3a48dc075245-kube-api-access-h8wht\") pod \"dnsmasq-dns-7d4d74cb79-bk5n5\" (UID: \"ecf9a649-68f2-4c6f-9460-3a48dc075245\") " pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" Dec 04 12:20:29.468008 master-0 kubenswrapper[35367]: I1204 12:20:29.464730 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ovsdbserver-nb-0" Dec 04 12:20:29.535279 master-0 kubenswrapper[35367]: I1204 12:20:29.535194 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" Dec 04 12:20:29.536784 master-0 kubenswrapper[35367]: I1204 12:20:29.535229 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ovsdbserver-sb-0" podStartSLOduration=26.948418003 podStartE2EDuration="58.535151519s" podCreationTimestamp="2025-12-04 12:19:31 +0000 UTC" firstStartedPulling="2025-12-04 12:19:56.640864096 +0000 UTC m=+1240.078925354" lastFinishedPulling="2025-12-04 12:20:28.227597612 +0000 UTC m=+1271.665658870" observedRunningTime="2025-12-04 12:20:29.312535459 +0000 UTC m=+1272.750596727" watchObservedRunningTime="2025-12-04 12:20:29.535151519 +0000 UTC m=+1272.973212797" Dec 04 12:20:29.601594 master-0 kubenswrapper[35367]: I1204 12:20:29.601535 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-4gtrh" Dec 04 12:20:29.611877 master-0 kubenswrapper[35367]: I1204 12:20:29.611793 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-8b5f79d6c-7cz4c"] Dec 04 12:20:29.707666 master-0 kubenswrapper[35367]: I1204 12:20:29.703198 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-574b77955f-hl9sw" Dec 04 12:20:29.708554 master-0 kubenswrapper[35367]: I1204 12:20:29.708480 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7b68ab26-0f7d-486e-9387-b08478d63900-utilities\") pod \"7b68ab26-0f7d-486e-9387-b08478d63900\" (UID: \"7b68ab26-0f7d-486e-9387-b08478d63900\") " Dec 04 12:20:29.708706 master-0 kubenswrapper[35367]: I1204 12:20:29.708659 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7b68ab26-0f7d-486e-9387-b08478d63900-catalog-content\") pod \"7b68ab26-0f7d-486e-9387-b08478d63900\" (UID: \"7b68ab26-0f7d-486e-9387-b08478d63900\") " Dec 04 12:20:29.708771 master-0 kubenswrapper[35367]: I1204 12:20:29.708756 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kz5s\" (UniqueName: \"kubernetes.io/projected/7b68ab26-0f7d-486e-9387-b08478d63900-kube-api-access-8kz5s\") pod \"7b68ab26-0f7d-486e-9387-b08478d63900\" (UID: \"7b68ab26-0f7d-486e-9387-b08478d63900\") " Dec 04 12:20:29.719841 master-0 kubenswrapper[35367]: I1204 12:20:29.711741 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b68ab26-0f7d-486e-9387-b08478d63900-utilities" (OuterVolumeSpecName: "utilities") pod "7b68ab26-0f7d-486e-9387-b08478d63900" (UID: "7b68ab26-0f7d-486e-9387-b08478d63900"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:20:29.750624 master-0 kubenswrapper[35367]: I1204 12:20:29.750383 35367 scope.go:117] "RemoveContainer" containerID="c4ef5c9e77d9b4d351a7451edd42d6437538f743695bc8a683308a0e8573a0cb" Dec 04 12:20:29.758138 master-0 kubenswrapper[35367]: I1204 12:20:29.758093 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-826mk" Dec 04 12:20:29.801127 master-0 kubenswrapper[35367]: I1204 12:20:29.798605 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b68ab26-0f7d-486e-9387-b08478d63900-kube-api-access-8kz5s" (OuterVolumeSpecName: "kube-api-access-8kz5s") pod "7b68ab26-0f7d-486e-9387-b08478d63900" (UID: "7b68ab26-0f7d-486e-9387-b08478d63900"). InnerVolumeSpecName "kube-api-access-8kz5s". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:20:29.814313 master-0 kubenswrapper[35367]: I1204 12:20:29.814256 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/c01c84d4-6af8-42c5-adc0-79e4207144f9-ovsdbserver-nb\") pod \"c01c84d4-6af8-42c5-adc0-79e4207144f9\" (UID: \"c01c84d4-6af8-42c5-adc0-79e4207144f9\") " Dec 04 12:20:29.814642 master-0 kubenswrapper[35367]: I1204 12:20:29.814380 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cccj\" (UniqueName: \"kubernetes.io/projected/c01c84d4-6af8-42c5-adc0-79e4207144f9-kube-api-access-4cccj\") pod \"c01c84d4-6af8-42c5-adc0-79e4207144f9\" (UID: \"c01c84d4-6af8-42c5-adc0-79e4207144f9\") " Dec 04 12:20:29.814642 master-0 kubenswrapper[35367]: I1204 12:20:29.814432 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/c01c84d4-6af8-42c5-adc0-79e4207144f9-dns-svc\") pod \"c01c84d4-6af8-42c5-adc0-79e4207144f9\" (UID: \"c01c84d4-6af8-42c5-adc0-79e4207144f9\") " Dec 04 12:20:29.814642 master-0 kubenswrapper[35367]: I1204 12:20:29.814632 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c01c84d4-6af8-42c5-adc0-79e4207144f9-config\") pod \"c01c84d4-6af8-42c5-adc0-79e4207144f9\" (UID: \"c01c84d4-6af8-42c5-adc0-79e4207144f9\") " Dec 04 12:20:29.816151 master-0 kubenswrapper[35367]: I1204 12:20:29.814929 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c01c84d4-6af8-42c5-adc0-79e4207144f9-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "c01c84d4-6af8-42c5-adc0-79e4207144f9" (UID: "c01c84d4-6af8-42c5-adc0-79e4207144f9"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:29.816151 master-0 kubenswrapper[35367]: I1204 12:20:29.815770 35367 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/c01c84d4-6af8-42c5-adc0-79e4207144f9-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:29.816151 master-0 kubenswrapper[35367]: I1204 12:20:29.815796 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7b68ab26-0f7d-486e-9387-b08478d63900-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:29.816151 master-0 kubenswrapper[35367]: I1204 12:20:29.815852 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8kz5s\" (UniqueName: \"kubernetes.io/projected/7b68ab26-0f7d-486e-9387-b08478d63900-kube-api-access-8kz5s\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:29.816549 master-0 kubenswrapper[35367]: I1204 12:20:29.816516 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c01c84d4-6af8-42c5-adc0-79e4207144f9-config" (OuterVolumeSpecName: "config") pod "c01c84d4-6af8-42c5-adc0-79e4207144f9" (UID: "c01c84d4-6af8-42c5-adc0-79e4207144f9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:29.817147 master-0 kubenswrapper[35367]: I1204 12:20:29.817117 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c01c84d4-6af8-42c5-adc0-79e4207144f9-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "c01c84d4-6af8-42c5-adc0-79e4207144f9" (UID: "c01c84d4-6af8-42c5-adc0-79e4207144f9"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:29.821518 master-0 kubenswrapper[35367]: I1204 12:20:29.821422 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b68ab26-0f7d-486e-9387-b08478d63900-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "7b68ab26-0f7d-486e-9387-b08478d63900" (UID: "7b68ab26-0f7d-486e-9387-b08478d63900"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:20:29.857246 master-0 kubenswrapper[35367]: I1204 12:20:29.856922 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c01c84d4-6af8-42c5-adc0-79e4207144f9-kube-api-access-4cccj" (OuterVolumeSpecName: "kube-api-access-4cccj") pod "c01c84d4-6af8-42c5-adc0-79e4207144f9" (UID: "c01c84d4-6af8-42c5-adc0-79e4207144f9"). InnerVolumeSpecName "kube-api-access-4cccj". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:20:29.922595 master-0 kubenswrapper[35367]: I1204 12:20:29.918761 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/016cf101-1d70-4d15-8857-5a92f2f8ce64-utilities\") pod \"016cf101-1d70-4d15-8857-5a92f2f8ce64\" (UID: \"016cf101-1d70-4d15-8857-5a92f2f8ce64\") " Dec 04 12:20:29.922595 master-0 kubenswrapper[35367]: I1204 12:20:29.918931 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/016cf101-1d70-4d15-8857-5a92f2f8ce64-catalog-content\") pod \"016cf101-1d70-4d15-8857-5a92f2f8ce64\" (UID: \"016cf101-1d70-4d15-8857-5a92f2f8ce64\") " Dec 04 12:20:29.922595 master-0 kubenswrapper[35367]: I1204 12:20:29.918976 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2brd5\" (UniqueName: \"kubernetes.io/projected/016cf101-1d70-4d15-8857-5a92f2f8ce64-kube-api-access-2brd5\") pod \"016cf101-1d70-4d15-8857-5a92f2f8ce64\" (UID: \"016cf101-1d70-4d15-8857-5a92f2f8ce64\") " Dec 04 12:20:29.922595 master-0 kubenswrapper[35367]: I1204 12:20:29.920152 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4cccj\" (UniqueName: \"kubernetes.io/projected/c01c84d4-6af8-42c5-adc0-79e4207144f9-kube-api-access-4cccj\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:29.922595 master-0 kubenswrapper[35367]: I1204 12:20:29.920179 35367 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/c01c84d4-6af8-42c5-adc0-79e4207144f9-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:29.922595 master-0 kubenswrapper[35367]: I1204 12:20:29.920191 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c01c84d4-6af8-42c5-adc0-79e4207144f9-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:29.922595 master-0 kubenswrapper[35367]: I1204 12:20:29.920204 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7b68ab26-0f7d-486e-9387-b08478d63900-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:29.923732 master-0 kubenswrapper[35367]: I1204 12:20:29.922888 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/016cf101-1d70-4d15-8857-5a92f2f8ce64-utilities" (OuterVolumeSpecName: "utilities") pod "016cf101-1d70-4d15-8857-5a92f2f8ce64" (UID: "016cf101-1d70-4d15-8857-5a92f2f8ce64"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:20:29.925183 master-0 kubenswrapper[35367]: I1204 12:20:29.925134 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/016cf101-1d70-4d15-8857-5a92f2f8ce64-kube-api-access-2brd5" (OuterVolumeSpecName: "kube-api-access-2brd5") pod "016cf101-1d70-4d15-8857-5a92f2f8ce64" (UID: "016cf101-1d70-4d15-8857-5a92f2f8ce64"). InnerVolumeSpecName "kube-api-access-2brd5". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:20:30.029852 master-0 kubenswrapper[35367]: I1204 12:20:30.023907 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/016cf101-1d70-4d15-8857-5a92f2f8ce64-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:30.029852 master-0 kubenswrapper[35367]: I1204 12:20:30.023993 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2brd5\" (UniqueName: \"kubernetes.io/projected/016cf101-1d70-4d15-8857-5a92f2f8ce64-kube-api-access-2brd5\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:30.145785 master-0 kubenswrapper[35367]: I1204 12:20:30.145712 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/016cf101-1d70-4d15-8857-5a92f2f8ce64-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "016cf101-1d70-4d15-8857-5a92f2f8ce64" (UID: "016cf101-1d70-4d15-8857-5a92f2f8ce64"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:20:30.231364 master-0 kubenswrapper[35367]: I1204 12:20:30.231301 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/016cf101-1d70-4d15-8857-5a92f2f8ce64-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:30.280970 master-0 kubenswrapper[35367]: I1204 12:20:30.280317 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/swift-storage-0"] Dec 04 12:20:30.282085 master-0 kubenswrapper[35367]: E1204 12:20:30.281963 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="016cf101-1d70-4d15-8857-5a92f2f8ce64" containerName="extract-utilities" Dec 04 12:20:30.282085 master-0 kubenswrapper[35367]: I1204 12:20:30.282077 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="016cf101-1d70-4d15-8857-5a92f2f8ce64" containerName="extract-utilities" Dec 04 12:20:30.282223 master-0 kubenswrapper[35367]: E1204 12:20:30.282143 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7b68ab26-0f7d-486e-9387-b08478d63900" containerName="extract-content" Dec 04 12:20:30.282223 master-0 kubenswrapper[35367]: I1204 12:20:30.282157 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b68ab26-0f7d-486e-9387-b08478d63900" containerName="extract-content" Dec 04 12:20:30.282223 master-0 kubenswrapper[35367]: E1204 12:20:30.282174 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="016cf101-1d70-4d15-8857-5a92f2f8ce64" containerName="registry-server" Dec 04 12:20:30.282223 master-0 kubenswrapper[35367]: I1204 12:20:30.282184 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="016cf101-1d70-4d15-8857-5a92f2f8ce64" containerName="registry-server" Dec 04 12:20:30.282223 master-0 kubenswrapper[35367]: E1204 12:20:30.282197 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7b68ab26-0f7d-486e-9387-b08478d63900" containerName="registry-server" Dec 04 12:20:30.282223 master-0 kubenswrapper[35367]: I1204 12:20:30.282204 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b68ab26-0f7d-486e-9387-b08478d63900" containerName="registry-server" Dec 04 12:20:30.282223 master-0 kubenswrapper[35367]: E1204 12:20:30.282226 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7b68ab26-0f7d-486e-9387-b08478d63900" containerName="extract-utilities" Dec 04 12:20:30.282223 master-0 kubenswrapper[35367]: I1204 12:20:30.282234 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b68ab26-0f7d-486e-9387-b08478d63900" containerName="extract-utilities" Dec 04 12:20:30.282578 master-0 kubenswrapper[35367]: E1204 12:20:30.282261 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="016cf101-1d70-4d15-8857-5a92f2f8ce64" containerName="extract-content" Dec 04 12:20:30.282578 master-0 kubenswrapper[35367]: I1204 12:20:30.282270 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="016cf101-1d70-4d15-8857-5a92f2f8ce64" containerName="extract-content" Dec 04 12:20:30.282651 master-0 kubenswrapper[35367]: I1204 12:20:30.282601 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="7b68ab26-0f7d-486e-9387-b08478d63900" containerName="registry-server" Dec 04 12:20:30.282691 master-0 kubenswrapper[35367]: I1204 12:20:30.282656 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="016cf101-1d70-4d15-8857-5a92f2f8ce64" containerName="registry-server" Dec 04 12:20:30.344651 master-0 kubenswrapper[35367]: I1204 12:20:30.344543 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/swift-storage-0" Dec 04 12:20:30.350038 master-0 kubenswrapper[35367]: I1204 12:20:30.349962 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"swift-conf" Dec 04 12:20:30.350437 master-0 kubenswrapper[35367]: I1204 12:20:30.350257 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"swift-ring-files" Dec 04 12:20:30.352034 master-0 kubenswrapper[35367]: I1204 12:20:30.351933 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"swift-storage-config-data" Dec 04 12:20:30.360419 master-0 kubenswrapper[35367]: I1204 12:20:30.360347 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/swift-storage-0"] Dec 04 12:20:30.375010 master-0 kubenswrapper[35367]: I1204 12:20:30.374493 35367 generic.go:334] "Generic (PLEG): container finished" podID="24a330c4-2fb4-4f90-b4bc-4b1241c01a11" containerID="fc918dae2c4c6740ff78073428b5b9b80b7cf66adb7f61100501acbddb8fb386" exitCode=0 Dec 04 12:20:30.375010 master-0 kubenswrapper[35367]: I1204 12:20:30.374601 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-9mxhg" event={"ID":"24a330c4-2fb4-4f90-b4bc-4b1241c01a11","Type":"ContainerDied","Data":"fc918dae2c4c6740ff78073428b5b9b80b7cf66adb7f61100501acbddb8fb386"} Dec 04 12:20:30.377078 master-0 kubenswrapper[35367]: I1204 12:20:30.377006 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-7d4d74cb79-bk5n5"] Dec 04 12:20:30.379146 master-0 kubenswrapper[35367]: I1204 12:20:30.379083 35367 generic.go:334] "Generic (PLEG): container finished" podID="82ef57ba-2c60-4caf-90d3-915b399a1a2c" containerID="ef78bac117b1894dc1418ce3a9de76386f16520d9e6e1c968fde7a81658c83a8" exitCode=0 Dec 04 12:20:30.379274 master-0 kubenswrapper[35367]: I1204 12:20:30.379244 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-8b5f79d6c-7cz4c" event={"ID":"82ef57ba-2c60-4caf-90d3-915b399a1a2c","Type":"ContainerDied","Data":"ef78bac117b1894dc1418ce3a9de76386f16520d9e6e1c968fde7a81658c83a8"} Dec 04 12:20:30.379360 master-0 kubenswrapper[35367]: I1204 12:20:30.379292 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-8b5f79d6c-7cz4c" event={"ID":"82ef57ba-2c60-4caf-90d3-915b399a1a2c","Type":"ContainerStarted","Data":"07b7c26efa550ccada2eb99ffc48e4a6bd48f0ef584ee3719f784780551c8105"} Dec 04 12:20:30.384342 master-0 kubenswrapper[35367]: I1204 12:20:30.384279 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" event={"ID":"70729025-94a7-4a9b-98b8-e68b73d59a3e","Type":"ContainerStarted","Data":"cbef00c5dea6fb701dedd2199a70f6f57956f5d54407a75b40fccc7ca6399e1a"} Dec 04 12:20:30.384342 master-0 kubenswrapper[35367]: I1204 12:20:30.384827 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" Dec 04 12:20:30.389996 master-0 kubenswrapper[35367]: I1204 12:20:30.389916 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-826mk" event={"ID":"016cf101-1d70-4d15-8857-5a92f2f8ce64","Type":"ContainerDied","Data":"5a075f7e0a534833157e4c0230fd9b54139a57f216c8aa51d67bbb2410350951"} Dec 04 12:20:30.389996 master-0 kubenswrapper[35367]: I1204 12:20:30.390010 35367 scope.go:117] "RemoveContainer" containerID="b5af7a5feaf30ce83d475e8091698d0378d0476a6b00439ad363d4fc4f8b0068" Dec 04 12:20:30.390356 master-0 kubenswrapper[35367]: I1204 12:20:30.390307 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-826mk" Dec 04 12:20:30.394735 master-0 kubenswrapper[35367]: I1204 12:20:30.394686 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-metrics-ksjdz" event={"ID":"289e5588-4158-47ce-b822-3b5e41037598","Type":"ContainerStarted","Data":"f52f62290c5a0cebb9e6051758a6c83a6e5d7413b332b05e76c7850d98fe6aa0"} Dec 04 12:20:30.399345 master-0 kubenswrapper[35367]: I1204 12:20:30.399283 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-574b77955f-hl9sw" Dec 04 12:20:30.399603 master-0 kubenswrapper[35367]: I1204 12:20:30.399448 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4gtrh" event={"ID":"7b68ab26-0f7d-486e-9387-b08478d63900","Type":"ContainerDied","Data":"ce4f122a2122dab0056b5b3878f5038ee006240207988b74e1b1dadbe0382ba1"} Dec 04 12:20:30.399706 master-0 kubenswrapper[35367]: I1204 12:20:30.399500 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-4gtrh" Dec 04 12:20:30.609660 master-0 kubenswrapper[35367]: I1204 12:20:30.609174 35367 scope.go:117] "RemoveContainer" containerID="f91800dcbf53e9546a85d5dae57bc62c600b2ac2e96c0d947fcac2fbbaf60d89" Dec 04 12:20:30.644627 master-0 kubenswrapper[35367]: I1204 12:20:30.644449 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs5kh\" (UniqueName: \"kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-kube-api-access-qs5kh\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") " pod="openstack/swift-storage-0" Dec 04 12:20:30.644627 master-0 kubenswrapper[35367]: I1204 12:20:30.644624 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-etc-swift\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") " pod="openstack/swift-storage-0" Dec 04 12:20:30.645062 master-0 kubenswrapper[35367]: I1204 12:20:30.644668 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-58595baf-ec9d-4bbe-b806-2bcab8e684f9\" (UniqueName: \"kubernetes.io/csi/topolvm.io^d063caff-e7aa-403f-bce8-01917ec923c3\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") " pod="openstack/swift-storage-0" Dec 04 12:20:30.645062 master-0 kubenswrapper[35367]: I1204 12:20:30.644721 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/d421bb44-18fc-4130-baa0-32c09ace37a7-lock\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") " pod="openstack/swift-storage-0" Dec 04 12:20:30.645062 master-0 kubenswrapper[35367]: I1204 12:20:30.644889 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/d421bb44-18fc-4130-baa0-32c09ace37a7-cache\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") " pod="openstack/swift-storage-0" Dec 04 12:20:30.666358 master-0 kubenswrapper[35367]: I1204 12:20:30.666287 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/ovsdbserver-sb-0" Dec 04 12:20:30.668111 master-0 kubenswrapper[35367]: I1204 12:20:30.668076 35367 scope.go:117] "RemoveContainer" containerID="6af4102a269ba8ce881b84ec7ef09bdfbc86009ebe270fe64af09c0978b51ba6" Dec 04 12:20:30.676624 master-0 kubenswrapper[35367]: I1204 12:20:30.676438 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ovn-controller-metrics-ksjdz" podStartSLOduration=8.676414795 podStartE2EDuration="8.676414795s" podCreationTimestamp="2025-12-04 12:20:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:20:30.663318172 +0000 UTC m=+1274.101379430" watchObservedRunningTime="2025-12-04 12:20:30.676414795 +0000 UTC m=+1274.114476053" Dec 04 12:20:30.749010 master-0 kubenswrapper[35367]: I1204 12:20:30.748288 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/d421bb44-18fc-4130-baa0-32c09ace37a7-cache\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") " pod="openstack/swift-storage-0" Dec 04 12:20:30.749010 master-0 kubenswrapper[35367]: I1204 12:20:30.748741 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qs5kh\" (UniqueName: \"kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-kube-api-access-qs5kh\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") " pod="openstack/swift-storage-0" Dec 04 12:20:30.749303 master-0 kubenswrapper[35367]: I1204 12:20:30.749128 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-etc-swift\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") " pod="openstack/swift-storage-0" Dec 04 12:20:30.749303 master-0 kubenswrapper[35367]: I1204 12:20:30.749206 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-58595baf-ec9d-4bbe-b806-2bcab8e684f9\" (UniqueName: \"kubernetes.io/csi/topolvm.io^d063caff-e7aa-403f-bce8-01917ec923c3\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") " pod="openstack/swift-storage-0" Dec 04 12:20:30.749411 master-0 kubenswrapper[35367]: I1204 12:20:30.749343 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/d421bb44-18fc-4130-baa0-32c09ace37a7-lock\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") " pod="openstack/swift-storage-0" Dec 04 12:20:30.750747 master-0 kubenswrapper[35367]: I1204 12:20:30.750691 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/d421bb44-18fc-4130-baa0-32c09ace37a7-cache\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") " pod="openstack/swift-storage-0" Dec 04 12:20:30.753852 master-0 kubenswrapper[35367]: E1204 12:20:30.751765 35367 projected.go:288] Couldn't get configMap openstack/swift-ring-files: configmap "swift-ring-files" not found Dec 04 12:20:30.753852 master-0 kubenswrapper[35367]: E1204 12:20:30.751832 35367 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack/swift-storage-0: configmap "swift-ring-files" not found Dec 04 12:20:30.753852 master-0 kubenswrapper[35367]: E1204 12:20:30.751915 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-etc-swift podName:d421bb44-18fc-4130-baa0-32c09ace37a7 nodeName:}" failed. No retries permitted until 2025-12-04 12:20:31.251886268 +0000 UTC m=+1274.689947606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-etc-swift") pod "swift-storage-0" (UID: "d421bb44-18fc-4130-baa0-32c09ace37a7") : configmap "swift-ring-files" not found Dec 04 12:20:30.753852 master-0 kubenswrapper[35367]: I1204 12:20:30.752581 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/d421bb44-18fc-4130-baa0-32c09ace37a7-lock\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") " pod="openstack/swift-storage-0" Dec 04 12:20:30.757242 master-0 kubenswrapper[35367]: I1204 12:20:30.756932 35367 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 12:20:30.757242 master-0 kubenswrapper[35367]: I1204 12:20:30.757026 35367 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-58595baf-ec9d-4bbe-b806-2bcab8e684f9\" (UniqueName: \"kubernetes.io/csi/topolvm.io^d063caff-e7aa-403f-bce8-01917ec923c3\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/135b02966cab77a54024687bf1be20e89859d4c92ed52c14e3c70ae68d0032a2/globalmount\"" pod="openstack/swift-storage-0" Dec 04 12:20:30.757995 master-0 kubenswrapper[35367]: I1204 12:20:30.757672 35367 scope.go:117] "RemoveContainer" containerID="af334c209a4e4c293c11c291a7435400798c8e198522b00522a9c52c308282c1" Dec 04 12:20:30.803696 master-0 kubenswrapper[35367]: I1204 12:20:30.802933 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs5kh\" (UniqueName: \"kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-kube-api-access-qs5kh\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") " pod="openstack/swift-storage-0" Dec 04 12:20:30.814789 master-0 kubenswrapper[35367]: I1204 12:20:30.809322 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/ovsdbserver-sb-0" Dec 04 12:20:30.814789 master-0 kubenswrapper[35367]: I1204 12:20:30.814663 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/ovn-controller-sm45t" podUID="a2cf9c09-b934-4bc5-babf-9ed4469aa5a0" containerName="ovn-controller" probeResult="failure" output=< Dec 04 12:20:30.814789 master-0 kubenswrapper[35367]: ERROR - ovn-controller connection status is 'not connected', expecting 'connected' status Dec 04 12:20:30.814789 master-0 kubenswrapper[35367]: > Dec 04 12:20:30.817220 master-0 kubenswrapper[35367]: I1204 12:20:30.816598 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-8b5f79d6c-7cz4c" Dec 04 12:20:30.848055 master-0 kubenswrapper[35367]: I1204 12:20:30.847969 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-4gtrh"] Dec 04 12:20:30.866928 master-0 kubenswrapper[35367]: I1204 12:20:30.865667 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-4gtrh"] Dec 04 12:20:30.883724 master-0 kubenswrapper[35367]: I1204 12:20:30.883369 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-826mk"] Dec 04 12:20:30.888438 master-0 kubenswrapper[35367]: I1204 12:20:30.888317 35367 scope.go:117] "RemoveContainer" containerID="fe60b3931768c3022896c329d67d0f1f627d6b792e38177e92f5391538a88d51" Dec 04 12:20:30.897734 master-0 kubenswrapper[35367]: I1204 12:20:30.895663 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-826mk"] Dec 04 12:20:30.927591 master-0 kubenswrapper[35367]: I1204 12:20:30.927499 35367 scope.go:117] "RemoveContainer" containerID="4b7ed1289466c679078759ba8957f82cefcd05463c79e069357738299dd8ef20" Dec 04 12:20:30.989140 master-0 kubenswrapper[35367]: I1204 12:20:30.988410 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hp99b\" (UniqueName: \"kubernetes.io/projected/82ef57ba-2c60-4caf-90d3-915b399a1a2c-kube-api-access-hp99b\") pod \"82ef57ba-2c60-4caf-90d3-915b399a1a2c\" (UID: \"82ef57ba-2c60-4caf-90d3-915b399a1a2c\") " Dec 04 12:20:30.989140 master-0 kubenswrapper[35367]: I1204 12:20:30.988754 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/82ef57ba-2c60-4caf-90d3-915b399a1a2c-config\") pod \"82ef57ba-2c60-4caf-90d3-915b399a1a2c\" (UID: \"82ef57ba-2c60-4caf-90d3-915b399a1a2c\") " Dec 04 12:20:30.992182 master-0 kubenswrapper[35367]: I1204 12:20:30.992083 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/82ef57ba-2c60-4caf-90d3-915b399a1a2c-dns-svc\") pod \"82ef57ba-2c60-4caf-90d3-915b399a1a2c\" (UID: \"82ef57ba-2c60-4caf-90d3-915b399a1a2c\") " Dec 04 12:20:30.999843 master-0 kubenswrapper[35367]: I1204 12:20:30.996939 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82ef57ba-2c60-4caf-90d3-915b399a1a2c-kube-api-access-hp99b" (OuterVolumeSpecName: "kube-api-access-hp99b") pod "82ef57ba-2c60-4caf-90d3-915b399a1a2c" (UID: "82ef57ba-2c60-4caf-90d3-915b399a1a2c"). InnerVolumeSpecName "kube-api-access-hp99b". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:20:31.008370 master-0 kubenswrapper[35367]: I1204 12:20:31.001947 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-574b77955f-hl9sw"] Dec 04 12:20:31.028876 master-0 kubenswrapper[35367]: I1204 12:20:31.026907 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82ef57ba-2c60-4caf-90d3-915b399a1a2c-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "82ef57ba-2c60-4caf-90d3-915b399a1a2c" (UID: "82ef57ba-2c60-4caf-90d3-915b399a1a2c"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:31.031301 master-0 kubenswrapper[35367]: I1204 12:20:31.030934 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82ef57ba-2c60-4caf-90d3-915b399a1a2c-config" (OuterVolumeSpecName: "config") pod "82ef57ba-2c60-4caf-90d3-915b399a1a2c" (UID: "82ef57ba-2c60-4caf-90d3-915b399a1a2c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:31.040776 master-0 kubenswrapper[35367]: I1204 12:20:31.040669 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-574b77955f-hl9sw"] Dec 04 12:20:31.097405 master-0 kubenswrapper[35367]: I1204 12:20:31.097334 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hp99b\" (UniqueName: \"kubernetes.io/projected/82ef57ba-2c60-4caf-90d3-915b399a1a2c-kube-api-access-hp99b\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:31.097405 master-0 kubenswrapper[35367]: I1204 12:20:31.097398 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/82ef57ba-2c60-4caf-90d3-915b399a1a2c-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:31.097405 master-0 kubenswrapper[35367]: I1204 12:20:31.097409 35367 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/82ef57ba-2c60-4caf-90d3-915b399a1a2c-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:31.301777 master-0 kubenswrapper[35367]: I1204 12:20:31.301686 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-etc-swift\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") " pod="openstack/swift-storage-0" Dec 04 12:20:31.302343 master-0 kubenswrapper[35367]: E1204 12:20:31.302085 35367 projected.go:288] Couldn't get configMap openstack/swift-ring-files: configmap "swift-ring-files" not found Dec 04 12:20:31.302343 master-0 kubenswrapper[35367]: E1204 12:20:31.302106 35367 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack/swift-storage-0: configmap "swift-ring-files" not found Dec 04 12:20:31.302343 master-0 kubenswrapper[35367]: E1204 12:20:31.302154 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-etc-swift podName:d421bb44-18fc-4130-baa0-32c09ace37a7 nodeName:}" failed. No retries permitted until 2025-12-04 12:20:32.302139743 +0000 UTC m=+1275.740201001 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-etc-swift") pod "swift-storage-0" (UID: "d421bb44-18fc-4130-baa0-32c09ace37a7") : configmap "swift-ring-files" not found Dec 04 12:20:31.420208 master-0 kubenswrapper[35367]: I1204 12:20:31.419590 35367 generic.go:334] "Generic (PLEG): container finished" podID="9e325c88-55d0-4cb0-8f32-bccf8a0fbdda" containerID="33b1f531d3180cc1d7842d75ef339a5ac26ba1932a9030d7d1e4ad74b66b3aed" exitCode=0 Dec 04 12:20:31.420208 master-0 kubenswrapper[35367]: I1204 12:20:31.419700 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-cell1-server-0" event={"ID":"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda","Type":"ContainerDied","Data":"33b1f531d3180cc1d7842d75ef339a5ac26ba1932a9030d7d1e4ad74b66b3aed"} Dec 04 12:20:31.437368 master-0 kubenswrapper[35367]: I1204 12:20:31.436119 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-9mxhg" event={"ID":"24a330c4-2fb4-4f90-b4bc-4b1241c01a11","Type":"ContainerStarted","Data":"9ed53b245f11cb536b62fe7cc177813ad77e888d0b8d3363dff15f21147d9de2"} Dec 04 12:20:31.444898 master-0 kubenswrapper[35367]: I1204 12:20:31.440834 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-8b5f79d6c-7cz4c" event={"ID":"82ef57ba-2c60-4caf-90d3-915b399a1a2c","Type":"ContainerDied","Data":"07b7c26efa550ccada2eb99ffc48e4a6bd48f0ef584ee3719f784780551c8105"} Dec 04 12:20:31.444898 master-0 kubenswrapper[35367]: I1204 12:20:31.440895 35367 scope.go:117] "RemoveContainer" containerID="ef78bac117b1894dc1418ce3a9de76386f16520d9e6e1c968fde7a81658c83a8" Dec 04 12:20:31.444898 master-0 kubenswrapper[35367]: I1204 12:20:31.441020 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-8b5f79d6c-7cz4c" Dec 04 12:20:31.450152 master-0 kubenswrapper[35367]: I1204 12:20:31.448384 35367 generic.go:334] "Generic (PLEG): container finished" podID="ecf9a649-68f2-4c6f-9460-3a48dc075245" containerID="90047ae68664c8f9a60670b3c58e4aa5ed9c24bca6cca00abbc29d0361037ce4" exitCode=0 Dec 04 12:20:31.450152 master-0 kubenswrapper[35367]: I1204 12:20:31.448570 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" event={"ID":"ecf9a649-68f2-4c6f-9460-3a48dc075245","Type":"ContainerDied","Data":"90047ae68664c8f9a60670b3c58e4aa5ed9c24bca6cca00abbc29d0361037ce4"} Dec 04 12:20:31.450152 master-0 kubenswrapper[35367]: I1204 12:20:31.448632 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" event={"ID":"ecf9a649-68f2-4c6f-9460-3a48dc075245","Type":"ContainerStarted","Data":"ca6d028e2ca94d7ab9c267e818ba9d229a96ee587fcb51a1c730acf35f7c978e"} Dec 04 12:20:31.450152 master-0 kubenswrapper[35367]: I1204 12:20:31.450092 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ovsdbserver-sb-0" Dec 04 12:20:31.533898 master-0 kubenswrapper[35367]: I1204 12:20:31.533057 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ovsdbserver-sb-0" Dec 04 12:20:31.537867 master-0 kubenswrapper[35367]: I1204 12:20:31.534137 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-9mxhg" podStartSLOduration=6.640669004 podStartE2EDuration="9.534109787s" podCreationTimestamp="2025-12-04 12:20:22 +0000 UTC" firstStartedPulling="2025-12-04 12:20:28.212888397 +0000 UTC m=+1271.650949655" lastFinishedPulling="2025-12-04 12:20:31.10632918 +0000 UTC m=+1274.544390438" observedRunningTime="2025-12-04 12:20:31.491148411 +0000 UTC m=+1274.929209689" watchObservedRunningTime="2025-12-04 12:20:31.534109787 +0000 UTC m=+1274.972171075" Dec 04 12:20:31.853510 master-0 kubenswrapper[35367]: I1204 12:20:31.853437 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-8b5f79d6c-7cz4c"] Dec 04 12:20:31.871543 master-0 kubenswrapper[35367]: I1204 12:20:31.866966 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-8b5f79d6c-7cz4c"] Dec 04 12:20:32.143685 master-0 kubenswrapper[35367]: I1204 12:20:32.142924 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovn-northd-0"] Dec 04 12:20:32.143936 master-0 kubenswrapper[35367]: E1204 12:20:32.143697 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="82ef57ba-2c60-4caf-90d3-915b399a1a2c" containerName="init" Dec 04 12:20:32.143936 master-0 kubenswrapper[35367]: I1204 12:20:32.143718 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ef57ba-2c60-4caf-90d3-915b399a1a2c" containerName="init" Dec 04 12:20:32.145115 master-0 kubenswrapper[35367]: I1204 12:20:32.144094 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="82ef57ba-2c60-4caf-90d3-915b399a1a2c" containerName="init" Dec 04 12:20:32.146894 master-0 kubenswrapper[35367]: I1204 12:20:32.145615 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-northd-0" Dec 04 12:20:32.172861 master-0 kubenswrapper[35367]: I1204 12:20:32.169386 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ovnnorthd-ovndbs" Dec 04 12:20:32.172861 master-0 kubenswrapper[35367]: I1204 12:20:32.169453 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovnnorthd-scripts" Dec 04 12:20:32.172861 master-0 kubenswrapper[35367]: I1204 12:20:32.169658 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovnnorthd-config" Dec 04 12:20:32.207953 master-0 kubenswrapper[35367]: I1204 12:20:32.205578 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-northd-0"] Dec 04 12:20:32.285844 master-0 kubenswrapper[35367]: I1204 12:20:32.272870 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/8758e8a1-60ca-4797-adc6-40c1e34d7060-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"8758e8a1-60ca-4797-adc6-40c1e34d7060\") " pod="openstack/ovn-northd-0" Dec 04 12:20:32.285844 master-0 kubenswrapper[35367]: I1204 12:20:32.272966 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8758e8a1-60ca-4797-adc6-40c1e34d7060-scripts\") pod \"ovn-northd-0\" (UID: \"8758e8a1-60ca-4797-adc6-40c1e34d7060\") " pod="openstack/ovn-northd-0" Dec 04 12:20:32.285844 master-0 kubenswrapper[35367]: I1204 12:20:32.273012 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/8758e8a1-60ca-4797-adc6-40c1e34d7060-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"8758e8a1-60ca-4797-adc6-40c1e34d7060\") " pod="openstack/ovn-northd-0" Dec 04 12:20:32.285844 master-0 kubenswrapper[35367]: I1204 12:20:32.273137 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/8758e8a1-60ca-4797-adc6-40c1e34d7060-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"8758e8a1-60ca-4797-adc6-40c1e34d7060\") " pod="openstack/ovn-northd-0" Dec 04 12:20:32.285844 master-0 kubenswrapper[35367]: I1204 12:20:32.273159 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg9j5\" (UniqueName: \"kubernetes.io/projected/8758e8a1-60ca-4797-adc6-40c1e34d7060-kube-api-access-kg9j5\") pod \"ovn-northd-0\" (UID: \"8758e8a1-60ca-4797-adc6-40c1e34d7060\") " pod="openstack/ovn-northd-0" Dec 04 12:20:32.285844 master-0 kubenswrapper[35367]: I1204 12:20:32.273216 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8758e8a1-60ca-4797-adc6-40c1e34d7060-config\") pod \"ovn-northd-0\" (UID: \"8758e8a1-60ca-4797-adc6-40c1e34d7060\") " pod="openstack/ovn-northd-0" Dec 04 12:20:32.285844 master-0 kubenswrapper[35367]: I1204 12:20:32.273270 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8758e8a1-60ca-4797-adc6-40c1e34d7060-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"8758e8a1-60ca-4797-adc6-40c1e34d7060\") " pod="openstack/ovn-northd-0" Dec 04 12:20:32.323649 master-0 kubenswrapper[35367]: I1204 12:20:32.323576 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-58595baf-ec9d-4bbe-b806-2bcab8e684f9\" (UniqueName: \"kubernetes.io/csi/topolvm.io^d063caff-e7aa-403f-bce8-01917ec923c3\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") " pod="openstack/swift-storage-0" Dec 04 12:20:32.378961 master-0 kubenswrapper[35367]: I1204 12:20:32.377879 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/8758e8a1-60ca-4797-adc6-40c1e34d7060-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"8758e8a1-60ca-4797-adc6-40c1e34d7060\") " pod="openstack/ovn-northd-0" Dec 04 12:20:32.378961 master-0 kubenswrapper[35367]: I1204 12:20:32.378066 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/8758e8a1-60ca-4797-adc6-40c1e34d7060-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"8758e8a1-60ca-4797-adc6-40c1e34d7060\") " pod="openstack/ovn-northd-0" Dec 04 12:20:32.378961 master-0 kubenswrapper[35367]: I1204 12:20:32.378103 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kg9j5\" (UniqueName: \"kubernetes.io/projected/8758e8a1-60ca-4797-adc6-40c1e34d7060-kube-api-access-kg9j5\") pod \"ovn-northd-0\" (UID: \"8758e8a1-60ca-4797-adc6-40c1e34d7060\") " pod="openstack/ovn-northd-0" Dec 04 12:20:32.378961 master-0 kubenswrapper[35367]: I1204 12:20:32.378143 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8758e8a1-60ca-4797-adc6-40c1e34d7060-config\") pod \"ovn-northd-0\" (UID: \"8758e8a1-60ca-4797-adc6-40c1e34d7060\") " pod="openstack/ovn-northd-0" Dec 04 12:20:32.378961 master-0 kubenswrapper[35367]: I1204 12:20:32.378207 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8758e8a1-60ca-4797-adc6-40c1e34d7060-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"8758e8a1-60ca-4797-adc6-40c1e34d7060\") " pod="openstack/ovn-northd-0" Dec 04 12:20:32.378961 master-0 kubenswrapper[35367]: I1204 12:20:32.378345 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-etc-swift\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") " pod="openstack/swift-storage-0" Dec 04 12:20:32.379467 master-0 kubenswrapper[35367]: I1204 12:20:32.379416 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8758e8a1-60ca-4797-adc6-40c1e34d7060-config\") pod \"ovn-northd-0\" (UID: \"8758e8a1-60ca-4797-adc6-40c1e34d7060\") " pod="openstack/ovn-northd-0" Dec 04 12:20:32.381258 master-0 kubenswrapper[35367]: E1204 12:20:32.379552 35367 projected.go:288] Couldn't get configMap openstack/swift-ring-files: configmap "swift-ring-files" not found Dec 04 12:20:32.381258 master-0 kubenswrapper[35367]: E1204 12:20:32.379605 35367 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack/swift-storage-0: configmap "swift-ring-files" not found Dec 04 12:20:32.381258 master-0 kubenswrapper[35367]: E1204 12:20:32.379651 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-etc-swift podName:d421bb44-18fc-4130-baa0-32c09ace37a7 nodeName:}" failed. No retries permitted until 2025-12-04 12:20:34.379635595 +0000 UTC m=+1277.817696853 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-etc-swift") pod "swift-storage-0" (UID: "d421bb44-18fc-4130-baa0-32c09ace37a7") : configmap "swift-ring-files" not found Dec 04 12:20:32.381258 master-0 kubenswrapper[35367]: I1204 12:20:32.380031 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/8758e8a1-60ca-4797-adc6-40c1e34d7060-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"8758e8a1-60ca-4797-adc6-40c1e34d7060\") " pod="openstack/ovn-northd-0" Dec 04 12:20:32.381258 master-0 kubenswrapper[35367]: I1204 12:20:32.380166 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/8758e8a1-60ca-4797-adc6-40c1e34d7060-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"8758e8a1-60ca-4797-adc6-40c1e34d7060\") " pod="openstack/ovn-northd-0" Dec 04 12:20:32.381258 master-0 kubenswrapper[35367]: I1204 12:20:32.380280 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8758e8a1-60ca-4797-adc6-40c1e34d7060-scripts\") pod \"ovn-northd-0\" (UID: \"8758e8a1-60ca-4797-adc6-40c1e34d7060\") " pod="openstack/ovn-northd-0" Dec 04 12:20:32.381258 master-0 kubenswrapper[35367]: I1204 12:20:32.381208 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8758e8a1-60ca-4797-adc6-40c1e34d7060-scripts\") pod \"ovn-northd-0\" (UID: \"8758e8a1-60ca-4797-adc6-40c1e34d7060\") " pod="openstack/ovn-northd-0" Dec 04 12:20:32.382904 master-0 kubenswrapper[35367]: I1204 12:20:32.382873 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8758e8a1-60ca-4797-adc6-40c1e34d7060-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"8758e8a1-60ca-4797-adc6-40c1e34d7060\") " pod="openstack/ovn-northd-0" Dec 04 12:20:32.387894 master-0 kubenswrapper[35367]: I1204 12:20:32.384936 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/8758e8a1-60ca-4797-adc6-40c1e34d7060-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"8758e8a1-60ca-4797-adc6-40c1e34d7060\") " pod="openstack/ovn-northd-0" Dec 04 12:20:32.387894 master-0 kubenswrapper[35367]: I1204 12:20:32.385100 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/8758e8a1-60ca-4797-adc6-40c1e34d7060-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"8758e8a1-60ca-4797-adc6-40c1e34d7060\") " pod="openstack/ovn-northd-0" Dec 04 12:20:32.409125 master-0 kubenswrapper[35367]: I1204 12:20:32.408937 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg9j5\" (UniqueName: \"kubernetes.io/projected/8758e8a1-60ca-4797-adc6-40c1e34d7060-kube-api-access-kg9j5\") pod \"ovn-northd-0\" (UID: \"8758e8a1-60ca-4797-adc6-40c1e34d7060\") " pod="openstack/ovn-northd-0" Dec 04 12:20:32.462204 master-0 kubenswrapper[35367]: I1204 12:20:32.462019 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" event={"ID":"ecf9a649-68f2-4c6f-9460-3a48dc075245","Type":"ContainerStarted","Data":"f185f6100be75725bcf243c9242c73fa7267710a6b71ae9bff3d50d8a6c5fbac"} Dec 04 12:20:32.463052 master-0 kubenswrapper[35367]: I1204 12:20:32.462998 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" Dec 04 12:20:32.465904 master-0 kubenswrapper[35367]: I1204 12:20:32.465836 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-cell1-server-0" event={"ID":"9e325c88-55d0-4cb0-8f32-bccf8a0fbdda","Type":"ContainerStarted","Data":"7c8aa68e3fef30268c06debb6fbb5ae7ef452f3e6683ff5b8192e717a2556359"} Dec 04 12:20:32.467064 master-0 kubenswrapper[35367]: I1204 12:20:32.467020 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:20:32.475602 master-0 kubenswrapper[35367]: I1204 12:20:32.475510 35367 generic.go:334] "Generic (PLEG): container finished" podID="f78e6ce3-d552-4b22-8bb1-002996379ed1" containerID="b5d8a7ca11fd06d9854a891d43533844b44383041d9d1eb2db7bd126ac9cf64d" exitCode=0 Dec 04 12:20:32.475851 master-0 kubenswrapper[35367]: I1204 12:20:32.475697 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-server-0" event={"ID":"f78e6ce3-d552-4b22-8bb1-002996379ed1","Type":"ContainerDied","Data":"b5d8a7ca11fd06d9854a891d43533844b44383041d9d1eb2db7bd126ac9cf64d"} Dec 04 12:20:32.507474 master-0 kubenswrapper[35367]: I1204 12:20:32.503684 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" podStartSLOduration=3.5036567720000003 podStartE2EDuration="3.503656772s" podCreationTimestamp="2025-12-04 12:20:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:20:32.499437209 +0000 UTC m=+1275.937498477" watchObservedRunningTime="2025-12-04 12:20:32.503656772 +0000 UTC m=+1275.941718030" Dec 04 12:20:32.520142 master-0 kubenswrapper[35367]: I1204 12:20:32.520057 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-northd-0" Dec 04 12:20:32.624549 master-0 kubenswrapper[35367]: I1204 12:20:32.624462 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/rabbitmq-cell1-server-0" podStartSLOduration=67.587836229 podStartE2EDuration="1m14.624437806s" podCreationTimestamp="2025-12-04 12:19:18 +0000 UTC" firstStartedPulling="2025-12-04 12:19:50.076731988 +0000 UTC m=+1233.514793246" lastFinishedPulling="2025-12-04 12:19:57.113333565 +0000 UTC m=+1240.551394823" observedRunningTime="2025-12-04 12:20:32.60779126 +0000 UTC m=+1276.045852548" watchObservedRunningTime="2025-12-04 12:20:32.624437806 +0000 UTC m=+1276.062499064" Dec 04 12:20:32.720396 master-0 kubenswrapper[35367]: I1204 12:20:32.720200 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/swift-ring-rebalance-52lhh"] Dec 04 12:20:32.726331 master-0 kubenswrapper[35367]: I1204 12:20:32.725420 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:32.738150 master-0 kubenswrapper[35367]: I1204 12:20:32.738082 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"swift-proxy-config-data" Dec 04 12:20:32.738357 master-0 kubenswrapper[35367]: I1204 12:20:32.738311 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"swift-ring-config-data" Dec 04 12:20:32.738597 master-0 kubenswrapper[35367]: I1204 12:20:32.738508 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"swift-ring-scripts" Dec 04 12:20:32.796204 master-0 kubenswrapper[35367]: I1204 12:20:32.795547 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="016cf101-1d70-4d15-8857-5a92f2f8ce64" path="/var/lib/kubelet/pods/016cf101-1d70-4d15-8857-5a92f2f8ce64/volumes" Dec 04 12:20:32.807758 master-0 kubenswrapper[35367]: I1204 12:20:32.807642 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f64da8fa-5055-48d6-936d-8ebad9ea046a-scripts\") pod \"swift-ring-rebalance-52lhh\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:32.814457 master-0 kubenswrapper[35367]: I1204 12:20:32.813558 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b68ab26-0f7d-486e-9387-b08478d63900" path="/var/lib/kubelet/pods/7b68ab26-0f7d-486e-9387-b08478d63900/volumes" Dec 04 12:20:32.815021 master-0 kubenswrapper[35367]: I1204 12:20:32.814992 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82ef57ba-2c60-4caf-90d3-915b399a1a2c" path="/var/lib/kubelet/pods/82ef57ba-2c60-4caf-90d3-915b399a1a2c/volumes" Dec 04 12:20:32.816129 master-0 kubenswrapper[35367]: I1204 12:20:32.815843 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c01c84d4-6af8-42c5-adc0-79e4207144f9" path="/var/lib/kubelet/pods/c01c84d4-6af8-42c5-adc0-79e4207144f9/volumes" Dec 04 12:20:32.816545 master-0 kubenswrapper[35367]: I1204 12:20:32.816514 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/swift-ring-rebalance-52lhh"] Dec 04 12:20:32.828983 master-0 kubenswrapper[35367]: I1204 12:20:32.828031 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/f64da8fa-5055-48d6-936d-8ebad9ea046a-swiftconf\") pod \"swift-ring-rebalance-52lhh\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:32.828983 master-0 kubenswrapper[35367]: I1204 12:20:32.828210 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/f64da8fa-5055-48d6-936d-8ebad9ea046a-etc-swift\") pod \"swift-ring-rebalance-52lhh\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:32.828983 master-0 kubenswrapper[35367]: I1204 12:20:32.828433 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/f64da8fa-5055-48d6-936d-8ebad9ea046a-ring-data-devices\") pod \"swift-ring-rebalance-52lhh\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:32.828983 master-0 kubenswrapper[35367]: I1204 12:20:32.828626 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/f64da8fa-5055-48d6-936d-8ebad9ea046a-dispersionconf\") pod \"swift-ring-rebalance-52lhh\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:32.828983 master-0 kubenswrapper[35367]: I1204 12:20:32.828704 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7llf6\" (UniqueName: \"kubernetes.io/projected/f64da8fa-5055-48d6-936d-8ebad9ea046a-kube-api-access-7llf6\") pod \"swift-ring-rebalance-52lhh\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:32.828983 master-0 kubenswrapper[35367]: I1204 12:20:32.828774 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f64da8fa-5055-48d6-936d-8ebad9ea046a-combined-ca-bundle\") pod \"swift-ring-rebalance-52lhh\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:32.860831 master-0 kubenswrapper[35367]: I1204 12:20:32.860391 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/swift-ring-rebalance-52lhh"] Dec 04 12:20:32.865829 master-0 kubenswrapper[35367]: E1204 12:20:32.861863 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle dispersionconf etc-swift kube-api-access-7llf6 ring-data-devices scripts swiftconf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack/swift-ring-rebalance-52lhh" podUID="f64da8fa-5055-48d6-936d-8ebad9ea046a" Dec 04 12:20:32.914846 master-0 kubenswrapper[35367]: I1204 12:20:32.904219 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/swift-ring-rebalance-m6xdx"] Dec 04 12:20:32.914846 master-0 kubenswrapper[35367]: I1204 12:20:32.906721 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:32.920468 master-0 kubenswrapper[35367]: I1204 12:20:32.917543 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/swift-ring-rebalance-m6xdx"] Dec 04 12:20:32.931291 master-0 kubenswrapper[35367]: I1204 12:20:32.931170 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f64da8fa-5055-48d6-936d-8ebad9ea046a-scripts\") pod \"swift-ring-rebalance-52lhh\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:32.931291 master-0 kubenswrapper[35367]: I1204 12:20:32.931299 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/f64da8fa-5055-48d6-936d-8ebad9ea046a-swiftconf\") pod \"swift-ring-rebalance-52lhh\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:32.931791 master-0 kubenswrapper[35367]: I1204 12:20:32.931411 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/f64da8fa-5055-48d6-936d-8ebad9ea046a-etc-swift\") pod \"swift-ring-rebalance-52lhh\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:32.931791 master-0 kubenswrapper[35367]: I1204 12:20:32.931497 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/f64da8fa-5055-48d6-936d-8ebad9ea046a-ring-data-devices\") pod \"swift-ring-rebalance-52lhh\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:32.931791 master-0 kubenswrapper[35367]: I1204 12:20:32.931646 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/f64da8fa-5055-48d6-936d-8ebad9ea046a-dispersionconf\") pod \"swift-ring-rebalance-52lhh\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:32.931791 master-0 kubenswrapper[35367]: I1204 12:20:32.931709 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7llf6\" (UniqueName: \"kubernetes.io/projected/f64da8fa-5055-48d6-936d-8ebad9ea046a-kube-api-access-7llf6\") pod \"swift-ring-rebalance-52lhh\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:32.931791 master-0 kubenswrapper[35367]: I1204 12:20:32.931753 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f64da8fa-5055-48d6-936d-8ebad9ea046a-combined-ca-bundle\") pod \"swift-ring-rebalance-52lhh\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:32.934572 master-0 kubenswrapper[35367]: I1204 12:20:32.933821 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f64da8fa-5055-48d6-936d-8ebad9ea046a-scripts\") pod \"swift-ring-rebalance-52lhh\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:32.937476 master-0 kubenswrapper[35367]: I1204 12:20:32.937431 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/f64da8fa-5055-48d6-936d-8ebad9ea046a-swiftconf\") pod \"swift-ring-rebalance-52lhh\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:32.939079 master-0 kubenswrapper[35367]: I1204 12:20:32.939050 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/f64da8fa-5055-48d6-936d-8ebad9ea046a-etc-swift\") pod \"swift-ring-rebalance-52lhh\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:32.939892 master-0 kubenswrapper[35367]: I1204 12:20:32.939823 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/f64da8fa-5055-48d6-936d-8ebad9ea046a-ring-data-devices\") pod \"swift-ring-rebalance-52lhh\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:32.944271 master-0 kubenswrapper[35367]: I1204 12:20:32.944097 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/f64da8fa-5055-48d6-936d-8ebad9ea046a-dispersionconf\") pod \"swift-ring-rebalance-52lhh\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:32.948865 master-0 kubenswrapper[35367]: I1204 12:20:32.948766 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f64da8fa-5055-48d6-936d-8ebad9ea046a-combined-ca-bundle\") pod \"swift-ring-rebalance-52lhh\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:33.036371 master-0 kubenswrapper[35367]: I1204 12:20:33.034777 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7llf6\" (UniqueName: \"kubernetes.io/projected/f64da8fa-5055-48d6-936d-8ebad9ea046a-kube-api-access-7llf6\") pod \"swift-ring-rebalance-52lhh\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:33.039317 master-0 kubenswrapper[35367]: I1204 12:20:33.038213 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/c797fda6-756e-40e4-acad-2adff91e19cd-etc-swift\") pod \"swift-ring-rebalance-m6xdx\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.039507 master-0 kubenswrapper[35367]: I1204 12:20:33.039384 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/c797fda6-756e-40e4-acad-2adff91e19cd-dispersionconf\") pod \"swift-ring-rebalance-m6xdx\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.039694 master-0 kubenswrapper[35367]: I1204 12:20:33.039655 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c797fda6-756e-40e4-acad-2adff91e19cd-scripts\") pod \"swift-ring-rebalance-m6xdx\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.039942 master-0 kubenswrapper[35367]: I1204 12:20:33.039738 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/c797fda6-756e-40e4-acad-2adff91e19cd-swiftconf\") pod \"swift-ring-rebalance-m6xdx\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.043292 master-0 kubenswrapper[35367]: I1204 12:20:33.040020 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb4tj\" (UniqueName: \"kubernetes.io/projected/c797fda6-756e-40e4-acad-2adff91e19cd-kube-api-access-kb4tj\") pod \"swift-ring-rebalance-m6xdx\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.043292 master-0 kubenswrapper[35367]: I1204 12:20:33.040683 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/c797fda6-756e-40e4-acad-2adff91e19cd-ring-data-devices\") pod \"swift-ring-rebalance-m6xdx\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.043292 master-0 kubenswrapper[35367]: I1204 12:20:33.041124 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c797fda6-756e-40e4-acad-2adff91e19cd-combined-ca-bundle\") pod \"swift-ring-rebalance-m6xdx\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.146860 master-0 kubenswrapper[35367]: I1204 12:20:33.146582 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/c797fda6-756e-40e4-acad-2adff91e19cd-ring-data-devices\") pod \"swift-ring-rebalance-m6xdx\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.147089 master-0 kubenswrapper[35367]: I1204 12:20:33.146985 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c797fda6-756e-40e4-acad-2adff91e19cd-combined-ca-bundle\") pod \"swift-ring-rebalance-m6xdx\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.147089 master-0 kubenswrapper[35367]: I1204 12:20:33.147052 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/c797fda6-756e-40e4-acad-2adff91e19cd-etc-swift\") pod \"swift-ring-rebalance-m6xdx\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.147200 master-0 kubenswrapper[35367]: I1204 12:20:33.147123 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/c797fda6-756e-40e4-acad-2adff91e19cd-dispersionconf\") pod \"swift-ring-rebalance-m6xdx\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.147200 master-0 kubenswrapper[35367]: I1204 12:20:33.147161 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c797fda6-756e-40e4-acad-2adff91e19cd-scripts\") pod \"swift-ring-rebalance-m6xdx\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.147200 master-0 kubenswrapper[35367]: I1204 12:20:33.147182 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/c797fda6-756e-40e4-acad-2adff91e19cd-swiftconf\") pod \"swift-ring-rebalance-m6xdx\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.147292 master-0 kubenswrapper[35367]: I1204 12:20:33.147219 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kb4tj\" (UniqueName: \"kubernetes.io/projected/c797fda6-756e-40e4-acad-2adff91e19cd-kube-api-access-kb4tj\") pod \"swift-ring-rebalance-m6xdx\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.148296 master-0 kubenswrapper[35367]: I1204 12:20:33.147628 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/c797fda6-756e-40e4-acad-2adff91e19cd-ring-data-devices\") pod \"swift-ring-rebalance-m6xdx\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.148457 master-0 kubenswrapper[35367]: I1204 12:20:33.148366 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c797fda6-756e-40e4-acad-2adff91e19cd-scripts\") pod \"swift-ring-rebalance-m6xdx\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.148503 master-0 kubenswrapper[35367]: I1204 12:20:33.148466 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/c797fda6-756e-40e4-acad-2adff91e19cd-etc-swift\") pod \"swift-ring-rebalance-m6xdx\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.152995 master-0 kubenswrapper[35367]: I1204 12:20:33.152299 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/c797fda6-756e-40e4-acad-2adff91e19cd-dispersionconf\") pod \"swift-ring-rebalance-m6xdx\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.156480 master-0 kubenswrapper[35367]: I1204 12:20:33.156431 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c797fda6-756e-40e4-acad-2adff91e19cd-combined-ca-bundle\") pod \"swift-ring-rebalance-m6xdx\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.161207 master-0 kubenswrapper[35367]: I1204 12:20:33.157648 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/c797fda6-756e-40e4-acad-2adff91e19cd-swiftconf\") pod \"swift-ring-rebalance-m6xdx\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.179878 master-0 kubenswrapper[35367]: I1204 12:20:33.178024 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb4tj\" (UniqueName: \"kubernetes.io/projected/c797fda6-756e-40e4-acad-2adff91e19cd-kube-api-access-kb4tj\") pod \"swift-ring-rebalance-m6xdx\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.195955 master-0 kubenswrapper[35367]: I1204 12:20:33.195850 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-northd-0"] Dec 04 12:20:33.250680 master-0 kubenswrapper[35367]: I1204 12:20:33.250145 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:33.379832 master-0 kubenswrapper[35367]: I1204 12:20:33.375074 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/openstack-galera-0" Dec 04 12:20:33.550477 master-0 kubenswrapper[35367]: I1204 12:20:33.544665 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/openstack-galera-0" Dec 04 12:20:33.550477 master-0 kubenswrapper[35367]: I1204 12:20:33.547153 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-northd-0" event={"ID":"8758e8a1-60ca-4797-adc6-40c1e34d7060","Type":"ContainerStarted","Data":"2d2886f7b604d0ca8dec5c62eeac6705d7ce4d8a1e950b4aad8aeea13806f27e"} Dec 04 12:20:33.567867 master-0 kubenswrapper[35367]: I1204 12:20:33.567795 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:33.587914 master-0 kubenswrapper[35367]: I1204 12:20:33.587513 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-server-0" event={"ID":"f78e6ce3-d552-4b22-8bb1-002996379ed1","Type":"ContainerStarted","Data":"c0660eaefbb5245c95b2a6c9d63c801558542b0a66a7bdd8139829a351bc4596"} Dec 04 12:20:33.603836 master-0 kubenswrapper[35367]: I1204 12:20:33.598888 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/rabbitmq-server-0" Dec 04 12:20:33.621838 master-0 kubenswrapper[35367]: I1204 12:20:33.621163 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:33.681050 master-0 kubenswrapper[35367]: I1204 12:20:33.678431 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/rabbitmq-server-0" podStartSLOduration=67.451495573 podStartE2EDuration="1m17.678408406s" podCreationTimestamp="2025-12-04 12:19:16 +0000 UTC" firstStartedPulling="2025-12-04 12:19:46.890949625 +0000 UTC m=+1230.329010883" lastFinishedPulling="2025-12-04 12:19:57.117862458 +0000 UTC m=+1240.555923716" observedRunningTime="2025-12-04 12:20:33.665472517 +0000 UTC m=+1277.103533795" watchObservedRunningTime="2025-12-04 12:20:33.678408406 +0000 UTC m=+1277.116469654" Dec 04 12:20:33.790392 master-0 kubenswrapper[35367]: I1204 12:20:33.782853 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/f64da8fa-5055-48d6-936d-8ebad9ea046a-ring-data-devices\") pod \"f64da8fa-5055-48d6-936d-8ebad9ea046a\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " Dec 04 12:20:33.790392 master-0 kubenswrapper[35367]: I1204 12:20:33.783702 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f64da8fa-5055-48d6-936d-8ebad9ea046a-scripts\") pod \"f64da8fa-5055-48d6-936d-8ebad9ea046a\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " Dec 04 12:20:33.790392 master-0 kubenswrapper[35367]: I1204 12:20:33.783934 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f64da8fa-5055-48d6-936d-8ebad9ea046a-combined-ca-bundle\") pod \"f64da8fa-5055-48d6-936d-8ebad9ea046a\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " Dec 04 12:20:33.790392 master-0 kubenswrapper[35367]: I1204 12:20:33.784467 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/f64da8fa-5055-48d6-936d-8ebad9ea046a-etc-swift\") pod \"f64da8fa-5055-48d6-936d-8ebad9ea046a\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " Dec 04 12:20:33.790392 master-0 kubenswrapper[35367]: I1204 12:20:33.784576 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7llf6\" (UniqueName: \"kubernetes.io/projected/f64da8fa-5055-48d6-936d-8ebad9ea046a-kube-api-access-7llf6\") pod \"f64da8fa-5055-48d6-936d-8ebad9ea046a\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " Dec 04 12:20:33.790392 master-0 kubenswrapper[35367]: I1204 12:20:33.784672 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/f64da8fa-5055-48d6-936d-8ebad9ea046a-swiftconf\") pod \"f64da8fa-5055-48d6-936d-8ebad9ea046a\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " Dec 04 12:20:33.790392 master-0 kubenswrapper[35367]: I1204 12:20:33.784729 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/f64da8fa-5055-48d6-936d-8ebad9ea046a-dispersionconf\") pod \"f64da8fa-5055-48d6-936d-8ebad9ea046a\" (UID: \"f64da8fa-5055-48d6-936d-8ebad9ea046a\") " Dec 04 12:20:33.790392 master-0 kubenswrapper[35367]: I1204 12:20:33.787560 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f64da8fa-5055-48d6-936d-8ebad9ea046a-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "f64da8fa-5055-48d6-936d-8ebad9ea046a" (UID: "f64da8fa-5055-48d6-936d-8ebad9ea046a"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:33.790392 master-0 kubenswrapper[35367]: I1204 12:20:33.788167 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f64da8fa-5055-48d6-936d-8ebad9ea046a-scripts" (OuterVolumeSpecName: "scripts") pod "f64da8fa-5055-48d6-936d-8ebad9ea046a" (UID: "f64da8fa-5055-48d6-936d-8ebad9ea046a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:33.793796 master-0 kubenswrapper[35367]: I1204 12:20:33.793654 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f64da8fa-5055-48d6-936d-8ebad9ea046a-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "f64da8fa-5055-48d6-936d-8ebad9ea046a" (UID: "f64da8fa-5055-48d6-936d-8ebad9ea046a"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:20:33.804834 master-0 kubenswrapper[35367]: I1204 12:20:33.804332 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f64da8fa-5055-48d6-936d-8ebad9ea046a-kube-api-access-7llf6" (OuterVolumeSpecName: "kube-api-access-7llf6") pod "f64da8fa-5055-48d6-936d-8ebad9ea046a" (UID: "f64da8fa-5055-48d6-936d-8ebad9ea046a"). InnerVolumeSpecName "kube-api-access-7llf6". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:20:33.804834 master-0 kubenswrapper[35367]: I1204 12:20:33.804560 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f64da8fa-5055-48d6-936d-8ebad9ea046a-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "f64da8fa-5055-48d6-936d-8ebad9ea046a" (UID: "f64da8fa-5055-48d6-936d-8ebad9ea046a"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:20:33.810018 master-0 kubenswrapper[35367]: I1204 12:20:33.809875 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f64da8fa-5055-48d6-936d-8ebad9ea046a-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "f64da8fa-5055-48d6-936d-8ebad9ea046a" (UID: "f64da8fa-5055-48d6-936d-8ebad9ea046a"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:20:33.818212 master-0 kubenswrapper[35367]: I1204 12:20:33.818091 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f64da8fa-5055-48d6-936d-8ebad9ea046a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f64da8fa-5055-48d6-936d-8ebad9ea046a" (UID: "f64da8fa-5055-48d6-936d-8ebad9ea046a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:20:33.899833 master-0 kubenswrapper[35367]: I1204 12:20:33.899501 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f64da8fa-5055-48d6-936d-8ebad9ea046a-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:33.899833 master-0 kubenswrapper[35367]: I1204 12:20:33.899556 35367 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/f64da8fa-5055-48d6-936d-8ebad9ea046a-etc-swift\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:33.899833 master-0 kubenswrapper[35367]: I1204 12:20:33.899567 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7llf6\" (UniqueName: \"kubernetes.io/projected/f64da8fa-5055-48d6-936d-8ebad9ea046a-kube-api-access-7llf6\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:33.899833 master-0 kubenswrapper[35367]: I1204 12:20:33.899643 35367 reconciler_common.go:293] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/f64da8fa-5055-48d6-936d-8ebad9ea046a-swiftconf\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:33.899833 master-0 kubenswrapper[35367]: I1204 12:20:33.899658 35367 reconciler_common.go:293] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/f64da8fa-5055-48d6-936d-8ebad9ea046a-dispersionconf\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:33.899833 master-0 kubenswrapper[35367]: I1204 12:20:33.899670 35367 reconciler_common.go:293] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/f64da8fa-5055-48d6-936d-8ebad9ea046a-ring-data-devices\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:33.899833 master-0 kubenswrapper[35367]: I1204 12:20:33.899680 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f64da8fa-5055-48d6-936d-8ebad9ea046a-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:34.413698 master-0 kubenswrapper[35367]: I1204 12:20:34.413623 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-etc-swift\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") " pod="openstack/swift-storage-0" Dec 04 12:20:34.414536 master-0 kubenswrapper[35367]: E1204 12:20:34.413971 35367 projected.go:288] Couldn't get configMap openstack/swift-ring-files: configmap "swift-ring-files" not found Dec 04 12:20:34.414536 master-0 kubenswrapper[35367]: E1204 12:20:34.414040 35367 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack/swift-storage-0: configmap "swift-ring-files" not found Dec 04 12:20:34.414536 master-0 kubenswrapper[35367]: E1204 12:20:34.414129 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-etc-swift podName:d421bb44-18fc-4130-baa0-32c09ace37a7 nodeName:}" failed. No retries permitted until 2025-12-04 12:20:38.414107306 +0000 UTC m=+1281.852168564 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-etc-swift") pod "swift-storage-0" (UID: "d421bb44-18fc-4130-baa0-32c09ace37a7") : configmap "swift-ring-files" not found Dec 04 12:20:34.507469 master-0 kubenswrapper[35367]: I1204 12:20:34.507395 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/swift-ring-rebalance-m6xdx"] Dec 04 12:20:34.511169 master-0 kubenswrapper[35367]: W1204 12:20:34.511081 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc797fda6_756e_40e4_acad_2adff91e19cd.slice/crio-b517f1b018c0bb3b34614900b5d24a3cdca65b3ec18247b1f97095ed2fd02076 WatchSource:0}: Error finding container b517f1b018c0bb3b34614900b5d24a3cdca65b3ec18247b1f97095ed2fd02076: Status 404 returned error can't find the container with id b517f1b018c0bb3b34614900b5d24a3cdca65b3ec18247b1f97095ed2fd02076 Dec 04 12:20:34.588975 master-0 kubenswrapper[35367]: I1204 12:20:34.588786 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-9mxhg" Dec 04 12:20:34.588975 master-0 kubenswrapper[35367]: I1204 12:20:34.588919 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-9mxhg" Dec 04 12:20:34.592519 master-0 kubenswrapper[35367]: I1204 12:20:34.592468 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/swift-ring-rebalance-52lhh" Dec 04 12:20:34.592663 master-0 kubenswrapper[35367]: I1204 12:20:34.592473 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-ring-rebalance-m6xdx" event={"ID":"c797fda6-756e-40e4-acad-2adff91e19cd","Type":"ContainerStarted","Data":"b517f1b018c0bb3b34614900b5d24a3cdca65b3ec18247b1f97095ed2fd02076"} Dec 04 12:20:34.692897 master-0 kubenswrapper[35367]: I1204 12:20:34.688785 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-9mxhg" Dec 04 12:20:34.737820 master-0 kubenswrapper[35367]: I1204 12:20:34.721416 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/swift-ring-rebalance-52lhh"] Dec 04 12:20:34.745915 master-0 kubenswrapper[35367]: I1204 12:20:34.745833 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/swift-ring-rebalance-52lhh"] Dec 04 12:20:34.790758 master-0 kubenswrapper[35367]: I1204 12:20:34.787552 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f64da8fa-5055-48d6-936d-8ebad9ea046a" path="/var/lib/kubelet/pods/f64da8fa-5055-48d6-936d-8ebad9ea046a/volumes" Dec 04 12:20:35.808504 master-0 kubenswrapper[35367]: I1204 12:20:35.808432 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/ovn-controller-sm45t" podUID="a2cf9c09-b934-4bc5-babf-9ed4469aa5a0" containerName="ovn-controller" probeResult="failure" output=< Dec 04 12:20:35.808504 master-0 kubenswrapper[35367]: ERROR - ovn-controller connection status is 'not connected', expecting 'connected' status Dec 04 12:20:35.808504 master-0 kubenswrapper[35367]: > Dec 04 12:20:35.914257 master-0 kubenswrapper[35367]: I1204 12:20:35.914194 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:20:36.624882 master-0 kubenswrapper[35367]: I1204 12:20:36.624708 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-northd-0" event={"ID":"8758e8a1-60ca-4797-adc6-40c1e34d7060","Type":"ContainerStarted","Data":"2aeec8058e0249d791212bdf83023a9200e193cf19a10f2940ad192839946a0b"} Dec 04 12:20:36.624882 master-0 kubenswrapper[35367]: I1204 12:20:36.624838 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-northd-0" event={"ID":"8758e8a1-60ca-4797-adc6-40c1e34d7060","Type":"ContainerStarted","Data":"a8e61acca79ce1dd2f8a0aad4e6c7515ea32c8a28392b774530d614a7220ab4c"} Dec 04 12:20:36.625206 master-0 kubenswrapper[35367]: I1204 12:20:36.624924 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ovn-northd-0" Dec 04 12:20:36.662010 master-0 kubenswrapper[35367]: I1204 12:20:36.661907 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ovn-northd-0" podStartSLOduration=2.673315232 podStartE2EDuration="4.661880051s" podCreationTimestamp="2025-12-04 12:20:32 +0000 UTC" firstStartedPulling="2025-12-04 12:20:33.202457348 +0000 UTC m=+1276.640518606" lastFinishedPulling="2025-12-04 12:20:35.191022167 +0000 UTC m=+1278.629083425" observedRunningTime="2025-12-04 12:20:36.651797383 +0000 UTC m=+1280.089858671" watchObservedRunningTime="2025-12-04 12:20:36.661880051 +0000 UTC m=+1280.099941309" Dec 04 12:20:36.839755 master-0 kubenswrapper[35367]: I1204 12:20:36.839661 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/openstack-cell1-galera-0" Dec 04 12:20:36.949003 master-0 kubenswrapper[35367]: I1204 12:20:36.944830 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/openstack-cell1-galera-0" Dec 04 12:20:38.439622 master-0 kubenswrapper[35367]: I1204 12:20:38.439473 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-etc-swift\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") " pod="openstack/swift-storage-0" Dec 04 12:20:38.440476 master-0 kubenswrapper[35367]: E1204 12:20:38.439759 35367 projected.go:288] Couldn't get configMap openstack/swift-ring-files: configmap "swift-ring-files" not found Dec 04 12:20:38.440476 master-0 kubenswrapper[35367]: E1204 12:20:38.439864 35367 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack/swift-storage-0: configmap "swift-ring-files" not found Dec 04 12:20:38.440476 master-0 kubenswrapper[35367]: E1204 12:20:38.439956 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-etc-swift podName:d421bb44-18fc-4130-baa0-32c09ace37a7 nodeName:}" failed. No retries permitted until 2025-12-04 12:20:46.439931045 +0000 UTC m=+1289.877992303 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-etc-swift") pod "swift-storage-0" (UID: "d421bb44-18fc-4130-baa0-32c09ace37a7") : configmap "swift-ring-files" not found Dec 04 12:20:39.540554 master-0 kubenswrapper[35367]: I1204 12:20:39.540485 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" Dec 04 12:20:39.557892 master-0 kubenswrapper[35367]: I1204 12:20:39.555428 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-db-create-mc686"] Dec 04 12:20:39.562891 master-0 kubenswrapper[35367]: I1204 12:20:39.560614 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-db-create-mc686" Dec 04 12:20:39.606635 master-0 kubenswrapper[35367]: I1204 12:20:39.606547 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-db-create-mc686"] Dec 04 12:20:39.659683 master-0 kubenswrapper[35367]: I1204 12:20:39.655900 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-7db0-account-create-update-p4fn7"] Dec 04 12:20:39.659683 master-0 kubenswrapper[35367]: I1204 12:20:39.658095 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-7db0-account-create-update-p4fn7" Dec 04 12:20:39.663834 master-0 kubenswrapper[35367]: I1204 12:20:39.663733 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-db-secret" Dec 04 12:20:39.681852 master-0 kubenswrapper[35367]: I1204 12:20:39.678358 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49lrh\" (UniqueName: \"kubernetes.io/projected/11479ec7-fd05-46d7-b8ef-61505345a925-kube-api-access-49lrh\") pod \"glance-db-create-mc686\" (UID: \"11479ec7-fd05-46d7-b8ef-61505345a925\") " pod="openstack/glance-db-create-mc686" Dec 04 12:20:39.681852 master-0 kubenswrapper[35367]: I1204 12:20:39.678688 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/11479ec7-fd05-46d7-b8ef-61505345a925-operator-scripts\") pod \"glance-db-create-mc686\" (UID: \"11479ec7-fd05-46d7-b8ef-61505345a925\") " pod="openstack/glance-db-create-mc686" Dec 04 12:20:39.716605 master-0 kubenswrapper[35367]: I1204 12:20:39.715572 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-7db0-account-create-update-p4fn7"] Dec 04 12:20:39.753978 master-0 kubenswrapper[35367]: I1204 12:20:39.750910 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-ring-rebalance-m6xdx" event={"ID":"c797fda6-756e-40e4-acad-2adff91e19cd","Type":"ContainerStarted","Data":"a4dc62a4f536a7bf836c76945963665a8021046538911836bf8539620958554d"} Dec 04 12:20:39.783705 master-0 kubenswrapper[35367]: I1204 12:20:39.781673 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7491014a-fcbc-4943-9362-c3ba47079204-operator-scripts\") pod \"glance-7db0-account-create-update-p4fn7\" (UID: \"7491014a-fcbc-4943-9362-c3ba47079204\") " pod="openstack/glance-7db0-account-create-update-p4fn7" Dec 04 12:20:39.783705 master-0 kubenswrapper[35367]: I1204 12:20:39.781836 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/11479ec7-fd05-46d7-b8ef-61505345a925-operator-scripts\") pod \"glance-db-create-mc686\" (UID: \"11479ec7-fd05-46d7-b8ef-61505345a925\") " pod="openstack/glance-db-create-mc686" Dec 04 12:20:39.783705 master-0 kubenswrapper[35367]: I1204 12:20:39.781961 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-49lrh\" (UniqueName: \"kubernetes.io/projected/11479ec7-fd05-46d7-b8ef-61505345a925-kube-api-access-49lrh\") pod \"glance-db-create-mc686\" (UID: \"11479ec7-fd05-46d7-b8ef-61505345a925\") " pod="openstack/glance-db-create-mc686" Dec 04 12:20:39.783705 master-0 kubenswrapper[35367]: I1204 12:20:39.782021 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmstm\" (UniqueName: \"kubernetes.io/projected/7491014a-fcbc-4943-9362-c3ba47079204-kube-api-access-mmstm\") pod \"glance-7db0-account-create-update-p4fn7\" (UID: \"7491014a-fcbc-4943-9362-c3ba47079204\") " pod="openstack/glance-7db0-account-create-update-p4fn7" Dec 04 12:20:39.783705 master-0 kubenswrapper[35367]: I1204 12:20:39.783036 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/11479ec7-fd05-46d7-b8ef-61505345a925-operator-scripts\") pod \"glance-db-create-mc686\" (UID: \"11479ec7-fd05-46d7-b8ef-61505345a925\") " pod="openstack/glance-db-create-mc686" Dec 04 12:20:39.820122 master-0 kubenswrapper[35367]: I1204 12:20:39.814821 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-49lrh\" (UniqueName: \"kubernetes.io/projected/11479ec7-fd05-46d7-b8ef-61505345a925-kube-api-access-49lrh\") pod \"glance-db-create-mc686\" (UID: \"11479ec7-fd05-46d7-b8ef-61505345a925\") " pod="openstack/glance-db-create-mc686" Dec 04 12:20:39.820122 master-0 kubenswrapper[35367]: I1204 12:20:39.820041 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-658bb5765c-fp46q"] Dec 04 12:20:39.820433 master-0 kubenswrapper[35367]: I1204 12:20:39.820402 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-658bb5765c-fp46q" podUID="6a88e1d8-2084-49c9-a30a-f3bf7464b104" containerName="dnsmasq-dns" containerID="cri-o://b2ec9d3e5687c1eedf0fb014c3ec7581d1b7d6a7de84cc3be719e2f052d2e220" gracePeriod=10 Dec 04 12:20:39.870154 master-0 kubenswrapper[35367]: I1204 12:20:39.868637 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/swift-ring-rebalance-m6xdx" podStartSLOduration=3.376196795 podStartE2EDuration="7.868613636s" podCreationTimestamp="2025-12-04 12:20:32 +0000 UTC" firstStartedPulling="2025-12-04 12:20:34.516870341 +0000 UTC m=+1277.954931599" lastFinishedPulling="2025-12-04 12:20:39.009287182 +0000 UTC m=+1282.447348440" observedRunningTime="2025-12-04 12:20:39.863470744 +0000 UTC m=+1283.301532002" watchObservedRunningTime="2025-12-04 12:20:39.868613636 +0000 UTC m=+1283.306674894" Dec 04 12:20:39.900653 master-0 kubenswrapper[35367]: I1204 12:20:39.895794 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7491014a-fcbc-4943-9362-c3ba47079204-operator-scripts\") pod \"glance-7db0-account-create-update-p4fn7\" (UID: \"7491014a-fcbc-4943-9362-c3ba47079204\") " pod="openstack/glance-7db0-account-create-update-p4fn7" Dec 04 12:20:39.900653 master-0 kubenswrapper[35367]: I1204 12:20:39.896218 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mmstm\" (UniqueName: \"kubernetes.io/projected/7491014a-fcbc-4943-9362-c3ba47079204-kube-api-access-mmstm\") pod \"glance-7db0-account-create-update-p4fn7\" (UID: \"7491014a-fcbc-4943-9362-c3ba47079204\") " pod="openstack/glance-7db0-account-create-update-p4fn7" Dec 04 12:20:39.900653 master-0 kubenswrapper[35367]: I1204 12:20:39.899103 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7491014a-fcbc-4943-9362-c3ba47079204-operator-scripts\") pod \"glance-7db0-account-create-update-p4fn7\" (UID: \"7491014a-fcbc-4943-9362-c3ba47079204\") " pod="openstack/glance-7db0-account-create-update-p4fn7" Dec 04 12:20:39.914862 master-0 kubenswrapper[35367]: I1204 12:20:39.914428 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-db-create-mc686" Dec 04 12:20:39.946887 master-0 kubenswrapper[35367]: I1204 12:20:39.938712 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmstm\" (UniqueName: \"kubernetes.io/projected/7491014a-fcbc-4943-9362-c3ba47079204-kube-api-access-mmstm\") pod \"glance-7db0-account-create-update-p4fn7\" (UID: \"7491014a-fcbc-4943-9362-c3ba47079204\") " pod="openstack/glance-7db0-account-create-update-p4fn7" Dec 04 12:20:40.051320 master-0 kubenswrapper[35367]: I1204 12:20:40.050846 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-7db0-account-create-update-p4fn7" Dec 04 12:20:40.792545 master-0 kubenswrapper[35367]: I1204 12:20:40.792354 35367 generic.go:334] "Generic (PLEG): container finished" podID="6a88e1d8-2084-49c9-a30a-f3bf7464b104" containerID="b2ec9d3e5687c1eedf0fb014c3ec7581d1b7d6a7de84cc3be719e2f052d2e220" exitCode=0 Dec 04 12:20:40.793715 master-0 kubenswrapper[35367]: I1204 12:20:40.793061 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-658bb5765c-fp46q" event={"ID":"6a88e1d8-2084-49c9-a30a-f3bf7464b104","Type":"ContainerDied","Data":"b2ec9d3e5687c1eedf0fb014c3ec7581d1b7d6a7de84cc3be719e2f052d2e220"} Dec 04 12:20:40.793958 master-0 kubenswrapper[35367]: I1204 12:20:40.793910 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-658bb5765c-fp46q" event={"ID":"6a88e1d8-2084-49c9-a30a-f3bf7464b104","Type":"ContainerDied","Data":"5d66313d0fa406d22063cad97f989eaff2191fdd647bf2573baca50b506ba14f"} Dec 04 12:20:40.794040 master-0 kubenswrapper[35367]: I1204 12:20:40.793959 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d66313d0fa406d22063cad97f989eaff2191fdd647bf2573baca50b506ba14f" Dec 04 12:20:40.802399 master-0 kubenswrapper[35367]: I1204 12:20:40.796794 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-658bb5765c-fp46q" Dec 04 12:20:40.812165 master-0 kubenswrapper[35367]: I1204 12:20:40.812100 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/ovn-controller-sm45t" podUID="a2cf9c09-b934-4bc5-babf-9ed4469aa5a0" containerName="ovn-controller" probeResult="failure" output=< Dec 04 12:20:40.812165 master-0 kubenswrapper[35367]: ERROR - ovn-controller connection status is 'not connected', expecting 'connected' status Dec 04 12:20:40.812165 master-0 kubenswrapper[35367]: > Dec 04 12:20:40.877259 master-0 kubenswrapper[35367]: I1204 12:20:40.869251 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-db-create-mc686"] Dec 04 12:20:40.880875 master-0 kubenswrapper[35367]: W1204 12:20:40.879387 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11479ec7_fd05_46d7_b8ef_61505345a925.slice/crio-8581ccfece0796b3acecad8388b3357d9b7d8e1bb4db3d521a49d06e59af7311 WatchSource:0}: Error finding container 8581ccfece0796b3acecad8388b3357d9b7d8e1bb4db3d521a49d06e59af7311: Status 404 returned error can't find the container with id 8581ccfece0796b3acecad8388b3357d9b7d8e1bb4db3d521a49d06e59af7311 Dec 04 12:20:40.914606 master-0 kubenswrapper[35367]: I1204 12:20:40.894236 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-7db0-account-create-update-p4fn7"] Dec 04 12:20:40.914606 master-0 kubenswrapper[35367]: I1204 12:20:40.911901 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ovn-controller-ovs-dwktl" Dec 04 12:20:40.954992 master-0 kubenswrapper[35367]: I1204 12:20:40.954935 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a88e1d8-2084-49c9-a30a-f3bf7464b104-config\") pod \"6a88e1d8-2084-49c9-a30a-f3bf7464b104\" (UID: \"6a88e1d8-2084-49c9-a30a-f3bf7464b104\") " Dec 04 12:20:40.956157 master-0 kubenswrapper[35367]: I1204 12:20:40.956040 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn9sn\" (UniqueName: \"kubernetes.io/projected/6a88e1d8-2084-49c9-a30a-f3bf7464b104-kube-api-access-gn9sn\") pod \"6a88e1d8-2084-49c9-a30a-f3bf7464b104\" (UID: \"6a88e1d8-2084-49c9-a30a-f3bf7464b104\") " Dec 04 12:20:40.956366 master-0 kubenswrapper[35367]: I1204 12:20:40.956282 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/6a88e1d8-2084-49c9-a30a-f3bf7464b104-dns-svc\") pod \"6a88e1d8-2084-49c9-a30a-f3bf7464b104\" (UID: \"6a88e1d8-2084-49c9-a30a-f3bf7464b104\") " Dec 04 12:20:40.959759 master-0 kubenswrapper[35367]: I1204 12:20:40.959644 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a88e1d8-2084-49c9-a30a-f3bf7464b104-kube-api-access-gn9sn" (OuterVolumeSpecName: "kube-api-access-gn9sn") pod "6a88e1d8-2084-49c9-a30a-f3bf7464b104" (UID: "6a88e1d8-2084-49c9-a30a-f3bf7464b104"). InnerVolumeSpecName "kube-api-access-gn9sn". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:20:41.023198 master-0 kubenswrapper[35367]: I1204 12:20:41.023147 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a88e1d8-2084-49c9-a30a-f3bf7464b104-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "6a88e1d8-2084-49c9-a30a-f3bf7464b104" (UID: "6a88e1d8-2084-49c9-a30a-f3bf7464b104"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:41.033502 master-0 kubenswrapper[35367]: I1204 12:20:41.033431 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a88e1d8-2084-49c9-a30a-f3bf7464b104-config" (OuterVolumeSpecName: "config") pod "6a88e1d8-2084-49c9-a30a-f3bf7464b104" (UID: "6a88e1d8-2084-49c9-a30a-f3bf7464b104"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:41.061461 master-0 kubenswrapper[35367]: I1204 12:20:41.059877 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a88e1d8-2084-49c9-a30a-f3bf7464b104-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:41.061461 master-0 kubenswrapper[35367]: I1204 12:20:41.059935 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gn9sn\" (UniqueName: \"kubernetes.io/projected/6a88e1d8-2084-49c9-a30a-f3bf7464b104-kube-api-access-gn9sn\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:41.061461 master-0 kubenswrapper[35367]: I1204 12:20:41.059951 35367 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/6a88e1d8-2084-49c9-a30a-f3bf7464b104-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:41.553372 master-0 kubenswrapper[35367]: I1204 12:20:41.552791 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovn-controller-sm45t-config-l9gbr"] Dec 04 12:20:41.553638 master-0 kubenswrapper[35367]: E1204 12:20:41.553580 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6a88e1d8-2084-49c9-a30a-f3bf7464b104" containerName="init" Dec 04 12:20:41.553638 master-0 kubenswrapper[35367]: I1204 12:20:41.553605 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a88e1d8-2084-49c9-a30a-f3bf7464b104" containerName="init" Dec 04 12:20:41.553740 master-0 kubenswrapper[35367]: E1204 12:20:41.553667 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6a88e1d8-2084-49c9-a30a-f3bf7464b104" containerName="dnsmasq-dns" Dec 04 12:20:41.553740 master-0 kubenswrapper[35367]: I1204 12:20:41.553676 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a88e1d8-2084-49c9-a30a-f3bf7464b104" containerName="dnsmasq-dns" Dec 04 12:20:41.554932 master-0 kubenswrapper[35367]: I1204 12:20:41.554066 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="6a88e1d8-2084-49c9-a30a-f3bf7464b104" containerName="dnsmasq-dns" Dec 04 12:20:41.556536 master-0 kubenswrapper[35367]: I1204 12:20:41.556463 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:41.560704 master-0 kubenswrapper[35367]: I1204 12:20:41.560627 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovncontroller-extra-scripts" Dec 04 12:20:41.605842 master-0 kubenswrapper[35367]: I1204 12:20:41.603587 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-sm45t-config-l9gbr"] Dec 04 12:20:41.682649 master-0 kubenswrapper[35367]: I1204 12:20:41.681228 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-scripts\") pod \"ovn-controller-sm45t-config-l9gbr\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:41.682649 master-0 kubenswrapper[35367]: I1204 12:20:41.681333 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-var-run\") pod \"ovn-controller-sm45t-config-l9gbr\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:41.682649 master-0 kubenswrapper[35367]: I1204 12:20:41.681358 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-var-log-ovn\") pod \"ovn-controller-sm45t-config-l9gbr\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:41.690835 master-0 kubenswrapper[35367]: I1204 12:20:41.681535 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-var-run-ovn\") pod \"ovn-controller-sm45t-config-l9gbr\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:41.714853 master-0 kubenswrapper[35367]: I1204 12:20:41.714338 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-additional-scripts\") pod \"ovn-controller-sm45t-config-l9gbr\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:41.714853 master-0 kubenswrapper[35367]: I1204 12:20:41.714634 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcccp\" (UniqueName: \"kubernetes.io/projected/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-kube-api-access-rcccp\") pod \"ovn-controller-sm45t-config-l9gbr\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:41.809303 master-0 kubenswrapper[35367]: I1204 12:20:41.809031 35367 generic.go:334] "Generic (PLEG): container finished" podID="11479ec7-fd05-46d7-b8ef-61505345a925" containerID="fe12f1ceac075212dc006898ead31b732494f7516c1492e02d663aa90e07dc47" exitCode=0 Dec 04 12:20:41.809303 master-0 kubenswrapper[35367]: I1204 12:20:41.809151 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-db-create-mc686" event={"ID":"11479ec7-fd05-46d7-b8ef-61505345a925","Type":"ContainerDied","Data":"fe12f1ceac075212dc006898ead31b732494f7516c1492e02d663aa90e07dc47"} Dec 04 12:20:41.809978 master-0 kubenswrapper[35367]: I1204 12:20:41.809308 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-db-create-mc686" event={"ID":"11479ec7-fd05-46d7-b8ef-61505345a925","Type":"ContainerStarted","Data":"8581ccfece0796b3acecad8388b3357d9b7d8e1bb4db3d521a49d06e59af7311"} Dec 04 12:20:41.813835 master-0 kubenswrapper[35367]: I1204 12:20:41.813766 35367 generic.go:334] "Generic (PLEG): container finished" podID="7491014a-fcbc-4943-9362-c3ba47079204" containerID="9ae56bc3dc569fd38544ff059f567433160bd3947352cec600d3b8129e3305d4" exitCode=0 Dec 04 12:20:41.814009 master-0 kubenswrapper[35367]: I1204 12:20:41.813918 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-658bb5765c-fp46q" Dec 04 12:20:41.814498 master-0 kubenswrapper[35367]: I1204 12:20:41.814420 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-7db0-account-create-update-p4fn7" event={"ID":"7491014a-fcbc-4943-9362-c3ba47079204","Type":"ContainerDied","Data":"9ae56bc3dc569fd38544ff059f567433160bd3947352cec600d3b8129e3305d4"} Dec 04 12:20:41.814568 master-0 kubenswrapper[35367]: I1204 12:20:41.814517 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-7db0-account-create-update-p4fn7" event={"ID":"7491014a-fcbc-4943-9362-c3ba47079204","Type":"ContainerStarted","Data":"65a41a0ed02c4817fdbae931cfcc9f4364dbb497034556b0c820389075b31e14"} Dec 04 12:20:41.817675 master-0 kubenswrapper[35367]: I1204 12:20:41.817571 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rcccp\" (UniqueName: \"kubernetes.io/projected/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-kube-api-access-rcccp\") pod \"ovn-controller-sm45t-config-l9gbr\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:41.817836 master-0 kubenswrapper[35367]: I1204 12:20:41.817685 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-scripts\") pod \"ovn-controller-sm45t-config-l9gbr\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:41.817836 master-0 kubenswrapper[35367]: I1204 12:20:41.817739 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-var-log-ovn\") pod \"ovn-controller-sm45t-config-l9gbr\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:41.817836 master-0 kubenswrapper[35367]: I1204 12:20:41.817768 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-var-run\") pod \"ovn-controller-sm45t-config-l9gbr\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:41.818026 master-0 kubenswrapper[35367]: I1204 12:20:41.817990 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-var-run-ovn\") pod \"ovn-controller-sm45t-config-l9gbr\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:41.818094 master-0 kubenswrapper[35367]: I1204 12:20:41.818014 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-var-log-ovn\") pod \"ovn-controller-sm45t-config-l9gbr\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:41.818276 master-0 kubenswrapper[35367]: I1204 12:20:41.818240 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-additional-scripts\") pod \"ovn-controller-sm45t-config-l9gbr\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:41.820071 master-0 kubenswrapper[35367]: I1204 12:20:41.819300 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-additional-scripts\") pod \"ovn-controller-sm45t-config-l9gbr\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:41.820304 master-0 kubenswrapper[35367]: I1204 12:20:41.820080 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-var-run\") pod \"ovn-controller-sm45t-config-l9gbr\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:41.821158 master-0 kubenswrapper[35367]: I1204 12:20:41.821116 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-var-run-ovn\") pod \"ovn-controller-sm45t-config-l9gbr\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:41.822706 master-0 kubenswrapper[35367]: I1204 12:20:41.822367 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-scripts\") pod \"ovn-controller-sm45t-config-l9gbr\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:41.841751 master-0 kubenswrapper[35367]: I1204 12:20:41.841661 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcccp\" (UniqueName: \"kubernetes.io/projected/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-kube-api-access-rcccp\") pod \"ovn-controller-sm45t-config-l9gbr\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:41.909664 master-0 kubenswrapper[35367]: I1204 12:20:41.909544 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:41.977841 master-0 kubenswrapper[35367]: I1204 12:20:41.974847 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-658bb5765c-fp46q"] Dec 04 12:20:42.002713 master-0 kubenswrapper[35367]: I1204 12:20:42.002656 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-658bb5765c-fp46q"] Dec 04 12:20:42.764701 master-0 kubenswrapper[35367]: I1204 12:20:42.764616 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a88e1d8-2084-49c9-a30a-f3bf7464b104" path="/var/lib/kubelet/pods/6a88e1d8-2084-49c9-a30a-f3bf7464b104/volumes" Dec 04 12:20:43.070521 master-0 kubenswrapper[35367]: I1204 12:20:43.066108 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/rabbitmq-cell1-server-0" Dec 04 12:20:43.164404 master-0 kubenswrapper[35367]: I1204 12:20:43.163771 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-sm45t-config-l9gbr"] Dec 04 12:20:43.342216 master-0 kubenswrapper[35367]: I1204 12:20:43.342065 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/keystone-9f97-account-create-update-pz8hh"] Dec 04 12:20:43.345555 master-0 kubenswrapper[35367]: I1204 12:20:43.345494 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-9f97-account-create-update-pz8hh" Dec 04 12:20:43.348749 master-0 kubenswrapper[35367]: I1204 12:20:43.348707 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone-db-secret" Dec 04 12:20:43.380010 master-0 kubenswrapper[35367]: I1204 12:20:43.379949 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-9f97-account-create-update-pz8hh"] Dec 04 12:20:43.407258 master-0 kubenswrapper[35367]: I1204 12:20:43.407145 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/keystone-db-create-srv98"] Dec 04 12:20:43.410649 master-0 kubenswrapper[35367]: I1204 12:20:43.410336 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-db-create-srv98" Dec 04 12:20:43.429398 master-0 kubenswrapper[35367]: I1204 12:20:43.429328 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-db-create-srv98"] Dec 04 12:20:43.490663 master-0 kubenswrapper[35367]: I1204 12:20:43.490507 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/09248008-9ef2-4192-b659-99a871da63fd-operator-scripts\") pod \"keystone-9f97-account-create-update-pz8hh\" (UID: \"09248008-9ef2-4192-b659-99a871da63fd\") " pod="openstack/keystone-9f97-account-create-update-pz8hh" Dec 04 12:20:43.490954 master-0 kubenswrapper[35367]: I1204 12:20:43.490704 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwrmz\" (UniqueName: \"kubernetes.io/projected/09248008-9ef2-4192-b659-99a871da63fd-kube-api-access-vwrmz\") pod \"keystone-9f97-account-create-update-pz8hh\" (UID: \"09248008-9ef2-4192-b659-99a871da63fd\") " pod="openstack/keystone-9f97-account-create-update-pz8hh" Dec 04 12:20:43.595064 master-0 kubenswrapper[35367]: I1204 12:20:43.593339 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/09248008-9ef2-4192-b659-99a871da63fd-operator-scripts\") pod \"keystone-9f97-account-create-update-pz8hh\" (UID: \"09248008-9ef2-4192-b659-99a871da63fd\") " pod="openstack/keystone-9f97-account-create-update-pz8hh" Dec 04 12:20:43.595064 master-0 kubenswrapper[35367]: I1204 12:20:43.593427 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vwrmz\" (UniqueName: \"kubernetes.io/projected/09248008-9ef2-4192-b659-99a871da63fd-kube-api-access-vwrmz\") pod \"keystone-9f97-account-create-update-pz8hh\" (UID: \"09248008-9ef2-4192-b659-99a871da63fd\") " pod="openstack/keystone-9f97-account-create-update-pz8hh" Dec 04 12:20:43.595064 master-0 kubenswrapper[35367]: I1204 12:20:43.593514 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdtdq\" (UniqueName: \"kubernetes.io/projected/ee42dab4-d3fb-4934-be07-6098344a2c31-kube-api-access-pdtdq\") pod \"keystone-db-create-srv98\" (UID: \"ee42dab4-d3fb-4934-be07-6098344a2c31\") " pod="openstack/keystone-db-create-srv98" Dec 04 12:20:43.595064 master-0 kubenswrapper[35367]: I1204 12:20:43.593647 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee42dab4-d3fb-4934-be07-6098344a2c31-operator-scripts\") pod \"keystone-db-create-srv98\" (UID: \"ee42dab4-d3fb-4934-be07-6098344a2c31\") " pod="openstack/keystone-db-create-srv98" Dec 04 12:20:43.595064 master-0 kubenswrapper[35367]: I1204 12:20:43.594617 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/09248008-9ef2-4192-b659-99a871da63fd-operator-scripts\") pod \"keystone-9f97-account-create-update-pz8hh\" (UID: \"09248008-9ef2-4192-b659-99a871da63fd\") " pod="openstack/keystone-9f97-account-create-update-pz8hh" Dec 04 12:20:43.640928 master-0 kubenswrapper[35367]: I1204 12:20:43.640771 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwrmz\" (UniqueName: \"kubernetes.io/projected/09248008-9ef2-4192-b659-99a871da63fd-kube-api-access-vwrmz\") pod \"keystone-9f97-account-create-update-pz8hh\" (UID: \"09248008-9ef2-4192-b659-99a871da63fd\") " pod="openstack/keystone-9f97-account-create-update-pz8hh" Dec 04 12:20:43.675598 master-0 kubenswrapper[35367]: I1204 12:20:43.663906 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-db-create-mc686" Dec 04 12:20:43.680044 master-0 kubenswrapper[35367]: I1204 12:20:43.679982 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-9f97-account-create-update-pz8hh" Dec 04 12:20:43.705836 master-0 kubenswrapper[35367]: I1204 12:20:43.695968 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pdtdq\" (UniqueName: \"kubernetes.io/projected/ee42dab4-d3fb-4934-be07-6098344a2c31-kube-api-access-pdtdq\") pod \"keystone-db-create-srv98\" (UID: \"ee42dab4-d3fb-4934-be07-6098344a2c31\") " pod="openstack/keystone-db-create-srv98" Dec 04 12:20:43.705836 master-0 kubenswrapper[35367]: I1204 12:20:43.696144 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee42dab4-d3fb-4934-be07-6098344a2c31-operator-scripts\") pod \"keystone-db-create-srv98\" (UID: \"ee42dab4-d3fb-4934-be07-6098344a2c31\") " pod="openstack/keystone-db-create-srv98" Dec 04 12:20:43.705836 master-0 kubenswrapper[35367]: I1204 12:20:43.697320 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee42dab4-d3fb-4934-be07-6098344a2c31-operator-scripts\") pod \"keystone-db-create-srv98\" (UID: \"ee42dab4-d3fb-4934-be07-6098344a2c31\") " pod="openstack/keystone-db-create-srv98" Dec 04 12:20:43.705836 master-0 kubenswrapper[35367]: I1204 12:20:43.701063 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/placement-dcfa-account-create-update-9th7n"] Dec 04 12:20:43.705836 master-0 kubenswrapper[35367]: E1204 12:20:43.701885 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="11479ec7-fd05-46d7-b8ef-61505345a925" containerName="mariadb-database-create" Dec 04 12:20:43.705836 master-0 kubenswrapper[35367]: I1204 12:20:43.701904 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="11479ec7-fd05-46d7-b8ef-61505345a925" containerName="mariadb-database-create" Dec 04 12:20:43.705836 master-0 kubenswrapper[35367]: I1204 12:20:43.702182 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="11479ec7-fd05-46d7-b8ef-61505345a925" containerName="mariadb-database-create" Dec 04 12:20:43.705836 master-0 kubenswrapper[35367]: I1204 12:20:43.703279 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-dcfa-account-create-update-9th7n" Dec 04 12:20:43.742761 master-0 kubenswrapper[35367]: I1204 12:20:43.725591 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/placement-db-create-7m5q7"] Dec 04 12:20:43.746734 master-0 kubenswrapper[35367]: I1204 12:20:43.726926 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"placement-db-secret" Dec 04 12:20:43.750940 master-0 kubenswrapper[35367]: I1204 12:20:43.750873 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-dcfa-account-create-update-9th7n"] Dec 04 12:20:43.752380 master-0 kubenswrapper[35367]: I1204 12:20:43.752344 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-db-create-7m5q7" Dec 04 12:20:43.768330 master-0 kubenswrapper[35367]: I1204 12:20:43.768278 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdtdq\" (UniqueName: \"kubernetes.io/projected/ee42dab4-d3fb-4934-be07-6098344a2c31-kube-api-access-pdtdq\") pod \"keystone-db-create-srv98\" (UID: \"ee42dab4-d3fb-4934-be07-6098344a2c31\") " pod="openstack/keystone-db-create-srv98" Dec 04 12:20:43.774542 master-0 kubenswrapper[35367]: I1204 12:20:43.774492 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-db-create-7m5q7"] Dec 04 12:20:43.802830 master-0 kubenswrapper[35367]: I1204 12:20:43.802362 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49lrh\" (UniqueName: \"kubernetes.io/projected/11479ec7-fd05-46d7-b8ef-61505345a925-kube-api-access-49lrh\") pod \"11479ec7-fd05-46d7-b8ef-61505345a925\" (UID: \"11479ec7-fd05-46d7-b8ef-61505345a925\") " Dec 04 12:20:43.802830 master-0 kubenswrapper[35367]: I1204 12:20:43.802627 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/11479ec7-fd05-46d7-b8ef-61505345a925-operator-scripts\") pod \"11479ec7-fd05-46d7-b8ef-61505345a925\" (UID: \"11479ec7-fd05-46d7-b8ef-61505345a925\") " Dec 04 12:20:43.803196 master-0 kubenswrapper[35367]: I1204 12:20:43.803158 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a54041bc-fcee-4c9f-b184-6c6cca276c17-operator-scripts\") pod \"placement-dcfa-account-create-update-9th7n\" (UID: \"a54041bc-fcee-4c9f-b184-6c6cca276c17\") " pod="openstack/placement-dcfa-account-create-update-9th7n" Dec 04 12:20:43.803387 master-0 kubenswrapper[35367]: I1204 12:20:43.803358 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wshcm\" (UniqueName: \"kubernetes.io/projected/a54041bc-fcee-4c9f-b184-6c6cca276c17-kube-api-access-wshcm\") pod \"placement-dcfa-account-create-update-9th7n\" (UID: \"a54041bc-fcee-4c9f-b184-6c6cca276c17\") " pod="openstack/placement-dcfa-account-create-update-9th7n" Dec 04 12:20:43.803465 master-0 kubenswrapper[35367]: I1204 12:20:43.803426 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11479ec7-fd05-46d7-b8ef-61505345a925-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "11479ec7-fd05-46d7-b8ef-61505345a925" (UID: "11479ec7-fd05-46d7-b8ef-61505345a925"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:43.804499 master-0 kubenswrapper[35367]: I1204 12:20:43.803631 35367 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/11479ec7-fd05-46d7-b8ef-61505345a925-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:43.821172 master-0 kubenswrapper[35367]: I1204 12:20:43.819515 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11479ec7-fd05-46d7-b8ef-61505345a925-kube-api-access-49lrh" (OuterVolumeSpecName: "kube-api-access-49lrh") pod "11479ec7-fd05-46d7-b8ef-61505345a925" (UID: "11479ec7-fd05-46d7-b8ef-61505345a925"). InnerVolumeSpecName "kube-api-access-49lrh". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:20:43.851146 master-0 kubenswrapper[35367]: I1204 12:20:43.846631 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-sm45t-config-l9gbr" event={"ID":"7ebc2c6f-6038-4a4f-9b03-79e46c3113be","Type":"ContainerStarted","Data":"a084cfadf9f827c31fdd37f2c14f75bd0d7f139152e01e1724c705cadac6cd62"} Dec 04 12:20:43.851146 master-0 kubenswrapper[35367]: I1204 12:20:43.848449 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-7db0-account-create-update-p4fn7" event={"ID":"7491014a-fcbc-4943-9362-c3ba47079204","Type":"ContainerDied","Data":"65a41a0ed02c4817fdbae931cfcc9f4364dbb497034556b0c820389075b31e14"} Dec 04 12:20:43.851146 master-0 kubenswrapper[35367]: I1204 12:20:43.848488 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65a41a0ed02c4817fdbae931cfcc9f4364dbb497034556b0c820389075b31e14" Dec 04 12:20:43.851146 master-0 kubenswrapper[35367]: I1204 12:20:43.851082 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-db-create-mc686" event={"ID":"11479ec7-fd05-46d7-b8ef-61505345a925","Type":"ContainerDied","Data":"8581ccfece0796b3acecad8388b3357d9b7d8e1bb4db3d521a49d06e59af7311"} Dec 04 12:20:43.851146 master-0 kubenswrapper[35367]: I1204 12:20:43.851118 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8581ccfece0796b3acecad8388b3357d9b7d8e1bb4db3d521a49d06e59af7311" Dec 04 12:20:43.851638 master-0 kubenswrapper[35367]: I1204 12:20:43.851194 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-db-create-mc686" Dec 04 12:20:43.888081 master-0 kubenswrapper[35367]: I1204 12:20:43.887994 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-7db0-account-create-update-p4fn7" Dec 04 12:20:43.906619 master-0 kubenswrapper[35367]: I1204 12:20:43.906531 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wshcm\" (UniqueName: \"kubernetes.io/projected/a54041bc-fcee-4c9f-b184-6c6cca276c17-kube-api-access-wshcm\") pod \"placement-dcfa-account-create-update-9th7n\" (UID: \"a54041bc-fcee-4c9f-b184-6c6cca276c17\") " pod="openstack/placement-dcfa-account-create-update-9th7n" Dec 04 12:20:43.907881 master-0 kubenswrapper[35367]: I1204 12:20:43.907273 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkfqj\" (UniqueName: \"kubernetes.io/projected/c77c7cce-fe37-4ebd-b63c-67e3ecedcbed-kube-api-access-dkfqj\") pod \"placement-db-create-7m5q7\" (UID: \"c77c7cce-fe37-4ebd-b63c-67e3ecedcbed\") " pod="openstack/placement-db-create-7m5q7" Dec 04 12:20:43.908528 master-0 kubenswrapper[35367]: I1204 12:20:43.908452 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c77c7cce-fe37-4ebd-b63c-67e3ecedcbed-operator-scripts\") pod \"placement-db-create-7m5q7\" (UID: \"c77c7cce-fe37-4ebd-b63c-67e3ecedcbed\") " pod="openstack/placement-db-create-7m5q7" Dec 04 12:20:43.909049 master-0 kubenswrapper[35367]: I1204 12:20:43.908950 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a54041bc-fcee-4c9f-b184-6c6cca276c17-operator-scripts\") pod \"placement-dcfa-account-create-update-9th7n\" (UID: \"a54041bc-fcee-4c9f-b184-6c6cca276c17\") " pod="openstack/placement-dcfa-account-create-update-9th7n" Dec 04 12:20:43.910127 master-0 kubenswrapper[35367]: I1204 12:20:43.910076 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-49lrh\" (UniqueName: \"kubernetes.io/projected/11479ec7-fd05-46d7-b8ef-61505345a925-kube-api-access-49lrh\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:43.914292 master-0 kubenswrapper[35367]: I1204 12:20:43.914236 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a54041bc-fcee-4c9f-b184-6c6cca276c17-operator-scripts\") pod \"placement-dcfa-account-create-update-9th7n\" (UID: \"a54041bc-fcee-4c9f-b184-6c6cca276c17\") " pod="openstack/placement-dcfa-account-create-update-9th7n" Dec 04 12:20:43.951937 master-0 kubenswrapper[35367]: I1204 12:20:43.948256 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wshcm\" (UniqueName: \"kubernetes.io/projected/a54041bc-fcee-4c9f-b184-6c6cca276c17-kube-api-access-wshcm\") pod \"placement-dcfa-account-create-update-9th7n\" (UID: \"a54041bc-fcee-4c9f-b184-6c6cca276c17\") " pod="openstack/placement-dcfa-account-create-update-9th7n" Dec 04 12:20:44.014035 master-0 kubenswrapper[35367]: I1204 12:20:44.013966 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmstm\" (UniqueName: \"kubernetes.io/projected/7491014a-fcbc-4943-9362-c3ba47079204-kube-api-access-mmstm\") pod \"7491014a-fcbc-4943-9362-c3ba47079204\" (UID: \"7491014a-fcbc-4943-9362-c3ba47079204\") " Dec 04 12:20:44.014274 master-0 kubenswrapper[35367]: I1204 12:20:44.014128 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7491014a-fcbc-4943-9362-c3ba47079204-operator-scripts\") pod \"7491014a-fcbc-4943-9362-c3ba47079204\" (UID: \"7491014a-fcbc-4943-9362-c3ba47079204\") " Dec 04 12:20:44.014635 master-0 kubenswrapper[35367]: I1204 12:20:44.014589 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c77c7cce-fe37-4ebd-b63c-67e3ecedcbed-operator-scripts\") pod \"placement-db-create-7m5q7\" (UID: \"c77c7cce-fe37-4ebd-b63c-67e3ecedcbed\") " pod="openstack/placement-db-create-7m5q7" Dec 04 12:20:44.015063 master-0 kubenswrapper[35367]: I1204 12:20:44.015027 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dkfqj\" (UniqueName: \"kubernetes.io/projected/c77c7cce-fe37-4ebd-b63c-67e3ecedcbed-kube-api-access-dkfqj\") pod \"placement-db-create-7m5q7\" (UID: \"c77c7cce-fe37-4ebd-b63c-67e3ecedcbed\") " pod="openstack/placement-db-create-7m5q7" Dec 04 12:20:44.016433 master-0 kubenswrapper[35367]: I1204 12:20:44.016338 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7491014a-fcbc-4943-9362-c3ba47079204-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "7491014a-fcbc-4943-9362-c3ba47079204" (UID: "7491014a-fcbc-4943-9362-c3ba47079204"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:44.019889 master-0 kubenswrapper[35367]: I1204 12:20:44.019578 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7491014a-fcbc-4943-9362-c3ba47079204-kube-api-access-mmstm" (OuterVolumeSpecName: "kube-api-access-mmstm") pod "7491014a-fcbc-4943-9362-c3ba47079204" (UID: "7491014a-fcbc-4943-9362-c3ba47079204"). InnerVolumeSpecName "kube-api-access-mmstm". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:20:44.020175 master-0 kubenswrapper[35367]: I1204 12:20:44.019755 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c77c7cce-fe37-4ebd-b63c-67e3ecedcbed-operator-scripts\") pod \"placement-db-create-7m5q7\" (UID: \"c77c7cce-fe37-4ebd-b63c-67e3ecedcbed\") " pod="openstack/placement-db-create-7m5q7" Dec 04 12:20:44.059354 master-0 kubenswrapper[35367]: I1204 12:20:44.058491 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkfqj\" (UniqueName: \"kubernetes.io/projected/c77c7cce-fe37-4ebd-b63c-67e3ecedcbed-kube-api-access-dkfqj\") pod \"placement-db-create-7m5q7\" (UID: \"c77c7cce-fe37-4ebd-b63c-67e3ecedcbed\") " pod="openstack/placement-db-create-7m5q7" Dec 04 12:20:44.064123 master-0 kubenswrapper[35367]: I1204 12:20:44.064071 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-db-create-srv98" Dec 04 12:20:44.075419 master-0 kubenswrapper[35367]: I1204 12:20:44.075344 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-dcfa-account-create-update-9th7n" Dec 04 12:20:44.117827 master-0 kubenswrapper[35367]: I1204 12:20:44.117649 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mmstm\" (UniqueName: \"kubernetes.io/projected/7491014a-fcbc-4943-9362-c3ba47079204-kube-api-access-mmstm\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:44.117827 master-0 kubenswrapper[35367]: I1204 12:20:44.117727 35367 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7491014a-fcbc-4943-9362-c3ba47079204-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:44.136240 master-0 kubenswrapper[35367]: I1204 12:20:44.134493 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-db-create-7m5q7" Dec 04 12:20:44.418096 master-0 kubenswrapper[35367]: I1204 12:20:44.418035 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-9f97-account-create-update-pz8hh"] Dec 04 12:20:44.424121 master-0 kubenswrapper[35367]: W1204 12:20:44.424040 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09248008_9ef2_4192_b659_99a871da63fd.slice/crio-76857eac80102217b2d8048e127f2477a2edac5f8fa71f0f249bb614871b1e2f WatchSource:0}: Error finding container 76857eac80102217b2d8048e127f2477a2edac5f8fa71f0f249bb614871b1e2f: Status 404 returned error can't find the container with id 76857eac80102217b2d8048e127f2477a2edac5f8fa71f0f249bb614871b1e2f Dec 04 12:20:44.838055 master-0 kubenswrapper[35367]: I1204 12:20:44.831373 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-db-create-srv98"] Dec 04 12:20:44.889463 master-0 kubenswrapper[35367]: I1204 12:20:44.888964 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-9mxhg" Dec 04 12:20:44.905225 master-0 kubenswrapper[35367]: I1204 12:20:44.904796 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-sm45t-config-l9gbr" event={"ID":"7ebc2c6f-6038-4a4f-9b03-79e46c3113be","Type":"ContainerStarted","Data":"d7272e51bee8f9e06cdec14f53ff7a99564d65be5814e4a7af599d830a9968ef"} Dec 04 12:20:44.907494 master-0 kubenswrapper[35367]: I1204 12:20:44.907446 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-db-create-srv98" event={"ID":"ee42dab4-d3fb-4934-be07-6098344a2c31","Type":"ContainerStarted","Data":"df5bf652835d04c28f4ac6fd748a3f751941e51092e4644561ba37cb1ecb5232"} Dec 04 12:20:44.930894 master-0 kubenswrapper[35367]: I1204 12:20:44.930821 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-7db0-account-create-update-p4fn7" Dec 04 12:20:44.931364 master-0 kubenswrapper[35367]: I1204 12:20:44.931282 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-9f97-account-create-update-pz8hh" event={"ID":"09248008-9ef2-4192-b659-99a871da63fd","Type":"ContainerStarted","Data":"76857eac80102217b2d8048e127f2477a2edac5f8fa71f0f249bb614871b1e2f"} Dec 04 12:20:44.984574 master-0 kubenswrapper[35367]: I1204 12:20:44.984480 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ovn-controller-sm45t-config-l9gbr" podStartSLOduration=3.984451054 podStartE2EDuration="3.984451054s" podCreationTimestamp="2025-12-04 12:20:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:20:44.970545965 +0000 UTC m=+1288.408607243" watchObservedRunningTime="2025-12-04 12:20:44.984451054 +0000 UTC m=+1288.422512312" Dec 04 12:20:45.036661 master-0 kubenswrapper[35367]: I1204 12:20:45.036618 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-9mxhg"] Dec 04 12:20:45.049912 master-0 kubenswrapper[35367]: I1204 12:20:45.049837 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-dcfa-account-create-update-9th7n"] Dec 04 12:20:45.054242 master-0 kubenswrapper[35367]: W1204 12:20:45.053718 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda54041bc_fcee_4c9f_b184_6c6cca276c17.slice/crio-7362422bbf6adbc8d44802ef7156209db4ee4f87a9555bb1fe9b13d62802ff85 WatchSource:0}: Error finding container 7362422bbf6adbc8d44802ef7156209db4ee4f87a9555bb1fe9b13d62802ff85: Status 404 returned error can't find the container with id 7362422bbf6adbc8d44802ef7156209db4ee4f87a9555bb1fe9b13d62802ff85 Dec 04 12:20:45.078022 master-0 kubenswrapper[35367]: I1204 12:20:45.077927 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-db-create-7m5q7"] Dec 04 12:20:45.088959 master-0 kubenswrapper[35367]: W1204 12:20:45.087255 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc77c7cce_fe37_4ebd_b63c_67e3ecedcbed.slice/crio-2cd891f3dc9f6aaa12935dfb0b0f50bf2c0e75a08b7562e2adb0f5226a9545df WatchSource:0}: Error finding container 2cd891f3dc9f6aaa12935dfb0b0f50bf2c0e75a08b7562e2adb0f5226a9545df: Status 404 returned error can't find the container with id 2cd891f3dc9f6aaa12935dfb0b0f50bf2c0e75a08b7562e2adb0f5226a9545df Dec 04 12:20:45.766024 master-0 kubenswrapper[35367]: I1204 12:20:45.765791 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ovn-controller-sm45t" Dec 04 12:20:45.950454 master-0 kubenswrapper[35367]: I1204 12:20:45.949872 35367 generic.go:334] "Generic (PLEG): container finished" podID="a54041bc-fcee-4c9f-b184-6c6cca276c17" containerID="90269fc47ea4a9a5d6d948fa8f94b79fdafc92837bd4ff17084473022f3b1549" exitCode=0 Dec 04 12:20:45.950454 master-0 kubenswrapper[35367]: I1204 12:20:45.949985 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-dcfa-account-create-update-9th7n" event={"ID":"a54041bc-fcee-4c9f-b184-6c6cca276c17","Type":"ContainerDied","Data":"90269fc47ea4a9a5d6d948fa8f94b79fdafc92837bd4ff17084473022f3b1549"} Dec 04 12:20:45.950454 master-0 kubenswrapper[35367]: I1204 12:20:45.950031 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-dcfa-account-create-update-9th7n" event={"ID":"a54041bc-fcee-4c9f-b184-6c6cca276c17","Type":"ContainerStarted","Data":"7362422bbf6adbc8d44802ef7156209db4ee4f87a9555bb1fe9b13d62802ff85"} Dec 04 12:20:45.952504 master-0 kubenswrapper[35367]: I1204 12:20:45.952422 35367 generic.go:334] "Generic (PLEG): container finished" podID="ee42dab4-d3fb-4934-be07-6098344a2c31" containerID="8bfc08a4c118de3419fa7616b42792efb5954388e9f4927a9dc287785e1a4eb1" exitCode=0 Dec 04 12:20:45.952626 master-0 kubenswrapper[35367]: I1204 12:20:45.952530 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-db-create-srv98" event={"ID":"ee42dab4-d3fb-4934-be07-6098344a2c31","Type":"ContainerDied","Data":"8bfc08a4c118de3419fa7616b42792efb5954388e9f4927a9dc287785e1a4eb1"} Dec 04 12:20:45.956467 master-0 kubenswrapper[35367]: I1204 12:20:45.956395 35367 generic.go:334] "Generic (PLEG): container finished" podID="c77c7cce-fe37-4ebd-b63c-67e3ecedcbed" containerID="0f94b85f0c59d9a842717ecd748ae9b5fc6362cbca39e00de457742c4820e9de" exitCode=0 Dec 04 12:20:45.956734 master-0 kubenswrapper[35367]: I1204 12:20:45.956499 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-db-create-7m5q7" event={"ID":"c77c7cce-fe37-4ebd-b63c-67e3ecedcbed","Type":"ContainerDied","Data":"0f94b85f0c59d9a842717ecd748ae9b5fc6362cbca39e00de457742c4820e9de"} Dec 04 12:20:45.956734 master-0 kubenswrapper[35367]: I1204 12:20:45.956537 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-db-create-7m5q7" event={"ID":"c77c7cce-fe37-4ebd-b63c-67e3ecedcbed","Type":"ContainerStarted","Data":"2cd891f3dc9f6aaa12935dfb0b0f50bf2c0e75a08b7562e2adb0f5226a9545df"} Dec 04 12:20:45.958333 master-0 kubenswrapper[35367]: I1204 12:20:45.958216 35367 generic.go:334] "Generic (PLEG): container finished" podID="09248008-9ef2-4192-b659-99a871da63fd" containerID="1ab027d7876a464e14bda26244acf59b0a582dda9985db55a4b467abc883fec5" exitCode=0 Dec 04 12:20:45.958458 master-0 kubenswrapper[35367]: I1204 12:20:45.958341 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-9f97-account-create-update-pz8hh" event={"ID":"09248008-9ef2-4192-b659-99a871da63fd","Type":"ContainerDied","Data":"1ab027d7876a464e14bda26244acf59b0a582dda9985db55a4b467abc883fec5"} Dec 04 12:20:45.961670 master-0 kubenswrapper[35367]: I1204 12:20:45.961495 35367 generic.go:334] "Generic (PLEG): container finished" podID="7ebc2c6f-6038-4a4f-9b03-79e46c3113be" containerID="d7272e51bee8f9e06cdec14f53ff7a99564d65be5814e4a7af599d830a9968ef" exitCode=0 Dec 04 12:20:45.961670 master-0 kubenswrapper[35367]: I1204 12:20:45.961579 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-sm45t-config-l9gbr" event={"ID":"7ebc2c6f-6038-4a4f-9b03-79e46c3113be","Type":"ContainerDied","Data":"d7272e51bee8f9e06cdec14f53ff7a99564d65be5814e4a7af599d830a9968ef"} Dec 04 12:20:45.961996 master-0 kubenswrapper[35367]: I1204 12:20:45.961855 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-9mxhg" podUID="24a330c4-2fb4-4f90-b4bc-4b1241c01a11" containerName="registry-server" containerID="cri-o://9ed53b245f11cb536b62fe7cc177813ad77e888d0b8d3363dff15f21147d9de2" gracePeriod=2 Dec 04 12:20:46.473486 master-0 kubenswrapper[35367]: I1204 12:20:46.473304 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-etc-swift\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") " pod="openstack/swift-storage-0" Dec 04 12:20:46.474117 master-0 kubenswrapper[35367]: E1204 12:20:46.473626 35367 projected.go:288] Couldn't get configMap openstack/swift-ring-files: configmap "swift-ring-files" not found Dec 04 12:20:46.474117 master-0 kubenswrapper[35367]: E1204 12:20:46.473650 35367 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack/swift-storage-0: configmap "swift-ring-files" not found Dec 04 12:20:46.474117 master-0 kubenswrapper[35367]: E1204 12:20:46.473721 35367 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-etc-swift podName:d421bb44-18fc-4130-baa0-32c09ace37a7 nodeName:}" failed. No retries permitted until 2025-12-04 12:21:02.473699508 +0000 UTC m=+1305.911760766 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-etc-swift") pod "swift-storage-0" (UID: "d421bb44-18fc-4130-baa0-32c09ace37a7") : configmap "swift-ring-files" not found Dec 04 12:20:46.980457 master-0 kubenswrapper[35367]: I1204 12:20:46.980392 35367 generic.go:334] "Generic (PLEG): container finished" podID="24a330c4-2fb4-4f90-b4bc-4b1241c01a11" containerID="9ed53b245f11cb536b62fe7cc177813ad77e888d0b8d3363dff15f21147d9de2" exitCode=0 Dec 04 12:20:46.980677 master-0 kubenswrapper[35367]: I1204 12:20:46.980641 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-9mxhg" event={"ID":"24a330c4-2fb4-4f90-b4bc-4b1241c01a11","Type":"ContainerDied","Data":"9ed53b245f11cb536b62fe7cc177813ad77e888d0b8d3363dff15f21147d9de2"} Dec 04 12:20:47.140545 master-0 kubenswrapper[35367]: I1204 12:20:47.140475 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-9mxhg" Dec 04 12:20:47.200024 master-0 kubenswrapper[35367]: I1204 12:20:47.199929 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/24a330c4-2fb4-4f90-b4bc-4b1241c01a11-catalog-content\") pod \"24a330c4-2fb4-4f90-b4bc-4b1241c01a11\" (UID: \"24a330c4-2fb4-4f90-b4bc-4b1241c01a11\") " Dec 04 12:20:47.200364 master-0 kubenswrapper[35367]: I1204 12:20:47.200135 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/24a330c4-2fb4-4f90-b4bc-4b1241c01a11-utilities\") pod \"24a330c4-2fb4-4f90-b4bc-4b1241c01a11\" (UID: \"24a330c4-2fb4-4f90-b4bc-4b1241c01a11\") " Dec 04 12:20:47.200364 master-0 kubenswrapper[35367]: I1204 12:20:47.200274 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crw2q\" (UniqueName: \"kubernetes.io/projected/24a330c4-2fb4-4f90-b4bc-4b1241c01a11-kube-api-access-crw2q\") pod \"24a330c4-2fb4-4f90-b4bc-4b1241c01a11\" (UID: \"24a330c4-2fb4-4f90-b4bc-4b1241c01a11\") " Dec 04 12:20:47.201425 master-0 kubenswrapper[35367]: I1204 12:20:47.200891 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a330c4-2fb4-4f90-b4bc-4b1241c01a11-utilities" (OuterVolumeSpecName: "utilities") pod "24a330c4-2fb4-4f90-b4bc-4b1241c01a11" (UID: "24a330c4-2fb4-4f90-b4bc-4b1241c01a11"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:20:47.201924 master-0 kubenswrapper[35367]: I1204 12:20:47.201892 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/24a330c4-2fb4-4f90-b4bc-4b1241c01a11-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:47.217130 master-0 kubenswrapper[35367]: I1204 12:20:47.217024 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24a330c4-2fb4-4f90-b4bc-4b1241c01a11-kube-api-access-crw2q" (OuterVolumeSpecName: "kube-api-access-crw2q") pod "24a330c4-2fb4-4f90-b4bc-4b1241c01a11" (UID: "24a330c4-2fb4-4f90-b4bc-4b1241c01a11"). InnerVolumeSpecName "kube-api-access-crw2q". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:20:47.222614 master-0 kubenswrapper[35367]: I1204 12:20:47.222401 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a330c4-2fb4-4f90-b4bc-4b1241c01a11-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "24a330c4-2fb4-4f90-b4bc-4b1241c01a11" (UID: "24a330c4-2fb4-4f90-b4bc-4b1241c01a11"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:20:47.304003 master-0 kubenswrapper[35367]: I1204 12:20:47.303927 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/24a330c4-2fb4-4f90-b4bc-4b1241c01a11-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:47.304003 master-0 kubenswrapper[35367]: I1204 12:20:47.303987 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-crw2q\" (UniqueName: \"kubernetes.io/projected/24a330c4-2fb4-4f90-b4bc-4b1241c01a11-kube-api-access-crw2q\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:47.582599 master-0 kubenswrapper[35367]: I1204 12:20:47.582542 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/placement-dcfa-account-create-update-9th7n" Dec 04 12:20:47.594895 master-0 kubenswrapper[35367]: I1204 12:20:47.594845 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ovn-northd-0" Dec 04 12:20:47.621142 master-0 kubenswrapper[35367]: I1204 12:20:47.621061 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wshcm\" (UniqueName: \"kubernetes.io/projected/a54041bc-fcee-4c9f-b184-6c6cca276c17-kube-api-access-wshcm\") pod \"a54041bc-fcee-4c9f-b184-6c6cca276c17\" (UID: \"a54041bc-fcee-4c9f-b184-6c6cca276c17\") " Dec 04 12:20:47.621142 master-0 kubenswrapper[35367]: I1204 12:20:47.621150 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a54041bc-fcee-4c9f-b184-6c6cca276c17-operator-scripts\") pod \"a54041bc-fcee-4c9f-b184-6c6cca276c17\" (UID: \"a54041bc-fcee-4c9f-b184-6c6cca276c17\") " Dec 04 12:20:47.621864 master-0 kubenswrapper[35367]: I1204 12:20:47.621769 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a54041bc-fcee-4c9f-b184-6c6cca276c17-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a54041bc-fcee-4c9f-b184-6c6cca276c17" (UID: "a54041bc-fcee-4c9f-b184-6c6cca276c17"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:47.625109 master-0 kubenswrapper[35367]: I1204 12:20:47.625047 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a54041bc-fcee-4c9f-b184-6c6cca276c17-kube-api-access-wshcm" (OuterVolumeSpecName: "kube-api-access-wshcm") pod "a54041bc-fcee-4c9f-b184-6c6cca276c17" (UID: "a54041bc-fcee-4c9f-b184-6c6cca276c17"). InnerVolumeSpecName "kube-api-access-wshcm". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:20:47.725899 master-0 kubenswrapper[35367]: I1204 12:20:47.725269 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wshcm\" (UniqueName: \"kubernetes.io/projected/a54041bc-fcee-4c9f-b184-6c6cca276c17-kube-api-access-wshcm\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:47.725899 master-0 kubenswrapper[35367]: I1204 12:20:47.725330 35367 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a54041bc-fcee-4c9f-b184-6c6cca276c17-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:47.793791 master-0 kubenswrapper[35367]: I1204 12:20:47.792153 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:47.799449 master-0 kubenswrapper[35367]: I1204 12:20:47.799383 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-9f97-account-create-update-pz8hh" Dec 04 12:20:47.808898 master-0 kubenswrapper[35367]: I1204 12:20:47.808772 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/placement-db-create-7m5q7" Dec 04 12:20:47.818682 master-0 kubenswrapper[35367]: I1204 12:20:47.818633 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-db-create-srv98" Dec 04 12:20:47.826614 master-0 kubenswrapper[35367]: I1204 12:20:47.826559 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-var-run-ovn\") pod \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " Dec 04 12:20:47.826762 master-0 kubenswrapper[35367]: I1204 12:20:47.826716 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-var-run-ovn" (OuterVolumeSpecName: "var-run-ovn") pod "7ebc2c6f-6038-4a4f-9b03-79e46c3113be" (UID: "7ebc2c6f-6038-4a4f-9b03-79e46c3113be"). InnerVolumeSpecName "var-run-ovn". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:20:47.826843 master-0 kubenswrapper[35367]: I1204 12:20:47.826789 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcccp\" (UniqueName: \"kubernetes.io/projected/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-kube-api-access-rcccp\") pod \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " Dec 04 12:20:47.826935 master-0 kubenswrapper[35367]: I1204 12:20:47.826906 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-additional-scripts\") pod \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " Dec 04 12:20:47.827012 master-0 kubenswrapper[35367]: I1204 12:20:47.826962 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-scripts\") pod \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " Dec 04 12:20:47.827059 master-0 kubenswrapper[35367]: I1204 12:20:47.827035 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-var-log-ovn\") pod \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " Dec 04 12:20:47.827270 master-0 kubenswrapper[35367]: I1204 12:20:47.827147 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-var-log-ovn" (OuterVolumeSpecName: "var-log-ovn") pod "7ebc2c6f-6038-4a4f-9b03-79e46c3113be" (UID: "7ebc2c6f-6038-4a4f-9b03-79e46c3113be"). InnerVolumeSpecName "var-log-ovn". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:20:47.827310 master-0 kubenswrapper[35367]: I1204 12:20:47.827298 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-var-run\") pod \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\" (UID: \"7ebc2c6f-6038-4a4f-9b03-79e46c3113be\") " Dec 04 12:20:47.827340 master-0 kubenswrapper[35367]: I1204 12:20:47.827314 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-additional-scripts" (OuterVolumeSpecName: "additional-scripts") pod "7ebc2c6f-6038-4a4f-9b03-79e46c3113be" (UID: "7ebc2c6f-6038-4a4f-9b03-79e46c3113be"). InnerVolumeSpecName "additional-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:47.827387 master-0 kubenswrapper[35367]: I1204 12:20:47.827365 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-var-run" (OuterVolumeSpecName: "var-run") pod "7ebc2c6f-6038-4a4f-9b03-79e46c3113be" (UID: "7ebc2c6f-6038-4a4f-9b03-79e46c3113be"). InnerVolumeSpecName "var-run". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:20:47.828085 master-0 kubenswrapper[35367]: I1204 12:20:47.828013 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-scripts" (OuterVolumeSpecName: "scripts") pod "7ebc2c6f-6038-4a4f-9b03-79e46c3113be" (UID: "7ebc2c6f-6038-4a4f-9b03-79e46c3113be"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:47.830214 master-0 kubenswrapper[35367]: I1204 12:20:47.830107 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-kube-api-access-rcccp" (OuterVolumeSpecName: "kube-api-access-rcccp") pod "7ebc2c6f-6038-4a4f-9b03-79e46c3113be" (UID: "7ebc2c6f-6038-4a4f-9b03-79e46c3113be"). InnerVolumeSpecName "kube-api-access-rcccp". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:20:47.830733 master-0 kubenswrapper[35367]: I1204 12:20:47.830692 35367 reconciler_common.go:293] "Volume detached for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-additional-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:47.830776 master-0 kubenswrapper[35367]: I1204 12:20:47.830766 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:47.830825 master-0 kubenswrapper[35367]: I1204 12:20:47.830778 35367 reconciler_common.go:293] "Volume detached for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-var-log-ovn\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:47.830825 master-0 kubenswrapper[35367]: I1204 12:20:47.830788 35367 reconciler_common.go:293] "Volume detached for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-var-run\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:47.830825 master-0 kubenswrapper[35367]: I1204 12:20:47.830797 35367 reconciler_common.go:293] "Volume detached for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-var-run-ovn\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:47.830925 master-0 kubenswrapper[35367]: I1204 12:20:47.830832 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rcccp\" (UniqueName: \"kubernetes.io/projected/7ebc2c6f-6038-4a4f-9b03-79e46c3113be-kube-api-access-rcccp\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:47.932826 master-0 kubenswrapper[35367]: I1204 12:20:47.932755 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwrmz\" (UniqueName: \"kubernetes.io/projected/09248008-9ef2-4192-b659-99a871da63fd-kube-api-access-vwrmz\") pod \"09248008-9ef2-4192-b659-99a871da63fd\" (UID: \"09248008-9ef2-4192-b659-99a871da63fd\") " Dec 04 12:20:47.932826 master-0 kubenswrapper[35367]: I1204 12:20:47.932839 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdtdq\" (UniqueName: \"kubernetes.io/projected/ee42dab4-d3fb-4934-be07-6098344a2c31-kube-api-access-pdtdq\") pod \"ee42dab4-d3fb-4934-be07-6098344a2c31\" (UID: \"ee42dab4-d3fb-4934-be07-6098344a2c31\") " Dec 04 12:20:47.933118 master-0 kubenswrapper[35367]: I1204 12:20:47.932868 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/09248008-9ef2-4192-b659-99a871da63fd-operator-scripts\") pod \"09248008-9ef2-4192-b659-99a871da63fd\" (UID: \"09248008-9ef2-4192-b659-99a871da63fd\") " Dec 04 12:20:47.933367 master-0 kubenswrapper[35367]: I1204 12:20:47.933328 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c77c7cce-fe37-4ebd-b63c-67e3ecedcbed-operator-scripts\") pod \"c77c7cce-fe37-4ebd-b63c-67e3ecedcbed\" (UID: \"c77c7cce-fe37-4ebd-b63c-67e3ecedcbed\") " Dec 04 12:20:47.933593 master-0 kubenswrapper[35367]: I1204 12:20:47.933343 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09248008-9ef2-4192-b659-99a871da63fd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "09248008-9ef2-4192-b659-99a871da63fd" (UID: "09248008-9ef2-4192-b659-99a871da63fd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:47.933642 master-0 kubenswrapper[35367]: I1204 12:20:47.933547 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee42dab4-d3fb-4934-be07-6098344a2c31-operator-scripts\") pod \"ee42dab4-d3fb-4934-be07-6098344a2c31\" (UID: \"ee42dab4-d3fb-4934-be07-6098344a2c31\") " Dec 04 12:20:47.933770 master-0 kubenswrapper[35367]: I1204 12:20:47.933739 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkfqj\" (UniqueName: \"kubernetes.io/projected/c77c7cce-fe37-4ebd-b63c-67e3ecedcbed-kube-api-access-dkfqj\") pod \"c77c7cce-fe37-4ebd-b63c-67e3ecedcbed\" (UID: \"c77c7cce-fe37-4ebd-b63c-67e3ecedcbed\") " Dec 04 12:20:47.934116 master-0 kubenswrapper[35367]: I1204 12:20:47.933793 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c77c7cce-fe37-4ebd-b63c-67e3ecedcbed-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c77c7cce-fe37-4ebd-b63c-67e3ecedcbed" (UID: "c77c7cce-fe37-4ebd-b63c-67e3ecedcbed"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:47.934483 master-0 kubenswrapper[35367]: I1204 12:20:47.934462 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee42dab4-d3fb-4934-be07-6098344a2c31-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ee42dab4-d3fb-4934-be07-6098344a2c31" (UID: "ee42dab4-d3fb-4934-be07-6098344a2c31"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:47.935138 master-0 kubenswrapper[35367]: I1204 12:20:47.935113 35367 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee42dab4-d3fb-4934-be07-6098344a2c31-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:47.935138 master-0 kubenswrapper[35367]: I1204 12:20:47.935139 35367 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/09248008-9ef2-4192-b659-99a871da63fd-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:47.935278 master-0 kubenswrapper[35367]: I1204 12:20:47.935152 35367 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c77c7cce-fe37-4ebd-b63c-67e3ecedcbed-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:47.936159 master-0 kubenswrapper[35367]: I1204 12:20:47.936103 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09248008-9ef2-4192-b659-99a871da63fd-kube-api-access-vwrmz" (OuterVolumeSpecName: "kube-api-access-vwrmz") pod "09248008-9ef2-4192-b659-99a871da63fd" (UID: "09248008-9ef2-4192-b659-99a871da63fd"). InnerVolumeSpecName "kube-api-access-vwrmz". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:20:47.937015 master-0 kubenswrapper[35367]: I1204 12:20:47.936972 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c77c7cce-fe37-4ebd-b63c-67e3ecedcbed-kube-api-access-dkfqj" (OuterVolumeSpecName: "kube-api-access-dkfqj") pod "c77c7cce-fe37-4ebd-b63c-67e3ecedcbed" (UID: "c77c7cce-fe37-4ebd-b63c-67e3ecedcbed"). InnerVolumeSpecName "kube-api-access-dkfqj". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:20:47.937015 master-0 kubenswrapper[35367]: I1204 12:20:47.937012 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee42dab4-d3fb-4934-be07-6098344a2c31-kube-api-access-pdtdq" (OuterVolumeSpecName: "kube-api-access-pdtdq") pod "ee42dab4-d3fb-4934-be07-6098344a2c31" (UID: "ee42dab4-d3fb-4934-be07-6098344a2c31"). InnerVolumeSpecName "kube-api-access-pdtdq". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:20:47.996342 master-0 kubenswrapper[35367]: I1204 12:20:47.996272 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/placement-dcfa-account-create-update-9th7n" Dec 04 12:20:47.996342 master-0 kubenswrapper[35367]: I1204 12:20:47.996276 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-dcfa-account-create-update-9th7n" event={"ID":"a54041bc-fcee-4c9f-b184-6c6cca276c17","Type":"ContainerDied","Data":"7362422bbf6adbc8d44802ef7156209db4ee4f87a9555bb1fe9b13d62802ff85"} Dec 04 12:20:47.996656 master-0 kubenswrapper[35367]: I1204 12:20:47.996402 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7362422bbf6adbc8d44802ef7156209db4ee4f87a9555bb1fe9b13d62802ff85" Dec 04 12:20:47.999657 master-0 kubenswrapper[35367]: I1204 12:20:47.999610 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-db-create-srv98" event={"ID":"ee42dab4-d3fb-4934-be07-6098344a2c31","Type":"ContainerDied","Data":"df5bf652835d04c28f4ac6fd748a3f751941e51092e4644561ba37cb1ecb5232"} Dec 04 12:20:47.999657 master-0 kubenswrapper[35367]: I1204 12:20:47.999646 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df5bf652835d04c28f4ac6fd748a3f751941e51092e4644561ba37cb1ecb5232" Dec 04 12:20:47.999756 master-0 kubenswrapper[35367]: I1204 12:20:47.999679 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-db-create-srv98" Dec 04 12:20:48.002510 master-0 kubenswrapper[35367]: I1204 12:20:48.002469 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/placement-db-create-7m5q7" Dec 04 12:20:48.002510 master-0 kubenswrapper[35367]: I1204 12:20:48.002476 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-db-create-7m5q7" event={"ID":"c77c7cce-fe37-4ebd-b63c-67e3ecedcbed","Type":"ContainerDied","Data":"2cd891f3dc9f6aaa12935dfb0b0f50bf2c0e75a08b7562e2adb0f5226a9545df"} Dec 04 12:20:48.002645 master-0 kubenswrapper[35367]: I1204 12:20:48.002538 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2cd891f3dc9f6aaa12935dfb0b0f50bf2c0e75a08b7562e2adb0f5226a9545df" Dec 04 12:20:48.004130 master-0 kubenswrapper[35367]: I1204 12:20:48.004090 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-9f97-account-create-update-pz8hh" event={"ID":"09248008-9ef2-4192-b659-99a871da63fd","Type":"ContainerDied","Data":"76857eac80102217b2d8048e127f2477a2edac5f8fa71f0f249bb614871b1e2f"} Dec 04 12:20:48.004342 master-0 kubenswrapper[35367]: I1204 12:20:48.004326 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76857eac80102217b2d8048e127f2477a2edac5f8fa71f0f249bb614871b1e2f" Dec 04 12:20:48.004449 master-0 kubenswrapper[35367]: I1204 12:20:48.004298 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-9f97-account-create-update-pz8hh" Dec 04 12:20:48.006242 master-0 kubenswrapper[35367]: I1204 12:20:48.006017 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-sm45t-config-l9gbr" event={"ID":"7ebc2c6f-6038-4a4f-9b03-79e46c3113be","Type":"ContainerDied","Data":"a084cfadf9f827c31fdd37f2c14f75bd0d7f139152e01e1724c705cadac6cd62"} Dec 04 12:20:48.006242 master-0 kubenswrapper[35367]: I1204 12:20:48.006053 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a084cfadf9f827c31fdd37f2c14f75bd0d7f139152e01e1724c705cadac6cd62" Dec 04 12:20:48.006242 master-0 kubenswrapper[35367]: I1204 12:20:48.006110 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-sm45t-config-l9gbr" Dec 04 12:20:48.008955 master-0 kubenswrapper[35367]: I1204 12:20:48.008896 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-9mxhg" event={"ID":"24a330c4-2fb4-4f90-b4bc-4b1241c01a11","Type":"ContainerDied","Data":"d05376109fc9168774cf67e06c726d8ae8eacf031137d9fd185e9f4ca66211c5"} Dec 04 12:20:48.009038 master-0 kubenswrapper[35367]: I1204 12:20:48.008967 35367 scope.go:117] "RemoveContainer" containerID="9ed53b245f11cb536b62fe7cc177813ad77e888d0b8d3363dff15f21147d9de2" Dec 04 12:20:48.009038 master-0 kubenswrapper[35367]: I1204 12:20:48.008991 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-9mxhg" Dec 04 12:20:48.043220 master-0 kubenswrapper[35367]: I1204 12:20:48.040824 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dkfqj\" (UniqueName: \"kubernetes.io/projected/c77c7cce-fe37-4ebd-b63c-67e3ecedcbed-kube-api-access-dkfqj\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:48.043220 master-0 kubenswrapper[35367]: I1204 12:20:48.040876 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vwrmz\" (UniqueName: \"kubernetes.io/projected/09248008-9ef2-4192-b659-99a871da63fd-kube-api-access-vwrmz\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:48.043220 master-0 kubenswrapper[35367]: I1204 12:20:48.040887 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pdtdq\" (UniqueName: \"kubernetes.io/projected/ee42dab4-d3fb-4934-be07-6098344a2c31-kube-api-access-pdtdq\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:48.072664 master-0 kubenswrapper[35367]: I1204 12:20:48.072611 35367 scope.go:117] "RemoveContainer" containerID="fc918dae2c4c6740ff78073428b5b9b80b7cf66adb7f61100501acbddb8fb386" Dec 04 12:20:48.109537 master-0 kubenswrapper[35367]: I1204 12:20:48.109487 35367 scope.go:117] "RemoveContainer" containerID="65f24d1ddec010883dcdf33298ea5eacd5491583bcffb78d6a5a07451f97bd81" Dec 04 12:20:48.698224 master-0 kubenswrapper[35367]: I1204 12:20:48.697270 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-9mxhg"] Dec 04 12:20:48.795693 master-0 kubenswrapper[35367]: I1204 12:20:48.795602 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-9mxhg"] Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: I1204 12:20:50.129766 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-db-sync-x46tq"] Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: E1204 12:20:50.130417 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7ebc2c6f-6038-4a4f-9b03-79e46c3113be" containerName="ovn-config" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: I1204 12:20:50.130435 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ebc2c6f-6038-4a4f-9b03-79e46c3113be" containerName="ovn-config" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: E1204 12:20:50.130463 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="09248008-9ef2-4192-b659-99a871da63fd" containerName="mariadb-account-create-update" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: I1204 12:20:50.130474 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="09248008-9ef2-4192-b659-99a871da63fd" containerName="mariadb-account-create-update" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: E1204 12:20:50.130501 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7491014a-fcbc-4943-9362-c3ba47079204" containerName="mariadb-account-create-update" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: I1204 12:20:50.130509 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="7491014a-fcbc-4943-9362-c3ba47079204" containerName="mariadb-account-create-update" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: E1204 12:20:50.130526 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="24a330c4-2fb4-4f90-b4bc-4b1241c01a11" containerName="extract-utilities" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: I1204 12:20:50.130534 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="24a330c4-2fb4-4f90-b4bc-4b1241c01a11" containerName="extract-utilities" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: E1204 12:20:50.130563 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="24a330c4-2fb4-4f90-b4bc-4b1241c01a11" containerName="registry-server" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: I1204 12:20:50.130571 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="24a330c4-2fb4-4f90-b4bc-4b1241c01a11" containerName="registry-server" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: E1204 12:20:50.130592 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="24a330c4-2fb4-4f90-b4bc-4b1241c01a11" containerName="extract-content" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: I1204 12:20:50.130600 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="24a330c4-2fb4-4f90-b4bc-4b1241c01a11" containerName="extract-content" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: E1204 12:20:50.130621 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ee42dab4-d3fb-4934-be07-6098344a2c31" containerName="mariadb-database-create" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: I1204 12:20:50.130628 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee42dab4-d3fb-4934-be07-6098344a2c31" containerName="mariadb-database-create" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: E1204 12:20:50.130640 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c77c7cce-fe37-4ebd-b63c-67e3ecedcbed" containerName="mariadb-database-create" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: I1204 12:20:50.130648 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77c7cce-fe37-4ebd-b63c-67e3ecedcbed" containerName="mariadb-database-create" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: E1204 12:20:50.130671 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a54041bc-fcee-4c9f-b184-6c6cca276c17" containerName="mariadb-account-create-update" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: I1204 12:20:50.130679 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="a54041bc-fcee-4c9f-b184-6c6cca276c17" containerName="mariadb-account-create-update" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: I1204 12:20:50.130959 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="7ebc2c6f-6038-4a4f-9b03-79e46c3113be" containerName="ovn-config" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: I1204 12:20:50.131008 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="ee42dab4-d3fb-4934-be07-6098344a2c31" containerName="mariadb-database-create" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: I1204 12:20:50.131040 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="24a330c4-2fb4-4f90-b4bc-4b1241c01a11" containerName="registry-server" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: I1204 12:20:50.131058 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="c77c7cce-fe37-4ebd-b63c-67e3ecedcbed" containerName="mariadb-database-create" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: I1204 12:20:50.131073 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="09248008-9ef2-4192-b659-99a871da63fd" containerName="mariadb-account-create-update" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: I1204 12:20:50.131084 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="7491014a-fcbc-4943-9362-c3ba47079204" containerName="mariadb-account-create-update" Dec 04 12:20:50.131888 master-0 kubenswrapper[35367]: I1204 12:20:50.131097 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="a54041bc-fcee-4c9f-b184-6c6cca276c17" containerName="mariadb-account-create-update" Dec 04 12:20:50.133748 master-0 kubenswrapper[35367]: I1204 12:20:50.132169 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-db-sync-x46tq" Dec 04 12:20:50.138224 master-0 kubenswrapper[35367]: I1204 12:20:50.138176 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-0c69e-config-data" Dec 04 12:20:50.152932 master-0 kubenswrapper[35367]: I1204 12:20:50.151152 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-db-sync-x46tq"] Dec 04 12:20:50.211441 master-0 kubenswrapper[35367]: I1204 12:20:50.211361 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/859636b6-4875-4193-b2b7-cf13e258fee9-db-sync-config-data\") pod \"glance-db-sync-x46tq\" (UID: \"859636b6-4875-4193-b2b7-cf13e258fee9\") " pod="openstack/glance-db-sync-x46tq" Dec 04 12:20:50.211935 master-0 kubenswrapper[35367]: I1204 12:20:50.211751 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/859636b6-4875-4193-b2b7-cf13e258fee9-combined-ca-bundle\") pod \"glance-db-sync-x46tq\" (UID: \"859636b6-4875-4193-b2b7-cf13e258fee9\") " pod="openstack/glance-db-sync-x46tq" Dec 04 12:20:50.212004 master-0 kubenswrapper[35367]: I1204 12:20:50.211950 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lsrg\" (UniqueName: \"kubernetes.io/projected/859636b6-4875-4193-b2b7-cf13e258fee9-kube-api-access-7lsrg\") pod \"glance-db-sync-x46tq\" (UID: \"859636b6-4875-4193-b2b7-cf13e258fee9\") " pod="openstack/glance-db-sync-x46tq" Dec 04 12:20:50.212084 master-0 kubenswrapper[35367]: I1204 12:20:50.212035 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/859636b6-4875-4193-b2b7-cf13e258fee9-config-data\") pod \"glance-db-sync-x46tq\" (UID: \"859636b6-4875-4193-b2b7-cf13e258fee9\") " pod="openstack/glance-db-sync-x46tq" Dec 04 12:20:50.316195 master-0 kubenswrapper[35367]: I1204 12:20:50.316097 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/859636b6-4875-4193-b2b7-cf13e258fee9-db-sync-config-data\") pod \"glance-db-sync-x46tq\" (UID: \"859636b6-4875-4193-b2b7-cf13e258fee9\") " pod="openstack/glance-db-sync-x46tq" Dec 04 12:20:50.316490 master-0 kubenswrapper[35367]: I1204 12:20:50.316264 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/859636b6-4875-4193-b2b7-cf13e258fee9-combined-ca-bundle\") pod \"glance-db-sync-x46tq\" (UID: \"859636b6-4875-4193-b2b7-cf13e258fee9\") " pod="openstack/glance-db-sync-x46tq" Dec 04 12:20:50.316490 master-0 kubenswrapper[35367]: I1204 12:20:50.316293 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7lsrg\" (UniqueName: \"kubernetes.io/projected/859636b6-4875-4193-b2b7-cf13e258fee9-kube-api-access-7lsrg\") pod \"glance-db-sync-x46tq\" (UID: \"859636b6-4875-4193-b2b7-cf13e258fee9\") " pod="openstack/glance-db-sync-x46tq" Dec 04 12:20:50.316490 master-0 kubenswrapper[35367]: I1204 12:20:50.316330 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/859636b6-4875-4193-b2b7-cf13e258fee9-config-data\") pod \"glance-db-sync-x46tq\" (UID: \"859636b6-4875-4193-b2b7-cf13e258fee9\") " pod="openstack/glance-db-sync-x46tq" Dec 04 12:20:50.321232 master-0 kubenswrapper[35367]: I1204 12:20:50.321132 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/859636b6-4875-4193-b2b7-cf13e258fee9-combined-ca-bundle\") pod \"glance-db-sync-x46tq\" (UID: \"859636b6-4875-4193-b2b7-cf13e258fee9\") " pod="openstack/glance-db-sync-x46tq" Dec 04 12:20:50.322824 master-0 kubenswrapper[35367]: I1204 12:20:50.322758 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/859636b6-4875-4193-b2b7-cf13e258fee9-config-data\") pod \"glance-db-sync-x46tq\" (UID: \"859636b6-4875-4193-b2b7-cf13e258fee9\") " pod="openstack/glance-db-sync-x46tq" Dec 04 12:20:50.322922 master-0 kubenswrapper[35367]: I1204 12:20:50.322876 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/859636b6-4875-4193-b2b7-cf13e258fee9-db-sync-config-data\") pod \"glance-db-sync-x46tq\" (UID: \"859636b6-4875-4193-b2b7-cf13e258fee9\") " pod="openstack/glance-db-sync-x46tq" Dec 04 12:20:50.337844 master-0 kubenswrapper[35367]: I1204 12:20:50.337761 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lsrg\" (UniqueName: \"kubernetes.io/projected/859636b6-4875-4193-b2b7-cf13e258fee9-kube-api-access-7lsrg\") pod \"glance-db-sync-x46tq\" (UID: \"859636b6-4875-4193-b2b7-cf13e258fee9\") " pod="openstack/glance-db-sync-x46tq" Dec 04 12:20:50.465751 master-0 kubenswrapper[35367]: I1204 12:20:50.465583 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-db-sync-x46tq" Dec 04 12:20:50.783223 master-0 kubenswrapper[35367]: I1204 12:20:50.779405 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24a330c4-2fb4-4f90-b4bc-4b1241c01a11" path="/var/lib/kubelet/pods/24a330c4-2fb4-4f90-b4bc-4b1241c01a11/volumes" Dec 04 12:20:50.934002 master-0 kubenswrapper[35367]: I1204 12:20:50.933915 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ovn-controller-sm45t-config-l9gbr"] Dec 04 12:20:50.950494 master-0 kubenswrapper[35367]: I1204 12:20:50.950421 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ovn-controller-sm45t-config-l9gbr"] Dec 04 12:20:51.031119 master-0 kubenswrapper[35367]: I1204 12:20:51.030962 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovn-controller-sm45t-config-vlfnh"] Dec 04 12:20:51.033412 master-0 kubenswrapper[35367]: I1204 12:20:51.032454 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:51.039616 master-0 kubenswrapper[35367]: I1204 12:20:51.039540 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovncontroller-extra-scripts" Dec 04 12:20:51.055494 master-0 kubenswrapper[35367]: I1204 12:20:51.055402 35367 generic.go:334] "Generic (PLEG): container finished" podID="c797fda6-756e-40e4-acad-2adff91e19cd" containerID="a4dc62a4f536a7bf836c76945963665a8021046538911836bf8539620958554d" exitCode=0 Dec 04 12:20:51.055616 master-0 kubenswrapper[35367]: I1204 12:20:51.055503 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-ring-rebalance-m6xdx" event={"ID":"c797fda6-756e-40e4-acad-2adff91e19cd","Type":"ContainerDied","Data":"a4dc62a4f536a7bf836c76945963665a8021046538911836bf8539620958554d"} Dec 04 12:20:51.097296 master-0 kubenswrapper[35367]: I1204 12:20:51.096384 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-sm45t-config-vlfnh"] Dec 04 12:20:51.144480 master-0 kubenswrapper[35367]: I1204 12:20:51.144425 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ab51d98-a1ac-48d8-b04d-b146e49d8927-var-run-ovn\") pod \"ovn-controller-sm45t-config-vlfnh\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:51.144914 master-0 kubenswrapper[35367]: I1204 12:20:51.144492 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxlsx\" (UniqueName: \"kubernetes.io/projected/1ab51d98-a1ac-48d8-b04d-b146e49d8927-kube-api-access-lxlsx\") pod \"ovn-controller-sm45t-config-vlfnh\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:51.144914 master-0 kubenswrapper[35367]: I1204 12:20:51.144579 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/1ab51d98-a1ac-48d8-b04d-b146e49d8927-var-run\") pod \"ovn-controller-sm45t-config-vlfnh\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:51.144914 master-0 kubenswrapper[35367]: I1204 12:20:51.144613 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1ab51d98-a1ac-48d8-b04d-b146e49d8927-scripts\") pod \"ovn-controller-sm45t-config-vlfnh\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:51.144914 master-0 kubenswrapper[35367]: I1204 12:20:51.144751 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/1ab51d98-a1ac-48d8-b04d-b146e49d8927-var-log-ovn\") pod \"ovn-controller-sm45t-config-vlfnh\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:51.144914 master-0 kubenswrapper[35367]: I1204 12:20:51.144796 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/1ab51d98-a1ac-48d8-b04d-b146e49d8927-additional-scripts\") pod \"ovn-controller-sm45t-config-vlfnh\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:51.152898 master-0 kubenswrapper[35367]: I1204 12:20:51.149533 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-db-sync-x46tq"] Dec 04 12:20:51.247186 master-0 kubenswrapper[35367]: I1204 12:20:51.247086 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/1ab51d98-a1ac-48d8-b04d-b146e49d8927-var-run\") pod \"ovn-controller-sm45t-config-vlfnh\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:51.247186 master-0 kubenswrapper[35367]: I1204 12:20:51.247185 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1ab51d98-a1ac-48d8-b04d-b146e49d8927-scripts\") pod \"ovn-controller-sm45t-config-vlfnh\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:51.247605 master-0 kubenswrapper[35367]: I1204 12:20:51.247362 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/1ab51d98-a1ac-48d8-b04d-b146e49d8927-var-log-ovn\") pod \"ovn-controller-sm45t-config-vlfnh\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:51.247605 master-0 kubenswrapper[35367]: I1204 12:20:51.247432 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/1ab51d98-a1ac-48d8-b04d-b146e49d8927-var-log-ovn\") pod \"ovn-controller-sm45t-config-vlfnh\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:51.247605 master-0 kubenswrapper[35367]: I1204 12:20:51.247434 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/1ab51d98-a1ac-48d8-b04d-b146e49d8927-additional-scripts\") pod \"ovn-controller-sm45t-config-vlfnh\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:51.247605 master-0 kubenswrapper[35367]: I1204 12:20:51.247359 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/1ab51d98-a1ac-48d8-b04d-b146e49d8927-var-run\") pod \"ovn-controller-sm45t-config-vlfnh\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:51.247915 master-0 kubenswrapper[35367]: I1204 12:20:51.247676 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ab51d98-a1ac-48d8-b04d-b146e49d8927-var-run-ovn\") pod \"ovn-controller-sm45t-config-vlfnh\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:51.247969 master-0 kubenswrapper[35367]: I1204 12:20:51.247926 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ab51d98-a1ac-48d8-b04d-b146e49d8927-var-run-ovn\") pod \"ovn-controller-sm45t-config-vlfnh\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:51.248121 master-0 kubenswrapper[35367]: I1204 12:20:51.248004 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lxlsx\" (UniqueName: \"kubernetes.io/projected/1ab51d98-a1ac-48d8-b04d-b146e49d8927-kube-api-access-lxlsx\") pod \"ovn-controller-sm45t-config-vlfnh\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:51.248515 master-0 kubenswrapper[35367]: I1204 12:20:51.248474 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/1ab51d98-a1ac-48d8-b04d-b146e49d8927-additional-scripts\") pod \"ovn-controller-sm45t-config-vlfnh\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:51.250622 master-0 kubenswrapper[35367]: I1204 12:20:51.249738 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1ab51d98-a1ac-48d8-b04d-b146e49d8927-scripts\") pod \"ovn-controller-sm45t-config-vlfnh\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:51.266046 master-0 kubenswrapper[35367]: I1204 12:20:51.265924 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxlsx\" (UniqueName: \"kubernetes.io/projected/1ab51d98-a1ac-48d8-b04d-b146e49d8927-kube-api-access-lxlsx\") pod \"ovn-controller-sm45t-config-vlfnh\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:51.360375 master-0 kubenswrapper[35367]: I1204 12:20:51.360298 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:51.653339 master-0 kubenswrapper[35367]: I1204 12:20:51.653163 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/rabbitmq-server-0" Dec 04 12:20:51.839907 master-0 kubenswrapper[35367]: I1204 12:20:51.839262 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-sm45t-config-vlfnh"] Dec 04 12:20:51.993544 master-0 kubenswrapper[35367]: I1204 12:20:51.993455 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-db-create-kscpb"] Dec 04 12:20:51.996302 master-0 kubenswrapper[35367]: I1204 12:20:51.996244 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-db-create-kscpb" Dec 04 12:20:52.013587 master-0 kubenswrapper[35367]: I1204 12:20:52.012932 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-db-create-kscpb"] Dec 04 12:20:52.088647 master-0 kubenswrapper[35367]: I1204 12:20:52.088580 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-a983-account-create-update-nkqvj"] Dec 04 12:20:52.090255 master-0 kubenswrapper[35367]: I1204 12:20:52.090208 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c7ca6286-ccd7-47ac-b456-88a38c89d97f-operator-scripts\") pod \"cinder-db-create-kscpb\" (UID: \"c7ca6286-ccd7-47ac-b456-88a38c89d97f\") " pod="openstack/cinder-db-create-kscpb" Dec 04 12:20:52.093134 master-0 kubenswrapper[35367]: I1204 12:20:52.093110 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx7kp\" (UniqueName: \"kubernetes.io/projected/c7ca6286-ccd7-47ac-b456-88a38c89d97f-kube-api-access-dx7kp\") pod \"cinder-db-create-kscpb\" (UID: \"c7ca6286-ccd7-47ac-b456-88a38c89d97f\") " pod="openstack/cinder-db-create-kscpb" Dec 04 12:20:52.111868 master-0 kubenswrapper[35367]: I1204 12:20:52.111744 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-db-sync-x46tq" event={"ID":"859636b6-4875-4193-b2b7-cf13e258fee9","Type":"ContainerStarted","Data":"2377d531fbdf7684951248873507bcb9627aec4c0992f98af1b4a1d5b9e6d49f"} Dec 04 12:20:52.111868 master-0 kubenswrapper[35367]: I1204 12:20:52.111865 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-sm45t-config-vlfnh" event={"ID":"1ab51d98-a1ac-48d8-b04d-b146e49d8927","Type":"ContainerStarted","Data":"2704cc066a8a4fe16e7ab549f4c3502365bca3c84dd603a7f92db480dff5f814"} Dec 04 12:20:52.112200 master-0 kubenswrapper[35367]: I1204 12:20:52.112008 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-a983-account-create-update-nkqvj" Dec 04 12:20:52.113861 master-0 kubenswrapper[35367]: I1204 12:20:52.113824 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-a983-account-create-update-nkqvj"] Dec 04 12:20:52.121065 master-0 kubenswrapper[35367]: I1204 12:20:52.121002 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-db-secret" Dec 04 12:20:52.218598 master-0 kubenswrapper[35367]: I1204 12:20:52.218399 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c7ca6286-ccd7-47ac-b456-88a38c89d97f-operator-scripts\") pod \"cinder-db-create-kscpb\" (UID: \"c7ca6286-ccd7-47ac-b456-88a38c89d97f\") " pod="openstack/cinder-db-create-kscpb" Dec 04 12:20:52.218598 master-0 kubenswrapper[35367]: I1204 12:20:52.218522 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dx7kp\" (UniqueName: \"kubernetes.io/projected/c7ca6286-ccd7-47ac-b456-88a38c89d97f-kube-api-access-dx7kp\") pod \"cinder-db-create-kscpb\" (UID: \"c7ca6286-ccd7-47ac-b456-88a38c89d97f\") " pod="openstack/cinder-db-create-kscpb" Dec 04 12:20:52.219321 master-0 kubenswrapper[35367]: I1204 12:20:52.218659 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grqnx\" (UniqueName: \"kubernetes.io/projected/920d85f6-b7a7-4720-83a0-84ca181a6453-kube-api-access-grqnx\") pod \"cinder-a983-account-create-update-nkqvj\" (UID: \"920d85f6-b7a7-4720-83a0-84ca181a6453\") " pod="openstack/cinder-a983-account-create-update-nkqvj" Dec 04 12:20:52.219321 master-0 kubenswrapper[35367]: I1204 12:20:52.218726 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/920d85f6-b7a7-4720-83a0-84ca181a6453-operator-scripts\") pod \"cinder-a983-account-create-update-nkqvj\" (UID: \"920d85f6-b7a7-4720-83a0-84ca181a6453\") " pod="openstack/cinder-a983-account-create-update-nkqvj" Dec 04 12:20:52.219733 master-0 kubenswrapper[35367]: I1204 12:20:52.219684 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c7ca6286-ccd7-47ac-b456-88a38c89d97f-operator-scripts\") pod \"cinder-db-create-kscpb\" (UID: \"c7ca6286-ccd7-47ac-b456-88a38c89d97f\") " pod="openstack/cinder-db-create-kscpb" Dec 04 12:20:52.240223 master-0 kubenswrapper[35367]: I1204 12:20:52.239451 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/neutron-db-create-46v6w"] Dec 04 12:20:52.244875 master-0 kubenswrapper[35367]: I1204 12:20:52.241265 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-db-create-46v6w" Dec 04 12:20:52.275929 master-0 kubenswrapper[35367]: I1204 12:20:52.273964 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx7kp\" (UniqueName: \"kubernetes.io/projected/c7ca6286-ccd7-47ac-b456-88a38c89d97f-kube-api-access-dx7kp\") pod \"cinder-db-create-kscpb\" (UID: \"c7ca6286-ccd7-47ac-b456-88a38c89d97f\") " pod="openstack/cinder-db-create-kscpb" Dec 04 12:20:52.285947 master-0 kubenswrapper[35367]: I1204 12:20:52.285047 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-db-create-46v6w"] Dec 04 12:20:52.322751 master-0 kubenswrapper[35367]: I1204 12:20:52.322515 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-grqnx\" (UniqueName: \"kubernetes.io/projected/920d85f6-b7a7-4720-83a0-84ca181a6453-kube-api-access-grqnx\") pod \"cinder-a983-account-create-update-nkqvj\" (UID: \"920d85f6-b7a7-4720-83a0-84ca181a6453\") " pod="openstack/cinder-a983-account-create-update-nkqvj" Dec 04 12:20:52.322751 master-0 kubenswrapper[35367]: I1204 12:20:52.322594 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/920d85f6-b7a7-4720-83a0-84ca181a6453-operator-scripts\") pod \"cinder-a983-account-create-update-nkqvj\" (UID: \"920d85f6-b7a7-4720-83a0-84ca181a6453\") " pod="openstack/cinder-a983-account-create-update-nkqvj" Dec 04 12:20:52.324426 master-0 kubenswrapper[35367]: I1204 12:20:52.323190 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7e577446-b134-4beb-81b4-4a3e355c3b26-operator-scripts\") pod \"neutron-db-create-46v6w\" (UID: \"7e577446-b134-4beb-81b4-4a3e355c3b26\") " pod="openstack/neutron-db-create-46v6w" Dec 04 12:20:52.324426 master-0 kubenswrapper[35367]: I1204 12:20:52.323688 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/920d85f6-b7a7-4720-83a0-84ca181a6453-operator-scripts\") pod \"cinder-a983-account-create-update-nkqvj\" (UID: \"920d85f6-b7a7-4720-83a0-84ca181a6453\") " pod="openstack/cinder-a983-account-create-update-nkqvj" Dec 04 12:20:52.324426 master-0 kubenswrapper[35367]: I1204 12:20:52.323737 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsn6s\" (UniqueName: \"kubernetes.io/projected/7e577446-b134-4beb-81b4-4a3e355c3b26-kube-api-access-bsn6s\") pod \"neutron-db-create-46v6w\" (UID: \"7e577446-b134-4beb-81b4-4a3e355c3b26\") " pod="openstack/neutron-db-create-46v6w" Dec 04 12:20:52.350396 master-0 kubenswrapper[35367]: I1204 12:20:52.350272 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-grqnx\" (UniqueName: \"kubernetes.io/projected/920d85f6-b7a7-4720-83a0-84ca181a6453-kube-api-access-grqnx\") pod \"cinder-a983-account-create-update-nkqvj\" (UID: \"920d85f6-b7a7-4720-83a0-84ca181a6453\") " pod="openstack/cinder-a983-account-create-update-nkqvj" Dec 04 12:20:52.371898 master-0 kubenswrapper[35367]: I1204 12:20:52.370273 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/neutron-c8b4-account-create-update-wrmr2"] Dec 04 12:20:52.376941 master-0 kubenswrapper[35367]: I1204 12:20:52.373116 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-c8b4-account-create-update-wrmr2" Dec 04 12:20:52.377699 master-0 kubenswrapper[35367]: I1204 12:20:52.377647 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"neutron-db-secret" Dec 04 12:20:52.384369 master-0 kubenswrapper[35367]: I1204 12:20:52.384089 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-c8b4-account-create-update-wrmr2"] Dec 04 12:20:52.399127 master-0 kubenswrapper[35367]: I1204 12:20:52.399030 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-db-create-kscpb" Dec 04 12:20:52.436878 master-0 kubenswrapper[35367]: I1204 12:20:52.436827 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c609368c-2cc0-4322-b1f0-00abab864e02-operator-scripts\") pod \"neutron-c8b4-account-create-update-wrmr2\" (UID: \"c609368c-2cc0-4322-b1f0-00abab864e02\") " pod="openstack/neutron-c8b4-account-create-update-wrmr2" Dec 04 12:20:52.437004 master-0 kubenswrapper[35367]: I1204 12:20:52.436936 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7e577446-b134-4beb-81b4-4a3e355c3b26-operator-scripts\") pod \"neutron-db-create-46v6w\" (UID: \"7e577446-b134-4beb-81b4-4a3e355c3b26\") " pod="openstack/neutron-db-create-46v6w" Dec 04 12:20:52.437004 master-0 kubenswrapper[35367]: I1204 12:20:52.436973 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4t4d\" (UniqueName: \"kubernetes.io/projected/c609368c-2cc0-4322-b1f0-00abab864e02-kube-api-access-d4t4d\") pod \"neutron-c8b4-account-create-update-wrmr2\" (UID: \"c609368c-2cc0-4322-b1f0-00abab864e02\") " pod="openstack/neutron-c8b4-account-create-update-wrmr2" Dec 04 12:20:52.437065 master-0 kubenswrapper[35367]: I1204 12:20:52.437017 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bsn6s\" (UniqueName: \"kubernetes.io/projected/7e577446-b134-4beb-81b4-4a3e355c3b26-kube-api-access-bsn6s\") pod \"neutron-db-create-46v6w\" (UID: \"7e577446-b134-4beb-81b4-4a3e355c3b26\") " pod="openstack/neutron-db-create-46v6w" Dec 04 12:20:52.438229 master-0 kubenswrapper[35367]: I1204 12:20:52.438183 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7e577446-b134-4beb-81b4-4a3e355c3b26-operator-scripts\") pod \"neutron-db-create-46v6w\" (UID: \"7e577446-b134-4beb-81b4-4a3e355c3b26\") " pod="openstack/neutron-db-create-46v6w" Dec 04 12:20:52.453303 master-0 kubenswrapper[35367]: I1204 12:20:52.453132 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-a983-account-create-update-nkqvj" Dec 04 12:20:52.459387 master-0 kubenswrapper[35367]: I1204 12:20:52.459344 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsn6s\" (UniqueName: \"kubernetes.io/projected/7e577446-b134-4beb-81b4-4a3e355c3b26-kube-api-access-bsn6s\") pod \"neutron-db-create-46v6w\" (UID: \"7e577446-b134-4beb-81b4-4a3e355c3b26\") " pod="openstack/neutron-db-create-46v6w" Dec 04 12:20:52.540691 master-0 kubenswrapper[35367]: I1204 12:20:52.539997 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c609368c-2cc0-4322-b1f0-00abab864e02-operator-scripts\") pod \"neutron-c8b4-account-create-update-wrmr2\" (UID: \"c609368c-2cc0-4322-b1f0-00abab864e02\") " pod="openstack/neutron-c8b4-account-create-update-wrmr2" Dec 04 12:20:52.540691 master-0 kubenswrapper[35367]: I1204 12:20:52.540520 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d4t4d\" (UniqueName: \"kubernetes.io/projected/c609368c-2cc0-4322-b1f0-00abab864e02-kube-api-access-d4t4d\") pod \"neutron-c8b4-account-create-update-wrmr2\" (UID: \"c609368c-2cc0-4322-b1f0-00abab864e02\") " pod="openstack/neutron-c8b4-account-create-update-wrmr2" Dec 04 12:20:52.542416 master-0 kubenswrapper[35367]: I1204 12:20:52.541365 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c609368c-2cc0-4322-b1f0-00abab864e02-operator-scripts\") pod \"neutron-c8b4-account-create-update-wrmr2\" (UID: \"c609368c-2cc0-4322-b1f0-00abab864e02\") " pod="openstack/neutron-c8b4-account-create-update-wrmr2" Dec 04 12:20:52.565992 master-0 kubenswrapper[35367]: I1204 12:20:52.565878 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4t4d\" (UniqueName: \"kubernetes.io/projected/c609368c-2cc0-4322-b1f0-00abab864e02-kube-api-access-d4t4d\") pod \"neutron-c8b4-account-create-update-wrmr2\" (UID: \"c609368c-2cc0-4322-b1f0-00abab864e02\") " pod="openstack/neutron-c8b4-account-create-update-wrmr2" Dec 04 12:20:52.655374 master-0 kubenswrapper[35367]: I1204 12:20:52.655308 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:52.740885 master-0 kubenswrapper[35367]: I1204 12:20:52.740425 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-db-create-46v6w" Dec 04 12:20:52.760309 master-0 kubenswrapper[35367]: I1204 12:20:52.752051 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kb4tj\" (UniqueName: \"kubernetes.io/projected/c797fda6-756e-40e4-acad-2adff91e19cd-kube-api-access-kb4tj\") pod \"c797fda6-756e-40e4-acad-2adff91e19cd\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " Dec 04 12:20:52.760309 master-0 kubenswrapper[35367]: I1204 12:20:52.752311 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/c797fda6-756e-40e4-acad-2adff91e19cd-swiftconf\") pod \"c797fda6-756e-40e4-acad-2adff91e19cd\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " Dec 04 12:20:52.760309 master-0 kubenswrapper[35367]: I1204 12:20:52.752464 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/c797fda6-756e-40e4-acad-2adff91e19cd-ring-data-devices\") pod \"c797fda6-756e-40e4-acad-2adff91e19cd\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " Dec 04 12:20:52.760309 master-0 kubenswrapper[35367]: I1204 12:20:52.752514 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c797fda6-756e-40e4-acad-2adff91e19cd-combined-ca-bundle\") pod \"c797fda6-756e-40e4-acad-2adff91e19cd\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " Dec 04 12:20:52.760309 master-0 kubenswrapper[35367]: I1204 12:20:52.752565 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/c797fda6-756e-40e4-acad-2adff91e19cd-etc-swift\") pod \"c797fda6-756e-40e4-acad-2adff91e19cd\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " Dec 04 12:20:52.760309 master-0 kubenswrapper[35367]: I1204 12:20:52.752595 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/c797fda6-756e-40e4-acad-2adff91e19cd-dispersionconf\") pod \"c797fda6-756e-40e4-acad-2adff91e19cd\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " Dec 04 12:20:52.760309 master-0 kubenswrapper[35367]: I1204 12:20:52.752649 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c797fda6-756e-40e4-acad-2adff91e19cd-scripts\") pod \"c797fda6-756e-40e4-acad-2adff91e19cd\" (UID: \"c797fda6-756e-40e4-acad-2adff91e19cd\") " Dec 04 12:20:52.762438 master-0 kubenswrapper[35367]: I1204 12:20:52.762368 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c797fda6-756e-40e4-acad-2adff91e19cd-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "c797fda6-756e-40e4-acad-2adff91e19cd" (UID: "c797fda6-756e-40e4-acad-2adff91e19cd"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:52.763720 master-0 kubenswrapper[35367]: I1204 12:20:52.763671 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c797fda6-756e-40e4-acad-2adff91e19cd-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "c797fda6-756e-40e4-acad-2adff91e19cd" (UID: "c797fda6-756e-40e4-acad-2adff91e19cd"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:20:52.780192 master-0 kubenswrapper[35367]: I1204 12:20:52.780059 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c797fda6-756e-40e4-acad-2adff91e19cd-kube-api-access-kb4tj" (OuterVolumeSpecName: "kube-api-access-kb4tj") pod "c797fda6-756e-40e4-acad-2adff91e19cd" (UID: "c797fda6-756e-40e4-acad-2adff91e19cd"). InnerVolumeSpecName "kube-api-access-kb4tj". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:20:52.813600 master-0 kubenswrapper[35367]: I1204 12:20:52.813512 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c797fda6-756e-40e4-acad-2adff91e19cd-scripts" (OuterVolumeSpecName: "scripts") pod "c797fda6-756e-40e4-acad-2adff91e19cd" (UID: "c797fda6-756e-40e4-acad-2adff91e19cd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:52.830756 master-0 kubenswrapper[35367]: I1204 12:20:52.828879 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ebc2c6f-6038-4a4f-9b03-79e46c3113be" path="/var/lib/kubelet/pods/7ebc2c6f-6038-4a4f-9b03-79e46c3113be/volumes" Dec 04 12:20:52.834129 master-0 kubenswrapper[35367]: I1204 12:20:52.834060 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c797fda6-756e-40e4-acad-2adff91e19cd-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "c797fda6-756e-40e4-acad-2adff91e19cd" (UID: "c797fda6-756e-40e4-acad-2adff91e19cd"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:20:52.872943 master-0 kubenswrapper[35367]: I1204 12:20:52.872073 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c797fda6-756e-40e4-acad-2adff91e19cd-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "c797fda6-756e-40e4-acad-2adff91e19cd" (UID: "c797fda6-756e-40e4-acad-2adff91e19cd"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:20:52.887761 master-0 kubenswrapper[35367]: I1204 12:20:52.882767 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-c8b4-account-create-update-wrmr2" Dec 04 12:20:52.887761 master-0 kubenswrapper[35367]: I1204 12:20:52.883167 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kb4tj\" (UniqueName: \"kubernetes.io/projected/c797fda6-756e-40e4-acad-2adff91e19cd-kube-api-access-kb4tj\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:52.912834 master-0 kubenswrapper[35367]: I1204 12:20:52.900479 35367 reconciler_common.go:293] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/c797fda6-756e-40e4-acad-2adff91e19cd-swiftconf\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:52.912834 master-0 kubenswrapper[35367]: I1204 12:20:52.901584 35367 reconciler_common.go:293] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/c797fda6-756e-40e4-acad-2adff91e19cd-ring-data-devices\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:52.912834 master-0 kubenswrapper[35367]: I1204 12:20:52.901607 35367 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/c797fda6-756e-40e4-acad-2adff91e19cd-etc-swift\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:52.912834 master-0 kubenswrapper[35367]: I1204 12:20:52.901620 35367 reconciler_common.go:293] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/c797fda6-756e-40e4-acad-2adff91e19cd-dispersionconf\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:52.912834 master-0 kubenswrapper[35367]: I1204 12:20:52.901633 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c797fda6-756e-40e4-acad-2adff91e19cd-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:52.912834 master-0 kubenswrapper[35367]: I1204 12:20:52.912024 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c797fda6-756e-40e4-acad-2adff91e19cd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c797fda6-756e-40e4-acad-2adff91e19cd" (UID: "c797fda6-756e-40e4-acad-2adff91e19cd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:20:53.012209 master-0 kubenswrapper[35367]: I1204 12:20:53.007159 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c797fda6-756e-40e4-acad-2adff91e19cd-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:53.040600 master-0 kubenswrapper[35367]: I1204 12:20:53.040546 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-a983-account-create-update-nkqvj"] Dec 04 12:20:53.047076 master-0 kubenswrapper[35367]: W1204 12:20:53.047003 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod920d85f6_b7a7_4720_83a0_84ca181a6453.slice/crio-a0b2ab07a3fc68b295d3c2660b1cbc28e62bbf2067e69cd0f1eed660e31487cb WatchSource:0}: Error finding container a0b2ab07a3fc68b295d3c2660b1cbc28e62bbf2067e69cd0f1eed660e31487cb: Status 404 returned error can't find the container with id a0b2ab07a3fc68b295d3c2660b1cbc28e62bbf2067e69cd0f1eed660e31487cb Dec 04 12:20:53.130987 master-0 kubenswrapper[35367]: I1204 12:20:53.127690 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/swift-ring-rebalance-m6xdx" Dec 04 12:20:53.130987 master-0 kubenswrapper[35367]: I1204 12:20:53.127704 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-ring-rebalance-m6xdx" event={"ID":"c797fda6-756e-40e4-acad-2adff91e19cd","Type":"ContainerDied","Data":"b517f1b018c0bb3b34614900b5d24a3cdca65b3ec18247b1f97095ed2fd02076"} Dec 04 12:20:53.130987 master-0 kubenswrapper[35367]: I1204 12:20:53.127779 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b517f1b018c0bb3b34614900b5d24a3cdca65b3ec18247b1f97095ed2fd02076" Dec 04 12:20:53.133517 master-0 kubenswrapper[35367]: I1204 12:20:53.133263 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-a983-account-create-update-nkqvj" event={"ID":"920d85f6-b7a7-4720-83a0-84ca181a6453","Type":"ContainerStarted","Data":"a0b2ab07a3fc68b295d3c2660b1cbc28e62bbf2067e69cd0f1eed660e31487cb"} Dec 04 12:20:53.150274 master-0 kubenswrapper[35367]: I1204 12:20:53.150197 35367 generic.go:334] "Generic (PLEG): container finished" podID="1ab51d98-a1ac-48d8-b04d-b146e49d8927" containerID="3e2eb8b6c263a899f926c3170cf29da97564f0ab4b819fd34f371b9acff42037" exitCode=0 Dec 04 12:20:53.150274 master-0 kubenswrapper[35367]: I1204 12:20:53.150276 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-sm45t-config-vlfnh" event={"ID":"1ab51d98-a1ac-48d8-b04d-b146e49d8927","Type":"ContainerDied","Data":"3e2eb8b6c263a899f926c3170cf29da97564f0ab4b819fd34f371b9acff42037"} Dec 04 12:20:53.274554 master-0 kubenswrapper[35367]: I1204 12:20:53.274505 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-db-create-kscpb"] Dec 04 12:20:53.518099 master-0 kubenswrapper[35367]: I1204 12:20:53.517927 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-db-create-46v6w"] Dec 04 12:20:53.652009 master-0 kubenswrapper[35367]: I1204 12:20:53.651908 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-c8b4-account-create-update-wrmr2"] Dec 04 12:20:53.969419 master-0 kubenswrapper[35367]: I1204 12:20:53.969316 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/keystone-db-sync-fh8h7"] Dec 04 12:20:53.974504 master-0 kubenswrapper[35367]: E1204 12:20:53.970422 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c797fda6-756e-40e4-acad-2adff91e19cd" containerName="swift-ring-rebalance" Dec 04 12:20:53.974504 master-0 kubenswrapper[35367]: I1204 12:20:53.970454 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="c797fda6-756e-40e4-acad-2adff91e19cd" containerName="swift-ring-rebalance" Dec 04 12:20:53.974504 master-0 kubenswrapper[35367]: I1204 12:20:53.970795 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="c797fda6-756e-40e4-acad-2adff91e19cd" containerName="swift-ring-rebalance" Dec 04 12:20:53.974504 master-0 kubenswrapper[35367]: I1204 12:20:53.971752 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-db-sync-fh8h7" Dec 04 12:20:53.982683 master-0 kubenswrapper[35367]: I1204 12:20:53.979681 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone" Dec 04 12:20:53.982683 master-0 kubenswrapper[35367]: I1204 12:20:53.979842 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone-config-data" Dec 04 12:20:53.982683 master-0 kubenswrapper[35367]: I1204 12:20:53.979963 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone-scripts" Dec 04 12:20:53.994879 master-0 kubenswrapper[35367]: I1204 12:20:53.993131 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-db-sync-fh8h7"] Dec 04 12:20:54.051123 master-0 kubenswrapper[35367]: I1204 12:20:54.051032 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ee232a5-994b-4ae0-8392-c4d5eed37c1a-combined-ca-bundle\") pod \"keystone-db-sync-fh8h7\" (UID: \"3ee232a5-994b-4ae0-8392-c4d5eed37c1a\") " pod="openstack/keystone-db-sync-fh8h7" Dec 04 12:20:54.051353 master-0 kubenswrapper[35367]: I1204 12:20:54.051183 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ee232a5-994b-4ae0-8392-c4d5eed37c1a-config-data\") pod \"keystone-db-sync-fh8h7\" (UID: \"3ee232a5-994b-4ae0-8392-c4d5eed37c1a\") " pod="openstack/keystone-db-sync-fh8h7" Dec 04 12:20:54.051353 master-0 kubenswrapper[35367]: I1204 12:20:54.051249 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdmq6\" (UniqueName: \"kubernetes.io/projected/3ee232a5-994b-4ae0-8392-c4d5eed37c1a-kube-api-access-sdmq6\") pod \"keystone-db-sync-fh8h7\" (UID: \"3ee232a5-994b-4ae0-8392-c4d5eed37c1a\") " pod="openstack/keystone-db-sync-fh8h7" Dec 04 12:20:54.153211 master-0 kubenswrapper[35367]: I1204 12:20:54.153137 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ee232a5-994b-4ae0-8392-c4d5eed37c1a-config-data\") pod \"keystone-db-sync-fh8h7\" (UID: \"3ee232a5-994b-4ae0-8392-c4d5eed37c1a\") " pod="openstack/keystone-db-sync-fh8h7" Dec 04 12:20:54.153443 master-0 kubenswrapper[35367]: I1204 12:20:54.153243 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sdmq6\" (UniqueName: \"kubernetes.io/projected/3ee232a5-994b-4ae0-8392-c4d5eed37c1a-kube-api-access-sdmq6\") pod \"keystone-db-sync-fh8h7\" (UID: \"3ee232a5-994b-4ae0-8392-c4d5eed37c1a\") " pod="openstack/keystone-db-sync-fh8h7" Dec 04 12:20:54.153443 master-0 kubenswrapper[35367]: I1204 12:20:54.153423 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ee232a5-994b-4ae0-8392-c4d5eed37c1a-combined-ca-bundle\") pod \"keystone-db-sync-fh8h7\" (UID: \"3ee232a5-994b-4ae0-8392-c4d5eed37c1a\") " pod="openstack/keystone-db-sync-fh8h7" Dec 04 12:20:54.161012 master-0 kubenswrapper[35367]: I1204 12:20:54.160962 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ee232a5-994b-4ae0-8392-c4d5eed37c1a-config-data\") pod \"keystone-db-sync-fh8h7\" (UID: \"3ee232a5-994b-4ae0-8392-c4d5eed37c1a\") " pod="openstack/keystone-db-sync-fh8h7" Dec 04 12:20:54.161253 master-0 kubenswrapper[35367]: I1204 12:20:54.161079 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ee232a5-994b-4ae0-8392-c4d5eed37c1a-combined-ca-bundle\") pod \"keystone-db-sync-fh8h7\" (UID: \"3ee232a5-994b-4ae0-8392-c4d5eed37c1a\") " pod="openstack/keystone-db-sync-fh8h7" Dec 04 12:20:54.169705 master-0 kubenswrapper[35367]: I1204 12:20:54.169624 35367 generic.go:334] "Generic (PLEG): container finished" podID="7e577446-b134-4beb-81b4-4a3e355c3b26" containerID="fc051b6c0765c8067d5af4af36530ed93e67e7824dbe051e5c5c919570ed57e7" exitCode=0 Dec 04 12:20:54.169951 master-0 kubenswrapper[35367]: I1204 12:20:54.169871 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-db-create-46v6w" event={"ID":"7e577446-b134-4beb-81b4-4a3e355c3b26","Type":"ContainerDied","Data":"fc051b6c0765c8067d5af4af36530ed93e67e7824dbe051e5c5c919570ed57e7"} Dec 04 12:20:54.169951 master-0 kubenswrapper[35367]: I1204 12:20:54.169907 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-db-create-46v6w" event={"ID":"7e577446-b134-4beb-81b4-4a3e355c3b26","Type":"ContainerStarted","Data":"070dc1e5c6f6b18f73e15c751e540072e8929663501ec97c2491637066b8730e"} Dec 04 12:20:54.172451 master-0 kubenswrapper[35367]: I1204 12:20:54.172041 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdmq6\" (UniqueName: \"kubernetes.io/projected/3ee232a5-994b-4ae0-8392-c4d5eed37c1a-kube-api-access-sdmq6\") pod \"keystone-db-sync-fh8h7\" (UID: \"3ee232a5-994b-4ae0-8392-c4d5eed37c1a\") " pod="openstack/keystone-db-sync-fh8h7" Dec 04 12:20:54.173426 master-0 kubenswrapper[35367]: I1204 12:20:54.173356 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-c8b4-account-create-update-wrmr2" event={"ID":"c609368c-2cc0-4322-b1f0-00abab864e02","Type":"ContainerStarted","Data":"2bf3a90031e21a4b6c891815c35bfe71bd45fd1d2f5acbd5c3cd3282a00789fe"} Dec 04 12:20:54.173426 master-0 kubenswrapper[35367]: I1204 12:20:54.173400 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-c8b4-account-create-update-wrmr2" event={"ID":"c609368c-2cc0-4322-b1f0-00abab864e02","Type":"ContainerStarted","Data":"53282b352b1beae6cf4e4ace9ace46d9829294dfa893982d029e5c53856f981b"} Dec 04 12:20:54.175910 master-0 kubenswrapper[35367]: I1204 12:20:54.175845 35367 generic.go:334] "Generic (PLEG): container finished" podID="920d85f6-b7a7-4720-83a0-84ca181a6453" containerID="ab69daabdf92b99dfde56873a3087f3b7378f9d8f0a94de328a60c3eef977ae4" exitCode=0 Dec 04 12:20:54.176011 master-0 kubenswrapper[35367]: I1204 12:20:54.175945 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-a983-account-create-update-nkqvj" event={"ID":"920d85f6-b7a7-4720-83a0-84ca181a6453","Type":"ContainerDied","Data":"ab69daabdf92b99dfde56873a3087f3b7378f9d8f0a94de328a60c3eef977ae4"} Dec 04 12:20:54.177564 master-0 kubenswrapper[35367]: I1204 12:20:54.177458 35367 generic.go:334] "Generic (PLEG): container finished" podID="c7ca6286-ccd7-47ac-b456-88a38c89d97f" containerID="8e5a50104e0acaa557d864d8ea8e8d20e830b7a400e46badb0410d9fb9ad31c9" exitCode=0 Dec 04 12:20:54.178018 master-0 kubenswrapper[35367]: I1204 12:20:54.177819 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-db-create-kscpb" event={"ID":"c7ca6286-ccd7-47ac-b456-88a38c89d97f","Type":"ContainerDied","Data":"8e5a50104e0acaa557d864d8ea8e8d20e830b7a400e46badb0410d9fb9ad31c9"} Dec 04 12:20:54.178018 master-0 kubenswrapper[35367]: I1204 12:20:54.177846 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-db-create-kscpb" event={"ID":"c7ca6286-ccd7-47ac-b456-88a38c89d97f","Type":"ContainerStarted","Data":"fa3fc849d606ba4b941b9ada9710b2c00b51ee41dcc51db7cd4676a02dba5b6a"} Dec 04 12:20:54.296975 master-0 kubenswrapper[35367]: I1204 12:20:54.296503 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-db-sync-fh8h7" Dec 04 12:20:54.299327 master-0 kubenswrapper[35367]: I1204 12:20:54.297793 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/neutron-c8b4-account-create-update-wrmr2" podStartSLOduration=2.297758239 podStartE2EDuration="2.297758239s" podCreationTimestamp="2025-12-04 12:20:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:20:54.279822083 +0000 UTC m=+1297.717883351" watchObservedRunningTime="2025-12-04 12:20:54.297758239 +0000 UTC m=+1297.735819497" Dec 04 12:20:54.683834 master-0 kubenswrapper[35367]: I1204 12:20:54.683720 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:54.785686 master-0 kubenswrapper[35367]: I1204 12:20:54.784585 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxlsx\" (UniqueName: \"kubernetes.io/projected/1ab51d98-a1ac-48d8-b04d-b146e49d8927-kube-api-access-lxlsx\") pod \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " Dec 04 12:20:54.785686 master-0 kubenswrapper[35367]: I1204 12:20:54.784760 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1ab51d98-a1ac-48d8-b04d-b146e49d8927-scripts\") pod \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " Dec 04 12:20:54.785979 master-0 kubenswrapper[35367]: I1204 12:20:54.785768 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ab51d98-a1ac-48d8-b04d-b146e49d8927-var-run-ovn\") pod \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " Dec 04 12:20:54.785979 master-0 kubenswrapper[35367]: I1204 12:20:54.785847 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1ab51d98-a1ac-48d8-b04d-b146e49d8927-var-run-ovn" (OuterVolumeSpecName: "var-run-ovn") pod "1ab51d98-a1ac-48d8-b04d-b146e49d8927" (UID: "1ab51d98-a1ac-48d8-b04d-b146e49d8927"). InnerVolumeSpecName "var-run-ovn". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:20:54.786057 master-0 kubenswrapper[35367]: I1204 12:20:54.786001 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/1ab51d98-a1ac-48d8-b04d-b146e49d8927-var-log-ovn\") pod \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " Dec 04 12:20:54.786156 master-0 kubenswrapper[35367]: I1204 12:20:54.786127 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/1ab51d98-a1ac-48d8-b04d-b146e49d8927-additional-scripts\") pod \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " Dec 04 12:20:54.786262 master-0 kubenswrapper[35367]: I1204 12:20:54.786239 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/1ab51d98-a1ac-48d8-b04d-b146e49d8927-var-run\") pod \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\" (UID: \"1ab51d98-a1ac-48d8-b04d-b146e49d8927\") " Dec 04 12:20:54.786589 master-0 kubenswrapper[35367]: I1204 12:20:54.786552 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ab51d98-a1ac-48d8-b04d-b146e49d8927-scripts" (OuterVolumeSpecName: "scripts") pod "1ab51d98-a1ac-48d8-b04d-b146e49d8927" (UID: "1ab51d98-a1ac-48d8-b04d-b146e49d8927"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:54.786647 master-0 kubenswrapper[35367]: I1204 12:20:54.786601 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1ab51d98-a1ac-48d8-b04d-b146e49d8927-var-log-ovn" (OuterVolumeSpecName: "var-log-ovn") pod "1ab51d98-a1ac-48d8-b04d-b146e49d8927" (UID: "1ab51d98-a1ac-48d8-b04d-b146e49d8927"). InnerVolumeSpecName "var-log-ovn". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:20:54.786978 master-0 kubenswrapper[35367]: I1204 12:20:54.786884 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1ab51d98-a1ac-48d8-b04d-b146e49d8927-var-run" (OuterVolumeSpecName: "var-run") pod "1ab51d98-a1ac-48d8-b04d-b146e49d8927" (UID: "1ab51d98-a1ac-48d8-b04d-b146e49d8927"). InnerVolumeSpecName "var-run". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:20:54.787263 master-0 kubenswrapper[35367]: I1204 12:20:54.787230 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ab51d98-a1ac-48d8-b04d-b146e49d8927-additional-scripts" (OuterVolumeSpecName: "additional-scripts") pod "1ab51d98-a1ac-48d8-b04d-b146e49d8927" (UID: "1ab51d98-a1ac-48d8-b04d-b146e49d8927"). InnerVolumeSpecName "additional-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:54.788842 master-0 kubenswrapper[35367]: I1204 12:20:54.788767 35367 reconciler_common.go:293] "Volume detached for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/1ab51d98-a1ac-48d8-b04d-b146e49d8927-var-run\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:54.788956 master-0 kubenswrapper[35367]: I1204 12:20:54.788847 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1ab51d98-a1ac-48d8-b04d-b146e49d8927-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:54.788956 master-0 kubenswrapper[35367]: I1204 12:20:54.788867 35367 reconciler_common.go:293] "Volume detached for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ab51d98-a1ac-48d8-b04d-b146e49d8927-var-run-ovn\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:54.788956 master-0 kubenswrapper[35367]: I1204 12:20:54.788883 35367 reconciler_common.go:293] "Volume detached for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/1ab51d98-a1ac-48d8-b04d-b146e49d8927-var-log-ovn\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:54.788956 master-0 kubenswrapper[35367]: I1204 12:20:54.788899 35367 reconciler_common.go:293] "Volume detached for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/1ab51d98-a1ac-48d8-b04d-b146e49d8927-additional-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:54.789350 master-0 kubenswrapper[35367]: I1204 12:20:54.789297 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ab51d98-a1ac-48d8-b04d-b146e49d8927-kube-api-access-lxlsx" (OuterVolumeSpecName: "kube-api-access-lxlsx") pod "1ab51d98-a1ac-48d8-b04d-b146e49d8927" (UID: "1ab51d98-a1ac-48d8-b04d-b146e49d8927"). InnerVolumeSpecName "kube-api-access-lxlsx". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:20:54.874210 master-0 kubenswrapper[35367]: I1204 12:20:54.874099 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-db-sync-fh8h7"] Dec 04 12:20:54.891476 master-0 kubenswrapper[35367]: I1204 12:20:54.891410 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lxlsx\" (UniqueName: \"kubernetes.io/projected/1ab51d98-a1ac-48d8-b04d-b146e49d8927-kube-api-access-lxlsx\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:55.192291 master-0 kubenswrapper[35367]: I1204 12:20:55.192208 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-db-sync-fh8h7" event={"ID":"3ee232a5-994b-4ae0-8392-c4d5eed37c1a","Type":"ContainerStarted","Data":"630878eeac63903074ce64bd188ced73c5a42ddc03c45b2394663a047bd64e14"} Dec 04 12:20:55.198703 master-0 kubenswrapper[35367]: I1204 12:20:55.198628 35367 generic.go:334] "Generic (PLEG): container finished" podID="c609368c-2cc0-4322-b1f0-00abab864e02" containerID="2bf3a90031e21a4b6c891815c35bfe71bd45fd1d2f5acbd5c3cd3282a00789fe" exitCode=0 Dec 04 12:20:55.198887 master-0 kubenswrapper[35367]: I1204 12:20:55.198700 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-c8b4-account-create-update-wrmr2" event={"ID":"c609368c-2cc0-4322-b1f0-00abab864e02","Type":"ContainerDied","Data":"2bf3a90031e21a4b6c891815c35bfe71bd45fd1d2f5acbd5c3cd3282a00789fe"} Dec 04 12:20:55.203032 master-0 kubenswrapper[35367]: I1204 12:20:55.202998 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-sm45t-config-vlfnh" Dec 04 12:20:55.206160 master-0 kubenswrapper[35367]: I1204 12:20:55.205935 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-sm45t-config-vlfnh" event={"ID":"1ab51d98-a1ac-48d8-b04d-b146e49d8927","Type":"ContainerDied","Data":"2704cc066a8a4fe16e7ab549f4c3502365bca3c84dd603a7f92db480dff5f814"} Dec 04 12:20:55.206160 master-0 kubenswrapper[35367]: I1204 12:20:55.206054 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2704cc066a8a4fe16e7ab549f4c3502365bca3c84dd603a7f92db480dff5f814" Dec 04 12:20:55.818050 master-0 kubenswrapper[35367]: I1204 12:20:55.817991 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ovn-controller-sm45t-config-vlfnh"] Dec 04 12:20:55.830125 master-0 kubenswrapper[35367]: I1204 12:20:55.830065 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ovn-controller-sm45t-config-vlfnh"] Dec 04 12:20:55.867428 master-0 kubenswrapper[35367]: I1204 12:20:55.867196 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-db-create-kscpb" Dec 04 12:20:56.013287 master-0 kubenswrapper[35367]: I1204 12:20:56.013224 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-a983-account-create-update-nkqvj" Dec 04 12:20:56.026853 master-0 kubenswrapper[35367]: I1204 12:20:56.026776 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-db-create-46v6w" Dec 04 12:20:56.028100 master-0 kubenswrapper[35367]: I1204 12:20:56.028013 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c7ca6286-ccd7-47ac-b456-88a38c89d97f-operator-scripts\") pod \"c7ca6286-ccd7-47ac-b456-88a38c89d97f\" (UID: \"c7ca6286-ccd7-47ac-b456-88a38c89d97f\") " Dec 04 12:20:56.028369 master-0 kubenswrapper[35367]: I1204 12:20:56.028339 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dx7kp\" (UniqueName: \"kubernetes.io/projected/c7ca6286-ccd7-47ac-b456-88a38c89d97f-kube-api-access-dx7kp\") pod \"c7ca6286-ccd7-47ac-b456-88a38c89d97f\" (UID: \"c7ca6286-ccd7-47ac-b456-88a38c89d97f\") " Dec 04 12:20:56.028725 master-0 kubenswrapper[35367]: I1204 12:20:56.028642 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7ca6286-ccd7-47ac-b456-88a38c89d97f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c7ca6286-ccd7-47ac-b456-88a38c89d97f" (UID: "c7ca6286-ccd7-47ac-b456-88a38c89d97f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:56.029177 master-0 kubenswrapper[35367]: I1204 12:20:56.029141 35367 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c7ca6286-ccd7-47ac-b456-88a38c89d97f-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:56.032542 master-0 kubenswrapper[35367]: I1204 12:20:56.031231 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7ca6286-ccd7-47ac-b456-88a38c89d97f-kube-api-access-dx7kp" (OuterVolumeSpecName: "kube-api-access-dx7kp") pod "c7ca6286-ccd7-47ac-b456-88a38c89d97f" (UID: "c7ca6286-ccd7-47ac-b456-88a38c89d97f"). InnerVolumeSpecName "kube-api-access-dx7kp". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:20:56.131172 master-0 kubenswrapper[35367]: I1204 12:20:56.130993 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7e577446-b134-4beb-81b4-4a3e355c3b26-operator-scripts\") pod \"7e577446-b134-4beb-81b4-4a3e355c3b26\" (UID: \"7e577446-b134-4beb-81b4-4a3e355c3b26\") " Dec 04 12:20:56.131385 master-0 kubenswrapper[35367]: I1204 12:20:56.131362 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsn6s\" (UniqueName: \"kubernetes.io/projected/7e577446-b134-4beb-81b4-4a3e355c3b26-kube-api-access-bsn6s\") pod \"7e577446-b134-4beb-81b4-4a3e355c3b26\" (UID: \"7e577446-b134-4beb-81b4-4a3e355c3b26\") " Dec 04 12:20:56.131663 master-0 kubenswrapper[35367]: I1204 12:20:56.131607 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e577446-b134-4beb-81b4-4a3e355c3b26-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "7e577446-b134-4beb-81b4-4a3e355c3b26" (UID: "7e577446-b134-4beb-81b4-4a3e355c3b26"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:56.131663 master-0 kubenswrapper[35367]: I1204 12:20:56.131653 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grqnx\" (UniqueName: \"kubernetes.io/projected/920d85f6-b7a7-4720-83a0-84ca181a6453-kube-api-access-grqnx\") pod \"920d85f6-b7a7-4720-83a0-84ca181a6453\" (UID: \"920d85f6-b7a7-4720-83a0-84ca181a6453\") " Dec 04 12:20:56.131774 master-0 kubenswrapper[35367]: I1204 12:20:56.131730 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/920d85f6-b7a7-4720-83a0-84ca181a6453-operator-scripts\") pod \"920d85f6-b7a7-4720-83a0-84ca181a6453\" (UID: \"920d85f6-b7a7-4720-83a0-84ca181a6453\") " Dec 04 12:20:56.132530 master-0 kubenswrapper[35367]: I1204 12:20:56.132500 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dx7kp\" (UniqueName: \"kubernetes.io/projected/c7ca6286-ccd7-47ac-b456-88a38c89d97f-kube-api-access-dx7kp\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:56.132530 master-0 kubenswrapper[35367]: I1204 12:20:56.132530 35367 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7e577446-b134-4beb-81b4-4a3e355c3b26-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:56.132700 master-0 kubenswrapper[35367]: I1204 12:20:56.132670 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/920d85f6-b7a7-4720-83a0-84ca181a6453-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "920d85f6-b7a7-4720-83a0-84ca181a6453" (UID: "920d85f6-b7a7-4720-83a0-84ca181a6453"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:56.135975 master-0 kubenswrapper[35367]: I1204 12:20:56.135946 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e577446-b134-4beb-81b4-4a3e355c3b26-kube-api-access-bsn6s" (OuterVolumeSpecName: "kube-api-access-bsn6s") pod "7e577446-b134-4beb-81b4-4a3e355c3b26" (UID: "7e577446-b134-4beb-81b4-4a3e355c3b26"). InnerVolumeSpecName "kube-api-access-bsn6s". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:20:56.136105 master-0 kubenswrapper[35367]: I1204 12:20:56.135719 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/920d85f6-b7a7-4720-83a0-84ca181a6453-kube-api-access-grqnx" (OuterVolumeSpecName: "kube-api-access-grqnx") pod "920d85f6-b7a7-4720-83a0-84ca181a6453" (UID: "920d85f6-b7a7-4720-83a0-84ca181a6453"). InnerVolumeSpecName "kube-api-access-grqnx". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:20:56.226834 master-0 kubenswrapper[35367]: I1204 12:20:56.218630 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-a983-account-create-update-nkqvj" event={"ID":"920d85f6-b7a7-4720-83a0-84ca181a6453","Type":"ContainerDied","Data":"a0b2ab07a3fc68b295d3c2660b1cbc28e62bbf2067e69cd0f1eed660e31487cb"} Dec 04 12:20:56.226834 master-0 kubenswrapper[35367]: I1204 12:20:56.218695 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0b2ab07a3fc68b295d3c2660b1cbc28e62bbf2067e69cd0f1eed660e31487cb" Dec 04 12:20:56.226834 master-0 kubenswrapper[35367]: I1204 12:20:56.218717 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-a983-account-create-update-nkqvj" Dec 04 12:20:56.226834 master-0 kubenswrapper[35367]: I1204 12:20:56.221330 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-db-create-kscpb" Dec 04 12:20:56.226834 master-0 kubenswrapper[35367]: I1204 12:20:56.221359 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-db-create-kscpb" event={"ID":"c7ca6286-ccd7-47ac-b456-88a38c89d97f","Type":"ContainerDied","Data":"fa3fc849d606ba4b941b9ada9710b2c00b51ee41dcc51db7cd4676a02dba5b6a"} Dec 04 12:20:56.226834 master-0 kubenswrapper[35367]: I1204 12:20:56.221535 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa3fc849d606ba4b941b9ada9710b2c00b51ee41dcc51db7cd4676a02dba5b6a" Dec 04 12:20:56.226834 master-0 kubenswrapper[35367]: I1204 12:20:56.223362 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-db-create-46v6w" event={"ID":"7e577446-b134-4beb-81b4-4a3e355c3b26","Type":"ContainerDied","Data":"070dc1e5c6f6b18f73e15c751e540072e8929663501ec97c2491637066b8730e"} Dec 04 12:20:56.226834 master-0 kubenswrapper[35367]: I1204 12:20:56.223464 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="070dc1e5c6f6b18f73e15c751e540072e8929663501ec97c2491637066b8730e" Dec 04 12:20:56.226834 master-0 kubenswrapper[35367]: I1204 12:20:56.223461 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-db-create-46v6w" Dec 04 12:20:56.235503 master-0 kubenswrapper[35367]: I1204 12:20:56.234727 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-grqnx\" (UniqueName: \"kubernetes.io/projected/920d85f6-b7a7-4720-83a0-84ca181a6453-kube-api-access-grqnx\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:56.235503 master-0 kubenswrapper[35367]: I1204 12:20:56.234796 35367 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/920d85f6-b7a7-4720-83a0-84ca181a6453-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:56.235503 master-0 kubenswrapper[35367]: I1204 12:20:56.234841 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bsn6s\" (UniqueName: \"kubernetes.io/projected/7e577446-b134-4beb-81b4-4a3e355c3b26-kube-api-access-bsn6s\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:56.690319 master-0 kubenswrapper[35367]: I1204 12:20:56.689849 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-c8b4-account-create-update-wrmr2" Dec 04 12:20:56.754373 master-0 kubenswrapper[35367]: I1204 12:20:56.754277 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c609368c-2cc0-4322-b1f0-00abab864e02-operator-scripts\") pod \"c609368c-2cc0-4322-b1f0-00abab864e02\" (UID: \"c609368c-2cc0-4322-b1f0-00abab864e02\") " Dec 04 12:20:56.754678 master-0 kubenswrapper[35367]: I1204 12:20:56.754463 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4t4d\" (UniqueName: \"kubernetes.io/projected/c609368c-2cc0-4322-b1f0-00abab864e02-kube-api-access-d4t4d\") pod \"c609368c-2cc0-4322-b1f0-00abab864e02\" (UID: \"c609368c-2cc0-4322-b1f0-00abab864e02\") " Dec 04 12:20:56.755762 master-0 kubenswrapper[35367]: I1204 12:20:56.755545 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c609368c-2cc0-4322-b1f0-00abab864e02-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c609368c-2cc0-4322-b1f0-00abab864e02" (UID: "c609368c-2cc0-4322-b1f0-00abab864e02"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:20:56.758633 master-0 kubenswrapper[35367]: I1204 12:20:56.758455 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c609368c-2cc0-4322-b1f0-00abab864e02-kube-api-access-d4t4d" (OuterVolumeSpecName: "kube-api-access-d4t4d") pod "c609368c-2cc0-4322-b1f0-00abab864e02" (UID: "c609368c-2cc0-4322-b1f0-00abab864e02"). InnerVolumeSpecName "kube-api-access-d4t4d". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:20:56.800525 master-0 kubenswrapper[35367]: I1204 12:20:56.800240 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ab51d98-a1ac-48d8-b04d-b146e49d8927" path="/var/lib/kubelet/pods/1ab51d98-a1ac-48d8-b04d-b146e49d8927/volumes" Dec 04 12:20:56.862610 master-0 kubenswrapper[35367]: I1204 12:20:56.862476 35367 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c609368c-2cc0-4322-b1f0-00abab864e02-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:56.862610 master-0 kubenswrapper[35367]: I1204 12:20:56.862539 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d4t4d\" (UniqueName: \"kubernetes.io/projected/c609368c-2cc0-4322-b1f0-00abab864e02-kube-api-access-d4t4d\") on node \"master-0\" DevicePath \"\"" Dec 04 12:20:57.253097 master-0 kubenswrapper[35367]: I1204 12:20:57.252594 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-c8b4-account-create-update-wrmr2" event={"ID":"c609368c-2cc0-4322-b1f0-00abab864e02","Type":"ContainerDied","Data":"53282b352b1beae6cf4e4ace9ace46d9829294dfa893982d029e5c53856f981b"} Dec 04 12:20:57.253097 master-0 kubenswrapper[35367]: I1204 12:20:57.252669 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53282b352b1beae6cf4e4ace9ace46d9829294dfa893982d029e5c53856f981b" Dec 04 12:20:57.253097 master-0 kubenswrapper[35367]: I1204 12:20:57.252719 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-c8b4-account-create-update-wrmr2" Dec 04 12:21:02.515350 master-0 kubenswrapper[35367]: I1204 12:21:02.515263 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-etc-swift\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") " pod="openstack/swift-storage-0" Dec 04 12:21:02.547413 master-0 kubenswrapper[35367]: I1204 12:21:02.547310 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d421bb44-18fc-4130-baa0-32c09ace37a7-etc-swift\") pod \"swift-storage-0\" (UID: \"d421bb44-18fc-4130-baa0-32c09ace37a7\") " pod="openstack/swift-storage-0" Dec 04 12:21:02.840772 master-0 kubenswrapper[35367]: I1204 12:21:02.840464 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/swift-storage-0" Dec 04 12:21:06.275325 master-0 kubenswrapper[35367]: I1204 12:21:06.275174 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/metallb-operator-controller-manager-6f8cddc44c-f979v" Dec 04 12:21:07.018043 master-0 kubenswrapper[35367]: I1204 12:21:07.017610 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/swift-storage-0"] Dec 04 12:21:07.041867 master-0 kubenswrapper[35367]: W1204 12:21:07.041757 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd421bb44_18fc_4130_baa0_32c09ace37a7.slice/crio-e56e2a6587fdeccd687933929a44539491a6ffa1ac1a09c02e25af0c31c9a8cc WatchSource:0}: Error finding container e56e2a6587fdeccd687933929a44539491a6ffa1ac1a09c02e25af0c31c9a8cc: Status 404 returned error can't find the container with id e56e2a6587fdeccd687933929a44539491a6ffa1ac1a09c02e25af0c31c9a8cc Dec 04 12:21:07.431271 master-0 kubenswrapper[35367]: I1204 12:21:07.431187 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-db-sync-x46tq" event={"ID":"859636b6-4875-4193-b2b7-cf13e258fee9","Type":"ContainerStarted","Data":"2c90db8b59d7eb21277b36492e67ff74acd7ee2a4b87af5c5ec79f7846363a83"} Dec 04 12:21:07.443316 master-0 kubenswrapper[35367]: I1204 12:21:07.443230 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"d421bb44-18fc-4130-baa0-32c09ace37a7","Type":"ContainerStarted","Data":"e56e2a6587fdeccd687933929a44539491a6ffa1ac1a09c02e25af0c31c9a8cc"} Dec 04 12:21:07.467948 master-0 kubenswrapper[35367]: I1204 12:21:07.466122 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-db-sync-fh8h7" event={"ID":"3ee232a5-994b-4ae0-8392-c4d5eed37c1a","Type":"ContainerStarted","Data":"b4440c7c1fb1e0e357a5564182e49dc21c2e26af3c111c9a338351bcdcaf978d"} Dec 04 12:21:07.534840 master-0 kubenswrapper[35367]: I1204 12:21:07.526236 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/glance-db-sync-x46tq" podStartSLOduration=2.136465405 podStartE2EDuration="17.526207569s" podCreationTimestamp="2025-12-04 12:20:50 +0000 UTC" firstStartedPulling="2025-12-04 12:20:51.159009581 +0000 UTC m=+1294.597070839" lastFinishedPulling="2025-12-04 12:21:06.548751745 +0000 UTC m=+1309.986813003" observedRunningTime="2025-12-04 12:21:07.506723804 +0000 UTC m=+1310.944785062" watchObservedRunningTime="2025-12-04 12:21:07.526207569 +0000 UTC m=+1310.964268837" Dec 04 12:21:07.569066 master-0 kubenswrapper[35367]: I1204 12:21:07.568787 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/keystone-db-sync-fh8h7" podStartSLOduration=2.965422908 podStartE2EDuration="14.568756212s" podCreationTimestamp="2025-12-04 12:20:53 +0000 UTC" firstStartedPulling="2025-12-04 12:20:54.906298215 +0000 UTC m=+1298.344359473" lastFinishedPulling="2025-12-04 12:21:06.509631529 +0000 UTC m=+1309.947692777" observedRunningTime="2025-12-04 12:21:07.54810617 +0000 UTC m=+1310.986167458" watchObservedRunningTime="2025-12-04 12:21:07.568756212 +0000 UTC m=+1311.006817470" Dec 04 12:21:09.513912 master-0 kubenswrapper[35367]: I1204 12:21:09.511443 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"d421bb44-18fc-4130-baa0-32c09ace37a7","Type":"ContainerStarted","Data":"ff2efbe7c6bb7cecd9e325fe9b9d4e0ddeb7859068fa5d8a24eae8f8f7c55149"} Dec 04 12:21:09.513912 master-0 kubenswrapper[35367]: I1204 12:21:09.511530 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"d421bb44-18fc-4130-baa0-32c09ace37a7","Type":"ContainerStarted","Data":"c85cf9502b2708d4a0909a2610d35cdfb7271f7c201b2fc19ca2b5cf3e968f4c"} Dec 04 12:21:09.513912 master-0 kubenswrapper[35367]: I1204 12:21:09.511545 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"d421bb44-18fc-4130-baa0-32c09ace37a7","Type":"ContainerStarted","Data":"f81f2a64d165d2c014dec1b951e148a19227667f3c563a5eb50306033b3ae105"} Dec 04 12:21:10.583844 master-0 kubenswrapper[35367]: I1204 12:21:10.579152 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"d421bb44-18fc-4130-baa0-32c09ace37a7","Type":"ContainerStarted","Data":"226da0e57d630e26a428a6375ef3faebfba6930736205bd893077d1410356f07"} Dec 04 12:21:11.598756 master-0 kubenswrapper[35367]: I1204 12:21:11.598645 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"d421bb44-18fc-4130-baa0-32c09ace37a7","Type":"ContainerStarted","Data":"88a7dcfb2d1a7c78099d673a8a81c65f6ed673c9dd35d249f93351efaa7c9f40"} Dec 04 12:21:11.598756 master-0 kubenswrapper[35367]: I1204 12:21:11.598747 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"d421bb44-18fc-4130-baa0-32c09ace37a7","Type":"ContainerStarted","Data":"42be3811b7d3b483e8d9bb8bdd677400fe48181ec74a009d0cb7a715c8b2045c"} Dec 04 12:21:12.621766 master-0 kubenswrapper[35367]: I1204 12:21:12.621676 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"d421bb44-18fc-4130-baa0-32c09ace37a7","Type":"ContainerStarted","Data":"2b8e1b1affc813c59d704474414aefe3b0c71e27a4fc46197a8c1ace348efe47"} Dec 04 12:21:12.621766 master-0 kubenswrapper[35367]: I1204 12:21:12.621767 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"d421bb44-18fc-4130-baa0-32c09ace37a7","Type":"ContainerStarted","Data":"8930621cae33ad55dc920694ab27e84022d046181c5e37cc238bb6cd46c3c566"} Dec 04 12:21:14.674403 master-0 kubenswrapper[35367]: I1204 12:21:14.674283 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"d421bb44-18fc-4130-baa0-32c09ace37a7","Type":"ContainerStarted","Data":"afba8fc0ea64d844f64d8f40b729c2508e889072cfab4db1db4bb8773ec68e7c"} Dec 04 12:21:14.674403 master-0 kubenswrapper[35367]: I1204 12:21:14.674350 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"d421bb44-18fc-4130-baa0-32c09ace37a7","Type":"ContainerStarted","Data":"d0c2fc42c6d82d96e1f0da64b8c54d14ea19c94c67d453cb16a0c0f599e87627"} Dec 04 12:21:14.674403 master-0 kubenswrapper[35367]: I1204 12:21:14.674359 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"d421bb44-18fc-4130-baa0-32c09ace37a7","Type":"ContainerStarted","Data":"1a3d3c9a75b6f457a7d2cabf13d88f06cc75062d4ceae0e6f169d6aaaf9a1ec9"} Dec 04 12:21:14.678333 master-0 kubenswrapper[35367]: I1204 12:21:14.678269 35367 generic.go:334] "Generic (PLEG): container finished" podID="3ee232a5-994b-4ae0-8392-c4d5eed37c1a" containerID="b4440c7c1fb1e0e357a5564182e49dc21c2e26af3c111c9a338351bcdcaf978d" exitCode=0 Dec 04 12:21:14.678567 master-0 kubenswrapper[35367]: I1204 12:21:14.678380 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-db-sync-fh8h7" event={"ID":"3ee232a5-994b-4ae0-8392-c4d5eed37c1a","Type":"ContainerDied","Data":"b4440c7c1fb1e0e357a5564182e49dc21c2e26af3c111c9a338351bcdcaf978d"} Dec 04 12:21:15.697916 master-0 kubenswrapper[35367]: I1204 12:21:15.697758 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"d421bb44-18fc-4130-baa0-32c09ace37a7","Type":"ContainerStarted","Data":"d1c336d7fa85fe1e00a9723284fc29ccc94bedf754d01301127832d9d9f08136"} Dec 04 12:21:15.697916 master-0 kubenswrapper[35367]: I1204 12:21:15.697846 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"d421bb44-18fc-4130-baa0-32c09ace37a7","Type":"ContainerStarted","Data":"945e7e01d57a3978fb6ed818755e79a4c16b69ebf430ab265faa244c2c8fe763"} Dec 04 12:21:16.195695 master-0 kubenswrapper[35367]: I1204 12:21:16.194591 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-db-sync-fh8h7" Dec 04 12:21:16.269452 master-0 kubenswrapper[35367]: I1204 12:21:16.269370 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ee232a5-994b-4ae0-8392-c4d5eed37c1a-combined-ca-bundle\") pod \"3ee232a5-994b-4ae0-8392-c4d5eed37c1a\" (UID: \"3ee232a5-994b-4ae0-8392-c4d5eed37c1a\") " Dec 04 12:21:16.269744 master-0 kubenswrapper[35367]: I1204 12:21:16.269583 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdmq6\" (UniqueName: \"kubernetes.io/projected/3ee232a5-994b-4ae0-8392-c4d5eed37c1a-kube-api-access-sdmq6\") pod \"3ee232a5-994b-4ae0-8392-c4d5eed37c1a\" (UID: \"3ee232a5-994b-4ae0-8392-c4d5eed37c1a\") " Dec 04 12:21:16.269988 master-0 kubenswrapper[35367]: I1204 12:21:16.269952 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ee232a5-994b-4ae0-8392-c4d5eed37c1a-config-data\") pod \"3ee232a5-994b-4ae0-8392-c4d5eed37c1a\" (UID: \"3ee232a5-994b-4ae0-8392-c4d5eed37c1a\") " Dec 04 12:21:16.273931 master-0 kubenswrapper[35367]: I1204 12:21:16.273700 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ee232a5-994b-4ae0-8392-c4d5eed37c1a-kube-api-access-sdmq6" (OuterVolumeSpecName: "kube-api-access-sdmq6") pod "3ee232a5-994b-4ae0-8392-c4d5eed37c1a" (UID: "3ee232a5-994b-4ae0-8392-c4d5eed37c1a"). InnerVolumeSpecName "kube-api-access-sdmq6". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:21:16.300316 master-0 kubenswrapper[35367]: I1204 12:21:16.300160 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ee232a5-994b-4ae0-8392-c4d5eed37c1a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3ee232a5-994b-4ae0-8392-c4d5eed37c1a" (UID: "3ee232a5-994b-4ae0-8392-c4d5eed37c1a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:16.329953 master-0 kubenswrapper[35367]: I1204 12:21:16.329779 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ee232a5-994b-4ae0-8392-c4d5eed37c1a-config-data" (OuterVolumeSpecName: "config-data") pod "3ee232a5-994b-4ae0-8392-c4d5eed37c1a" (UID: "3ee232a5-994b-4ae0-8392-c4d5eed37c1a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:16.374171 master-0 kubenswrapper[35367]: I1204 12:21:16.374051 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sdmq6\" (UniqueName: \"kubernetes.io/projected/3ee232a5-994b-4ae0-8392-c4d5eed37c1a-kube-api-access-sdmq6\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:16.374171 master-0 kubenswrapper[35367]: I1204 12:21:16.374117 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ee232a5-994b-4ae0-8392-c4d5eed37c1a-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:16.374171 master-0 kubenswrapper[35367]: I1204 12:21:16.374129 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ee232a5-994b-4ae0-8392-c4d5eed37c1a-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:16.722276 master-0 kubenswrapper[35367]: I1204 12:21:16.722177 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"d421bb44-18fc-4130-baa0-32c09ace37a7","Type":"ContainerStarted","Data":"13b877624500cdc9cd4e57771f25a3dd687d62424a04e47c28cc980661cd5a2c"} Dec 04 12:21:16.722276 master-0 kubenswrapper[35367]: I1204 12:21:16.722257 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"d421bb44-18fc-4130-baa0-32c09ace37a7","Type":"ContainerStarted","Data":"5c2a101946f5ad88e1babca26f1cf045659cf6172cfbb7cb3d4d0a0a180119bf"} Dec 04 12:21:16.725420 master-0 kubenswrapper[35367]: I1204 12:21:16.725369 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-db-sync-fh8h7" event={"ID":"3ee232a5-994b-4ae0-8392-c4d5eed37c1a","Type":"ContainerDied","Data":"630878eeac63903074ce64bd188ced73c5a42ddc03c45b2394663a047bd64e14"} Dec 04 12:21:16.725420 master-0 kubenswrapper[35367]: I1204 12:21:16.725408 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="630878eeac63903074ce64bd188ced73c5a42ddc03c45b2394663a047bd64e14" Dec 04 12:21:16.725588 master-0 kubenswrapper[35367]: I1204 12:21:16.725469 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-db-sync-fh8h7" Dec 04 12:21:16.783879 master-0 kubenswrapper[35367]: I1204 12:21:16.780935 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/swift-storage-0" podStartSLOduration=42.91100506 podStartE2EDuration="49.780908903s" podCreationTimestamp="2025-12-04 12:20:27 +0000 UTC" firstStartedPulling="2025-12-04 12:21:07.046098659 +0000 UTC m=+1310.484159917" lastFinishedPulling="2025-12-04 12:21:13.916002502 +0000 UTC m=+1317.354063760" observedRunningTime="2025-12-04 12:21:16.780669216 +0000 UTC m=+1320.218730494" watchObservedRunningTime="2025-12-04 12:21:16.780908903 +0000 UTC m=+1320.218970161" Dec 04 12:21:17.170238 master-0 kubenswrapper[35367]: I1204 12:21:17.170076 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-749df7dbf7-vjbqp"] Dec 04 12:21:17.170964 master-0 kubenswrapper[35367]: E1204 12:21:17.170896 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1ab51d98-a1ac-48d8-b04d-b146e49d8927" containerName="ovn-config" Dec 04 12:21:17.170964 master-0 kubenswrapper[35367]: I1204 12:21:17.170925 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ab51d98-a1ac-48d8-b04d-b146e49d8927" containerName="ovn-config" Dec 04 12:21:17.170964 master-0 kubenswrapper[35367]: E1204 12:21:17.170958 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7e577446-b134-4beb-81b4-4a3e355c3b26" containerName="mariadb-database-create" Dec 04 12:21:17.170964 master-0 kubenswrapper[35367]: I1204 12:21:17.170968 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e577446-b134-4beb-81b4-4a3e355c3b26" containerName="mariadb-database-create" Dec 04 12:21:17.171192 master-0 kubenswrapper[35367]: E1204 12:21:17.171007 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3ee232a5-994b-4ae0-8392-c4d5eed37c1a" containerName="keystone-db-sync" Dec 04 12:21:17.171192 master-0 kubenswrapper[35367]: I1204 12:21:17.171017 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ee232a5-994b-4ae0-8392-c4d5eed37c1a" containerName="keystone-db-sync" Dec 04 12:21:17.171192 master-0 kubenswrapper[35367]: E1204 12:21:17.171040 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c609368c-2cc0-4322-b1f0-00abab864e02" containerName="mariadb-account-create-update" Dec 04 12:21:17.171192 master-0 kubenswrapper[35367]: I1204 12:21:17.171049 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="c609368c-2cc0-4322-b1f0-00abab864e02" containerName="mariadb-account-create-update" Dec 04 12:21:17.171192 master-0 kubenswrapper[35367]: E1204 12:21:17.171073 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="920d85f6-b7a7-4720-83a0-84ca181a6453" containerName="mariadb-account-create-update" Dec 04 12:21:17.171192 master-0 kubenswrapper[35367]: I1204 12:21:17.171082 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="920d85f6-b7a7-4720-83a0-84ca181a6453" containerName="mariadb-account-create-update" Dec 04 12:21:17.171192 master-0 kubenswrapper[35367]: E1204 12:21:17.171095 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c7ca6286-ccd7-47ac-b456-88a38c89d97f" containerName="mariadb-database-create" Dec 04 12:21:17.171192 master-0 kubenswrapper[35367]: I1204 12:21:17.171103 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7ca6286-ccd7-47ac-b456-88a38c89d97f" containerName="mariadb-database-create" Dec 04 12:21:17.171526 master-0 kubenswrapper[35367]: I1204 12:21:17.171372 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="7e577446-b134-4beb-81b4-4a3e355c3b26" containerName="mariadb-database-create" Dec 04 12:21:17.171526 master-0 kubenswrapper[35367]: I1204 12:21:17.171415 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="920d85f6-b7a7-4720-83a0-84ca181a6453" containerName="mariadb-account-create-update" Dec 04 12:21:17.171526 master-0 kubenswrapper[35367]: I1204 12:21:17.171431 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="1ab51d98-a1ac-48d8-b04d-b146e49d8927" containerName="ovn-config" Dec 04 12:21:17.171526 master-0 kubenswrapper[35367]: I1204 12:21:17.171444 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="c7ca6286-ccd7-47ac-b456-88a38c89d97f" containerName="mariadb-database-create" Dec 04 12:21:17.171526 master-0 kubenswrapper[35367]: I1204 12:21:17.171459 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="3ee232a5-994b-4ae0-8392-c4d5eed37c1a" containerName="keystone-db-sync" Dec 04 12:21:17.171526 master-0 kubenswrapper[35367]: I1204 12:21:17.171492 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="c609368c-2cc0-4322-b1f0-00abab864e02" containerName="mariadb-account-create-update" Dec 04 12:21:17.173965 master-0 kubenswrapper[35367]: I1204 12:21:17.173919 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-749df7dbf7-vjbqp" Dec 04 12:21:17.195354 master-0 kubenswrapper[35367]: I1204 12:21:17.195284 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-dns-svc\") pod \"dnsmasq-dns-749df7dbf7-vjbqp\" (UID: \"7c03bd6a-a573-4935-be44-232bb5059c18\") " pod="openstack/dnsmasq-dns-749df7dbf7-vjbqp" Dec 04 12:21:17.195892 master-0 kubenswrapper[35367]: I1204 12:21:17.195694 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-ovsdbserver-sb\") pod \"dnsmasq-dns-749df7dbf7-vjbqp\" (UID: \"7c03bd6a-a573-4935-be44-232bb5059c18\") " pod="openstack/dnsmasq-dns-749df7dbf7-vjbqp" Dec 04 12:21:17.196257 master-0 kubenswrapper[35367]: I1204 12:21:17.196204 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-config\") pod \"dnsmasq-dns-749df7dbf7-vjbqp\" (UID: \"7c03bd6a-a573-4935-be44-232bb5059c18\") " pod="openstack/dnsmasq-dns-749df7dbf7-vjbqp" Dec 04 12:21:17.198039 master-0 kubenswrapper[35367]: I1204 12:21:17.197937 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6clvl\" (UniqueName: \"kubernetes.io/projected/7c03bd6a-a573-4935-be44-232bb5059c18-kube-api-access-6clvl\") pod \"dnsmasq-dns-749df7dbf7-vjbqp\" (UID: \"7c03bd6a-a573-4935-be44-232bb5059c18\") " pod="openstack/dnsmasq-dns-749df7dbf7-vjbqp" Dec 04 12:21:17.198273 master-0 kubenswrapper[35367]: I1204 12:21:17.198252 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-ovsdbserver-nb\") pod \"dnsmasq-dns-749df7dbf7-vjbqp\" (UID: \"7c03bd6a-a573-4935-be44-232bb5059c18\") " pod="openstack/dnsmasq-dns-749df7dbf7-vjbqp" Dec 04 12:21:17.224364 master-0 kubenswrapper[35367]: I1204 12:21:17.224114 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-749df7dbf7-vjbqp"] Dec 04 12:21:17.251898 master-0 kubenswrapper[35367]: I1204 12:21:17.249861 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/keystone-bootstrap-xxnvq"] Dec 04 12:21:17.278496 master-0 kubenswrapper[35367]: I1204 12:21:17.252942 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:17.278496 master-0 kubenswrapper[35367]: I1204 12:21:17.277040 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-bootstrap-xxnvq"] Dec 04 12:21:17.279422 master-0 kubenswrapper[35367]: I1204 12:21:17.279381 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone" Dec 04 12:21:17.279754 master-0 kubenswrapper[35367]: I1204 12:21:17.279737 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone-scripts" Dec 04 12:21:17.279987 master-0 kubenswrapper[35367]: I1204 12:21:17.279828 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"osp-secret" Dec 04 12:21:17.281237 master-0 kubenswrapper[35367]: I1204 12:21:17.280864 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone-config-data" Dec 04 12:21:17.310285 master-0 kubenswrapper[35367]: I1204 12:21:17.307561 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-config\") pod \"dnsmasq-dns-749df7dbf7-vjbqp\" (UID: \"7c03bd6a-a573-4935-be44-232bb5059c18\") " pod="openstack/dnsmasq-dns-749df7dbf7-vjbqp" Dec 04 12:21:17.310285 master-0 kubenswrapper[35367]: I1204 12:21:17.307707 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-fernet-keys\") pod \"keystone-bootstrap-xxnvq\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:17.310285 master-0 kubenswrapper[35367]: I1204 12:21:17.307745 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-config-data\") pod \"keystone-bootstrap-xxnvq\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:17.310285 master-0 kubenswrapper[35367]: I1204 12:21:17.307774 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-credential-keys\") pod \"keystone-bootstrap-xxnvq\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:17.310285 master-0 kubenswrapper[35367]: I1204 12:21:17.307849 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6clvl\" (UniqueName: \"kubernetes.io/projected/7c03bd6a-a573-4935-be44-232bb5059c18-kube-api-access-6clvl\") pod \"dnsmasq-dns-749df7dbf7-vjbqp\" (UID: \"7c03bd6a-a573-4935-be44-232bb5059c18\") " pod="openstack/dnsmasq-dns-749df7dbf7-vjbqp" Dec 04 12:21:17.310285 master-0 kubenswrapper[35367]: I1204 12:21:17.307890 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-combined-ca-bundle\") pod \"keystone-bootstrap-xxnvq\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:17.310285 master-0 kubenswrapper[35367]: I1204 12:21:17.307919 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j99x9\" (UniqueName: \"kubernetes.io/projected/6003f8aa-82ad-4465-b61c-e956d45ce162-kube-api-access-j99x9\") pod \"keystone-bootstrap-xxnvq\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:17.310285 master-0 kubenswrapper[35367]: I1204 12:21:17.308195 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-ovsdbserver-nb\") pod \"dnsmasq-dns-749df7dbf7-vjbqp\" (UID: \"7c03bd6a-a573-4935-be44-232bb5059c18\") " pod="openstack/dnsmasq-dns-749df7dbf7-vjbqp" Dec 04 12:21:17.310285 master-0 kubenswrapper[35367]: I1204 12:21:17.308401 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-scripts\") pod \"keystone-bootstrap-xxnvq\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:17.310285 master-0 kubenswrapper[35367]: I1204 12:21:17.308650 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-dns-svc\") pod \"dnsmasq-dns-749df7dbf7-vjbqp\" (UID: \"7c03bd6a-a573-4935-be44-232bb5059c18\") " pod="openstack/dnsmasq-dns-749df7dbf7-vjbqp" Dec 04 12:21:17.310285 master-0 kubenswrapper[35367]: I1204 12:21:17.308706 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-ovsdbserver-sb\") pod \"dnsmasq-dns-749df7dbf7-vjbqp\" (UID: \"7c03bd6a-a573-4935-be44-232bb5059c18\") " pod="openstack/dnsmasq-dns-749df7dbf7-vjbqp" Dec 04 12:21:17.310285 master-0 kubenswrapper[35367]: I1204 12:21:17.309252 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-config\") pod \"dnsmasq-dns-749df7dbf7-vjbqp\" (UID: \"7c03bd6a-a573-4935-be44-232bb5059c18\") " pod="openstack/dnsmasq-dns-749df7dbf7-vjbqp" Dec 04 12:21:17.310285 master-0 kubenswrapper[35367]: I1204 12:21:17.309507 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-ovsdbserver-nb\") pod \"dnsmasq-dns-749df7dbf7-vjbqp\" (UID: \"7c03bd6a-a573-4935-be44-232bb5059c18\") " pod="openstack/dnsmasq-dns-749df7dbf7-vjbqp" Dec 04 12:21:17.310285 master-0 kubenswrapper[35367]: I1204 12:21:17.310029 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-ovsdbserver-sb\") pod \"dnsmasq-dns-749df7dbf7-vjbqp\" (UID: \"7c03bd6a-a573-4935-be44-232bb5059c18\") " pod="openstack/dnsmasq-dns-749df7dbf7-vjbqp" Dec 04 12:21:17.311182 master-0 kubenswrapper[35367]: I1204 12:21:17.311115 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-dns-svc\") pod \"dnsmasq-dns-749df7dbf7-vjbqp\" (UID: \"7c03bd6a-a573-4935-be44-232bb5059c18\") " pod="openstack/dnsmasq-dns-749df7dbf7-vjbqp" Dec 04 12:21:17.335491 master-0 kubenswrapper[35367]: I1204 12:21:17.334917 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-749df7dbf7-vjbqp"] Dec 04 12:21:17.336180 master-0 kubenswrapper[35367]: E1204 12:21:17.336122 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-6clvl], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack/dnsmasq-dns-749df7dbf7-vjbqp" podUID="7c03bd6a-a573-4935-be44-232bb5059c18" Dec 04 12:21:17.380919 master-0 kubenswrapper[35367]: I1204 12:21:17.365845 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6clvl\" (UniqueName: \"kubernetes.io/projected/7c03bd6a-a573-4935-be44-232bb5059c18-kube-api-access-6clvl\") pod \"dnsmasq-dns-749df7dbf7-vjbqp\" (UID: \"7c03bd6a-a573-4935-be44-232bb5059c18\") " pod="openstack/dnsmasq-dns-749df7dbf7-vjbqp" Dec 04 12:21:17.415069 master-0 kubenswrapper[35367]: I1204 12:21:17.414101 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-fernet-keys\") pod \"keystone-bootstrap-xxnvq\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:17.415069 master-0 kubenswrapper[35367]: I1204 12:21:17.414358 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-config-data\") pod \"keystone-bootstrap-xxnvq\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:17.415069 master-0 kubenswrapper[35367]: I1204 12:21:17.414411 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-credential-keys\") pod \"keystone-bootstrap-xxnvq\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:17.415069 master-0 kubenswrapper[35367]: I1204 12:21:17.414552 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-combined-ca-bundle\") pod \"keystone-bootstrap-xxnvq\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:17.415069 master-0 kubenswrapper[35367]: I1204 12:21:17.414586 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j99x9\" (UniqueName: \"kubernetes.io/projected/6003f8aa-82ad-4465-b61c-e956d45ce162-kube-api-access-j99x9\") pod \"keystone-bootstrap-xxnvq\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:17.415069 master-0 kubenswrapper[35367]: I1204 12:21:17.414754 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-scripts\") pod \"keystone-bootstrap-xxnvq\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:17.434149 master-0 kubenswrapper[35367]: I1204 12:21:17.418665 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-scripts\") pod \"keystone-bootstrap-xxnvq\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:17.434149 master-0 kubenswrapper[35367]: I1204 12:21:17.419247 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-8575ff9b5-t5m24"] Dec 04 12:21:17.434149 master-0 kubenswrapper[35367]: I1204 12:21:17.420033 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-fernet-keys\") pod \"keystone-bootstrap-xxnvq\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:17.434149 master-0 kubenswrapper[35367]: I1204 12:21:17.423668 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:17.434149 master-0 kubenswrapper[35367]: I1204 12:21:17.428842 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-combined-ca-bundle\") pod \"keystone-bootstrap-xxnvq\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:17.434149 master-0 kubenswrapper[35367]: I1204 12:21:17.432430 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns-swift-storage-0" Dec 04 12:21:17.434618 master-0 kubenswrapper[35367]: I1204 12:21:17.434194 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-credential-keys\") pod \"keystone-bootstrap-xxnvq\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:17.446841 master-0 kubenswrapper[35367]: I1204 12:21:17.442397 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-config-data\") pod \"keystone-bootstrap-xxnvq\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:17.463980 master-0 kubenswrapper[35367]: I1204 12:21:17.462016 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j99x9\" (UniqueName: \"kubernetes.io/projected/6003f8aa-82ad-4465-b61c-e956d45ce162-kube-api-access-j99x9\") pod \"keystone-bootstrap-xxnvq\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:17.563118 master-0 kubenswrapper[35367]: I1204 12:21:17.554759 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-ovsdbserver-nb\") pod \"dnsmasq-dns-8575ff9b5-t5m24\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:17.563118 master-0 kubenswrapper[35367]: I1204 12:21:17.554931 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-dns-svc\") pod \"dnsmasq-dns-8575ff9b5-t5m24\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:17.563118 master-0 kubenswrapper[35367]: I1204 12:21:17.555345 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-dns-swift-storage-0\") pod \"dnsmasq-dns-8575ff9b5-t5m24\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:17.563118 master-0 kubenswrapper[35367]: I1204 12:21:17.555438 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-config\") pod \"dnsmasq-dns-8575ff9b5-t5m24\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:17.563118 master-0 kubenswrapper[35367]: I1204 12:21:17.555631 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq9ck\" (UniqueName: \"kubernetes.io/projected/9d3c7130-ade7-4628-80b9-ada3d0941c90-kube-api-access-fq9ck\") pod \"dnsmasq-dns-8575ff9b5-t5m24\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:17.563118 master-0 kubenswrapper[35367]: I1204 12:21:17.555689 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-ovsdbserver-sb\") pod \"dnsmasq-dns-8575ff9b5-t5m24\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:17.593496 master-0 kubenswrapper[35367]: I1204 12:21:17.585434 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-db-create-dsptr"] Dec 04 12:21:17.647856 master-0 kubenswrapper[35367]: I1204 12:21:17.646771 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-db-create-dsptr" Dec 04 12:21:17.670015 master-0 kubenswrapper[35367]: I1204 12:21:17.669096 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fq9ck\" (UniqueName: \"kubernetes.io/projected/9d3c7130-ade7-4628-80b9-ada3d0941c90-kube-api-access-fq9ck\") pod \"dnsmasq-dns-8575ff9b5-t5m24\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:17.670015 master-0 kubenswrapper[35367]: I1204 12:21:17.669176 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-ovsdbserver-sb\") pod \"dnsmasq-dns-8575ff9b5-t5m24\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:17.670015 master-0 kubenswrapper[35367]: I1204 12:21:17.669378 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/241869d7-8118-40e8-8550-76c59263f7c7-operator-scripts\") pod \"ironic-db-create-dsptr\" (UID: \"241869d7-8118-40e8-8550-76c59263f7c7\") " pod="openstack/ironic-db-create-dsptr" Dec 04 12:21:17.670015 master-0 kubenswrapper[35367]: I1204 12:21:17.669498 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-ovsdbserver-nb\") pod \"dnsmasq-dns-8575ff9b5-t5m24\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:17.670015 master-0 kubenswrapper[35367]: I1204 12:21:17.669562 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-dns-svc\") pod \"dnsmasq-dns-8575ff9b5-t5m24\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:17.670015 master-0 kubenswrapper[35367]: I1204 12:21:17.669760 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-dns-swift-storage-0\") pod \"dnsmasq-dns-8575ff9b5-t5m24\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:17.670015 master-0 kubenswrapper[35367]: I1204 12:21:17.669848 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cncmp\" (UniqueName: \"kubernetes.io/projected/241869d7-8118-40e8-8550-76c59263f7c7-kube-api-access-cncmp\") pod \"ironic-db-create-dsptr\" (UID: \"241869d7-8118-40e8-8550-76c59263f7c7\") " pod="openstack/ironic-db-create-dsptr" Dec 04 12:21:17.673717 master-0 kubenswrapper[35367]: I1204 12:21:17.671467 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:17.673717 master-0 kubenswrapper[35367]: I1204 12:21:17.672212 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-config\") pod \"dnsmasq-dns-8575ff9b5-t5m24\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:17.681469 master-0 kubenswrapper[35367]: I1204 12:21:17.676139 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-ovsdbserver-sb\") pod \"dnsmasq-dns-8575ff9b5-t5m24\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:17.681469 master-0 kubenswrapper[35367]: I1204 12:21:17.677009 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-config\") pod \"dnsmasq-dns-8575ff9b5-t5m24\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:17.681469 master-0 kubenswrapper[35367]: I1204 12:21:17.677581 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-dns-swift-storage-0\") pod \"dnsmasq-dns-8575ff9b5-t5m24\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:17.681469 master-0 kubenswrapper[35367]: I1204 12:21:17.678579 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-ovsdbserver-nb\") pod \"dnsmasq-dns-8575ff9b5-t5m24\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:17.689846 master-0 kubenswrapper[35367]: I1204 12:21:17.688625 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-8575ff9b5-t5m24"] Dec 04 12:21:17.745408 master-0 kubenswrapper[35367]: I1204 12:21:17.745331 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-dns-svc\") pod \"dnsmasq-dns-8575ff9b5-t5m24\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:17.748889 master-0 kubenswrapper[35367]: I1204 12:21:17.746768 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq9ck\" (UniqueName: \"kubernetes.io/projected/9d3c7130-ade7-4628-80b9-ada3d0941c90-kube-api-access-fq9ck\") pod \"dnsmasq-dns-8575ff9b5-t5m24\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:17.759891 master-0 kubenswrapper[35367]: I1204 12:21:17.757935 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-db-create-dsptr"] Dec 04 12:21:17.782587 master-0 kubenswrapper[35367]: I1204 12:21:17.782505 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-0c69e-db-sync-x9w96"] Dec 04 12:21:17.784126 master-0 kubenswrapper[35367]: I1204 12:21:17.784066 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cncmp\" (UniqueName: \"kubernetes.io/projected/241869d7-8118-40e8-8550-76c59263f7c7-kube-api-access-cncmp\") pod \"ironic-db-create-dsptr\" (UID: \"241869d7-8118-40e8-8550-76c59263f7c7\") " pod="openstack/ironic-db-create-dsptr" Dec 04 12:21:17.784498 master-0 kubenswrapper[35367]: I1204 12:21:17.782651 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-749df7dbf7-vjbqp" Dec 04 12:21:17.786165 master-0 kubenswrapper[35367]: I1204 12:21:17.786125 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:17.788712 master-0 kubenswrapper[35367]: I1204 12:21:17.788679 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/241869d7-8118-40e8-8550-76c59263f7c7-operator-scripts\") pod \"ironic-db-create-dsptr\" (UID: \"241869d7-8118-40e8-8550-76c59263f7c7\") " pod="openstack/ironic-db-create-dsptr" Dec 04 12:21:17.790059 master-0 kubenswrapper[35367]: I1204 12:21:17.789968 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/241869d7-8118-40e8-8550-76c59263f7c7-operator-scripts\") pod \"ironic-db-create-dsptr\" (UID: \"241869d7-8118-40e8-8550-76c59263f7c7\") " pod="openstack/ironic-db-create-dsptr" Dec 04 12:21:17.791778 master-0 kubenswrapper[35367]: I1204 12:21:17.791713 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-0c69e-scripts" Dec 04 12:21:17.792330 master-0 kubenswrapper[35367]: I1204 12:21:17.792125 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-0c69e-config-data" Dec 04 12:21:17.814636 master-0 kubenswrapper[35367]: I1204 12:21:17.814535 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cncmp\" (UniqueName: \"kubernetes.io/projected/241869d7-8118-40e8-8550-76c59263f7c7-kube-api-access-cncmp\") pod \"ironic-db-create-dsptr\" (UID: \"241869d7-8118-40e8-8550-76c59263f7c7\") " pod="openstack/ironic-db-create-dsptr" Dec 04 12:21:17.823021 master-0 kubenswrapper[35367]: I1204 12:21:17.822970 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-0c69e-db-sync-x9w96"] Dec 04 12:21:17.897420 master-0 kubenswrapper[35367]: I1204 12:21:17.886032 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/neutron-db-sync-ck757"] Dec 04 12:21:17.897420 master-0 kubenswrapper[35367]: I1204 12:21:17.888188 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-db-sync-ck757" Dec 04 12:21:17.897420 master-0 kubenswrapper[35367]: I1204 12:21:17.890126 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:17.897420 master-0 kubenswrapper[35367]: I1204 12:21:17.890963 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"neutron-httpd-config" Dec 04 12:21:17.897420 master-0 kubenswrapper[35367]: I1204 12:21:17.892463 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-config-data\") pod \"cinder-0c69e-db-sync-x9w96\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:17.897420 master-0 kubenswrapper[35367]: I1204 12:21:17.892581 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e72935b7-293c-4160-a02a-cbf179274ab0-etc-machine-id\") pod \"cinder-0c69e-db-sync-x9w96\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:17.897420 master-0 kubenswrapper[35367]: I1204 12:21:17.892619 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-db-sync-config-data\") pod \"cinder-0c69e-db-sync-x9w96\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:17.897420 master-0 kubenswrapper[35367]: I1204 12:21:17.892744 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmq2f\" (UniqueName: \"kubernetes.io/projected/e72935b7-293c-4160-a02a-cbf179274ab0-kube-api-access-vmq2f\") pod \"cinder-0c69e-db-sync-x9w96\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:17.897420 master-0 kubenswrapper[35367]: I1204 12:21:17.892796 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-scripts\") pod \"cinder-0c69e-db-sync-x9w96\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:17.897420 master-0 kubenswrapper[35367]: I1204 12:21:17.892938 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-combined-ca-bundle\") pod \"cinder-0c69e-db-sync-x9w96\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:17.897420 master-0 kubenswrapper[35367]: I1204 12:21:17.895307 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"neutron-config" Dec 04 12:21:17.909093 master-0 kubenswrapper[35367]: I1204 12:21:17.909000 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-f7e2-account-create-update-mlr6p"] Dec 04 12:21:17.913749 master-0 kubenswrapper[35367]: I1204 12:21:17.910642 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-db-create-dsptr" Dec 04 12:21:17.913749 master-0 kubenswrapper[35367]: I1204 12:21:17.911120 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-f7e2-account-create-update-mlr6p" Dec 04 12:21:17.922281 master-0 kubenswrapper[35367]: I1204 12:21:17.922223 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-db-secret" Dec 04 12:21:17.928342 master-0 kubenswrapper[35367]: I1204 12:21:17.927775 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-db-sync-ck757"] Dec 04 12:21:17.939397 master-0 kubenswrapper[35367]: I1204 12:21:17.938247 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-749df7dbf7-vjbqp" Dec 04 12:21:17.943541 master-0 kubenswrapper[35367]: I1204 12:21:17.943502 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-f7e2-account-create-update-mlr6p"] Dec 04 12:21:17.963652 master-0 kubenswrapper[35367]: I1204 12:21:17.963547 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/placement-db-sync-hlw45"] Dec 04 12:21:17.968520 master-0 kubenswrapper[35367]: I1204 12:21:17.965789 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-db-sync-hlw45" Dec 04 12:21:17.970302 master-0 kubenswrapper[35367]: I1204 12:21:17.969686 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"placement-config-data" Dec 04 12:21:17.970302 master-0 kubenswrapper[35367]: I1204 12:21:17.970130 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"placement-scripts" Dec 04 12:21:17.982076 master-0 kubenswrapper[35367]: I1204 12:21:17.981925 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-8575ff9b5-t5m24"] Dec 04 12:21:17.995483 master-0 kubenswrapper[35367]: I1204 12:21:17.995415 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-dns-svc\") pod \"7c03bd6a-a573-4935-be44-232bb5059c18\" (UID: \"7c03bd6a-a573-4935-be44-232bb5059c18\") " Dec 04 12:21:17.995611 master-0 kubenswrapper[35367]: I1204 12:21:17.995502 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-ovsdbserver-sb\") pod \"7c03bd6a-a573-4935-be44-232bb5059c18\" (UID: \"7c03bd6a-a573-4935-be44-232bb5059c18\") " Dec 04 12:21:17.995775 master-0 kubenswrapper[35367]: I1204 12:21:17.995744 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-config\") pod \"7c03bd6a-a573-4935-be44-232bb5059c18\" (UID: \"7c03bd6a-a573-4935-be44-232bb5059c18\") " Dec 04 12:21:17.995848 master-0 kubenswrapper[35367]: I1204 12:21:17.995829 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6clvl\" (UniqueName: \"kubernetes.io/projected/7c03bd6a-a573-4935-be44-232bb5059c18-kube-api-access-6clvl\") pod \"7c03bd6a-a573-4935-be44-232bb5059c18\" (UID: \"7c03bd6a-a573-4935-be44-232bb5059c18\") " Dec 04 12:21:17.995957 master-0 kubenswrapper[35367]: I1204 12:21:17.995903 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-ovsdbserver-nb\") pod \"7c03bd6a-a573-4935-be44-232bb5059c18\" (UID: \"7c03bd6a-a573-4935-be44-232bb5059c18\") " Dec 04 12:21:17.996640 master-0 kubenswrapper[35367]: I1204 12:21:17.996599 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e72935b7-293c-4160-a02a-cbf179274ab0-etc-machine-id\") pod \"cinder-0c69e-db-sync-x9w96\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:17.996711 master-0 kubenswrapper[35367]: I1204 12:21:17.996667 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-db-sync-config-data\") pod \"cinder-0c69e-db-sync-x9w96\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:17.996750 master-0 kubenswrapper[35367]: I1204 12:21:17.996731 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0e9b193-ab20-484e-b727-c24c8aecb2c5-logs\") pod \"placement-db-sync-hlw45\" (UID: \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\") " pod="openstack/placement-db-sync-hlw45" Dec 04 12:21:17.996794 master-0 kubenswrapper[35367]: I1204 12:21:17.996761 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0e9b193-ab20-484e-b727-c24c8aecb2c5-config-data\") pod \"placement-db-sync-hlw45\" (UID: \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\") " pod="openstack/placement-db-sync-hlw45" Dec 04 12:21:17.996947 master-0 kubenswrapper[35367]: I1204 12:21:17.996871 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3b713b22-8016-49e5-999d-a69c23149635-config\") pod \"neutron-db-sync-ck757\" (UID: \"3b713b22-8016-49e5-999d-a69c23149635\") " pod="openstack/neutron-db-sync-ck757" Dec 04 12:21:17.996947 master-0 kubenswrapper[35367]: I1204 12:21:17.996925 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/de1c0574-23b1-4430-8d67-76a0f30bad90-operator-scripts\") pod \"ironic-f7e2-account-create-update-mlr6p\" (UID: \"de1c0574-23b1-4430-8d67-76a0f30bad90\") " pod="openstack/ironic-f7e2-account-create-update-mlr6p" Dec 04 12:21:17.997022 master-0 kubenswrapper[35367]: I1204 12:21:17.996950 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg8v6\" (UniqueName: \"kubernetes.io/projected/de1c0574-23b1-4430-8d67-76a0f30bad90-kube-api-access-gg8v6\") pod \"ironic-f7e2-account-create-update-mlr6p\" (UID: \"de1c0574-23b1-4430-8d67-76a0f30bad90\") " pod="openstack/ironic-f7e2-account-create-update-mlr6p" Dec 04 12:21:17.997022 master-0 kubenswrapper[35367]: I1204 12:21:17.997006 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vmq2f\" (UniqueName: \"kubernetes.io/projected/e72935b7-293c-4160-a02a-cbf179274ab0-kube-api-access-vmq2f\") pod \"cinder-0c69e-db-sync-x9w96\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:17.997087 master-0 kubenswrapper[35367]: I1204 12:21:17.997045 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-scripts\") pod \"cinder-0c69e-db-sync-x9w96\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:17.997087 master-0 kubenswrapper[35367]: I1204 12:21:17.997071 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-combined-ca-bundle\") pod \"cinder-0c69e-db-sync-x9w96\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:17.997147 master-0 kubenswrapper[35367]: I1204 12:21:17.997125 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0e9b193-ab20-484e-b727-c24c8aecb2c5-combined-ca-bundle\") pod \"placement-db-sync-hlw45\" (UID: \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\") " pod="openstack/placement-db-sync-hlw45" Dec 04 12:21:17.997188 master-0 kubenswrapper[35367]: I1204 12:21:17.997155 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqsx6\" (UniqueName: \"kubernetes.io/projected/3b713b22-8016-49e5-999d-a69c23149635-kube-api-access-xqsx6\") pod \"neutron-db-sync-ck757\" (UID: \"3b713b22-8016-49e5-999d-a69c23149635\") " pod="openstack/neutron-db-sync-ck757" Dec 04 12:21:17.997235 master-0 kubenswrapper[35367]: I1204 12:21:17.997215 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b713b22-8016-49e5-999d-a69c23149635-combined-ca-bundle\") pod \"neutron-db-sync-ck757\" (UID: \"3b713b22-8016-49e5-999d-a69c23149635\") " pod="openstack/neutron-db-sync-ck757" Dec 04 12:21:17.997404 master-0 kubenswrapper[35367]: I1204 12:21:17.997335 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-config-data\") pod \"cinder-0c69e-db-sync-x9w96\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:17.997452 master-0 kubenswrapper[35367]: I1204 12:21:17.997436 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cfh2\" (UniqueName: \"kubernetes.io/projected/f0e9b193-ab20-484e-b727-c24c8aecb2c5-kube-api-access-2cfh2\") pod \"placement-db-sync-hlw45\" (UID: \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\") " pod="openstack/placement-db-sync-hlw45" Dec 04 12:21:17.997540 master-0 kubenswrapper[35367]: I1204 12:21:17.997508 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0e9b193-ab20-484e-b727-c24c8aecb2c5-scripts\") pod \"placement-db-sync-hlw45\" (UID: \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\") " pod="openstack/placement-db-sync-hlw45" Dec 04 12:21:17.999113 master-0 kubenswrapper[35367]: I1204 12:21:17.999047 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "7c03bd6a-a573-4935-be44-232bb5059c18" (UID: "7c03bd6a-a573-4935-be44-232bb5059c18"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:17.999637 master-0 kubenswrapper[35367]: I1204 12:21:17.999548 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "7c03bd6a-a573-4935-be44-232bb5059c18" (UID: "7c03bd6a-a573-4935-be44-232bb5059c18"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:18.000166 master-0 kubenswrapper[35367]: I1204 12:21:18.000133 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-config" (OuterVolumeSpecName: "config") pod "7c03bd6a-a573-4935-be44-232bb5059c18" (UID: "7c03bd6a-a573-4935-be44-232bb5059c18"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:18.004035 master-0 kubenswrapper[35367]: I1204 12:21:18.003933 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c03bd6a-a573-4935-be44-232bb5059c18-kube-api-access-6clvl" (OuterVolumeSpecName: "kube-api-access-6clvl") pod "7c03bd6a-a573-4935-be44-232bb5059c18" (UID: "7c03bd6a-a573-4935-be44-232bb5059c18"). InnerVolumeSpecName "kube-api-access-6clvl". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:21:18.004511 master-0 kubenswrapper[35367]: I1204 12:21:18.004435 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "7c03bd6a-a573-4935-be44-232bb5059c18" (UID: "7c03bd6a-a573-4935-be44-232bb5059c18"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:18.004585 master-0 kubenswrapper[35367]: I1204 12:21:18.004515 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e72935b7-293c-4160-a02a-cbf179274ab0-etc-machine-id\") pod \"cinder-0c69e-db-sync-x9w96\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:18.012104 master-0 kubenswrapper[35367]: I1204 12:21:18.010198 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-db-sync-hlw45"] Dec 04 12:21:18.012904 master-0 kubenswrapper[35367]: I1204 12:21:18.012485 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-db-sync-config-data\") pod \"cinder-0c69e-db-sync-x9w96\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:18.019652 master-0 kubenswrapper[35367]: I1204 12:21:18.019584 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-scripts\") pod \"cinder-0c69e-db-sync-x9w96\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:18.027977 master-0 kubenswrapper[35367]: I1204 12:21:18.025307 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-combined-ca-bundle\") pod \"cinder-0c69e-db-sync-x9w96\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:18.027977 master-0 kubenswrapper[35367]: I1204 12:21:18.027782 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-config-data\") pod \"cinder-0c69e-db-sync-x9w96\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:18.039348 master-0 kubenswrapper[35367]: I1204 12:21:18.039287 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmq2f\" (UniqueName: \"kubernetes.io/projected/e72935b7-293c-4160-a02a-cbf179274ab0-kube-api-access-vmq2f\") pod \"cinder-0c69e-db-sync-x9w96\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:18.049992 master-0 kubenswrapper[35367]: I1204 12:21:18.049914 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-fd8dd6b45-8nntp"] Dec 04 12:21:18.059769 master-0 kubenswrapper[35367]: I1204 12:21:18.059379 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:18.067440 master-0 kubenswrapper[35367]: I1204 12:21:18.062355 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-fd8dd6b45-8nntp"] Dec 04 12:21:18.102681 master-0 kubenswrapper[35367]: I1204 12:21:18.102491 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2cfh2\" (UniqueName: \"kubernetes.io/projected/f0e9b193-ab20-484e-b727-c24c8aecb2c5-kube-api-access-2cfh2\") pod \"placement-db-sync-hlw45\" (UID: \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\") " pod="openstack/placement-db-sync-hlw45" Dec 04 12:21:18.102681 master-0 kubenswrapper[35367]: I1204 12:21:18.102628 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0e9b193-ab20-484e-b727-c24c8aecb2c5-scripts\") pod \"placement-db-sync-hlw45\" (UID: \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\") " pod="openstack/placement-db-sync-hlw45" Dec 04 12:21:18.106128 master-0 kubenswrapper[35367]: I1204 12:21:18.106071 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdbqm\" (UniqueName: \"kubernetes.io/projected/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-kube-api-access-bdbqm\") pod \"dnsmasq-dns-fd8dd6b45-8nntp\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:18.106328 master-0 kubenswrapper[35367]: I1204 12:21:18.106169 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-dns-swift-storage-0\") pod \"dnsmasq-dns-fd8dd6b45-8nntp\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:18.106484 master-0 kubenswrapper[35367]: I1204 12:21:18.106354 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0e9b193-ab20-484e-b727-c24c8aecb2c5-logs\") pod \"placement-db-sync-hlw45\" (UID: \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\") " pod="openstack/placement-db-sync-hlw45" Dec 04 12:21:18.106484 master-0 kubenswrapper[35367]: I1204 12:21:18.106435 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-dns-svc\") pod \"dnsmasq-dns-fd8dd6b45-8nntp\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:18.106556 master-0 kubenswrapper[35367]: I1204 12:21:18.106481 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0e9b193-ab20-484e-b727-c24c8aecb2c5-config-data\") pod \"placement-db-sync-hlw45\" (UID: \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\") " pod="openstack/placement-db-sync-hlw45" Dec 04 12:21:18.106675 master-0 kubenswrapper[35367]: I1204 12:21:18.106656 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3b713b22-8016-49e5-999d-a69c23149635-config\") pod \"neutron-db-sync-ck757\" (UID: \"3b713b22-8016-49e5-999d-a69c23149635\") " pod="openstack/neutron-db-sync-ck757" Dec 04 12:21:18.106764 master-0 kubenswrapper[35367]: I1204 12:21:18.106744 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-config\") pod \"dnsmasq-dns-fd8dd6b45-8nntp\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:18.106830 master-0 kubenswrapper[35367]: I1204 12:21:18.106781 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/de1c0574-23b1-4430-8d67-76a0f30bad90-operator-scripts\") pod \"ironic-f7e2-account-create-update-mlr6p\" (UID: \"de1c0574-23b1-4430-8d67-76a0f30bad90\") " pod="openstack/ironic-f7e2-account-create-update-mlr6p" Dec 04 12:21:18.106830 master-0 kubenswrapper[35367]: I1204 12:21:18.106820 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gg8v6\" (UniqueName: \"kubernetes.io/projected/de1c0574-23b1-4430-8d67-76a0f30bad90-kube-api-access-gg8v6\") pod \"ironic-f7e2-account-create-update-mlr6p\" (UID: \"de1c0574-23b1-4430-8d67-76a0f30bad90\") " pod="openstack/ironic-f7e2-account-create-update-mlr6p" Dec 04 12:21:18.106935 master-0 kubenswrapper[35367]: I1204 12:21:18.106914 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-ovsdbserver-nb\") pod \"dnsmasq-dns-fd8dd6b45-8nntp\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:18.107140 master-0 kubenswrapper[35367]: I1204 12:21:18.107082 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0e9b193-ab20-484e-b727-c24c8aecb2c5-combined-ca-bundle\") pod \"placement-db-sync-hlw45\" (UID: \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\") " pod="openstack/placement-db-sync-hlw45" Dec 04 12:21:18.107140 master-0 kubenswrapper[35367]: I1204 12:21:18.107118 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xqsx6\" (UniqueName: \"kubernetes.io/projected/3b713b22-8016-49e5-999d-a69c23149635-kube-api-access-xqsx6\") pod \"neutron-db-sync-ck757\" (UID: \"3b713b22-8016-49e5-999d-a69c23149635\") " pod="openstack/neutron-db-sync-ck757" Dec 04 12:21:18.107235 master-0 kubenswrapper[35367]: I1204 12:21:18.107153 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-ovsdbserver-sb\") pod \"dnsmasq-dns-fd8dd6b45-8nntp\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:18.107273 master-0 kubenswrapper[35367]: I1204 12:21:18.107234 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b713b22-8016-49e5-999d-a69c23149635-combined-ca-bundle\") pod \"neutron-db-sync-ck757\" (UID: \"3b713b22-8016-49e5-999d-a69c23149635\") " pod="openstack/neutron-db-sync-ck757" Dec 04 12:21:18.110404 master-0 kubenswrapper[35367]: I1204 12:21:18.107850 35367 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:18.110404 master-0 kubenswrapper[35367]: I1204 12:21:18.107888 35367 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:18.110404 master-0 kubenswrapper[35367]: I1204 12:21:18.107911 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:18.110404 master-0 kubenswrapper[35367]: I1204 12:21:18.107925 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6clvl\" (UniqueName: \"kubernetes.io/projected/7c03bd6a-a573-4935-be44-232bb5059c18-kube-api-access-6clvl\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:18.110404 master-0 kubenswrapper[35367]: I1204 12:21:18.107940 35367 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/7c03bd6a-a573-4935-be44-232bb5059c18-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:18.110404 master-0 kubenswrapper[35367]: I1204 12:21:18.108655 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/de1c0574-23b1-4430-8d67-76a0f30bad90-operator-scripts\") pod \"ironic-f7e2-account-create-update-mlr6p\" (UID: \"de1c0574-23b1-4430-8d67-76a0f30bad90\") " pod="openstack/ironic-f7e2-account-create-update-mlr6p" Dec 04 12:21:18.110404 master-0 kubenswrapper[35367]: I1204 12:21:18.108936 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0e9b193-ab20-484e-b727-c24c8aecb2c5-logs\") pod \"placement-db-sync-hlw45\" (UID: \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\") " pod="openstack/placement-db-sync-hlw45" Dec 04 12:21:18.110404 master-0 kubenswrapper[35367]: I1204 12:21:18.109845 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0e9b193-ab20-484e-b727-c24c8aecb2c5-scripts\") pod \"placement-db-sync-hlw45\" (UID: \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\") " pod="openstack/placement-db-sync-hlw45" Dec 04 12:21:18.116539 master-0 kubenswrapper[35367]: I1204 12:21:18.116460 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0e9b193-ab20-484e-b727-c24c8aecb2c5-combined-ca-bundle\") pod \"placement-db-sync-hlw45\" (UID: \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\") " pod="openstack/placement-db-sync-hlw45" Dec 04 12:21:18.118849 master-0 kubenswrapper[35367]: I1204 12:21:18.118655 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3b713b22-8016-49e5-999d-a69c23149635-config\") pod \"neutron-db-sync-ck757\" (UID: \"3b713b22-8016-49e5-999d-a69c23149635\") " pod="openstack/neutron-db-sync-ck757" Dec 04 12:21:18.119822 master-0 kubenswrapper[35367]: I1204 12:21:18.119732 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0e9b193-ab20-484e-b727-c24c8aecb2c5-config-data\") pod \"placement-db-sync-hlw45\" (UID: \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\") " pod="openstack/placement-db-sync-hlw45" Dec 04 12:21:18.126430 master-0 kubenswrapper[35367]: I1204 12:21:18.126380 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b713b22-8016-49e5-999d-a69c23149635-combined-ca-bundle\") pod \"neutron-db-sync-ck757\" (UID: \"3b713b22-8016-49e5-999d-a69c23149635\") " pod="openstack/neutron-db-sync-ck757" Dec 04 12:21:18.129205 master-0 kubenswrapper[35367]: I1204 12:21:18.129155 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cfh2\" (UniqueName: \"kubernetes.io/projected/f0e9b193-ab20-484e-b727-c24c8aecb2c5-kube-api-access-2cfh2\") pod \"placement-db-sync-hlw45\" (UID: \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\") " pod="openstack/placement-db-sync-hlw45" Dec 04 12:21:18.152950 master-0 kubenswrapper[35367]: I1204 12:21:18.152878 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqsx6\" (UniqueName: \"kubernetes.io/projected/3b713b22-8016-49e5-999d-a69c23149635-kube-api-access-xqsx6\") pod \"neutron-db-sync-ck757\" (UID: \"3b713b22-8016-49e5-999d-a69c23149635\") " pod="openstack/neutron-db-sync-ck757" Dec 04 12:21:18.154322 master-0 kubenswrapper[35367]: I1204 12:21:18.154161 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg8v6\" (UniqueName: \"kubernetes.io/projected/de1c0574-23b1-4430-8d67-76a0f30bad90-kube-api-access-gg8v6\") pod \"ironic-f7e2-account-create-update-mlr6p\" (UID: \"de1c0574-23b1-4430-8d67-76a0f30bad90\") " pod="openstack/ironic-f7e2-account-create-update-mlr6p" Dec 04 12:21:18.211409 master-0 kubenswrapper[35367]: I1204 12:21:18.211312 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-config\") pod \"dnsmasq-dns-fd8dd6b45-8nntp\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:18.211762 master-0 kubenswrapper[35367]: I1204 12:21:18.211695 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-ovsdbserver-nb\") pod \"dnsmasq-dns-fd8dd6b45-8nntp\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:18.211977 master-0 kubenswrapper[35367]: I1204 12:21:18.211951 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-ovsdbserver-sb\") pod \"dnsmasq-dns-fd8dd6b45-8nntp\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:18.212606 master-0 kubenswrapper[35367]: I1204 12:21:18.212559 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bdbqm\" (UniqueName: \"kubernetes.io/projected/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-kube-api-access-bdbqm\") pod \"dnsmasq-dns-fd8dd6b45-8nntp\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:18.212670 master-0 kubenswrapper[35367]: I1204 12:21:18.212643 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-dns-swift-storage-0\") pod \"dnsmasq-dns-fd8dd6b45-8nntp\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:18.212876 master-0 kubenswrapper[35367]: I1204 12:21:18.212787 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-dns-svc\") pod \"dnsmasq-dns-fd8dd6b45-8nntp\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:18.213384 master-0 kubenswrapper[35367]: I1204 12:21:18.213296 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-ovsdbserver-nb\") pod \"dnsmasq-dns-fd8dd6b45-8nntp\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:18.214864 master-0 kubenswrapper[35367]: I1204 12:21:18.214792 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-ovsdbserver-sb\") pod \"dnsmasq-dns-fd8dd6b45-8nntp\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:18.215993 master-0 kubenswrapper[35367]: I1204 12:21:18.215936 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-dns-swift-storage-0\") pod \"dnsmasq-dns-fd8dd6b45-8nntp\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:18.216110 master-0 kubenswrapper[35367]: I1204 12:21:18.216002 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-dns-svc\") pod \"dnsmasq-dns-fd8dd6b45-8nntp\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:18.216766 master-0 kubenswrapper[35367]: I1204 12:21:18.216722 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-config\") pod \"dnsmasq-dns-fd8dd6b45-8nntp\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:18.236870 master-0 kubenswrapper[35367]: I1204 12:21:18.236742 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdbqm\" (UniqueName: \"kubernetes.io/projected/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-kube-api-access-bdbqm\") pod \"dnsmasq-dns-fd8dd6b45-8nntp\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:18.314119 master-0 kubenswrapper[35367]: I1204 12:21:18.314030 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:18.331584 master-0 kubenswrapper[35367]: I1204 12:21:18.331522 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-bootstrap-xxnvq"] Dec 04 12:21:18.350479 master-0 kubenswrapper[35367]: I1204 12:21:18.350334 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-db-sync-ck757" Dec 04 12:21:18.373829 master-0 kubenswrapper[35367]: I1204 12:21:18.373756 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-f7e2-account-create-update-mlr6p" Dec 04 12:21:18.404919 master-0 kubenswrapper[35367]: I1204 12:21:18.404160 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-db-sync-hlw45" Dec 04 12:21:18.425940 master-0 kubenswrapper[35367]: I1204 12:21:18.425205 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:18.636663 master-0 kubenswrapper[35367]: I1204 12:21:18.635130 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-8575ff9b5-t5m24"] Dec 04 12:21:18.703008 master-0 kubenswrapper[35367]: I1204 12:21:18.702955 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-db-create-dsptr"] Dec 04 12:21:18.862013 master-0 kubenswrapper[35367]: I1204 12:21:18.861932 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-db-create-dsptr" event={"ID":"241869d7-8118-40e8-8550-76c59263f7c7","Type":"ContainerStarted","Data":"9746a5b73311dd57fa25f9002ef20e36bd612213086cb19a78f2de99a607ac48"} Dec 04 12:21:18.868732 master-0 kubenswrapper[35367]: I1204 12:21:18.868640 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" event={"ID":"9d3c7130-ade7-4628-80b9-ada3d0941c90","Type":"ContainerStarted","Data":"f997e066d8c0c210875321111875b076c2faed400c747a1eccdcfe52500e00f0"} Dec 04 12:21:18.871306 master-0 kubenswrapper[35367]: I1204 12:21:18.871237 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-749df7dbf7-vjbqp" Dec 04 12:21:18.871698 master-0 kubenswrapper[35367]: I1204 12:21:18.871596 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-bootstrap-xxnvq" event={"ID":"6003f8aa-82ad-4465-b61c-e956d45ce162","Type":"ContainerStarted","Data":"3affafdd4fe54a1b01c1eb382fd75dce6b8452a661cd02a127dd52b28cc56977"} Dec 04 12:21:19.316375 master-0 kubenswrapper[35367]: I1204 12:21:19.307787 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-0c69e-db-sync-x9w96"] Dec 04 12:21:19.342151 master-0 kubenswrapper[35367]: I1204 12:21:19.335472 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-f7e2-account-create-update-mlr6p"] Dec 04 12:21:19.352587 master-0 kubenswrapper[35367]: W1204 12:21:19.351858 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b713b22_8016_49e5_999d_a69c23149635.slice/crio-6de797acc502d7ebfee6fefd75294ff518f2ab5a91fa79a6d5fca0d0121b0346 WatchSource:0}: Error finding container 6de797acc502d7ebfee6fefd75294ff518f2ab5a91fa79a6d5fca0d0121b0346: Status 404 returned error can't find the container with id 6de797acc502d7ebfee6fefd75294ff518f2ab5a91fa79a6d5fca0d0121b0346 Dec 04 12:21:19.378233 master-0 kubenswrapper[35367]: I1204 12:21:19.376489 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-db-sync-ck757"] Dec 04 12:21:19.434122 master-0 kubenswrapper[35367]: I1204 12:21:19.434077 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-749df7dbf7-vjbqp"] Dec 04 12:21:19.452971 master-0 kubenswrapper[35367]: I1204 12:21:19.450595 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-749df7dbf7-vjbqp"] Dec 04 12:21:19.470146 master-0 kubenswrapper[35367]: I1204 12:21:19.470035 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-db-sync-hlw45"] Dec 04 12:21:19.492741 master-0 kubenswrapper[35367]: I1204 12:21:19.492587 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-fd8dd6b45-8nntp"] Dec 04 12:21:19.896293 master-0 kubenswrapper[35367]: I1204 12:21:19.896216 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-f7e2-account-create-update-mlr6p" event={"ID":"de1c0574-23b1-4430-8d67-76a0f30bad90","Type":"ContainerStarted","Data":"bf6f8c3b0ce5efdafab6b8bec11a76a6fb705803bdd287b9655e28c196e1ec40"} Dec 04 12:21:19.900697 master-0 kubenswrapper[35367]: I1204 12:21:19.900576 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-db-sync-hlw45" event={"ID":"f0e9b193-ab20-484e-b727-c24c8aecb2c5","Type":"ContainerStarted","Data":"7f23999743b541897fb7b7bea1cdef24d016c6b0541698efe667a7a68fa3f39e"} Dec 04 12:21:19.904242 master-0 kubenswrapper[35367]: I1204 12:21:19.904188 35367 generic.go:334] "Generic (PLEG): container finished" podID="241869d7-8118-40e8-8550-76c59263f7c7" containerID="3a8591c1596ea44b95ee52fc9bc0af27031e3adb6580c3305ded210b9c7547f3" exitCode=0 Dec 04 12:21:19.904565 master-0 kubenswrapper[35367]: I1204 12:21:19.904543 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-db-create-dsptr" event={"ID":"241869d7-8118-40e8-8550-76c59263f7c7","Type":"ContainerDied","Data":"3a8591c1596ea44b95ee52fc9bc0af27031e3adb6580c3305ded210b9c7547f3"} Dec 04 12:21:19.912925 master-0 kubenswrapper[35367]: I1204 12:21:19.912855 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-db-sync-x9w96" event={"ID":"e72935b7-293c-4160-a02a-cbf179274ab0","Type":"ContainerStarted","Data":"5fe82de13eec9f989fcfcdfca4101ebeec202d90ad6515cd2c1ce5005448c308"} Dec 04 12:21:19.917763 master-0 kubenswrapper[35367]: I1204 12:21:19.917690 35367 generic.go:334] "Generic (PLEG): container finished" podID="9d3c7130-ade7-4628-80b9-ada3d0941c90" containerID="d14c381221f39588549169194de49a8b770e439cd9b15a0a63e30e3bcf215daa" exitCode=0 Dec 04 12:21:19.918075 master-0 kubenswrapper[35367]: I1204 12:21:19.917830 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" event={"ID":"9d3c7130-ade7-4628-80b9-ada3d0941c90","Type":"ContainerDied","Data":"d14c381221f39588549169194de49a8b770e439cd9b15a0a63e30e3bcf215daa"} Dec 04 12:21:19.922780 master-0 kubenswrapper[35367]: I1204 12:21:19.922615 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-bootstrap-xxnvq" event={"ID":"6003f8aa-82ad-4465-b61c-e956d45ce162","Type":"ContainerStarted","Data":"a3d463e996a76ce2d1379bf3356c4486289488e2f57b19406c3eb02c79133012"} Dec 04 12:21:19.933969 master-0 kubenswrapper[35367]: I1204 12:21:19.927327 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" event={"ID":"2ec5d2f3-2ce5-48f6-951a-3579aeba6439","Type":"ContainerStarted","Data":"4cb53096ff0c865b09fd912597def5d6531e275861c26cc5eab9383ce04c1f9f"} Dec 04 12:21:19.933969 master-0 kubenswrapper[35367]: I1204 12:21:19.931621 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-db-sync-ck757" event={"ID":"3b713b22-8016-49e5-999d-a69c23149635","Type":"ContainerStarted","Data":"6de797acc502d7ebfee6fefd75294ff518f2ab5a91fa79a6d5fca0d0121b0346"} Dec 04 12:21:19.991304 master-0 kubenswrapper[35367]: I1204 12:21:19.991182 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/neutron-db-sync-ck757" podStartSLOduration=2.99115617 podStartE2EDuration="2.99115617s" podCreationTimestamp="2025-12-04 12:21:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:21:19.9645742 +0000 UTC m=+1323.402635458" watchObservedRunningTime="2025-12-04 12:21:19.99115617 +0000 UTC m=+1323.429217428" Dec 04 12:21:20.085756 master-0 kubenswrapper[35367]: I1204 12:21:20.085681 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/keystone-bootstrap-xxnvq" podStartSLOduration=3.085660464 podStartE2EDuration="3.085660464s" podCreationTimestamp="2025-12-04 12:21:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:21:20.028264871 +0000 UTC m=+1323.466326129" watchObservedRunningTime="2025-12-04 12:21:20.085660464 +0000 UTC m=+1323.523721722" Dec 04 12:21:20.775886 master-0 kubenswrapper[35367]: I1204 12:21:20.775795 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:20.782137 master-0 kubenswrapper[35367]: I1204 12:21:20.782059 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c03bd6a-a573-4935-be44-232bb5059c18" path="/var/lib/kubelet/pods/7c03bd6a-a573-4935-be44-232bb5059c18/volumes" Dec 04 12:21:20.908901 master-0 kubenswrapper[35367]: I1204 12:21:20.908121 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fq9ck\" (UniqueName: \"kubernetes.io/projected/9d3c7130-ade7-4628-80b9-ada3d0941c90-kube-api-access-fq9ck\") pod \"9d3c7130-ade7-4628-80b9-ada3d0941c90\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " Dec 04 12:21:20.909546 master-0 kubenswrapper[35367]: I1204 12:21:20.908943 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-config\") pod \"9d3c7130-ade7-4628-80b9-ada3d0941c90\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " Dec 04 12:21:20.909546 master-0 kubenswrapper[35367]: I1204 12:21:20.909101 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-dns-swift-storage-0\") pod \"9d3c7130-ade7-4628-80b9-ada3d0941c90\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " Dec 04 12:21:20.909546 master-0 kubenswrapper[35367]: I1204 12:21:20.909132 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-dns-svc\") pod \"9d3c7130-ade7-4628-80b9-ada3d0941c90\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " Dec 04 12:21:20.909546 master-0 kubenswrapper[35367]: I1204 12:21:20.909393 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-ovsdbserver-sb\") pod \"9d3c7130-ade7-4628-80b9-ada3d0941c90\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " Dec 04 12:21:20.909546 master-0 kubenswrapper[35367]: I1204 12:21:20.909441 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-ovsdbserver-nb\") pod \"9d3c7130-ade7-4628-80b9-ada3d0941c90\" (UID: \"9d3c7130-ade7-4628-80b9-ada3d0941c90\") " Dec 04 12:21:20.915084 master-0 kubenswrapper[35367]: I1204 12:21:20.915008 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d3c7130-ade7-4628-80b9-ada3d0941c90-kube-api-access-fq9ck" (OuterVolumeSpecName: "kube-api-access-fq9ck") pod "9d3c7130-ade7-4628-80b9-ada3d0941c90" (UID: "9d3c7130-ade7-4628-80b9-ada3d0941c90"). InnerVolumeSpecName "kube-api-access-fq9ck". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:21:20.941730 master-0 kubenswrapper[35367]: I1204 12:21:20.941633 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "9d3c7130-ade7-4628-80b9-ada3d0941c90" (UID: "9d3c7130-ade7-4628-80b9-ada3d0941c90"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:20.945444 master-0 kubenswrapper[35367]: I1204 12:21:20.945110 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "9d3c7130-ade7-4628-80b9-ada3d0941c90" (UID: "9d3c7130-ade7-4628-80b9-ada3d0941c90"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:20.969033 master-0 kubenswrapper[35367]: I1204 12:21:20.968944 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-config" (OuterVolumeSpecName: "config") pod "9d3c7130-ade7-4628-80b9-ada3d0941c90" (UID: "9d3c7130-ade7-4628-80b9-ada3d0941c90"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:20.986633 master-0 kubenswrapper[35367]: I1204 12:21:20.985973 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-db-sync-ck757" event={"ID":"3b713b22-8016-49e5-999d-a69c23149635","Type":"ContainerStarted","Data":"3e0e3f13cb2d87e2c8132ee961379e19d1434a0669d5679d977ff80bb6a86470"} Dec 04 12:21:20.995030 master-0 kubenswrapper[35367]: I1204 12:21:20.994464 35367 generic.go:334] "Generic (PLEG): container finished" podID="de1c0574-23b1-4430-8d67-76a0f30bad90" containerID="05fd97dd460476d463bc913d79a465484536acc6e07b76dd609cebe18b895cb0" exitCode=0 Dec 04 12:21:20.995030 master-0 kubenswrapper[35367]: I1204 12:21:20.994566 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-f7e2-account-create-update-mlr6p" event={"ID":"de1c0574-23b1-4430-8d67-76a0f30bad90","Type":"ContainerDied","Data":"05fd97dd460476d463bc913d79a465484536acc6e07b76dd609cebe18b895cb0"} Dec 04 12:21:20.995418 master-0 kubenswrapper[35367]: I1204 12:21:20.995342 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "9d3c7130-ade7-4628-80b9-ada3d0941c90" (UID: "9d3c7130-ade7-4628-80b9-ada3d0941c90"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:21.004100 master-0 kubenswrapper[35367]: I1204 12:21:21.003395 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" Dec 04 12:21:21.004395 master-0 kubenswrapper[35367]: I1204 12:21:21.003396 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-8575ff9b5-t5m24" event={"ID":"9d3c7130-ade7-4628-80b9-ada3d0941c90","Type":"ContainerDied","Data":"f997e066d8c0c210875321111875b076c2faed400c747a1eccdcfe52500e00f0"} Dec 04 12:21:21.004470 master-0 kubenswrapper[35367]: I1204 12:21:21.004433 35367 scope.go:117] "RemoveContainer" containerID="d14c381221f39588549169194de49a8b770e439cd9b15a0a63e30e3bcf215daa" Dec 04 12:21:21.010544 master-0 kubenswrapper[35367]: I1204 12:21:21.010103 35367 generic.go:334] "Generic (PLEG): container finished" podID="2ec5d2f3-2ce5-48f6-951a-3579aeba6439" containerID="ad18d22768c790327376ca81ef00a442527ce771c9e094e2487f451d00bfd8d0" exitCode=0 Dec 04 12:21:21.012936 master-0 kubenswrapper[35367]: I1204 12:21:21.011419 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" event={"ID":"2ec5d2f3-2ce5-48f6-951a-3579aeba6439","Type":"ContainerDied","Data":"ad18d22768c790327376ca81ef00a442527ce771c9e094e2487f451d00bfd8d0"} Dec 04 12:21:21.018706 master-0 kubenswrapper[35367]: I1204 12:21:21.018557 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "9d3c7130-ade7-4628-80b9-ada3d0941c90" (UID: "9d3c7130-ade7-4628-80b9-ada3d0941c90"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:21.019906 master-0 kubenswrapper[35367]: I1204 12:21:21.019524 35367 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:21.019906 master-0 kubenswrapper[35367]: I1204 12:21:21.019555 35367 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:21.019906 master-0 kubenswrapper[35367]: I1204 12:21:21.019568 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fq9ck\" (UniqueName: \"kubernetes.io/projected/9d3c7130-ade7-4628-80b9-ada3d0941c90-kube-api-access-fq9ck\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:21.019906 master-0 kubenswrapper[35367]: I1204 12:21:21.019584 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:21.019906 master-0 kubenswrapper[35367]: I1204 12:21:21.019597 35367 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-dns-swift-storage-0\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:21.019906 master-0 kubenswrapper[35367]: I1204 12:21:21.019611 35367 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/9d3c7130-ade7-4628-80b9-ada3d0941c90-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:21.498525 master-0 kubenswrapper[35367]: I1204 12:21:21.498477 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-db-create-dsptr" Dec 04 12:21:21.597322 master-0 kubenswrapper[35367]: I1204 12:21:21.596783 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-8575ff9b5-t5m24"] Dec 04 12:21:21.597322 master-0 kubenswrapper[35367]: I1204 12:21:21.597161 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/241869d7-8118-40e8-8550-76c59263f7c7-operator-scripts\") pod \"241869d7-8118-40e8-8550-76c59263f7c7\" (UID: \"241869d7-8118-40e8-8550-76c59263f7c7\") " Dec 04 12:21:21.598240 master-0 kubenswrapper[35367]: I1204 12:21:21.598213 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/241869d7-8118-40e8-8550-76c59263f7c7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "241869d7-8118-40e8-8550-76c59263f7c7" (UID: "241869d7-8118-40e8-8550-76c59263f7c7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:21.612229 master-0 kubenswrapper[35367]: I1204 12:21:21.612166 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-8575ff9b5-t5m24"] Dec 04 12:21:21.701406 master-0 kubenswrapper[35367]: I1204 12:21:21.700836 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cncmp\" (UniqueName: \"kubernetes.io/projected/241869d7-8118-40e8-8550-76c59263f7c7-kube-api-access-cncmp\") pod \"241869d7-8118-40e8-8550-76c59263f7c7\" (UID: \"241869d7-8118-40e8-8550-76c59263f7c7\") " Dec 04 12:21:21.703063 master-0 kubenswrapper[35367]: I1204 12:21:21.703003 35367 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/241869d7-8118-40e8-8550-76c59263f7c7-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:21.707523 master-0 kubenswrapper[35367]: I1204 12:21:21.707434 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/241869d7-8118-40e8-8550-76c59263f7c7-kube-api-access-cncmp" (OuterVolumeSpecName: "kube-api-access-cncmp") pod "241869d7-8118-40e8-8550-76c59263f7c7" (UID: "241869d7-8118-40e8-8550-76c59263f7c7"). InnerVolumeSpecName "kube-api-access-cncmp". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:21:21.811497 master-0 kubenswrapper[35367]: I1204 12:21:21.806754 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cncmp\" (UniqueName: \"kubernetes.io/projected/241869d7-8118-40e8-8550-76c59263f7c7-kube-api-access-cncmp\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:22.035085 master-0 kubenswrapper[35367]: I1204 12:21:22.034499 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" event={"ID":"2ec5d2f3-2ce5-48f6-951a-3579aeba6439","Type":"ContainerStarted","Data":"4af8381503d052b48a9c170ee22aa603590c83164275ec586c3837058a0b9b08"} Dec 04 12:21:22.035085 master-0 kubenswrapper[35367]: I1204 12:21:22.034693 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:22.041214 master-0 kubenswrapper[35367]: I1204 12:21:22.041129 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-db-create-dsptr" event={"ID":"241869d7-8118-40e8-8550-76c59263f7c7","Type":"ContainerDied","Data":"9746a5b73311dd57fa25f9002ef20e36bd612213086cb19a78f2de99a607ac48"} Dec 04 12:21:22.041214 master-0 kubenswrapper[35367]: I1204 12:21:22.041202 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9746a5b73311dd57fa25f9002ef20e36bd612213086cb19a78f2de99a607ac48" Dec 04 12:21:22.042291 master-0 kubenswrapper[35367]: I1204 12:21:22.041900 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-db-create-dsptr" Dec 04 12:21:22.050939 master-0 kubenswrapper[35367]: I1204 12:21:22.047119 35367 generic.go:334] "Generic (PLEG): container finished" podID="859636b6-4875-4193-b2b7-cf13e258fee9" containerID="2c90db8b59d7eb21277b36492e67ff74acd7ee2a4b87af5c5ec79f7846363a83" exitCode=0 Dec 04 12:21:22.050939 master-0 kubenswrapper[35367]: I1204 12:21:22.047196 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-db-sync-x46tq" event={"ID":"859636b6-4875-4193-b2b7-cf13e258fee9","Type":"ContainerDied","Data":"2c90db8b59d7eb21277b36492e67ff74acd7ee2a4b87af5c5ec79f7846363a83"} Dec 04 12:21:22.084350 master-0 kubenswrapper[35367]: I1204 12:21:22.084149 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" podStartSLOduration=5.084121107 podStartE2EDuration="5.084121107s" podCreationTimestamp="2025-12-04 12:21:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:21:22.070494496 +0000 UTC m=+1325.508555764" watchObservedRunningTime="2025-12-04 12:21:22.084121107 +0000 UTC m=+1325.522182375" Dec 04 12:21:22.640585 master-0 kubenswrapper[35367]: I1204 12:21:22.640488 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-f7e2-account-create-update-mlr6p" Dec 04 12:21:22.834912 master-0 kubenswrapper[35367]: I1204 12:21:22.834833 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/de1c0574-23b1-4430-8d67-76a0f30bad90-operator-scripts\") pod \"de1c0574-23b1-4430-8d67-76a0f30bad90\" (UID: \"de1c0574-23b1-4430-8d67-76a0f30bad90\") " Dec 04 12:21:22.835235 master-0 kubenswrapper[35367]: I1204 12:21:22.835098 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gg8v6\" (UniqueName: \"kubernetes.io/projected/de1c0574-23b1-4430-8d67-76a0f30bad90-kube-api-access-gg8v6\") pod \"de1c0574-23b1-4430-8d67-76a0f30bad90\" (UID: \"de1c0574-23b1-4430-8d67-76a0f30bad90\") " Dec 04 12:21:22.835776 master-0 kubenswrapper[35367]: I1204 12:21:22.835554 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de1c0574-23b1-4430-8d67-76a0f30bad90-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "de1c0574-23b1-4430-8d67-76a0f30bad90" (UID: "de1c0574-23b1-4430-8d67-76a0f30bad90"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:22.837835 master-0 kubenswrapper[35367]: I1204 12:21:22.837765 35367 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/de1c0574-23b1-4430-8d67-76a0f30bad90-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:22.840593 master-0 kubenswrapper[35367]: I1204 12:21:22.840526 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d3c7130-ade7-4628-80b9-ada3d0941c90" path="/var/lib/kubelet/pods/9d3c7130-ade7-4628-80b9-ada3d0941c90/volumes" Dec 04 12:21:22.869462 master-0 kubenswrapper[35367]: I1204 12:21:22.869364 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de1c0574-23b1-4430-8d67-76a0f30bad90-kube-api-access-gg8v6" (OuterVolumeSpecName: "kube-api-access-gg8v6") pod "de1c0574-23b1-4430-8d67-76a0f30bad90" (UID: "de1c0574-23b1-4430-8d67-76a0f30bad90"). InnerVolumeSpecName "kube-api-access-gg8v6". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:21:22.952289 master-0 kubenswrapper[35367]: I1204 12:21:22.951657 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gg8v6\" (UniqueName: \"kubernetes.io/projected/de1c0574-23b1-4430-8d67-76a0f30bad90-kube-api-access-gg8v6\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:23.097190 master-0 kubenswrapper[35367]: I1204 12:21:23.097012 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-f7e2-account-create-update-mlr6p" Dec 04 12:21:23.097190 master-0 kubenswrapper[35367]: I1204 12:21:23.096997 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-f7e2-account-create-update-mlr6p" event={"ID":"de1c0574-23b1-4430-8d67-76a0f30bad90","Type":"ContainerDied","Data":"bf6f8c3b0ce5efdafab6b8bec11a76a6fb705803bdd287b9655e28c196e1ec40"} Dec 04 12:21:23.097190 master-0 kubenswrapper[35367]: I1204 12:21:23.097099 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf6f8c3b0ce5efdafab6b8bec11a76a6fb705803bdd287b9655e28c196e1ec40" Dec 04 12:21:24.124170 master-0 kubenswrapper[35367]: I1204 12:21:24.123676 35367 generic.go:334] "Generic (PLEG): container finished" podID="6003f8aa-82ad-4465-b61c-e956d45ce162" containerID="a3d463e996a76ce2d1379bf3356c4486289488e2f57b19406c3eb02c79133012" exitCode=0 Dec 04 12:21:24.124170 master-0 kubenswrapper[35367]: I1204 12:21:24.123747 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-bootstrap-xxnvq" event={"ID":"6003f8aa-82ad-4465-b61c-e956d45ce162","Type":"ContainerDied","Data":"a3d463e996a76ce2d1379bf3356c4486289488e2f57b19406c3eb02c79133012"} Dec 04 12:21:24.971893 master-0 kubenswrapper[35367]: I1204 12:21:24.971834 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-db-sync-x46tq" Dec 04 12:21:25.113680 master-0 kubenswrapper[35367]: I1204 12:21:25.113574 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/859636b6-4875-4193-b2b7-cf13e258fee9-config-data\") pod \"859636b6-4875-4193-b2b7-cf13e258fee9\" (UID: \"859636b6-4875-4193-b2b7-cf13e258fee9\") " Dec 04 12:21:25.114648 master-0 kubenswrapper[35367]: I1204 12:21:25.114595 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lsrg\" (UniqueName: \"kubernetes.io/projected/859636b6-4875-4193-b2b7-cf13e258fee9-kube-api-access-7lsrg\") pod \"859636b6-4875-4193-b2b7-cf13e258fee9\" (UID: \"859636b6-4875-4193-b2b7-cf13e258fee9\") " Dec 04 12:21:25.114813 master-0 kubenswrapper[35367]: I1204 12:21:25.114769 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/859636b6-4875-4193-b2b7-cf13e258fee9-combined-ca-bundle\") pod \"859636b6-4875-4193-b2b7-cf13e258fee9\" (UID: \"859636b6-4875-4193-b2b7-cf13e258fee9\") " Dec 04 12:21:25.115005 master-0 kubenswrapper[35367]: I1204 12:21:25.114979 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/859636b6-4875-4193-b2b7-cf13e258fee9-db-sync-config-data\") pod \"859636b6-4875-4193-b2b7-cf13e258fee9\" (UID: \"859636b6-4875-4193-b2b7-cf13e258fee9\") " Dec 04 12:21:25.122840 master-0 kubenswrapper[35367]: I1204 12:21:25.122742 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/859636b6-4875-4193-b2b7-cf13e258fee9-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "859636b6-4875-4193-b2b7-cf13e258fee9" (UID: "859636b6-4875-4193-b2b7-cf13e258fee9"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:25.123978 master-0 kubenswrapper[35367]: I1204 12:21:25.123935 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/859636b6-4875-4193-b2b7-cf13e258fee9-kube-api-access-7lsrg" (OuterVolumeSpecName: "kube-api-access-7lsrg") pod "859636b6-4875-4193-b2b7-cf13e258fee9" (UID: "859636b6-4875-4193-b2b7-cf13e258fee9"). InnerVolumeSpecName "kube-api-access-7lsrg". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:21:25.139893 master-0 kubenswrapper[35367]: I1204 12:21:25.139826 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-db-sync-x46tq" Dec 04 12:21:25.140691 master-0 kubenswrapper[35367]: I1204 12:21:25.140437 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-db-sync-x46tq" event={"ID":"859636b6-4875-4193-b2b7-cf13e258fee9","Type":"ContainerDied","Data":"2377d531fbdf7684951248873507bcb9627aec4c0992f98af1b4a1d5b9e6d49f"} Dec 04 12:21:25.140691 master-0 kubenswrapper[35367]: I1204 12:21:25.140478 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2377d531fbdf7684951248873507bcb9627aec4c0992f98af1b4a1d5b9e6d49f" Dec 04 12:21:25.162986 master-0 kubenswrapper[35367]: I1204 12:21:25.162835 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/859636b6-4875-4193-b2b7-cf13e258fee9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "859636b6-4875-4193-b2b7-cf13e258fee9" (UID: "859636b6-4875-4193-b2b7-cf13e258fee9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:25.205298 master-0 kubenswrapper[35367]: I1204 12:21:25.205012 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/859636b6-4875-4193-b2b7-cf13e258fee9-config-data" (OuterVolumeSpecName: "config-data") pod "859636b6-4875-4193-b2b7-cf13e258fee9" (UID: "859636b6-4875-4193-b2b7-cf13e258fee9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:25.221457 master-0 kubenswrapper[35367]: I1204 12:21:25.221294 35367 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/859636b6-4875-4193-b2b7-cf13e258fee9-db-sync-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:25.221457 master-0 kubenswrapper[35367]: I1204 12:21:25.221455 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/859636b6-4875-4193-b2b7-cf13e258fee9-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:25.221942 master-0 kubenswrapper[35367]: I1204 12:21:25.221474 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7lsrg\" (UniqueName: \"kubernetes.io/projected/859636b6-4875-4193-b2b7-cf13e258fee9-kube-api-access-7lsrg\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:25.221942 master-0 kubenswrapper[35367]: I1204 12:21:25.221513 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/859636b6-4875-4193-b2b7-cf13e258fee9-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:25.609216 master-0 kubenswrapper[35367]: I1204 12:21:25.609140 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:25.659240 master-0 kubenswrapper[35367]: I1204 12:21:25.659163 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-fernet-keys\") pod \"6003f8aa-82ad-4465-b61c-e956d45ce162\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " Dec 04 12:21:25.659240 master-0 kubenswrapper[35367]: I1204 12:21:25.659248 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-scripts\") pod \"6003f8aa-82ad-4465-b61c-e956d45ce162\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " Dec 04 12:21:25.659552 master-0 kubenswrapper[35367]: I1204 12:21:25.659301 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-credential-keys\") pod \"6003f8aa-82ad-4465-b61c-e956d45ce162\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " Dec 04 12:21:25.659552 master-0 kubenswrapper[35367]: I1204 12:21:25.659370 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j99x9\" (UniqueName: \"kubernetes.io/projected/6003f8aa-82ad-4465-b61c-e956d45ce162-kube-api-access-j99x9\") pod \"6003f8aa-82ad-4465-b61c-e956d45ce162\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " Dec 04 12:21:25.659552 master-0 kubenswrapper[35367]: I1204 12:21:25.659395 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-combined-ca-bundle\") pod \"6003f8aa-82ad-4465-b61c-e956d45ce162\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " Dec 04 12:21:25.659552 master-0 kubenswrapper[35367]: I1204 12:21:25.659422 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-config-data\") pod \"6003f8aa-82ad-4465-b61c-e956d45ce162\" (UID: \"6003f8aa-82ad-4465-b61c-e956d45ce162\") " Dec 04 12:21:25.664714 master-0 kubenswrapper[35367]: I1204 12:21:25.664649 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-scripts" (OuterVolumeSpecName: "scripts") pod "6003f8aa-82ad-4465-b61c-e956d45ce162" (UID: "6003f8aa-82ad-4465-b61c-e956d45ce162"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:25.664957 master-0 kubenswrapper[35367]: I1204 12:21:25.664727 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "6003f8aa-82ad-4465-b61c-e956d45ce162" (UID: "6003f8aa-82ad-4465-b61c-e956d45ce162"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:25.665123 master-0 kubenswrapper[35367]: I1204 12:21:25.665057 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6003f8aa-82ad-4465-b61c-e956d45ce162-kube-api-access-j99x9" (OuterVolumeSpecName: "kube-api-access-j99x9") pod "6003f8aa-82ad-4465-b61c-e956d45ce162" (UID: "6003f8aa-82ad-4465-b61c-e956d45ce162"). InnerVolumeSpecName "kube-api-access-j99x9". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:21:25.665295 master-0 kubenswrapper[35367]: I1204 12:21:25.665252 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "6003f8aa-82ad-4465-b61c-e956d45ce162" (UID: "6003f8aa-82ad-4465-b61c-e956d45ce162"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:25.694501 master-0 kubenswrapper[35367]: I1204 12:21:25.694428 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6003f8aa-82ad-4465-b61c-e956d45ce162" (UID: "6003f8aa-82ad-4465-b61c-e956d45ce162"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:25.713336 master-0 kubenswrapper[35367]: I1204 12:21:25.713253 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-config-data" (OuterVolumeSpecName: "config-data") pod "6003f8aa-82ad-4465-b61c-e956d45ce162" (UID: "6003f8aa-82ad-4465-b61c-e956d45ce162"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:25.763319 master-0 kubenswrapper[35367]: I1204 12:21:25.763139 35367 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-fernet-keys\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:25.763319 master-0 kubenswrapper[35367]: I1204 12:21:25.763247 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:25.763597 master-0 kubenswrapper[35367]: I1204 12:21:25.763478 35367 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-credential-keys\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:25.763597 master-0 kubenswrapper[35367]: I1204 12:21:25.763530 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-j99x9\" (UniqueName: \"kubernetes.io/projected/6003f8aa-82ad-4465-b61c-e956d45ce162-kube-api-access-j99x9\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:25.763597 master-0 kubenswrapper[35367]: I1204 12:21:25.763546 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:25.763597 master-0 kubenswrapper[35367]: I1204 12:21:25.763560 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6003f8aa-82ad-4465-b61c-e956d45ce162-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:26.156741 master-0 kubenswrapper[35367]: I1204 12:21:26.156635 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-bootstrap-xxnvq" event={"ID":"6003f8aa-82ad-4465-b61c-e956d45ce162","Type":"ContainerDied","Data":"3affafdd4fe54a1b01c1eb382fd75dce6b8452a661cd02a127dd52b28cc56977"} Dec 04 12:21:26.156741 master-0 kubenswrapper[35367]: I1204 12:21:26.156714 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3affafdd4fe54a1b01c1eb382fd75dce6b8452a661cd02a127dd52b28cc56977" Dec 04 12:21:26.157519 master-0 kubenswrapper[35367]: I1204 12:21:26.156862 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-bootstrap-xxnvq" Dec 04 12:21:26.171183 master-0 kubenswrapper[35367]: I1204 12:21:26.171100 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-db-sync-hlw45" event={"ID":"f0e9b193-ab20-484e-b727-c24c8aecb2c5","Type":"ContainerStarted","Data":"63a818c26d002b5ec86f3b80790345c055ac0a9076debc358d3f81a8e7e89870"} Dec 04 12:21:26.225646 master-0 kubenswrapper[35367]: I1204 12:21:26.225485 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/placement-db-sync-hlw45" podStartSLOduration=3.797563863 podStartE2EDuration="9.225453643s" podCreationTimestamp="2025-12-04 12:21:17 +0000 UTC" firstStartedPulling="2025-12-04 12:21:19.433800901 +0000 UTC m=+1322.871880359" lastFinishedPulling="2025-12-04 12:21:24.861708881 +0000 UTC m=+1328.299770139" observedRunningTime="2025-12-04 12:21:26.217228383 +0000 UTC m=+1329.655289641" watchObservedRunningTime="2025-12-04 12:21:26.225453643 +0000 UTC m=+1329.663514911" Dec 04 12:21:26.308820 master-0 kubenswrapper[35367]: I1204 12:21:26.308684 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/keystone-bootstrap-xxnvq"] Dec 04 12:21:26.339473 master-0 kubenswrapper[35367]: I1204 12:21:26.337995 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/keystone-bootstrap-xxnvq"] Dec 04 12:21:26.488620 master-0 kubenswrapper[35367]: I1204 12:21:26.487787 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/keystone-bootstrap-zzmjk"] Dec 04 12:21:26.489475 master-0 kubenswrapper[35367]: E1204 12:21:26.489449 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de1c0574-23b1-4430-8d67-76a0f30bad90" containerName="mariadb-account-create-update" Dec 04 12:21:26.489475 master-0 kubenswrapper[35367]: I1204 12:21:26.489475 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="de1c0574-23b1-4430-8d67-76a0f30bad90" containerName="mariadb-account-create-update" Dec 04 12:21:26.489603 master-0 kubenswrapper[35367]: E1204 12:21:26.489503 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="241869d7-8118-40e8-8550-76c59263f7c7" containerName="mariadb-database-create" Dec 04 12:21:26.489603 master-0 kubenswrapper[35367]: I1204 12:21:26.489535 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="241869d7-8118-40e8-8550-76c59263f7c7" containerName="mariadb-database-create" Dec 04 12:21:26.489603 master-0 kubenswrapper[35367]: E1204 12:21:26.489549 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="859636b6-4875-4193-b2b7-cf13e258fee9" containerName="glance-db-sync" Dec 04 12:21:26.489603 master-0 kubenswrapper[35367]: I1204 12:21:26.489557 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="859636b6-4875-4193-b2b7-cf13e258fee9" containerName="glance-db-sync" Dec 04 12:21:26.489603 master-0 kubenswrapper[35367]: E1204 12:21:26.489583 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6003f8aa-82ad-4465-b61c-e956d45ce162" containerName="keystone-bootstrap" Dec 04 12:21:26.490009 master-0 kubenswrapper[35367]: I1204 12:21:26.489614 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="6003f8aa-82ad-4465-b61c-e956d45ce162" containerName="keystone-bootstrap" Dec 04 12:21:26.490009 master-0 kubenswrapper[35367]: E1204 12:21:26.489633 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9d3c7130-ade7-4628-80b9-ada3d0941c90" containerName="init" Dec 04 12:21:26.490009 master-0 kubenswrapper[35367]: I1204 12:21:26.489640 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d3c7130-ade7-4628-80b9-ada3d0941c90" containerName="init" Dec 04 12:21:26.490245 master-0 kubenswrapper[35367]: I1204 12:21:26.490042 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="de1c0574-23b1-4430-8d67-76a0f30bad90" containerName="mariadb-account-create-update" Dec 04 12:21:26.490245 master-0 kubenswrapper[35367]: I1204 12:21:26.490099 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="9d3c7130-ade7-4628-80b9-ada3d0941c90" containerName="init" Dec 04 12:21:26.490245 master-0 kubenswrapper[35367]: I1204 12:21:26.490115 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="859636b6-4875-4193-b2b7-cf13e258fee9" containerName="glance-db-sync" Dec 04 12:21:26.490245 master-0 kubenswrapper[35367]: I1204 12:21:26.490222 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="6003f8aa-82ad-4465-b61c-e956d45ce162" containerName="keystone-bootstrap" Dec 04 12:21:26.490245 master-0 kubenswrapper[35367]: I1204 12:21:26.490240 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="241869d7-8118-40e8-8550-76c59263f7c7" containerName="mariadb-database-create" Dec 04 12:21:26.492263 master-0 kubenswrapper[35367]: I1204 12:21:26.491484 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:26.501850 master-0 kubenswrapper[35367]: I1204 12:21:26.500709 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone-config-data" Dec 04 12:21:26.501850 master-0 kubenswrapper[35367]: I1204 12:21:26.500917 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone" Dec 04 12:21:26.501850 master-0 kubenswrapper[35367]: I1204 12:21:26.501066 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone-scripts" Dec 04 12:21:26.509386 master-0 kubenswrapper[35367]: I1204 12:21:26.509040 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"osp-secret" Dec 04 12:21:26.537900 master-0 kubenswrapper[35367]: I1204 12:21:26.537738 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-bootstrap-zzmjk"] Dec 04 12:21:26.599512 master-0 kubenswrapper[35367]: I1204 12:21:26.599433 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-config-data\") pod \"keystone-bootstrap-zzmjk\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:26.599790 master-0 kubenswrapper[35367]: I1204 12:21:26.599721 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-fernet-keys\") pod \"keystone-bootstrap-zzmjk\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:26.600043 master-0 kubenswrapper[35367]: I1204 12:21:26.599997 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-scripts\") pod \"keystone-bootstrap-zzmjk\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:26.600121 master-0 kubenswrapper[35367]: I1204 12:21:26.600089 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8482d\" (UniqueName: \"kubernetes.io/projected/088fa28d-a668-4bcc-9038-24e9a97f25d4-kube-api-access-8482d\") pod \"keystone-bootstrap-zzmjk\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:26.600688 master-0 kubenswrapper[35367]: I1204 12:21:26.600598 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-credential-keys\") pod \"keystone-bootstrap-zzmjk\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:26.601070 master-0 kubenswrapper[35367]: I1204 12:21:26.601010 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-combined-ca-bundle\") pod \"keystone-bootstrap-zzmjk\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:26.623174 master-0 kubenswrapper[35367]: I1204 12:21:26.622911 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-fd8dd6b45-8nntp"] Dec 04 12:21:26.628231 master-0 kubenswrapper[35367]: I1204 12:21:26.623232 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" podUID="2ec5d2f3-2ce5-48f6-951a-3579aeba6439" containerName="dnsmasq-dns" containerID="cri-o://4af8381503d052b48a9c170ee22aa603590c83164275ec586c3837058a0b9b08" gracePeriod=10 Dec 04 12:21:26.648936 master-0 kubenswrapper[35367]: I1204 12:21:26.637267 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:26.711333 master-0 kubenswrapper[35367]: I1204 12:21:26.710076 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-credential-keys\") pod \"keystone-bootstrap-zzmjk\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:26.711333 master-0 kubenswrapper[35367]: I1204 12:21:26.710176 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-combined-ca-bundle\") pod \"keystone-bootstrap-zzmjk\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:26.711333 master-0 kubenswrapper[35367]: I1204 12:21:26.710263 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-config-data\") pod \"keystone-bootstrap-zzmjk\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:26.711333 master-0 kubenswrapper[35367]: I1204 12:21:26.710302 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-fernet-keys\") pod \"keystone-bootstrap-zzmjk\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:26.711333 master-0 kubenswrapper[35367]: I1204 12:21:26.710323 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-scripts\") pod \"keystone-bootstrap-zzmjk\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:26.711333 master-0 kubenswrapper[35367]: I1204 12:21:26.710344 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8482d\" (UniqueName: \"kubernetes.io/projected/088fa28d-a668-4bcc-9038-24e9a97f25d4-kube-api-access-8482d\") pod \"keystone-bootstrap-zzmjk\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:26.716770 master-0 kubenswrapper[35367]: I1204 12:21:26.716636 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-credential-keys\") pod \"keystone-bootstrap-zzmjk\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:26.717244 master-0 kubenswrapper[35367]: I1204 12:21:26.717206 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-config-data\") pod \"keystone-bootstrap-zzmjk\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:26.721587 master-0 kubenswrapper[35367]: I1204 12:21:26.721508 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-combined-ca-bundle\") pod \"keystone-bootstrap-zzmjk\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:26.735366 master-0 kubenswrapper[35367]: I1204 12:21:26.735302 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-fernet-keys\") pod \"keystone-bootstrap-zzmjk\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:26.735969 master-0 kubenswrapper[35367]: I1204 12:21:26.735923 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-scripts\") pod \"keystone-bootstrap-zzmjk\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:26.744682 master-0 kubenswrapper[35367]: I1204 12:21:26.744579 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8482d\" (UniqueName: \"kubernetes.io/projected/088fa28d-a668-4bcc-9038-24e9a97f25d4-kube-api-access-8482d\") pod \"keystone-bootstrap-zzmjk\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:26.746224 master-0 kubenswrapper[35367]: I1204 12:21:26.746134 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-7c8d56b84f-g89zk"] Dec 04 12:21:26.771661 master-0 kubenswrapper[35367]: I1204 12:21:26.770634 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:26.772113 master-0 kubenswrapper[35367]: I1204 12:21:26.771924 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6003f8aa-82ad-4465-b61c-e956d45ce162" path="/var/lib/kubelet/pods/6003f8aa-82ad-4465-b61c-e956d45ce162/volumes" Dec 04 12:21:26.772983 master-0 kubenswrapper[35367]: I1204 12:21:26.772787 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-7c8d56b84f-g89zk"] Dec 04 12:21:26.856753 master-0 kubenswrapper[35367]: I1204 12:21:26.853510 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:26.928467 master-0 kubenswrapper[35367]: I1204 12:21:26.928338 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52gpz\" (UniqueName: \"kubernetes.io/projected/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-kube-api-access-52gpz\") pod \"dnsmasq-dns-7c8d56b84f-g89zk\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:26.928783 master-0 kubenswrapper[35367]: I1204 12:21:26.928578 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-ovsdbserver-nb\") pod \"dnsmasq-dns-7c8d56b84f-g89zk\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:26.929021 master-0 kubenswrapper[35367]: I1204 12:21:26.928982 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-config\") pod \"dnsmasq-dns-7c8d56b84f-g89zk\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:26.929110 master-0 kubenswrapper[35367]: I1204 12:21:26.929091 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-dns-swift-storage-0\") pod \"dnsmasq-dns-7c8d56b84f-g89zk\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:26.929317 master-0 kubenswrapper[35367]: I1204 12:21:26.929146 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-ovsdbserver-sb\") pod \"dnsmasq-dns-7c8d56b84f-g89zk\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:26.929414 master-0 kubenswrapper[35367]: I1204 12:21:26.929388 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-dns-svc\") pod \"dnsmasq-dns-7c8d56b84f-g89zk\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:27.034350 master-0 kubenswrapper[35367]: I1204 12:21:27.031978 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-config\") pod \"dnsmasq-dns-7c8d56b84f-g89zk\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:27.034350 master-0 kubenswrapper[35367]: I1204 12:21:27.032100 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-dns-swift-storage-0\") pod \"dnsmasq-dns-7c8d56b84f-g89zk\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:27.034350 master-0 kubenswrapper[35367]: I1204 12:21:27.032160 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-ovsdbserver-sb\") pod \"dnsmasq-dns-7c8d56b84f-g89zk\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:27.034350 master-0 kubenswrapper[35367]: I1204 12:21:27.032233 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-dns-svc\") pod \"dnsmasq-dns-7c8d56b84f-g89zk\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:27.034350 master-0 kubenswrapper[35367]: I1204 12:21:27.032452 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-52gpz\" (UniqueName: \"kubernetes.io/projected/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-kube-api-access-52gpz\") pod \"dnsmasq-dns-7c8d56b84f-g89zk\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:27.034350 master-0 kubenswrapper[35367]: I1204 12:21:27.032524 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-ovsdbserver-nb\") pod \"dnsmasq-dns-7c8d56b84f-g89zk\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:27.034350 master-0 kubenswrapper[35367]: I1204 12:21:27.034286 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-ovsdbserver-nb\") pod \"dnsmasq-dns-7c8d56b84f-g89zk\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:27.034893 master-0 kubenswrapper[35367]: I1204 12:21:27.034745 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-dns-svc\") pod \"dnsmasq-dns-7c8d56b84f-g89zk\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:27.035961 master-0 kubenswrapper[35367]: I1204 12:21:27.035711 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-dns-swift-storage-0\") pod \"dnsmasq-dns-7c8d56b84f-g89zk\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:27.043323 master-0 kubenswrapper[35367]: I1204 12:21:27.043202 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-ovsdbserver-sb\") pod \"dnsmasq-dns-7c8d56b84f-g89zk\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:27.060896 master-0 kubenswrapper[35367]: I1204 12:21:27.059169 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-config\") pod \"dnsmasq-dns-7c8d56b84f-g89zk\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:27.060896 master-0 kubenswrapper[35367]: I1204 12:21:27.060343 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-52gpz\" (UniqueName: \"kubernetes.io/projected/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-kube-api-access-52gpz\") pod \"dnsmasq-dns-7c8d56b84f-g89zk\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:27.200730 master-0 kubenswrapper[35367]: I1204 12:21:27.200616 35367 generic.go:334] "Generic (PLEG): container finished" podID="2ec5d2f3-2ce5-48f6-951a-3579aeba6439" containerID="4af8381503d052b48a9c170ee22aa603590c83164275ec586c3837058a0b9b08" exitCode=0 Dec 04 12:21:27.200730 master-0 kubenswrapper[35367]: I1204 12:21:27.200690 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" event={"ID":"2ec5d2f3-2ce5-48f6-951a-3579aeba6439","Type":"ContainerDied","Data":"4af8381503d052b48a9c170ee22aa603590c83164275ec586c3837058a0b9b08"} Dec 04 12:21:27.357877 master-0 kubenswrapper[35367]: I1204 12:21:27.357749 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:27.482939 master-0 kubenswrapper[35367]: I1204 12:21:27.482265 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:27.649040 master-0 kubenswrapper[35367]: I1204 12:21:27.648789 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-dns-swift-storage-0\") pod \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " Dec 04 12:21:27.649040 master-0 kubenswrapper[35367]: I1204 12:21:27.648886 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-ovsdbserver-sb\") pod \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " Dec 04 12:21:27.649040 master-0 kubenswrapper[35367]: I1204 12:21:27.649042 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-dns-svc\") pod \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " Dec 04 12:21:27.649439 master-0 kubenswrapper[35367]: I1204 12:21:27.649130 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-config\") pod \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " Dec 04 12:21:27.650048 master-0 kubenswrapper[35367]: I1204 12:21:27.649791 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdbqm\" (UniqueName: \"kubernetes.io/projected/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-kube-api-access-bdbqm\") pod \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " Dec 04 12:21:27.650048 master-0 kubenswrapper[35367]: I1204 12:21:27.649913 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-ovsdbserver-nb\") pod \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\" (UID: \"2ec5d2f3-2ce5-48f6-951a-3579aeba6439\") " Dec 04 12:21:27.669756 master-0 kubenswrapper[35367]: I1204 12:21:27.669676 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-bootstrap-zzmjk"] Dec 04 12:21:27.676997 master-0 kubenswrapper[35367]: I1204 12:21:27.675216 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-kube-api-access-bdbqm" (OuterVolumeSpecName: "kube-api-access-bdbqm") pod "2ec5d2f3-2ce5-48f6-951a-3579aeba6439" (UID: "2ec5d2f3-2ce5-48f6-951a-3579aeba6439"). InnerVolumeSpecName "kube-api-access-bdbqm". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:21:27.682471 master-0 kubenswrapper[35367]: W1204 12:21:27.682391 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod088fa28d_a668_4bcc_9038_24e9a97f25d4.slice/crio-25843b962cbe865d02877193aec60e2f79c2e179ebdcbb64b23afafa4a955c9b WatchSource:0}: Error finding container 25843b962cbe865d02877193aec60e2f79c2e179ebdcbb64b23afafa4a955c9b: Status 404 returned error can't find the container with id 25843b962cbe865d02877193aec60e2f79c2e179ebdcbb64b23afafa4a955c9b Dec 04 12:21:27.765291 master-0 kubenswrapper[35367]: I1204 12:21:27.762607 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "2ec5d2f3-2ce5-48f6-951a-3579aeba6439" (UID: "2ec5d2f3-2ce5-48f6-951a-3579aeba6439"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:27.765291 master-0 kubenswrapper[35367]: I1204 12:21:27.764776 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bdbqm\" (UniqueName: \"kubernetes.io/projected/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-kube-api-access-bdbqm\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:27.765291 master-0 kubenswrapper[35367]: I1204 12:21:27.764837 35367 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:27.797964 master-0 kubenswrapper[35367]: I1204 12:21:27.797824 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-config" (OuterVolumeSpecName: "config") pod "2ec5d2f3-2ce5-48f6-951a-3579aeba6439" (UID: "2ec5d2f3-2ce5-48f6-951a-3579aeba6439"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:27.800453 master-0 kubenswrapper[35367]: I1204 12:21:27.800158 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "2ec5d2f3-2ce5-48f6-951a-3579aeba6439" (UID: "2ec5d2f3-2ce5-48f6-951a-3579aeba6439"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:27.807022 master-0 kubenswrapper[35367]: I1204 12:21:27.806956 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "2ec5d2f3-2ce5-48f6-951a-3579aeba6439" (UID: "2ec5d2f3-2ce5-48f6-951a-3579aeba6439"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:27.809903 master-0 kubenswrapper[35367]: I1204 12:21:27.809781 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "2ec5d2f3-2ce5-48f6-951a-3579aeba6439" (UID: "2ec5d2f3-2ce5-48f6-951a-3579aeba6439"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:27.867219 master-0 kubenswrapper[35367]: I1204 12:21:27.867153 35367 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:27.867478 master-0 kubenswrapper[35367]: I1204 12:21:27.867229 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:27.867478 master-0 kubenswrapper[35367]: I1204 12:21:27.867247 35367 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:27.867478 master-0 kubenswrapper[35367]: I1204 12:21:27.867264 35367 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/2ec5d2f3-2ce5-48f6-951a-3579aeba6439-dns-swift-storage-0\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:28.274844 master-0 kubenswrapper[35367]: I1204 12:21:28.263882 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" event={"ID":"2ec5d2f3-2ce5-48f6-951a-3579aeba6439","Type":"ContainerDied","Data":"4cb53096ff0c865b09fd912597def5d6531e275861c26cc5eab9383ce04c1f9f"} Dec 04 12:21:28.274844 master-0 kubenswrapper[35367]: I1204 12:21:28.263966 35367 scope.go:117] "RemoveContainer" containerID="4af8381503d052b48a9c170ee22aa603590c83164275ec586c3837058a0b9b08" Dec 04 12:21:28.274844 master-0 kubenswrapper[35367]: I1204 12:21:28.264169 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-fd8dd6b45-8nntp" Dec 04 12:21:28.276593 master-0 kubenswrapper[35367]: I1204 12:21:28.276130 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-bootstrap-zzmjk" event={"ID":"088fa28d-a668-4bcc-9038-24e9a97f25d4","Type":"ContainerStarted","Data":"25843b962cbe865d02877193aec60e2f79c2e179ebdcbb64b23afafa4a955c9b"} Dec 04 12:21:28.291832 master-0 kubenswrapper[35367]: I1204 12:21:28.280773 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-7c8d56b84f-g89zk"] Dec 04 12:21:28.335839 master-0 kubenswrapper[35367]: I1204 12:21:28.333405 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/keystone-bootstrap-zzmjk" podStartSLOduration=2.3333816929999998 podStartE2EDuration="2.333381693s" podCreationTimestamp="2025-12-04 12:21:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:21:28.316984665 +0000 UTC m=+1331.755045933" watchObservedRunningTime="2025-12-04 12:21:28.333381693 +0000 UTC m=+1331.771442961" Dec 04 12:21:28.382532 master-0 kubenswrapper[35367]: I1204 12:21:28.381789 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-fd8dd6b45-8nntp"] Dec 04 12:21:28.401002 master-0 kubenswrapper[35367]: I1204 12:21:28.400911 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-fd8dd6b45-8nntp"] Dec 04 12:21:28.506925 master-0 kubenswrapper[35367]: I1204 12:21:28.504976 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-db-sync-ql68f"] Dec 04 12:21:28.506925 master-0 kubenswrapper[35367]: E1204 12:21:28.505851 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2ec5d2f3-2ce5-48f6-951a-3579aeba6439" containerName="init" Dec 04 12:21:28.506925 master-0 kubenswrapper[35367]: I1204 12:21:28.505875 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ec5d2f3-2ce5-48f6-951a-3579aeba6439" containerName="init" Dec 04 12:21:28.506925 master-0 kubenswrapper[35367]: E1204 12:21:28.505962 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2ec5d2f3-2ce5-48f6-951a-3579aeba6439" containerName="dnsmasq-dns" Dec 04 12:21:28.506925 master-0 kubenswrapper[35367]: I1204 12:21:28.505975 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ec5d2f3-2ce5-48f6-951a-3579aeba6439" containerName="dnsmasq-dns" Dec 04 12:21:28.506925 master-0 kubenswrapper[35367]: I1204 12:21:28.506440 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="2ec5d2f3-2ce5-48f6-951a-3579aeba6439" containerName="dnsmasq-dns" Dec 04 12:21:28.510080 master-0 kubenswrapper[35367]: I1204 12:21:28.508548 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-db-sync-ql68f" Dec 04 12:21:28.514542 master-0 kubenswrapper[35367]: I1204 12:21:28.514285 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-config-data" Dec 04 12:21:28.516466 master-0 kubenswrapper[35367]: I1204 12:21:28.514709 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-scripts" Dec 04 12:21:28.526101 master-0 kubenswrapper[35367]: I1204 12:21:28.525399 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-db-sync-ql68f"] Dec 04 12:21:28.591927 master-0 kubenswrapper[35367]: I1204 12:21:28.591842 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a783310-4355-49c9-9962-b5741fb70344-combined-ca-bundle\") pod \"ironic-db-sync-ql68f\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " pod="openstack/ironic-db-sync-ql68f" Dec 04 12:21:28.592201 master-0 kubenswrapper[35367]: I1204 12:21:28.592124 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grxd9\" (UniqueName: \"kubernetes.io/projected/0a783310-4355-49c9-9962-b5741fb70344-kube-api-access-grxd9\") pod \"ironic-db-sync-ql68f\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " pod="openstack/ironic-db-sync-ql68f" Dec 04 12:21:28.592345 master-0 kubenswrapper[35367]: I1204 12:21:28.592303 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a783310-4355-49c9-9962-b5741fb70344-config-data\") pod \"ironic-db-sync-ql68f\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " pod="openstack/ironic-db-sync-ql68f" Dec 04 12:21:28.592512 master-0 kubenswrapper[35367]: I1204 12:21:28.592479 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a783310-4355-49c9-9962-b5741fb70344-scripts\") pod \"ironic-db-sync-ql68f\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " pod="openstack/ironic-db-sync-ql68f" Dec 04 12:21:28.592660 master-0 kubenswrapper[35367]: I1204 12:21:28.592618 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a783310-4355-49c9-9962-b5741fb70344-etc-podinfo\") pod \"ironic-db-sync-ql68f\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " pod="openstack/ironic-db-sync-ql68f" Dec 04 12:21:28.592850 master-0 kubenswrapper[35367]: I1204 12:21:28.592752 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/0a783310-4355-49c9-9962-b5741fb70344-config-data-merged\") pod \"ironic-db-sync-ql68f\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " pod="openstack/ironic-db-sync-ql68f" Dec 04 12:21:28.695607 master-0 kubenswrapper[35367]: I1204 12:21:28.695466 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a783310-4355-49c9-9962-b5741fb70344-config-data\") pod \"ironic-db-sync-ql68f\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " pod="openstack/ironic-db-sync-ql68f" Dec 04 12:21:28.696375 master-0 kubenswrapper[35367]: I1204 12:21:28.695710 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a783310-4355-49c9-9962-b5741fb70344-scripts\") pod \"ironic-db-sync-ql68f\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " pod="openstack/ironic-db-sync-ql68f" Dec 04 12:21:28.696375 master-0 kubenswrapper[35367]: I1204 12:21:28.695770 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a783310-4355-49c9-9962-b5741fb70344-etc-podinfo\") pod \"ironic-db-sync-ql68f\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " pod="openstack/ironic-db-sync-ql68f" Dec 04 12:21:28.696375 master-0 kubenswrapper[35367]: I1204 12:21:28.695829 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/0a783310-4355-49c9-9962-b5741fb70344-config-data-merged\") pod \"ironic-db-sync-ql68f\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " pod="openstack/ironic-db-sync-ql68f" Dec 04 12:21:28.698037 master-0 kubenswrapper[35367]: I1204 12:21:28.696597 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a783310-4355-49c9-9962-b5741fb70344-combined-ca-bundle\") pod \"ironic-db-sync-ql68f\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " pod="openstack/ironic-db-sync-ql68f" Dec 04 12:21:28.698037 master-0 kubenswrapper[35367]: I1204 12:21:28.696830 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/0a783310-4355-49c9-9962-b5741fb70344-config-data-merged\") pod \"ironic-db-sync-ql68f\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " pod="openstack/ironic-db-sync-ql68f" Dec 04 12:21:28.698037 master-0 kubenswrapper[35367]: I1204 12:21:28.696949 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-grxd9\" (UniqueName: \"kubernetes.io/projected/0a783310-4355-49c9-9962-b5741fb70344-kube-api-access-grxd9\") pod \"ironic-db-sync-ql68f\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " pod="openstack/ironic-db-sync-ql68f" Dec 04 12:21:28.699703 master-0 kubenswrapper[35367]: I1204 12:21:28.699628 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a783310-4355-49c9-9962-b5741fb70344-config-data\") pod \"ironic-db-sync-ql68f\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " pod="openstack/ironic-db-sync-ql68f" Dec 04 12:21:28.701108 master-0 kubenswrapper[35367]: I1204 12:21:28.700750 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a783310-4355-49c9-9962-b5741fb70344-etc-podinfo\") pod \"ironic-db-sync-ql68f\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " pod="openstack/ironic-db-sync-ql68f" Dec 04 12:21:28.701349 master-0 kubenswrapper[35367]: I1204 12:21:28.701319 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a783310-4355-49c9-9962-b5741fb70344-scripts\") pod \"ironic-db-sync-ql68f\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " pod="openstack/ironic-db-sync-ql68f" Dec 04 12:21:28.708404 master-0 kubenswrapper[35367]: I1204 12:21:28.708342 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a783310-4355-49c9-9962-b5741fb70344-combined-ca-bundle\") pod \"ironic-db-sync-ql68f\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " pod="openstack/ironic-db-sync-ql68f" Dec 04 12:21:28.725104 master-0 kubenswrapper[35367]: I1204 12:21:28.725049 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-grxd9\" (UniqueName: \"kubernetes.io/projected/0a783310-4355-49c9-9962-b5741fb70344-kube-api-access-grxd9\") pod \"ironic-db-sync-ql68f\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " pod="openstack/ironic-db-sync-ql68f" Dec 04 12:21:28.772475 master-0 kubenswrapper[35367]: I1204 12:21:28.772275 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ec5d2f3-2ce5-48f6-951a-3579aeba6439" path="/var/lib/kubelet/pods/2ec5d2f3-2ce5-48f6-951a-3579aeba6439/volumes" Dec 04 12:21:28.851676 master-0 kubenswrapper[35367]: I1204 12:21:28.850680 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-db-sync-ql68f" Dec 04 12:21:29.316240 master-0 kubenswrapper[35367]: I1204 12:21:29.316166 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-bootstrap-zzmjk" event={"ID":"088fa28d-a668-4bcc-9038-24e9a97f25d4","Type":"ContainerStarted","Data":"3e451254ceb489f64f16da9882a53b4f005ba07f9888f7dad45df4403abf3957"} Dec 04 12:21:30.337165 master-0 kubenswrapper[35367]: I1204 12:21:30.337048 35367 generic.go:334] "Generic (PLEG): container finished" podID="f0e9b193-ab20-484e-b727-c24c8aecb2c5" containerID="63a818c26d002b5ec86f3b80790345c055ac0a9076debc358d3f81a8e7e89870" exitCode=0 Dec 04 12:21:30.338901 master-0 kubenswrapper[35367]: I1204 12:21:30.338857 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-db-sync-hlw45" event={"ID":"f0e9b193-ab20-484e-b727-c24c8aecb2c5","Type":"ContainerDied","Data":"63a818c26d002b5ec86f3b80790345c055ac0a9076debc358d3f81a8e7e89870"} Dec 04 12:21:30.815457 master-0 kubenswrapper[35367]: I1204 12:21:30.815340 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-0c69e-default-external-api-0"] Dec 04 12:21:30.818495 master-0 kubenswrapper[35367]: I1204 12:21:30.818462 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:30.825500 master-0 kubenswrapper[35367]: I1204 12:21:30.825131 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-0c69e-default-external-config-data" Dec 04 12:21:30.825882 master-0 kubenswrapper[35367]: I1204 12:21:30.825717 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-scripts" Dec 04 12:21:31.269145 master-0 kubenswrapper[35367]: I1204 12:21:31.269000 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-0c69e-default-external-api-0"] Dec 04 12:21:31.282943 master-0 kubenswrapper[35367]: I1204 12:21:31.282887 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js6x8\" (UniqueName: \"kubernetes.io/projected/a5c4d71b-02f5-432b-bcd8-4303603439c2-kube-api-access-js6x8\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:31.283302 master-0 kubenswrapper[35367]: I1204 12:21:31.283274 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5c4d71b-02f5-432b-bcd8-4303603439c2-combined-ca-bundle\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:31.283436 master-0 kubenswrapper[35367]: I1204 12:21:31.283418 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-5b3d373a-b38f-44c7-a861-0a8380dfd1e5\" (UniqueName: \"kubernetes.io/csi/topolvm.io^f318c560-8a01-4027-a490-af9e3eba2a4a\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:31.283635 master-0 kubenswrapper[35367]: I1204 12:21:31.283611 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5c4d71b-02f5-432b-bcd8-4303603439c2-config-data\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:31.284036 master-0 kubenswrapper[35367]: I1204 12:21:31.284014 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a5c4d71b-02f5-432b-bcd8-4303603439c2-scripts\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:31.284168 master-0 kubenswrapper[35367]: I1204 12:21:31.284146 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a5c4d71b-02f5-432b-bcd8-4303603439c2-httpd-run\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:31.284302 master-0 kubenswrapper[35367]: I1204 12:21:31.284280 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a5c4d71b-02f5-432b-bcd8-4303603439c2-logs\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:31.388314 master-0 kubenswrapper[35367]: I1204 12:21:31.388192 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5c4d71b-02f5-432b-bcd8-4303603439c2-config-data\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:31.389499 master-0 kubenswrapper[35367]: I1204 12:21:31.388523 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a5c4d71b-02f5-432b-bcd8-4303603439c2-scripts\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:31.389499 master-0 kubenswrapper[35367]: I1204 12:21:31.388555 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a5c4d71b-02f5-432b-bcd8-4303603439c2-httpd-run\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:31.389499 master-0 kubenswrapper[35367]: I1204 12:21:31.388911 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a5c4d71b-02f5-432b-bcd8-4303603439c2-logs\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:31.389499 master-0 kubenswrapper[35367]: I1204 12:21:31.389235 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a5c4d71b-02f5-432b-bcd8-4303603439c2-httpd-run\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:31.389499 master-0 kubenswrapper[35367]: I1204 12:21:31.389244 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-js6x8\" (UniqueName: \"kubernetes.io/projected/a5c4d71b-02f5-432b-bcd8-4303603439c2-kube-api-access-js6x8\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:31.389499 master-0 kubenswrapper[35367]: I1204 12:21:31.389399 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5c4d71b-02f5-432b-bcd8-4303603439c2-combined-ca-bundle\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:31.389499 master-0 kubenswrapper[35367]: I1204 12:21:31.389443 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-5b3d373a-b38f-44c7-a861-0a8380dfd1e5\" (UniqueName: \"kubernetes.io/csi/topolvm.io^f318c560-8a01-4027-a490-af9e3eba2a4a\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:31.390289 master-0 kubenswrapper[35367]: I1204 12:21:31.390147 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a5c4d71b-02f5-432b-bcd8-4303603439c2-logs\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:31.391645 master-0 kubenswrapper[35367]: I1204 12:21:31.391616 35367 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 12:21:31.391762 master-0 kubenswrapper[35367]: I1204 12:21:31.391654 35367 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-5b3d373a-b38f-44c7-a861-0a8380dfd1e5\" (UniqueName: \"kubernetes.io/csi/topolvm.io^f318c560-8a01-4027-a490-af9e3eba2a4a\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/74115e60b5409cbebfa619be32d6ac347cad5b2eedd93383ec88e211c6c7024b/globalmount\"" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:31.396627 master-0 kubenswrapper[35367]: I1204 12:21:31.396264 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a5c4d71b-02f5-432b-bcd8-4303603439c2-scripts\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:31.414331 master-0 kubenswrapper[35367]: I1204 12:21:31.413877 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5c4d71b-02f5-432b-bcd8-4303603439c2-combined-ca-bundle\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:31.414331 master-0 kubenswrapper[35367]: I1204 12:21:31.414253 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5c4d71b-02f5-432b-bcd8-4303603439c2-config-data\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:31.424882 master-0 kubenswrapper[35367]: I1204 12:21:31.424774 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-js6x8\" (UniqueName: \"kubernetes.io/projected/a5c4d71b-02f5-432b-bcd8-4303603439c2-kube-api-access-js6x8\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:31.743429 master-0 kubenswrapper[35367]: I1204 12:21:31.743121 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-0c69e-default-external-api-0"] Dec 04 12:21:31.744542 master-0 kubenswrapper[35367]: E1204 12:21:31.744466 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[glance], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack/glance-0c69e-default-external-api-0" podUID="a5c4d71b-02f5-432b-bcd8-4303603439c2" Dec 04 12:21:32.382605 master-0 kubenswrapper[35367]: I1204 12:21:32.382420 35367 generic.go:334] "Generic (PLEG): container finished" podID="088fa28d-a668-4bcc-9038-24e9a97f25d4" containerID="3e451254ceb489f64f16da9882a53b4f005ba07f9888f7dad45df4403abf3957" exitCode=0 Dec 04 12:21:32.382605 master-0 kubenswrapper[35367]: I1204 12:21:32.382601 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:32.384080 master-0 kubenswrapper[35367]: I1204 12:21:32.384019 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-bootstrap-zzmjk" event={"ID":"088fa28d-a668-4bcc-9038-24e9a97f25d4","Type":"ContainerDied","Data":"3e451254ceb489f64f16da9882a53b4f005ba07f9888f7dad45df4403abf3957"} Dec 04 12:21:32.398595 master-0 kubenswrapper[35367]: I1204 12:21:32.398017 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:32.518887 master-0 kubenswrapper[35367]: I1204 12:21:32.517658 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5c4d71b-02f5-432b-bcd8-4303603439c2-combined-ca-bundle\") pod \"a5c4d71b-02f5-432b-bcd8-4303603439c2\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " Dec 04 12:21:32.518887 master-0 kubenswrapper[35367]: I1204 12:21:32.517981 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a5c4d71b-02f5-432b-bcd8-4303603439c2-scripts\") pod \"a5c4d71b-02f5-432b-bcd8-4303603439c2\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " Dec 04 12:21:32.518887 master-0 kubenswrapper[35367]: I1204 12:21:32.518043 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5c4d71b-02f5-432b-bcd8-4303603439c2-config-data\") pod \"a5c4d71b-02f5-432b-bcd8-4303603439c2\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " Dec 04 12:21:32.518887 master-0 kubenswrapper[35367]: I1204 12:21:32.518177 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a5c4d71b-02f5-432b-bcd8-4303603439c2-httpd-run\") pod \"a5c4d71b-02f5-432b-bcd8-4303603439c2\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " Dec 04 12:21:32.518887 master-0 kubenswrapper[35367]: I1204 12:21:32.518383 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a5c4d71b-02f5-432b-bcd8-4303603439c2-logs\") pod \"a5c4d71b-02f5-432b-bcd8-4303603439c2\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " Dec 04 12:21:32.518887 master-0 kubenswrapper[35367]: I1204 12:21:32.518498 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js6x8\" (UniqueName: \"kubernetes.io/projected/a5c4d71b-02f5-432b-bcd8-4303603439c2-kube-api-access-js6x8\") pod \"a5c4d71b-02f5-432b-bcd8-4303603439c2\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " Dec 04 12:21:32.524162 master-0 kubenswrapper[35367]: I1204 12:21:32.519121 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5c4d71b-02f5-432b-bcd8-4303603439c2-logs" (OuterVolumeSpecName: "logs") pod "a5c4d71b-02f5-432b-bcd8-4303603439c2" (UID: "a5c4d71b-02f5-432b-bcd8-4303603439c2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:21:32.524162 master-0 kubenswrapper[35367]: I1204 12:21:32.519237 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5c4d71b-02f5-432b-bcd8-4303603439c2-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "a5c4d71b-02f5-432b-bcd8-4303603439c2" (UID: "a5c4d71b-02f5-432b-bcd8-4303603439c2"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:21:32.524162 master-0 kubenswrapper[35367]: I1204 12:21:32.520305 35367 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a5c4d71b-02f5-432b-bcd8-4303603439c2-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:32.524162 master-0 kubenswrapper[35367]: I1204 12:21:32.520332 35367 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a5c4d71b-02f5-432b-bcd8-4303603439c2-httpd-run\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:32.525369 master-0 kubenswrapper[35367]: I1204 12:21:32.524709 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5c4d71b-02f5-432b-bcd8-4303603439c2-kube-api-access-js6x8" (OuterVolumeSpecName: "kube-api-access-js6x8") pod "a5c4d71b-02f5-432b-bcd8-4303603439c2" (UID: "a5c4d71b-02f5-432b-bcd8-4303603439c2"). InnerVolumeSpecName "kube-api-access-js6x8". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:21:32.525369 master-0 kubenswrapper[35367]: I1204 12:21:32.524926 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5c4d71b-02f5-432b-bcd8-4303603439c2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a5c4d71b-02f5-432b-bcd8-4303603439c2" (UID: "a5c4d71b-02f5-432b-bcd8-4303603439c2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:32.525640 master-0 kubenswrapper[35367]: I1204 12:21:32.525617 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5c4d71b-02f5-432b-bcd8-4303603439c2-scripts" (OuterVolumeSpecName: "scripts") pod "a5c4d71b-02f5-432b-bcd8-4303603439c2" (UID: "a5c4d71b-02f5-432b-bcd8-4303603439c2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:32.526101 master-0 kubenswrapper[35367]: I1204 12:21:32.526061 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5c4d71b-02f5-432b-bcd8-4303603439c2-config-data" (OuterVolumeSpecName: "config-data") pod "a5c4d71b-02f5-432b-bcd8-4303603439c2" (UID: "a5c4d71b-02f5-432b-bcd8-4303603439c2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:32.623765 master-0 kubenswrapper[35367]: I1204 12:21:32.623507 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5c4d71b-02f5-432b-bcd8-4303603439c2-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:32.623765 master-0 kubenswrapper[35367]: I1204 12:21:32.623704 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a5c4d71b-02f5-432b-bcd8-4303603439c2-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:32.623765 master-0 kubenswrapper[35367]: I1204 12:21:32.623722 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5c4d71b-02f5-432b-bcd8-4303603439c2-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:32.623765 master-0 kubenswrapper[35367]: I1204 12:21:32.623736 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-js6x8\" (UniqueName: \"kubernetes.io/projected/a5c4d71b-02f5-432b-bcd8-4303603439c2-kube-api-access-js6x8\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:33.244005 master-0 kubenswrapper[35367]: I1204 12:21:33.243938 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-0c69e-default-internal-api-0"] Dec 04 12:21:33.253263 master-0 kubenswrapper[35367]: I1204 12:21:33.253217 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.258092 master-0 kubenswrapper[35367]: I1204 12:21:33.257744 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-glance-default-internal-svc" Dec 04 12:21:33.258418 master-0 kubenswrapper[35367]: I1204 12:21:33.258197 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-0c69e-default-internal-config-data" Dec 04 12:21:33.263382 master-0 kubenswrapper[35367]: I1204 12:21:33.263302 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-0c69e-default-internal-api-0"] Dec 04 12:21:33.344763 master-0 kubenswrapper[35367]: I1204 12:21:33.344693 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-630610d1-9609-4ef9-bffe-3fdf6689bf1a\" (UniqueName: \"kubernetes.io/csi/topolvm.io^a7ac49b8-50e4-4168-b971-2f8b0e4db56e\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.344992 master-0 kubenswrapper[35367]: I1204 12:21:33.344897 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-combined-ca-bundle\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.345273 master-0 kubenswrapper[35367]: I1204 12:21:33.345221 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v8rg\" (UniqueName: \"kubernetes.io/projected/55e3f630-c2c3-49ee-950b-ce9301018170-kube-api-access-2v8rg\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.345350 master-0 kubenswrapper[35367]: I1204 12:21:33.345300 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-internal-tls-certs\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.345527 master-0 kubenswrapper[35367]: I1204 12:21:33.345503 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-config-data\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.345585 master-0 kubenswrapper[35367]: I1204 12:21:33.345546 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-scripts\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.345585 master-0 kubenswrapper[35367]: I1204 12:21:33.345571 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/55e3f630-c2c3-49ee-950b-ce9301018170-logs\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.346677 master-0 kubenswrapper[35367]: I1204 12:21:33.345766 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/55e3f630-c2c3-49ee-950b-ce9301018170-httpd-run\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.398782 master-0 kubenswrapper[35367]: I1204 12:21:33.398727 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.459837 master-0 kubenswrapper[35367]: I1204 12:21:33.450530 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/55e3f630-c2c3-49ee-950b-ce9301018170-httpd-run\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.459837 master-0 kubenswrapper[35367]: I1204 12:21:33.450764 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-630610d1-9609-4ef9-bffe-3fdf6689bf1a\" (UniqueName: \"kubernetes.io/csi/topolvm.io^a7ac49b8-50e4-4168-b971-2f8b0e4db56e\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.459837 master-0 kubenswrapper[35367]: I1204 12:21:33.451003 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-combined-ca-bundle\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.459837 master-0 kubenswrapper[35367]: I1204 12:21:33.451309 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2v8rg\" (UniqueName: \"kubernetes.io/projected/55e3f630-c2c3-49ee-950b-ce9301018170-kube-api-access-2v8rg\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.459837 master-0 kubenswrapper[35367]: I1204 12:21:33.451352 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-internal-tls-certs\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.459837 master-0 kubenswrapper[35367]: I1204 12:21:33.451583 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-config-data\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.459837 master-0 kubenswrapper[35367]: I1204 12:21:33.451646 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-scripts\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.459837 master-0 kubenswrapper[35367]: I1204 12:21:33.451677 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/55e3f630-c2c3-49ee-950b-ce9301018170-logs\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.459837 master-0 kubenswrapper[35367]: I1204 12:21:33.452527 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/55e3f630-c2c3-49ee-950b-ce9301018170-logs\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.459837 master-0 kubenswrapper[35367]: I1204 12:21:33.452852 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/55e3f630-c2c3-49ee-950b-ce9301018170-httpd-run\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.459837 master-0 kubenswrapper[35367]: I1204 12:21:33.457768 35367 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 12:21:33.459837 master-0 kubenswrapper[35367]: I1204 12:21:33.457843 35367 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-630610d1-9609-4ef9-bffe-3fdf6689bf1a\" (UniqueName: \"kubernetes.io/csi/topolvm.io^a7ac49b8-50e4-4168-b971-2f8b0e4db56e\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/7a8384074b0c5bf14b517730f91cd3abecb695a5ebd6253723131526ebea9d40/globalmount\"" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.459837 master-0 kubenswrapper[35367]: I1204 12:21:33.459011 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-config-data\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.460623 master-0 kubenswrapper[35367]: I1204 12:21:33.460149 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-combined-ca-bundle\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.479109 master-0 kubenswrapper[35367]: I1204 12:21:33.479018 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-scripts\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.484941 master-0 kubenswrapper[35367]: I1204 12:21:33.484892 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-internal-tls-certs\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.498121 master-0 kubenswrapper[35367]: I1204 12:21:33.492644 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v8rg\" (UniqueName: \"kubernetes.io/projected/55e3f630-c2c3-49ee-950b-ce9301018170-kube-api-access-2v8rg\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:33.503942 master-0 kubenswrapper[35367]: I1204 12:21:33.503120 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-0c69e-default-external-api-0"] Dec 04 12:21:33.536685 master-0 kubenswrapper[35367]: I1204 12:21:33.536596 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/glance-0c69e-default-external-api-0"] Dec 04 12:21:33.542734 master-0 kubenswrapper[35367]: I1204 12:21:33.542657 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-5b3d373a-b38f-44c7-a861-0a8380dfd1e5\" (UniqueName: \"kubernetes.io/csi/topolvm.io^f318c560-8a01-4027-a490-af9e3eba2a4a\") pod \"glance-0c69e-default-external-api-0\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.552296 master-0 kubenswrapper[35367]: I1204 12:21:33.552216 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-0c69e-default-external-api-0"] Dec 04 12:21:33.554345 master-0 kubenswrapper[35367]: I1204 12:21:33.554281 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/csi/topolvm.io^f318c560-8a01-4027-a490-af9e3eba2a4a\") pod \"a5c4d71b-02f5-432b-bcd8-4303603439c2\" (UID: \"a5c4d71b-02f5-432b-bcd8-4303603439c2\") " Dec 04 12:21:33.555068 master-0 kubenswrapper[35367]: I1204 12:21:33.555027 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.559144 master-0 kubenswrapper[35367]: I1204 12:21:33.559098 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-glance-default-public-svc" Dec 04 12:21:33.559436 master-0 kubenswrapper[35367]: I1204 12:21:33.559402 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-0c69e-default-external-config-data" Dec 04 12:21:33.578161 master-0 kubenswrapper[35367]: I1204 12:21:33.576256 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-0c69e-default-external-api-0"] Dec 04 12:21:33.658009 master-0 kubenswrapper[35367]: I1204 12:21:33.657847 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-scripts\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.658009 master-0 kubenswrapper[35367]: I1204 12:21:33.657909 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-logs\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.658009 master-0 kubenswrapper[35367]: I1204 12:21:33.657996 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-combined-ca-bundle\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.658340 master-0 kubenswrapper[35367]: I1204 12:21:33.658048 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-httpd-run\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.658340 master-0 kubenswrapper[35367]: I1204 12:21:33.658124 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-public-tls-certs\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.658340 master-0 kubenswrapper[35367]: I1204 12:21:33.658188 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctmjd\" (UniqueName: \"kubernetes.io/projected/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-kube-api-access-ctmjd\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.658340 master-0 kubenswrapper[35367]: I1204 12:21:33.658233 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-config-data\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.763845 master-0 kubenswrapper[35367]: I1204 12:21:33.762481 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-scripts\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.763845 master-0 kubenswrapper[35367]: I1204 12:21:33.762584 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-logs\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.763845 master-0 kubenswrapper[35367]: I1204 12:21:33.763083 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-combined-ca-bundle\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.763845 master-0 kubenswrapper[35367]: I1204 12:21:33.763131 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-httpd-run\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.763845 master-0 kubenswrapper[35367]: I1204 12:21:33.763224 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-public-tls-certs\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.763845 master-0 kubenswrapper[35367]: I1204 12:21:33.763390 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ctmjd\" (UniqueName: \"kubernetes.io/projected/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-kube-api-access-ctmjd\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.763845 master-0 kubenswrapper[35367]: I1204 12:21:33.763485 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-config-data\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.764483 master-0 kubenswrapper[35367]: I1204 12:21:33.764411 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-logs\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.769613 master-0 kubenswrapper[35367]: I1204 12:21:33.767661 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-httpd-run\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.769613 master-0 kubenswrapper[35367]: I1204 12:21:33.767862 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-scripts\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.770046 master-0 kubenswrapper[35367]: I1204 12:21:33.769667 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-combined-ca-bundle\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.772852 master-0 kubenswrapper[35367]: I1204 12:21:33.772765 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-config-data\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.774495 master-0 kubenswrapper[35367]: I1204 12:21:33.774369 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-public-tls-certs\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:33.780484 master-0 kubenswrapper[35367]: I1204 12:21:33.780392 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctmjd\" (UniqueName: \"kubernetes.io/projected/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-kube-api-access-ctmjd\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:35.595625 master-0 kubenswrapper[35367]: I1204 12:21:35.595565 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/topolvm.io^f318c560-8a01-4027-a490-af9e3eba2a4a" (OuterVolumeSpecName: "glance") pod "a5c4d71b-02f5-432b-bcd8-4303603439c2" (UID: "a5c4d71b-02f5-432b-bcd8-4303603439c2"). InnerVolumeSpecName "pvc-5b3d373a-b38f-44c7-a861-0a8380dfd1e5". PluginName "kubernetes.io/csi", VolumeGidValue "" Dec 04 12:21:35.606838 master-0 kubenswrapper[35367]: I1204 12:21:35.606748 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-630610d1-9609-4ef9-bffe-3fdf6689bf1a\" (UniqueName: \"kubernetes.io/csi/topolvm.io^a7ac49b8-50e4-4168-b971-2f8b0e4db56e\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:35.608960 master-0 kubenswrapper[35367]: I1204 12:21:35.608903 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-5b3d373a-b38f-44c7-a861-0a8380dfd1e5\" (UniqueName: \"kubernetes.io/csi/topolvm.io^f318c560-8a01-4027-a490-af9e3eba2a4a\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:35.686385 master-0 kubenswrapper[35367]: I1204 12:21:35.686334 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:36.768243 master-0 kubenswrapper[35367]: I1204 12:21:36.768164 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5c4d71b-02f5-432b-bcd8-4303603439c2" path="/var/lib/kubelet/pods/a5c4d71b-02f5-432b-bcd8-4303603439c2/volumes" Dec 04 12:21:37.042582 master-0 kubenswrapper[35367]: I1204 12:21:37.042434 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-5b3d373a-b38f-44c7-a861-0a8380dfd1e5\" (UniqueName: \"kubernetes.io/csi/topolvm.io^f318c560-8a01-4027-a490-af9e3eba2a4a\") pod \"glance-0c69e-default-external-api-0\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:37.216467 master-0 kubenswrapper[35367]: I1204 12:21:37.216355 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:38.555717 master-0 kubenswrapper[35367]: W1204 12:21:38.555617 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15d9c3a0_4909_4282_8eb3_8d7a7faafd50.slice/crio-a0ca9e65ac27016e90df7951c7db4c2fa15011081ebe0fea6014de0d4995a1e4 WatchSource:0}: Error finding container a0ca9e65ac27016e90df7951c7db4c2fa15011081ebe0fea6014de0d4995a1e4: Status 404 returned error can't find the container with id a0ca9e65ac27016e90df7951c7db4c2fa15011081ebe0fea6014de0d4995a1e4 Dec 04 12:21:38.571889 master-0 kubenswrapper[35367]: I1204 12:21:38.571839 35367 scope.go:117] "RemoveContainer" containerID="ad18d22768c790327376ca81ef00a442527ce771c9e094e2487f451d00bfd8d0" Dec 04 12:21:38.708911 master-0 kubenswrapper[35367]: I1204 12:21:38.708800 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/placement-db-sync-hlw45" Dec 04 12:21:38.792420 master-0 kubenswrapper[35367]: I1204 12:21:38.792350 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:38.908865 master-0 kubenswrapper[35367]: I1204 12:21:38.906819 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-credential-keys\") pod \"088fa28d-a668-4bcc-9038-24e9a97f25d4\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " Dec 04 12:21:38.908865 master-0 kubenswrapper[35367]: I1204 12:21:38.906958 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-scripts\") pod \"088fa28d-a668-4bcc-9038-24e9a97f25d4\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " Dec 04 12:21:38.908865 master-0 kubenswrapper[35367]: I1204 12:21:38.906998 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0e9b193-ab20-484e-b727-c24c8aecb2c5-combined-ca-bundle\") pod \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\" (UID: \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\") " Dec 04 12:21:38.908865 master-0 kubenswrapper[35367]: I1204 12:21:38.907068 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8482d\" (UniqueName: \"kubernetes.io/projected/088fa28d-a668-4bcc-9038-24e9a97f25d4-kube-api-access-8482d\") pod \"088fa28d-a668-4bcc-9038-24e9a97f25d4\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " Dec 04 12:21:38.908865 master-0 kubenswrapper[35367]: I1204 12:21:38.907134 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cfh2\" (UniqueName: \"kubernetes.io/projected/f0e9b193-ab20-484e-b727-c24c8aecb2c5-kube-api-access-2cfh2\") pod \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\" (UID: \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\") " Dec 04 12:21:38.908865 master-0 kubenswrapper[35367]: I1204 12:21:38.907181 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0e9b193-ab20-484e-b727-c24c8aecb2c5-scripts\") pod \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\" (UID: \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\") " Dec 04 12:21:38.908865 master-0 kubenswrapper[35367]: I1204 12:21:38.907212 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-combined-ca-bundle\") pod \"088fa28d-a668-4bcc-9038-24e9a97f25d4\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " Dec 04 12:21:38.908865 master-0 kubenswrapper[35367]: I1204 12:21:38.907262 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0e9b193-ab20-484e-b727-c24c8aecb2c5-logs\") pod \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\" (UID: \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\") " Dec 04 12:21:38.908865 master-0 kubenswrapper[35367]: I1204 12:21:38.907288 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0e9b193-ab20-484e-b727-c24c8aecb2c5-config-data\") pod \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\" (UID: \"f0e9b193-ab20-484e-b727-c24c8aecb2c5\") " Dec 04 12:21:38.908865 master-0 kubenswrapper[35367]: I1204 12:21:38.907334 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-fernet-keys\") pod \"088fa28d-a668-4bcc-9038-24e9a97f25d4\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " Dec 04 12:21:38.908865 master-0 kubenswrapper[35367]: I1204 12:21:38.907382 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-config-data\") pod \"088fa28d-a668-4bcc-9038-24e9a97f25d4\" (UID: \"088fa28d-a668-4bcc-9038-24e9a97f25d4\") " Dec 04 12:21:38.908865 master-0 kubenswrapper[35367]: I1204 12:21:38.908459 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0e9b193-ab20-484e-b727-c24c8aecb2c5-logs" (OuterVolumeSpecName: "logs") pod "f0e9b193-ab20-484e-b727-c24c8aecb2c5" (UID: "f0e9b193-ab20-484e-b727-c24c8aecb2c5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:21:38.917394 master-0 kubenswrapper[35367]: I1204 12:21:38.916151 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0e9b193-ab20-484e-b727-c24c8aecb2c5-scripts" (OuterVolumeSpecName: "scripts") pod "f0e9b193-ab20-484e-b727-c24c8aecb2c5" (UID: "f0e9b193-ab20-484e-b727-c24c8aecb2c5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:38.919307 master-0 kubenswrapper[35367]: I1204 12:21:38.919233 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "088fa28d-a668-4bcc-9038-24e9a97f25d4" (UID: "088fa28d-a668-4bcc-9038-24e9a97f25d4"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:38.919527 master-0 kubenswrapper[35367]: I1204 12:21:38.919494 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-scripts" (OuterVolumeSpecName: "scripts") pod "088fa28d-a668-4bcc-9038-24e9a97f25d4" (UID: "088fa28d-a668-4bcc-9038-24e9a97f25d4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:38.919624 master-0 kubenswrapper[35367]: I1204 12:21:38.919543 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/088fa28d-a668-4bcc-9038-24e9a97f25d4-kube-api-access-8482d" (OuterVolumeSpecName: "kube-api-access-8482d") pod "088fa28d-a668-4bcc-9038-24e9a97f25d4" (UID: "088fa28d-a668-4bcc-9038-24e9a97f25d4"). InnerVolumeSpecName "kube-api-access-8482d". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:21:38.919624 master-0 kubenswrapper[35367]: I1204 12:21:38.919561 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "088fa28d-a668-4bcc-9038-24e9a97f25d4" (UID: "088fa28d-a668-4bcc-9038-24e9a97f25d4"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:38.921562 master-0 kubenswrapper[35367]: I1204 12:21:38.921469 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0e9b193-ab20-484e-b727-c24c8aecb2c5-kube-api-access-2cfh2" (OuterVolumeSpecName: "kube-api-access-2cfh2") pod "f0e9b193-ab20-484e-b727-c24c8aecb2c5" (UID: "f0e9b193-ab20-484e-b727-c24c8aecb2c5"). InnerVolumeSpecName "kube-api-access-2cfh2". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:21:38.949968 master-0 kubenswrapper[35367]: I1204 12:21:38.949907 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0e9b193-ab20-484e-b727-c24c8aecb2c5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f0e9b193-ab20-484e-b727-c24c8aecb2c5" (UID: "f0e9b193-ab20-484e-b727-c24c8aecb2c5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:38.957862 master-0 kubenswrapper[35367]: I1204 12:21:38.957730 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "088fa28d-a668-4bcc-9038-24e9a97f25d4" (UID: "088fa28d-a668-4bcc-9038-24e9a97f25d4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:38.963579 master-0 kubenswrapper[35367]: I1204 12:21:38.963502 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0e9b193-ab20-484e-b727-c24c8aecb2c5-config-data" (OuterVolumeSpecName: "config-data") pod "f0e9b193-ab20-484e-b727-c24c8aecb2c5" (UID: "f0e9b193-ab20-484e-b727-c24c8aecb2c5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:38.990372 master-0 kubenswrapper[35367]: I1204 12:21:38.985335 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-config-data" (OuterVolumeSpecName: "config-data") pod "088fa28d-a668-4bcc-9038-24e9a97f25d4" (UID: "088fa28d-a668-4bcc-9038-24e9a97f25d4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:39.015391 master-0 kubenswrapper[35367]: I1204 12:21:39.014031 35367 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-credential-keys\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:39.015391 master-0 kubenswrapper[35367]: I1204 12:21:39.014088 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:39.015391 master-0 kubenswrapper[35367]: I1204 12:21:39.014102 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0e9b193-ab20-484e-b727-c24c8aecb2c5-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:39.015391 master-0 kubenswrapper[35367]: I1204 12:21:39.014121 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8482d\" (UniqueName: \"kubernetes.io/projected/088fa28d-a668-4bcc-9038-24e9a97f25d4-kube-api-access-8482d\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:39.015391 master-0 kubenswrapper[35367]: I1204 12:21:39.014138 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2cfh2\" (UniqueName: \"kubernetes.io/projected/f0e9b193-ab20-484e-b727-c24c8aecb2c5-kube-api-access-2cfh2\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:39.015391 master-0 kubenswrapper[35367]: I1204 12:21:39.014153 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0e9b193-ab20-484e-b727-c24c8aecb2c5-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:39.015391 master-0 kubenswrapper[35367]: I1204 12:21:39.014165 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:39.015391 master-0 kubenswrapper[35367]: I1204 12:21:39.014180 35367 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0e9b193-ab20-484e-b727-c24c8aecb2c5-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:39.015391 master-0 kubenswrapper[35367]: I1204 12:21:39.014191 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0e9b193-ab20-484e-b727-c24c8aecb2c5-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:39.015391 master-0 kubenswrapper[35367]: I1204 12:21:39.014203 35367 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-fernet-keys\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:39.015391 master-0 kubenswrapper[35367]: I1204 12:21:39.014214 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/088fa28d-a668-4bcc-9038-24e9a97f25d4-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:39.338519 master-0 kubenswrapper[35367]: I1204 12:21:39.338419 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-db-sync-ql68f"] Dec 04 12:21:39.347933 master-0 kubenswrapper[35367]: I1204 12:21:39.347441 35367 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Dec 04 12:21:39.499581 master-0 kubenswrapper[35367]: I1204 12:21:39.499505 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-db-sync-hlw45" event={"ID":"f0e9b193-ab20-484e-b727-c24c8aecb2c5","Type":"ContainerDied","Data":"7f23999743b541897fb7b7bea1cdef24d016c6b0541698efe667a7a68fa3f39e"} Dec 04 12:21:39.499581 master-0 kubenswrapper[35367]: I1204 12:21:39.499567 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f23999743b541897fb7b7bea1cdef24d016c6b0541698efe667a7a68fa3f39e" Dec 04 12:21:39.499581 master-0 kubenswrapper[35367]: I1204 12:21:39.499519 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/placement-db-sync-hlw45" Dec 04 12:21:39.502119 master-0 kubenswrapper[35367]: I1204 12:21:39.502067 35367 generic.go:334] "Generic (PLEG): container finished" podID="15d9c3a0-4909-4282-8eb3-8d7a7faafd50" containerID="e79009673255b982975b565c237c1b40249f3329adb28c1cacbb656c10404789" exitCode=0 Dec 04 12:21:39.502214 master-0 kubenswrapper[35367]: I1204 12:21:39.502152 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" event={"ID":"15d9c3a0-4909-4282-8eb3-8d7a7faafd50","Type":"ContainerDied","Data":"e79009673255b982975b565c237c1b40249f3329adb28c1cacbb656c10404789"} Dec 04 12:21:39.502253 master-0 kubenswrapper[35367]: I1204 12:21:39.502218 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" event={"ID":"15d9c3a0-4909-4282-8eb3-8d7a7faafd50","Type":"ContainerStarted","Data":"a0ca9e65ac27016e90df7951c7db4c2fa15011081ebe0fea6014de0d4995a1e4"} Dec 04 12:21:39.519414 master-0 kubenswrapper[35367]: I1204 12:21:39.519286 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-db-sync-ql68f" event={"ID":"0a783310-4355-49c9-9962-b5741fb70344","Type":"ContainerStarted","Data":"c2a276bb307f155cad90d73d8e7b55be2abd7ac505da9dac1f553991244ffcc2"} Dec 04 12:21:39.530522 master-0 kubenswrapper[35367]: I1204 12:21:39.530385 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-bootstrap-zzmjk" event={"ID":"088fa28d-a668-4bcc-9038-24e9a97f25d4","Type":"ContainerDied","Data":"25843b962cbe865d02877193aec60e2f79c2e179ebdcbb64b23afafa4a955c9b"} Dec 04 12:21:39.530522 master-0 kubenswrapper[35367]: I1204 12:21:39.530454 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25843b962cbe865d02877193aec60e2f79c2e179ebdcbb64b23afafa4a955c9b" Dec 04 12:21:39.530676 master-0 kubenswrapper[35367]: I1204 12:21:39.530532 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-bootstrap-zzmjk" Dec 04 12:21:39.545100 master-0 kubenswrapper[35367]: I1204 12:21:39.545032 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-0c69e-default-internal-api-0"] Dec 04 12:21:39.694257 master-0 kubenswrapper[35367]: W1204 12:21:39.694158 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2811f60c_87a0_4438_96b6_a19e9d8a5b6a.slice/crio-d9dd106906b8c27c38d341e41423267af8bf6d40c09655e906296e296a498a5d WatchSource:0}: Error finding container d9dd106906b8c27c38d341e41423267af8bf6d40c09655e906296e296a498a5d: Status 404 returned error can't find the container with id d9dd106906b8c27c38d341e41423267af8bf6d40c09655e906296e296a498a5d Dec 04 12:21:39.700996 master-0 kubenswrapper[35367]: I1204 12:21:39.700669 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-0c69e-default-external-api-0"] Dec 04 12:21:39.950379 master-0 kubenswrapper[35367]: I1204 12:21:39.950052 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/placement-99465d558-ft78w"] Dec 04 12:21:39.950756 master-0 kubenswrapper[35367]: E1204 12:21:39.950717 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="088fa28d-a668-4bcc-9038-24e9a97f25d4" containerName="keystone-bootstrap" Dec 04 12:21:39.950756 master-0 kubenswrapper[35367]: I1204 12:21:39.950749 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="088fa28d-a668-4bcc-9038-24e9a97f25d4" containerName="keystone-bootstrap" Dec 04 12:21:39.950951 master-0 kubenswrapper[35367]: E1204 12:21:39.950831 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f0e9b193-ab20-484e-b727-c24c8aecb2c5" containerName="placement-db-sync" Dec 04 12:21:39.950951 master-0 kubenswrapper[35367]: I1204 12:21:39.950841 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0e9b193-ab20-484e-b727-c24c8aecb2c5" containerName="placement-db-sync" Dec 04 12:21:39.951110 master-0 kubenswrapper[35367]: I1204 12:21:39.951090 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="f0e9b193-ab20-484e-b727-c24c8aecb2c5" containerName="placement-db-sync" Dec 04 12:21:39.951244 master-0 kubenswrapper[35367]: I1204 12:21:39.951124 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="088fa28d-a668-4bcc-9038-24e9a97f25d4" containerName="keystone-bootstrap" Dec 04 12:21:39.956325 master-0 kubenswrapper[35367]: I1204 12:21:39.956266 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:39.966300 master-0 kubenswrapper[35367]: I1204 12:21:39.963883 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"placement-scripts" Dec 04 12:21:39.966300 master-0 kubenswrapper[35367]: I1204 12:21:39.963960 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"placement-config-data" Dec 04 12:21:39.966300 master-0 kubenswrapper[35367]: I1204 12:21:39.964393 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-placement-internal-svc" Dec 04 12:21:39.966300 master-0 kubenswrapper[35367]: I1204 12:21:39.964485 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-placement-public-svc" Dec 04 12:21:39.983144 master-0 kubenswrapper[35367]: I1204 12:21:39.979784 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-99465d558-ft78w"] Dec 04 12:21:40.065921 master-0 kubenswrapper[35367]: I1204 12:21:40.063053 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e619fe71-b94e-40da-9068-6fa75085f5e4-scripts\") pod \"placement-99465d558-ft78w\" (UID: \"e619fe71-b94e-40da-9068-6fa75085f5e4\") " pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.065921 master-0 kubenswrapper[35367]: I1204 12:21:40.063144 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e619fe71-b94e-40da-9068-6fa75085f5e4-internal-tls-certs\") pod \"placement-99465d558-ft78w\" (UID: \"e619fe71-b94e-40da-9068-6fa75085f5e4\") " pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.065921 master-0 kubenswrapper[35367]: I1204 12:21:40.063187 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e619fe71-b94e-40da-9068-6fa75085f5e4-public-tls-certs\") pod \"placement-99465d558-ft78w\" (UID: \"e619fe71-b94e-40da-9068-6fa75085f5e4\") " pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.065921 master-0 kubenswrapper[35367]: I1204 12:21:40.063309 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e619fe71-b94e-40da-9068-6fa75085f5e4-config-data\") pod \"placement-99465d558-ft78w\" (UID: \"e619fe71-b94e-40da-9068-6fa75085f5e4\") " pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.065921 master-0 kubenswrapper[35367]: I1204 12:21:40.064030 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e619fe71-b94e-40da-9068-6fa75085f5e4-combined-ca-bundle\") pod \"placement-99465d558-ft78w\" (UID: \"e619fe71-b94e-40da-9068-6fa75085f5e4\") " pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.065921 master-0 kubenswrapper[35367]: I1204 12:21:40.064484 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz8xs\" (UniqueName: \"kubernetes.io/projected/e619fe71-b94e-40da-9068-6fa75085f5e4-kube-api-access-gz8xs\") pod \"placement-99465d558-ft78w\" (UID: \"e619fe71-b94e-40da-9068-6fa75085f5e4\") " pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.065921 master-0 kubenswrapper[35367]: I1204 12:21:40.064534 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e619fe71-b94e-40da-9068-6fa75085f5e4-logs\") pod \"placement-99465d558-ft78w\" (UID: \"e619fe71-b94e-40da-9068-6fa75085f5e4\") " pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.095691 master-0 kubenswrapper[35367]: I1204 12:21:40.090922 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/keystone-774cd58b59-fd4bc"] Dec 04 12:21:40.095691 master-0 kubenswrapper[35367]: I1204 12:21:40.094146 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.098837 master-0 kubenswrapper[35367]: I1204 12:21:40.097684 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-keystone-public-svc" Dec 04 12:21:40.098837 master-0 kubenswrapper[35367]: I1204 12:21:40.098149 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-keystone-internal-svc" Dec 04 12:21:40.098837 master-0 kubenswrapper[35367]: I1204 12:21:40.098334 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone-scripts" Dec 04 12:21:40.098837 master-0 kubenswrapper[35367]: I1204 12:21:40.098486 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone-config-data" Dec 04 12:21:40.098837 master-0 kubenswrapper[35367]: I1204 12:21:40.098634 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone" Dec 04 12:21:40.142332 master-0 kubenswrapper[35367]: I1204 12:21:40.142259 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-774cd58b59-fd4bc"] Dec 04 12:21:40.170837 master-0 kubenswrapper[35367]: I1204 12:21:40.170144 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e619fe71-b94e-40da-9068-6fa75085f5e4-combined-ca-bundle\") pod \"placement-99465d558-ft78w\" (UID: \"e619fe71-b94e-40da-9068-6fa75085f5e4\") " pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.170837 master-0 kubenswrapper[35367]: I1204 12:21:40.170241 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/245ad8fa-8ee1-4f84-91e9-effa83491c09-fernet-keys\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.170837 master-0 kubenswrapper[35367]: I1204 12:21:40.170280 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/245ad8fa-8ee1-4f84-91e9-effa83491c09-public-tls-certs\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.170837 master-0 kubenswrapper[35367]: I1204 12:21:40.170469 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/245ad8fa-8ee1-4f84-91e9-effa83491c09-internal-tls-certs\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.170837 master-0 kubenswrapper[35367]: I1204 12:21:40.170539 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/245ad8fa-8ee1-4f84-91e9-effa83491c09-scripts\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.170837 master-0 kubenswrapper[35367]: I1204 12:21:40.170617 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/245ad8fa-8ee1-4f84-91e9-effa83491c09-config-data\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.170837 master-0 kubenswrapper[35367]: I1204 12:21:40.170656 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gz8xs\" (UniqueName: \"kubernetes.io/projected/e619fe71-b94e-40da-9068-6fa75085f5e4-kube-api-access-gz8xs\") pod \"placement-99465d558-ft78w\" (UID: \"e619fe71-b94e-40da-9068-6fa75085f5e4\") " pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.170837 master-0 kubenswrapper[35367]: I1204 12:21:40.170693 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e619fe71-b94e-40da-9068-6fa75085f5e4-logs\") pod \"placement-99465d558-ft78w\" (UID: \"e619fe71-b94e-40da-9068-6fa75085f5e4\") " pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.170837 master-0 kubenswrapper[35367]: I1204 12:21:40.170725 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/245ad8fa-8ee1-4f84-91e9-effa83491c09-credential-keys\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.170837 master-0 kubenswrapper[35367]: I1204 12:21:40.170762 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/245ad8fa-8ee1-4f84-91e9-effa83491c09-combined-ca-bundle\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.170837 master-0 kubenswrapper[35367]: I1204 12:21:40.170822 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e619fe71-b94e-40da-9068-6fa75085f5e4-scripts\") pod \"placement-99465d558-ft78w\" (UID: \"e619fe71-b94e-40da-9068-6fa75085f5e4\") " pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.171523 master-0 kubenswrapper[35367]: I1204 12:21:40.170891 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e619fe71-b94e-40da-9068-6fa75085f5e4-internal-tls-certs\") pod \"placement-99465d558-ft78w\" (UID: \"e619fe71-b94e-40da-9068-6fa75085f5e4\") " pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.171523 master-0 kubenswrapper[35367]: I1204 12:21:40.170938 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6g2j\" (UniqueName: \"kubernetes.io/projected/245ad8fa-8ee1-4f84-91e9-effa83491c09-kube-api-access-x6g2j\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.171523 master-0 kubenswrapper[35367]: I1204 12:21:40.170980 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e619fe71-b94e-40da-9068-6fa75085f5e4-public-tls-certs\") pod \"placement-99465d558-ft78w\" (UID: \"e619fe71-b94e-40da-9068-6fa75085f5e4\") " pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.171523 master-0 kubenswrapper[35367]: I1204 12:21:40.171114 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e619fe71-b94e-40da-9068-6fa75085f5e4-config-data\") pod \"placement-99465d558-ft78w\" (UID: \"e619fe71-b94e-40da-9068-6fa75085f5e4\") " pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.173985 master-0 kubenswrapper[35367]: I1204 12:21:40.172237 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e619fe71-b94e-40da-9068-6fa75085f5e4-logs\") pod \"placement-99465d558-ft78w\" (UID: \"e619fe71-b94e-40da-9068-6fa75085f5e4\") " pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.175431 master-0 kubenswrapper[35367]: I1204 12:21:40.175323 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e619fe71-b94e-40da-9068-6fa75085f5e4-combined-ca-bundle\") pod \"placement-99465d558-ft78w\" (UID: \"e619fe71-b94e-40da-9068-6fa75085f5e4\") " pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.176981 master-0 kubenswrapper[35367]: I1204 12:21:40.175569 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e619fe71-b94e-40da-9068-6fa75085f5e4-config-data\") pod \"placement-99465d558-ft78w\" (UID: \"e619fe71-b94e-40da-9068-6fa75085f5e4\") " pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.177477 master-0 kubenswrapper[35367]: I1204 12:21:40.177444 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e619fe71-b94e-40da-9068-6fa75085f5e4-scripts\") pod \"placement-99465d558-ft78w\" (UID: \"e619fe71-b94e-40da-9068-6fa75085f5e4\") " pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.179398 master-0 kubenswrapper[35367]: I1204 12:21:40.178391 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e619fe71-b94e-40da-9068-6fa75085f5e4-internal-tls-certs\") pod \"placement-99465d558-ft78w\" (UID: \"e619fe71-b94e-40da-9068-6fa75085f5e4\") " pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.182665 master-0 kubenswrapper[35367]: I1204 12:21:40.182617 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e619fe71-b94e-40da-9068-6fa75085f5e4-public-tls-certs\") pod \"placement-99465d558-ft78w\" (UID: \"e619fe71-b94e-40da-9068-6fa75085f5e4\") " pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.193165 master-0 kubenswrapper[35367]: I1204 12:21:40.193116 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz8xs\" (UniqueName: \"kubernetes.io/projected/e619fe71-b94e-40da-9068-6fa75085f5e4-kube-api-access-gz8xs\") pod \"placement-99465d558-ft78w\" (UID: \"e619fe71-b94e-40da-9068-6fa75085f5e4\") " pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.277727 master-0 kubenswrapper[35367]: I1204 12:21:40.273437 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/245ad8fa-8ee1-4f84-91e9-effa83491c09-fernet-keys\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.277727 master-0 kubenswrapper[35367]: I1204 12:21:40.273525 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/245ad8fa-8ee1-4f84-91e9-effa83491c09-public-tls-certs\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.277727 master-0 kubenswrapper[35367]: I1204 12:21:40.273637 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/245ad8fa-8ee1-4f84-91e9-effa83491c09-internal-tls-certs\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.277727 master-0 kubenswrapper[35367]: I1204 12:21:40.273685 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/245ad8fa-8ee1-4f84-91e9-effa83491c09-scripts\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.277727 master-0 kubenswrapper[35367]: I1204 12:21:40.273759 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/245ad8fa-8ee1-4f84-91e9-effa83491c09-config-data\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.277727 master-0 kubenswrapper[35367]: I1204 12:21:40.273836 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/245ad8fa-8ee1-4f84-91e9-effa83491c09-credential-keys\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.277727 master-0 kubenswrapper[35367]: I1204 12:21:40.273876 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/245ad8fa-8ee1-4f84-91e9-effa83491c09-combined-ca-bundle\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.277727 master-0 kubenswrapper[35367]: I1204 12:21:40.273950 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-x6g2j\" (UniqueName: \"kubernetes.io/projected/245ad8fa-8ee1-4f84-91e9-effa83491c09-kube-api-access-x6g2j\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.286515 master-0 kubenswrapper[35367]: I1204 12:21:40.279088 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/245ad8fa-8ee1-4f84-91e9-effa83491c09-scripts\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.286515 master-0 kubenswrapper[35367]: I1204 12:21:40.279353 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/245ad8fa-8ee1-4f84-91e9-effa83491c09-config-data\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.286515 master-0 kubenswrapper[35367]: I1204 12:21:40.279379 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/245ad8fa-8ee1-4f84-91e9-effa83491c09-fernet-keys\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.286515 master-0 kubenswrapper[35367]: I1204 12:21:40.279472 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/245ad8fa-8ee1-4f84-91e9-effa83491c09-credential-keys\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.286515 master-0 kubenswrapper[35367]: I1204 12:21:40.279656 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/245ad8fa-8ee1-4f84-91e9-effa83491c09-internal-tls-certs\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.286515 master-0 kubenswrapper[35367]: I1204 12:21:40.280348 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/245ad8fa-8ee1-4f84-91e9-effa83491c09-public-tls-certs\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.286515 master-0 kubenswrapper[35367]: I1204 12:21:40.282450 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/245ad8fa-8ee1-4f84-91e9-effa83491c09-combined-ca-bundle\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.295959 master-0 kubenswrapper[35367]: I1204 12:21:40.295904 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6g2j\" (UniqueName: \"kubernetes.io/projected/245ad8fa-8ee1-4f84-91e9-effa83491c09-kube-api-access-x6g2j\") pod \"keystone-774cd58b59-fd4bc\" (UID: \"245ad8fa-8ee1-4f84-91e9-effa83491c09\") " pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.311253 master-0 kubenswrapper[35367]: I1204 12:21:40.311171 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:40.448676 master-0 kubenswrapper[35367]: I1204 12:21:40.448553 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:40.587927 master-0 kubenswrapper[35367]: I1204 12:21:40.587222 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" event={"ID":"15d9c3a0-4909-4282-8eb3-8d7a7faafd50","Type":"ContainerStarted","Data":"ab91a90c9968dd402e207fcaf1ecc7defd7e714ae7df0cec67b640112ca547ce"} Dec 04 12:21:40.587927 master-0 kubenswrapper[35367]: I1204 12:21:40.587860 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:40.600863 master-0 kubenswrapper[35367]: I1204 12:21:40.596908 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-db-sync-x9w96" event={"ID":"e72935b7-293c-4160-a02a-cbf179274ab0","Type":"ContainerStarted","Data":"89d2e2a28656ced1e0a7e37fbc365be3169225c02a2a7f219453321436644f67"} Dec 04 12:21:40.605869 master-0 kubenswrapper[35367]: I1204 12:21:40.603989 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-0c69e-default-external-api-0" event={"ID":"2811f60c-87a0-4438-96b6-a19e9d8a5b6a","Type":"ContainerStarted","Data":"cdc0396c2487a84e8966f80f5ff54e0c6a4b2047e4a265d4bb08e82502a9aa90"} Dec 04 12:21:40.605869 master-0 kubenswrapper[35367]: I1204 12:21:40.604068 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-0c69e-default-external-api-0" event={"ID":"2811f60c-87a0-4438-96b6-a19e9d8a5b6a","Type":"ContainerStarted","Data":"d9dd106906b8c27c38d341e41423267af8bf6d40c09655e906296e296a498a5d"} Dec 04 12:21:40.612378 master-0 kubenswrapper[35367]: I1204 12:21:40.606309 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-0c69e-default-internal-api-0" event={"ID":"55e3f630-c2c3-49ee-950b-ce9301018170","Type":"ContainerStarted","Data":"b48f1aa23617dfbd2c90cfe5e203205569b5b3b00e05485f4e021f009a0262f8"} Dec 04 12:21:40.612378 master-0 kubenswrapper[35367]: I1204 12:21:40.606378 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-0c69e-default-internal-api-0" event={"ID":"55e3f630-c2c3-49ee-950b-ce9301018170","Type":"ContainerStarted","Data":"c99abc7cd491db75960e349888347d672b37d43ab5c399d8314288b6e0873b17"} Dec 04 12:21:40.656866 master-0 kubenswrapper[35367]: I1204 12:21:40.649866 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" podStartSLOduration=14.649834856 podStartE2EDuration="14.649834856s" podCreationTimestamp="2025-12-04 12:21:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:21:40.640765719 +0000 UTC m=+1344.078826997" watchObservedRunningTime="2025-12-04 12:21:40.649834856 +0000 UTC m=+1344.087896114" Dec 04 12:21:40.702952 master-0 kubenswrapper[35367]: I1204 12:21:40.698902 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-0c69e-db-sync-x9w96" podStartSLOduration=4.105780004 podStartE2EDuration="23.698862723s" podCreationTimestamp="2025-12-04 12:21:17 +0000 UTC" firstStartedPulling="2025-12-04 12:21:19.321586267 +0000 UTC m=+1322.759647525" lastFinishedPulling="2025-12-04 12:21:38.914668986 +0000 UTC m=+1342.352730244" observedRunningTime="2025-12-04 12:21:40.684994506 +0000 UTC m=+1344.123055774" watchObservedRunningTime="2025-12-04 12:21:40.698862723 +0000 UTC m=+1344.136923981" Dec 04 12:21:40.980380 master-0 kubenswrapper[35367]: I1204 12:21:40.978172 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-99465d558-ft78w"] Dec 04 12:21:41.067959 master-0 kubenswrapper[35367]: I1204 12:21:41.064497 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-774cd58b59-fd4bc"] Dec 04 12:21:41.119181 master-0 kubenswrapper[35367]: W1204 12:21:41.119124 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod245ad8fa_8ee1_4f84_91e9_effa83491c09.slice/crio-db966ff691a05c3b17e9656db71fc2a35207237ee3e503d1e89d4ef3e1ba57c7 WatchSource:0}: Error finding container db966ff691a05c3b17e9656db71fc2a35207237ee3e503d1e89d4ef3e1ba57c7: Status 404 returned error can't find the container with id db966ff691a05c3b17e9656db71fc2a35207237ee3e503d1e89d4ef3e1ba57c7 Dec 04 12:21:41.646899 master-0 kubenswrapper[35367]: I1204 12:21:41.646727 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-99465d558-ft78w" event={"ID":"e619fe71-b94e-40da-9068-6fa75085f5e4","Type":"ContainerStarted","Data":"0ab231c3613ccbc193b161ec55227827b0f2ad43c4ed12e4eecb3a3dcc1bb6f0"} Dec 04 12:21:41.646899 master-0 kubenswrapper[35367]: I1204 12:21:41.646834 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-99465d558-ft78w" event={"ID":"e619fe71-b94e-40da-9068-6fa75085f5e4","Type":"ContainerStarted","Data":"6d6e84165ff9427acf38df9998eb0a99aca620c49fe4e47504da98d31d861cb5"} Dec 04 12:21:41.653503 master-0 kubenswrapper[35367]: I1204 12:21:41.652204 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-0c69e-default-external-api-0" event={"ID":"2811f60c-87a0-4438-96b6-a19e9d8a5b6a","Type":"ContainerStarted","Data":"f9347c31ff229c8d7ffcbf80a45550af30f3e14a3c456160cd0e8a6e2b89d47b"} Dec 04 12:21:41.662449 master-0 kubenswrapper[35367]: I1204 12:21:41.662314 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-774cd58b59-fd4bc" event={"ID":"245ad8fa-8ee1-4f84-91e9-effa83491c09","Type":"ContainerStarted","Data":"6a99cd037ebb7f4b416e7b38fe6ec1fde701579712f8ab3332022c0404903e12"} Dec 04 12:21:41.662449 master-0 kubenswrapper[35367]: I1204 12:21:41.662388 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-774cd58b59-fd4bc" event={"ID":"245ad8fa-8ee1-4f84-91e9-effa83491c09","Type":"ContainerStarted","Data":"db966ff691a05c3b17e9656db71fc2a35207237ee3e503d1e89d4ef3e1ba57c7"} Dec 04 12:21:41.662680 master-0 kubenswrapper[35367]: I1204 12:21:41.662518 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:21:41.666938 master-0 kubenswrapper[35367]: I1204 12:21:41.666795 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-0c69e-default-internal-api-0" event={"ID":"55e3f630-c2c3-49ee-950b-ce9301018170","Type":"ContainerStarted","Data":"b522ce1baa53af37db7bea93b6c278b3fd0dadb6babeac6d5037b2a76e3c06f0"} Dec 04 12:21:41.688593 master-0 kubenswrapper[35367]: I1204 12:21:41.684712 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/glance-0c69e-default-external-api-0" podStartSLOduration=8.684686252 podStartE2EDuration="8.684686252s" podCreationTimestamp="2025-12-04 12:21:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:21:41.67956594 +0000 UTC m=+1345.117627208" watchObservedRunningTime="2025-12-04 12:21:41.684686252 +0000 UTC m=+1345.122747510" Dec 04 12:21:41.738063 master-0 kubenswrapper[35367]: I1204 12:21:41.737817 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/keystone-774cd58b59-fd4bc" podStartSLOduration=2.737771708 podStartE2EDuration="2.737771708s" podCreationTimestamp="2025-12-04 12:21:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:21:41.716500327 +0000 UTC m=+1345.154561585" watchObservedRunningTime="2025-12-04 12:21:41.737771708 +0000 UTC m=+1345.175832986" Dec 04 12:21:41.758064 master-0 kubenswrapper[35367]: I1204 12:21:41.756447 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/glance-0c69e-default-internal-api-0" podStartSLOduration=9.756420726 podStartE2EDuration="9.756420726s" podCreationTimestamp="2025-12-04 12:21:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:21:41.745634706 +0000 UTC m=+1345.183695964" watchObservedRunningTime="2025-12-04 12:21:41.756420726 +0000 UTC m=+1345.194481984" Dec 04 12:21:42.695561 master-0 kubenswrapper[35367]: I1204 12:21:42.695470 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-99465d558-ft78w" event={"ID":"e619fe71-b94e-40da-9068-6fa75085f5e4","Type":"ContainerStarted","Data":"4537aa71fc26743b1586b3afd69570c804cc4731d9017b6fac4cafc7ef1c1258"} Dec 04 12:21:42.695561 master-0 kubenswrapper[35367]: I1204 12:21:42.695563 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:42.695886 master-0 kubenswrapper[35367]: I1204 12:21:42.695577 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/placement-99465d558-ft78w" Dec 04 12:21:42.750834 master-0 kubenswrapper[35367]: I1204 12:21:42.745299 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/placement-99465d558-ft78w" podStartSLOduration=3.74526795 podStartE2EDuration="3.74526795s" podCreationTimestamp="2025-12-04 12:21:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:21:42.73195853 +0000 UTC m=+1346.170019808" watchObservedRunningTime="2025-12-04 12:21:42.74526795 +0000 UTC m=+1346.183329218" Dec 04 12:21:45.687668 master-0 kubenswrapper[35367]: I1204 12:21:45.687585 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:45.687668 master-0 kubenswrapper[35367]: I1204 12:21:45.687661 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:45.722220 master-0 kubenswrapper[35367]: I1204 12:21:45.722112 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:45.733630 master-0 kubenswrapper[35367]: I1204 12:21:45.733570 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:45.737233 master-0 kubenswrapper[35367]: I1204 12:21:45.736931 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:45.737411 master-0 kubenswrapper[35367]: I1204 12:21:45.737385 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:47.217339 master-0 kubenswrapper[35367]: I1204 12:21:47.217246 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:47.217339 master-0 kubenswrapper[35367]: I1204 12:21:47.217347 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:47.252163 master-0 kubenswrapper[35367]: I1204 12:21:47.252070 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:47.269194 master-0 kubenswrapper[35367]: I1204 12:21:47.269134 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:47.360089 master-0 kubenswrapper[35367]: I1204 12:21:47.360008 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:21:47.764221 master-0 kubenswrapper[35367]: I1204 12:21:47.763158 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:47.764221 master-0 kubenswrapper[35367]: I1204 12:21:47.763225 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:48.022510 master-0 kubenswrapper[35367]: I1204 12:21:48.022349 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:48.024344 master-0 kubenswrapper[35367]: I1204 12:21:48.024296 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:21:49.917568 master-0 kubenswrapper[35367]: I1204 12:21:49.917435 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:49.918205 master-0 kubenswrapper[35367]: I1204 12:21:49.917698 35367 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 12:21:49.989237 master-0 kubenswrapper[35367]: I1204 12:21:49.989146 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:21:51.321836 master-0 kubenswrapper[35367]: I1204 12:21:51.317896 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-7d4d74cb79-bk5n5"] Dec 04 12:21:51.321836 master-0 kubenswrapper[35367]: I1204 12:21:51.318261 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" podUID="ecf9a649-68f2-4c6f-9460-3a48dc075245" containerName="dnsmasq-dns" containerID="cri-o://f185f6100be75725bcf243c9242c73fa7267710a6b71ae9bff3d50d8a6c5fbac" gracePeriod=10 Dec 04 12:21:51.853814 master-0 kubenswrapper[35367]: I1204 12:21:51.853715 35367 generic.go:334] "Generic (PLEG): container finished" podID="e72935b7-293c-4160-a02a-cbf179274ab0" containerID="89d2e2a28656ced1e0a7e37fbc365be3169225c02a2a7f219453321436644f67" exitCode=0 Dec 04 12:21:51.854112 master-0 kubenswrapper[35367]: I1204 12:21:51.853828 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-db-sync-x9w96" event={"ID":"e72935b7-293c-4160-a02a-cbf179274ab0","Type":"ContainerDied","Data":"89d2e2a28656ced1e0a7e37fbc365be3169225c02a2a7f219453321436644f67"} Dec 04 12:21:51.857941 master-0 kubenswrapper[35367]: I1204 12:21:51.857879 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-db-sync-ql68f" event={"ID":"0a783310-4355-49c9-9962-b5741fb70344","Type":"ContainerStarted","Data":"3c2ed72cc2db710f315cdda4492ec3dcb50fc6946600edc49c893714ce0800f6"} Dec 04 12:21:51.860674 master-0 kubenswrapper[35367]: I1204 12:21:51.860618 35367 generic.go:334] "Generic (PLEG): container finished" podID="ecf9a649-68f2-4c6f-9460-3a48dc075245" containerID="f185f6100be75725bcf243c9242c73fa7267710a6b71ae9bff3d50d8a6c5fbac" exitCode=0 Dec 04 12:21:51.860758 master-0 kubenswrapper[35367]: I1204 12:21:51.860692 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" event={"ID":"ecf9a649-68f2-4c6f-9460-3a48dc075245","Type":"ContainerDied","Data":"f185f6100be75725bcf243c9242c73fa7267710a6b71ae9bff3d50d8a6c5fbac"} Dec 04 12:21:52.093087 master-0 kubenswrapper[35367]: I1204 12:21:52.093032 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" Dec 04 12:21:52.167171 master-0 kubenswrapper[35367]: I1204 12:21:52.167097 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-ovsdbserver-sb\") pod \"ecf9a649-68f2-4c6f-9460-3a48dc075245\" (UID: \"ecf9a649-68f2-4c6f-9460-3a48dc075245\") " Dec 04 12:21:52.167171 master-0 kubenswrapper[35367]: I1204 12:21:52.167176 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-ovsdbserver-nb\") pod \"ecf9a649-68f2-4c6f-9460-3a48dc075245\" (UID: \"ecf9a649-68f2-4c6f-9460-3a48dc075245\") " Dec 04 12:21:52.167513 master-0 kubenswrapper[35367]: I1204 12:21:52.167304 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-dns-svc\") pod \"ecf9a649-68f2-4c6f-9460-3a48dc075245\" (UID: \"ecf9a649-68f2-4c6f-9460-3a48dc075245\") " Dec 04 12:21:52.167513 master-0 kubenswrapper[35367]: I1204 12:21:52.167402 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-config\") pod \"ecf9a649-68f2-4c6f-9460-3a48dc075245\" (UID: \"ecf9a649-68f2-4c6f-9460-3a48dc075245\") " Dec 04 12:21:52.167513 master-0 kubenswrapper[35367]: I1204 12:21:52.167450 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8wht\" (UniqueName: \"kubernetes.io/projected/ecf9a649-68f2-4c6f-9460-3a48dc075245-kube-api-access-h8wht\") pod \"ecf9a649-68f2-4c6f-9460-3a48dc075245\" (UID: \"ecf9a649-68f2-4c6f-9460-3a48dc075245\") " Dec 04 12:21:52.190648 master-0 kubenswrapper[35367]: I1204 12:21:52.190559 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecf9a649-68f2-4c6f-9460-3a48dc075245-kube-api-access-h8wht" (OuterVolumeSpecName: "kube-api-access-h8wht") pod "ecf9a649-68f2-4c6f-9460-3a48dc075245" (UID: "ecf9a649-68f2-4c6f-9460-3a48dc075245"). InnerVolumeSpecName "kube-api-access-h8wht". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:21:52.228663 master-0 kubenswrapper[35367]: I1204 12:21:52.228592 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-config" (OuterVolumeSpecName: "config") pod "ecf9a649-68f2-4c6f-9460-3a48dc075245" (UID: "ecf9a649-68f2-4c6f-9460-3a48dc075245"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:52.230086 master-0 kubenswrapper[35367]: I1204 12:21:52.230015 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "ecf9a649-68f2-4c6f-9460-3a48dc075245" (UID: "ecf9a649-68f2-4c6f-9460-3a48dc075245"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:52.247683 master-0 kubenswrapper[35367]: I1204 12:21:52.247589 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "ecf9a649-68f2-4c6f-9460-3a48dc075245" (UID: "ecf9a649-68f2-4c6f-9460-3a48dc075245"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:52.248078 master-0 kubenswrapper[35367]: I1204 12:21:52.247927 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "ecf9a649-68f2-4c6f-9460-3a48dc075245" (UID: "ecf9a649-68f2-4c6f-9460-3a48dc075245"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:52.271731 master-0 kubenswrapper[35367]: I1204 12:21:52.271515 35367 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:52.271731 master-0 kubenswrapper[35367]: I1204 12:21:52.271666 35367 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:52.271731 master-0 kubenswrapper[35367]: I1204 12:21:52.271683 35367 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:52.271731 master-0 kubenswrapper[35367]: I1204 12:21:52.271693 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ecf9a649-68f2-4c6f-9460-3a48dc075245-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:52.271731 master-0 kubenswrapper[35367]: I1204 12:21:52.271703 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-h8wht\" (UniqueName: \"kubernetes.io/projected/ecf9a649-68f2-4c6f-9460-3a48dc075245-kube-api-access-h8wht\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:52.878832 master-0 kubenswrapper[35367]: I1204 12:21:52.878707 35367 generic.go:334] "Generic (PLEG): container finished" podID="0a783310-4355-49c9-9962-b5741fb70344" containerID="3c2ed72cc2db710f315cdda4492ec3dcb50fc6946600edc49c893714ce0800f6" exitCode=0 Dec 04 12:21:52.879462 master-0 kubenswrapper[35367]: I1204 12:21:52.878874 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-db-sync-ql68f" event={"ID":"0a783310-4355-49c9-9962-b5741fb70344","Type":"ContainerDied","Data":"3c2ed72cc2db710f315cdda4492ec3dcb50fc6946600edc49c893714ce0800f6"} Dec 04 12:21:52.881423 master-0 kubenswrapper[35367]: I1204 12:21:52.881353 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" event={"ID":"ecf9a649-68f2-4c6f-9460-3a48dc075245","Type":"ContainerDied","Data":"ca6d028e2ca94d7ab9c267e818ba9d229a96ee587fcb51a1c730acf35f7c978e"} Dec 04 12:21:52.881545 master-0 kubenswrapper[35367]: I1204 12:21:52.881469 35367 scope.go:117] "RemoveContainer" containerID="f185f6100be75725bcf243c9242c73fa7267710a6b71ae9bff3d50d8a6c5fbac" Dec 04 12:21:52.881674 master-0 kubenswrapper[35367]: I1204 12:21:52.881649 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7d4d74cb79-bk5n5" Dec 04 12:21:52.884501 master-0 kubenswrapper[35367]: I1204 12:21:52.883952 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-db-sync-ck757" event={"ID":"3b713b22-8016-49e5-999d-a69c23149635","Type":"ContainerDied","Data":"3e0e3f13cb2d87e2c8132ee961379e19d1434a0669d5679d977ff80bb6a86470"} Dec 04 12:21:52.884501 master-0 kubenswrapper[35367]: I1204 12:21:52.883960 35367 generic.go:334] "Generic (PLEG): container finished" podID="3b713b22-8016-49e5-999d-a69c23149635" containerID="3e0e3f13cb2d87e2c8132ee961379e19d1434a0669d5679d977ff80bb6a86470" exitCode=0 Dec 04 12:21:53.061655 master-0 kubenswrapper[35367]: I1204 12:21:53.061609 35367 scope.go:117] "RemoveContainer" containerID="90047ae68664c8f9a60670b3c58e4aa5ed9c24bca6cca00abbc29d0361037ce4" Dec 04 12:21:53.106079 master-0 kubenswrapper[35367]: I1204 12:21:53.105999 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-7d4d74cb79-bk5n5"] Dec 04 12:21:53.120790 master-0 kubenswrapper[35367]: I1204 12:21:53.120740 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-7d4d74cb79-bk5n5"] Dec 04 12:21:53.259020 master-0 kubenswrapper[35367]: I1204 12:21:53.258915 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:53.402637 master-0 kubenswrapper[35367]: I1204 12:21:53.402541 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e72935b7-293c-4160-a02a-cbf179274ab0-etc-machine-id\") pod \"e72935b7-293c-4160-a02a-cbf179274ab0\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " Dec 04 12:21:53.402924 master-0 kubenswrapper[35367]: I1204 12:21:53.402708 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e72935b7-293c-4160-a02a-cbf179274ab0-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "e72935b7-293c-4160-a02a-cbf179274ab0" (UID: "e72935b7-293c-4160-a02a-cbf179274ab0"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:21:53.402924 master-0 kubenswrapper[35367]: I1204 12:21:53.402747 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-combined-ca-bundle\") pod \"e72935b7-293c-4160-a02a-cbf179274ab0\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " Dec 04 12:21:53.402924 master-0 kubenswrapper[35367]: I1204 12:21:53.402864 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-db-sync-config-data\") pod \"e72935b7-293c-4160-a02a-cbf179274ab0\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " Dec 04 12:21:53.403051 master-0 kubenswrapper[35367]: I1204 12:21:53.402974 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-config-data\") pod \"e72935b7-293c-4160-a02a-cbf179274ab0\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " Dec 04 12:21:53.403085 master-0 kubenswrapper[35367]: I1204 12:21:53.403057 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmq2f\" (UniqueName: \"kubernetes.io/projected/e72935b7-293c-4160-a02a-cbf179274ab0-kube-api-access-vmq2f\") pod \"e72935b7-293c-4160-a02a-cbf179274ab0\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " Dec 04 12:21:53.403555 master-0 kubenswrapper[35367]: I1204 12:21:53.403096 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-scripts\") pod \"e72935b7-293c-4160-a02a-cbf179274ab0\" (UID: \"e72935b7-293c-4160-a02a-cbf179274ab0\") " Dec 04 12:21:53.404968 master-0 kubenswrapper[35367]: I1204 12:21:53.404938 35367 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e72935b7-293c-4160-a02a-cbf179274ab0-etc-machine-id\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:53.406176 master-0 kubenswrapper[35367]: I1204 12:21:53.406129 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e72935b7-293c-4160-a02a-cbf179274ab0-kube-api-access-vmq2f" (OuterVolumeSpecName: "kube-api-access-vmq2f") pod "e72935b7-293c-4160-a02a-cbf179274ab0" (UID: "e72935b7-293c-4160-a02a-cbf179274ab0"). InnerVolumeSpecName "kube-api-access-vmq2f". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:21:53.407398 master-0 kubenswrapper[35367]: I1204 12:21:53.407319 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "e72935b7-293c-4160-a02a-cbf179274ab0" (UID: "e72935b7-293c-4160-a02a-cbf179274ab0"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:53.407871 master-0 kubenswrapper[35367]: I1204 12:21:53.407821 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-scripts" (OuterVolumeSpecName: "scripts") pod "e72935b7-293c-4160-a02a-cbf179274ab0" (UID: "e72935b7-293c-4160-a02a-cbf179274ab0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:53.433317 master-0 kubenswrapper[35367]: I1204 12:21:53.433228 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e72935b7-293c-4160-a02a-cbf179274ab0" (UID: "e72935b7-293c-4160-a02a-cbf179274ab0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:53.467979 master-0 kubenswrapper[35367]: I1204 12:21:53.467885 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-config-data" (OuterVolumeSpecName: "config-data") pod "e72935b7-293c-4160-a02a-cbf179274ab0" (UID: "e72935b7-293c-4160-a02a-cbf179274ab0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:53.508185 master-0 kubenswrapper[35367]: I1204 12:21:53.508106 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:53.508185 master-0 kubenswrapper[35367]: I1204 12:21:53.508156 35367 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-db-sync-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:53.508185 master-0 kubenswrapper[35367]: I1204 12:21:53.508169 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:53.508185 master-0 kubenswrapper[35367]: I1204 12:21:53.508184 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vmq2f\" (UniqueName: \"kubernetes.io/projected/e72935b7-293c-4160-a02a-cbf179274ab0-kube-api-access-vmq2f\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:53.508185 master-0 kubenswrapper[35367]: I1204 12:21:53.508192 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e72935b7-293c-4160-a02a-cbf179274ab0-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:53.899872 master-0 kubenswrapper[35367]: I1204 12:21:53.899787 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-db-sync-x9w96" event={"ID":"e72935b7-293c-4160-a02a-cbf179274ab0","Type":"ContainerDied","Data":"5fe82de13eec9f989fcfcdfca4101ebeec202d90ad6515cd2c1ce5005448c308"} Dec 04 12:21:53.899872 master-0 kubenswrapper[35367]: I1204 12:21:53.899873 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5fe82de13eec9f989fcfcdfca4101ebeec202d90ad6515cd2c1ce5005448c308" Dec 04 12:21:53.900505 master-0 kubenswrapper[35367]: I1204 12:21:53.899892 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-db-sync-x9w96" Dec 04 12:21:53.902781 master-0 kubenswrapper[35367]: I1204 12:21:53.902711 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-db-sync-ql68f" event={"ID":"0a783310-4355-49c9-9962-b5741fb70344","Type":"ContainerStarted","Data":"9ae87b2a13c6c4f282d04d0f5101650aa41112f61ff0576a09c80efc508b16ec"} Dec 04 12:21:53.949841 master-0 kubenswrapper[35367]: I1204 12:21:53.948881 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ironic-db-sync-ql68f" podStartSLOduration=14.001228837 podStartE2EDuration="25.948859823s" podCreationTimestamp="2025-12-04 12:21:28 +0000 UTC" firstStartedPulling="2025-12-04 12:21:39.347374389 +0000 UTC m=+1342.785435647" lastFinishedPulling="2025-12-04 12:21:51.295005375 +0000 UTC m=+1354.733066633" observedRunningTime="2025-12-04 12:21:53.929215842 +0000 UTC m=+1357.367277100" watchObservedRunningTime="2025-12-04 12:21:53.948859823 +0000 UTC m=+1357.386921081" Dec 04 12:21:54.288021 master-0 kubenswrapper[35367]: I1204 12:21:54.286772 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-7964985c65-pg7fs"] Dec 04 12:21:54.288021 master-0 kubenswrapper[35367]: E1204 12:21:54.287529 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e72935b7-293c-4160-a02a-cbf179274ab0" containerName="cinder-0c69e-db-sync" Dec 04 12:21:54.288021 master-0 kubenswrapper[35367]: I1204 12:21:54.287552 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e72935b7-293c-4160-a02a-cbf179274ab0" containerName="cinder-0c69e-db-sync" Dec 04 12:21:54.288021 master-0 kubenswrapper[35367]: E1204 12:21:54.287575 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ecf9a649-68f2-4c6f-9460-3a48dc075245" containerName="init" Dec 04 12:21:54.288021 master-0 kubenswrapper[35367]: I1204 12:21:54.287584 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecf9a649-68f2-4c6f-9460-3a48dc075245" containerName="init" Dec 04 12:21:54.288021 master-0 kubenswrapper[35367]: E1204 12:21:54.287612 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ecf9a649-68f2-4c6f-9460-3a48dc075245" containerName="dnsmasq-dns" Dec 04 12:21:54.288021 master-0 kubenswrapper[35367]: I1204 12:21:54.287621 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecf9a649-68f2-4c6f-9460-3a48dc075245" containerName="dnsmasq-dns" Dec 04 12:21:54.294566 master-0 kubenswrapper[35367]: I1204 12:21:54.294502 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="e72935b7-293c-4160-a02a-cbf179274ab0" containerName="cinder-0c69e-db-sync" Dec 04 12:21:54.294791 master-0 kubenswrapper[35367]: I1204 12:21:54.294648 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="ecf9a649-68f2-4c6f-9460-3a48dc075245" containerName="dnsmasq-dns" Dec 04 12:21:54.297009 master-0 kubenswrapper[35367]: I1204 12:21:54.296976 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:54.324748 master-0 kubenswrapper[35367]: I1204 12:21:54.322667 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccmkg\" (UniqueName: \"kubernetes.io/projected/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-kube-api-access-ccmkg\") pod \"dnsmasq-dns-7964985c65-pg7fs\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:54.324748 master-0 kubenswrapper[35367]: I1204 12:21:54.322925 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-dns-svc\") pod \"dnsmasq-dns-7964985c65-pg7fs\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:54.324748 master-0 kubenswrapper[35367]: I1204 12:21:54.323140 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-dns-swift-storage-0\") pod \"dnsmasq-dns-7964985c65-pg7fs\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:54.324748 master-0 kubenswrapper[35367]: I1204 12:21:54.323220 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-config\") pod \"dnsmasq-dns-7964985c65-pg7fs\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:54.324748 master-0 kubenswrapper[35367]: I1204 12:21:54.323386 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-ovsdbserver-sb\") pod \"dnsmasq-dns-7964985c65-pg7fs\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:54.324748 master-0 kubenswrapper[35367]: I1204 12:21:54.323410 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-ovsdbserver-nb\") pod \"dnsmasq-dns-7964985c65-pg7fs\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:54.337067 master-0 kubenswrapper[35367]: I1204 12:21:54.337004 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-0c69e-scheduler-0"] Dec 04 12:21:54.343897 master-0 kubenswrapper[35367]: I1204 12:21:54.341737 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:21:54.356787 master-0 kubenswrapper[35367]: I1204 12:21:54.354245 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-0c69e-scripts" Dec 04 12:21:54.356787 master-0 kubenswrapper[35367]: I1204 12:21:54.354590 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-0c69e-config-data" Dec 04 12:21:54.360069 master-0 kubenswrapper[35367]: I1204 12:21:54.358206 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-0c69e-scheduler-config-data" Dec 04 12:21:54.375794 master-0 kubenswrapper[35367]: I1204 12:21:54.375657 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-0c69e-volume-lvm-iscsi-0"] Dec 04 12:21:54.378094 master-0 kubenswrapper[35367]: I1204 12:21:54.378054 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.385522 master-0 kubenswrapper[35367]: I1204 12:21:54.385307 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-0c69e-volume-lvm-iscsi-config-data" Dec 04 12:21:54.425763 master-0 kubenswrapper[35367]: I1204 12:21:54.425656 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-7964985c65-pg7fs"] Dec 04 12:21:54.432568 master-0 kubenswrapper[35367]: I1204 12:21:54.432240 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-config-data-custom\") pod \"cinder-0c69e-scheduler-0\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:21:54.432568 master-0 kubenswrapper[35367]: I1204 12:21:54.432306 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-dns-swift-storage-0\") pod \"dnsmasq-dns-7964985c65-pg7fs\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:54.432568 master-0 kubenswrapper[35367]: I1204 12:21:54.432356 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-run\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.432568 master-0 kubenswrapper[35367]: I1204 12:21:54.432378 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-config\") pod \"dnsmasq-dns-7964985c65-pg7fs\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:54.432568 master-0 kubenswrapper[35367]: I1204 12:21:54.432405 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-etc-nvme\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.432568 master-0 kubenswrapper[35367]: I1204 12:21:54.432423 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-combined-ca-bundle\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.432568 master-0 kubenswrapper[35367]: I1204 12:21:54.432510 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-var-locks-brick\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.432568 master-0 kubenswrapper[35367]: I1204 12:21:54.432560 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-ovsdbserver-nb\") pod \"dnsmasq-dns-7964985c65-pg7fs\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:54.432568 master-0 kubenswrapper[35367]: I1204 12:21:54.432584 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-ovsdbserver-sb\") pod \"dnsmasq-dns-7964985c65-pg7fs\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:54.433284 master-0 kubenswrapper[35367]: I1204 12:21:54.432604 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-var-lib-cinder\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.433284 master-0 kubenswrapper[35367]: I1204 12:21:54.432630 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-etc-iscsi\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.433284 master-0 kubenswrapper[35367]: I1204 12:21:54.432678 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ccmkg\" (UniqueName: \"kubernetes.io/projected/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-kube-api-access-ccmkg\") pod \"dnsmasq-dns-7964985c65-pg7fs\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:54.433284 master-0 kubenswrapper[35367]: I1204 12:21:54.432719 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-scripts\") pod \"cinder-0c69e-scheduler-0\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:21:54.433284 master-0 kubenswrapper[35367]: I1204 12:21:54.432739 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-sys\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.433284 master-0 kubenswrapper[35367]: I1204 12:21:54.432772 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-var-locks-cinder\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.433284 master-0 kubenswrapper[35367]: I1204 12:21:54.432827 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/93ed4f64-900a-44ba-b838-82e0594a1809-etc-machine-id\") pod \"cinder-0c69e-scheduler-0\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:21:54.433284 master-0 kubenswrapper[35367]: I1204 12:21:54.432856 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-etc-machine-id\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.433284 master-0 kubenswrapper[35367]: I1204 12:21:54.432884 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87wf8\" (UniqueName: \"kubernetes.io/projected/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-kube-api-access-87wf8\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.433284 master-0 kubenswrapper[35367]: I1204 12:21:54.432952 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-dns-svc\") pod \"dnsmasq-dns-7964985c65-pg7fs\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:54.433284 master-0 kubenswrapper[35367]: I1204 12:21:54.432973 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-dev\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.433284 master-0 kubenswrapper[35367]: I1204 12:21:54.432997 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-combined-ca-bundle\") pod \"cinder-0c69e-scheduler-0\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:21:54.433284 master-0 kubenswrapper[35367]: I1204 12:21:54.433044 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pljhx\" (UniqueName: \"kubernetes.io/projected/93ed4f64-900a-44ba-b838-82e0594a1809-kube-api-access-pljhx\") pod \"cinder-0c69e-scheduler-0\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:21:54.433284 master-0 kubenswrapper[35367]: I1204 12:21:54.433071 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-config-data\") pod \"cinder-0c69e-scheduler-0\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:21:54.433284 master-0 kubenswrapper[35367]: I1204 12:21:54.433088 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-scripts\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.433284 master-0 kubenswrapper[35367]: I1204 12:21:54.433119 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-lib-modules\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.433284 master-0 kubenswrapper[35367]: I1204 12:21:54.433160 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-config-data\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.433284 master-0 kubenswrapper[35367]: I1204 12:21:54.433182 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-config-data-custom\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.436978 master-0 kubenswrapper[35367]: I1204 12:21:54.435355 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-dns-swift-storage-0\") pod \"dnsmasq-dns-7964985c65-pg7fs\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:54.436978 master-0 kubenswrapper[35367]: I1204 12:21:54.436326 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-config\") pod \"dnsmasq-dns-7964985c65-pg7fs\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:54.438211 master-0 kubenswrapper[35367]: I1204 12:21:54.437512 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-ovsdbserver-nb\") pod \"dnsmasq-dns-7964985c65-pg7fs\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:54.438211 master-0 kubenswrapper[35367]: I1204 12:21:54.438107 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-0c69e-volume-lvm-iscsi-0"] Dec 04 12:21:54.458891 master-0 kubenswrapper[35367]: I1204 12:21:54.438693 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-ovsdbserver-sb\") pod \"dnsmasq-dns-7964985c65-pg7fs\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:54.458891 master-0 kubenswrapper[35367]: I1204 12:21:54.440683 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-dns-svc\") pod \"dnsmasq-dns-7964985c65-pg7fs\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:54.463461 master-0 kubenswrapper[35367]: I1204 12:21:54.463308 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-0c69e-scheduler-0"] Dec 04 12:21:54.475554 master-0 kubenswrapper[35367]: I1204 12:21:54.475454 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccmkg\" (UniqueName: \"kubernetes.io/projected/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-kube-api-access-ccmkg\") pod \"dnsmasq-dns-7964985c65-pg7fs\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:54.539123 master-0 kubenswrapper[35367]: I1204 12:21:54.538932 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-scripts\") pod \"cinder-0c69e-scheduler-0\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:21:54.539123 master-0 kubenswrapper[35367]: I1204 12:21:54.539090 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-sys\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.539682 master-0 kubenswrapper[35367]: I1204 12:21:54.539173 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-var-locks-cinder\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.539682 master-0 kubenswrapper[35367]: I1204 12:21:54.539239 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/93ed4f64-900a-44ba-b838-82e0594a1809-etc-machine-id\") pod \"cinder-0c69e-scheduler-0\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:21:54.539682 master-0 kubenswrapper[35367]: I1204 12:21:54.539511 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-etc-machine-id\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.539682 master-0 kubenswrapper[35367]: I1204 12:21:54.539605 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-87wf8\" (UniqueName: \"kubernetes.io/projected/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-kube-api-access-87wf8\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.539843 master-0 kubenswrapper[35367]: I1204 12:21:54.539711 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-dev\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.539843 master-0 kubenswrapper[35367]: I1204 12:21:54.539759 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-combined-ca-bundle\") pod \"cinder-0c69e-scheduler-0\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:21:54.539922 master-0 kubenswrapper[35367]: I1204 12:21:54.539883 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pljhx\" (UniqueName: \"kubernetes.io/projected/93ed4f64-900a-44ba-b838-82e0594a1809-kube-api-access-pljhx\") pod \"cinder-0c69e-scheduler-0\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:21:54.540165 master-0 kubenswrapper[35367]: I1204 12:21:54.540103 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-etc-machine-id\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.540208 master-0 kubenswrapper[35367]: I1204 12:21:54.540177 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-config-data\") pod \"cinder-0c69e-scheduler-0\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:21:54.553320 master-0 kubenswrapper[35367]: I1204 12:21:54.552486 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/93ed4f64-900a-44ba-b838-82e0594a1809-etc-machine-id\") pod \"cinder-0c69e-scheduler-0\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:21:54.553320 master-0 kubenswrapper[35367]: I1204 12:21:54.552574 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-sys\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.553320 master-0 kubenswrapper[35367]: I1204 12:21:54.552742 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-dev\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.553320 master-0 kubenswrapper[35367]: I1204 12:21:54.552958 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-var-locks-cinder\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.553320 master-0 kubenswrapper[35367]: I1204 12:21:54.553032 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-scripts\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.553912 master-0 kubenswrapper[35367]: I1204 12:21:54.553442 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-lib-modules\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.553912 master-0 kubenswrapper[35367]: I1204 12:21:54.553604 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-config-data\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.553912 master-0 kubenswrapper[35367]: I1204 12:21:54.553669 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-lib-modules\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.553912 master-0 kubenswrapper[35367]: I1204 12:21:54.553673 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-config-data-custom\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.553912 master-0 kubenswrapper[35367]: I1204 12:21:54.553864 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-config-data-custom\") pod \"cinder-0c69e-scheduler-0\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:21:54.554265 master-0 kubenswrapper[35367]: I1204 12:21:54.553984 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-run\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.554265 master-0 kubenswrapper[35367]: I1204 12:21:54.554168 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-etc-nvme\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.554265 master-0 kubenswrapper[35367]: I1204 12:21:54.554208 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-run\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.554265 master-0 kubenswrapper[35367]: I1204 12:21:54.554218 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-combined-ca-bundle\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.554494 master-0 kubenswrapper[35367]: I1204 12:21:54.554449 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-var-locks-brick\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.554679 master-0 kubenswrapper[35367]: I1204 12:21:54.554650 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-var-lib-cinder\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.554735 master-0 kubenswrapper[35367]: I1204 12:21:54.554714 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-etc-iscsi\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.554941 master-0 kubenswrapper[35367]: I1204 12:21:54.554910 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-var-locks-brick\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.555143 master-0 kubenswrapper[35367]: I1204 12:21:54.555116 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-etc-iscsi\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.555253 master-0 kubenswrapper[35367]: I1204 12:21:54.555227 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-etc-nvme\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.555374 master-0 kubenswrapper[35367]: I1204 12:21:54.555351 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-var-lib-cinder\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.556986 master-0 kubenswrapper[35367]: I1204 12:21:54.556909 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-scripts\") pod \"cinder-0c69e-scheduler-0\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:21:54.558328 master-0 kubenswrapper[35367]: I1204 12:21:54.557998 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-config-data-custom\") pod \"cinder-0c69e-scheduler-0\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:21:54.560687 master-0 kubenswrapper[35367]: I1204 12:21:54.560630 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-combined-ca-bundle\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.561729 master-0 kubenswrapper[35367]: I1204 12:21:54.561655 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-config-data\") pod \"cinder-0c69e-scheduler-0\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:21:54.561729 master-0 kubenswrapper[35367]: I1204 12:21:54.561712 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-0c69e-backup-0"] Dec 04 12:21:54.562567 master-0 kubenswrapper[35367]: I1204 12:21:54.562516 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-config-data-custom\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.565240 master-0 kubenswrapper[35367]: I1204 12:21:54.565007 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-combined-ca-bundle\") pod \"cinder-0c69e-scheduler-0\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:21:54.566089 master-0 kubenswrapper[35367]: I1204 12:21:54.566047 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-config-data\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.570174 master-0 kubenswrapper[35367]: I1204 12:21:54.570125 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-scripts\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.574922 master-0 kubenswrapper[35367]: I1204 12:21:54.574647 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.576052 master-0 kubenswrapper[35367]: I1204 12:21:54.576000 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pljhx\" (UniqueName: \"kubernetes.io/projected/93ed4f64-900a-44ba-b838-82e0594a1809-kube-api-access-pljhx\") pod \"cinder-0c69e-scheduler-0\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:21:54.578567 master-0 kubenswrapper[35367]: I1204 12:21:54.578420 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-0c69e-backup-config-data" Dec 04 12:21:54.581601 master-0 kubenswrapper[35367]: I1204 12:21:54.581306 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-87wf8\" (UniqueName: \"kubernetes.io/projected/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-kube-api-access-87wf8\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.590140 master-0 kubenswrapper[35367]: I1204 12:21:54.590071 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-0c69e-backup-0"] Dec 04 12:21:54.657848 master-0 kubenswrapper[35367]: I1204 12:21:54.657734 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-sys\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.658125 master-0 kubenswrapper[35367]: I1204 12:21:54.657906 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-etc-machine-id\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.658125 master-0 kubenswrapper[35367]: I1204 12:21:54.657992 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-var-locks-brick\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.658125 master-0 kubenswrapper[35367]: I1204 12:21:54.658030 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-var-locks-cinder\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.658125 master-0 kubenswrapper[35367]: I1204 12:21:54.658096 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-var-lib-cinder\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.658300 master-0 kubenswrapper[35367]: I1204 12:21:54.658130 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-etc-nvme\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.658486 master-0 kubenswrapper[35367]: I1204 12:21:54.658181 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-combined-ca-bundle\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.658540 master-0 kubenswrapper[35367]: I1204 12:21:54.658522 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-dev\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.658604 master-0 kubenswrapper[35367]: I1204 12:21:54.658586 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-config-data\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.658651 master-0 kubenswrapper[35367]: I1204 12:21:54.658637 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-etc-iscsi\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.658699 master-0 kubenswrapper[35367]: I1204 12:21:54.658665 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z57gs\" (UniqueName: \"kubernetes.io/projected/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-kube-api-access-z57gs\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.658746 master-0 kubenswrapper[35367]: I1204 12:21:54.658702 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-config-data-custom\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.658787 master-0 kubenswrapper[35367]: I1204 12:21:54.658758 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-run\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.658863 master-0 kubenswrapper[35367]: I1204 12:21:54.658827 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-scripts\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.658863 master-0 kubenswrapper[35367]: I1204 12:21:54.658852 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-lib-modules\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.659179 master-0 kubenswrapper[35367]: I1204 12:21:54.659129 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:21:54.670228 master-0 kubenswrapper[35367]: I1204 12:21:54.670106 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:21:54.676895 master-0 kubenswrapper[35367]: I1204 12:21:54.676847 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-db-sync-ck757" Dec 04 12:21:54.682747 master-0 kubenswrapper[35367]: I1204 12:21:54.682681 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:54.775375 master-0 kubenswrapper[35367]: I1204 12:21:54.773901 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-sys\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.775375 master-0 kubenswrapper[35367]: I1204 12:21:54.774038 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-etc-machine-id\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.775375 master-0 kubenswrapper[35367]: I1204 12:21:54.774096 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-var-locks-brick\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.775375 master-0 kubenswrapper[35367]: I1204 12:21:54.774296 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-var-locks-cinder\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.775375 master-0 kubenswrapper[35367]: I1204 12:21:54.774406 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-var-lib-cinder\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.775375 master-0 kubenswrapper[35367]: I1204 12:21:54.774431 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-etc-nvme\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.775375 master-0 kubenswrapper[35367]: I1204 12:21:54.774492 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-combined-ca-bundle\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.775375 master-0 kubenswrapper[35367]: I1204 12:21:54.774554 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-dev\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.775375 master-0 kubenswrapper[35367]: I1204 12:21:54.774634 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-config-data\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.775375 master-0 kubenswrapper[35367]: I1204 12:21:54.774676 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-sys\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.775375 master-0 kubenswrapper[35367]: I1204 12:21:54.774694 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z57gs\" (UniqueName: \"kubernetes.io/projected/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-kube-api-access-z57gs\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.775375 master-0 kubenswrapper[35367]: I1204 12:21:54.774795 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-etc-iscsi\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.775375 master-0 kubenswrapper[35367]: I1204 12:21:54.774871 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-config-data-custom\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.775375 master-0 kubenswrapper[35367]: I1204 12:21:54.774962 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-run\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.775375 master-0 kubenswrapper[35367]: I1204 12:21:54.775017 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-scripts\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.775375 master-0 kubenswrapper[35367]: I1204 12:21:54.775035 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-lib-modules\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.776626 master-0 kubenswrapper[35367]: I1204 12:21:54.776040 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-etc-machine-id\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.776626 master-0 kubenswrapper[35367]: I1204 12:21:54.776181 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-var-locks-brick\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.776722 master-0 kubenswrapper[35367]: I1204 12:21:54.776641 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-var-locks-cinder\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.776722 master-0 kubenswrapper[35367]: I1204 12:21:54.776681 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-var-lib-cinder\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.776722 master-0 kubenswrapper[35367]: I1204 12:21:54.776720 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-etc-nvme\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.777662 master-0 kubenswrapper[35367]: I1204 12:21:54.777638 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-dev\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.777885 master-0 kubenswrapper[35367]: I1204 12:21:54.777845 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-run\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.780375 master-0 kubenswrapper[35367]: I1204 12:21:54.780261 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-etc-iscsi\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.781552 master-0 kubenswrapper[35367]: I1204 12:21:54.781215 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-lib-modules\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.782208 master-0 kubenswrapper[35367]: I1204 12:21:54.782144 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-scripts\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.788461 master-0 kubenswrapper[35367]: I1204 12:21:54.783992 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-config-data\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.792123 master-0 kubenswrapper[35367]: I1204 12:21:54.789641 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-config-data-custom\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.804984 master-0 kubenswrapper[35367]: I1204 12:21:54.804405 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z57gs\" (UniqueName: \"kubernetes.io/projected/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-kube-api-access-z57gs\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.805645 master-0 kubenswrapper[35367]: I1204 12:21:54.805571 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-combined-ca-bundle\") pod \"cinder-0c69e-backup-0\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:54.823528 master-0 kubenswrapper[35367]: I1204 12:21:54.823454 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecf9a649-68f2-4c6f-9460-3a48dc075245" path="/var/lib/kubelet/pods/ecf9a649-68f2-4c6f-9460-3a48dc075245/volumes" Dec 04 12:21:54.829123 master-0 kubenswrapper[35367]: I1204 12:21:54.828207 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-0c69e-api-0"] Dec 04 12:21:54.829276 master-0 kubenswrapper[35367]: E1204 12:21:54.829133 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3b713b22-8016-49e5-999d-a69c23149635" containerName="neutron-db-sync" Dec 04 12:21:54.829276 master-0 kubenswrapper[35367]: I1204 12:21:54.829159 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b713b22-8016-49e5-999d-a69c23149635" containerName="neutron-db-sync" Dec 04 12:21:54.829653 master-0 kubenswrapper[35367]: I1204 12:21:54.829631 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="3b713b22-8016-49e5-999d-a69c23149635" containerName="neutron-db-sync" Dec 04 12:21:54.832203 master-0 kubenswrapper[35367]: I1204 12:21:54.832163 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-0c69e-api-0"] Dec 04 12:21:54.832297 master-0 kubenswrapper[35367]: I1204 12:21:54.832271 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:54.858827 master-0 kubenswrapper[35367]: I1204 12:21:54.855525 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-0c69e-api-config-data" Dec 04 12:21:54.882135 master-0 kubenswrapper[35367]: I1204 12:21:54.879684 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3b713b22-8016-49e5-999d-a69c23149635-config\") pod \"3b713b22-8016-49e5-999d-a69c23149635\" (UID: \"3b713b22-8016-49e5-999d-a69c23149635\") " Dec 04 12:21:54.882135 master-0 kubenswrapper[35367]: I1204 12:21:54.879780 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b713b22-8016-49e5-999d-a69c23149635-combined-ca-bundle\") pod \"3b713b22-8016-49e5-999d-a69c23149635\" (UID: \"3b713b22-8016-49e5-999d-a69c23149635\") " Dec 04 12:21:54.882135 master-0 kubenswrapper[35367]: I1204 12:21:54.881685 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqsx6\" (UniqueName: \"kubernetes.io/projected/3b713b22-8016-49e5-999d-a69c23149635-kube-api-access-xqsx6\") pod \"3b713b22-8016-49e5-999d-a69c23149635\" (UID: \"3b713b22-8016-49e5-999d-a69c23149635\") " Dec 04 12:21:54.882666 master-0 kubenswrapper[35367]: I1204 12:21:54.882610 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-config-data\") pod \"cinder-0c69e-api-0\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:54.883645 master-0 kubenswrapper[35367]: I1204 12:21:54.882894 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-logs\") pod \"cinder-0c69e-api-0\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:54.883645 master-0 kubenswrapper[35367]: I1204 12:21:54.882931 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-config-data-custom\") pod \"cinder-0c69e-api-0\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:54.883645 master-0 kubenswrapper[35367]: I1204 12:21:54.882955 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6jln\" (UniqueName: \"kubernetes.io/projected/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-kube-api-access-h6jln\") pod \"cinder-0c69e-api-0\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:54.883645 master-0 kubenswrapper[35367]: I1204 12:21:54.883017 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-scripts\") pod \"cinder-0c69e-api-0\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:54.883645 master-0 kubenswrapper[35367]: I1204 12:21:54.883074 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-etc-machine-id\") pod \"cinder-0c69e-api-0\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:54.883645 master-0 kubenswrapper[35367]: I1204 12:21:54.883202 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-combined-ca-bundle\") pod \"cinder-0c69e-api-0\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:54.896470 master-0 kubenswrapper[35367]: I1204 12:21:54.896278 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b713b22-8016-49e5-999d-a69c23149635-kube-api-access-xqsx6" (OuterVolumeSpecName: "kube-api-access-xqsx6") pod "3b713b22-8016-49e5-999d-a69c23149635" (UID: "3b713b22-8016-49e5-999d-a69c23149635"). InnerVolumeSpecName "kube-api-access-xqsx6". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:21:54.955236 master-0 kubenswrapper[35367]: I1204 12:21:54.954985 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-db-sync-ck757" Dec 04 12:21:54.978239 master-0 kubenswrapper[35367]: I1204 12:21:54.955160 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-db-sync-ck757" event={"ID":"3b713b22-8016-49e5-999d-a69c23149635","Type":"ContainerDied","Data":"6de797acc502d7ebfee6fefd75294ff518f2ab5a91fa79a6d5fca0d0121b0346"} Dec 04 12:21:54.978239 master-0 kubenswrapper[35367]: I1204 12:21:54.977095 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6de797acc502d7ebfee6fefd75294ff518f2ab5a91fa79a6d5fca0d0121b0346" Dec 04 12:21:54.978239 master-0 kubenswrapper[35367]: I1204 12:21:54.957370 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b713b22-8016-49e5-999d-a69c23149635-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3b713b22-8016-49e5-999d-a69c23149635" (UID: "3b713b22-8016-49e5-999d-a69c23149635"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:54.978239 master-0 kubenswrapper[35367]: I1204 12:21:54.966015 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b713b22-8016-49e5-999d-a69c23149635-config" (OuterVolumeSpecName: "config") pod "3b713b22-8016-49e5-999d-a69c23149635" (UID: "3b713b22-8016-49e5-999d-a69c23149635"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:21:54.991070 master-0 kubenswrapper[35367]: I1204 12:21:54.985716 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-config-data\") pod \"cinder-0c69e-api-0\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:54.991070 master-0 kubenswrapper[35367]: I1204 12:21:54.985843 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-logs\") pod \"cinder-0c69e-api-0\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:54.991070 master-0 kubenswrapper[35367]: I1204 12:21:54.985874 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-config-data-custom\") pod \"cinder-0c69e-api-0\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:54.991070 master-0 kubenswrapper[35367]: I1204 12:21:54.985901 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h6jln\" (UniqueName: \"kubernetes.io/projected/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-kube-api-access-h6jln\") pod \"cinder-0c69e-api-0\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:54.991070 master-0 kubenswrapper[35367]: I1204 12:21:54.985930 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-scripts\") pod \"cinder-0c69e-api-0\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:54.991070 master-0 kubenswrapper[35367]: I1204 12:21:54.985978 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-etc-machine-id\") pod \"cinder-0c69e-api-0\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:54.991070 master-0 kubenswrapper[35367]: I1204 12:21:54.986056 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-combined-ca-bundle\") pod \"cinder-0c69e-api-0\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:54.991070 master-0 kubenswrapper[35367]: I1204 12:21:54.986158 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3b713b22-8016-49e5-999d-a69c23149635-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:54.991070 master-0 kubenswrapper[35367]: I1204 12:21:54.986173 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b713b22-8016-49e5-999d-a69c23149635-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:54.991070 master-0 kubenswrapper[35367]: I1204 12:21:54.986185 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xqsx6\" (UniqueName: \"kubernetes.io/projected/3b713b22-8016-49e5-999d-a69c23149635-kube-api-access-xqsx6\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:54.995593 master-0 kubenswrapper[35367]: I1204 12:21:54.993052 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-etc-machine-id\") pod \"cinder-0c69e-api-0\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:54.995593 master-0 kubenswrapper[35367]: I1204 12:21:54.993685 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-combined-ca-bundle\") pod \"cinder-0c69e-api-0\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:54.995593 master-0 kubenswrapper[35367]: I1204 12:21:54.994999 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-logs\") pod \"cinder-0c69e-api-0\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:54.996166 master-0 kubenswrapper[35367]: I1204 12:21:54.995997 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-config-data\") pod \"cinder-0c69e-api-0\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:54.999608 master-0 kubenswrapper[35367]: I1204 12:21:54.997220 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-scripts\") pod \"cinder-0c69e-api-0\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:54.999608 master-0 kubenswrapper[35367]: I1204 12:21:54.997632 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-config-data-custom\") pod \"cinder-0c69e-api-0\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:55.015290 master-0 kubenswrapper[35367]: I1204 12:21:55.014382 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6jln\" (UniqueName: \"kubernetes.io/projected/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-kube-api-access-h6jln\") pod \"cinder-0c69e-api-0\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:55.101829 master-0 kubenswrapper[35367]: I1204 12:21:55.091618 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-backup-0" Dec 04 12:21:55.181828 master-0 kubenswrapper[35367]: I1204 12:21:55.181714 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-api-0" Dec 04 12:21:55.256694 master-0 kubenswrapper[35367]: I1204 12:21:55.246979 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-7964985c65-pg7fs"] Dec 04 12:21:55.335523 master-0 kubenswrapper[35367]: I1204 12:21:55.320882 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-597ccf57f9-r8p69"] Dec 04 12:21:55.335523 master-0 kubenswrapper[35367]: I1204 12:21:55.323360 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:21:55.344915 master-0 kubenswrapper[35367]: I1204 12:21:55.342938 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/neutron-5b756f7d96-fzd2s"] Dec 04 12:21:55.349449 master-0 kubenswrapper[35367]: I1204 12:21:55.347387 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-5b756f7d96-fzd2s" Dec 04 12:21:55.357282 master-0 kubenswrapper[35367]: I1204 12:21:55.355031 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-neutron-ovndbs" Dec 04 12:21:55.357282 master-0 kubenswrapper[35367]: I1204 12:21:55.355292 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"neutron-httpd-config" Dec 04 12:21:55.361767 master-0 kubenswrapper[35367]: I1204 12:21:55.359410 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"neutron-config" Dec 04 12:21:55.367297 master-0 kubenswrapper[35367]: I1204 12:21:55.367239 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-597ccf57f9-r8p69"] Dec 04 12:21:55.390632 master-0 kubenswrapper[35367]: I1204 12:21:55.390545 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-5b756f7d96-fzd2s"] Dec 04 12:21:55.415552 master-0 kubenswrapper[35367]: I1204 12:21:55.415467 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mx27\" (UniqueName: \"kubernetes.io/projected/6bc1884b-12c9-49ac-bdfe-106e815f94a3-kube-api-access-7mx27\") pod \"neutron-5b756f7d96-fzd2s\" (UID: \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\") " pod="openstack/neutron-5b756f7d96-fzd2s" Dec 04 12:21:55.415552 master-0 kubenswrapper[35367]: I1204 12:21:55.415547 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-combined-ca-bundle\") pod \"neutron-5b756f7d96-fzd2s\" (UID: \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\") " pod="openstack/neutron-5b756f7d96-fzd2s" Dec 04 12:21:55.415869 master-0 kubenswrapper[35367]: I1204 12:21:55.415686 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-dns-svc\") pod \"dnsmasq-dns-597ccf57f9-r8p69\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:21:55.415869 master-0 kubenswrapper[35367]: I1204 12:21:55.415735 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-ovndb-tls-certs\") pod \"neutron-5b756f7d96-fzd2s\" (UID: \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\") " pod="openstack/neutron-5b756f7d96-fzd2s" Dec 04 12:21:55.416512 master-0 kubenswrapper[35367]: I1204 12:21:55.416415 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-ovsdbserver-nb\") pod \"dnsmasq-dns-597ccf57f9-r8p69\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:21:55.416649 master-0 kubenswrapper[35367]: I1204 12:21:55.416604 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-dns-swift-storage-0\") pod \"dnsmasq-dns-597ccf57f9-r8p69\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:21:55.416763 master-0 kubenswrapper[35367]: I1204 12:21:55.416730 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-config\") pod \"dnsmasq-dns-597ccf57f9-r8p69\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:21:55.416982 master-0 kubenswrapper[35367]: I1204 12:21:55.416912 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-config\") pod \"neutron-5b756f7d96-fzd2s\" (UID: \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\") " pod="openstack/neutron-5b756f7d96-fzd2s" Dec 04 12:21:55.417301 master-0 kubenswrapper[35367]: I1204 12:21:55.417223 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-ovsdbserver-sb\") pod \"dnsmasq-dns-597ccf57f9-r8p69\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:21:55.417431 master-0 kubenswrapper[35367]: I1204 12:21:55.417397 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf8mp\" (UniqueName: \"kubernetes.io/projected/f2a286f2-4ada-485a-97db-414518e8621e-kube-api-access-wf8mp\") pod \"dnsmasq-dns-597ccf57f9-r8p69\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:21:55.417489 master-0 kubenswrapper[35367]: I1204 12:21:55.417467 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-httpd-config\") pod \"neutron-5b756f7d96-fzd2s\" (UID: \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\") " pod="openstack/neutron-5b756f7d96-fzd2s" Dec 04 12:21:55.446238 master-0 kubenswrapper[35367]: I1204 12:21:55.444322 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-0c69e-scheduler-0"] Dec 04 12:21:55.451477 master-0 kubenswrapper[35367]: W1204 12:21:55.451406 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93ed4f64_900a_44ba_b838_82e0594a1809.slice/crio-1a44619f5a802a817c1c6231e1f3cbdb1821284e08e5fde80fbab9c3603c3560 WatchSource:0}: Error finding container 1a44619f5a802a817c1c6231e1f3cbdb1821284e08e5fde80fbab9c3603c3560: Status 404 returned error can't find the container with id 1a44619f5a802a817c1c6231e1f3cbdb1821284e08e5fde80fbab9c3603c3560 Dec 04 12:21:55.522884 master-0 kubenswrapper[35367]: I1204 12:21:55.522797 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-0c69e-volume-lvm-iscsi-0"] Dec 04 12:21:55.528013 master-0 kubenswrapper[35367]: I1204 12:21:55.523540 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-dns-svc\") pod \"dnsmasq-dns-597ccf57f9-r8p69\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:21:55.528013 master-0 kubenswrapper[35367]: I1204 12:21:55.523621 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-ovndb-tls-certs\") pod \"neutron-5b756f7d96-fzd2s\" (UID: \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\") " pod="openstack/neutron-5b756f7d96-fzd2s" Dec 04 12:21:55.528013 master-0 kubenswrapper[35367]: I1204 12:21:55.524491 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-ovsdbserver-nb\") pod \"dnsmasq-dns-597ccf57f9-r8p69\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:21:55.528013 master-0 kubenswrapper[35367]: I1204 12:21:55.524619 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-dns-swift-storage-0\") pod \"dnsmasq-dns-597ccf57f9-r8p69\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:21:55.528013 master-0 kubenswrapper[35367]: I1204 12:21:55.524657 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-config\") pod \"dnsmasq-dns-597ccf57f9-r8p69\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:21:55.528013 master-0 kubenswrapper[35367]: I1204 12:21:55.524689 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-config\") pod \"neutron-5b756f7d96-fzd2s\" (UID: \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\") " pod="openstack/neutron-5b756f7d96-fzd2s" Dec 04 12:21:55.528013 master-0 kubenswrapper[35367]: I1204 12:21:55.524716 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-ovsdbserver-sb\") pod \"dnsmasq-dns-597ccf57f9-r8p69\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:21:55.528013 master-0 kubenswrapper[35367]: I1204 12:21:55.524742 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wf8mp\" (UniqueName: \"kubernetes.io/projected/f2a286f2-4ada-485a-97db-414518e8621e-kube-api-access-wf8mp\") pod \"dnsmasq-dns-597ccf57f9-r8p69\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:21:55.528013 master-0 kubenswrapper[35367]: I1204 12:21:55.524763 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-httpd-config\") pod \"neutron-5b756f7d96-fzd2s\" (UID: \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\") " pod="openstack/neutron-5b756f7d96-fzd2s" Dec 04 12:21:55.528013 master-0 kubenswrapper[35367]: I1204 12:21:55.524894 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7mx27\" (UniqueName: \"kubernetes.io/projected/6bc1884b-12c9-49ac-bdfe-106e815f94a3-kube-api-access-7mx27\") pod \"neutron-5b756f7d96-fzd2s\" (UID: \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\") " pod="openstack/neutron-5b756f7d96-fzd2s" Dec 04 12:21:55.528013 master-0 kubenswrapper[35367]: I1204 12:21:55.524921 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-combined-ca-bundle\") pod \"neutron-5b756f7d96-fzd2s\" (UID: \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\") " pod="openstack/neutron-5b756f7d96-fzd2s" Dec 04 12:21:55.528542 master-0 kubenswrapper[35367]: I1204 12:21:55.528196 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-config\") pod \"dnsmasq-dns-597ccf57f9-r8p69\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:21:55.530849 master-0 kubenswrapper[35367]: I1204 12:21:55.530101 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-dns-swift-storage-0\") pod \"dnsmasq-dns-597ccf57f9-r8p69\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:21:55.531691 master-0 kubenswrapper[35367]: I1204 12:21:55.531622 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-ovsdbserver-nb\") pod \"dnsmasq-dns-597ccf57f9-r8p69\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:21:55.532010 master-0 kubenswrapper[35367]: I1204 12:21:55.531944 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-ovsdbserver-sb\") pod \"dnsmasq-dns-597ccf57f9-r8p69\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:21:55.536298 master-0 kubenswrapper[35367]: I1204 12:21:55.532969 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-config\") pod \"neutron-5b756f7d96-fzd2s\" (UID: \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\") " pod="openstack/neutron-5b756f7d96-fzd2s" Dec 04 12:21:55.536298 master-0 kubenswrapper[35367]: I1204 12:21:55.533243 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-dns-svc\") pod \"dnsmasq-dns-597ccf57f9-r8p69\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:21:55.536298 master-0 kubenswrapper[35367]: I1204 12:21:55.535647 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-httpd-config\") pod \"neutron-5b756f7d96-fzd2s\" (UID: \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\") " pod="openstack/neutron-5b756f7d96-fzd2s" Dec 04 12:21:55.544233 master-0 kubenswrapper[35367]: I1204 12:21:55.544176 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-ovndb-tls-certs\") pod \"neutron-5b756f7d96-fzd2s\" (UID: \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\") " pod="openstack/neutron-5b756f7d96-fzd2s" Dec 04 12:21:55.544484 master-0 kubenswrapper[35367]: I1204 12:21:55.544371 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-combined-ca-bundle\") pod \"neutron-5b756f7d96-fzd2s\" (UID: \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\") " pod="openstack/neutron-5b756f7d96-fzd2s" Dec 04 12:21:55.553698 master-0 kubenswrapper[35367]: I1204 12:21:55.552773 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mx27\" (UniqueName: \"kubernetes.io/projected/6bc1884b-12c9-49ac-bdfe-106e815f94a3-kube-api-access-7mx27\") pod \"neutron-5b756f7d96-fzd2s\" (UID: \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\") " pod="openstack/neutron-5b756f7d96-fzd2s" Dec 04 12:21:55.588219 master-0 kubenswrapper[35367]: I1204 12:21:55.560071 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf8mp\" (UniqueName: \"kubernetes.io/projected/f2a286f2-4ada-485a-97db-414518e8621e-kube-api-access-wf8mp\") pod \"dnsmasq-dns-597ccf57f9-r8p69\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:21:55.705902 master-0 kubenswrapper[35367]: I1204 12:21:55.699417 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:21:55.708086 master-0 kubenswrapper[35367]: I1204 12:21:55.708033 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-5b756f7d96-fzd2s" Dec 04 12:21:55.729859 master-0 kubenswrapper[35367]: I1204 12:21:55.729507 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-7964985c65-pg7fs"] Dec 04 12:21:55.980044 master-0 kubenswrapper[35367]: I1204 12:21:55.978402 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" event={"ID":"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d","Type":"ContainerStarted","Data":"7974f1e4a39bdb557e7ca9328c99f9554af72e0dcfa94c22fc03f9884728eced"} Dec 04 12:21:55.980044 master-0 kubenswrapper[35367]: I1204 12:21:55.979747 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7964985c65-pg7fs" event={"ID":"1592b239-21b6-4f0b-bd45-d53aa68fe3f7","Type":"ContainerStarted","Data":"2a0e4a95710b29b7866656c8fc6df6779687aa4cd534ea4492733137a445d207"} Dec 04 12:21:55.984599 master-0 kubenswrapper[35367]: I1204 12:21:55.984540 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-scheduler-0" event={"ID":"93ed4f64-900a-44ba-b838-82e0594a1809","Type":"ContainerStarted","Data":"1a44619f5a802a817c1c6231e1f3cbdb1821284e08e5fde80fbab9c3603c3560"} Dec 04 12:21:56.221067 master-0 kubenswrapper[35367]: I1204 12:21:56.221007 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-0c69e-api-0"] Dec 04 12:21:56.270520 master-0 kubenswrapper[35367]: I1204 12:21:56.270453 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-0c69e-backup-0"] Dec 04 12:21:56.439928 master-0 kubenswrapper[35367]: I1204 12:21:56.428863 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-5b756f7d96-fzd2s"] Dec 04 12:21:56.445663 master-0 kubenswrapper[35367]: I1204 12:21:56.445563 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-597ccf57f9-r8p69"] Dec 04 12:21:56.582184 master-0 kubenswrapper[35367]: W1204 12:21:56.582103 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2a286f2_4ada_485a_97db_414518e8621e.slice/crio-3ad69fb90dd4402f57d56039a310ce4534b72459e3d6f197b2706b52a748754f WatchSource:0}: Error finding container 3ad69fb90dd4402f57d56039a310ce4534b72459e3d6f197b2706b52a748754f: Status 404 returned error can't find the container with id 3ad69fb90dd4402f57d56039a310ce4534b72459e3d6f197b2706b52a748754f Dec 04 12:21:56.585421 master-0 kubenswrapper[35367]: W1204 12:21:56.585320 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bc1884b_12c9_49ac_bdfe_106e815f94a3.slice/crio-4e12bb338c62264876a16ea7e6ced219d15c77cf7623c434292242da9f1c472b WatchSource:0}: Error finding container 4e12bb338c62264876a16ea7e6ced219d15c77cf7623c434292242da9f1c472b: Status 404 returned error can't find the container with id 4e12bb338c62264876a16ea7e6ced219d15c77cf7623c434292242da9f1c472b Dec 04 12:21:57.012838 master-0 kubenswrapper[35367]: I1204 12:21:57.012755 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-api-0" event={"ID":"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa","Type":"ContainerStarted","Data":"4139c1b16b3d5fcad42ca667fdbe79597cbc57495c18e49f7a9f560aa762cc8a"} Dec 04 12:21:57.024231 master-0 kubenswrapper[35367]: I1204 12:21:57.023896 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-5b756f7d96-fzd2s" event={"ID":"6bc1884b-12c9-49ac-bdfe-106e815f94a3","Type":"ContainerStarted","Data":"4e12bb338c62264876a16ea7e6ced219d15c77cf7623c434292242da9f1c472b"} Dec 04 12:21:57.036194 master-0 kubenswrapper[35367]: I1204 12:21:57.036123 35367 generic.go:334] "Generic (PLEG): container finished" podID="1592b239-21b6-4f0b-bd45-d53aa68fe3f7" containerID="5ccc1b67df2256fdca85f88a3b7c8485d70a1b75ffc9fb5a955b09c4e3569d6f" exitCode=0 Dec 04 12:21:57.037096 master-0 kubenswrapper[35367]: I1204 12:21:57.036447 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7964985c65-pg7fs" event={"ID":"1592b239-21b6-4f0b-bd45-d53aa68fe3f7","Type":"ContainerDied","Data":"5ccc1b67df2256fdca85f88a3b7c8485d70a1b75ffc9fb5a955b09c4e3569d6f"} Dec 04 12:21:57.045266 master-0 kubenswrapper[35367]: I1204 12:21:57.042459 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" event={"ID":"f2a286f2-4ada-485a-97db-414518e8621e","Type":"ContainerStarted","Data":"3ad69fb90dd4402f57d56039a310ce4534b72459e3d6f197b2706b52a748754f"} Dec 04 12:21:57.046087 master-0 kubenswrapper[35367]: I1204 12:21:57.046050 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-backup-0" event={"ID":"7c028dc2-88b7-45cc-abe6-f63d7254cfa8","Type":"ContainerStarted","Data":"e971ab8b3052818304f9734b3bef80738837da85ae5dc60fb0da864883da312e"} Dec 04 12:21:57.968922 master-0 kubenswrapper[35367]: I1204 12:21:57.967768 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:57.975832 master-0 kubenswrapper[35367]: I1204 12:21:57.972127 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-0c69e-api-0"] Dec 04 12:21:58.067962 master-0 kubenswrapper[35367]: I1204 12:21:58.067885 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-5b756f7d96-fzd2s" event={"ID":"6bc1884b-12c9-49ac-bdfe-106e815f94a3","Type":"ContainerStarted","Data":"4393b01cf32532990704afbc04e04d92d5b4683cbe5402d55d70c628a4a61a97"} Dec 04 12:21:58.074084 master-0 kubenswrapper[35367]: I1204 12:21:58.074027 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7964985c65-pg7fs" event={"ID":"1592b239-21b6-4f0b-bd45-d53aa68fe3f7","Type":"ContainerDied","Data":"2a0e4a95710b29b7866656c8fc6df6779687aa4cd534ea4492733137a445d207"} Dec 04 12:21:58.074177 master-0 kubenswrapper[35367]: I1204 12:21:58.074076 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7964985c65-pg7fs" Dec 04 12:21:58.074177 master-0 kubenswrapper[35367]: I1204 12:21:58.074113 35367 scope.go:117] "RemoveContainer" containerID="5ccc1b67df2256fdca85f88a3b7c8485d70a1b75ffc9fb5a955b09c4e3569d6f" Dec 04 12:21:58.078902 master-0 kubenswrapper[35367]: I1204 12:21:58.078834 35367 generic.go:334] "Generic (PLEG): container finished" podID="f2a286f2-4ada-485a-97db-414518e8621e" containerID="e6eabb30db646a600030b8c5d7436a3445c768fe0ef9f674755812d4b0d2a123" exitCode=0 Dec 04 12:21:58.078990 master-0 kubenswrapper[35367]: I1204 12:21:58.078959 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" event={"ID":"f2a286f2-4ada-485a-97db-414518e8621e","Type":"ContainerDied","Data":"e6eabb30db646a600030b8c5d7436a3445c768fe0ef9f674755812d4b0d2a123"} Dec 04 12:21:58.084752 master-0 kubenswrapper[35367]: I1204 12:21:58.084686 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" event={"ID":"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d","Type":"ContainerStarted","Data":"81f9dd5febf40d19bb118ccf87e9246e4ff45a66e11baae0e5a949d58239fd6d"} Dec 04 12:21:58.125970 master-0 kubenswrapper[35367]: I1204 12:21:58.123501 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-dns-swift-storage-0\") pod \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " Dec 04 12:21:58.125970 master-0 kubenswrapper[35367]: I1204 12:21:58.123760 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-ovsdbserver-sb\") pod \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " Dec 04 12:21:58.125970 master-0 kubenswrapper[35367]: I1204 12:21:58.123901 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-dns-svc\") pod \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " Dec 04 12:21:58.125970 master-0 kubenswrapper[35367]: I1204 12:21:58.123960 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-ovsdbserver-nb\") pod \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " Dec 04 12:21:58.125970 master-0 kubenswrapper[35367]: I1204 12:21:58.124026 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccmkg\" (UniqueName: \"kubernetes.io/projected/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-kube-api-access-ccmkg\") pod \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " Dec 04 12:21:58.125970 master-0 kubenswrapper[35367]: I1204 12:21:58.124076 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-config\") pod \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\" (UID: \"1592b239-21b6-4f0b-bd45-d53aa68fe3f7\") " Dec 04 12:21:58.159250 master-0 kubenswrapper[35367]: I1204 12:21:58.159146 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-kube-api-access-ccmkg" (OuterVolumeSpecName: "kube-api-access-ccmkg") pod "1592b239-21b6-4f0b-bd45-d53aa68fe3f7" (UID: "1592b239-21b6-4f0b-bd45-d53aa68fe3f7"). InnerVolumeSpecName "kube-api-access-ccmkg". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:21:58.238170 master-0 kubenswrapper[35367]: I1204 12:21:58.230320 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ccmkg\" (UniqueName: \"kubernetes.io/projected/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-kube-api-access-ccmkg\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:58.304919 master-0 kubenswrapper[35367]: I1204 12:21:58.304838 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "1592b239-21b6-4f0b-bd45-d53aa68fe3f7" (UID: "1592b239-21b6-4f0b-bd45-d53aa68fe3f7"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:58.309569 master-0 kubenswrapper[35367]: I1204 12:21:58.309505 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "1592b239-21b6-4f0b-bd45-d53aa68fe3f7" (UID: "1592b239-21b6-4f0b-bd45-d53aa68fe3f7"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:58.314597 master-0 kubenswrapper[35367]: I1204 12:21:58.313693 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "1592b239-21b6-4f0b-bd45-d53aa68fe3f7" (UID: "1592b239-21b6-4f0b-bd45-d53aa68fe3f7"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:58.319738 master-0 kubenswrapper[35367]: I1204 12:21:58.319628 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "1592b239-21b6-4f0b-bd45-d53aa68fe3f7" (UID: "1592b239-21b6-4f0b-bd45-d53aa68fe3f7"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:58.320111 master-0 kubenswrapper[35367]: I1204 12:21:58.319723 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-config" (OuterVolumeSpecName: "config") pod "1592b239-21b6-4f0b-bd45-d53aa68fe3f7" (UID: "1592b239-21b6-4f0b-bd45-d53aa68fe3f7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:21:58.336492 master-0 kubenswrapper[35367]: I1204 12:21:58.335420 35367 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:58.336492 master-0 kubenswrapper[35367]: I1204 12:21:58.335468 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:58.336492 master-0 kubenswrapper[35367]: I1204 12:21:58.335478 35367 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-dns-swift-storage-0\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:58.336492 master-0 kubenswrapper[35367]: I1204 12:21:58.335493 35367 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:58.336492 master-0 kubenswrapper[35367]: I1204 12:21:58.335504 35367 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/1592b239-21b6-4f0b-bd45-d53aa68fe3f7-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 12:21:58.537366 master-0 kubenswrapper[35367]: I1204 12:21:58.537269 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-7964985c65-pg7fs"] Dec 04 12:21:58.584237 master-0 kubenswrapper[35367]: I1204 12:21:58.584164 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-7964985c65-pg7fs"] Dec 04 12:21:58.767063 master-0 kubenswrapper[35367]: I1204 12:21:58.766914 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1592b239-21b6-4f0b-bd45-d53aa68fe3f7" path="/var/lib/kubelet/pods/1592b239-21b6-4f0b-bd45-d53aa68fe3f7/volumes" Dec 04 12:21:59.119795 master-0 kubenswrapper[35367]: I1204 12:21:59.119711 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-backup-0" event={"ID":"7c028dc2-88b7-45cc-abe6-f63d7254cfa8","Type":"ContainerStarted","Data":"4f98ae1f9d1353c8d7ecbda9131d85c2ee784cb1a3a5c558992ef2d8452e7029"} Dec 04 12:21:59.120197 master-0 kubenswrapper[35367]: I1204 12:21:59.119798 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-backup-0" event={"ID":"7c028dc2-88b7-45cc-abe6-f63d7254cfa8","Type":"ContainerStarted","Data":"8e49e0ccac73260aa9c691e8e5b190f690e753a9cb2c33c193ca253499325e9f"} Dec 04 12:21:59.123743 master-0 kubenswrapper[35367]: I1204 12:21:59.123685 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-api-0" event={"ID":"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa","Type":"ContainerStarted","Data":"9a5be801730c6b5426045ffbef33623866928b42eafb0e323e28845020946990"} Dec 04 12:21:59.139628 master-0 kubenswrapper[35367]: I1204 12:21:59.139055 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-5b756f7d96-fzd2s" event={"ID":"6bc1884b-12c9-49ac-bdfe-106e815f94a3","Type":"ContainerStarted","Data":"62555a02a83fec002b982218db9ce3b56f380cab92b2d92a6fc3850cbbcf8bc8"} Dec 04 12:21:59.139628 master-0 kubenswrapper[35367]: I1204 12:21:59.139300 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/neutron-5b756f7d96-fzd2s" Dec 04 12:21:59.144682 master-0 kubenswrapper[35367]: I1204 12:21:59.144632 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" event={"ID":"f2a286f2-4ada-485a-97db-414518e8621e","Type":"ContainerStarted","Data":"b03e1245627d8a899bc2d5efdd20a1280c5385b0bb784ed6ab02f4b30a72bcf6"} Dec 04 12:21:59.144884 master-0 kubenswrapper[35367]: I1204 12:21:59.144786 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:21:59.159834 master-0 kubenswrapper[35367]: I1204 12:21:59.159145 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-scheduler-0" event={"ID":"93ed4f64-900a-44ba-b838-82e0594a1809","Type":"ContainerStarted","Data":"36b4cff5b4c7b42d714a33878fd694e7c27f69ae3ce3538b8dbf835c4687beb3"} Dec 04 12:21:59.159834 master-0 kubenswrapper[35367]: I1204 12:21:59.159343 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-0c69e-backup-0" podStartSLOduration=4.1171462 podStartE2EDuration="5.159325288s" podCreationTimestamp="2025-12-04 12:21:54 +0000 UTC" firstStartedPulling="2025-12-04 12:21:56.210466235 +0000 UTC m=+1359.648527493" lastFinishedPulling="2025-12-04 12:21:57.252645323 +0000 UTC m=+1360.690706581" observedRunningTime="2025-12-04 12:21:59.154760864 +0000 UTC m=+1362.592822122" watchObservedRunningTime="2025-12-04 12:21:59.159325288 +0000 UTC m=+1362.597386546" Dec 04 12:21:59.172913 master-0 kubenswrapper[35367]: I1204 12:21:59.164303 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" event={"ID":"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d","Type":"ContainerStarted","Data":"4a0a1561781eea60aae99a6eb5a86453b8b3ff0f5435c9a102b617cc0b55629f"} Dec 04 12:21:59.199596 master-0 kubenswrapper[35367]: I1204 12:21:59.199509 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" podStartSLOduration=4.199482976 podStartE2EDuration="4.199482976s" podCreationTimestamp="2025-12-04 12:21:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:21:59.187458736 +0000 UTC m=+1362.625520014" watchObservedRunningTime="2025-12-04 12:21:59.199482976 +0000 UTC m=+1362.637544234" Dec 04 12:21:59.231831 master-0 kubenswrapper[35367]: I1204 12:21:59.228374 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/neutron-5b756f7d96-fzd2s" podStartSLOduration=4.228346307 podStartE2EDuration="4.228346307s" podCreationTimestamp="2025-12-04 12:21:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:21:59.218329891 +0000 UTC m=+1362.656391149" watchObservedRunningTime="2025-12-04 12:21:59.228346307 +0000 UTC m=+1362.666407585" Dec 04 12:21:59.265842 master-0 kubenswrapper[35367]: I1204 12:21:59.262068 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" podStartSLOduration=4.070034162 podStartE2EDuration="5.26202191s" podCreationTimestamp="2025-12-04 12:21:54 +0000 UTC" firstStartedPulling="2025-12-04 12:21:55.482470528 +0000 UTC m=+1358.920531786" lastFinishedPulling="2025-12-04 12:21:56.674458276 +0000 UTC m=+1360.112519534" observedRunningTime="2025-12-04 12:21:59.253492841 +0000 UTC m=+1362.691554119" watchObservedRunningTime="2025-12-04 12:21:59.26202191 +0000 UTC m=+1362.700083178" Dec 04 12:21:59.673866 master-0 kubenswrapper[35367]: I1204 12:21:59.671612 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:00.094134 master-0 kubenswrapper[35367]: I1204 12:22:00.093527 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:00.182540 master-0 kubenswrapper[35367]: I1204 12:22:00.182453 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-scheduler-0" event={"ID":"93ed4f64-900a-44ba-b838-82e0594a1809","Type":"ContainerStarted","Data":"e7d2eb4c4326d9328d1019e46d575326b9fece657d1ace703f372512c14290a6"} Dec 04 12:22:00.186736 master-0 kubenswrapper[35367]: I1204 12:22:00.186686 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-api-0" event={"ID":"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa","Type":"ContainerStarted","Data":"e6d258676237bdda6ca6daf74e1595fc2d2758f4905f5ca152c98db1b53c0f1a"} Dec 04 12:22:00.187247 master-0 kubenswrapper[35367]: I1204 12:22:00.187173 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/cinder-0c69e-api-0" podUID="f836e5c1-bdd0-41e1-92e5-8698e9dd18aa" containerName="cinder-0c69e-api-log" containerID="cri-o://9a5be801730c6b5426045ffbef33623866928b42eafb0e323e28845020946990" gracePeriod=30 Dec 04 12:22:00.187448 master-0 kubenswrapper[35367]: I1204 12:22:00.187269 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/cinder-0c69e-api-0" podUID="f836e5c1-bdd0-41e1-92e5-8698e9dd18aa" containerName="cinder-api" containerID="cri-o://e6d258676237bdda6ca6daf74e1595fc2d2758f4905f5ca152c98db1b53c0f1a" gracePeriod=30 Dec 04 12:22:00.233288 master-0 kubenswrapper[35367]: I1204 12:22:00.231746 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-0c69e-scheduler-0" podStartSLOduration=5.0130826 podStartE2EDuration="6.231714359s" podCreationTimestamp="2025-12-04 12:21:54 +0000 UTC" firstStartedPulling="2025-12-04 12:21:55.454484024 +0000 UTC m=+1358.892545282" lastFinishedPulling="2025-12-04 12:21:56.673115783 +0000 UTC m=+1360.111177041" observedRunningTime="2025-12-04 12:22:00.215385234 +0000 UTC m=+1363.653446492" watchObservedRunningTime="2025-12-04 12:22:00.231714359 +0000 UTC m=+1363.669775617" Dec 04 12:22:00.271489 master-0 kubenswrapper[35367]: I1204 12:22:00.271328 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-0c69e-api-0" podStartSLOduration=6.271301899 podStartE2EDuration="6.271301899s" podCreationTimestamp="2025-12-04 12:21:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:22:00.248755378 +0000 UTC m=+1363.686816636" watchObservedRunningTime="2025-12-04 12:22:00.271301899 +0000 UTC m=+1363.709363167" Dec 04 12:22:00.957744 master-0 kubenswrapper[35367]: I1204 12:22:00.957666 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.160440 master-0 kubenswrapper[35367]: I1204 12:22:01.160249 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-config-data\") pod \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " Dec 04 12:22:01.160440 master-0 kubenswrapper[35367]: I1204 12:22:01.160400 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-logs\") pod \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " Dec 04 12:22:01.160813 master-0 kubenswrapper[35367]: I1204 12:22:01.160602 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-config-data-custom\") pod \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " Dec 04 12:22:01.160813 master-0 kubenswrapper[35367]: I1204 12:22:01.160722 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6jln\" (UniqueName: \"kubernetes.io/projected/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-kube-api-access-h6jln\") pod \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " Dec 04 12:22:01.160911 master-0 kubenswrapper[35367]: I1204 12:22:01.160842 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-combined-ca-bundle\") pod \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " Dec 04 12:22:01.160911 master-0 kubenswrapper[35367]: I1204 12:22:01.160890 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-scripts\") pod \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " Dec 04 12:22:01.160991 master-0 kubenswrapper[35367]: I1204 12:22:01.160918 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-etc-machine-id\") pod \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\" (UID: \"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa\") " Dec 04 12:22:01.161118 master-0 kubenswrapper[35367]: I1204 12:22:01.161040 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-logs" (OuterVolumeSpecName: "logs") pod "f836e5c1-bdd0-41e1-92e5-8698e9dd18aa" (UID: "f836e5c1-bdd0-41e1-92e5-8698e9dd18aa"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:22:01.161182 master-0 kubenswrapper[35367]: I1204 12:22:01.161139 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "f836e5c1-bdd0-41e1-92e5-8698e9dd18aa" (UID: "f836e5c1-bdd0-41e1-92e5-8698e9dd18aa"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:01.161506 master-0 kubenswrapper[35367]: I1204 12:22:01.161449 35367 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-etc-machine-id\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:01.161506 master-0 kubenswrapper[35367]: I1204 12:22:01.161482 35367 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:01.165100 master-0 kubenswrapper[35367]: I1204 12:22:01.164967 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "f836e5c1-bdd0-41e1-92e5-8698e9dd18aa" (UID: "f836e5c1-bdd0-41e1-92e5-8698e9dd18aa"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:01.165708 master-0 kubenswrapper[35367]: I1204 12:22:01.165669 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-scripts" (OuterVolumeSpecName: "scripts") pod "f836e5c1-bdd0-41e1-92e5-8698e9dd18aa" (UID: "f836e5c1-bdd0-41e1-92e5-8698e9dd18aa"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:01.191401 master-0 kubenswrapper[35367]: I1204 12:22:01.191293 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-kube-api-access-h6jln" (OuterVolumeSpecName: "kube-api-access-h6jln") pod "f836e5c1-bdd0-41e1-92e5-8698e9dd18aa" (UID: "f836e5c1-bdd0-41e1-92e5-8698e9dd18aa"). InnerVolumeSpecName "kube-api-access-h6jln". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:01.204526 master-0 kubenswrapper[35367]: I1204 12:22:01.204429 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f836e5c1-bdd0-41e1-92e5-8698e9dd18aa" (UID: "f836e5c1-bdd0-41e1-92e5-8698e9dd18aa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:01.217708 master-0 kubenswrapper[35367]: I1204 12:22:01.217565 35367 generic.go:334] "Generic (PLEG): container finished" podID="f836e5c1-bdd0-41e1-92e5-8698e9dd18aa" containerID="e6d258676237bdda6ca6daf74e1595fc2d2758f4905f5ca152c98db1b53c0f1a" exitCode=0 Dec 04 12:22:01.217708 master-0 kubenswrapper[35367]: I1204 12:22:01.217664 35367 generic.go:334] "Generic (PLEG): container finished" podID="f836e5c1-bdd0-41e1-92e5-8698e9dd18aa" containerID="9a5be801730c6b5426045ffbef33623866928b42eafb0e323e28845020946990" exitCode=143 Dec 04 12:22:01.217708 master-0 kubenswrapper[35367]: I1204 12:22:01.217650 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-api-0" event={"ID":"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa","Type":"ContainerDied","Data":"e6d258676237bdda6ca6daf74e1595fc2d2758f4905f5ca152c98db1b53c0f1a"} Dec 04 12:22:01.217970 master-0 kubenswrapper[35367]: I1204 12:22:01.217707 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.217970 master-0 kubenswrapper[35367]: I1204 12:22:01.217755 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-api-0" event={"ID":"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa","Type":"ContainerDied","Data":"9a5be801730c6b5426045ffbef33623866928b42eafb0e323e28845020946990"} Dec 04 12:22:01.217970 master-0 kubenswrapper[35367]: I1204 12:22:01.217780 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-api-0" event={"ID":"f836e5c1-bdd0-41e1-92e5-8698e9dd18aa","Type":"ContainerDied","Data":"4139c1b16b3d5fcad42ca667fdbe79597cbc57495c18e49f7a9f560aa762cc8a"} Dec 04 12:22:01.217970 master-0 kubenswrapper[35367]: I1204 12:22:01.217802 35367 scope.go:117] "RemoveContainer" containerID="e6d258676237bdda6ca6daf74e1595fc2d2758f4905f5ca152c98db1b53c0f1a" Dec 04 12:22:01.238043 master-0 kubenswrapper[35367]: I1204 12:22:01.237958 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-config-data" (OuterVolumeSpecName: "config-data") pod "f836e5c1-bdd0-41e1-92e5-8698e9dd18aa" (UID: "f836e5c1-bdd0-41e1-92e5-8698e9dd18aa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:01.265283 master-0 kubenswrapper[35367]: I1204 12:22:01.265213 35367 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-config-data-custom\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:01.265283 master-0 kubenswrapper[35367]: I1204 12:22:01.265283 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-h6jln\" (UniqueName: \"kubernetes.io/projected/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-kube-api-access-h6jln\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:01.265283 master-0 kubenswrapper[35367]: I1204 12:22:01.265299 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:01.265614 master-0 kubenswrapper[35367]: I1204 12:22:01.265316 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:01.265614 master-0 kubenswrapper[35367]: I1204 12:22:01.265331 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:01.271439 master-0 kubenswrapper[35367]: I1204 12:22:01.271130 35367 scope.go:117] "RemoveContainer" containerID="9a5be801730c6b5426045ffbef33623866928b42eafb0e323e28845020946990" Dec 04 12:22:01.304443 master-0 kubenswrapper[35367]: I1204 12:22:01.304381 35367 scope.go:117] "RemoveContainer" containerID="e6d258676237bdda6ca6daf74e1595fc2d2758f4905f5ca152c98db1b53c0f1a" Dec 04 12:22:01.318701 master-0 kubenswrapper[35367]: E1204 12:22:01.316031 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6d258676237bdda6ca6daf74e1595fc2d2758f4905f5ca152c98db1b53c0f1a\": container with ID starting with e6d258676237bdda6ca6daf74e1595fc2d2758f4905f5ca152c98db1b53c0f1a not found: ID does not exist" containerID="e6d258676237bdda6ca6daf74e1595fc2d2758f4905f5ca152c98db1b53c0f1a" Dec 04 12:22:01.318701 master-0 kubenswrapper[35367]: I1204 12:22:01.316113 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6d258676237bdda6ca6daf74e1595fc2d2758f4905f5ca152c98db1b53c0f1a"} err="failed to get container status \"e6d258676237bdda6ca6daf74e1595fc2d2758f4905f5ca152c98db1b53c0f1a\": rpc error: code = NotFound desc = could not find container \"e6d258676237bdda6ca6daf74e1595fc2d2758f4905f5ca152c98db1b53c0f1a\": container with ID starting with e6d258676237bdda6ca6daf74e1595fc2d2758f4905f5ca152c98db1b53c0f1a not found: ID does not exist" Dec 04 12:22:01.318701 master-0 kubenswrapper[35367]: I1204 12:22:01.316146 35367 scope.go:117] "RemoveContainer" containerID="9a5be801730c6b5426045ffbef33623866928b42eafb0e323e28845020946990" Dec 04 12:22:01.319503 master-0 kubenswrapper[35367]: E1204 12:22:01.319458 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a5be801730c6b5426045ffbef33623866928b42eafb0e323e28845020946990\": container with ID starting with 9a5be801730c6b5426045ffbef33623866928b42eafb0e323e28845020946990 not found: ID does not exist" containerID="9a5be801730c6b5426045ffbef33623866928b42eafb0e323e28845020946990" Dec 04 12:22:01.319589 master-0 kubenswrapper[35367]: I1204 12:22:01.319512 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a5be801730c6b5426045ffbef33623866928b42eafb0e323e28845020946990"} err="failed to get container status \"9a5be801730c6b5426045ffbef33623866928b42eafb0e323e28845020946990\": rpc error: code = NotFound desc = could not find container \"9a5be801730c6b5426045ffbef33623866928b42eafb0e323e28845020946990\": container with ID starting with 9a5be801730c6b5426045ffbef33623866928b42eafb0e323e28845020946990 not found: ID does not exist" Dec 04 12:22:01.319589 master-0 kubenswrapper[35367]: I1204 12:22:01.319541 35367 scope.go:117] "RemoveContainer" containerID="e6d258676237bdda6ca6daf74e1595fc2d2758f4905f5ca152c98db1b53c0f1a" Dec 04 12:22:01.321517 master-0 kubenswrapper[35367]: I1204 12:22:01.321481 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6d258676237bdda6ca6daf74e1595fc2d2758f4905f5ca152c98db1b53c0f1a"} err="failed to get container status \"e6d258676237bdda6ca6daf74e1595fc2d2758f4905f5ca152c98db1b53c0f1a\": rpc error: code = NotFound desc = could not find container \"e6d258676237bdda6ca6daf74e1595fc2d2758f4905f5ca152c98db1b53c0f1a\": container with ID starting with e6d258676237bdda6ca6daf74e1595fc2d2758f4905f5ca152c98db1b53c0f1a not found: ID does not exist" Dec 04 12:22:01.321517 master-0 kubenswrapper[35367]: I1204 12:22:01.321512 35367 scope.go:117] "RemoveContainer" containerID="9a5be801730c6b5426045ffbef33623866928b42eafb0e323e28845020946990" Dec 04 12:22:01.322386 master-0 kubenswrapper[35367]: I1204 12:22:01.322332 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a5be801730c6b5426045ffbef33623866928b42eafb0e323e28845020946990"} err="failed to get container status \"9a5be801730c6b5426045ffbef33623866928b42eafb0e323e28845020946990\": rpc error: code = NotFound desc = could not find container \"9a5be801730c6b5426045ffbef33623866928b42eafb0e323e28845020946990\": container with ID starting with 9a5be801730c6b5426045ffbef33623866928b42eafb0e323e28845020946990 not found: ID does not exist" Dec 04 12:22:01.386051 master-0 kubenswrapper[35367]: I1204 12:22:01.385991 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/neutron-ccdfc9489-s67vx"] Dec 04 12:22:01.387092 master-0 kubenswrapper[35367]: E1204 12:22:01.387044 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f836e5c1-bdd0-41e1-92e5-8698e9dd18aa" containerName="cinder-0c69e-api-log" Dec 04 12:22:01.387217 master-0 kubenswrapper[35367]: I1204 12:22:01.387205 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f836e5c1-bdd0-41e1-92e5-8698e9dd18aa" containerName="cinder-0c69e-api-log" Dec 04 12:22:01.387323 master-0 kubenswrapper[35367]: E1204 12:22:01.387312 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1592b239-21b6-4f0b-bd45-d53aa68fe3f7" containerName="init" Dec 04 12:22:01.387385 master-0 kubenswrapper[35367]: I1204 12:22:01.387375 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="1592b239-21b6-4f0b-bd45-d53aa68fe3f7" containerName="init" Dec 04 12:22:01.387471 master-0 kubenswrapper[35367]: E1204 12:22:01.387460 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f836e5c1-bdd0-41e1-92e5-8698e9dd18aa" containerName="cinder-api" Dec 04 12:22:01.387536 master-0 kubenswrapper[35367]: I1204 12:22:01.387526 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f836e5c1-bdd0-41e1-92e5-8698e9dd18aa" containerName="cinder-api" Dec 04 12:22:01.387918 master-0 kubenswrapper[35367]: I1204 12:22:01.387902 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="1592b239-21b6-4f0b-bd45-d53aa68fe3f7" containerName="init" Dec 04 12:22:01.388009 master-0 kubenswrapper[35367]: I1204 12:22:01.387998 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="f836e5c1-bdd0-41e1-92e5-8698e9dd18aa" containerName="cinder-api" Dec 04 12:22:01.388109 master-0 kubenswrapper[35367]: I1204 12:22:01.388099 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="f836e5c1-bdd0-41e1-92e5-8698e9dd18aa" containerName="cinder-0c69e-api-log" Dec 04 12:22:01.390544 master-0 kubenswrapper[35367]: I1204 12:22:01.390524 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.394706 master-0 kubenswrapper[35367]: I1204 12:22:01.394661 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-neutron-internal-svc" Dec 04 12:22:01.395062 master-0 kubenswrapper[35367]: I1204 12:22:01.395039 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-neutron-public-svc" Dec 04 12:22:01.403098 master-0 kubenswrapper[35367]: I1204 12:22:01.402782 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-ccdfc9489-s67vx"] Dec 04 12:22:01.490042 master-0 kubenswrapper[35367]: I1204 12:22:01.489894 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9db132a1-1982-45f8-8fac-c326723aac14-internal-tls-certs\") pod \"neutron-ccdfc9489-s67vx\" (UID: \"9db132a1-1982-45f8-8fac-c326723aac14\") " pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.490634 master-0 kubenswrapper[35367]: I1204 12:22:01.490606 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9db132a1-1982-45f8-8fac-c326723aac14-ovndb-tls-certs\") pod \"neutron-ccdfc9489-s67vx\" (UID: \"9db132a1-1982-45f8-8fac-c326723aac14\") " pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.490983 master-0 kubenswrapper[35367]: I1204 12:22:01.490873 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9db132a1-1982-45f8-8fac-c326723aac14-combined-ca-bundle\") pod \"neutron-ccdfc9489-s67vx\" (UID: \"9db132a1-1982-45f8-8fac-c326723aac14\") " pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.491342 master-0 kubenswrapper[35367]: I1204 12:22:01.491284 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9db132a1-1982-45f8-8fac-c326723aac14-httpd-config\") pod \"neutron-ccdfc9489-s67vx\" (UID: \"9db132a1-1982-45f8-8fac-c326723aac14\") " pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.491498 master-0 kubenswrapper[35367]: I1204 12:22:01.491479 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9db132a1-1982-45f8-8fac-c326723aac14-public-tls-certs\") pod \"neutron-ccdfc9489-s67vx\" (UID: \"9db132a1-1982-45f8-8fac-c326723aac14\") " pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.491776 master-0 kubenswrapper[35367]: I1204 12:22:01.491759 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m4bd\" (UniqueName: \"kubernetes.io/projected/9db132a1-1982-45f8-8fac-c326723aac14-kube-api-access-9m4bd\") pod \"neutron-ccdfc9489-s67vx\" (UID: \"9db132a1-1982-45f8-8fac-c326723aac14\") " pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.492454 master-0 kubenswrapper[35367]: I1204 12:22:01.492427 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9db132a1-1982-45f8-8fac-c326723aac14-config\") pod \"neutron-ccdfc9489-s67vx\" (UID: \"9db132a1-1982-45f8-8fac-c326723aac14\") " pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.578324 master-0 kubenswrapper[35367]: I1204 12:22:01.578212 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-0c69e-api-0"] Dec 04 12:22:01.597836 master-0 kubenswrapper[35367]: I1204 12:22:01.596164 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9db132a1-1982-45f8-8fac-c326723aac14-httpd-config\") pod \"neutron-ccdfc9489-s67vx\" (UID: \"9db132a1-1982-45f8-8fac-c326723aac14\") " pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.597836 master-0 kubenswrapper[35367]: I1204 12:22:01.596230 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9db132a1-1982-45f8-8fac-c326723aac14-public-tls-certs\") pod \"neutron-ccdfc9489-s67vx\" (UID: \"9db132a1-1982-45f8-8fac-c326723aac14\") " pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.597836 master-0 kubenswrapper[35367]: I1204 12:22:01.596278 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9m4bd\" (UniqueName: \"kubernetes.io/projected/9db132a1-1982-45f8-8fac-c326723aac14-kube-api-access-9m4bd\") pod \"neutron-ccdfc9489-s67vx\" (UID: \"9db132a1-1982-45f8-8fac-c326723aac14\") " pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.597836 master-0 kubenswrapper[35367]: I1204 12:22:01.596317 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9db132a1-1982-45f8-8fac-c326723aac14-config\") pod \"neutron-ccdfc9489-s67vx\" (UID: \"9db132a1-1982-45f8-8fac-c326723aac14\") " pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.597836 master-0 kubenswrapper[35367]: I1204 12:22:01.596367 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9db132a1-1982-45f8-8fac-c326723aac14-internal-tls-certs\") pod \"neutron-ccdfc9489-s67vx\" (UID: \"9db132a1-1982-45f8-8fac-c326723aac14\") " pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.597836 master-0 kubenswrapper[35367]: I1204 12:22:01.596447 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9db132a1-1982-45f8-8fac-c326723aac14-ovndb-tls-certs\") pod \"neutron-ccdfc9489-s67vx\" (UID: \"9db132a1-1982-45f8-8fac-c326723aac14\") " pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.597836 master-0 kubenswrapper[35367]: I1204 12:22:01.596488 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9db132a1-1982-45f8-8fac-c326723aac14-combined-ca-bundle\") pod \"neutron-ccdfc9489-s67vx\" (UID: \"9db132a1-1982-45f8-8fac-c326723aac14\") " pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.601905 master-0 kubenswrapper[35367]: I1204 12:22:01.598931 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/cinder-0c69e-api-0"] Dec 04 12:22:01.603586 master-0 kubenswrapper[35367]: I1204 12:22:01.603530 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9db132a1-1982-45f8-8fac-c326723aac14-public-tls-certs\") pod \"neutron-ccdfc9489-s67vx\" (UID: \"9db132a1-1982-45f8-8fac-c326723aac14\") " pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.611452 master-0 kubenswrapper[35367]: I1204 12:22:01.609017 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9db132a1-1982-45f8-8fac-c326723aac14-combined-ca-bundle\") pod \"neutron-ccdfc9489-s67vx\" (UID: \"9db132a1-1982-45f8-8fac-c326723aac14\") " pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.615055 master-0 kubenswrapper[35367]: I1204 12:22:01.614934 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-0c69e-api-0"] Dec 04 12:22:01.615287 master-0 kubenswrapper[35367]: I1204 12:22:01.615104 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9db132a1-1982-45f8-8fac-c326723aac14-ovndb-tls-certs\") pod \"neutron-ccdfc9489-s67vx\" (UID: \"9db132a1-1982-45f8-8fac-c326723aac14\") " pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.615348 master-0 kubenswrapper[35367]: I1204 12:22:01.615326 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9db132a1-1982-45f8-8fac-c326723aac14-config\") pod \"neutron-ccdfc9489-s67vx\" (UID: \"9db132a1-1982-45f8-8fac-c326723aac14\") " pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.615878 master-0 kubenswrapper[35367]: I1204 12:22:01.615839 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9db132a1-1982-45f8-8fac-c326723aac14-httpd-config\") pod \"neutron-ccdfc9489-s67vx\" (UID: \"9db132a1-1982-45f8-8fac-c326723aac14\") " pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.622475 master-0 kubenswrapper[35367]: I1204 12:22:01.619766 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9db132a1-1982-45f8-8fac-c326723aac14-internal-tls-certs\") pod \"neutron-ccdfc9489-s67vx\" (UID: \"9db132a1-1982-45f8-8fac-c326723aac14\") " pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.622475 master-0 kubenswrapper[35367]: I1204 12:22:01.620976 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.626386 master-0 kubenswrapper[35367]: I1204 12:22:01.624904 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-0c69e-api-config-data" Dec 04 12:22:01.629961 master-0 kubenswrapper[35367]: I1204 12:22:01.629192 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-cinder-public-svc" Dec 04 12:22:01.629961 master-0 kubenswrapper[35367]: I1204 12:22:01.629510 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-cinder-internal-svc" Dec 04 12:22:01.629961 master-0 kubenswrapper[35367]: I1204 12:22:01.629879 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m4bd\" (UniqueName: \"kubernetes.io/projected/9db132a1-1982-45f8-8fac-c326723aac14-kube-api-access-9m4bd\") pod \"neutron-ccdfc9489-s67vx\" (UID: \"9db132a1-1982-45f8-8fac-c326723aac14\") " pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.658834 master-0 kubenswrapper[35367]: I1204 12:22:01.652384 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-0c69e-api-0"] Dec 04 12:22:01.699329 master-0 kubenswrapper[35367]: I1204 12:22:01.699077 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-logs\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.699329 master-0 kubenswrapper[35367]: I1204 12:22:01.699249 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-config-data\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.699644 master-0 kubenswrapper[35367]: I1204 12:22:01.699332 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-config-data-custom\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.699644 master-0 kubenswrapper[35367]: I1204 12:22:01.699361 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-public-tls-certs\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.699644 master-0 kubenswrapper[35367]: I1204 12:22:01.699488 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-combined-ca-bundle\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.699644 master-0 kubenswrapper[35367]: I1204 12:22:01.699555 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-scripts\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.699644 master-0 kubenswrapper[35367]: I1204 12:22:01.699589 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-etc-machine-id\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.699644 master-0 kubenswrapper[35367]: I1204 12:22:01.699617 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-internal-tls-certs\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.699947 master-0 kubenswrapper[35367]: I1204 12:22:01.699665 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54m9w\" (UniqueName: \"kubernetes.io/projected/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-kube-api-access-54m9w\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.726845 master-0 kubenswrapper[35367]: I1204 12:22:01.725485 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:01.804052 master-0 kubenswrapper[35367]: I1204 12:22:01.803513 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-logs\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.804352 master-0 kubenswrapper[35367]: I1204 12:22:01.804286 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-config-data\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.804473 master-0 kubenswrapper[35367]: I1204 12:22:01.804434 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-config-data-custom\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.806728 master-0 kubenswrapper[35367]: I1204 12:22:01.806677 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-public-tls-certs\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.806856 master-0 kubenswrapper[35367]: I1204 12:22:01.804952 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-logs\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.807099 master-0 kubenswrapper[35367]: I1204 12:22:01.807062 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-combined-ca-bundle\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.807287 master-0 kubenswrapper[35367]: I1204 12:22:01.807226 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-scripts\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.807370 master-0 kubenswrapper[35367]: I1204 12:22:01.807344 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-etc-machine-id\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.807434 master-0 kubenswrapper[35367]: I1204 12:22:01.807418 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-internal-tls-certs\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.807742 master-0 kubenswrapper[35367]: I1204 12:22:01.807587 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-54m9w\" (UniqueName: \"kubernetes.io/projected/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-kube-api-access-54m9w\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.808143 master-0 kubenswrapper[35367]: I1204 12:22:01.807996 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-etc-machine-id\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.814123 master-0 kubenswrapper[35367]: I1204 12:22:01.814067 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-internal-tls-certs\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.814477 master-0 kubenswrapper[35367]: I1204 12:22:01.814436 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-combined-ca-bundle\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.814676 master-0 kubenswrapper[35367]: I1204 12:22:01.814648 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-config-data\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.814927 master-0 kubenswrapper[35367]: I1204 12:22:01.814891 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-config-data-custom\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.817526 master-0 kubenswrapper[35367]: I1204 12:22:01.817481 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-public-tls-certs\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.818822 master-0 kubenswrapper[35367]: I1204 12:22:01.818760 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-scripts\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:01.832861 master-0 kubenswrapper[35367]: I1204 12:22:01.832771 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-54m9w\" (UniqueName: \"kubernetes.io/projected/37057ae0-e4a5-4c17-ba4b-78f5c5619fa6-kube-api-access-54m9w\") pod \"cinder-0c69e-api-0\" (UID: \"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6\") " pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:02.058714 master-0 kubenswrapper[35367]: I1204 12:22:02.058635 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:02.389164 master-0 kubenswrapper[35367]: I1204 12:22:02.389039 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-ccdfc9489-s67vx"] Dec 04 12:22:02.392257 master-0 kubenswrapper[35367]: W1204 12:22:02.391063 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9db132a1_1982_45f8_8fac_c326723aac14.slice/crio-a3451ab57c855f93816730d103c71ef5c33ba109cb6bb1e14432c3b2c7522b02 WatchSource:0}: Error finding container a3451ab57c855f93816730d103c71ef5c33ba109cb6bb1e14432c3b2c7522b02: Status 404 returned error can't find the container with id a3451ab57c855f93816730d103c71ef5c33ba109cb6bb1e14432c3b2c7522b02 Dec 04 12:22:02.681724 master-0 kubenswrapper[35367]: W1204 12:22:02.681641 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37057ae0_e4a5_4c17_ba4b_78f5c5619fa6.slice/crio-d64dc699296069460157857c66ba7db6961cd3bb723f377a7b9b022dbdd93fd7 WatchSource:0}: Error finding container d64dc699296069460157857c66ba7db6961cd3bb723f377a7b9b022dbdd93fd7: Status 404 returned error can't find the container with id d64dc699296069460157857c66ba7db6961cd3bb723f377a7b9b022dbdd93fd7 Dec 04 12:22:02.688021 master-0 kubenswrapper[35367]: I1204 12:22:02.687576 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-0c69e-api-0"] Dec 04 12:22:02.771180 master-0 kubenswrapper[35367]: I1204 12:22:02.771084 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f836e5c1-bdd0-41e1-92e5-8698e9dd18aa" path="/var/lib/kubelet/pods/f836e5c1-bdd0-41e1-92e5-8698e9dd18aa/volumes" Dec 04 12:22:03.263675 master-0 kubenswrapper[35367]: I1204 12:22:03.260473 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-api-0" event={"ID":"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6","Type":"ContainerStarted","Data":"d64dc699296069460157857c66ba7db6961cd3bb723f377a7b9b022dbdd93fd7"} Dec 04 12:22:03.268087 master-0 kubenswrapper[35367]: I1204 12:22:03.264560 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-ccdfc9489-s67vx" event={"ID":"9db132a1-1982-45f8-8fac-c326723aac14","Type":"ContainerStarted","Data":"ac29fa2bb1b634107609426844142e3ecf0dbadcdd39e0c8c11e46647eaff50b"} Dec 04 12:22:03.268087 master-0 kubenswrapper[35367]: I1204 12:22:03.264631 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-ccdfc9489-s67vx" event={"ID":"9db132a1-1982-45f8-8fac-c326723aac14","Type":"ContainerStarted","Data":"7d83eca37af902d4a5d963a733456d50e0e65e278fa5a1cb978f47ecacab6eea"} Dec 04 12:22:03.268087 master-0 kubenswrapper[35367]: I1204 12:22:03.264648 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-ccdfc9489-s67vx" event={"ID":"9db132a1-1982-45f8-8fac-c326723aac14","Type":"ContainerStarted","Data":"a3451ab57c855f93816730d103c71ef5c33ba109cb6bb1e14432c3b2c7522b02"} Dec 04 12:22:03.268087 master-0 kubenswrapper[35367]: I1204 12:22:03.265619 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:03.409692 master-0 kubenswrapper[35367]: I1204 12:22:03.409594 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/neutron-ccdfc9489-s67vx" podStartSLOduration=2.409564543 podStartE2EDuration="2.409564543s" podCreationTimestamp="2025-12-04 12:22:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:22:03.397832932 +0000 UTC m=+1366.835894190" watchObservedRunningTime="2025-12-04 12:22:03.409564543 +0000 UTC m=+1366.847625811" Dec 04 12:22:04.307288 master-0 kubenswrapper[35367]: I1204 12:22:04.307192 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-api-0" event={"ID":"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6","Type":"ContainerStarted","Data":"86ed587e91573f7a23ad7d223e4cddac4ea5439efd1f8c43b33e677970fc0679"} Dec 04 12:22:04.398465 master-0 kubenswrapper[35367]: I1204 12:22:04.397724 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-0c69e-api-0" podStartSLOduration=3.397699004 podStartE2EDuration="3.397699004s" podCreationTimestamp="2025-12-04 12:22:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:22:04.388901976 +0000 UTC m=+1367.826963264" watchObservedRunningTime="2025-12-04 12:22:04.397699004 +0000 UTC m=+1367.835760272" Dec 04 12:22:04.660331 master-0 kubenswrapper[35367]: I1204 12:22:04.660190 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:04.898848 master-0 kubenswrapper[35367]: I1204 12:22:04.898136 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:04.970195 master-0 kubenswrapper[35367]: I1204 12:22:04.969722 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:05.040602 master-0 kubenswrapper[35367]: I1204 12:22:05.040518 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-0c69e-volume-lvm-iscsi-0"] Dec 04 12:22:05.333118 master-0 kubenswrapper[35367]: I1204 12:22:05.330399 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-api-0" event={"ID":"37057ae0-e4a5-4c17-ba4b-78f5c5619fa6","Type":"ContainerStarted","Data":"374bd44f81ee6e5178759f9200b97bdd48954ec4071f8bf3fc3324f7bd43acf4"} Dec 04 12:22:05.333118 master-0 kubenswrapper[35367]: I1204 12:22:05.332446 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" podUID="bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" containerName="cinder-volume" containerID="cri-o://81f9dd5febf40d19bb118ccf87e9246e4ff45a66e11baae0e5a949d58239fd6d" gracePeriod=30 Dec 04 12:22:05.333118 master-0 kubenswrapper[35367]: I1204 12:22:05.332590 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:05.333118 master-0 kubenswrapper[35367]: I1204 12:22:05.332659 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" podUID="bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" containerName="probe" containerID="cri-o://4a0a1561781eea60aae99a6eb5a86453b8b3ff0f5435c9a102b617cc0b55629f" gracePeriod=30 Dec 04 12:22:05.355970 master-0 kubenswrapper[35367]: I1204 12:22:05.352915 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:05.532991 master-0 kubenswrapper[35367]: I1204 12:22:05.532917 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-0c69e-scheduler-0"] Dec 04 12:22:05.574293 master-0 kubenswrapper[35367]: I1204 12:22:05.574063 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-0c69e-backup-0"] Dec 04 12:22:05.701058 master-0 kubenswrapper[35367]: I1204 12:22:05.701001 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:22:05.804554 master-0 kubenswrapper[35367]: I1204 12:22:05.804102 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-7c8d56b84f-g89zk"] Dec 04 12:22:05.804891 master-0 kubenswrapper[35367]: I1204 12:22:05.804569 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" podUID="15d9c3a0-4909-4282-8eb3-8d7a7faafd50" containerName="dnsmasq-dns" containerID="cri-o://ab91a90c9968dd402e207fcaf1ecc7defd7e714ae7df0cec67b640112ca547ce" gracePeriod=10 Dec 04 12:22:06.177969 master-0 kubenswrapper[35367]: W1204 12:22:06.160702 35367 container.go:586] Failed to update stats for container "/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfaa1c4e_58d6_4a96_b29b_6ecb0203b23d.slice/crio-7974f1e4a39bdb557e7ca9328c99f9554af72e0dcfa94c22fc03f9884728eced": error while statting cgroup v2: [unable to parse /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfaa1c4e_58d6_4a96_b29b_6ecb0203b23d.slice/crio-7974f1e4a39bdb557e7ca9328c99f9554af72e0dcfa94c22fc03f9884728eced/memory.stat: read /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfaa1c4e_58d6_4a96_b29b_6ecb0203b23d.slice/crio-7974f1e4a39bdb557e7ca9328c99f9554af72e0dcfa94c22fc03f9884728eced/memory.stat: no such device], continuing to push stats Dec 04 12:22:06.351574 master-0 kubenswrapper[35367]: I1204 12:22:06.351521 35367 generic.go:334] "Generic (PLEG): container finished" podID="bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" containerID="4a0a1561781eea60aae99a6eb5a86453b8b3ff0f5435c9a102b617cc0b55629f" exitCode=0 Dec 04 12:22:06.351855 master-0 kubenswrapper[35367]: I1204 12:22:06.351841 35367 generic.go:334] "Generic (PLEG): container finished" podID="bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" containerID="81f9dd5febf40d19bb118ccf87e9246e4ff45a66e11baae0e5a949d58239fd6d" exitCode=0 Dec 04 12:22:06.351984 master-0 kubenswrapper[35367]: I1204 12:22:06.351963 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" event={"ID":"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d","Type":"ContainerDied","Data":"4a0a1561781eea60aae99a6eb5a86453b8b3ff0f5435c9a102b617cc0b55629f"} Dec 04 12:22:06.352071 master-0 kubenswrapper[35367]: I1204 12:22:06.352057 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" event={"ID":"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d","Type":"ContainerDied","Data":"81f9dd5febf40d19bb118ccf87e9246e4ff45a66e11baae0e5a949d58239fd6d"} Dec 04 12:22:06.356300 master-0 kubenswrapper[35367]: I1204 12:22:06.356248 35367 generic.go:334] "Generic (PLEG): container finished" podID="15d9c3a0-4909-4282-8eb3-8d7a7faafd50" containerID="ab91a90c9968dd402e207fcaf1ecc7defd7e714ae7df0cec67b640112ca547ce" exitCode=0 Dec 04 12:22:06.356731 master-0 kubenswrapper[35367]: I1204 12:22:06.356681 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" event={"ID":"15d9c3a0-4909-4282-8eb3-8d7a7faafd50","Type":"ContainerDied","Data":"ab91a90c9968dd402e207fcaf1ecc7defd7e714ae7df0cec67b640112ca547ce"} Dec 04 12:22:06.358830 master-0 kubenswrapper[35367]: I1204 12:22:06.358705 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/cinder-0c69e-scheduler-0" podUID="93ed4f64-900a-44ba-b838-82e0594a1809" containerName="cinder-scheduler" containerID="cri-o://36b4cff5b4c7b42d714a33878fd694e7c27f69ae3ce3538b8dbf835c4687beb3" gracePeriod=30 Dec 04 12:22:06.359025 master-0 kubenswrapper[35367]: I1204 12:22:06.358961 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/cinder-0c69e-scheduler-0" podUID="93ed4f64-900a-44ba-b838-82e0594a1809" containerName="probe" containerID="cri-o://e7d2eb4c4326d9328d1019e46d575326b9fece657d1ace703f372512c14290a6" gracePeriod=30 Dec 04 12:22:06.359081 master-0 kubenswrapper[35367]: I1204 12:22:06.358967 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/cinder-0c69e-backup-0" podUID="7c028dc2-88b7-45cc-abe6-f63d7254cfa8" containerName="probe" containerID="cri-o://4f98ae1f9d1353c8d7ecbda9131d85c2ee784cb1a3a5c558992ef2d8452e7029" gracePeriod=30 Dec 04 12:22:06.359210 master-0 kubenswrapper[35367]: I1204 12:22:06.359183 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/cinder-0c69e-backup-0" podUID="7c028dc2-88b7-45cc-abe6-f63d7254cfa8" containerName="cinder-backup" containerID="cri-o://8e49e0ccac73260aa9c691e8e5b190f690e753a9cb2c33c193ca253499325e9f" gracePeriod=30 Dec 04 12:22:06.664847 master-0 kubenswrapper[35367]: I1204 12:22:06.658610 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:22:06.957899 master-0 kubenswrapper[35367]: I1204 12:22:06.957614 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-dns-svc\") pod \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " Dec 04 12:22:06.957899 master-0 kubenswrapper[35367]: I1204 12:22:06.957743 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-dns-swift-storage-0\") pod \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " Dec 04 12:22:06.958705 master-0 kubenswrapper[35367]: I1204 12:22:06.957931 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52gpz\" (UniqueName: \"kubernetes.io/projected/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-kube-api-access-52gpz\") pod \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " Dec 04 12:22:06.958705 master-0 kubenswrapper[35367]: I1204 12:22:06.958105 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-config\") pod \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " Dec 04 12:22:06.958705 master-0 kubenswrapper[35367]: I1204 12:22:06.958369 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-ovsdbserver-sb\") pod \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " Dec 04 12:22:06.958705 master-0 kubenswrapper[35367]: I1204 12:22:06.958401 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-ovsdbserver-nb\") pod \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\" (UID: \"15d9c3a0-4909-4282-8eb3-8d7a7faafd50\") " Dec 04 12:22:06.985643 master-0 kubenswrapper[35367]: I1204 12:22:06.985543 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-kube-api-access-52gpz" (OuterVolumeSpecName: "kube-api-access-52gpz") pod "15d9c3a0-4909-4282-8eb3-8d7a7faafd50" (UID: "15d9c3a0-4909-4282-8eb3-8d7a7faafd50"). InnerVolumeSpecName "kube-api-access-52gpz". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:07.065886 master-0 kubenswrapper[35367]: I1204 12:22:07.065732 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-52gpz\" (UniqueName: \"kubernetes.io/projected/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-kube-api-access-52gpz\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:07.066401 master-0 kubenswrapper[35367]: I1204 12:22:07.066351 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "15d9c3a0-4909-4282-8eb3-8d7a7faafd50" (UID: "15d9c3a0-4909-4282-8eb3-8d7a7faafd50"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:07.073060 master-0 kubenswrapper[35367]: I1204 12:22:07.072895 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-config" (OuterVolumeSpecName: "config") pod "15d9c3a0-4909-4282-8eb3-8d7a7faafd50" (UID: "15d9c3a0-4909-4282-8eb3-8d7a7faafd50"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:07.075097 master-0 kubenswrapper[35367]: I1204 12:22:07.074482 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "15d9c3a0-4909-4282-8eb3-8d7a7faafd50" (UID: "15d9c3a0-4909-4282-8eb3-8d7a7faafd50"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:07.093950 master-0 kubenswrapper[35367]: I1204 12:22:07.093798 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "15d9c3a0-4909-4282-8eb3-8d7a7faafd50" (UID: "15d9c3a0-4909-4282-8eb3-8d7a7faafd50"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:07.101369 master-0 kubenswrapper[35367]: I1204 12:22:07.101305 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "15d9c3a0-4909-4282-8eb3-8d7a7faafd50" (UID: "15d9c3a0-4909-4282-8eb3-8d7a7faafd50"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:07.126267 master-0 kubenswrapper[35367]: I1204 12:22:07.126201 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.168059 master-0 kubenswrapper[35367]: I1204 12:22:07.167959 35367 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:07.168059 master-0 kubenswrapper[35367]: I1204 12:22:07.168020 35367 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:07.168059 master-0 kubenswrapper[35367]: I1204 12:22:07.168033 35367 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:07.168059 master-0 kubenswrapper[35367]: I1204 12:22:07.168045 35367 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-dns-swift-storage-0\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:07.168059 master-0 kubenswrapper[35367]: I1204 12:22:07.168057 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15d9c3a0-4909-4282-8eb3-8d7a7faafd50-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:07.270289 master-0 kubenswrapper[35367]: I1204 12:22:07.269738 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-scripts\") pod \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " Dec 04 12:22:07.270289 master-0 kubenswrapper[35367]: I1204 12:22:07.269859 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-sys\") pod \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " Dec 04 12:22:07.270289 master-0 kubenswrapper[35367]: I1204 12:22:07.269943 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-etc-iscsi\") pod \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " Dec 04 12:22:07.270289 master-0 kubenswrapper[35367]: I1204 12:22:07.270025 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-var-locks-cinder\") pod \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " Dec 04 12:22:07.270289 master-0 kubenswrapper[35367]: I1204 12:22:07.270165 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-var-locks-cinder" (OuterVolumeSpecName: "var-locks-cinder") pod "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" (UID: "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d"). InnerVolumeSpecName "var-locks-cinder". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:07.270289 master-0 kubenswrapper[35367]: I1204 12:22:07.270221 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-sys" (OuterVolumeSpecName: "sys") pod "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" (UID: "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d"). InnerVolumeSpecName "sys". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:07.270289 master-0 kubenswrapper[35367]: I1204 12:22:07.270249 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-etc-iscsi" (OuterVolumeSpecName: "etc-iscsi") pod "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" (UID: "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d"). InnerVolumeSpecName "etc-iscsi". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:07.270993 master-0 kubenswrapper[35367]: I1204 12:22:07.270955 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-lib-modules\") pod \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " Dec 04 12:22:07.271142 master-0 kubenswrapper[35367]: I1204 12:22:07.271127 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-run\") pod \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " Dec 04 12:22:07.271279 master-0 kubenswrapper[35367]: I1204 12:22:07.271264 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-var-lib-cinder\") pod \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " Dec 04 12:22:07.271473 master-0 kubenswrapper[35367]: I1204 12:22:07.271459 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-config-data-custom\") pod \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " Dec 04 12:22:07.271568 master-0 kubenswrapper[35367]: I1204 12:22:07.271556 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-config-data\") pod \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " Dec 04 12:22:07.271649 master-0 kubenswrapper[35367]: I1204 12:22:07.271637 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-dev\") pod \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " Dec 04 12:22:07.271743 master-0 kubenswrapper[35367]: I1204 12:22:07.271731 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-etc-machine-id\") pod \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " Dec 04 12:22:07.271895 master-0 kubenswrapper[35367]: I1204 12:22:07.271879 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87wf8\" (UniqueName: \"kubernetes.io/projected/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-kube-api-access-87wf8\") pod \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " Dec 04 12:22:07.272138 master-0 kubenswrapper[35367]: I1204 12:22:07.272086 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-combined-ca-bundle\") pod \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " Dec 04 12:22:07.273021 master-0 kubenswrapper[35367]: I1204 12:22:07.273001 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-etc-nvme\") pod \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " Dec 04 12:22:07.273773 master-0 kubenswrapper[35367]: I1204 12:22:07.271782 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-var-lib-cinder" (OuterVolumeSpecName: "var-lib-cinder") pod "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" (UID: "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d"). InnerVolumeSpecName "var-lib-cinder". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:07.273773 master-0 kubenswrapper[35367]: I1204 12:22:07.271827 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-lib-modules" (OuterVolumeSpecName: "lib-modules") pod "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" (UID: "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d"). InnerVolumeSpecName "lib-modules". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:07.273773 master-0 kubenswrapper[35367]: I1204 12:22:07.271853 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-run" (OuterVolumeSpecName: "run") pod "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" (UID: "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d"). InnerVolumeSpecName "run". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:07.273773 master-0 kubenswrapper[35367]: I1204 12:22:07.272277 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" (UID: "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:07.273773 master-0 kubenswrapper[35367]: I1204 12:22:07.272370 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-dev" (OuterVolumeSpecName: "dev") pod "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" (UID: "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d"). InnerVolumeSpecName "dev". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:07.273773 master-0 kubenswrapper[35367]: I1204 12:22:07.273048 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-etc-nvme" (OuterVolumeSpecName: "etc-nvme") pod "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" (UID: "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d"). InnerVolumeSpecName "etc-nvme". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:07.273773 master-0 kubenswrapper[35367]: I1204 12:22:07.273830 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-var-locks-brick\") pod \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\" (UID: \"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d\") " Dec 04 12:22:07.273773 master-0 kubenswrapper[35367]: I1204 12:22:07.273841 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-scripts" (OuterVolumeSpecName: "scripts") pod "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" (UID: "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:07.273773 master-0 kubenswrapper[35367]: I1204 12:22:07.273876 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-var-locks-brick" (OuterVolumeSpecName: "var-locks-brick") pod "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" (UID: "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d"). InnerVolumeSpecName "var-locks-brick". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:07.275576 master-0 kubenswrapper[35367]: I1204 12:22:07.275534 35367 reconciler_common.go:293] "Volume detached for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-dev\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:07.275576 master-0 kubenswrapper[35367]: I1204 12:22:07.275566 35367 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-etc-machine-id\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:07.275576 master-0 kubenswrapper[35367]: I1204 12:22:07.275582 35367 reconciler_common.go:293] "Volume detached for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-etc-nvme\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:07.275576 master-0 kubenswrapper[35367]: I1204 12:22:07.275591 35367 reconciler_common.go:293] "Volume detached for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-var-locks-brick\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:07.276016 master-0 kubenswrapper[35367]: I1204 12:22:07.275601 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:07.276016 master-0 kubenswrapper[35367]: I1204 12:22:07.275609 35367 reconciler_common.go:293] "Volume detached for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-sys\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:07.276016 master-0 kubenswrapper[35367]: I1204 12:22:07.275617 35367 reconciler_common.go:293] "Volume detached for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-etc-iscsi\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:07.276016 master-0 kubenswrapper[35367]: I1204 12:22:07.275625 35367 reconciler_common.go:293] "Volume detached for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-var-locks-cinder\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:07.276016 master-0 kubenswrapper[35367]: I1204 12:22:07.275634 35367 reconciler_common.go:293] "Volume detached for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-lib-modules\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:07.276016 master-0 kubenswrapper[35367]: I1204 12:22:07.275641 35367 reconciler_common.go:293] "Volume detached for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-run\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:07.276016 master-0 kubenswrapper[35367]: I1204 12:22:07.275650 35367 reconciler_common.go:293] "Volume detached for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-var-lib-cinder\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:07.276541 master-0 kubenswrapper[35367]: I1204 12:22:07.276506 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" (UID: "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:07.279475 master-0 kubenswrapper[35367]: I1204 12:22:07.278968 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-kube-api-access-87wf8" (OuterVolumeSpecName: "kube-api-access-87wf8") pod "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" (UID: "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d"). InnerVolumeSpecName "kube-api-access-87wf8". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:07.370083 master-0 kubenswrapper[35367]: I1204 12:22:07.369998 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" (UID: "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:07.379208 master-0 kubenswrapper[35367]: I1204 12:22:07.377926 35367 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-config-data-custom\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:07.379208 master-0 kubenswrapper[35367]: I1204 12:22:07.377972 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-87wf8\" (UniqueName: \"kubernetes.io/projected/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-kube-api-access-87wf8\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:07.379208 master-0 kubenswrapper[35367]: I1204 12:22:07.377986 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:07.389434 master-0 kubenswrapper[35367]: I1204 12:22:07.389287 35367 generic.go:334] "Generic (PLEG): container finished" podID="93ed4f64-900a-44ba-b838-82e0594a1809" containerID="e7d2eb4c4326d9328d1019e46d575326b9fece657d1ace703f372512c14290a6" exitCode=0 Dec 04 12:22:07.389434 master-0 kubenswrapper[35367]: I1204 12:22:07.389353 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-scheduler-0" event={"ID":"93ed4f64-900a-44ba-b838-82e0594a1809","Type":"ContainerDied","Data":"e7d2eb4c4326d9328d1019e46d575326b9fece657d1ace703f372512c14290a6"} Dec 04 12:22:07.396258 master-0 kubenswrapper[35367]: I1204 12:22:07.391569 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" event={"ID":"bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d","Type":"ContainerDied","Data":"7974f1e4a39bdb557e7ca9328c99f9554af72e0dcfa94c22fc03f9884728eced"} Dec 04 12:22:07.396258 master-0 kubenswrapper[35367]: I1204 12:22:07.391616 35367 scope.go:117] "RemoveContainer" containerID="4a0a1561781eea60aae99a6eb5a86453b8b3ff0f5435c9a102b617cc0b55629f" Dec 04 12:22:07.396258 master-0 kubenswrapper[35367]: I1204 12:22:07.391675 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.406455 master-0 kubenswrapper[35367]: I1204 12:22:07.406353 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" event={"ID":"15d9c3a0-4909-4282-8eb3-8d7a7faafd50","Type":"ContainerDied","Data":"a0ca9e65ac27016e90df7951c7db4c2fa15011081ebe0fea6014de0d4995a1e4"} Dec 04 12:22:07.407413 master-0 kubenswrapper[35367]: I1204 12:22:07.407367 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7c8d56b84f-g89zk" Dec 04 12:22:07.416030 master-0 kubenswrapper[35367]: I1204 12:22:07.415957 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-config-data" (OuterVolumeSpecName: "config-data") pod "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" (UID: "bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:07.442008 master-0 kubenswrapper[35367]: I1204 12:22:07.441957 35367 scope.go:117] "RemoveContainer" containerID="81f9dd5febf40d19bb118ccf87e9246e4ff45a66e11baae0e5a949d58239fd6d" Dec 04 12:22:07.480927 master-0 kubenswrapper[35367]: I1204 12:22:07.479935 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:07.544069 master-0 kubenswrapper[35367]: I1204 12:22:07.543888 35367 scope.go:117] "RemoveContainer" containerID="ab91a90c9968dd402e207fcaf1ecc7defd7e714ae7df0cec67b640112ca547ce" Dec 04 12:22:07.551182 master-0 kubenswrapper[35367]: I1204 12:22:07.551098 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-7c8d56b84f-g89zk"] Dec 04 12:22:07.567229 master-0 kubenswrapper[35367]: I1204 12:22:07.566962 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-7c8d56b84f-g89zk"] Dec 04 12:22:07.611241 master-0 kubenswrapper[35367]: I1204 12:22:07.610948 35367 scope.go:117] "RemoveContainer" containerID="e79009673255b982975b565c237c1b40249f3329adb28c1cacbb656c10404789" Dec 04 12:22:07.747873 master-0 kubenswrapper[35367]: I1204 12:22:07.747769 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-0c69e-volume-lvm-iscsi-0"] Dec 04 12:22:07.768437 master-0 kubenswrapper[35367]: I1204 12:22:07.766022 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/cinder-0c69e-volume-lvm-iscsi-0"] Dec 04 12:22:07.785327 master-0 kubenswrapper[35367]: I1204 12:22:07.782512 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-0c69e-volume-lvm-iscsi-0"] Dec 04 12:22:07.785327 master-0 kubenswrapper[35367]: E1204 12:22:07.783205 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="15d9c3a0-4909-4282-8eb3-8d7a7faafd50" containerName="dnsmasq-dns" Dec 04 12:22:07.785327 master-0 kubenswrapper[35367]: I1204 12:22:07.783229 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="15d9c3a0-4909-4282-8eb3-8d7a7faafd50" containerName="dnsmasq-dns" Dec 04 12:22:07.785327 master-0 kubenswrapper[35367]: E1204 12:22:07.783271 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" containerName="probe" Dec 04 12:22:07.785327 master-0 kubenswrapper[35367]: I1204 12:22:07.783278 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" containerName="probe" Dec 04 12:22:07.785327 master-0 kubenswrapper[35367]: E1204 12:22:07.783293 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" containerName="cinder-volume" Dec 04 12:22:07.785327 master-0 kubenswrapper[35367]: I1204 12:22:07.783299 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" containerName="cinder-volume" Dec 04 12:22:07.785327 master-0 kubenswrapper[35367]: E1204 12:22:07.783337 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="15d9c3a0-4909-4282-8eb3-8d7a7faafd50" containerName="init" Dec 04 12:22:07.785327 master-0 kubenswrapper[35367]: I1204 12:22:07.783343 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="15d9c3a0-4909-4282-8eb3-8d7a7faafd50" containerName="init" Dec 04 12:22:07.785327 master-0 kubenswrapper[35367]: I1204 12:22:07.783628 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" containerName="probe" Dec 04 12:22:07.785327 master-0 kubenswrapper[35367]: I1204 12:22:07.783649 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" containerName="cinder-volume" Dec 04 12:22:07.785327 master-0 kubenswrapper[35367]: I1204 12:22:07.783666 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="15d9c3a0-4909-4282-8eb3-8d7a7faafd50" containerName="dnsmasq-dns" Dec 04 12:22:07.786045 master-0 kubenswrapper[35367]: I1204 12:22:07.785436 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.813057 master-0 kubenswrapper[35367]: I1204 12:22:07.808507 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-0c69e-volume-lvm-iscsi-config-data" Dec 04 12:22:07.821962 master-0 kubenswrapper[35367]: I1204 12:22:07.821311 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-var-lib-cinder\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.821962 master-0 kubenswrapper[35367]: I1204 12:22:07.821862 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-run\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.821962 master-0 kubenswrapper[35367]: I1204 12:22:07.821965 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-var-locks-brick\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.822347 master-0 kubenswrapper[35367]: I1204 12:22:07.822002 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-etc-nvme\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.822347 master-0 kubenswrapper[35367]: I1204 12:22:07.822109 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-var-locks-cinder\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.822347 master-0 kubenswrapper[35367]: I1204 12:22:07.822222 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-config-data-custom\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.822347 master-0 kubenswrapper[35367]: I1204 12:22:07.822311 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-scripts\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.822550 master-0 kubenswrapper[35367]: I1204 12:22:07.822510 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-etc-machine-id\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.822593 master-0 kubenswrapper[35367]: I1204 12:22:07.822558 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-config-data\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.822630 master-0 kubenswrapper[35367]: I1204 12:22:07.822602 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-combined-ca-bundle\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.822741 master-0 kubenswrapper[35367]: I1204 12:22:07.822710 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-lib-modules\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.822980 master-0 kubenswrapper[35367]: I1204 12:22:07.822953 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-etc-iscsi\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.823032 master-0 kubenswrapper[35367]: I1204 12:22:07.822989 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6lxd\" (UniqueName: \"kubernetes.io/projected/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-kube-api-access-p6lxd\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.823098 master-0 kubenswrapper[35367]: I1204 12:22:07.823080 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-dev\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.823133 master-0 kubenswrapper[35367]: I1204 12:22:07.823109 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-sys\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.823389 master-0 kubenswrapper[35367]: I1204 12:22:07.823263 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-0c69e-volume-lvm-iscsi-0"] Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.926123 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-etc-machine-id\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.926354 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-config-data\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.926430 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-combined-ca-bundle\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.926508 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-lib-modules\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.926597 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-etc-iscsi\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.926631 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p6lxd\" (UniqueName: \"kubernetes.io/projected/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-kube-api-access-p6lxd\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.926711 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-dev\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.926754 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-sys\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.926795 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-var-lib-cinder\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.926800 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-etc-machine-id\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.926929 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-run\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.926862 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-run\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.927073 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-var-locks-brick\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.927113 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-etc-nvme\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.927219 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-var-locks-cinder\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.927346 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-config-data-custom\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.927477 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-scripts\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.927550 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-etc-nvme\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.927620 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-etc-iscsi\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.927697 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-var-locks-brick\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.928390 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-lib-modules\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.928802 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-var-lib-cinder\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.928920 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-var-locks-cinder\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.929088 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-sys\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.937835 master-0 kubenswrapper[35367]: I1204 12:22:07.929156 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-dev\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.959906 master-0 kubenswrapper[35367]: I1204 12:22:07.941874 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-combined-ca-bundle\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.959906 master-0 kubenswrapper[35367]: I1204 12:22:07.957426 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-config-data\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.959906 master-0 kubenswrapper[35367]: I1204 12:22:07.958061 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-scripts\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.964417 master-0 kubenswrapper[35367]: I1204 12:22:07.960011 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-config-data-custom\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:07.964417 master-0 kubenswrapper[35367]: I1204 12:22:07.961054 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6lxd\" (UniqueName: \"kubernetes.io/projected/b3e0fd68-8367-46c5-b57d-a9ec6c21188f-kube-api-access-p6lxd\") pod \"cinder-0c69e-volume-lvm-iscsi-0\" (UID: \"b3e0fd68-8367-46c5-b57d-a9ec6c21188f\") " pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:08.182293 master-0 kubenswrapper[35367]: I1204 12:22:08.182193 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:08.224246 master-0 kubenswrapper[35367]: I1204 12:22:08.222683 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:08.346204 master-0 kubenswrapper[35367]: I1204 12:22:08.344233 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-dev\") pod \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " Dec 04 12:22:08.346204 master-0 kubenswrapper[35367]: I1204 12:22:08.344359 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-run\") pod \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " Dec 04 12:22:08.346204 master-0 kubenswrapper[35367]: I1204 12:22:08.345501 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-dev" (OuterVolumeSpecName: "dev") pod "7c028dc2-88b7-45cc-abe6-f63d7254cfa8" (UID: "7c028dc2-88b7-45cc-abe6-f63d7254cfa8"). InnerVolumeSpecName "dev". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:08.346204 master-0 kubenswrapper[35367]: I1204 12:22:08.345524 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-run" (OuterVolumeSpecName: "run") pod "7c028dc2-88b7-45cc-abe6-f63d7254cfa8" (UID: "7c028dc2-88b7-45cc-abe6-f63d7254cfa8"). InnerVolumeSpecName "run". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:08.346204 master-0 kubenswrapper[35367]: I1204 12:22:08.345629 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-var-locks-brick" (OuterVolumeSpecName: "var-locks-brick") pod "7c028dc2-88b7-45cc-abe6-f63d7254cfa8" (UID: "7c028dc2-88b7-45cc-abe6-f63d7254cfa8"). InnerVolumeSpecName "var-locks-brick". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:08.346927 master-0 kubenswrapper[35367]: I1204 12:22:08.345289 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-var-locks-brick\") pod \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " Dec 04 12:22:08.346927 master-0 kubenswrapper[35367]: I1204 12:22:08.346621 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-lib-modules\") pod \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " Dec 04 12:22:08.347181 master-0 kubenswrapper[35367]: I1204 12:22:08.347150 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-sys\") pod \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " Dec 04 12:22:08.347258 master-0 kubenswrapper[35367]: I1204 12:22:08.347238 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-etc-machine-id\") pod \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " Dec 04 12:22:08.347322 master-0 kubenswrapper[35367]: I1204 12:22:08.347289 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-lib-modules" (OuterVolumeSpecName: "lib-modules") pod "7c028dc2-88b7-45cc-abe6-f63d7254cfa8" (UID: "7c028dc2-88b7-45cc-abe6-f63d7254cfa8"). InnerVolumeSpecName "lib-modules". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:08.347385 master-0 kubenswrapper[35367]: I1204 12:22:08.347338 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-sys" (OuterVolumeSpecName: "sys") pod "7c028dc2-88b7-45cc-abe6-f63d7254cfa8" (UID: "7c028dc2-88b7-45cc-abe6-f63d7254cfa8"). InnerVolumeSpecName "sys". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:08.347912 master-0 kubenswrapper[35367]: I1204 12:22:08.347886 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "7c028dc2-88b7-45cc-abe6-f63d7254cfa8" (UID: "7c028dc2-88b7-45cc-abe6-f63d7254cfa8"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:08.348233 master-0 kubenswrapper[35367]: I1204 12:22:08.348202 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-config-data\") pod \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " Dec 04 12:22:08.350292 master-0 kubenswrapper[35367]: I1204 12:22:08.349643 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-var-locks-cinder\") pod \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " Dec 04 12:22:08.350407 master-0 kubenswrapper[35367]: I1204 12:22:08.350293 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-scripts\") pod \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " Dec 04 12:22:08.350407 master-0 kubenswrapper[35367]: I1204 12:22:08.350335 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z57gs\" (UniqueName: \"kubernetes.io/projected/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-kube-api-access-z57gs\") pod \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " Dec 04 12:22:08.350407 master-0 kubenswrapper[35367]: I1204 12:22:08.350383 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-etc-nvme\") pod \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " Dec 04 12:22:08.350525 master-0 kubenswrapper[35367]: I1204 12:22:08.350443 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-etc-iscsi\") pod \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " Dec 04 12:22:08.350525 master-0 kubenswrapper[35367]: I1204 12:22:08.350494 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-var-lib-cinder\") pod \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " Dec 04 12:22:08.350695 master-0 kubenswrapper[35367]: I1204 12:22:08.350566 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-config-data-custom\") pod \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " Dec 04 12:22:08.350695 master-0 kubenswrapper[35367]: I1204 12:22:08.350651 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-combined-ca-bundle\") pod \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\" (UID: \"7c028dc2-88b7-45cc-abe6-f63d7254cfa8\") " Dec 04 12:22:08.351351 master-0 kubenswrapper[35367]: I1204 12:22:08.349904 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-var-locks-cinder" (OuterVolumeSpecName: "var-locks-cinder") pod "7c028dc2-88b7-45cc-abe6-f63d7254cfa8" (UID: "7c028dc2-88b7-45cc-abe6-f63d7254cfa8"). InnerVolumeSpecName "var-locks-cinder". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:08.351351 master-0 kubenswrapper[35367]: I1204 12:22:08.351175 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-etc-nvme" (OuterVolumeSpecName: "etc-nvme") pod "7c028dc2-88b7-45cc-abe6-f63d7254cfa8" (UID: "7c028dc2-88b7-45cc-abe6-f63d7254cfa8"). InnerVolumeSpecName "etc-nvme". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:08.351351 master-0 kubenswrapper[35367]: I1204 12:22:08.351256 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-var-lib-cinder" (OuterVolumeSpecName: "var-lib-cinder") pod "7c028dc2-88b7-45cc-abe6-f63d7254cfa8" (UID: "7c028dc2-88b7-45cc-abe6-f63d7254cfa8"). InnerVolumeSpecName "var-lib-cinder". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:08.351351 master-0 kubenswrapper[35367]: I1204 12:22:08.351266 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-etc-iscsi" (OuterVolumeSpecName: "etc-iscsi") pod "7c028dc2-88b7-45cc-abe6-f63d7254cfa8" (UID: "7c028dc2-88b7-45cc-abe6-f63d7254cfa8"). InnerVolumeSpecName "etc-iscsi". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:08.357366 master-0 kubenswrapper[35367]: I1204 12:22:08.355088 35367 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-etc-machine-id\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:08.357366 master-0 kubenswrapper[35367]: I1204 12:22:08.355152 35367 reconciler_common.go:293] "Volume detached for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-var-locks-cinder\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:08.357366 master-0 kubenswrapper[35367]: I1204 12:22:08.355166 35367 reconciler_common.go:293] "Volume detached for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-etc-nvme\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:08.357366 master-0 kubenswrapper[35367]: I1204 12:22:08.355180 35367 reconciler_common.go:293] "Volume detached for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-etc-iscsi\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:08.357366 master-0 kubenswrapper[35367]: I1204 12:22:08.355190 35367 reconciler_common.go:293] "Volume detached for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-var-lib-cinder\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:08.357366 master-0 kubenswrapper[35367]: I1204 12:22:08.355199 35367 reconciler_common.go:293] "Volume detached for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-dev\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:08.357366 master-0 kubenswrapper[35367]: I1204 12:22:08.355209 35367 reconciler_common.go:293] "Volume detached for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-run\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:08.357366 master-0 kubenswrapper[35367]: I1204 12:22:08.355219 35367 reconciler_common.go:293] "Volume detached for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-var-locks-brick\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:08.357366 master-0 kubenswrapper[35367]: I1204 12:22:08.355228 35367 reconciler_common.go:293] "Volume detached for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-lib-modules\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:08.357366 master-0 kubenswrapper[35367]: I1204 12:22:08.355237 35367 reconciler_common.go:293] "Volume detached for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-sys\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:08.357366 master-0 kubenswrapper[35367]: I1204 12:22:08.356111 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-scripts" (OuterVolumeSpecName: "scripts") pod "7c028dc2-88b7-45cc-abe6-f63d7254cfa8" (UID: "7c028dc2-88b7-45cc-abe6-f63d7254cfa8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:08.357366 master-0 kubenswrapper[35367]: I1204 12:22:08.357343 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-kube-api-access-z57gs" (OuterVolumeSpecName: "kube-api-access-z57gs") pod "7c028dc2-88b7-45cc-abe6-f63d7254cfa8" (UID: "7c028dc2-88b7-45cc-abe6-f63d7254cfa8"). InnerVolumeSpecName "kube-api-access-z57gs". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:08.360036 master-0 kubenswrapper[35367]: I1204 12:22:08.359981 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "7c028dc2-88b7-45cc-abe6-f63d7254cfa8" (UID: "7c028dc2-88b7-45cc-abe6-f63d7254cfa8"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:08.428744 master-0 kubenswrapper[35367]: I1204 12:22:08.424919 35367 generic.go:334] "Generic (PLEG): container finished" podID="7c028dc2-88b7-45cc-abe6-f63d7254cfa8" containerID="4f98ae1f9d1353c8d7ecbda9131d85c2ee784cb1a3a5c558992ef2d8452e7029" exitCode=0 Dec 04 12:22:08.428744 master-0 kubenswrapper[35367]: I1204 12:22:08.424963 35367 generic.go:334] "Generic (PLEG): container finished" podID="7c028dc2-88b7-45cc-abe6-f63d7254cfa8" containerID="8e49e0ccac73260aa9c691e8e5b190f690e753a9cb2c33c193ca253499325e9f" exitCode=0 Dec 04 12:22:08.428744 master-0 kubenswrapper[35367]: I1204 12:22:08.424984 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-backup-0" event={"ID":"7c028dc2-88b7-45cc-abe6-f63d7254cfa8","Type":"ContainerDied","Data":"4f98ae1f9d1353c8d7ecbda9131d85c2ee784cb1a3a5c558992ef2d8452e7029"} Dec 04 12:22:08.428744 master-0 kubenswrapper[35367]: I1204 12:22:08.425010 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-backup-0" event={"ID":"7c028dc2-88b7-45cc-abe6-f63d7254cfa8","Type":"ContainerDied","Data":"8e49e0ccac73260aa9c691e8e5b190f690e753a9cb2c33c193ca253499325e9f"} Dec 04 12:22:08.428744 master-0 kubenswrapper[35367]: I1204 12:22:08.425022 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-backup-0" event={"ID":"7c028dc2-88b7-45cc-abe6-f63d7254cfa8","Type":"ContainerDied","Data":"e971ab8b3052818304f9734b3bef80738837da85ae5dc60fb0da864883da312e"} Dec 04 12:22:08.428744 master-0 kubenswrapper[35367]: I1204 12:22:08.425037 35367 scope.go:117] "RemoveContainer" containerID="4f98ae1f9d1353c8d7ecbda9131d85c2ee784cb1a3a5c558992ef2d8452e7029" Dec 04 12:22:08.428744 master-0 kubenswrapper[35367]: I1204 12:22:08.425152 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:08.435686 master-0 kubenswrapper[35367]: I1204 12:22:08.435273 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7c028dc2-88b7-45cc-abe6-f63d7254cfa8" (UID: "7c028dc2-88b7-45cc-abe6-f63d7254cfa8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:08.458262 master-0 kubenswrapper[35367]: I1204 12:22:08.458213 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:08.458262 master-0 kubenswrapper[35367]: I1204 12:22:08.458256 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-z57gs\" (UniqueName: \"kubernetes.io/projected/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-kube-api-access-z57gs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:08.458262 master-0 kubenswrapper[35367]: I1204 12:22:08.458267 35367 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-config-data-custom\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:08.458573 master-0 kubenswrapper[35367]: I1204 12:22:08.458277 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:08.464574 master-0 kubenswrapper[35367]: I1204 12:22:08.464513 35367 scope.go:117] "RemoveContainer" containerID="8e49e0ccac73260aa9c691e8e5b190f690e753a9cb2c33c193ca253499325e9f" Dec 04 12:22:08.498641 master-0 kubenswrapper[35367]: I1204 12:22:08.498588 35367 scope.go:117] "RemoveContainer" containerID="4f98ae1f9d1353c8d7ecbda9131d85c2ee784cb1a3a5c558992ef2d8452e7029" Dec 04 12:22:08.499572 master-0 kubenswrapper[35367]: E1204 12:22:08.499525 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f98ae1f9d1353c8d7ecbda9131d85c2ee784cb1a3a5c558992ef2d8452e7029\": container with ID starting with 4f98ae1f9d1353c8d7ecbda9131d85c2ee784cb1a3a5c558992ef2d8452e7029 not found: ID does not exist" containerID="4f98ae1f9d1353c8d7ecbda9131d85c2ee784cb1a3a5c558992ef2d8452e7029" Dec 04 12:22:08.499624 master-0 kubenswrapper[35367]: I1204 12:22:08.499577 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f98ae1f9d1353c8d7ecbda9131d85c2ee784cb1a3a5c558992ef2d8452e7029"} err="failed to get container status \"4f98ae1f9d1353c8d7ecbda9131d85c2ee784cb1a3a5c558992ef2d8452e7029\": rpc error: code = NotFound desc = could not find container \"4f98ae1f9d1353c8d7ecbda9131d85c2ee784cb1a3a5c558992ef2d8452e7029\": container with ID starting with 4f98ae1f9d1353c8d7ecbda9131d85c2ee784cb1a3a5c558992ef2d8452e7029 not found: ID does not exist" Dec 04 12:22:08.499624 master-0 kubenswrapper[35367]: I1204 12:22:08.499611 35367 scope.go:117] "RemoveContainer" containerID="8e49e0ccac73260aa9c691e8e5b190f690e753a9cb2c33c193ca253499325e9f" Dec 04 12:22:08.500087 master-0 kubenswrapper[35367]: E1204 12:22:08.500057 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e49e0ccac73260aa9c691e8e5b190f690e753a9cb2c33c193ca253499325e9f\": container with ID starting with 8e49e0ccac73260aa9c691e8e5b190f690e753a9cb2c33c193ca253499325e9f not found: ID does not exist" containerID="8e49e0ccac73260aa9c691e8e5b190f690e753a9cb2c33c193ca253499325e9f" Dec 04 12:22:08.500128 master-0 kubenswrapper[35367]: I1204 12:22:08.500085 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e49e0ccac73260aa9c691e8e5b190f690e753a9cb2c33c193ca253499325e9f"} err="failed to get container status \"8e49e0ccac73260aa9c691e8e5b190f690e753a9cb2c33c193ca253499325e9f\": rpc error: code = NotFound desc = could not find container \"8e49e0ccac73260aa9c691e8e5b190f690e753a9cb2c33c193ca253499325e9f\": container with ID starting with 8e49e0ccac73260aa9c691e8e5b190f690e753a9cb2c33c193ca253499325e9f not found: ID does not exist" Dec 04 12:22:08.500128 master-0 kubenswrapper[35367]: I1204 12:22:08.500103 35367 scope.go:117] "RemoveContainer" containerID="4f98ae1f9d1353c8d7ecbda9131d85c2ee784cb1a3a5c558992ef2d8452e7029" Dec 04 12:22:08.500461 master-0 kubenswrapper[35367]: I1204 12:22:08.500427 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f98ae1f9d1353c8d7ecbda9131d85c2ee784cb1a3a5c558992ef2d8452e7029"} err="failed to get container status \"4f98ae1f9d1353c8d7ecbda9131d85c2ee784cb1a3a5c558992ef2d8452e7029\": rpc error: code = NotFound desc = could not find container \"4f98ae1f9d1353c8d7ecbda9131d85c2ee784cb1a3a5c558992ef2d8452e7029\": container with ID starting with 4f98ae1f9d1353c8d7ecbda9131d85c2ee784cb1a3a5c558992ef2d8452e7029 not found: ID does not exist" Dec 04 12:22:08.500461 master-0 kubenswrapper[35367]: I1204 12:22:08.500452 35367 scope.go:117] "RemoveContainer" containerID="8e49e0ccac73260aa9c691e8e5b190f690e753a9cb2c33c193ca253499325e9f" Dec 04 12:22:08.500786 master-0 kubenswrapper[35367]: I1204 12:22:08.500748 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e49e0ccac73260aa9c691e8e5b190f690e753a9cb2c33c193ca253499325e9f"} err="failed to get container status \"8e49e0ccac73260aa9c691e8e5b190f690e753a9cb2c33c193ca253499325e9f\": rpc error: code = NotFound desc = could not find container \"8e49e0ccac73260aa9c691e8e5b190f690e753a9cb2c33c193ca253499325e9f\": container with ID starting with 8e49e0ccac73260aa9c691e8e5b190f690e753a9cb2c33c193ca253499325e9f not found: ID does not exist" Dec 04 12:22:08.512945 master-0 kubenswrapper[35367]: I1204 12:22:08.512878 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-config-data" (OuterVolumeSpecName: "config-data") pod "7c028dc2-88b7-45cc-abe6-f63d7254cfa8" (UID: "7c028dc2-88b7-45cc-abe6-f63d7254cfa8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:08.560411 master-0 kubenswrapper[35367]: I1204 12:22:08.560326 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c028dc2-88b7-45cc-abe6-f63d7254cfa8-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:08.726171 master-0 kubenswrapper[35367]: I1204 12:22:08.726080 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-0c69e-volume-lvm-iscsi-0"] Dec 04 12:22:08.739900 master-0 kubenswrapper[35367]: W1204 12:22:08.739795 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3e0fd68_8367_46c5_b57d_a9ec6c21188f.slice/crio-ad0c05432f4ae9b158b84ce605e2919e60c56490b7c607ca38e24a8cfe77fcd9 WatchSource:0}: Error finding container ad0c05432f4ae9b158b84ce605e2919e60c56490b7c607ca38e24a8cfe77fcd9: Status 404 returned error can't find the container with id ad0c05432f4ae9b158b84ce605e2919e60c56490b7c607ca38e24a8cfe77fcd9 Dec 04 12:22:08.785951 master-0 kubenswrapper[35367]: I1204 12:22:08.776617 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15d9c3a0-4909-4282-8eb3-8d7a7faafd50" path="/var/lib/kubelet/pods/15d9c3a0-4909-4282-8eb3-8d7a7faafd50/volumes" Dec 04 12:22:08.785951 master-0 kubenswrapper[35367]: I1204 12:22:08.778472 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d" path="/var/lib/kubelet/pods/bfaa1c4e-58d6-4a96-b29b-6ecb0203b23d/volumes" Dec 04 12:22:08.813035 master-0 kubenswrapper[35367]: I1204 12:22:08.812907 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-0c69e-backup-0"] Dec 04 12:22:08.836525 master-0 kubenswrapper[35367]: I1204 12:22:08.836401 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/cinder-0c69e-backup-0"] Dec 04 12:22:08.866295 master-0 kubenswrapper[35367]: I1204 12:22:08.865709 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-0c69e-backup-0"] Dec 04 12:22:08.868858 master-0 kubenswrapper[35367]: E1204 12:22:08.868400 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7c028dc2-88b7-45cc-abe6-f63d7254cfa8" containerName="cinder-backup" Dec 04 12:22:08.868858 master-0 kubenswrapper[35367]: I1204 12:22:08.868446 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c028dc2-88b7-45cc-abe6-f63d7254cfa8" containerName="cinder-backup" Dec 04 12:22:08.868858 master-0 kubenswrapper[35367]: E1204 12:22:08.868475 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7c028dc2-88b7-45cc-abe6-f63d7254cfa8" containerName="probe" Dec 04 12:22:08.868858 master-0 kubenswrapper[35367]: I1204 12:22:08.868486 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c028dc2-88b7-45cc-abe6-f63d7254cfa8" containerName="probe" Dec 04 12:22:08.869989 master-0 kubenswrapper[35367]: I1204 12:22:08.869933 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="7c028dc2-88b7-45cc-abe6-f63d7254cfa8" containerName="cinder-backup" Dec 04 12:22:08.870215 master-0 kubenswrapper[35367]: I1204 12:22:08.870197 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="7c028dc2-88b7-45cc-abe6-f63d7254cfa8" containerName="probe" Dec 04 12:22:08.875198 master-0 kubenswrapper[35367]: I1204 12:22:08.875160 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:08.879995 master-0 kubenswrapper[35367]: I1204 12:22:08.878297 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-0c69e-backup-config-data" Dec 04 12:22:08.930649 master-0 kubenswrapper[35367]: I1204 12:22:08.930552 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-0c69e-backup-0"] Dec 04 12:22:08.973714 master-0 kubenswrapper[35367]: I1204 12:22:08.973621 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-dev\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:08.973714 master-0 kubenswrapper[35367]: I1204 12:22:08.973706 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-etc-nvme\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:08.974397 master-0 kubenswrapper[35367]: I1204 12:22:08.973736 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a3dabcca-0c5e-4068-b7de-ede07416b452-config-data-custom\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:08.974397 master-0 kubenswrapper[35367]: I1204 12:22:08.973883 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xddt5\" (UniqueName: \"kubernetes.io/projected/a3dabcca-0c5e-4068-b7de-ede07416b452-kube-api-access-xddt5\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:08.974397 master-0 kubenswrapper[35367]: I1204 12:22:08.974276 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-var-locks-cinder\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:08.974652 master-0 kubenswrapper[35367]: I1204 12:22:08.974539 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-run\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:08.974844 master-0 kubenswrapper[35367]: I1204 12:22:08.974734 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-etc-iscsi\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:08.975036 master-0 kubenswrapper[35367]: I1204 12:22:08.974964 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-etc-machine-id\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:08.975097 master-0 kubenswrapper[35367]: I1204 12:22:08.975083 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-sys\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:08.975162 master-0 kubenswrapper[35367]: I1204 12:22:08.975144 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-var-locks-brick\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:08.975388 master-0 kubenswrapper[35367]: I1204 12:22:08.975323 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a3dabcca-0c5e-4068-b7de-ede07416b452-scripts\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:08.975453 master-0 kubenswrapper[35367]: I1204 12:22:08.975406 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-lib-modules\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:08.975453 master-0 kubenswrapper[35367]: I1204 12:22:08.975434 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a3dabcca-0c5e-4068-b7de-ede07416b452-config-data\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:08.975776 master-0 kubenswrapper[35367]: I1204 12:22:08.975699 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-var-lib-cinder\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:08.975776 master-0 kubenswrapper[35367]: I1204 12:22:08.975744 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3dabcca-0c5e-4068-b7de-ede07416b452-combined-ca-bundle\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.078722 master-0 kubenswrapper[35367]: I1204 12:22:09.078655 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-etc-machine-id\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.079005 master-0 kubenswrapper[35367]: I1204 12:22:09.078763 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-sys\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.079005 master-0 kubenswrapper[35367]: I1204 12:22:09.078946 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-etc-machine-id\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.079005 master-0 kubenswrapper[35367]: I1204 12:22:09.078988 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-var-locks-brick\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.079156 master-0 kubenswrapper[35367]: I1204 12:22:09.078926 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-sys\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.079156 master-0 kubenswrapper[35367]: I1204 12:22:09.079099 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-var-locks-brick\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.079156 master-0 kubenswrapper[35367]: I1204 12:22:09.079072 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a3dabcca-0c5e-4068-b7de-ede07416b452-scripts\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.079301 master-0 kubenswrapper[35367]: I1204 12:22:09.079177 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-lib-modules\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.079301 master-0 kubenswrapper[35367]: I1204 12:22:09.079244 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a3dabcca-0c5e-4068-b7de-ede07416b452-config-data\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.079301 master-0 kubenswrapper[35367]: I1204 12:22:09.079252 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-lib-modules\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.079567 master-0 kubenswrapper[35367]: I1204 12:22:09.079503 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-var-lib-cinder\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.079641 master-0 kubenswrapper[35367]: I1204 12:22:09.079615 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-var-lib-cinder\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.079723 master-0 kubenswrapper[35367]: I1204 12:22:09.079696 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3dabcca-0c5e-4068-b7de-ede07416b452-combined-ca-bundle\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.080384 master-0 kubenswrapper[35367]: I1204 12:22:09.080341 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-dev\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.080460 master-0 kubenswrapper[35367]: I1204 12:22:09.080385 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-etc-nvme\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.080460 master-0 kubenswrapper[35367]: I1204 12:22:09.080424 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a3dabcca-0c5e-4068-b7de-ede07416b452-config-data-custom\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.080630 master-0 kubenswrapper[35367]: I1204 12:22:09.080565 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-dev\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.081067 master-0 kubenswrapper[35367]: I1204 12:22:09.081020 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-etc-nvme\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.081141 master-0 kubenswrapper[35367]: I1204 12:22:09.081066 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xddt5\" (UniqueName: \"kubernetes.io/projected/a3dabcca-0c5e-4068-b7de-ede07416b452-kube-api-access-xddt5\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.081193 master-0 kubenswrapper[35367]: I1204 12:22:09.081153 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-var-locks-cinder\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.081467 master-0 kubenswrapper[35367]: I1204 12:22:09.081414 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-run\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.081559 master-0 kubenswrapper[35367]: I1204 12:22:09.081530 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-etc-iscsi\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.081637 master-0 kubenswrapper[35367]: I1204 12:22:09.081563 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-var-locks-cinder\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.081730 master-0 kubenswrapper[35367]: I1204 12:22:09.081684 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-run\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.081855 master-0 kubenswrapper[35367]: I1204 12:22:09.081819 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/a3dabcca-0c5e-4068-b7de-ede07416b452-etc-iscsi\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.085897 master-0 kubenswrapper[35367]: I1204 12:22:09.085492 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a3dabcca-0c5e-4068-b7de-ede07416b452-config-data-custom\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.086667 master-0 kubenswrapper[35367]: I1204 12:22:09.086533 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3dabcca-0c5e-4068-b7de-ede07416b452-combined-ca-bundle\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.086667 master-0 kubenswrapper[35367]: I1204 12:22:09.086515 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a3dabcca-0c5e-4068-b7de-ede07416b452-config-data\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.093248 master-0 kubenswrapper[35367]: I1204 12:22:09.093161 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a3dabcca-0c5e-4068-b7de-ede07416b452-scripts\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.101911 master-0 kubenswrapper[35367]: I1204 12:22:09.101780 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xddt5\" (UniqueName: \"kubernetes.io/projected/a3dabcca-0c5e-4068-b7de-ede07416b452-kube-api-access-xddt5\") pod \"cinder-0c69e-backup-0\" (UID: \"a3dabcca-0c5e-4068-b7de-ede07416b452\") " pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.378330 master-0 kubenswrapper[35367]: I1204 12:22:09.378247 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:09.452879 master-0 kubenswrapper[35367]: I1204 12:22:09.452771 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" event={"ID":"b3e0fd68-8367-46c5-b57d-a9ec6c21188f","Type":"ContainerStarted","Data":"6cdef463e53ae81b3c8f3575afaf6a6d5d27f1b89f6af6d91aa393c272f2fb17"} Dec 04 12:22:09.452879 master-0 kubenswrapper[35367]: I1204 12:22:09.452853 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" event={"ID":"b3e0fd68-8367-46c5-b57d-a9ec6c21188f","Type":"ContainerStarted","Data":"ad0c05432f4ae9b158b84ce605e2919e60c56490b7c607ca38e24a8cfe77fcd9"} Dec 04 12:22:09.456160 master-0 kubenswrapper[35367]: I1204 12:22:09.456098 35367 generic.go:334] "Generic (PLEG): container finished" podID="0a783310-4355-49c9-9962-b5741fb70344" containerID="9ae87b2a13c6c4f282d04d0f5101650aa41112f61ff0576a09c80efc508b16ec" exitCode=0 Dec 04 12:22:09.456160 master-0 kubenswrapper[35367]: I1204 12:22:09.456145 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-db-sync-ql68f" event={"ID":"0a783310-4355-49c9-9962-b5741fb70344","Type":"ContainerDied","Data":"9ae87b2a13c6c4f282d04d0f5101650aa41112f61ff0576a09c80efc508b16ec"} Dec 04 12:22:10.011844 master-0 kubenswrapper[35367]: W1204 12:22:10.011753 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3dabcca_0c5e_4068_b7de_ede07416b452.slice/crio-faf3215ba449c0a519bc1e814f645c6b37937ea5e315058b8dd62cfc6863e0dc WatchSource:0}: Error finding container faf3215ba449c0a519bc1e814f645c6b37937ea5e315058b8dd62cfc6863e0dc: Status 404 returned error can't find the container with id faf3215ba449c0a519bc1e814f645c6b37937ea5e315058b8dd62cfc6863e0dc Dec 04 12:22:10.013662 master-0 kubenswrapper[35367]: I1204 12:22:10.013631 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-0c69e-backup-0"] Dec 04 12:22:10.522048 master-0 kubenswrapper[35367]: I1204 12:22:10.521975 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" event={"ID":"b3e0fd68-8367-46c5-b57d-a9ec6c21188f","Type":"ContainerStarted","Data":"3be9d0eb7661cd7a7ca7d37a7a29228137e7411a726657f06119dce88548ac91"} Dec 04 12:22:10.531114 master-0 kubenswrapper[35367]: I1204 12:22:10.531059 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-backup-0" event={"ID":"a3dabcca-0c5e-4068-b7de-ede07416b452","Type":"ContainerStarted","Data":"0b2c9030d40333809e44b13679f23e093a1edd97b49925278ea18fa57c4121e1"} Dec 04 12:22:10.531114 master-0 kubenswrapper[35367]: I1204 12:22:10.531108 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-backup-0" event={"ID":"a3dabcca-0c5e-4068-b7de-ede07416b452","Type":"ContainerStarted","Data":"faf3215ba449c0a519bc1e814f645c6b37937ea5e315058b8dd62cfc6863e0dc"} Dec 04 12:22:10.567671 master-0 kubenswrapper[35367]: I1204 12:22:10.566855 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" podStartSLOduration=3.566829369 podStartE2EDuration="3.566829369s" podCreationTimestamp="2025-12-04 12:22:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:22:10.561830272 +0000 UTC m=+1373.999891530" watchObservedRunningTime="2025-12-04 12:22:10.566829369 +0000 UTC m=+1374.004890627" Dec 04 12:22:10.794127 master-0 kubenswrapper[35367]: I1204 12:22:10.788603 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c028dc2-88b7-45cc-abe6-f63d7254cfa8" path="/var/lib/kubelet/pods/7c028dc2-88b7-45cc-abe6-f63d7254cfa8/volumes" Dec 04 12:22:11.158835 master-0 kubenswrapper[35367]: I1204 12:22:11.157839 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-db-sync-ql68f" Dec 04 12:22:11.275644 master-0 kubenswrapper[35367]: I1204 12:22:11.275585 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a783310-4355-49c9-9962-b5741fb70344-scripts\") pod \"0a783310-4355-49c9-9962-b5741fb70344\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " Dec 04 12:22:11.275644 master-0 kubenswrapper[35367]: I1204 12:22:11.275665 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a783310-4355-49c9-9962-b5741fb70344-config-data\") pod \"0a783310-4355-49c9-9962-b5741fb70344\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " Dec 04 12:22:11.275979 master-0 kubenswrapper[35367]: I1204 12:22:11.275875 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grxd9\" (UniqueName: \"kubernetes.io/projected/0a783310-4355-49c9-9962-b5741fb70344-kube-api-access-grxd9\") pod \"0a783310-4355-49c9-9962-b5741fb70344\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " Dec 04 12:22:11.276054 master-0 kubenswrapper[35367]: I1204 12:22:11.276036 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/0a783310-4355-49c9-9962-b5741fb70344-config-data-merged\") pod \"0a783310-4355-49c9-9962-b5741fb70344\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " Dec 04 12:22:11.276128 master-0 kubenswrapper[35367]: I1204 12:22:11.276072 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a783310-4355-49c9-9962-b5741fb70344-combined-ca-bundle\") pod \"0a783310-4355-49c9-9962-b5741fb70344\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " Dec 04 12:22:11.276202 master-0 kubenswrapper[35367]: I1204 12:22:11.276173 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a783310-4355-49c9-9962-b5741fb70344-etc-podinfo\") pod \"0a783310-4355-49c9-9962-b5741fb70344\" (UID: \"0a783310-4355-49c9-9962-b5741fb70344\") " Dec 04 12:22:11.278962 master-0 kubenswrapper[35367]: I1204 12:22:11.278892 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a783310-4355-49c9-9962-b5741fb70344-config-data-merged" (OuterVolumeSpecName: "config-data-merged") pod "0a783310-4355-49c9-9962-b5741fb70344" (UID: "0a783310-4355-49c9-9962-b5741fb70344"). InnerVolumeSpecName "config-data-merged". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:22:11.282792 master-0 kubenswrapper[35367]: I1204 12:22:11.282629 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0a783310-4355-49c9-9962-b5741fb70344-etc-podinfo" (OuterVolumeSpecName: "etc-podinfo") pod "0a783310-4355-49c9-9962-b5741fb70344" (UID: "0a783310-4355-49c9-9962-b5741fb70344"). InnerVolumeSpecName "etc-podinfo". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Dec 04 12:22:11.344848 master-0 kubenswrapper[35367]: I1204 12:22:11.306072 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a783310-4355-49c9-9962-b5741fb70344-scripts" (OuterVolumeSpecName: "scripts") pod "0a783310-4355-49c9-9962-b5741fb70344" (UID: "0a783310-4355-49c9-9962-b5741fb70344"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:11.344848 master-0 kubenswrapper[35367]: I1204 12:22:11.306261 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a783310-4355-49c9-9962-b5741fb70344-kube-api-access-grxd9" (OuterVolumeSpecName: "kube-api-access-grxd9") pod "0a783310-4355-49c9-9962-b5741fb70344" (UID: "0a783310-4355-49c9-9962-b5741fb70344"). InnerVolumeSpecName "kube-api-access-grxd9". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:11.393834 master-0 kubenswrapper[35367]: I1204 12:22:11.384823 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-grxd9\" (UniqueName: \"kubernetes.io/projected/0a783310-4355-49c9-9962-b5741fb70344-kube-api-access-grxd9\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:11.393834 master-0 kubenswrapper[35367]: I1204 12:22:11.384886 35367 reconciler_common.go:293] "Volume detached for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/0a783310-4355-49c9-9962-b5741fb70344-config-data-merged\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:11.393834 master-0 kubenswrapper[35367]: I1204 12:22:11.384896 35367 reconciler_common.go:293] "Volume detached for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a783310-4355-49c9-9962-b5741fb70344-etc-podinfo\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:11.393834 master-0 kubenswrapper[35367]: I1204 12:22:11.384905 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a783310-4355-49c9-9962-b5741fb70344-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:11.424841 master-0 kubenswrapper[35367]: I1204 12:22:11.421484 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a783310-4355-49c9-9962-b5741fb70344-config-data" (OuterVolumeSpecName: "config-data") pod "0a783310-4355-49c9-9962-b5741fb70344" (UID: "0a783310-4355-49c9-9962-b5741fb70344"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:11.438240 master-0 kubenswrapper[35367]: I1204 12:22:11.438025 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a783310-4355-49c9-9962-b5741fb70344-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0a783310-4355-49c9-9962-b5741fb70344" (UID: "0a783310-4355-49c9-9962-b5741fb70344"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:11.491982 master-0 kubenswrapper[35367]: I1204 12:22:11.490908 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a783310-4355-49c9-9962-b5741fb70344-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:11.491982 master-0 kubenswrapper[35367]: I1204 12:22:11.490979 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a783310-4355-49c9-9962-b5741fb70344-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:11.566839 master-0 kubenswrapper[35367]: I1204 12:22:11.565819 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-db-sync-ql68f" event={"ID":"0a783310-4355-49c9-9962-b5741fb70344","Type":"ContainerDied","Data":"c2a276bb307f155cad90d73d8e7b55be2abd7ac505da9dac1f553991244ffcc2"} Dec 04 12:22:11.566839 master-0 kubenswrapper[35367]: I1204 12:22:11.565868 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2a276bb307f155cad90d73d8e7b55be2abd7ac505da9dac1f553991244ffcc2" Dec 04 12:22:11.566839 master-0 kubenswrapper[35367]: I1204 12:22:11.565938 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-db-sync-ql68f" Dec 04 12:22:11.577973 master-0 kubenswrapper[35367]: I1204 12:22:11.575373 35367 generic.go:334] "Generic (PLEG): container finished" podID="93ed4f64-900a-44ba-b838-82e0594a1809" containerID="36b4cff5b4c7b42d714a33878fd694e7c27f69ae3ce3538b8dbf835c4687beb3" exitCode=0 Dec 04 12:22:11.577973 master-0 kubenswrapper[35367]: I1204 12:22:11.575461 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-scheduler-0" event={"ID":"93ed4f64-900a-44ba-b838-82e0594a1809","Type":"ContainerDied","Data":"36b4cff5b4c7b42d714a33878fd694e7c27f69ae3ce3538b8dbf835c4687beb3"} Dec 04 12:22:11.606159 master-0 kubenswrapper[35367]: I1204 12:22:11.584425 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-backup-0" event={"ID":"a3dabcca-0c5e-4068-b7de-ede07416b452","Type":"ContainerStarted","Data":"7818be5d1db60eb05f483d531ad0bd0641766ddd4bb998160d217598961f278c"} Dec 04 12:22:11.627843 master-0 kubenswrapper[35367]: I1204 12:22:11.620306 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-0c69e-backup-0" podStartSLOduration=3.620288833 podStartE2EDuration="3.620288833s" podCreationTimestamp="2025-12-04 12:22:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:22:11.617148394 +0000 UTC m=+1375.055209642" watchObservedRunningTime="2025-12-04 12:22:11.620288833 +0000 UTC m=+1375.058350091" Dec 04 12:22:11.997833 master-0 kubenswrapper[35367]: I1204 12:22:11.996956 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-inspector-db-create-2vlsx"] Dec 04 12:22:12.006833 master-0 kubenswrapper[35367]: E1204 12:22:11.999048 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0a783310-4355-49c9-9962-b5741fb70344" containerName="init" Dec 04 12:22:12.006833 master-0 kubenswrapper[35367]: I1204 12:22:11.999088 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a783310-4355-49c9-9962-b5741fb70344" containerName="init" Dec 04 12:22:12.006833 master-0 kubenswrapper[35367]: E1204 12:22:11.999177 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0a783310-4355-49c9-9962-b5741fb70344" containerName="ironic-db-sync" Dec 04 12:22:12.006833 master-0 kubenswrapper[35367]: I1204 12:22:11.999193 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a783310-4355-49c9-9962-b5741fb70344" containerName="ironic-db-sync" Dec 04 12:22:12.071841 master-0 kubenswrapper[35367]: I1204 12:22:12.066343 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="0a783310-4355-49c9-9962-b5741fb70344" containerName="ironic-db-sync" Dec 04 12:22:12.071841 master-0 kubenswrapper[35367]: I1204 12:22:12.068441 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/placement-99465d558-ft78w" Dec 04 12:22:12.071841 master-0 kubenswrapper[35367]: I1204 12:22:12.071794 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-db-create-2vlsx" Dec 04 12:22:12.122980 master-0 kubenswrapper[35367]: I1204 12:22:12.115721 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-inspector-db-create-2vlsx"] Dec 04 12:22:12.122980 master-0 kubenswrapper[35367]: I1204 12:22:12.118516 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:12.214835 master-0 kubenswrapper[35367]: I1204 12:22:12.199201 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-inspector-d6e5-account-create-update-w8hkj"] Dec 04 12:22:12.214835 master-0 kubenswrapper[35367]: E1204 12:22:12.199851 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="93ed4f64-900a-44ba-b838-82e0594a1809" containerName="cinder-scheduler" Dec 04 12:22:12.214835 master-0 kubenswrapper[35367]: I1204 12:22:12.199866 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="93ed4f64-900a-44ba-b838-82e0594a1809" containerName="cinder-scheduler" Dec 04 12:22:12.214835 master-0 kubenswrapper[35367]: E1204 12:22:12.199889 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="93ed4f64-900a-44ba-b838-82e0594a1809" containerName="probe" Dec 04 12:22:12.214835 master-0 kubenswrapper[35367]: I1204 12:22:12.199896 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="93ed4f64-900a-44ba-b838-82e0594a1809" containerName="probe" Dec 04 12:22:12.214835 master-0 kubenswrapper[35367]: I1204 12:22:12.200146 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="93ed4f64-900a-44ba-b838-82e0594a1809" containerName="cinder-scheduler" Dec 04 12:22:12.214835 master-0 kubenswrapper[35367]: I1204 12:22:12.200165 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="93ed4f64-900a-44ba-b838-82e0594a1809" containerName="probe" Dec 04 12:22:12.225035 master-0 kubenswrapper[35367]: I1204 12:22:12.219152 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-combined-ca-bundle\") pod \"93ed4f64-900a-44ba-b838-82e0594a1809\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " Dec 04 12:22:12.225035 master-0 kubenswrapper[35367]: I1204 12:22:12.219268 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/93ed4f64-900a-44ba-b838-82e0594a1809-etc-machine-id\") pod \"93ed4f64-900a-44ba-b838-82e0594a1809\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " Dec 04 12:22:12.225035 master-0 kubenswrapper[35367]: I1204 12:22:12.219627 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-scripts\") pod \"93ed4f64-900a-44ba-b838-82e0594a1809\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " Dec 04 12:22:12.225035 master-0 kubenswrapper[35367]: I1204 12:22:12.219687 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pljhx\" (UniqueName: \"kubernetes.io/projected/93ed4f64-900a-44ba-b838-82e0594a1809-kube-api-access-pljhx\") pod \"93ed4f64-900a-44ba-b838-82e0594a1809\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " Dec 04 12:22:12.225035 master-0 kubenswrapper[35367]: I1204 12:22:12.219729 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-config-data\") pod \"93ed4f64-900a-44ba-b838-82e0594a1809\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " Dec 04 12:22:12.225035 master-0 kubenswrapper[35367]: I1204 12:22:12.219794 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-config-data-custom\") pod \"93ed4f64-900a-44ba-b838-82e0594a1809\" (UID: \"93ed4f64-900a-44ba-b838-82e0594a1809\") " Dec 04 12:22:12.292855 master-0 kubenswrapper[35367]: I1204 12:22:12.284155 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f01f664c-8d89-44ae-a467-fed3c2c32855-operator-scripts\") pod \"ironic-inspector-db-create-2vlsx\" (UID: \"f01f664c-8d89-44ae-a467-fed3c2c32855\") " pod="openstack/ironic-inspector-db-create-2vlsx" Dec 04 12:22:12.292855 master-0 kubenswrapper[35367]: I1204 12:22:12.284625 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzv9l\" (UniqueName: \"kubernetes.io/projected/f01f664c-8d89-44ae-a467-fed3c2c32855-kube-api-access-gzv9l\") pod \"ironic-inspector-db-create-2vlsx\" (UID: \"f01f664c-8d89-44ae-a467-fed3c2c32855\") " pod="openstack/ironic-inspector-db-create-2vlsx" Dec 04 12:22:12.292855 master-0 kubenswrapper[35367]: I1204 12:22:12.274961 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-inspector-d6e5-account-create-update-w8hkj"] Dec 04 12:22:12.292855 master-0 kubenswrapper[35367]: I1204 12:22:12.220077 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-d6e5-account-create-update-w8hkj" Dec 04 12:22:12.292855 master-0 kubenswrapper[35367]: I1204 12:22:12.225988 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-scripts" (OuterVolumeSpecName: "scripts") pod "93ed4f64-900a-44ba-b838-82e0594a1809" (UID: "93ed4f64-900a-44ba-b838-82e0594a1809"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:12.292855 master-0 kubenswrapper[35367]: I1204 12:22:12.226966 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/93ed4f64-900a-44ba-b838-82e0594a1809-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "93ed4f64-900a-44ba-b838-82e0594a1809" (UID: "93ed4f64-900a-44ba-b838-82e0594a1809"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:22:12.292855 master-0 kubenswrapper[35367]: I1204 12:22:12.254405 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93ed4f64-900a-44ba-b838-82e0594a1809-kube-api-access-pljhx" (OuterVolumeSpecName: "kube-api-access-pljhx") pod "93ed4f64-900a-44ba-b838-82e0594a1809" (UID: "93ed4f64-900a-44ba-b838-82e0594a1809"). InnerVolumeSpecName "kube-api-access-pljhx". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:12.292855 master-0 kubenswrapper[35367]: I1204 12:22:12.255448 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "93ed4f64-900a-44ba-b838-82e0594a1809" (UID: "93ed4f64-900a-44ba-b838-82e0594a1809"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:12.294567 master-0 kubenswrapper[35367]: I1204 12:22:12.293497 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-inspector-db-secret" Dec 04 12:22:12.390605 master-0 kubenswrapper[35367]: I1204 12:22:12.384329 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-neutron-agent-776b955f8c-hd9lh"] Dec 04 12:22:12.390605 master-0 kubenswrapper[35367]: I1204 12:22:12.386081 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "93ed4f64-900a-44ba-b838-82e0594a1809" (UID: "93ed4f64-900a-44ba-b838-82e0594a1809"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:12.390605 master-0 kubenswrapper[35367]: I1204 12:22:12.386999 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" Dec 04 12:22:12.390605 master-0 kubenswrapper[35367]: I1204 12:22:12.390420 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-ironic-neutron-agent-config-data" Dec 04 12:22:12.414065 master-0 kubenswrapper[35367]: I1204 12:22:12.414009 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f01f664c-8d89-44ae-a467-fed3c2c32855-operator-scripts\") pod \"ironic-inspector-db-create-2vlsx\" (UID: \"f01f664c-8d89-44ae-a467-fed3c2c32855\") " pod="openstack/ironic-inspector-db-create-2vlsx" Dec 04 12:22:12.414946 master-0 kubenswrapper[35367]: I1204 12:22:12.414771 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/42c0c08e-5eb9-4e64-b523-363d39eff4c9-operator-scripts\") pod \"ironic-inspector-d6e5-account-create-update-w8hkj\" (UID: \"42c0c08e-5eb9-4e64-b523-363d39eff4c9\") " pod="openstack/ironic-inspector-d6e5-account-create-update-w8hkj" Dec 04 12:22:12.415239 master-0 kubenswrapper[35367]: I1204 12:22:12.415218 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gzv9l\" (UniqueName: \"kubernetes.io/projected/f01f664c-8d89-44ae-a467-fed3c2c32855-kube-api-access-gzv9l\") pod \"ironic-inspector-db-create-2vlsx\" (UID: \"f01f664c-8d89-44ae-a467-fed3c2c32855\") " pod="openstack/ironic-inspector-db-create-2vlsx" Dec 04 12:22:12.415584 master-0 kubenswrapper[35367]: I1204 12:22:12.415567 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tslcw\" (UniqueName: \"kubernetes.io/projected/42c0c08e-5eb9-4e64-b523-363d39eff4c9-kube-api-access-tslcw\") pod \"ironic-inspector-d6e5-account-create-update-w8hkj\" (UID: \"42c0c08e-5eb9-4e64-b523-363d39eff4c9\") " pod="openstack/ironic-inspector-d6e5-account-create-update-w8hkj" Dec 04 12:22:12.415844 master-0 kubenswrapper[35367]: I1204 12:22:12.415829 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:12.415973 master-0 kubenswrapper[35367]: I1204 12:22:12.415952 35367 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/93ed4f64-900a-44ba-b838-82e0594a1809-etc-machine-id\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:12.416069 master-0 kubenswrapper[35367]: I1204 12:22:12.416055 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:12.416151 master-0 kubenswrapper[35367]: I1204 12:22:12.416137 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pljhx\" (UniqueName: \"kubernetes.io/projected/93ed4f64-900a-44ba-b838-82e0594a1809-kube-api-access-pljhx\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:12.416244 master-0 kubenswrapper[35367]: I1204 12:22:12.416227 35367 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-config-data-custom\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:12.416321 master-0 kubenswrapper[35367]: I1204 12:22:12.416093 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f01f664c-8d89-44ae-a467-fed3c2c32855-operator-scripts\") pod \"ironic-inspector-db-create-2vlsx\" (UID: \"f01f664c-8d89-44ae-a467-fed3c2c32855\") " pod="openstack/ironic-inspector-db-create-2vlsx" Dec 04 12:22:12.416414 master-0 kubenswrapper[35367]: I1204 12:22:12.414907 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-neutron-agent-776b955f8c-hd9lh"] Dec 04 12:22:12.448068 master-0 kubenswrapper[35367]: I1204 12:22:12.447751 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/placement-99465d558-ft78w" Dec 04 12:22:12.489848 master-0 kubenswrapper[35367]: I1204 12:22:12.472973 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-798989f845-tfbmz"] Dec 04 12:22:12.494478 master-0 kubenswrapper[35367]: I1204 12:22:12.492454 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:12.504378 master-0 kubenswrapper[35367]: I1204 12:22:12.498894 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-798989f845-tfbmz"] Dec 04 12:22:12.508461 master-0 kubenswrapper[35367]: I1204 12:22:12.508419 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzv9l\" (UniqueName: \"kubernetes.io/projected/f01f664c-8d89-44ae-a467-fed3c2c32855-kube-api-access-gzv9l\") pod \"ironic-inspector-db-create-2vlsx\" (UID: \"f01f664c-8d89-44ae-a467-fed3c2c32855\") " pod="openstack/ironic-inspector-db-create-2vlsx" Dec 04 12:22:12.519179 master-0 kubenswrapper[35367]: I1204 12:22:12.518832 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-db-create-2vlsx" Dec 04 12:22:12.524454 master-0 kubenswrapper[35367]: I1204 12:22:12.521693 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-dns-svc\") pod \"dnsmasq-dns-798989f845-tfbmz\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:12.524454 master-0 kubenswrapper[35367]: I1204 12:22:12.521747 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60937ace-8171-4692-a7a8-75df15eeb551-combined-ca-bundle\") pod \"ironic-neutron-agent-776b955f8c-hd9lh\" (UID: \"60937ace-8171-4692-a7a8-75df15eeb551\") " pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" Dec 04 12:22:12.524454 master-0 kubenswrapper[35367]: I1204 12:22:12.521789 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tslcw\" (UniqueName: \"kubernetes.io/projected/42c0c08e-5eb9-4e64-b523-363d39eff4c9-kube-api-access-tslcw\") pod \"ironic-inspector-d6e5-account-create-update-w8hkj\" (UID: \"42c0c08e-5eb9-4e64-b523-363d39eff4c9\") " pod="openstack/ironic-inspector-d6e5-account-create-update-w8hkj" Dec 04 12:22:12.524454 master-0 kubenswrapper[35367]: I1204 12:22:12.522010 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/60937ace-8171-4692-a7a8-75df15eeb551-config\") pod \"ironic-neutron-agent-776b955f8c-hd9lh\" (UID: \"60937ace-8171-4692-a7a8-75df15eeb551\") " pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" Dec 04 12:22:12.524454 master-0 kubenswrapper[35367]: I1204 12:22:12.522049 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-dns-swift-storage-0\") pod \"dnsmasq-dns-798989f845-tfbmz\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:12.524454 master-0 kubenswrapper[35367]: I1204 12:22:12.522102 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwfmd\" (UniqueName: \"kubernetes.io/projected/0a6ed281-8138-49a1-b433-ff5813e6562b-kube-api-access-cwfmd\") pod \"dnsmasq-dns-798989f845-tfbmz\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:12.524454 master-0 kubenswrapper[35367]: I1204 12:22:12.522143 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/42c0c08e-5eb9-4e64-b523-363d39eff4c9-operator-scripts\") pod \"ironic-inspector-d6e5-account-create-update-w8hkj\" (UID: \"42c0c08e-5eb9-4e64-b523-363d39eff4c9\") " pod="openstack/ironic-inspector-d6e5-account-create-update-w8hkj" Dec 04 12:22:12.524454 master-0 kubenswrapper[35367]: I1204 12:22:12.522171 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-ovsdbserver-nb\") pod \"dnsmasq-dns-798989f845-tfbmz\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:12.524454 master-0 kubenswrapper[35367]: I1204 12:22:12.522192 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-config\") pod \"dnsmasq-dns-798989f845-tfbmz\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:12.524454 master-0 kubenswrapper[35367]: I1204 12:22:12.522230 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-ovsdbserver-sb\") pod \"dnsmasq-dns-798989f845-tfbmz\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:12.524454 master-0 kubenswrapper[35367]: I1204 12:22:12.522253 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjbck\" (UniqueName: \"kubernetes.io/projected/60937ace-8171-4692-a7a8-75df15eeb551-kube-api-access-bjbck\") pod \"ironic-neutron-agent-776b955f8c-hd9lh\" (UID: \"60937ace-8171-4692-a7a8-75df15eeb551\") " pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" Dec 04 12:22:12.541890 master-0 kubenswrapper[35367]: I1204 12:22:12.533685 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/42c0c08e-5eb9-4e64-b523-363d39eff4c9-operator-scripts\") pod \"ironic-inspector-d6e5-account-create-update-w8hkj\" (UID: \"42c0c08e-5eb9-4e64-b523-363d39eff4c9\") " pod="openstack/ironic-inspector-d6e5-account-create-update-w8hkj" Dec 04 12:22:12.612777 master-0 kubenswrapper[35367]: I1204 12:22:12.611894 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tslcw\" (UniqueName: \"kubernetes.io/projected/42c0c08e-5eb9-4e64-b523-363d39eff4c9-kube-api-access-tslcw\") pod \"ironic-inspector-d6e5-account-create-update-w8hkj\" (UID: \"42c0c08e-5eb9-4e64-b523-363d39eff4c9\") " pod="openstack/ironic-inspector-d6e5-account-create-update-w8hkj" Dec 04 12:22:12.638850 master-0 kubenswrapper[35367]: I1204 12:22:12.636888 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/60937ace-8171-4692-a7a8-75df15eeb551-config\") pod \"ironic-neutron-agent-776b955f8c-hd9lh\" (UID: \"60937ace-8171-4692-a7a8-75df15eeb551\") " pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" Dec 04 12:22:12.638850 master-0 kubenswrapper[35367]: I1204 12:22:12.636971 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-dns-swift-storage-0\") pod \"dnsmasq-dns-798989f845-tfbmz\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:12.638850 master-0 kubenswrapper[35367]: I1204 12:22:12.637018 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cwfmd\" (UniqueName: \"kubernetes.io/projected/0a6ed281-8138-49a1-b433-ff5813e6562b-kube-api-access-cwfmd\") pod \"dnsmasq-dns-798989f845-tfbmz\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:12.638850 master-0 kubenswrapper[35367]: I1204 12:22:12.637057 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-ovsdbserver-nb\") pod \"dnsmasq-dns-798989f845-tfbmz\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:12.638850 master-0 kubenswrapper[35367]: I1204 12:22:12.637084 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-config\") pod \"dnsmasq-dns-798989f845-tfbmz\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:12.638850 master-0 kubenswrapper[35367]: I1204 12:22:12.637116 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-ovsdbserver-sb\") pod \"dnsmasq-dns-798989f845-tfbmz\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:12.649967 master-0 kubenswrapper[35367]: I1204 12:22:12.643669 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-dns-swift-storage-0\") pod \"dnsmasq-dns-798989f845-tfbmz\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:12.649967 master-0 kubenswrapper[35367]: I1204 12:22:12.643750 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-ovsdbserver-nb\") pod \"dnsmasq-dns-798989f845-tfbmz\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:12.649967 master-0 kubenswrapper[35367]: I1204 12:22:12.645788 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-ovsdbserver-sb\") pod \"dnsmasq-dns-798989f845-tfbmz\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:12.649967 master-0 kubenswrapper[35367]: I1204 12:22:12.646293 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-config\") pod \"dnsmasq-dns-798989f845-tfbmz\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:12.649967 master-0 kubenswrapper[35367]: I1204 12:22:12.637135 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bjbck\" (UniqueName: \"kubernetes.io/projected/60937ace-8171-4692-a7a8-75df15eeb551-kube-api-access-bjbck\") pod \"ironic-neutron-agent-776b955f8c-hd9lh\" (UID: \"60937ace-8171-4692-a7a8-75df15eeb551\") " pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" Dec 04 12:22:12.649967 master-0 kubenswrapper[35367]: I1204 12:22:12.648379 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-dns-svc\") pod \"dnsmasq-dns-798989f845-tfbmz\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:12.649967 master-0 kubenswrapper[35367]: I1204 12:22:12.648504 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60937ace-8171-4692-a7a8-75df15eeb551-combined-ca-bundle\") pod \"ironic-neutron-agent-776b955f8c-hd9lh\" (UID: \"60937ace-8171-4692-a7a8-75df15eeb551\") " pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" Dec 04 12:22:12.656213 master-0 kubenswrapper[35367]: I1204 12:22:12.652587 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-dns-svc\") pod \"dnsmasq-dns-798989f845-tfbmz\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:12.669632 master-0 kubenswrapper[35367]: I1204 12:22:12.661073 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/60937ace-8171-4692-a7a8-75df15eeb551-config\") pod \"ironic-neutron-agent-776b955f8c-hd9lh\" (UID: \"60937ace-8171-4692-a7a8-75df15eeb551\") " pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" Dec 04 12:22:12.673341 master-0 kubenswrapper[35367]: I1204 12:22:12.672997 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60937ace-8171-4692-a7a8-75df15eeb551-combined-ca-bundle\") pod \"ironic-neutron-agent-776b955f8c-hd9lh\" (UID: \"60937ace-8171-4692-a7a8-75df15eeb551\") " pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" Dec 04 12:22:12.674411 master-0 kubenswrapper[35367]: I1204 12:22:12.674001 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:12.697451 master-0 kubenswrapper[35367]: I1204 12:22:12.678625 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwfmd\" (UniqueName: \"kubernetes.io/projected/0a6ed281-8138-49a1-b433-ff5813e6562b-kube-api-access-cwfmd\") pod \"dnsmasq-dns-798989f845-tfbmz\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:12.697451 master-0 kubenswrapper[35367]: I1204 12:22:12.680950 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-scheduler-0" event={"ID":"93ed4f64-900a-44ba-b838-82e0594a1809","Type":"ContainerDied","Data":"1a44619f5a802a817c1c6231e1f3cbdb1821284e08e5fde80fbab9c3603c3560"} Dec 04 12:22:12.697451 master-0 kubenswrapper[35367]: I1204 12:22:12.681047 35367 scope.go:117] "RemoveContainer" containerID="e7d2eb4c4326d9328d1019e46d575326b9fece657d1ace703f372512c14290a6" Dec 04 12:22:12.707974 master-0 kubenswrapper[35367]: I1204 12:22:12.707744 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-d6e5-account-create-update-w8hkj" Dec 04 12:22:12.716030 master-0 kubenswrapper[35367]: I1204 12:22:12.714340 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjbck\" (UniqueName: \"kubernetes.io/projected/60937ace-8171-4692-a7a8-75df15eeb551-kube-api-access-bjbck\") pod \"ironic-neutron-agent-776b955f8c-hd9lh\" (UID: \"60937ace-8171-4692-a7a8-75df15eeb551\") " pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" Dec 04 12:22:12.727256 master-0 kubenswrapper[35367]: I1204 12:22:12.726904 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" Dec 04 12:22:12.743314 master-0 kubenswrapper[35367]: I1204 12:22:12.743205 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-5d764777ff-vcxc5"] Dec 04 12:22:12.747388 master-0 kubenswrapper[35367]: I1204 12:22:12.746674 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.756231 master-0 kubenswrapper[35367]: I1204 12:22:12.752036 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-config-data" Dec 04 12:22:12.756231 master-0 kubenswrapper[35367]: I1204 12:22:12.752257 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-api-scripts" Dec 04 12:22:12.756231 master-0 kubenswrapper[35367]: I1204 12:22:12.752731 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-api-config-data" Dec 04 12:22:12.756231 master-0 kubenswrapper[35367]: I1204 12:22:12.754355 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"rabbitmq-transport-url-ironic-transport" Dec 04 12:22:12.756231 master-0 kubenswrapper[35367]: I1204 12:22:12.754510 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-config-data" (OuterVolumeSpecName: "config-data") pod "93ed4f64-900a-44ba-b838-82e0594a1809" (UID: "93ed4f64-900a-44ba-b838-82e0594a1809"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:12.756231 master-0 kubenswrapper[35367]: I1204 12:22:12.756213 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"osp-secret" Dec 04 12:22:12.772346 master-0 kubenswrapper[35367]: I1204 12:22:12.765794 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-config-data-custom\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.772346 master-0 kubenswrapper[35367]: I1204 12:22:12.766068 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/a8165365-59aa-419d-a5bf-fc6e97981f19-config-data-merged\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.772346 master-0 kubenswrapper[35367]: I1204 12:22:12.766303 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-config-data\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.772346 master-0 kubenswrapper[35367]: I1204 12:22:12.766444 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a8165365-59aa-419d-a5bf-fc6e97981f19-logs\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.772346 master-0 kubenswrapper[35367]: I1204 12:22:12.766468 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-combined-ca-bundle\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.772346 master-0 kubenswrapper[35367]: I1204 12:22:12.766498 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pq4w\" (UniqueName: \"kubernetes.io/projected/a8165365-59aa-419d-a5bf-fc6e97981f19-kube-api-access-9pq4w\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.772346 master-0 kubenswrapper[35367]: I1204 12:22:12.766575 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-scripts\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.772346 master-0 kubenswrapper[35367]: I1204 12:22:12.766717 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8165365-59aa-419d-a5bf-fc6e97981f19-etc-podinfo\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.772346 master-0 kubenswrapper[35367]: I1204 12:22:12.767301 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93ed4f64-900a-44ba-b838-82e0594a1809-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:12.822078 master-0 kubenswrapper[35367]: I1204 12:22:12.821060 35367 scope.go:117] "RemoveContainer" containerID="36b4cff5b4c7b42d714a33878fd694e7c27f69ae3ce3538b8dbf835c4687beb3" Dec 04 12:22:12.839014 master-0 kubenswrapper[35367]: I1204 12:22:12.838906 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:12.903771 master-0 kubenswrapper[35367]: I1204 12:22:12.903226 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-config-data\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.903771 master-0 kubenswrapper[35367]: I1204 12:22:12.903527 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a8165365-59aa-419d-a5bf-fc6e97981f19-logs\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.903771 master-0 kubenswrapper[35367]: I1204 12:22:12.903641 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-combined-ca-bundle\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.903771 master-0 kubenswrapper[35367]: I1204 12:22:12.903679 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9pq4w\" (UniqueName: \"kubernetes.io/projected/a8165365-59aa-419d-a5bf-fc6e97981f19-kube-api-access-9pq4w\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.904151 master-0 kubenswrapper[35367]: I1204 12:22:12.904052 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-scripts\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.905678 master-0 kubenswrapper[35367]: I1204 12:22:12.904697 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8165365-59aa-419d-a5bf-fc6e97981f19-etc-podinfo\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.905678 master-0 kubenswrapper[35367]: I1204 12:22:12.904725 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a8165365-59aa-419d-a5bf-fc6e97981f19-logs\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.906404 master-0 kubenswrapper[35367]: I1204 12:22:12.906332 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-config-data-custom\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.906573 master-0 kubenswrapper[35367]: I1204 12:22:12.906544 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/a8165365-59aa-419d-a5bf-fc6e97981f19-config-data-merged\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.907688 master-0 kubenswrapper[35367]: I1204 12:22:12.907579 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/a8165365-59aa-419d-a5bf-fc6e97981f19-config-data-merged\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.917883 master-0 kubenswrapper[35367]: I1204 12:22:12.917793 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8165365-59aa-419d-a5bf-fc6e97981f19-etc-podinfo\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.919746 master-0 kubenswrapper[35367]: I1204 12:22:12.919187 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-scripts\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.919746 master-0 kubenswrapper[35367]: I1204 12:22:12.919663 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-config-data\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.922760 master-0 kubenswrapper[35367]: I1204 12:22:12.922356 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-combined-ca-bundle\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.933272 master-0 kubenswrapper[35367]: I1204 12:22:12.933200 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pq4w\" (UniqueName: \"kubernetes.io/projected/a8165365-59aa-419d-a5bf-fc6e97981f19-kube-api-access-9pq4w\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:12.966650 master-0 kubenswrapper[35367]: I1204 12:22:12.966473 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-5d764777ff-vcxc5"] Dec 04 12:22:13.021343 master-0 kubenswrapper[35367]: I1204 12:22:13.021043 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-config-data-custom\") pod \"ironic-5d764777ff-vcxc5\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:13.191973 master-0 kubenswrapper[35367]: I1204 12:22:13.189756 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:13.223218 master-0 kubenswrapper[35367]: I1204 12:22:13.220001 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:13.653922 master-0 kubenswrapper[35367]: I1204 12:22:13.645816 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-0c69e-scheduler-0"] Dec 04 12:22:13.829702 master-0 kubenswrapper[35367]: I1204 12:22:13.829588 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-db-create-2vlsx" event={"ID":"f01f664c-8d89-44ae-a467-fed3c2c32855","Type":"ContainerStarted","Data":"bb5a94b94285d41627f5d5b284851f37e5f0ea9afd4de1d06f2dde0787b4610e"} Dec 04 12:22:13.871361 master-0 kubenswrapper[35367]: I1204 12:22:13.871009 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/cinder-0c69e-scheduler-0"] Dec 04 12:22:13.874556 master-0 kubenswrapper[35367]: I1204 12:22:13.874528 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/keystone-774cd58b59-fd4bc" Dec 04 12:22:13.891872 master-0 kubenswrapper[35367]: I1204 12:22:13.889568 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-inspector-db-create-2vlsx"] Dec 04 12:22:13.929143 master-0 kubenswrapper[35367]: I1204 12:22:13.929070 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-0c69e-scheduler-0"] Dec 04 12:22:13.936696 master-0 kubenswrapper[35367]: I1204 12:22:13.935413 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:13.961014 master-0 kubenswrapper[35367]: I1204 12:22:13.959648 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-0c69e-scheduler-config-data" Dec 04 12:22:14.050374 master-0 kubenswrapper[35367]: I1204 12:22:14.050290 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/50d10cf3-8e68-4afa-bd86-97b19b610658-config-data-custom\") pod \"cinder-0c69e-scheduler-0\" (UID: \"50d10cf3-8e68-4afa-bd86-97b19b610658\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:14.050615 master-0 kubenswrapper[35367]: I1204 12:22:14.050537 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50d10cf3-8e68-4afa-bd86-97b19b610658-combined-ca-bundle\") pod \"cinder-0c69e-scheduler-0\" (UID: \"50d10cf3-8e68-4afa-bd86-97b19b610658\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:14.050908 master-0 kubenswrapper[35367]: I1204 12:22:14.050877 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/50d10cf3-8e68-4afa-bd86-97b19b610658-scripts\") pod \"cinder-0c69e-scheduler-0\" (UID: \"50d10cf3-8e68-4afa-bd86-97b19b610658\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:14.052577 master-0 kubenswrapper[35367]: I1204 12:22:14.052506 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-0c69e-scheduler-0"] Dec 04 12:22:14.052978 master-0 kubenswrapper[35367]: I1204 12:22:14.052936 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/50d10cf3-8e68-4afa-bd86-97b19b610658-etc-machine-id\") pod \"cinder-0c69e-scheduler-0\" (UID: \"50d10cf3-8e68-4afa-bd86-97b19b610658\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:14.053039 master-0 kubenswrapper[35367]: I1204 12:22:14.053026 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j78b4\" (UniqueName: \"kubernetes.io/projected/50d10cf3-8e68-4afa-bd86-97b19b610658-kube-api-access-j78b4\") pod \"cinder-0c69e-scheduler-0\" (UID: \"50d10cf3-8e68-4afa-bd86-97b19b610658\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:14.053136 master-0 kubenswrapper[35367]: I1204 12:22:14.053082 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50d10cf3-8e68-4afa-bd86-97b19b610658-config-data\") pod \"cinder-0c69e-scheduler-0\" (UID: \"50d10cf3-8e68-4afa-bd86-97b19b610658\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:14.081721 master-0 kubenswrapper[35367]: W1204 12:22:14.081614 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42c0c08e_5eb9_4e64_b523_363d39eff4c9.slice/crio-06a18a9889961758ed017756de9f1e5705f0bb72450ffee350789adc3d6bb231 WatchSource:0}: Error finding container 06a18a9889961758ed017756de9f1e5705f0bb72450ffee350789adc3d6bb231: Status 404 returned error can't find the container with id 06a18a9889961758ed017756de9f1e5705f0bb72450ffee350789adc3d6bb231 Dec 04 12:22:14.102204 master-0 kubenswrapper[35367]: I1204 12:22:14.101925 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-neutron-agent-776b955f8c-hd9lh"] Dec 04 12:22:14.139077 master-0 kubenswrapper[35367]: I1204 12:22:14.138925 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-inspector-d6e5-account-create-update-w8hkj"] Dec 04 12:22:14.159419 master-0 kubenswrapper[35367]: I1204 12:22:14.159328 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/50d10cf3-8e68-4afa-bd86-97b19b610658-config-data-custom\") pod \"cinder-0c69e-scheduler-0\" (UID: \"50d10cf3-8e68-4afa-bd86-97b19b610658\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:14.159419 master-0 kubenswrapper[35367]: I1204 12:22:14.159398 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50d10cf3-8e68-4afa-bd86-97b19b610658-combined-ca-bundle\") pod \"cinder-0c69e-scheduler-0\" (UID: \"50d10cf3-8e68-4afa-bd86-97b19b610658\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:14.159745 master-0 kubenswrapper[35367]: I1204 12:22:14.159530 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/50d10cf3-8e68-4afa-bd86-97b19b610658-scripts\") pod \"cinder-0c69e-scheduler-0\" (UID: \"50d10cf3-8e68-4afa-bd86-97b19b610658\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:14.159745 master-0 kubenswrapper[35367]: I1204 12:22:14.159639 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/50d10cf3-8e68-4afa-bd86-97b19b610658-etc-machine-id\") pod \"cinder-0c69e-scheduler-0\" (UID: \"50d10cf3-8e68-4afa-bd86-97b19b610658\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:14.159745 master-0 kubenswrapper[35367]: I1204 12:22:14.159697 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j78b4\" (UniqueName: \"kubernetes.io/projected/50d10cf3-8e68-4afa-bd86-97b19b610658-kube-api-access-j78b4\") pod \"cinder-0c69e-scheduler-0\" (UID: \"50d10cf3-8e68-4afa-bd86-97b19b610658\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:14.159916 master-0 kubenswrapper[35367]: I1204 12:22:14.159753 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50d10cf3-8e68-4afa-bd86-97b19b610658-config-data\") pod \"cinder-0c69e-scheduler-0\" (UID: \"50d10cf3-8e68-4afa-bd86-97b19b610658\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:14.163664 master-0 kubenswrapper[35367]: I1204 12:22:14.163561 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/50d10cf3-8e68-4afa-bd86-97b19b610658-etc-machine-id\") pod \"cinder-0c69e-scheduler-0\" (UID: \"50d10cf3-8e68-4afa-bd86-97b19b610658\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:14.165944 master-0 kubenswrapper[35367]: I1204 12:22:14.165877 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50d10cf3-8e68-4afa-bd86-97b19b610658-config-data\") pod \"cinder-0c69e-scheduler-0\" (UID: \"50d10cf3-8e68-4afa-bd86-97b19b610658\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:14.168116 master-0 kubenswrapper[35367]: I1204 12:22:14.167321 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50d10cf3-8e68-4afa-bd86-97b19b610658-combined-ca-bundle\") pod \"cinder-0c69e-scheduler-0\" (UID: \"50d10cf3-8e68-4afa-bd86-97b19b610658\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:14.179941 master-0 kubenswrapper[35367]: I1204 12:22:14.179852 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-798989f845-tfbmz"] Dec 04 12:22:14.180515 master-0 kubenswrapper[35367]: I1204 12:22:14.180469 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/50d10cf3-8e68-4afa-bd86-97b19b610658-scripts\") pod \"cinder-0c69e-scheduler-0\" (UID: \"50d10cf3-8e68-4afa-bd86-97b19b610658\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:14.185870 master-0 kubenswrapper[35367]: I1204 12:22:14.185787 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/50d10cf3-8e68-4afa-bd86-97b19b610658-config-data-custom\") pod \"cinder-0c69e-scheduler-0\" (UID: \"50d10cf3-8e68-4afa-bd86-97b19b610658\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:14.189914 master-0 kubenswrapper[35367]: W1204 12:22:14.188325 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a6ed281_8138_49a1_b433_ff5813e6562b.slice/crio-8473b532c6a2a95e672c158e26c03b2291661a94264a6ffed9e78d53ca92977a WatchSource:0}: Error finding container 8473b532c6a2a95e672c158e26c03b2291661a94264a6ffed9e78d53ca92977a: Status 404 returned error can't find the container with id 8473b532c6a2a95e672c158e26c03b2291661a94264a6ffed9e78d53ca92977a Dec 04 12:22:14.216283 master-0 kubenswrapper[35367]: I1204 12:22:14.216172 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j78b4\" (UniqueName: \"kubernetes.io/projected/50d10cf3-8e68-4afa-bd86-97b19b610658-kube-api-access-j78b4\") pod \"cinder-0c69e-scheduler-0\" (UID: \"50d10cf3-8e68-4afa-bd86-97b19b610658\") " pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:14.316622 master-0 kubenswrapper[35367]: I1204 12:22:14.314152 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-conductor-0"] Dec 04 12:22:14.321219 master-0 kubenswrapper[35367]: I1204 12:22:14.321146 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-conductor-0" Dec 04 12:22:14.333779 master-0 kubenswrapper[35367]: I1204 12:22:14.333234 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-conductor-0"] Dec 04 12:22:14.334858 master-0 kubenswrapper[35367]: I1204 12:22:14.334772 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-conductor-scripts" Dec 04 12:22:14.335128 master-0 kubenswrapper[35367]: I1204 12:22:14.335065 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-conductor-config-data" Dec 04 12:22:14.370414 master-0 kubenswrapper[35367]: I1204 12:22:14.370341 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:14.382852 master-0 kubenswrapper[35367]: I1204 12:22:14.382216 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:14.509977 master-0 kubenswrapper[35367]: I1204 12:22:14.509791 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/822f5f37-f2cc-4473-9544-0fb50d3d9266-config-data\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:14.509977 master-0 kubenswrapper[35367]: I1204 12:22:14.509972 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92jxb\" (UniqueName: \"kubernetes.io/projected/822f5f37-f2cc-4473-9544-0fb50d3d9266-kube-api-access-92jxb\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:14.510243 master-0 kubenswrapper[35367]: I1204 12:22:14.510124 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/822f5f37-f2cc-4473-9544-0fb50d3d9266-config-data-custom\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:14.510243 master-0 kubenswrapper[35367]: I1204 12:22:14.510177 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/822f5f37-f2cc-4473-9544-0fb50d3d9266-scripts\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:14.510305 master-0 kubenswrapper[35367]: I1204 12:22:14.510244 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/822f5f37-f2cc-4473-9544-0fb50d3d9266-combined-ca-bundle\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:14.510577 master-0 kubenswrapper[35367]: I1204 12:22:14.510511 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/822f5f37-f2cc-4473-9544-0fb50d3d9266-config-data-merged\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:14.510674 master-0 kubenswrapper[35367]: I1204 12:22:14.510635 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/822f5f37-f2cc-4473-9544-0fb50d3d9266-etc-podinfo\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:14.510759 master-0 kubenswrapper[35367]: I1204 12:22:14.510727 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-5a573bd2-fd14-47d0-b972-929693af1b7c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^92bbf630-d930-42d1-a145-27cd505043c7\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:14.613554 master-0 kubenswrapper[35367]: I1204 12:22:14.613304 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/822f5f37-f2cc-4473-9544-0fb50d3d9266-combined-ca-bundle\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:14.613554 master-0 kubenswrapper[35367]: I1204 12:22:14.613516 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/822f5f37-f2cc-4473-9544-0fb50d3d9266-config-data-merged\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:14.613761 master-0 kubenswrapper[35367]: I1204 12:22:14.613596 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/822f5f37-f2cc-4473-9544-0fb50d3d9266-etc-podinfo\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:14.613761 master-0 kubenswrapper[35367]: I1204 12:22:14.613739 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/822f5f37-f2cc-4473-9544-0fb50d3d9266-config-data\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:14.613980 master-0 kubenswrapper[35367]: I1204 12:22:14.613845 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-92jxb\" (UniqueName: \"kubernetes.io/projected/822f5f37-f2cc-4473-9544-0fb50d3d9266-kube-api-access-92jxb\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:14.614991 master-0 kubenswrapper[35367]: I1204 12:22:14.614945 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/822f5f37-f2cc-4473-9544-0fb50d3d9266-config-data-merged\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:14.615288 master-0 kubenswrapper[35367]: I1204 12:22:14.615250 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/822f5f37-f2cc-4473-9544-0fb50d3d9266-config-data-custom\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:14.615346 master-0 kubenswrapper[35367]: I1204 12:22:14.615299 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/822f5f37-f2cc-4473-9544-0fb50d3d9266-scripts\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:14.617601 master-0 kubenswrapper[35367]: I1204 12:22:14.617560 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/822f5f37-f2cc-4473-9544-0fb50d3d9266-combined-ca-bundle\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:14.619763 master-0 kubenswrapper[35367]: I1204 12:22:14.619704 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/822f5f37-f2cc-4473-9544-0fb50d3d9266-etc-podinfo\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:14.620335 master-0 kubenswrapper[35367]: I1204 12:22:14.620303 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/822f5f37-f2cc-4473-9544-0fb50d3d9266-config-data\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:14.620541 master-0 kubenswrapper[35367]: I1204 12:22:14.620505 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/822f5f37-f2cc-4473-9544-0fb50d3d9266-scripts\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:14.622248 master-0 kubenswrapper[35367]: I1204 12:22:14.622206 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/822f5f37-f2cc-4473-9544-0fb50d3d9266-config-data-custom\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:14.765203 master-0 kubenswrapper[35367]: I1204 12:22:14.764572 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93ed4f64-900a-44ba-b838-82e0594a1809" path="/var/lib/kubelet/pods/93ed4f64-900a-44ba-b838-82e0594a1809/volumes" Dec 04 12:22:14.855531 master-0 kubenswrapper[35367]: I1204 12:22:14.855467 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-d6e5-account-create-update-w8hkj" event={"ID":"42c0c08e-5eb9-4e64-b523-363d39eff4c9","Type":"ContainerStarted","Data":"3ad05b7db986ed4242ec0a5f1474166ec176aafe9b1f484f1e85eb8c71f6dc7d"} Dec 04 12:22:14.855702 master-0 kubenswrapper[35367]: I1204 12:22:14.855545 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-d6e5-account-create-update-w8hkj" event={"ID":"42c0c08e-5eb9-4e64-b523-363d39eff4c9","Type":"ContainerStarted","Data":"06a18a9889961758ed017756de9f1e5705f0bb72450ffee350789adc3d6bb231"} Dec 04 12:22:14.860945 master-0 kubenswrapper[35367]: I1204 12:22:14.859008 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-798989f845-tfbmz" event={"ID":"0a6ed281-8138-49a1-b433-ff5813e6562b","Type":"ContainerStarted","Data":"8473b532c6a2a95e672c158e26c03b2291661a94264a6ffed9e78d53ca92977a"} Dec 04 12:22:14.862312 master-0 kubenswrapper[35367]: I1204 12:22:14.862222 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" event={"ID":"60937ace-8171-4692-a7a8-75df15eeb551","Type":"ContainerStarted","Data":"ef028efac947763142bd5b3a5ad5d8ae2be5d562a41ce2d75542a6021e49487c"} Dec 04 12:22:14.865402 master-0 kubenswrapper[35367]: I1204 12:22:14.865307 35367 generic.go:334] "Generic (PLEG): container finished" podID="f01f664c-8d89-44ae-a467-fed3c2c32855" containerID="0b5e7513379707fe7f95495022fd8b19b4d638d2ac6ca86d4354fb8bd2aaa3f5" exitCode=0 Dec 04 12:22:14.865402 master-0 kubenswrapper[35367]: I1204 12:22:14.865399 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-db-create-2vlsx" event={"ID":"f01f664c-8d89-44ae-a467-fed3c2c32855","Type":"ContainerDied","Data":"0b5e7513379707fe7f95495022fd8b19b4d638d2ac6ca86d4354fb8bd2aaa3f5"} Dec 04 12:22:14.997886 master-0 kubenswrapper[35367]: I1204 12:22:14.997840 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-92jxb\" (UniqueName: \"kubernetes.io/projected/822f5f37-f2cc-4473-9544-0fb50d3d9266-kube-api-access-92jxb\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:15.004956 master-0 kubenswrapper[35367]: I1204 12:22:15.004847 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-5d764777ff-vcxc5"] Dec 04 12:22:15.030282 master-0 kubenswrapper[35367]: I1204 12:22:15.030159 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-5a573bd2-fd14-47d0-b972-929693af1b7c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^92bbf630-d930-42d1-a145-27cd505043c7\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:15.032160 master-0 kubenswrapper[35367]: W1204 12:22:15.031303 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8165365_59aa_419d_a5bf_fc6e97981f19.slice/crio-9bfb407a86cdbf0e3009aaa2056bb7856e40e2b71b3bdc6b33a0ba99240220d4 WatchSource:0}: Error finding container 9bfb407a86cdbf0e3009aaa2056bb7856e40e2b71b3bdc6b33a0ba99240220d4: Status 404 returned error can't find the container with id 9bfb407a86cdbf0e3009aaa2056bb7856e40e2b71b3bdc6b33a0ba99240220d4 Dec 04 12:22:15.032889 master-0 kubenswrapper[35367]: I1204 12:22:15.032713 35367 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 12:22:15.032981 master-0 kubenswrapper[35367]: I1204 12:22:15.032793 35367 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-5a573bd2-fd14-47d0-b972-929693af1b7c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^92bbf630-d930-42d1-a145-27cd505043c7\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/ebd4eea9c89177822f75ae602a8a3fff4945c152e1779fd4df4b479d980d49d9/globalmount\"" pod="openstack/ironic-conductor-0" Dec 04 12:22:15.249470 master-0 kubenswrapper[35367]: I1204 12:22:15.249319 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-0c69e-scheduler-0"] Dec 04 12:22:15.443105 master-0 kubenswrapper[35367]: I1204 12:22:15.442878 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/openstackclient"] Dec 04 12:22:15.446279 master-0 kubenswrapper[35367]: I1204 12:22:15.446227 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/openstackclient" Dec 04 12:22:15.469014 master-0 kubenswrapper[35367]: I1204 12:22:15.468954 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"openstack-config" Dec 04 12:22:15.469273 master-0 kubenswrapper[35367]: I1204 12:22:15.469248 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"openstack-config-secret" Dec 04 12:22:15.532721 master-0 kubenswrapper[35367]: I1204 12:22:15.532649 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/openstackclient"] Dec 04 12:22:15.551563 master-0 kubenswrapper[35367]: I1204 12:22:15.551352 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/0417aae4-1fcb-4905-9907-c410a9584497-openstack-config-secret\") pod \"openstackclient\" (UID: \"0417aae4-1fcb-4905-9907-c410a9584497\") " pod="openstack/openstackclient" Dec 04 12:22:15.551563 master-0 kubenswrapper[35367]: I1204 12:22:15.551433 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssg4z\" (UniqueName: \"kubernetes.io/projected/0417aae4-1fcb-4905-9907-c410a9584497-kube-api-access-ssg4z\") pod \"openstackclient\" (UID: \"0417aae4-1fcb-4905-9907-c410a9584497\") " pod="openstack/openstackclient" Dec 04 12:22:15.552316 master-0 kubenswrapper[35367]: I1204 12:22:15.551833 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/0417aae4-1fcb-4905-9907-c410a9584497-openstack-config\") pod \"openstackclient\" (UID: \"0417aae4-1fcb-4905-9907-c410a9584497\") " pod="openstack/openstackclient" Dec 04 12:22:15.552316 master-0 kubenswrapper[35367]: I1204 12:22:15.552211 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0417aae4-1fcb-4905-9907-c410a9584497-combined-ca-bundle\") pod \"openstackclient\" (UID: \"0417aae4-1fcb-4905-9907-c410a9584497\") " pod="openstack/openstackclient" Dec 04 12:22:15.659592 master-0 kubenswrapper[35367]: I1204 12:22:15.659506 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/0417aae4-1fcb-4905-9907-c410a9584497-openstack-config-secret\") pod \"openstackclient\" (UID: \"0417aae4-1fcb-4905-9907-c410a9584497\") " pod="openstack/openstackclient" Dec 04 12:22:15.660037 master-0 kubenswrapper[35367]: I1204 12:22:15.659659 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ssg4z\" (UniqueName: \"kubernetes.io/projected/0417aae4-1fcb-4905-9907-c410a9584497-kube-api-access-ssg4z\") pod \"openstackclient\" (UID: \"0417aae4-1fcb-4905-9907-c410a9584497\") " pod="openstack/openstackclient" Dec 04 12:22:15.660949 master-0 kubenswrapper[35367]: I1204 12:22:15.660187 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/0417aae4-1fcb-4905-9907-c410a9584497-openstack-config\") pod \"openstackclient\" (UID: \"0417aae4-1fcb-4905-9907-c410a9584497\") " pod="openstack/openstackclient" Dec 04 12:22:15.660949 master-0 kubenswrapper[35367]: I1204 12:22:15.660600 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0417aae4-1fcb-4905-9907-c410a9584497-combined-ca-bundle\") pod \"openstackclient\" (UID: \"0417aae4-1fcb-4905-9907-c410a9584497\") " pod="openstack/openstackclient" Dec 04 12:22:15.662053 master-0 kubenswrapper[35367]: I1204 12:22:15.661928 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/0417aae4-1fcb-4905-9907-c410a9584497-openstack-config\") pod \"openstackclient\" (UID: \"0417aae4-1fcb-4905-9907-c410a9584497\") " pod="openstack/openstackclient" Dec 04 12:22:15.665045 master-0 kubenswrapper[35367]: I1204 12:22:15.665011 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/0417aae4-1fcb-4905-9907-c410a9584497-openstack-config-secret\") pod \"openstackclient\" (UID: \"0417aae4-1fcb-4905-9907-c410a9584497\") " pod="openstack/openstackclient" Dec 04 12:22:15.666512 master-0 kubenswrapper[35367]: I1204 12:22:15.666312 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0417aae4-1fcb-4905-9907-c410a9584497-combined-ca-bundle\") pod \"openstackclient\" (UID: \"0417aae4-1fcb-4905-9907-c410a9584497\") " pod="openstack/openstackclient" Dec 04 12:22:15.830540 master-0 kubenswrapper[35367]: I1204 12:22:15.830484 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/cinder-0c69e-api-0" Dec 04 12:22:15.895459 master-0 kubenswrapper[35367]: I1204 12:22:15.895383 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-5d764777ff-vcxc5" event={"ID":"a8165365-59aa-419d-a5bf-fc6e97981f19","Type":"ContainerStarted","Data":"9bfb407a86cdbf0e3009aaa2056bb7856e40e2b71b3bdc6b33a0ba99240220d4"} Dec 04 12:22:15.905980 master-0 kubenswrapper[35367]: I1204 12:22:15.901453 35367 generic.go:334] "Generic (PLEG): container finished" podID="42c0c08e-5eb9-4e64-b523-363d39eff4c9" containerID="3ad05b7db986ed4242ec0a5f1474166ec176aafe9b1f484f1e85eb8c71f6dc7d" exitCode=0 Dec 04 12:22:15.905980 master-0 kubenswrapper[35367]: I1204 12:22:15.901570 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-d6e5-account-create-update-w8hkj" event={"ID":"42c0c08e-5eb9-4e64-b523-363d39eff4c9","Type":"ContainerDied","Data":"3ad05b7db986ed4242ec0a5f1474166ec176aafe9b1f484f1e85eb8c71f6dc7d"} Dec 04 12:22:15.910334 master-0 kubenswrapper[35367]: I1204 12:22:15.909266 35367 generic.go:334] "Generic (PLEG): container finished" podID="0a6ed281-8138-49a1-b433-ff5813e6562b" containerID="23b1943f0914d18307baa9d2da6b19fa2fd86dfc5a01f0b612668712ecbf19fb" exitCode=0 Dec 04 12:22:15.910334 master-0 kubenswrapper[35367]: I1204 12:22:15.909431 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-798989f845-tfbmz" event={"ID":"0a6ed281-8138-49a1-b433-ff5813e6562b","Type":"ContainerDied","Data":"23b1943f0914d18307baa9d2da6b19fa2fd86dfc5a01f0b612668712ecbf19fb"} Dec 04 12:22:15.917301 master-0 kubenswrapper[35367]: I1204 12:22:15.915870 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-scheduler-0" event={"ID":"50d10cf3-8e68-4afa-bd86-97b19b610658","Type":"ContainerStarted","Data":"98313b9ff012f6f6cb30d558cdbb7787f93cdb286f3b6003b44c167378b383b7"} Dec 04 12:22:15.942316 master-0 kubenswrapper[35367]: I1204 12:22:15.941419 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssg4z\" (UniqueName: \"kubernetes.io/projected/0417aae4-1fcb-4905-9907-c410a9584497-kube-api-access-ssg4z\") pod \"openstackclient\" (UID: \"0417aae4-1fcb-4905-9907-c410a9584497\") " pod="openstack/openstackclient" Dec 04 12:22:16.114087 master-0 kubenswrapper[35367]: I1204 12:22:16.113749 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/openstackclient" Dec 04 12:22:16.523202 master-0 kubenswrapper[35367]: I1204 12:22:16.522037 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-5a573bd2-fd14-47d0-b972-929693af1b7c\" (UniqueName: \"kubernetes.io/csi/topolvm.io^92bbf630-d930-42d1-a145-27cd505043c7\") pod \"ironic-conductor-0\" (UID: \"822f5f37-f2cc-4473-9544-0fb50d3d9266\") " pod="openstack/ironic-conductor-0" Dec 04 12:22:16.813088 master-0 kubenswrapper[35367]: I1204 12:22:16.809327 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-conductor-0" Dec 04 12:22:16.953981 master-0 kubenswrapper[35367]: I1204 12:22:16.952606 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-scheduler-0" event={"ID":"50d10cf3-8e68-4afa-bd86-97b19b610658","Type":"ContainerStarted","Data":"01357dae06ad6b4330aec51da4eda80837e855dba7b9a3ccb1782f2e32cc574b"} Dec 04 12:22:17.763337 master-0 kubenswrapper[35367]: I1204 12:22:17.761022 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-db-create-2vlsx" Dec 04 12:22:17.775856 master-0 kubenswrapper[35367]: I1204 12:22:17.775515 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-d6e5-account-create-update-w8hkj" Dec 04 12:22:17.833924 master-0 kubenswrapper[35367]: I1204 12:22:17.829017 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzv9l\" (UniqueName: \"kubernetes.io/projected/f01f664c-8d89-44ae-a467-fed3c2c32855-kube-api-access-gzv9l\") pod \"f01f664c-8d89-44ae-a467-fed3c2c32855\" (UID: \"f01f664c-8d89-44ae-a467-fed3c2c32855\") " Dec 04 12:22:17.833924 master-0 kubenswrapper[35367]: I1204 12:22:17.829314 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f01f664c-8d89-44ae-a467-fed3c2c32855-operator-scripts\") pod \"f01f664c-8d89-44ae-a467-fed3c2c32855\" (UID: \"f01f664c-8d89-44ae-a467-fed3c2c32855\") " Dec 04 12:22:17.833924 master-0 kubenswrapper[35367]: I1204 12:22:17.829547 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/42c0c08e-5eb9-4e64-b523-363d39eff4c9-operator-scripts\") pod \"42c0c08e-5eb9-4e64-b523-363d39eff4c9\" (UID: \"42c0c08e-5eb9-4e64-b523-363d39eff4c9\") " Dec 04 12:22:17.833924 master-0 kubenswrapper[35367]: I1204 12:22:17.829575 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tslcw\" (UniqueName: \"kubernetes.io/projected/42c0c08e-5eb9-4e64-b523-363d39eff4c9-kube-api-access-tslcw\") pod \"42c0c08e-5eb9-4e64-b523-363d39eff4c9\" (UID: \"42c0c08e-5eb9-4e64-b523-363d39eff4c9\") " Dec 04 12:22:17.833924 master-0 kubenswrapper[35367]: I1204 12:22:17.832988 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f01f664c-8d89-44ae-a467-fed3c2c32855-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f01f664c-8d89-44ae-a467-fed3c2c32855" (UID: "f01f664c-8d89-44ae-a467-fed3c2c32855"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:17.833924 master-0 kubenswrapper[35367]: I1204 12:22:17.833451 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42c0c08e-5eb9-4e64-b523-363d39eff4c9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "42c0c08e-5eb9-4e64-b523-363d39eff4c9" (UID: "42c0c08e-5eb9-4e64-b523-363d39eff4c9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:17.842843 master-0 kubenswrapper[35367]: I1204 12:22:17.839265 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42c0c08e-5eb9-4e64-b523-363d39eff4c9-kube-api-access-tslcw" (OuterVolumeSpecName: "kube-api-access-tslcw") pod "42c0c08e-5eb9-4e64-b523-363d39eff4c9" (UID: "42c0c08e-5eb9-4e64-b523-363d39eff4c9"). InnerVolumeSpecName "kube-api-access-tslcw". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:17.846836 master-0 kubenswrapper[35367]: I1204 12:22:17.844008 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f01f664c-8d89-44ae-a467-fed3c2c32855-kube-api-access-gzv9l" (OuterVolumeSpecName: "kube-api-access-gzv9l") pod "f01f664c-8d89-44ae-a467-fed3c2c32855" (UID: "f01f664c-8d89-44ae-a467-fed3c2c32855"). InnerVolumeSpecName "kube-api-access-gzv9l". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:17.936837 master-0 kubenswrapper[35367]: I1204 12:22:17.936475 35367 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f01f664c-8d89-44ae-a467-fed3c2c32855-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:17.936837 master-0 kubenswrapper[35367]: I1204 12:22:17.936534 35367 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/42c0c08e-5eb9-4e64-b523-363d39eff4c9-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:17.936837 master-0 kubenswrapper[35367]: I1204 12:22:17.936553 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tslcw\" (UniqueName: \"kubernetes.io/projected/42c0c08e-5eb9-4e64-b523-363d39eff4c9-kube-api-access-tslcw\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:17.936837 master-0 kubenswrapper[35367]: I1204 12:22:17.936567 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gzv9l\" (UniqueName: \"kubernetes.io/projected/f01f664c-8d89-44ae-a467-fed3c2c32855-kube-api-access-gzv9l\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:17.982864 master-0 kubenswrapper[35367]: I1204 12:22:17.982327 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-d6e5-account-create-update-w8hkj" event={"ID":"42c0c08e-5eb9-4e64-b523-363d39eff4c9","Type":"ContainerDied","Data":"06a18a9889961758ed017756de9f1e5705f0bb72450ffee350789adc3d6bb231"} Dec 04 12:22:17.982864 master-0 kubenswrapper[35367]: I1204 12:22:17.982413 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06a18a9889961758ed017756de9f1e5705f0bb72450ffee350789adc3d6bb231" Dec 04 12:22:17.982864 master-0 kubenswrapper[35367]: I1204 12:22:17.982547 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-d6e5-account-create-update-w8hkj" Dec 04 12:22:17.986331 master-0 kubenswrapper[35367]: I1204 12:22:17.986046 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-db-create-2vlsx" event={"ID":"f01f664c-8d89-44ae-a467-fed3c2c32855","Type":"ContainerDied","Data":"bb5a94b94285d41627f5d5b284851f37e5f0ea9afd4de1d06f2dde0787b4610e"} Dec 04 12:22:17.986331 master-0 kubenswrapper[35367]: I1204 12:22:17.986119 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb5a94b94285d41627f5d5b284851f37e5f0ea9afd4de1d06f2dde0787b4610e" Dec 04 12:22:17.986331 master-0 kubenswrapper[35367]: I1204 12:22:17.986208 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-db-create-2vlsx" Dec 04 12:22:18.302395 master-0 kubenswrapper[35367]: I1204 12:22:18.301576 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-7f6fdfb78f-cclgs"] Dec 04 12:22:18.302616 master-0 kubenswrapper[35367]: E1204 12:22:18.302441 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f01f664c-8d89-44ae-a467-fed3c2c32855" containerName="mariadb-database-create" Dec 04 12:22:18.302616 master-0 kubenswrapper[35367]: I1204 12:22:18.302462 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f01f664c-8d89-44ae-a467-fed3c2c32855" containerName="mariadb-database-create" Dec 04 12:22:18.302616 master-0 kubenswrapper[35367]: E1204 12:22:18.302522 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="42c0c08e-5eb9-4e64-b523-363d39eff4c9" containerName="mariadb-account-create-update" Dec 04 12:22:18.302616 master-0 kubenswrapper[35367]: I1204 12:22:18.302530 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="42c0c08e-5eb9-4e64-b523-363d39eff4c9" containerName="mariadb-account-create-update" Dec 04 12:22:18.304847 master-0 kubenswrapper[35367]: I1204 12:22:18.302848 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="42c0c08e-5eb9-4e64-b523-363d39eff4c9" containerName="mariadb-account-create-update" Dec 04 12:22:18.304847 master-0 kubenswrapper[35367]: I1204 12:22:18.302876 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="f01f664c-8d89-44ae-a467-fed3c2c32855" containerName="mariadb-database-create" Dec 04 12:22:18.312382 master-0 kubenswrapper[35367]: I1204 12:22:18.309915 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.315013 master-0 kubenswrapper[35367]: I1204 12:22:18.314719 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ironic-internal-svc" Dec 04 12:22:18.316644 master-0 kubenswrapper[35367]: I1204 12:22:18.316593 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ironic-public-svc" Dec 04 12:22:18.322939 master-0 kubenswrapper[35367]: I1204 12:22:18.322503 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-7f6fdfb78f-cclgs"] Dec 04 12:22:18.464749 master-0 kubenswrapper[35367]: I1204 12:22:18.464522 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0332e93-b2ea-4249-89f2-f80e10238ac9-config-data\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.464749 master-0 kubenswrapper[35367]: I1204 12:22:18.464684 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-269jv\" (UniqueName: \"kubernetes.io/projected/e0332e93-b2ea-4249-89f2-f80e10238ac9-kube-api-access-269jv\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.464749 master-0 kubenswrapper[35367]: I1204 12:22:18.464713 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e0332e93-b2ea-4249-89f2-f80e10238ac9-config-data-custom\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.464749 master-0 kubenswrapper[35367]: I1204 12:22:18.464739 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0332e93-b2ea-4249-89f2-f80e10238ac9-internal-tls-certs\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.466012 master-0 kubenswrapper[35367]: I1204 12:22:18.465371 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0332e93-b2ea-4249-89f2-f80e10238ac9-etc-podinfo\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.466012 master-0 kubenswrapper[35367]: I1204 12:22:18.465523 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0332e93-b2ea-4249-89f2-f80e10238ac9-logs\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.466012 master-0 kubenswrapper[35367]: I1204 12:22:18.465591 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0332e93-b2ea-4249-89f2-f80e10238ac9-public-tls-certs\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.466012 master-0 kubenswrapper[35367]: I1204 12:22:18.465620 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/e0332e93-b2ea-4249-89f2-f80e10238ac9-config-data-merged\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.466012 master-0 kubenswrapper[35367]: I1204 12:22:18.465652 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0332e93-b2ea-4249-89f2-f80e10238ac9-scripts\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.466012 master-0 kubenswrapper[35367]: I1204 12:22:18.465731 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0332e93-b2ea-4249-89f2-f80e10238ac9-combined-ca-bundle\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.561748 master-0 kubenswrapper[35367]: I1204 12:22:18.560006 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" Dec 04 12:22:18.569653 master-0 kubenswrapper[35367]: I1204 12:22:18.569597 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0332e93-b2ea-4249-89f2-f80e10238ac9-config-data\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.570000 master-0 kubenswrapper[35367]: I1204 12:22:18.569977 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-269jv\" (UniqueName: \"kubernetes.io/projected/e0332e93-b2ea-4249-89f2-f80e10238ac9-kube-api-access-269jv\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.570103 master-0 kubenswrapper[35367]: I1204 12:22:18.570087 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e0332e93-b2ea-4249-89f2-f80e10238ac9-config-data-custom\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.570238 master-0 kubenswrapper[35367]: I1204 12:22:18.570221 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0332e93-b2ea-4249-89f2-f80e10238ac9-internal-tls-certs\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.570538 master-0 kubenswrapper[35367]: I1204 12:22:18.570515 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0332e93-b2ea-4249-89f2-f80e10238ac9-etc-podinfo\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.570720 master-0 kubenswrapper[35367]: I1204 12:22:18.570663 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0332e93-b2ea-4249-89f2-f80e10238ac9-logs\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.572391 master-0 kubenswrapper[35367]: I1204 12:22:18.571629 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0332e93-b2ea-4249-89f2-f80e10238ac9-logs\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.572855 master-0 kubenswrapper[35367]: I1204 12:22:18.572832 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0332e93-b2ea-4249-89f2-f80e10238ac9-public-tls-certs\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.572985 master-0 kubenswrapper[35367]: I1204 12:22:18.572966 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/e0332e93-b2ea-4249-89f2-f80e10238ac9-config-data-merged\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.573180 master-0 kubenswrapper[35367]: I1204 12:22:18.573163 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0332e93-b2ea-4249-89f2-f80e10238ac9-scripts\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.573417 master-0 kubenswrapper[35367]: I1204 12:22:18.573396 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0332e93-b2ea-4249-89f2-f80e10238ac9-combined-ca-bundle\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.574335 master-0 kubenswrapper[35367]: I1204 12:22:18.574292 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/e0332e93-b2ea-4249-89f2-f80e10238ac9-config-data-merged\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.577855 master-0 kubenswrapper[35367]: I1204 12:22:18.577681 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0332e93-b2ea-4249-89f2-f80e10238ac9-public-tls-certs\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.578342 master-0 kubenswrapper[35367]: I1204 12:22:18.578295 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0332e93-b2ea-4249-89f2-f80e10238ac9-etc-podinfo\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.578596 master-0 kubenswrapper[35367]: I1204 12:22:18.578543 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0332e93-b2ea-4249-89f2-f80e10238ac9-internal-tls-certs\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.578981 master-0 kubenswrapper[35367]: I1204 12:22:18.578938 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0332e93-b2ea-4249-89f2-f80e10238ac9-config-data\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.579723 master-0 kubenswrapper[35367]: I1204 12:22:18.579665 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0332e93-b2ea-4249-89f2-f80e10238ac9-scripts\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.580487 master-0 kubenswrapper[35367]: I1204 12:22:18.580416 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0332e93-b2ea-4249-89f2-f80e10238ac9-combined-ca-bundle\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.581384 master-0 kubenswrapper[35367]: I1204 12:22:18.581355 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e0332e93-b2ea-4249-89f2-f80e10238ac9-config-data-custom\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.589565 master-0 kubenswrapper[35367]: I1204 12:22:18.589496 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-269jv\" (UniqueName: \"kubernetes.io/projected/e0332e93-b2ea-4249-89f2-f80e10238ac9-kube-api-access-269jv\") pod \"ironic-7f6fdfb78f-cclgs\" (UID: \"e0332e93-b2ea-4249-89f2-f80e10238ac9\") " pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.639673 master-0 kubenswrapper[35367]: I1204 12:22:18.639378 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:18.944490 master-0 kubenswrapper[35367]: I1204 12:22:18.944443 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"osp-secret" Dec 04 12:22:18.955743 master-0 kubenswrapper[35367]: I1204 12:22:18.955206 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"rabbitmq-transport-url-ironic-transport" Dec 04 12:22:19.358297 master-0 kubenswrapper[35367]: I1204 12:22:19.357264 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/openstackclient"] Dec 04 12:22:19.374533 master-0 kubenswrapper[35367]: W1204 12:22:19.374055 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0417aae4_1fcb_4905_9907_c410a9584497.slice/crio-d7ca6945b19b5db2ea505d0773a5280ee66a58e22087d9722b8d9204815b6397 WatchSource:0}: Error finding container d7ca6945b19b5db2ea505d0773a5280ee66a58e22087d9722b8d9204815b6397: Status 404 returned error can't find the container with id d7ca6945b19b5db2ea505d0773a5280ee66a58e22087d9722b8d9204815b6397 Dec 04 12:22:19.668131 master-0 kubenswrapper[35367]: I1204 12:22:19.668065 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-conductor-0"] Dec 04 12:22:19.697650 master-0 kubenswrapper[35367]: I1204 12:22:19.696536 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-7f6fdfb78f-cclgs"] Dec 04 12:22:19.812241 master-0 kubenswrapper[35367]: I1204 12:22:19.811876 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/cinder-0c69e-backup-0" Dec 04 12:22:20.108579 master-0 kubenswrapper[35367]: I1204 12:22:20.108510 35367 generic.go:334] "Generic (PLEG): container finished" podID="a8165365-59aa-419d-a5bf-fc6e97981f19" containerID="0047f897e5892cd89b0f717b9404baa960f3ac5c320a219ef979eab5ed739e39" exitCode=0 Dec 04 12:22:20.108579 master-0 kubenswrapper[35367]: I1204 12:22:20.108582 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-5d764777ff-vcxc5" event={"ID":"a8165365-59aa-419d-a5bf-fc6e97981f19","Type":"ContainerDied","Data":"0047f897e5892cd89b0f717b9404baa960f3ac5c320a219ef979eab5ed739e39"} Dec 04 12:22:20.114601 master-0 kubenswrapper[35367]: I1204 12:22:20.114509 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstackclient" event={"ID":"0417aae4-1fcb-4905-9907-c410a9584497","Type":"ContainerStarted","Data":"d7ca6945b19b5db2ea505d0773a5280ee66a58e22087d9722b8d9204815b6397"} Dec 04 12:22:20.126906 master-0 kubenswrapper[35367]: I1204 12:22:20.126735 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-7f6fdfb78f-cclgs" event={"ID":"e0332e93-b2ea-4249-89f2-f80e10238ac9","Type":"ContainerStarted","Data":"fb046249482c382fa3200077de27b80d49ff59245c8584bccf59466087bce054"} Dec 04 12:22:20.126906 master-0 kubenswrapper[35367]: I1204 12:22:20.126832 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-7f6fdfb78f-cclgs" event={"ID":"e0332e93-b2ea-4249-89f2-f80e10238ac9","Type":"ContainerStarted","Data":"54ab72e612c8286de6b6f1021ac44ab89fb4109a222c36f8b5b3bf814d6a3a87"} Dec 04 12:22:20.201745 master-0 kubenswrapper[35367]: I1204 12:22:20.200556 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-798989f845-tfbmz" event={"ID":"0a6ed281-8138-49a1-b433-ff5813e6562b","Type":"ContainerStarted","Data":"54fed0f73eb43d65f4ff87686eef4ac9fdc81cb37c96f1d2dab53d0ffd6c5f74"} Dec 04 12:22:20.201745 master-0 kubenswrapper[35367]: I1204 12:22:20.200781 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:20.206551 master-0 kubenswrapper[35367]: I1204 12:22:20.206494 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" event={"ID":"60937ace-8171-4692-a7a8-75df15eeb551","Type":"ContainerStarted","Data":"51c3f815efe8703773cdeb5af8770181fb823b6950816f223f890e658e8af1dc"} Dec 04 12:22:20.207950 master-0 kubenswrapper[35367]: I1204 12:22:20.207908 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" Dec 04 12:22:20.217032 master-0 kubenswrapper[35367]: I1204 12:22:20.216955 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-conductor-0" event={"ID":"822f5f37-f2cc-4473-9544-0fb50d3d9266","Type":"ContainerStarted","Data":"900c0128157a607f74e0ac44a3b39fa1c23550f9846536c888b4325e8d8e3f36"} Dec 04 12:22:20.226790 master-0 kubenswrapper[35367]: I1204 12:22:20.221387 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-0c69e-scheduler-0" event={"ID":"50d10cf3-8e68-4afa-bd86-97b19b610658","Type":"ContainerStarted","Data":"1a9ac67138afda87ab865d9d8811975f37e50f235378646ff95df72e6dd06891"} Dec 04 12:22:20.240566 master-0 kubenswrapper[35367]: I1204 12:22:20.239234 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-798989f845-tfbmz" podStartSLOduration=8.239207912 podStartE2EDuration="8.239207912s" podCreationTimestamp="2025-12-04 12:22:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:22:20.227536634 +0000 UTC m=+1383.665597902" watchObservedRunningTime="2025-12-04 12:22:20.239207912 +0000 UTC m=+1383.677269170" Dec 04 12:22:20.264548 master-0 kubenswrapper[35367]: I1204 12:22:20.264462 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-0c69e-scheduler-0" podStartSLOduration=7.264436359 podStartE2EDuration="7.264436359s" podCreationTimestamp="2025-12-04 12:22:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:22:20.253364579 +0000 UTC m=+1383.691425857" watchObservedRunningTime="2025-12-04 12:22:20.264436359 +0000 UTC m=+1383.702497617" Dec 04 12:22:20.332458 master-0 kubenswrapper[35367]: I1204 12:22:20.331865 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" podStartSLOduration=3.406862408 podStartE2EDuration="8.331833557s" podCreationTimestamp="2025-12-04 12:22:12 +0000 UTC" firstStartedPulling="2025-12-04 12:22:13.970095851 +0000 UTC m=+1377.408157109" lastFinishedPulling="2025-12-04 12:22:18.895067 +0000 UTC m=+1382.333128258" observedRunningTime="2025-12-04 12:22:20.274959132 +0000 UTC m=+1383.713020390" watchObservedRunningTime="2025-12-04 12:22:20.331833557 +0000 UTC m=+1383.769894815" Dec 04 12:22:21.250044 master-0 kubenswrapper[35367]: I1204 12:22:21.249783 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-conductor-0" event={"ID":"822f5f37-f2cc-4473-9544-0fb50d3d9266","Type":"ContainerStarted","Data":"ae9697ff9eabe1c1ef6ebdcc5f6c8d2e0c0f6d466a0c7a8c1fc226aeb9be9265"} Dec 04 12:22:21.269646 master-0 kubenswrapper[35367]: I1204 12:22:21.269554 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-5d764777ff-vcxc5" event={"ID":"a8165365-59aa-419d-a5bf-fc6e97981f19","Type":"ContainerStarted","Data":"1978444e095c9b97bce5a5eaeca16afb6b3b0ef00bf2a7ebc5903c109b9f4bf6"} Dec 04 12:22:21.269646 master-0 kubenswrapper[35367]: I1204 12:22:21.269618 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-5d764777ff-vcxc5" event={"ID":"a8165365-59aa-419d-a5bf-fc6e97981f19","Type":"ContainerStarted","Data":"5fc609ecacc8d45bba12372a7fba933551c96188233d88526e43db685e5462f2"} Dec 04 12:22:21.271405 master-0 kubenswrapper[35367]: I1204 12:22:21.271279 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:21.276554 master-0 kubenswrapper[35367]: I1204 12:22:21.276480 35367 generic.go:334] "Generic (PLEG): container finished" podID="e0332e93-b2ea-4249-89f2-f80e10238ac9" containerID="fb046249482c382fa3200077de27b80d49ff59245c8584bccf59466087bce054" exitCode=0 Dec 04 12:22:21.278437 master-0 kubenswrapper[35367]: I1204 12:22:21.278361 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-7f6fdfb78f-cclgs" event={"ID":"e0332e93-b2ea-4249-89f2-f80e10238ac9","Type":"ContainerDied","Data":"fb046249482c382fa3200077de27b80d49ff59245c8584bccf59466087bce054"} Dec 04 12:22:21.382550 master-0 kubenswrapper[35367]: I1204 12:22:21.382399 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ironic-5d764777ff-vcxc5" podStartSLOduration=5.483409456 podStartE2EDuration="9.382375529s" podCreationTimestamp="2025-12-04 12:22:12 +0000 UTC" firstStartedPulling="2025-12-04 12:22:15.040557081 +0000 UTC m=+1378.478618339" lastFinishedPulling="2025-12-04 12:22:18.939523154 +0000 UTC m=+1382.377584412" observedRunningTime="2025-12-04 12:22:21.351867416 +0000 UTC m=+1384.789928694" watchObservedRunningTime="2025-12-04 12:22:21.382375529 +0000 UTC m=+1384.820436797" Dec 04 12:22:22.301649 master-0 kubenswrapper[35367]: I1204 12:22:22.301347 35367 generic.go:334] "Generic (PLEG): container finished" podID="a8165365-59aa-419d-a5bf-fc6e97981f19" containerID="1978444e095c9b97bce5a5eaeca16afb6b3b0ef00bf2a7ebc5903c109b9f4bf6" exitCode=1 Dec 04 12:22:22.310864 master-0 kubenswrapper[35367]: I1204 12:22:22.301476 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-5d764777ff-vcxc5" event={"ID":"a8165365-59aa-419d-a5bf-fc6e97981f19","Type":"ContainerDied","Data":"1978444e095c9b97bce5a5eaeca16afb6b3b0ef00bf2a7ebc5903c109b9f4bf6"} Dec 04 12:22:22.310864 master-0 kubenswrapper[35367]: I1204 12:22:22.303557 35367 scope.go:117] "RemoveContainer" containerID="1978444e095c9b97bce5a5eaeca16afb6b3b0ef00bf2a7ebc5903c109b9f4bf6" Dec 04 12:22:22.328170 master-0 kubenswrapper[35367]: I1204 12:22:22.328085 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-7f6fdfb78f-cclgs" event={"ID":"e0332e93-b2ea-4249-89f2-f80e10238ac9","Type":"ContainerStarted","Data":"4a96fb7ff0c5cfc6eecb3c1df19f57dc748350fe24d2fd98a3023fafa6e00a1b"} Dec 04 12:22:22.328170 master-0 kubenswrapper[35367]: I1204 12:22:22.328163 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-7f6fdfb78f-cclgs" event={"ID":"e0332e93-b2ea-4249-89f2-f80e10238ac9","Type":"ContainerStarted","Data":"6734cab0abc99f369f4e5e6666bad4a8eea9fbfc9023b9223347f5fa3c55c6de"} Dec 04 12:22:22.772470 master-0 kubenswrapper[35367]: I1204 12:22:22.772213 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" Dec 04 12:22:22.802058 master-0 kubenswrapper[35367]: I1204 12:22:22.801954 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ironic-7f6fdfb78f-cclgs" podStartSLOduration=4.801927563 podStartE2EDuration="4.801927563s" podCreationTimestamp="2025-12-04 12:22:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:22:22.378639387 +0000 UTC m=+1385.816700645" watchObservedRunningTime="2025-12-04 12:22:22.801927563 +0000 UTC m=+1386.239988821" Dec 04 12:22:23.224833 master-0 kubenswrapper[35367]: I1204 12:22:23.221742 35367 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:23.351146 master-0 kubenswrapper[35367]: I1204 12:22:23.351041 35367 generic.go:334] "Generic (PLEG): container finished" podID="60937ace-8171-4692-a7a8-75df15eeb551" containerID="51c3f815efe8703773cdeb5af8770181fb823b6950816f223f890e658e8af1dc" exitCode=1 Dec 04 12:22:23.351767 master-0 kubenswrapper[35367]: I1204 12:22:23.351151 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" event={"ID":"60937ace-8171-4692-a7a8-75df15eeb551","Type":"ContainerDied","Data":"51c3f815efe8703773cdeb5af8770181fb823b6950816f223f890e658e8af1dc"} Dec 04 12:22:23.352269 master-0 kubenswrapper[35367]: I1204 12:22:23.352223 35367 scope.go:117] "RemoveContainer" containerID="51c3f815efe8703773cdeb5af8770181fb823b6950816f223f890e658e8af1dc" Dec 04 12:22:23.355178 master-0 kubenswrapper[35367]: I1204 12:22:23.355104 35367 generic.go:334] "Generic (PLEG): container finished" podID="822f5f37-f2cc-4473-9544-0fb50d3d9266" containerID="ae9697ff9eabe1c1ef6ebdcc5f6c8d2e0c0f6d466a0c7a8c1fc226aeb9be9265" exitCode=0 Dec 04 12:22:23.355279 master-0 kubenswrapper[35367]: I1204 12:22:23.355202 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-conductor-0" event={"ID":"822f5f37-f2cc-4473-9544-0fb50d3d9266","Type":"ContainerDied","Data":"ae9697ff9eabe1c1ef6ebdcc5f6c8d2e0c0f6d466a0c7a8c1fc226aeb9be9265"} Dec 04 12:22:23.363352 master-0 kubenswrapper[35367]: I1204 12:22:23.363300 35367 generic.go:334] "Generic (PLEG): container finished" podID="a8165365-59aa-419d-a5bf-fc6e97981f19" containerID="5b06cebaf37510f59857b8f0285b1c1f0f76baf63e182b05b48cf3d7a630392e" exitCode=1 Dec 04 12:22:23.363515 master-0 kubenswrapper[35367]: I1204 12:22:23.363486 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-5d764777ff-vcxc5" event={"ID":"a8165365-59aa-419d-a5bf-fc6e97981f19","Type":"ContainerDied","Data":"5b06cebaf37510f59857b8f0285b1c1f0f76baf63e182b05b48cf3d7a630392e"} Dec 04 12:22:23.363626 master-0 kubenswrapper[35367]: I1204 12:22:23.363609 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:23.366843 master-0 kubenswrapper[35367]: I1204 12:22:23.363683 35367 scope.go:117] "RemoveContainer" containerID="1978444e095c9b97bce5a5eaeca16afb6b3b0ef00bf2a7ebc5903c109b9f4bf6" Dec 04 12:22:23.366843 master-0 kubenswrapper[35367]: I1204 12:22:23.364556 35367 scope.go:117] "RemoveContainer" containerID="5b06cebaf37510f59857b8f0285b1c1f0f76baf63e182b05b48cf3d7a630392e" Dec 04 12:22:23.366843 master-0 kubenswrapper[35367]: E1204 12:22:23.365045 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ironic-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=ironic-api pod=ironic-5d764777ff-vcxc5_openstack(a8165365-59aa-419d-a5bf-fc6e97981f19)\"" pod="openstack/ironic-5d764777ff-vcxc5" podUID="a8165365-59aa-419d-a5bf-fc6e97981f19" Dec 04 12:22:24.371712 master-0 kubenswrapper[35367]: I1204 12:22:24.371534 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:24.383535 master-0 kubenswrapper[35367]: I1204 12:22:24.382917 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" event={"ID":"60937ace-8171-4692-a7a8-75df15eeb551","Type":"ContainerStarted","Data":"c699b6b1a822fa92db5217d8455e49c923287471c83b0cbaba5fd782e61cfedf"} Dec 04 12:22:24.383535 master-0 kubenswrapper[35367]: I1204 12:22:24.383179 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" Dec 04 12:22:24.392172 master-0 kubenswrapper[35367]: I1204 12:22:24.390375 35367 scope.go:117] "RemoveContainer" containerID="5b06cebaf37510f59857b8f0285b1c1f0f76baf63e182b05b48cf3d7a630392e" Dec 04 12:22:24.392172 master-0 kubenswrapper[35367]: E1204 12:22:24.390682 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ironic-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=ironic-api pod=ironic-5d764777ff-vcxc5_openstack(a8165365-59aa-419d-a5bf-fc6e97981f19)\"" pod="openstack/ironic-5d764777ff-vcxc5" podUID="a8165365-59aa-419d-a5bf-fc6e97981f19" Dec 04 12:22:24.606740 master-0 kubenswrapper[35367]: I1204 12:22:24.606370 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/swift-proxy-548cfff678-vw66t"] Dec 04 12:22:24.609398 master-0 kubenswrapper[35367]: I1204 12:22:24.609033 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.617841 master-0 kubenswrapper[35367]: I1204 12:22:24.616491 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-swift-public-svc" Dec 04 12:22:24.617841 master-0 kubenswrapper[35367]: I1204 12:22:24.616952 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"swift-proxy-config-data" Dec 04 12:22:24.617841 master-0 kubenswrapper[35367]: I1204 12:22:24.617592 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-swift-internal-svc" Dec 04 12:22:24.672050 master-0 kubenswrapper[35367]: I1204 12:22:24.640125 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/swift-proxy-548cfff678-vw66t"] Dec 04 12:22:24.699542 master-0 kubenswrapper[35367]: I1204 12:22:24.699359 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr2x5\" (UniqueName: \"kubernetes.io/projected/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-kube-api-access-gr2x5\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.699542 master-0 kubenswrapper[35367]: I1204 12:22:24.699481 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-config-data\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.699542 master-0 kubenswrapper[35367]: I1204 12:22:24.699528 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-public-tls-certs\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.699932 master-0 kubenswrapper[35367]: I1204 12:22:24.699583 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-etc-swift\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.699932 master-0 kubenswrapper[35367]: I1204 12:22:24.699601 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-internal-tls-certs\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.699932 master-0 kubenswrapper[35367]: I1204 12:22:24.699642 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-run-httpd\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.699932 master-0 kubenswrapper[35367]: I1204 12:22:24.699677 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-log-httpd\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.699932 master-0 kubenswrapper[35367]: I1204 12:22:24.699922 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-combined-ca-bundle\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.726316 master-0 kubenswrapper[35367]: I1204 12:22:24.726162 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/cinder-0c69e-scheduler-0" Dec 04 12:22:24.808939 master-0 kubenswrapper[35367]: I1204 12:22:24.808405 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-combined-ca-bundle\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.808939 master-0 kubenswrapper[35367]: I1204 12:22:24.808488 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gr2x5\" (UniqueName: \"kubernetes.io/projected/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-kube-api-access-gr2x5\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.808939 master-0 kubenswrapper[35367]: I1204 12:22:24.808787 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-config-data\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.808939 master-0 kubenswrapper[35367]: I1204 12:22:24.808858 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-public-tls-certs\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.813630 master-0 kubenswrapper[35367]: I1204 12:22:24.810838 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-etc-swift\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.813630 master-0 kubenswrapper[35367]: I1204 12:22:24.811058 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-internal-tls-certs\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.815455 master-0 kubenswrapper[35367]: I1204 12:22:24.815400 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-public-tls-certs\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.815455 master-0 kubenswrapper[35367]: I1204 12:22:24.815398 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-combined-ca-bundle\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.815455 master-0 kubenswrapper[35367]: I1204 12:22:24.815398 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-internal-tls-certs\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.815610 master-0 kubenswrapper[35367]: I1204 12:22:24.815578 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-run-httpd\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.815677 master-0 kubenswrapper[35367]: I1204 12:22:24.815656 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-log-httpd\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.816056 master-0 kubenswrapper[35367]: I1204 12:22:24.816006 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-run-httpd\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.817232 master-0 kubenswrapper[35367]: I1204 12:22:24.817125 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-log-httpd\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.819793 master-0 kubenswrapper[35367]: I1204 12:22:24.819394 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-config-data\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.820145 master-0 kubenswrapper[35367]: I1204 12:22:24.820075 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-etc-swift\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.829146 master-0 kubenswrapper[35367]: I1204 12:22:24.829073 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr2x5\" (UniqueName: \"kubernetes.io/projected/a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6-kube-api-access-gr2x5\") pod \"swift-proxy-548cfff678-vw66t\" (UID: \"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6\") " pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:24.973462 master-0 kubenswrapper[35367]: I1204 12:22:24.973399 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:25.638833 master-0 kubenswrapper[35367]: I1204 12:22:25.638211 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/swift-proxy-548cfff678-vw66t"] Dec 04 12:22:25.731785 master-0 kubenswrapper[35367]: I1204 12:22:25.731664 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/neutron-5b756f7d96-fzd2s" Dec 04 12:22:26.495412 master-0 kubenswrapper[35367]: I1204 12:22:26.495333 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ironic-7f6fdfb78f-cclgs" Dec 04 12:22:27.732680 master-0 kubenswrapper[35367]: E1204 12:22:27.732603 35367 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c699b6b1a822fa92db5217d8455e49c923287471c83b0cbaba5fd782e61cfedf is running failed: container process not found" containerID="c699b6b1a822fa92db5217d8455e49c923287471c83b0cbaba5fd782e61cfedf" cmd=["/bin/true"] Dec 04 12:22:27.733304 master-0 kubenswrapper[35367]: E1204 12:22:27.732745 35367 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c699b6b1a822fa92db5217d8455e49c923287471c83b0cbaba5fd782e61cfedf is running failed: container process not found" containerID="c699b6b1a822fa92db5217d8455e49c923287471c83b0cbaba5fd782e61cfedf" cmd=["/bin/true"] Dec 04 12:22:27.733528 master-0 kubenswrapper[35367]: E1204 12:22:27.733461 35367 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c699b6b1a822fa92db5217d8455e49c923287471c83b0cbaba5fd782e61cfedf is running failed: container process not found" containerID="c699b6b1a822fa92db5217d8455e49c923287471c83b0cbaba5fd782e61cfedf" cmd=["/bin/true"] Dec 04 12:22:27.733528 master-0 kubenswrapper[35367]: E1204 12:22:27.733508 35367 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c699b6b1a822fa92db5217d8455e49c923287471c83b0cbaba5fd782e61cfedf is running failed: container process not found" containerID="c699b6b1a822fa92db5217d8455e49c923287471c83b0cbaba5fd782e61cfedf" cmd=["/bin/true"] Dec 04 12:22:27.733940 master-0 kubenswrapper[35367]: E1204 12:22:27.733914 35367 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c699b6b1a822fa92db5217d8455e49c923287471c83b0cbaba5fd782e61cfedf is running failed: container process not found" containerID="c699b6b1a822fa92db5217d8455e49c923287471c83b0cbaba5fd782e61cfedf" cmd=["/bin/true"] Dec 04 12:22:27.734003 master-0 kubenswrapper[35367]: E1204 12:22:27.733921 35367 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c699b6b1a822fa92db5217d8455e49c923287471c83b0cbaba5fd782e61cfedf is running failed: container process not found" containerID="c699b6b1a822fa92db5217d8455e49c923287471c83b0cbaba5fd782e61cfedf" cmd=["/bin/true"] Dec 04 12:22:27.734003 master-0 kubenswrapper[35367]: E1204 12:22:27.733946 35367 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c699b6b1a822fa92db5217d8455e49c923287471c83b0cbaba5fd782e61cfedf is running failed: container process not found" probeType="Liveness" pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" podUID="60937ace-8171-4692-a7a8-75df15eeb551" containerName="ironic-neutron-agent" Dec 04 12:22:27.734003 master-0 kubenswrapper[35367]: E1204 12:22:27.733963 35367 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c699b6b1a822fa92db5217d8455e49c923287471c83b0cbaba5fd782e61cfedf is running failed: container process not found" probeType="Readiness" pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" podUID="60937ace-8171-4692-a7a8-75df15eeb551" containerName="ironic-neutron-agent" Dec 04 12:22:27.840662 master-0 kubenswrapper[35367]: I1204 12:22:27.840608 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:28.221178 master-0 kubenswrapper[35367]: I1204 12:22:28.220921 35367 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:28.221178 master-0 kubenswrapper[35367]: I1204 12:22:28.221002 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:28.222326 master-0 kubenswrapper[35367]: I1204 12:22:28.222280 35367 scope.go:117] "RemoveContainer" containerID="5b06cebaf37510f59857b8f0285b1c1f0f76baf63e182b05b48cf3d7a630392e" Dec 04 12:22:28.222665 master-0 kubenswrapper[35367]: E1204 12:22:28.222636 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ironic-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=ironic-api pod=ironic-5d764777ff-vcxc5_openstack(a8165365-59aa-419d-a5bf-fc6e97981f19)\"" pod="openstack/ironic-5d764777ff-vcxc5" podUID="a8165365-59aa-419d-a5bf-fc6e97981f19" Dec 04 12:22:29.508999 master-0 kubenswrapper[35367]: I1204 12:22:29.508865 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-5d764777ff-vcxc5"] Dec 04 12:22:29.511156 master-0 kubenswrapper[35367]: I1204 12:22:29.509597 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/ironic-5d764777ff-vcxc5" podUID="a8165365-59aa-419d-a5bf-fc6e97981f19" containerName="ironic-api-log" containerID="cri-o://5fc609ecacc8d45bba12372a7fba933551c96188233d88526e43db685e5462f2" gracePeriod=60 Dec 04 12:22:29.605346 master-0 kubenswrapper[35367]: I1204 12:22:29.602561 35367 generic.go:334] "Generic (PLEG): container finished" podID="60937ace-8171-4692-a7a8-75df15eeb551" containerID="c699b6b1a822fa92db5217d8455e49c923287471c83b0cbaba5fd782e61cfedf" exitCode=1 Dec 04 12:22:29.605346 master-0 kubenswrapper[35367]: I1204 12:22:29.602637 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" event={"ID":"60937ace-8171-4692-a7a8-75df15eeb551","Type":"ContainerDied","Data":"c699b6b1a822fa92db5217d8455e49c923287471c83b0cbaba5fd782e61cfedf"} Dec 04 12:22:29.605346 master-0 kubenswrapper[35367]: I1204 12:22:29.602684 35367 scope.go:117] "RemoveContainer" containerID="51c3f815efe8703773cdeb5af8770181fb823b6950816f223f890e658e8af1dc" Dec 04 12:22:29.616438 master-0 kubenswrapper[35367]: I1204 12:22:29.614990 35367 scope.go:117] "RemoveContainer" containerID="c699b6b1a822fa92db5217d8455e49c923287471c83b0cbaba5fd782e61cfedf" Dec 04 12:22:29.620176 master-0 kubenswrapper[35367]: E1204 12:22:29.620074 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ironic-neutron-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=ironic-neutron-agent pod=ironic-neutron-agent-776b955f8c-hd9lh_openstack(60937ace-8171-4692-a7a8-75df15eeb551)\"" pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" podUID="60937ace-8171-4692-a7a8-75df15eeb551" Dec 04 12:22:29.645601 master-0 kubenswrapper[35367]: I1204 12:22:29.643323 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-597ccf57f9-r8p69"] Dec 04 12:22:29.645601 master-0 kubenswrapper[35367]: I1204 12:22:29.643739 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" podUID="f2a286f2-4ada-485a-97db-414518e8621e" containerName="dnsmasq-dns" containerID="cri-o://b03e1245627d8a899bc2d5efdd20a1280c5385b0bb784ed6ab02f4b30a72bcf6" gracePeriod=10 Dec 04 12:22:29.714124 master-0 kubenswrapper[35367]: I1204 12:22:29.714039 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-inspector-db-sync-wxhxv"] Dec 04 12:22:29.717631 master-0 kubenswrapper[35367]: I1204 12:22:29.717583 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:29.723570 master-0 kubenswrapper[35367]: I1204 12:22:29.723525 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-inspector-config-data" Dec 04 12:22:29.723973 master-0 kubenswrapper[35367]: I1204 12:22:29.723828 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-inspector-scripts" Dec 04 12:22:29.773368 master-0 kubenswrapper[35367]: I1204 12:22:29.770947 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-inspector-db-sync-wxhxv"] Dec 04 12:22:29.824983 master-0 kubenswrapper[35367]: I1204 12:22:29.824630 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-etc-podinfo\") pod \"ironic-inspector-db-sync-wxhxv\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:29.825336 master-0 kubenswrapper[35367]: I1204 12:22:29.825289 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlsn6\" (UniqueName: \"kubernetes.io/projected/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-kube-api-access-zlsn6\") pod \"ironic-inspector-db-sync-wxhxv\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:29.825440 master-0 kubenswrapper[35367]: I1204 12:22:29.825381 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-config\") pod \"ironic-inspector-db-sync-wxhxv\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:29.825495 master-0 kubenswrapper[35367]: I1204 12:22:29.825438 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"ironic-inspector-db-sync-wxhxv\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:29.826008 master-0 kubenswrapper[35367]: I1204 12:22:29.825849 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-scripts\") pod \"ironic-inspector-db-sync-wxhxv\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:29.826008 master-0 kubenswrapper[35367]: I1204 12:22:29.825938 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-combined-ca-bundle\") pod \"ironic-inspector-db-sync-wxhxv\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:29.830017 master-0 kubenswrapper[35367]: I1204 12:22:29.828315 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-var-lib-ironic\") pod \"ironic-inspector-db-sync-wxhxv\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:29.933500 master-0 kubenswrapper[35367]: I1204 12:22:29.933403 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-scripts\") pod \"ironic-inspector-db-sync-wxhxv\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:29.933832 master-0 kubenswrapper[35367]: I1204 12:22:29.933668 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-combined-ca-bundle\") pod \"ironic-inspector-db-sync-wxhxv\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:29.934018 master-0 kubenswrapper[35367]: I1204 12:22:29.933991 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-var-lib-ironic\") pod \"ironic-inspector-db-sync-wxhxv\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:29.935420 master-0 kubenswrapper[35367]: I1204 12:22:29.934302 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-etc-podinfo\") pod \"ironic-inspector-db-sync-wxhxv\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:29.935420 master-0 kubenswrapper[35367]: I1204 12:22:29.934472 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zlsn6\" (UniqueName: \"kubernetes.io/projected/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-kube-api-access-zlsn6\") pod \"ironic-inspector-db-sync-wxhxv\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:29.935420 master-0 kubenswrapper[35367]: I1204 12:22:29.934610 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-config\") pod \"ironic-inspector-db-sync-wxhxv\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:29.935420 master-0 kubenswrapper[35367]: I1204 12:22:29.934652 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"ironic-inspector-db-sync-wxhxv\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:29.935420 master-0 kubenswrapper[35367]: I1204 12:22:29.934915 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-var-lib-ironic\") pod \"ironic-inspector-db-sync-wxhxv\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:29.935420 master-0 kubenswrapper[35367]: I1204 12:22:29.935122 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"ironic-inspector-db-sync-wxhxv\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:29.939655 master-0 kubenswrapper[35367]: I1204 12:22:29.939546 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-etc-podinfo\") pod \"ironic-inspector-db-sync-wxhxv\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:29.943463 master-0 kubenswrapper[35367]: I1204 12:22:29.941515 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-config\") pod \"ironic-inspector-db-sync-wxhxv\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:29.943463 master-0 kubenswrapper[35367]: I1204 12:22:29.942109 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-scripts\") pod \"ironic-inspector-db-sync-wxhxv\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:29.951642 master-0 kubenswrapper[35367]: I1204 12:22:29.951568 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-combined-ca-bundle\") pod \"ironic-inspector-db-sync-wxhxv\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:29.957404 master-0 kubenswrapper[35367]: I1204 12:22:29.957353 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlsn6\" (UniqueName: \"kubernetes.io/projected/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-kube-api-access-zlsn6\") pod \"ironic-inspector-db-sync-wxhxv\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:30.070837 master-0 kubenswrapper[35367]: I1204 12:22:30.070530 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:30.626836 master-0 kubenswrapper[35367]: I1204 12:22:30.626744 35367 generic.go:334] "Generic (PLEG): container finished" podID="a8165365-59aa-419d-a5bf-fc6e97981f19" containerID="5fc609ecacc8d45bba12372a7fba933551c96188233d88526e43db685e5462f2" exitCode=143 Dec 04 12:22:30.627383 master-0 kubenswrapper[35367]: I1204 12:22:30.626881 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-5d764777ff-vcxc5" event={"ID":"a8165365-59aa-419d-a5bf-fc6e97981f19","Type":"ContainerDied","Data":"5fc609ecacc8d45bba12372a7fba933551c96188233d88526e43db685e5462f2"} Dec 04 12:22:30.630021 master-0 kubenswrapper[35367]: I1204 12:22:30.629974 35367 generic.go:334] "Generic (PLEG): container finished" podID="f2a286f2-4ada-485a-97db-414518e8621e" containerID="b03e1245627d8a899bc2d5efdd20a1280c5385b0bb784ed6ab02f4b30a72bcf6" exitCode=0 Dec 04 12:22:30.630091 master-0 kubenswrapper[35367]: I1204 12:22:30.630030 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" event={"ID":"f2a286f2-4ada-485a-97db-414518e8621e","Type":"ContainerDied","Data":"b03e1245627d8a899bc2d5efdd20a1280c5385b0bb784ed6ab02f4b30a72bcf6"} Dec 04 12:22:30.700096 master-0 kubenswrapper[35367]: I1204 12:22:30.700002 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" podUID="f2a286f2-4ada-485a-97db-414518e8621e" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.128.0.255:5353: connect: connection refused" Dec 04 12:22:30.922763 master-0 kubenswrapper[35367]: W1204 12:22:30.922698 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6d3234c_5af0_41d4_8fd2_3f3357e2f3e6.slice/crio-48a50a942005bb9705f7c44ec7d180ab21a2745c1d595d107672be69f6e293f4 WatchSource:0}: Error finding container 48a50a942005bb9705f7c44ec7d180ab21a2745c1d595d107672be69f6e293f4: Status 404 returned error can't find the container with id 48a50a942005bb9705f7c44ec7d180ab21a2745c1d595d107672be69f6e293f4 Dec 04 12:22:31.543905 master-0 kubenswrapper[35367]: I1204 12:22:31.543453 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-0c69e-default-external-api-0"] Dec 04 12:22:31.544165 master-0 kubenswrapper[35367]: I1204 12:22:31.543999 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/glance-0c69e-default-external-api-0" podUID="2811f60c-87a0-4438-96b6-a19e9d8a5b6a" containerName="glance-log" containerID="cri-o://cdc0396c2487a84e8966f80f5ff54e0c6a4b2047e4a265d4bb08e82502a9aa90" gracePeriod=30 Dec 04 12:22:31.550001 master-0 kubenswrapper[35367]: I1204 12:22:31.544402 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/glance-0c69e-default-external-api-0" podUID="2811f60c-87a0-4438-96b6-a19e9d8a5b6a" containerName="glance-httpd" containerID="cri-o://f9347c31ff229c8d7ffcbf80a45550af30f3e14a3c456160cd0e8a6e2b89d47b" gracePeriod=30 Dec 04 12:22:31.673830 master-0 kubenswrapper[35367]: I1204 12:22:31.673711 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-proxy-548cfff678-vw66t" event={"ID":"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6","Type":"ContainerStarted","Data":"48a50a942005bb9705f7c44ec7d180ab21a2745c1d595d107672be69f6e293f4"} Dec 04 12:22:31.742575 master-0 kubenswrapper[35367]: I1204 12:22:31.742520 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/neutron-ccdfc9489-s67vx" Dec 04 12:22:31.988757 master-0 kubenswrapper[35367]: I1204 12:22:31.988612 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/neutron-5b756f7d96-fzd2s"] Dec 04 12:22:31.992736 master-0 kubenswrapper[35367]: I1204 12:22:31.989067 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/neutron-5b756f7d96-fzd2s" podUID="6bc1884b-12c9-49ac-bdfe-106e815f94a3" containerName="neutron-api" containerID="cri-o://4393b01cf32532990704afbc04e04d92d5b4683cbe5402d55d70c628a4a61a97" gracePeriod=30 Dec 04 12:22:31.992736 master-0 kubenswrapper[35367]: I1204 12:22:31.989334 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/neutron-5b756f7d96-fzd2s" podUID="6bc1884b-12c9-49ac-bdfe-106e815f94a3" containerName="neutron-httpd" containerID="cri-o://62555a02a83fec002b982218db9ce3b56f380cab92b2d92a6fc3850cbbcf8bc8" gracePeriod=30 Dec 04 12:22:32.720180 master-0 kubenswrapper[35367]: I1204 12:22:32.711773 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-0c69e-default-internal-api-0"] Dec 04 12:22:32.720180 master-0 kubenswrapper[35367]: I1204 12:22:32.713709 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/glance-0c69e-default-internal-api-0" podUID="55e3f630-c2c3-49ee-950b-ce9301018170" containerName="glance-httpd" containerID="cri-o://b522ce1baa53af37db7bea93b6c278b3fd0dadb6babeac6d5037b2a76e3c06f0" gracePeriod=30 Dec 04 12:22:32.720180 master-0 kubenswrapper[35367]: I1204 12:22:32.719586 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/glance-0c69e-default-internal-api-0" podUID="55e3f630-c2c3-49ee-950b-ce9301018170" containerName="glance-log" containerID="cri-o://b48f1aa23617dfbd2c90cfe5e203205569b5b3b00e05485f4e021f009a0262f8" gracePeriod=30 Dec 04 12:22:32.732994 master-0 kubenswrapper[35367]: I1204 12:22:32.732685 35367 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" Dec 04 12:22:32.734270 master-0 kubenswrapper[35367]: I1204 12:22:32.734151 35367 scope.go:117] "RemoveContainer" containerID="c699b6b1a822fa92db5217d8455e49c923287471c83b0cbaba5fd782e61cfedf" Dec 04 12:22:32.734727 master-0 kubenswrapper[35367]: E1204 12:22:32.734668 35367 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ironic-neutron-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=ironic-neutron-agent pod=ironic-neutron-agent-776b955f8c-hd9lh_openstack(60937ace-8171-4692-a7a8-75df15eeb551)\"" pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" podUID="60937ace-8171-4692-a7a8-75df15eeb551" Dec 04 12:22:32.736482 master-0 kubenswrapper[35367]: I1204 12:22:32.736228 35367 generic.go:334] "Generic (PLEG): container finished" podID="2811f60c-87a0-4438-96b6-a19e9d8a5b6a" containerID="cdc0396c2487a84e8966f80f5ff54e0c6a4b2047e4a265d4bb08e82502a9aa90" exitCode=143 Dec 04 12:22:32.736482 master-0 kubenswrapper[35367]: I1204 12:22:32.736307 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-0c69e-default-external-api-0" event={"ID":"2811f60c-87a0-4438-96b6-a19e9d8a5b6a","Type":"ContainerDied","Data":"cdc0396c2487a84e8966f80f5ff54e0c6a4b2047e4a265d4bb08e82502a9aa90"} Dec 04 12:22:32.749004 master-0 kubenswrapper[35367]: I1204 12:22:32.748931 35367 generic.go:334] "Generic (PLEG): container finished" podID="6bc1884b-12c9-49ac-bdfe-106e815f94a3" containerID="62555a02a83fec002b982218db9ce3b56f380cab92b2d92a6fc3850cbbcf8bc8" exitCode=0 Dec 04 12:22:32.790427 master-0 kubenswrapper[35367]: I1204 12:22:32.790294 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-5b756f7d96-fzd2s" event={"ID":"6bc1884b-12c9-49ac-bdfe-106e815f94a3","Type":"ContainerDied","Data":"62555a02a83fec002b982218db9ce3b56f380cab92b2d92a6fc3850cbbcf8bc8"} Dec 04 12:22:33.406509 master-0 kubenswrapper[35367]: I1204 12:22:33.405318 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:22:33.412780 master-0 kubenswrapper[35367]: I1204 12:22:33.412184 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:33.570555 master-0 kubenswrapper[35367]: I1204 12:22:33.570477 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-ovsdbserver-nb\") pod \"f2a286f2-4ada-485a-97db-414518e8621e\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " Dec 04 12:22:33.570555 master-0 kubenswrapper[35367]: I1204 12:22:33.570552 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pq4w\" (UniqueName: \"kubernetes.io/projected/a8165365-59aa-419d-a5bf-fc6e97981f19-kube-api-access-9pq4w\") pod \"a8165365-59aa-419d-a5bf-fc6e97981f19\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " Dec 04 12:22:33.571240 master-0 kubenswrapper[35367]: I1204 12:22:33.570615 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-scripts\") pod \"a8165365-59aa-419d-a5bf-fc6e97981f19\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " Dec 04 12:22:33.571240 master-0 kubenswrapper[35367]: I1204 12:22:33.570729 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/a8165365-59aa-419d-a5bf-fc6e97981f19-config-data-merged\") pod \"a8165365-59aa-419d-a5bf-fc6e97981f19\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " Dec 04 12:22:33.571240 master-0 kubenswrapper[35367]: I1204 12:22:33.570928 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-config-data\") pod \"a8165365-59aa-419d-a5bf-fc6e97981f19\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " Dec 04 12:22:33.571240 master-0 kubenswrapper[35367]: I1204 12:22:33.570957 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wf8mp\" (UniqueName: \"kubernetes.io/projected/f2a286f2-4ada-485a-97db-414518e8621e-kube-api-access-wf8mp\") pod \"f2a286f2-4ada-485a-97db-414518e8621e\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " Dec 04 12:22:33.571240 master-0 kubenswrapper[35367]: I1204 12:22:33.571010 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a8165365-59aa-419d-a5bf-fc6e97981f19-logs\") pod \"a8165365-59aa-419d-a5bf-fc6e97981f19\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " Dec 04 12:22:33.571240 master-0 kubenswrapper[35367]: I1204 12:22:33.571156 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-dns-svc\") pod \"f2a286f2-4ada-485a-97db-414518e8621e\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " Dec 04 12:22:33.571240 master-0 kubenswrapper[35367]: I1204 12:22:33.571202 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8165365-59aa-419d-a5bf-fc6e97981f19-etc-podinfo\") pod \"a8165365-59aa-419d-a5bf-fc6e97981f19\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " Dec 04 12:22:33.571240 master-0 kubenswrapper[35367]: I1204 12:22:33.571231 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-combined-ca-bundle\") pod \"a8165365-59aa-419d-a5bf-fc6e97981f19\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " Dec 04 12:22:33.572626 master-0 kubenswrapper[35367]: I1204 12:22:33.571286 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-dns-swift-storage-0\") pod \"f2a286f2-4ada-485a-97db-414518e8621e\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " Dec 04 12:22:33.572626 master-0 kubenswrapper[35367]: I1204 12:22:33.571487 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-config-data-custom\") pod \"a8165365-59aa-419d-a5bf-fc6e97981f19\" (UID: \"a8165365-59aa-419d-a5bf-fc6e97981f19\") " Dec 04 12:22:33.572626 master-0 kubenswrapper[35367]: I1204 12:22:33.571530 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-config\") pod \"f2a286f2-4ada-485a-97db-414518e8621e\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " Dec 04 12:22:33.572626 master-0 kubenswrapper[35367]: I1204 12:22:33.571612 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-ovsdbserver-sb\") pod \"f2a286f2-4ada-485a-97db-414518e8621e\" (UID: \"f2a286f2-4ada-485a-97db-414518e8621e\") " Dec 04 12:22:33.572626 master-0 kubenswrapper[35367]: I1204 12:22:33.572114 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8165365-59aa-419d-a5bf-fc6e97981f19-config-data-merged" (OuterVolumeSpecName: "config-data-merged") pod "a8165365-59aa-419d-a5bf-fc6e97981f19" (UID: "a8165365-59aa-419d-a5bf-fc6e97981f19"). InnerVolumeSpecName "config-data-merged". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:22:33.572626 master-0 kubenswrapper[35367]: I1204 12:22:33.572572 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8165365-59aa-419d-a5bf-fc6e97981f19-logs" (OuterVolumeSpecName: "logs") pod "a8165365-59aa-419d-a5bf-fc6e97981f19" (UID: "a8165365-59aa-419d-a5bf-fc6e97981f19"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:22:33.573344 master-0 kubenswrapper[35367]: I1204 12:22:33.573313 35367 reconciler_common.go:293] "Volume detached for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/a8165365-59aa-419d-a5bf-fc6e97981f19-config-data-merged\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:33.573344 master-0 kubenswrapper[35367]: I1204 12:22:33.573339 35367 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a8165365-59aa-419d-a5bf-fc6e97981f19-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:33.576523 master-0 kubenswrapper[35367]: I1204 12:22:33.576308 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2a286f2-4ada-485a-97db-414518e8621e-kube-api-access-wf8mp" (OuterVolumeSpecName: "kube-api-access-wf8mp") pod "f2a286f2-4ada-485a-97db-414518e8621e" (UID: "f2a286f2-4ada-485a-97db-414518e8621e"). InnerVolumeSpecName "kube-api-access-wf8mp". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:33.578876 master-0 kubenswrapper[35367]: I1204 12:22:33.578761 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8165365-59aa-419d-a5bf-fc6e97981f19-kube-api-access-9pq4w" (OuterVolumeSpecName: "kube-api-access-9pq4w") pod "a8165365-59aa-419d-a5bf-fc6e97981f19" (UID: "a8165365-59aa-419d-a5bf-fc6e97981f19"). InnerVolumeSpecName "kube-api-access-9pq4w". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:33.580863 master-0 kubenswrapper[35367]: I1204 12:22:33.580797 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a8165365-59aa-419d-a5bf-fc6e97981f19-etc-podinfo" (OuterVolumeSpecName: "etc-podinfo") pod "a8165365-59aa-419d-a5bf-fc6e97981f19" (UID: "a8165365-59aa-419d-a5bf-fc6e97981f19"). InnerVolumeSpecName "etc-podinfo". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Dec 04 12:22:33.588418 master-0 kubenswrapper[35367]: I1204 12:22:33.588355 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-scripts" (OuterVolumeSpecName: "scripts") pod "a8165365-59aa-419d-a5bf-fc6e97981f19" (UID: "a8165365-59aa-419d-a5bf-fc6e97981f19"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:33.591671 master-0 kubenswrapper[35367]: I1204 12:22:33.591546 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "a8165365-59aa-419d-a5bf-fc6e97981f19" (UID: "a8165365-59aa-419d-a5bf-fc6e97981f19"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:33.677367 master-0 kubenswrapper[35367]: I1204 12:22:33.676089 35367 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-config-data-custom\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:33.677367 master-0 kubenswrapper[35367]: I1204 12:22:33.677307 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9pq4w\" (UniqueName: \"kubernetes.io/projected/a8165365-59aa-419d-a5bf-fc6e97981f19-kube-api-access-9pq4w\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:33.677367 master-0 kubenswrapper[35367]: I1204 12:22:33.677331 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:33.677367 master-0 kubenswrapper[35367]: I1204 12:22:33.677352 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wf8mp\" (UniqueName: \"kubernetes.io/projected/f2a286f2-4ada-485a-97db-414518e8621e-kube-api-access-wf8mp\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:33.677367 master-0 kubenswrapper[35367]: I1204 12:22:33.677363 35367 reconciler_common.go:293] "Volume detached for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8165365-59aa-419d-a5bf-fc6e97981f19-etc-podinfo\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:33.710196 master-0 kubenswrapper[35367]: I1204 12:22:33.710124 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-inspector-db-sync-wxhxv"] Dec 04 12:22:33.754999 master-0 kubenswrapper[35367]: W1204 12:22:33.754384 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa8d8c09_968e_4c52_ac80_fd7a0a1df758.slice/crio-2003d3973f53d25f7d714789ca0526268fc359c5d9a3c9a708f48424d66b0a76 WatchSource:0}: Error finding container 2003d3973f53d25f7d714789ca0526268fc359c5d9a3c9a708f48424d66b0a76: Status 404 returned error can't find the container with id 2003d3973f53d25f7d714789ca0526268fc359c5d9a3c9a708f48424d66b0a76 Dec 04 12:22:33.782955 master-0 kubenswrapper[35367]: I1204 12:22:33.782821 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-5d764777ff-vcxc5" event={"ID":"a8165365-59aa-419d-a5bf-fc6e97981f19","Type":"ContainerDied","Data":"9bfb407a86cdbf0e3009aaa2056bb7856e40e2b71b3bdc6b33a0ba99240220d4"} Dec 04 12:22:33.782955 master-0 kubenswrapper[35367]: I1204 12:22:33.782891 35367 scope.go:117] "RemoveContainer" containerID="5b06cebaf37510f59857b8f0285b1c1f0f76baf63e182b05b48cf3d7a630392e" Dec 04 12:22:33.782955 master-0 kubenswrapper[35367]: I1204 12:22:33.782888 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-5d764777ff-vcxc5" Dec 04 12:22:33.793718 master-0 kubenswrapper[35367]: I1204 12:22:33.792820 35367 generic.go:334] "Generic (PLEG): container finished" podID="6bc1884b-12c9-49ac-bdfe-106e815f94a3" containerID="4393b01cf32532990704afbc04e04d92d5b4683cbe5402d55d70c628a4a61a97" exitCode=0 Dec 04 12:22:33.793718 master-0 kubenswrapper[35367]: I1204 12:22:33.792902 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-5b756f7d96-fzd2s" event={"ID":"6bc1884b-12c9-49ac-bdfe-106e815f94a3","Type":"ContainerDied","Data":"4393b01cf32532990704afbc04e04d92d5b4683cbe5402d55d70c628a4a61a97"} Dec 04 12:22:33.805095 master-0 kubenswrapper[35367]: I1204 12:22:33.804765 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" event={"ID":"f2a286f2-4ada-485a-97db-414518e8621e","Type":"ContainerDied","Data":"3ad69fb90dd4402f57d56039a310ce4534b72459e3d6f197b2706b52a748754f"} Dec 04 12:22:33.805822 master-0 kubenswrapper[35367]: I1204 12:22:33.805762 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-597ccf57f9-r8p69" Dec 04 12:22:33.836994 master-0 kubenswrapper[35367]: I1204 12:22:33.836582 35367 generic.go:334] "Generic (PLEG): container finished" podID="55e3f630-c2c3-49ee-950b-ce9301018170" containerID="b48f1aa23617dfbd2c90cfe5e203205569b5b3b00e05485f4e021f009a0262f8" exitCode=143 Dec 04 12:22:33.836994 master-0 kubenswrapper[35367]: I1204 12:22:33.836644 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-0c69e-default-internal-api-0" event={"ID":"55e3f630-c2c3-49ee-950b-ce9301018170","Type":"ContainerDied","Data":"b48f1aa23617dfbd2c90cfe5e203205569b5b3b00e05485f4e021f009a0262f8"} Dec 04 12:22:33.855360 master-0 kubenswrapper[35367]: I1204 12:22:33.849361 35367 scope.go:117] "RemoveContainer" containerID="5fc609ecacc8d45bba12372a7fba933551c96188233d88526e43db685e5462f2" Dec 04 12:22:33.901045 master-0 kubenswrapper[35367]: I1204 12:22:33.900962 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-config-data" (OuterVolumeSpecName: "config-data") pod "a8165365-59aa-419d-a5bf-fc6e97981f19" (UID: "a8165365-59aa-419d-a5bf-fc6e97981f19"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:33.902932 master-0 kubenswrapper[35367]: I1204 12:22:33.902599 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:33.903635 master-0 kubenswrapper[35367]: I1204 12:22:33.903564 35367 scope.go:117] "RemoveContainer" containerID="0047f897e5892cd89b0f717b9404baa960f3ac5c320a219ef979eab5ed739e39" Dec 04 12:22:33.966604 master-0 kubenswrapper[35367]: I1204 12:22:33.966420 35367 scope.go:117] "RemoveContainer" containerID="b03e1245627d8a899bc2d5efdd20a1280c5385b0bb784ed6ab02f4b30a72bcf6" Dec 04 12:22:33.974385 master-0 kubenswrapper[35367]: I1204 12:22:33.973469 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-config" (OuterVolumeSpecName: "config") pod "f2a286f2-4ada-485a-97db-414518e8621e" (UID: "f2a286f2-4ada-485a-97db-414518e8621e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:33.978515 master-0 kubenswrapper[35367]: I1204 12:22:33.978437 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "f2a286f2-4ada-485a-97db-414518e8621e" (UID: "f2a286f2-4ada-485a-97db-414518e8621e"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:33.987066 master-0 kubenswrapper[35367]: I1204 12:22:33.986871 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "f2a286f2-4ada-485a-97db-414518e8621e" (UID: "f2a286f2-4ada-485a-97db-414518e8621e"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:33.990057 master-0 kubenswrapper[35367]: I1204 12:22:33.989962 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a8165365-59aa-419d-a5bf-fc6e97981f19" (UID: "a8165365-59aa-419d-a5bf-fc6e97981f19"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:34.005543 master-0 kubenswrapper[35367]: I1204 12:22:34.005355 35367 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:34.005543 master-0 kubenswrapper[35367]: I1204 12:22:34.005406 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8165365-59aa-419d-a5bf-fc6e97981f19-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:34.005543 master-0 kubenswrapper[35367]: I1204 12:22:34.005420 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:34.005543 master-0 kubenswrapper[35367]: I1204 12:22:34.005428 35367 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:34.006649 master-0 kubenswrapper[35367]: I1204 12:22:34.006579 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "f2a286f2-4ada-485a-97db-414518e8621e" (UID: "f2a286f2-4ada-485a-97db-414518e8621e"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:34.015651 master-0 kubenswrapper[35367]: I1204 12:22:34.015546 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "f2a286f2-4ada-485a-97db-414518e8621e" (UID: "f2a286f2-4ada-485a-97db-414518e8621e"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:34.031519 master-0 kubenswrapper[35367]: I1204 12:22:34.030887 35367 scope.go:117] "RemoveContainer" containerID="e6eabb30db646a600030b8c5d7436a3445c768fe0ef9f674755812d4b0d2a123" Dec 04 12:22:34.112125 master-0 kubenswrapper[35367]: I1204 12:22:34.108249 35367 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-dns-swift-storage-0\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:34.112125 master-0 kubenswrapper[35367]: I1204 12:22:34.108291 35367 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/f2a286f2-4ada-485a-97db-414518e8621e-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:34.216536 master-0 kubenswrapper[35367]: I1204 12:22:34.216406 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-5b756f7d96-fzd2s" Dec 04 12:22:34.312922 master-0 kubenswrapper[35367]: I1204 12:22:34.312840 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-httpd-config\") pod \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\" (UID: \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\") " Dec 04 12:22:34.313248 master-0 kubenswrapper[35367]: I1204 12:22:34.312979 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-ovndb-tls-certs\") pod \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\" (UID: \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\") " Dec 04 12:22:34.313248 master-0 kubenswrapper[35367]: I1204 12:22:34.313085 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mx27\" (UniqueName: \"kubernetes.io/projected/6bc1884b-12c9-49ac-bdfe-106e815f94a3-kube-api-access-7mx27\") pod \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\" (UID: \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\") " Dec 04 12:22:34.313248 master-0 kubenswrapper[35367]: I1204 12:22:34.313121 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-combined-ca-bundle\") pod \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\" (UID: \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\") " Dec 04 12:22:34.313248 master-0 kubenswrapper[35367]: I1204 12:22:34.313194 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-config\") pod \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\" (UID: \"6bc1884b-12c9-49ac-bdfe-106e815f94a3\") " Dec 04 12:22:34.317763 master-0 kubenswrapper[35367]: I1204 12:22:34.317217 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bc1884b-12c9-49ac-bdfe-106e815f94a3-kube-api-access-7mx27" (OuterVolumeSpecName: "kube-api-access-7mx27") pod "6bc1884b-12c9-49ac-bdfe-106e815f94a3" (UID: "6bc1884b-12c9-49ac-bdfe-106e815f94a3"). InnerVolumeSpecName "kube-api-access-7mx27". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:34.322435 master-0 kubenswrapper[35367]: I1204 12:22:34.322228 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "6bc1884b-12c9-49ac-bdfe-106e815f94a3" (UID: "6bc1884b-12c9-49ac-bdfe-106e815f94a3"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:34.388782 master-0 kubenswrapper[35367]: I1204 12:22:34.385152 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6bc1884b-12c9-49ac-bdfe-106e815f94a3" (UID: "6bc1884b-12c9-49ac-bdfe-106e815f94a3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:34.395568 master-0 kubenswrapper[35367]: I1204 12:22:34.395464 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-config" (OuterVolumeSpecName: "config") pod "6bc1884b-12c9-49ac-bdfe-106e815f94a3" (UID: "6bc1884b-12c9-49ac-bdfe-106e815f94a3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:34.406442 master-0 kubenswrapper[35367]: I1204 12:22:34.406375 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-597ccf57f9-r8p69"] Dec 04 12:22:34.420276 master-0 kubenswrapper[35367]: I1204 12:22:34.419500 35367 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-httpd-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:34.420276 master-0 kubenswrapper[35367]: I1204 12:22:34.419560 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7mx27\" (UniqueName: \"kubernetes.io/projected/6bc1884b-12c9-49ac-bdfe-106e815f94a3-kube-api-access-7mx27\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:34.420276 master-0 kubenswrapper[35367]: I1204 12:22:34.419573 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:34.420276 master-0 kubenswrapper[35367]: I1204 12:22:34.419583 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:34.439916 master-0 kubenswrapper[35367]: I1204 12:22:34.439093 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-597ccf57f9-r8p69"] Dec 04 12:22:34.445193 master-0 kubenswrapper[35367]: I1204 12:22:34.445115 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "6bc1884b-12c9-49ac-bdfe-106e815f94a3" (UID: "6bc1884b-12c9-49ac-bdfe-106e815f94a3"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:34.453909 master-0 kubenswrapper[35367]: I1204 12:22:34.453661 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-5d764777ff-vcxc5"] Dec 04 12:22:34.472937 master-0 kubenswrapper[35367]: I1204 12:22:34.472496 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ironic-5d764777ff-vcxc5"] Dec 04 12:22:34.526149 master-0 kubenswrapper[35367]: I1204 12:22:34.522314 35367 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6bc1884b-12c9-49ac-bdfe-106e815f94a3-ovndb-tls-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:34.776976 master-0 kubenswrapper[35367]: I1204 12:22:34.776823 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8165365-59aa-419d-a5bf-fc6e97981f19" path="/var/lib/kubelet/pods/a8165365-59aa-419d-a5bf-fc6e97981f19/volumes" Dec 04 12:22:34.778068 master-0 kubenswrapper[35367]: I1204 12:22:34.778033 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2a286f2-4ada-485a-97db-414518e8621e" path="/var/lib/kubelet/pods/f2a286f2-4ada-485a-97db-414518e8621e/volumes" Dec 04 12:22:34.867912 master-0 kubenswrapper[35367]: I1204 12:22:34.867838 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-5b756f7d96-fzd2s" event={"ID":"6bc1884b-12c9-49ac-bdfe-106e815f94a3","Type":"ContainerDied","Data":"4e12bb338c62264876a16ea7e6ced219d15c77cf7623c434292242da9f1c472b"} Dec 04 12:22:34.867912 master-0 kubenswrapper[35367]: I1204 12:22:34.867920 35367 scope.go:117] "RemoveContainer" containerID="62555a02a83fec002b982218db9ce3b56f380cab92b2d92a6fc3850cbbcf8bc8" Dec 04 12:22:34.868252 master-0 kubenswrapper[35367]: I1204 12:22:34.868052 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-5b756f7d96-fzd2s" Dec 04 12:22:34.886969 master-0 kubenswrapper[35367]: I1204 12:22:34.886891 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstackclient" event={"ID":"0417aae4-1fcb-4905-9907-c410a9584497","Type":"ContainerStarted","Data":"308eb996d3871c4623be12178392a377c9928c819a485d178a52ff429e959b2e"} Dec 04 12:22:34.903483 master-0 kubenswrapper[35367]: I1204 12:22:34.902009 35367 generic.go:334] "Generic (PLEG): container finished" podID="2811f60c-87a0-4438-96b6-a19e9d8a5b6a" containerID="f9347c31ff229c8d7ffcbf80a45550af30f3e14a3c456160cd0e8a6e2b89d47b" exitCode=0 Dec 04 12:22:34.903483 master-0 kubenswrapper[35367]: I1204 12:22:34.902110 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-0c69e-default-external-api-0" event={"ID":"2811f60c-87a0-4438-96b6-a19e9d8a5b6a","Type":"ContainerDied","Data":"f9347c31ff229c8d7ffcbf80a45550af30f3e14a3c456160cd0e8a6e2b89d47b"} Dec 04 12:22:34.905772 master-0 kubenswrapper[35367]: I1204 12:22:34.905730 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-proxy-548cfff678-vw66t" event={"ID":"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6","Type":"ContainerStarted","Data":"b7614b7026ad71de9d1aef7ea06815cde7598eb48e5f284f887b70b3fac18486"} Dec 04 12:22:34.905976 master-0 kubenswrapper[35367]: I1204 12:22:34.905859 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-proxy-548cfff678-vw66t" event={"ID":"a6d3234c-5af0-41d4-8fd2-3f3357e2f3e6","Type":"ContainerStarted","Data":"049c2fa1e1932a15826b94a6db2a6e05573fa95e07ee641ab6216d18790c222e"} Dec 04 12:22:34.906157 master-0 kubenswrapper[35367]: I1204 12:22:34.906097 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:34.906157 master-0 kubenswrapper[35367]: I1204 12:22:34.906157 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:34.909880 master-0 kubenswrapper[35367]: I1204 12:22:34.909679 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/neutron-5b756f7d96-fzd2s"] Dec 04 12:22:34.922529 master-0 kubenswrapper[35367]: I1204 12:22:34.922479 35367 scope.go:117] "RemoveContainer" containerID="4393b01cf32532990704afbc04e04d92d5b4683cbe5402d55d70c628a4a61a97" Dec 04 12:22:34.922645 master-0 kubenswrapper[35367]: I1204 12:22:34.922560 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-db-sync-wxhxv" event={"ID":"fa8d8c09-968e-4c52-ac80-fd7a0a1df758","Type":"ContainerStarted","Data":"2003d3973f53d25f7d714789ca0526268fc359c5d9a3c9a708f48424d66b0a76"} Dec 04 12:22:34.923770 master-0 kubenswrapper[35367]: I1204 12:22:34.923738 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/neutron-5b756f7d96-fzd2s"] Dec 04 12:22:35.080239 master-0 kubenswrapper[35367]: I1204 12:22:35.080091 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/openstackclient" podStartSLOduration=6.257627999 podStartE2EDuration="20.080062795s" podCreationTimestamp="2025-12-04 12:22:15 +0000 UTC" firstStartedPulling="2025-12-04 12:22:19.386081534 +0000 UTC m=+1382.824142792" lastFinishedPulling="2025-12-04 12:22:33.20851633 +0000 UTC m=+1396.646577588" observedRunningTime="2025-12-04 12:22:35.046693522 +0000 UTC m=+1398.484754780" watchObservedRunningTime="2025-12-04 12:22:35.080062795 +0000 UTC m=+1398.518124053" Dec 04 12:22:35.100312 master-0 kubenswrapper[35367]: I1204 12:22:35.100178 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/swift-proxy-548cfff678-vw66t" podStartSLOduration=11.10015582 podStartE2EDuration="11.10015582s" podCreationTimestamp="2025-12-04 12:22:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:22:35.084226207 +0000 UTC m=+1398.522287465" watchObservedRunningTime="2025-12-04 12:22:35.10015582 +0000 UTC m=+1398.538217078" Dec 04 12:22:35.865209 master-0 kubenswrapper[35367]: I1204 12:22:35.865118 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/glance-0c69e-default-internal-api-0" podUID="55e3f630-c2c3-49ee-950b-ce9301018170" containerName="glance-log" probeResult="failure" output="Get \"https://10.128.0.246:9292/healthcheck\": read tcp 10.128.0.2:54592->10.128.0.246:9292: read: connection reset by peer" Dec 04 12:22:35.865889 master-0 kubenswrapper[35367]: I1204 12:22:35.865228 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/glance-0c69e-default-internal-api-0" podUID="55e3f630-c2c3-49ee-950b-ce9301018170" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.128.0.246:9292/healthcheck\": read tcp 10.128.0.2:54588->10.128.0.246:9292: read: connection reset by peer" Dec 04 12:22:36.201015 master-0 kubenswrapper[35367]: I1204 12:22:36.200958 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:36.320920 master-0 kubenswrapper[35367]: I1204 12:22:36.320733 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctmjd\" (UniqueName: \"kubernetes.io/projected/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-kube-api-access-ctmjd\") pod \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " Dec 04 12:22:36.320920 master-0 kubenswrapper[35367]: I1204 12:22:36.320872 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-httpd-run\") pod \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " Dec 04 12:22:36.320920 master-0 kubenswrapper[35367]: I1204 12:22:36.320922 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-logs\") pod \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " Dec 04 12:22:36.322233 master-0 kubenswrapper[35367]: I1204 12:22:36.321078 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-combined-ca-bundle\") pod \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " Dec 04 12:22:36.322233 master-0 kubenswrapper[35367]: I1204 12:22:36.321255 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-public-tls-certs\") pod \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " Dec 04 12:22:36.322233 master-0 kubenswrapper[35367]: I1204 12:22:36.321421 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-config-data\") pod \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " Dec 04 12:22:36.322233 master-0 kubenswrapper[35367]: I1204 12:22:36.321935 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/csi/topolvm.io^f318c560-8a01-4027-a490-af9e3eba2a4a\") pod \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " Dec 04 12:22:36.322233 master-0 kubenswrapper[35367]: I1204 12:22:36.321971 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-scripts\") pod \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\" (UID: \"2811f60c-87a0-4438-96b6-a19e9d8a5b6a\") " Dec 04 12:22:36.333742 master-0 kubenswrapper[35367]: I1204 12:22:36.333129 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "2811f60c-87a0-4438-96b6-a19e9d8a5b6a" (UID: "2811f60c-87a0-4438-96b6-a19e9d8a5b6a"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:22:36.333742 master-0 kubenswrapper[35367]: I1204 12:22:36.333490 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-logs" (OuterVolumeSpecName: "logs") pod "2811f60c-87a0-4438-96b6-a19e9d8a5b6a" (UID: "2811f60c-87a0-4438-96b6-a19e9d8a5b6a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:22:36.336579 master-0 kubenswrapper[35367]: I1204 12:22:36.336154 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-scripts" (OuterVolumeSpecName: "scripts") pod "2811f60c-87a0-4438-96b6-a19e9d8a5b6a" (UID: "2811f60c-87a0-4438-96b6-a19e9d8a5b6a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:36.337712 master-0 kubenswrapper[35367]: I1204 12:22:36.337169 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-kube-api-access-ctmjd" (OuterVolumeSpecName: "kube-api-access-ctmjd") pod "2811f60c-87a0-4438-96b6-a19e9d8a5b6a" (UID: "2811f60c-87a0-4438-96b6-a19e9d8a5b6a"). InnerVolumeSpecName "kube-api-access-ctmjd". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:36.364981 master-0 kubenswrapper[35367]: I1204 12:22:36.364753 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/topolvm.io^f318c560-8a01-4027-a490-af9e3eba2a4a" (OuterVolumeSpecName: "glance") pod "2811f60c-87a0-4438-96b6-a19e9d8a5b6a" (UID: "2811f60c-87a0-4438-96b6-a19e9d8a5b6a"). InnerVolumeSpecName "pvc-5b3d373a-b38f-44c7-a861-0a8380dfd1e5". PluginName "kubernetes.io/csi", VolumeGidValue "" Dec 04 12:22:36.375921 master-0 kubenswrapper[35367]: I1204 12:22:36.375831 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2811f60c-87a0-4438-96b6-a19e9d8a5b6a" (UID: "2811f60c-87a0-4438-96b6-a19e9d8a5b6a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:36.432154 master-0 kubenswrapper[35367]: I1204 12:22:36.431997 35367 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"pvc-5b3d373a-b38f-44c7-a861-0a8380dfd1e5\" (UniqueName: \"kubernetes.io/csi/topolvm.io^f318c560-8a01-4027-a490-af9e3eba2a4a\") on node \"master-0\" " Dec 04 12:22:36.432154 master-0 kubenswrapper[35367]: I1204 12:22:36.432067 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:36.432154 master-0 kubenswrapper[35367]: I1204 12:22:36.432089 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ctmjd\" (UniqueName: \"kubernetes.io/projected/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-kube-api-access-ctmjd\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:36.432154 master-0 kubenswrapper[35367]: I1204 12:22:36.432102 35367 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-httpd-run\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:36.432154 master-0 kubenswrapper[35367]: I1204 12:22:36.432113 35367 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:36.432154 master-0 kubenswrapper[35367]: I1204 12:22:36.432125 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:36.446545 master-0 kubenswrapper[35367]: I1204 12:22:36.446430 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-config-data" (OuterVolumeSpecName: "config-data") pod "2811f60c-87a0-4438-96b6-a19e9d8a5b6a" (UID: "2811f60c-87a0-4438-96b6-a19e9d8a5b6a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:36.479554 master-0 kubenswrapper[35367]: I1204 12:22:36.479497 35367 csi_attacher.go:630] kubernetes.io/csi: attacher.UnmountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping UnmountDevice... Dec 04 12:22:36.479903 master-0 kubenswrapper[35367]: I1204 12:22:36.479678 35367 operation_generator.go:917] UnmountDevice succeeded for volume "pvc-5b3d373a-b38f-44c7-a861-0a8380dfd1e5" (UniqueName: "kubernetes.io/csi/topolvm.io^f318c560-8a01-4027-a490-af9e3eba2a4a") on node "master-0" Dec 04 12:22:36.481556 master-0 kubenswrapper[35367]: I1204 12:22:36.481478 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2811f60c-87a0-4438-96b6-a19e9d8a5b6a" (UID: "2811f60c-87a0-4438-96b6-a19e9d8a5b6a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:36.537046 master-0 kubenswrapper[35367]: I1204 12:22:36.536660 35367 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-public-tls-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:36.537046 master-0 kubenswrapper[35367]: I1204 12:22:36.537041 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2811f60c-87a0-4438-96b6-a19e9d8a5b6a-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:36.537046 master-0 kubenswrapper[35367]: I1204 12:22:36.537059 35367 reconciler_common.go:293] "Volume detached for volume \"pvc-5b3d373a-b38f-44c7-a861-0a8380dfd1e5\" (UniqueName: \"kubernetes.io/csi/topolvm.io^f318c560-8a01-4027-a490-af9e3eba2a4a\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:36.659522 master-0 kubenswrapper[35367]: I1204 12:22:36.659457 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:36.744489 master-0 kubenswrapper[35367]: I1204 12:22:36.743464 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-config-data\") pod \"55e3f630-c2c3-49ee-950b-ce9301018170\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " Dec 04 12:22:36.744489 master-0 kubenswrapper[35367]: I1204 12:22:36.743668 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-internal-tls-certs\") pod \"55e3f630-c2c3-49ee-950b-ce9301018170\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " Dec 04 12:22:36.744489 master-0 kubenswrapper[35367]: I1204 12:22:36.743715 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-scripts\") pod \"55e3f630-c2c3-49ee-950b-ce9301018170\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " Dec 04 12:22:36.744489 master-0 kubenswrapper[35367]: I1204 12:22:36.743936 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/55e3f630-c2c3-49ee-950b-ce9301018170-logs\") pod \"55e3f630-c2c3-49ee-950b-ce9301018170\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " Dec 04 12:22:36.745015 master-0 kubenswrapper[35367]: I1204 12:22:36.744536 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55e3f630-c2c3-49ee-950b-ce9301018170-logs" (OuterVolumeSpecName: "logs") pod "55e3f630-c2c3-49ee-950b-ce9301018170" (UID: "55e3f630-c2c3-49ee-950b-ce9301018170"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:22:36.745015 master-0 kubenswrapper[35367]: I1204 12:22:36.744687 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2v8rg\" (UniqueName: \"kubernetes.io/projected/55e3f630-c2c3-49ee-950b-ce9301018170-kube-api-access-2v8rg\") pod \"55e3f630-c2c3-49ee-950b-ce9301018170\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " Dec 04 12:22:36.745262 master-0 kubenswrapper[35367]: I1204 12:22:36.745225 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/55e3f630-c2c3-49ee-950b-ce9301018170-httpd-run\") pod \"55e3f630-c2c3-49ee-950b-ce9301018170\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " Dec 04 12:22:36.745472 master-0 kubenswrapper[35367]: I1204 12:22:36.745435 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/csi/topolvm.io^a7ac49b8-50e4-4168-b971-2f8b0e4db56e\") pod \"55e3f630-c2c3-49ee-950b-ce9301018170\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " Dec 04 12:22:36.745952 master-0 kubenswrapper[35367]: I1204 12:22:36.745918 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-combined-ca-bundle\") pod \"55e3f630-c2c3-49ee-950b-ce9301018170\" (UID: \"55e3f630-c2c3-49ee-950b-ce9301018170\") " Dec 04 12:22:36.746061 master-0 kubenswrapper[35367]: I1204 12:22:36.746021 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55e3f630-c2c3-49ee-950b-ce9301018170-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "55e3f630-c2c3-49ee-950b-ce9301018170" (UID: "55e3f630-c2c3-49ee-950b-ce9301018170"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:22:36.747560 master-0 kubenswrapper[35367]: I1204 12:22:36.747527 35367 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/55e3f630-c2c3-49ee-950b-ce9301018170-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:36.747645 master-0 kubenswrapper[35367]: I1204 12:22:36.747562 35367 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/55e3f630-c2c3-49ee-950b-ce9301018170-httpd-run\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:36.759941 master-0 kubenswrapper[35367]: I1204 12:22:36.758716 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-scripts" (OuterVolumeSpecName: "scripts") pod "55e3f630-c2c3-49ee-950b-ce9301018170" (UID: "55e3f630-c2c3-49ee-950b-ce9301018170"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:36.759941 master-0 kubenswrapper[35367]: I1204 12:22:36.758797 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55e3f630-c2c3-49ee-950b-ce9301018170-kube-api-access-2v8rg" (OuterVolumeSpecName: "kube-api-access-2v8rg") pod "55e3f630-c2c3-49ee-950b-ce9301018170" (UID: "55e3f630-c2c3-49ee-950b-ce9301018170"). InnerVolumeSpecName "kube-api-access-2v8rg". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:36.772291 master-0 kubenswrapper[35367]: I1204 12:22:36.772098 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bc1884b-12c9-49ac-bdfe-106e815f94a3" path="/var/lib/kubelet/pods/6bc1884b-12c9-49ac-bdfe-106e815f94a3/volumes" Dec 04 12:22:36.780904 master-0 kubenswrapper[35367]: I1204 12:22:36.780800 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/topolvm.io^a7ac49b8-50e4-4168-b971-2f8b0e4db56e" (OuterVolumeSpecName: "glance") pod "55e3f630-c2c3-49ee-950b-ce9301018170" (UID: "55e3f630-c2c3-49ee-950b-ce9301018170"). InnerVolumeSpecName "pvc-630610d1-9609-4ef9-bffe-3fdf6689bf1a". PluginName "kubernetes.io/csi", VolumeGidValue "" Dec 04 12:22:36.829064 master-0 kubenswrapper[35367]: I1204 12:22:36.828974 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "55e3f630-c2c3-49ee-950b-ce9301018170" (UID: "55e3f630-c2c3-49ee-950b-ce9301018170"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:36.840121 master-0 kubenswrapper[35367]: I1204 12:22:36.840058 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "55e3f630-c2c3-49ee-950b-ce9301018170" (UID: "55e3f630-c2c3-49ee-950b-ce9301018170"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:36.850641 master-0 kubenswrapper[35367]: I1204 12:22:36.850380 35367 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-internal-tls-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:36.850641 master-0 kubenswrapper[35367]: I1204 12:22:36.850427 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:36.850641 master-0 kubenswrapper[35367]: I1204 12:22:36.850437 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2v8rg\" (UniqueName: \"kubernetes.io/projected/55e3f630-c2c3-49ee-950b-ce9301018170-kube-api-access-2v8rg\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:36.850641 master-0 kubenswrapper[35367]: I1204 12:22:36.850475 35367 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"pvc-630610d1-9609-4ef9-bffe-3fdf6689bf1a\" (UniqueName: \"kubernetes.io/csi/topolvm.io^a7ac49b8-50e4-4168-b971-2f8b0e4db56e\") on node \"master-0\" " Dec 04 12:22:36.850641 master-0 kubenswrapper[35367]: I1204 12:22:36.850487 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:36.862347 master-0 kubenswrapper[35367]: I1204 12:22:36.862275 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-config-data" (OuterVolumeSpecName: "config-data") pod "55e3f630-c2c3-49ee-950b-ce9301018170" (UID: "55e3f630-c2c3-49ee-950b-ce9301018170"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:36.888618 master-0 kubenswrapper[35367]: I1204 12:22:36.888427 35367 csi_attacher.go:630] kubernetes.io/csi: attacher.UnmountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping UnmountDevice... Dec 04 12:22:36.889247 master-0 kubenswrapper[35367]: I1204 12:22:36.888748 35367 operation_generator.go:917] UnmountDevice succeeded for volume "pvc-630610d1-9609-4ef9-bffe-3fdf6689bf1a" (UniqueName: "kubernetes.io/csi/topolvm.io^a7ac49b8-50e4-4168-b971-2f8b0e4db56e") on node "master-0" Dec 04 12:22:36.954602 master-0 kubenswrapper[35367]: I1204 12:22:36.954444 35367 reconciler_common.go:293] "Volume detached for volume \"pvc-630610d1-9609-4ef9-bffe-3fdf6689bf1a\" (UniqueName: \"kubernetes.io/csi/topolvm.io^a7ac49b8-50e4-4168-b971-2f8b0e4db56e\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:36.954602 master-0 kubenswrapper[35367]: I1204 12:22:36.954557 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55e3f630-c2c3-49ee-950b-ce9301018170-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:36.960613 master-0 kubenswrapper[35367]: I1204 12:22:36.958915 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-db-sync-wxhxv" event={"ID":"fa8d8c09-968e-4c52-ac80-fd7a0a1df758","Type":"ContainerStarted","Data":"50c8a4ba75bad18f2713ed6d95e4b15c73d846c3b3df7ef6198393e8dd0c436a"} Dec 04 12:22:36.970829 master-0 kubenswrapper[35367]: I1204 12:22:36.965202 35367 generic.go:334] "Generic (PLEG): container finished" podID="55e3f630-c2c3-49ee-950b-ce9301018170" containerID="b522ce1baa53af37db7bea93b6c278b3fd0dadb6babeac6d5037b2a76e3c06f0" exitCode=0 Dec 04 12:22:36.970829 master-0 kubenswrapper[35367]: I1204 12:22:36.965282 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-0c69e-default-internal-api-0" event={"ID":"55e3f630-c2c3-49ee-950b-ce9301018170","Type":"ContainerDied","Data":"b522ce1baa53af37db7bea93b6c278b3fd0dadb6babeac6d5037b2a76e3c06f0"} Dec 04 12:22:36.970829 master-0 kubenswrapper[35367]: I1204 12:22:36.965312 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-0c69e-default-internal-api-0" event={"ID":"55e3f630-c2c3-49ee-950b-ce9301018170","Type":"ContainerDied","Data":"c99abc7cd491db75960e349888347d672b37d43ab5c399d8314288b6e0873b17"} Dec 04 12:22:36.970829 master-0 kubenswrapper[35367]: I1204 12:22:36.965332 35367 scope.go:117] "RemoveContainer" containerID="b522ce1baa53af37db7bea93b6c278b3fd0dadb6babeac6d5037b2a76e3c06f0" Dec 04 12:22:36.970829 master-0 kubenswrapper[35367]: I1204 12:22:36.965444 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:36.973510 master-0 kubenswrapper[35367]: I1204 12:22:36.973301 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-0c69e-default-external-api-0" event={"ID":"2811f60c-87a0-4438-96b6-a19e9d8a5b6a","Type":"ContainerDied","Data":"d9dd106906b8c27c38d341e41423267af8bf6d40c09655e906296e296a498a5d"} Dec 04 12:22:36.973510 master-0 kubenswrapper[35367]: I1204 12:22:36.973420 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.003456 master-0 kubenswrapper[35367]: I1204 12:22:37.003412 35367 scope.go:117] "RemoveContainer" containerID="b48f1aa23617dfbd2c90cfe5e203205569b5b3b00e05485f4e021f009a0262f8" Dec 04 12:22:37.013569 master-0 kubenswrapper[35367]: I1204 12:22:37.013252 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ironic-inspector-db-sync-wxhxv" podStartSLOduration=5.582411962 podStartE2EDuration="8.013198256s" podCreationTimestamp="2025-12-04 12:22:29 +0000 UTC" firstStartedPulling="2025-12-04 12:22:33.758412163 +0000 UTC m=+1397.196473421" lastFinishedPulling="2025-12-04 12:22:36.189198457 +0000 UTC m=+1399.627259715" observedRunningTime="2025-12-04 12:22:36.983199018 +0000 UTC m=+1400.421260286" watchObservedRunningTime="2025-12-04 12:22:37.013198256 +0000 UTC m=+1400.451259554" Dec 04 12:22:37.060687 master-0 kubenswrapper[35367]: I1204 12:22:37.060428 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-0c69e-default-external-api-0"] Dec 04 12:22:37.086214 master-0 kubenswrapper[35367]: I1204 12:22:37.085952 35367 scope.go:117] "RemoveContainer" containerID="b522ce1baa53af37db7bea93b6c278b3fd0dadb6babeac6d5037b2a76e3c06f0" Dec 04 12:22:37.089412 master-0 kubenswrapper[35367]: E1204 12:22:37.088965 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b522ce1baa53af37db7bea93b6c278b3fd0dadb6babeac6d5037b2a76e3c06f0\": container with ID starting with b522ce1baa53af37db7bea93b6c278b3fd0dadb6babeac6d5037b2a76e3c06f0 not found: ID does not exist" containerID="b522ce1baa53af37db7bea93b6c278b3fd0dadb6babeac6d5037b2a76e3c06f0" Dec 04 12:22:37.089412 master-0 kubenswrapper[35367]: I1204 12:22:37.089045 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b522ce1baa53af37db7bea93b6c278b3fd0dadb6babeac6d5037b2a76e3c06f0"} err="failed to get container status \"b522ce1baa53af37db7bea93b6c278b3fd0dadb6babeac6d5037b2a76e3c06f0\": rpc error: code = NotFound desc = could not find container \"b522ce1baa53af37db7bea93b6c278b3fd0dadb6babeac6d5037b2a76e3c06f0\": container with ID starting with b522ce1baa53af37db7bea93b6c278b3fd0dadb6babeac6d5037b2a76e3c06f0 not found: ID does not exist" Dec 04 12:22:37.089412 master-0 kubenswrapper[35367]: I1204 12:22:37.089076 35367 scope.go:117] "RemoveContainer" containerID="b48f1aa23617dfbd2c90cfe5e203205569b5b3b00e05485f4e021f009a0262f8" Dec 04 12:22:37.115195 master-0 kubenswrapper[35367]: E1204 12:22:37.114353 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b48f1aa23617dfbd2c90cfe5e203205569b5b3b00e05485f4e021f009a0262f8\": container with ID starting with b48f1aa23617dfbd2c90cfe5e203205569b5b3b00e05485f4e021f009a0262f8 not found: ID does not exist" containerID="b48f1aa23617dfbd2c90cfe5e203205569b5b3b00e05485f4e021f009a0262f8" Dec 04 12:22:37.115195 master-0 kubenswrapper[35367]: I1204 12:22:37.114442 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b48f1aa23617dfbd2c90cfe5e203205569b5b3b00e05485f4e021f009a0262f8"} err="failed to get container status \"b48f1aa23617dfbd2c90cfe5e203205569b5b3b00e05485f4e021f009a0262f8\": rpc error: code = NotFound desc = could not find container \"b48f1aa23617dfbd2c90cfe5e203205569b5b3b00e05485f4e021f009a0262f8\": container with ID starting with b48f1aa23617dfbd2c90cfe5e203205569b5b3b00e05485f4e021f009a0262f8 not found: ID does not exist" Dec 04 12:22:37.115195 master-0 kubenswrapper[35367]: I1204 12:22:37.114474 35367 scope.go:117] "RemoveContainer" containerID="f9347c31ff229c8d7ffcbf80a45550af30f3e14a3c456160cd0e8a6e2b89d47b" Dec 04 12:22:37.143424 master-0 kubenswrapper[35367]: I1204 12:22:37.143338 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/glance-0c69e-default-external-api-0"] Dec 04 12:22:37.167705 master-0 kubenswrapper[35367]: I1204 12:22:37.167611 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-0c69e-default-internal-api-0"] Dec 04 12:22:37.178536 master-0 kubenswrapper[35367]: I1204 12:22:37.178431 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-0c69e-default-external-api-0"] Dec 04 12:22:37.181792 master-0 kubenswrapper[35367]: E1204 12:22:37.181755 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f2a286f2-4ada-485a-97db-414518e8621e" containerName="dnsmasq-dns" Dec 04 12:22:37.181792 master-0 kubenswrapper[35367]: I1204 12:22:37.181787 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2a286f2-4ada-485a-97db-414518e8621e" containerName="dnsmasq-dns" Dec 04 12:22:37.182201 master-0 kubenswrapper[35367]: E1204 12:22:37.182053 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a8165365-59aa-419d-a5bf-fc6e97981f19" containerName="ironic-api" Dec 04 12:22:37.182201 master-0 kubenswrapper[35367]: I1204 12:22:37.182066 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8165365-59aa-419d-a5bf-fc6e97981f19" containerName="ironic-api" Dec 04 12:22:37.182201 master-0 kubenswrapper[35367]: E1204 12:22:37.182089 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="55e3f630-c2c3-49ee-950b-ce9301018170" containerName="glance-httpd" Dec 04 12:22:37.182201 master-0 kubenswrapper[35367]: I1204 12:22:37.182096 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="55e3f630-c2c3-49ee-950b-ce9301018170" containerName="glance-httpd" Dec 04 12:22:37.182201 master-0 kubenswrapper[35367]: E1204 12:22:37.182112 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f2a286f2-4ada-485a-97db-414518e8621e" containerName="init" Dec 04 12:22:37.182201 master-0 kubenswrapper[35367]: I1204 12:22:37.182119 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2a286f2-4ada-485a-97db-414518e8621e" containerName="init" Dec 04 12:22:37.182201 master-0 kubenswrapper[35367]: E1204 12:22:37.182146 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6bc1884b-12c9-49ac-bdfe-106e815f94a3" containerName="neutron-api" Dec 04 12:22:37.182201 master-0 kubenswrapper[35367]: I1204 12:22:37.182152 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bc1884b-12c9-49ac-bdfe-106e815f94a3" containerName="neutron-api" Dec 04 12:22:37.182201 master-0 kubenswrapper[35367]: E1204 12:22:37.182160 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a8165365-59aa-419d-a5bf-fc6e97981f19" containerName="ironic-api" Dec 04 12:22:37.182201 master-0 kubenswrapper[35367]: I1204 12:22:37.182166 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8165365-59aa-419d-a5bf-fc6e97981f19" containerName="ironic-api" Dec 04 12:22:37.182201 master-0 kubenswrapper[35367]: E1204 12:22:37.182176 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="55e3f630-c2c3-49ee-950b-ce9301018170" containerName="glance-log" Dec 04 12:22:37.182201 master-0 kubenswrapper[35367]: I1204 12:22:37.182183 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="55e3f630-c2c3-49ee-950b-ce9301018170" containerName="glance-log" Dec 04 12:22:37.183965 master-0 kubenswrapper[35367]: E1204 12:22:37.183907 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6bc1884b-12c9-49ac-bdfe-106e815f94a3" containerName="neutron-httpd" Dec 04 12:22:37.184388 master-0 kubenswrapper[35367]: I1204 12:22:37.183967 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bc1884b-12c9-49ac-bdfe-106e815f94a3" containerName="neutron-httpd" Dec 04 12:22:37.184388 master-0 kubenswrapper[35367]: E1204 12:22:37.184029 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2811f60c-87a0-4438-96b6-a19e9d8a5b6a" containerName="glance-log" Dec 04 12:22:37.184388 master-0 kubenswrapper[35367]: I1204 12:22:37.184038 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="2811f60c-87a0-4438-96b6-a19e9d8a5b6a" containerName="glance-log" Dec 04 12:22:37.184388 master-0 kubenswrapper[35367]: E1204 12:22:37.184073 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2811f60c-87a0-4438-96b6-a19e9d8a5b6a" containerName="glance-httpd" Dec 04 12:22:37.184388 master-0 kubenswrapper[35367]: I1204 12:22:37.184081 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="2811f60c-87a0-4438-96b6-a19e9d8a5b6a" containerName="glance-httpd" Dec 04 12:22:37.184388 master-0 kubenswrapper[35367]: E1204 12:22:37.184100 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a8165365-59aa-419d-a5bf-fc6e97981f19" containerName="init" Dec 04 12:22:37.184388 master-0 kubenswrapper[35367]: I1204 12:22:37.184108 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8165365-59aa-419d-a5bf-fc6e97981f19" containerName="init" Dec 04 12:22:37.184388 master-0 kubenswrapper[35367]: E1204 12:22:37.184151 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a8165365-59aa-419d-a5bf-fc6e97981f19" containerName="ironic-api-log" Dec 04 12:22:37.184388 master-0 kubenswrapper[35367]: I1204 12:22:37.184160 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8165365-59aa-419d-a5bf-fc6e97981f19" containerName="ironic-api-log" Dec 04 12:22:37.185251 master-0 kubenswrapper[35367]: I1204 12:22:37.185180 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="6bc1884b-12c9-49ac-bdfe-106e815f94a3" containerName="neutron-api" Dec 04 12:22:37.185251 master-0 kubenswrapper[35367]: I1204 12:22:37.185227 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="55e3f630-c2c3-49ee-950b-ce9301018170" containerName="glance-log" Dec 04 12:22:37.185251 master-0 kubenswrapper[35367]: I1204 12:22:37.185239 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="a8165365-59aa-419d-a5bf-fc6e97981f19" containerName="ironic-api" Dec 04 12:22:37.185251 master-0 kubenswrapper[35367]: I1204 12:22:37.185256 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="a8165365-59aa-419d-a5bf-fc6e97981f19" containerName="ironic-api-log" Dec 04 12:22:37.185492 master-0 kubenswrapper[35367]: I1204 12:22:37.185290 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="2811f60c-87a0-4438-96b6-a19e9d8a5b6a" containerName="glance-httpd" Dec 04 12:22:37.185492 master-0 kubenswrapper[35367]: I1204 12:22:37.185311 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="55e3f630-c2c3-49ee-950b-ce9301018170" containerName="glance-httpd" Dec 04 12:22:37.185492 master-0 kubenswrapper[35367]: I1204 12:22:37.185326 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="6bc1884b-12c9-49ac-bdfe-106e815f94a3" containerName="neutron-httpd" Dec 04 12:22:37.185492 master-0 kubenswrapper[35367]: I1204 12:22:37.185339 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="a8165365-59aa-419d-a5bf-fc6e97981f19" containerName="ironic-api" Dec 04 12:22:37.185492 master-0 kubenswrapper[35367]: I1204 12:22:37.185351 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="2811f60c-87a0-4438-96b6-a19e9d8a5b6a" containerName="glance-log" Dec 04 12:22:37.185492 master-0 kubenswrapper[35367]: I1204 12:22:37.185361 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="f2a286f2-4ada-485a-97db-414518e8621e" containerName="dnsmasq-dns" Dec 04 12:22:37.187359 master-0 kubenswrapper[35367]: I1204 12:22:37.187326 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.190541 master-0 kubenswrapper[35367]: I1204 12:22:37.190498 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-0c69e-default-external-config-data" Dec 04 12:22:37.190629 master-0 kubenswrapper[35367]: I1204 12:22:37.190543 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-glance-default-public-svc" Dec 04 12:22:37.191525 master-0 kubenswrapper[35367]: I1204 12:22:37.190961 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-scripts" Dec 04 12:22:37.203369 master-0 kubenswrapper[35367]: I1204 12:22:37.203280 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/glance-0c69e-default-internal-api-0"] Dec 04 12:22:37.221421 master-0 kubenswrapper[35367]: I1204 12:22:37.221353 35367 scope.go:117] "RemoveContainer" containerID="cdc0396c2487a84e8966f80f5ff54e0c6a4b2047e4a265d4bb08e82502a9aa90" Dec 04 12:22:37.225148 master-0 kubenswrapper[35367]: I1204 12:22:37.225065 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-0c69e-default-external-api-0"] Dec 04 12:22:37.238446 master-0 kubenswrapper[35367]: I1204 12:22:37.238369 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-0c69e-default-internal-api-0"] Dec 04 12:22:37.241818 master-0 kubenswrapper[35367]: I1204 12:22:37.241095 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.245399 master-0 kubenswrapper[35367]: I1204 12:22:37.245329 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-glance-default-internal-svc" Dec 04 12:22:37.245670 master-0 kubenswrapper[35367]: I1204 12:22:37.245635 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-0c69e-default-internal-config-data" Dec 04 12:22:37.278080 master-0 kubenswrapper[35367]: I1204 12:22:37.277470 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-0c69e-default-internal-api-0"] Dec 04 12:22:37.394026 master-0 kubenswrapper[35367]: I1204 12:22:37.393939 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/31ebc18f-33af-4bd2-ba43-618d86db70cb-config-data\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.394277 master-0 kubenswrapper[35367]: I1204 12:22:37.394048 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ff693596-151c-4d87-894b-79c4457be996-httpd-run\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.394277 master-0 kubenswrapper[35367]: I1204 12:22:37.394097 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff693596-151c-4d87-894b-79c4457be996-public-tls-certs\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.394277 master-0 kubenswrapper[35367]: I1204 12:22:37.394135 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff693596-151c-4d87-894b-79c4457be996-config-data\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.394277 master-0 kubenswrapper[35367]: I1204 12:22:37.394193 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff693596-151c-4d87-894b-79c4457be996-scripts\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.394468 master-0 kubenswrapper[35367]: I1204 12:22:37.394384 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/31ebc18f-33af-4bd2-ba43-618d86db70cb-logs\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.394526 master-0 kubenswrapper[35367]: I1204 12:22:37.394495 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-630610d1-9609-4ef9-bffe-3fdf6689bf1a\" (UniqueName: \"kubernetes.io/csi/topolvm.io^a7ac49b8-50e4-4168-b971-2f8b0e4db56e\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.394639 master-0 kubenswrapper[35367]: I1204 12:22:37.394614 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/31ebc18f-33af-4bd2-ba43-618d86db70cb-combined-ca-bundle\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.394823 master-0 kubenswrapper[35367]: I1204 12:22:37.394781 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-5b3d373a-b38f-44c7-a861-0a8380dfd1e5\" (UniqueName: \"kubernetes.io/csi/topolvm.io^f318c560-8a01-4027-a490-af9e3eba2a4a\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.395008 master-0 kubenswrapper[35367]: I1204 12:22:37.394974 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/31ebc18f-33af-4bd2-ba43-618d86db70cb-httpd-run\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.395080 master-0 kubenswrapper[35367]: I1204 12:22:37.395057 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff693596-151c-4d87-894b-79c4457be996-combined-ca-bundle\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.395145 master-0 kubenswrapper[35367]: I1204 12:22:37.395124 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtq8c\" (UniqueName: \"kubernetes.io/projected/ff693596-151c-4d87-894b-79c4457be996-kube-api-access-dtq8c\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.395363 master-0 kubenswrapper[35367]: I1204 12:22:37.395337 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsx5k\" (UniqueName: \"kubernetes.io/projected/31ebc18f-33af-4bd2-ba43-618d86db70cb-kube-api-access-fsx5k\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.395605 master-0 kubenswrapper[35367]: I1204 12:22:37.395558 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ff693596-151c-4d87-894b-79c4457be996-logs\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.395647 master-0 kubenswrapper[35367]: I1204 12:22:37.395627 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/31ebc18f-33af-4bd2-ba43-618d86db70cb-internal-tls-certs\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.395678 master-0 kubenswrapper[35367]: I1204 12:22:37.395666 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/31ebc18f-33af-4bd2-ba43-618d86db70cb-scripts\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.498757 master-0 kubenswrapper[35367]: I1204 12:22:37.498620 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ff693596-151c-4d87-894b-79c4457be996-httpd-run\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.498757 master-0 kubenswrapper[35367]: I1204 12:22:37.498728 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff693596-151c-4d87-894b-79c4457be996-public-tls-certs\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.499295 master-0 kubenswrapper[35367]: I1204 12:22:37.498783 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff693596-151c-4d87-894b-79c4457be996-config-data\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.499295 master-0 kubenswrapper[35367]: I1204 12:22:37.498851 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff693596-151c-4d87-894b-79c4457be996-scripts\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.499609 master-0 kubenswrapper[35367]: I1204 12:22:37.498951 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/31ebc18f-33af-4bd2-ba43-618d86db70cb-logs\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.500299 master-0 kubenswrapper[35367]: I1204 12:22:37.499596 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-630610d1-9609-4ef9-bffe-3fdf6689bf1a\" (UniqueName: \"kubernetes.io/csi/topolvm.io^a7ac49b8-50e4-4168-b971-2f8b0e4db56e\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.500385 master-0 kubenswrapper[35367]: I1204 12:22:37.500318 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/31ebc18f-33af-4bd2-ba43-618d86db70cb-combined-ca-bundle\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.501632 master-0 kubenswrapper[35367]: I1204 12:22:37.501084 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-5b3d373a-b38f-44c7-a861-0a8380dfd1e5\" (UniqueName: \"kubernetes.io/csi/topolvm.io^f318c560-8a01-4027-a490-af9e3eba2a4a\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.501632 master-0 kubenswrapper[35367]: I1204 12:22:37.499510 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/31ebc18f-33af-4bd2-ba43-618d86db70cb-logs\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.501632 master-0 kubenswrapper[35367]: I1204 12:22:37.501292 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/31ebc18f-33af-4bd2-ba43-618d86db70cb-httpd-run\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.501632 master-0 kubenswrapper[35367]: I1204 12:22:37.499829 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ff693596-151c-4d87-894b-79c4457be996-httpd-run\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.501632 master-0 kubenswrapper[35367]: I1204 12:22:37.501468 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff693596-151c-4d87-894b-79c4457be996-combined-ca-bundle\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.501632 master-0 kubenswrapper[35367]: I1204 12:22:37.501516 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dtq8c\" (UniqueName: \"kubernetes.io/projected/ff693596-151c-4d87-894b-79c4457be996-kube-api-access-dtq8c\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.502336 master-0 kubenswrapper[35367]: I1204 12:22:37.501696 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fsx5k\" (UniqueName: \"kubernetes.io/projected/31ebc18f-33af-4bd2-ba43-618d86db70cb-kube-api-access-fsx5k\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.502336 master-0 kubenswrapper[35367]: I1204 12:22:37.501946 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/31ebc18f-33af-4bd2-ba43-618d86db70cb-httpd-run\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.502484 master-0 kubenswrapper[35367]: I1204 12:22:37.502454 35367 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 12:22:37.502630 master-0 kubenswrapper[35367]: I1204 12:22:37.502515 35367 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-630610d1-9609-4ef9-bffe-3fdf6689bf1a\" (UniqueName: \"kubernetes.io/csi/topolvm.io^a7ac49b8-50e4-4168-b971-2f8b0e4db56e\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/7a8384074b0c5bf14b517730f91cd3abecb695a5ebd6253723131526ebea9d40/globalmount\"" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.502918 master-0 kubenswrapper[35367]: I1204 12:22:37.502872 35367 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Dec 04 12:22:37.503023 master-0 kubenswrapper[35367]: I1204 12:22:37.502911 35367 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-5b3d373a-b38f-44c7-a861-0a8380dfd1e5\" (UniqueName: \"kubernetes.io/csi/topolvm.io^f318c560-8a01-4027-a490-af9e3eba2a4a\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/74115e60b5409cbebfa619be32d6ac347cad5b2eedd93383ec88e211c6c7024b/globalmount\"" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.503226 master-0 kubenswrapper[35367]: I1204 12:22:37.503180 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff693596-151c-4d87-894b-79c4457be996-config-data\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.503354 master-0 kubenswrapper[35367]: I1204 12:22:37.503235 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ff693596-151c-4d87-894b-79c4457be996-logs\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.503354 master-0 kubenswrapper[35367]: I1204 12:22:37.502395 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ff693596-151c-4d87-894b-79c4457be996-logs\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.503606 master-0 kubenswrapper[35367]: I1204 12:22:37.503359 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/31ebc18f-33af-4bd2-ba43-618d86db70cb-internal-tls-certs\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.503606 master-0 kubenswrapper[35367]: I1204 12:22:37.503388 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/31ebc18f-33af-4bd2-ba43-618d86db70cb-scripts\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.503606 master-0 kubenswrapper[35367]: I1204 12:22:37.503495 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff693596-151c-4d87-894b-79c4457be996-public-tls-certs\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.503606 master-0 kubenswrapper[35367]: I1204 12:22:37.503570 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/31ebc18f-33af-4bd2-ba43-618d86db70cb-config-data\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.505638 master-0 kubenswrapper[35367]: I1204 12:22:37.505527 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/31ebc18f-33af-4bd2-ba43-618d86db70cb-combined-ca-bundle\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.506370 master-0 kubenswrapper[35367]: I1204 12:22:37.506328 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff693596-151c-4d87-894b-79c4457be996-combined-ca-bundle\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.506980 master-0 kubenswrapper[35367]: I1204 12:22:37.506666 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/31ebc18f-33af-4bd2-ba43-618d86db70cb-internal-tls-certs\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.509031 master-0 kubenswrapper[35367]: I1204 12:22:37.508993 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff693596-151c-4d87-894b-79c4457be996-scripts\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.511553 master-0 kubenswrapper[35367]: I1204 12:22:37.511496 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/31ebc18f-33af-4bd2-ba43-618d86db70cb-config-data\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.514907 master-0 kubenswrapper[35367]: I1204 12:22:37.514844 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/31ebc18f-33af-4bd2-ba43-618d86db70cb-scripts\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:37.524496 master-0 kubenswrapper[35367]: I1204 12:22:37.524380 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtq8c\" (UniqueName: \"kubernetes.io/projected/ff693596-151c-4d87-894b-79c4457be996-kube-api-access-dtq8c\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:37.525087 master-0 kubenswrapper[35367]: I1204 12:22:37.524645 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsx5k\" (UniqueName: \"kubernetes.io/projected/31ebc18f-33af-4bd2-ba43-618d86db70cb-kube-api-access-fsx5k\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:38.766230 master-0 kubenswrapper[35367]: I1204 12:22:38.766048 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2811f60c-87a0-4438-96b6-a19e9d8a5b6a" path="/var/lib/kubelet/pods/2811f60c-87a0-4438-96b6-a19e9d8a5b6a/volumes" Dec 04 12:22:38.767304 master-0 kubenswrapper[35367]: I1204 12:22:38.767269 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55e3f630-c2c3-49ee-950b-ce9301018170" path="/var/lib/kubelet/pods/55e3f630-c2c3-49ee-950b-ce9301018170/volumes" Dec 04 12:22:38.863332 master-0 kubenswrapper[35367]: I1204 12:22:38.859848 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-630610d1-9609-4ef9-bffe-3fdf6689bf1a\" (UniqueName: \"kubernetes.io/csi/topolvm.io^a7ac49b8-50e4-4168-b971-2f8b0e4db56e\") pod \"glance-0c69e-default-internal-api-0\" (UID: \"31ebc18f-33af-4bd2-ba43-618d86db70cb\") " pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:39.014017 master-0 kubenswrapper[35367]: I1204 12:22:39.013852 35367 generic.go:334] "Generic (PLEG): container finished" podID="fa8d8c09-968e-4c52-ac80-fd7a0a1df758" containerID="50c8a4ba75bad18f2713ed6d95e4b15c73d846c3b3df7ef6198393e8dd0c436a" exitCode=0 Dec 04 12:22:39.014017 master-0 kubenswrapper[35367]: I1204 12:22:39.013946 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-db-sync-wxhxv" event={"ID":"fa8d8c09-968e-4c52-ac80-fd7a0a1df758","Type":"ContainerDied","Data":"50c8a4ba75bad18f2713ed6d95e4b15c73d846c3b3df7ef6198393e8dd0c436a"} Dec 04 12:22:39.088148 master-0 kubenswrapper[35367]: I1204 12:22:39.088084 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:39.698134 master-0 kubenswrapper[35367]: I1204 12:22:39.698056 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-0c69e-default-internal-api-0"] Dec 04 12:22:39.706210 master-0 kubenswrapper[35367]: I1204 12:22:39.706095 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-5b3d373a-b38f-44c7-a861-0a8380dfd1e5\" (UniqueName: \"kubernetes.io/csi/topolvm.io^f318c560-8a01-4027-a490-af9e3eba2a4a\") pod \"glance-0c69e-default-external-api-0\" (UID: \"ff693596-151c-4d87-894b-79c4457be996\") " pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:39.713307 master-0 kubenswrapper[35367]: W1204 12:22:39.713242 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31ebc18f_33af_4bd2_ba43_618d86db70cb.slice/crio-68130a67588118c8348cc79f2dd6dcf0d19d049fdc36ae4f8e2dcdad85d9c839 WatchSource:0}: Error finding container 68130a67588118c8348cc79f2dd6dcf0d19d049fdc36ae4f8e2dcdad85d9c839: Status 404 returned error can't find the container with id 68130a67588118c8348cc79f2dd6dcf0d19d049fdc36ae4f8e2dcdad85d9c839 Dec 04 12:22:39.923720 master-0 kubenswrapper[35367]: I1204 12:22:39.923544 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:39.984994 master-0 kubenswrapper[35367]: I1204 12:22:39.984883 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:40.000840 master-0 kubenswrapper[35367]: I1204 12:22:40.000719 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/swift-proxy-548cfff678-vw66t" Dec 04 12:22:40.038764 master-0 kubenswrapper[35367]: I1204 12:22:40.038255 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-0c69e-default-internal-api-0" event={"ID":"31ebc18f-33af-4bd2-ba43-618d86db70cb","Type":"ContainerStarted","Data":"68130a67588118c8348cc79f2dd6dcf0d19d049fdc36ae4f8e2dcdad85d9c839"} Dec 04 12:22:40.692332 master-0 kubenswrapper[35367]: I1204 12:22:40.692203 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-0c69e-default-external-api-0"] Dec 04 12:22:40.727535 master-0 kubenswrapper[35367]: I1204 12:22:40.727473 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:40.928739 master-0 kubenswrapper[35367]: I1204 12:22:40.928659 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlsn6\" (UniqueName: \"kubernetes.io/projected/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-kube-api-access-zlsn6\") pod \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " Dec 04 12:22:40.929407 master-0 kubenswrapper[35367]: I1204 12:22:40.928853 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-combined-ca-bundle\") pod \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " Dec 04 12:22:40.929407 master-0 kubenswrapper[35367]: I1204 12:22:40.928987 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-scripts\") pod \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " Dec 04 12:22:40.929407 master-0 kubenswrapper[35367]: I1204 12:22:40.929063 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-etc-podinfo\") pod \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " Dec 04 12:22:40.929560 master-0 kubenswrapper[35367]: I1204 12:22:40.929401 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-var-lib-ironic\") pod \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " Dec 04 12:22:40.929560 master-0 kubenswrapper[35367]: I1204 12:22:40.929480 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-config\") pod \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " Dec 04 12:22:40.929710 master-0 kubenswrapper[35367]: I1204 12:22:40.929611 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\" (UID: \"fa8d8c09-968e-4c52-ac80-fd7a0a1df758\") " Dec 04 12:22:40.931452 master-0 kubenswrapper[35367]: I1204 12:22:40.930271 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-var-lib-ironic" (OuterVolumeSpecName: "var-lib-ironic") pod "fa8d8c09-968e-4c52-ac80-fd7a0a1df758" (UID: "fa8d8c09-968e-4c52-ac80-fd7a0a1df758"). InnerVolumeSpecName "var-lib-ironic". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:22:40.931452 master-0 kubenswrapper[35367]: I1204 12:22:40.930707 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-var-lib-ironic-inspector-dhcp-hostsdir" (OuterVolumeSpecName: "var-lib-ironic-inspector-dhcp-hostsdir") pod "fa8d8c09-968e-4c52-ac80-fd7a0a1df758" (UID: "fa8d8c09-968e-4c52-ac80-fd7a0a1df758"). InnerVolumeSpecName "var-lib-ironic-inspector-dhcp-hostsdir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:22:40.932138 master-0 kubenswrapper[35367]: I1204 12:22:40.932080 35367 reconciler_common.go:293] "Volume detached for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-var-lib-ironic\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:40.932138 master-0 kubenswrapper[35367]: I1204 12:22:40.932105 35367 reconciler_common.go:293] "Volume detached for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-var-lib-ironic-inspector-dhcp-hostsdir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:40.933526 master-0 kubenswrapper[35367]: I1204 12:22:40.933458 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-etc-podinfo" (OuterVolumeSpecName: "etc-podinfo") pod "fa8d8c09-968e-4c52-ac80-fd7a0a1df758" (UID: "fa8d8c09-968e-4c52-ac80-fd7a0a1df758"). InnerVolumeSpecName "etc-podinfo". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Dec 04 12:22:40.936118 master-0 kubenswrapper[35367]: I1204 12:22:40.936009 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-scripts" (OuterVolumeSpecName: "scripts") pod "fa8d8c09-968e-4c52-ac80-fd7a0a1df758" (UID: "fa8d8c09-968e-4c52-ac80-fd7a0a1df758"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:40.938601 master-0 kubenswrapper[35367]: I1204 12:22:40.938539 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-kube-api-access-zlsn6" (OuterVolumeSpecName: "kube-api-access-zlsn6") pod "fa8d8c09-968e-4c52-ac80-fd7a0a1df758" (UID: "fa8d8c09-968e-4c52-ac80-fd7a0a1df758"). InnerVolumeSpecName "kube-api-access-zlsn6". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:40.965489 master-0 kubenswrapper[35367]: I1204 12:22:40.965434 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-config" (OuterVolumeSpecName: "config") pod "fa8d8c09-968e-4c52-ac80-fd7a0a1df758" (UID: "fa8d8c09-968e-4c52-ac80-fd7a0a1df758"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:40.979007 master-0 kubenswrapper[35367]: I1204 12:22:40.978944 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fa8d8c09-968e-4c52-ac80-fd7a0a1df758" (UID: "fa8d8c09-968e-4c52-ac80-fd7a0a1df758"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:41.033251 master-0 kubenswrapper[35367]: I1204 12:22:41.033169 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:41.033251 master-0 kubenswrapper[35367]: I1204 12:22:41.033228 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zlsn6\" (UniqueName: \"kubernetes.io/projected/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-kube-api-access-zlsn6\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:41.033251 master-0 kubenswrapper[35367]: I1204 12:22:41.033247 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:41.033251 master-0 kubenswrapper[35367]: I1204 12:22:41.033256 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:41.033251 master-0 kubenswrapper[35367]: I1204 12:22:41.033265 35367 reconciler_common.go:293] "Volume detached for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa8d8c09-968e-4c52-ac80-fd7a0a1df758-etc-podinfo\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:41.078854 master-0 kubenswrapper[35367]: I1204 12:22:41.076662 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-0c69e-default-internal-api-0" event={"ID":"31ebc18f-33af-4bd2-ba43-618d86db70cb","Type":"ContainerStarted","Data":"5b7183dee5d43f81aaa165c88a91a9f7acc4b6c0812f399a560659afe26e9b54"} Dec 04 12:22:41.078854 master-0 kubenswrapper[35367]: I1204 12:22:41.078227 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-0c69e-default-external-api-0" event={"ID":"ff693596-151c-4d87-894b-79c4457be996","Type":"ContainerStarted","Data":"5596ba609b828f6478e1974295659833f0f077d6524dff4590148c18b45d496d"} Dec 04 12:22:41.084857 master-0 kubenswrapper[35367]: I1204 12:22:41.082047 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-db-sync-wxhxv" event={"ID":"fa8d8c09-968e-4c52-ac80-fd7a0a1df758","Type":"ContainerDied","Data":"2003d3973f53d25f7d714789ca0526268fc359c5d9a3c9a708f48424d66b0a76"} Dec 04 12:22:41.084857 master-0 kubenswrapper[35367]: I1204 12:22:41.082073 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2003d3973f53d25f7d714789ca0526268fc359c5d9a3c9a708f48424d66b0a76" Dec 04 12:22:41.084857 master-0 kubenswrapper[35367]: I1204 12:22:41.082135 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-db-sync-wxhxv" Dec 04 12:22:41.912075 master-0 kubenswrapper[35367]: I1204 12:22:41.911957 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-65c9687b5f-h6zpt"] Dec 04 12:22:41.913195 master-0 kubenswrapper[35367]: E1204 12:22:41.912731 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fa8d8c09-968e-4c52-ac80-fd7a0a1df758" containerName="ironic-inspector-db-sync" Dec 04 12:22:41.913195 master-0 kubenswrapper[35367]: I1204 12:22:41.912760 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8d8c09-968e-4c52-ac80-fd7a0a1df758" containerName="ironic-inspector-db-sync" Dec 04 12:22:41.913195 master-0 kubenswrapper[35367]: I1204 12:22:41.913125 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="fa8d8c09-968e-4c52-ac80-fd7a0a1df758" containerName="ironic-inspector-db-sync" Dec 04 12:22:41.915108 master-0 kubenswrapper[35367]: I1204 12:22:41.914908 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:42.035607 master-0 kubenswrapper[35367]: I1204 12:22:42.035430 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-65c9687b5f-h6zpt"] Dec 04 12:22:42.088242 master-0 kubenswrapper[35367]: I1204 12:22:42.081714 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx6k5\" (UniqueName: \"kubernetes.io/projected/8294f299-adc0-4d31-9475-3b425402b08a-kube-api-access-xx6k5\") pod \"dnsmasq-dns-65c9687b5f-h6zpt\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:42.088242 master-0 kubenswrapper[35367]: I1204 12:22:42.081841 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-dns-swift-storage-0\") pod \"dnsmasq-dns-65c9687b5f-h6zpt\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:42.088242 master-0 kubenswrapper[35367]: I1204 12:22:42.083297 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-config\") pod \"dnsmasq-dns-65c9687b5f-h6zpt\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:42.088242 master-0 kubenswrapper[35367]: I1204 12:22:42.083407 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-ovsdbserver-nb\") pod \"dnsmasq-dns-65c9687b5f-h6zpt\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:42.088242 master-0 kubenswrapper[35367]: I1204 12:22:42.084960 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-ovsdbserver-sb\") pod \"dnsmasq-dns-65c9687b5f-h6zpt\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:42.088242 master-0 kubenswrapper[35367]: I1204 12:22:42.085029 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-dns-svc\") pod \"dnsmasq-dns-65c9687b5f-h6zpt\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:42.140928 master-0 kubenswrapper[35367]: I1204 12:22:42.140834 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-0c69e-default-internal-api-0" event={"ID":"31ebc18f-33af-4bd2-ba43-618d86db70cb","Type":"ContainerStarted","Data":"343fedf8c1833b20222da6c48a1515c0316e8aa7953fde72c718ee1d934b5f13"} Dec 04 12:22:42.149362 master-0 kubenswrapper[35367]: I1204 12:22:42.149253 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-0c69e-default-external-api-0" event={"ID":"ff693596-151c-4d87-894b-79c4457be996","Type":"ContainerStarted","Data":"8878d8f60a9fc7c44b3e0f562349163bf7ccd798bd9d5a986afc30c853768a55"} Dec 04 12:22:42.156179 master-0 kubenswrapper[35367]: I1204 12:22:42.156109 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-inspector-0"] Dec 04 12:22:42.162289 master-0 kubenswrapper[35367]: I1204 12:22:42.162224 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-0" Dec 04 12:22:42.167343 master-0 kubenswrapper[35367]: I1204 12:22:42.167266 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-inspector-config-data" Dec 04 12:22:42.167663 master-0 kubenswrapper[35367]: I1204 12:22:42.167437 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-inspector-scripts" Dec 04 12:22:42.167663 master-0 kubenswrapper[35367]: I1204 12:22:42.167622 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"rabbitmq-transport-url-ironic-inspector-transport" Dec 04 12:22:42.208054 master-0 kubenswrapper[35367]: I1204 12:22:42.207994 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-dns-svc\") pod \"dnsmasq-dns-65c9687b5f-h6zpt\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:42.208562 master-0 kubenswrapper[35367]: I1204 12:22:42.208533 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xx6k5\" (UniqueName: \"kubernetes.io/projected/8294f299-adc0-4d31-9475-3b425402b08a-kube-api-access-xx6k5\") pod \"dnsmasq-dns-65c9687b5f-h6zpt\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:42.208751 master-0 kubenswrapper[35367]: I1204 12:22:42.208730 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-dns-swift-storage-0\") pod \"dnsmasq-dns-65c9687b5f-h6zpt\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:42.209109 master-0 kubenswrapper[35367]: I1204 12:22:42.209077 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-config\") pod \"dnsmasq-dns-65c9687b5f-h6zpt\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:42.209287 master-0 kubenswrapper[35367]: I1204 12:22:42.209265 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-ovsdbserver-nb\") pod \"dnsmasq-dns-65c9687b5f-h6zpt\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:42.209451 master-0 kubenswrapper[35367]: I1204 12:22:42.209429 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-ovsdbserver-sb\") pod \"dnsmasq-dns-65c9687b5f-h6zpt\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:42.211906 master-0 kubenswrapper[35367]: I1204 12:22:42.211870 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-ovsdbserver-sb\") pod \"dnsmasq-dns-65c9687b5f-h6zpt\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:42.213337 master-0 kubenswrapper[35367]: I1204 12:22:42.212758 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-inspector-0"] Dec 04 12:22:42.213496 master-0 kubenswrapper[35367]: I1204 12:22:42.213451 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-dns-svc\") pod \"dnsmasq-dns-65c9687b5f-h6zpt\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:42.216229 master-0 kubenswrapper[35367]: I1204 12:22:42.216188 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-ovsdbserver-nb\") pod \"dnsmasq-dns-65c9687b5f-h6zpt\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:42.216866 master-0 kubenswrapper[35367]: I1204 12:22:42.216782 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-config\") pod \"dnsmasq-dns-65c9687b5f-h6zpt\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:42.217323 master-0 kubenswrapper[35367]: I1204 12:22:42.217298 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-dns-swift-storage-0\") pod \"dnsmasq-dns-65c9687b5f-h6zpt\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:42.230559 master-0 kubenswrapper[35367]: I1204 12:22:42.230446 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/glance-0c69e-default-internal-api-0" podStartSLOduration=5.230420824 podStartE2EDuration="5.230420824s" podCreationTimestamp="2025-12-04 12:22:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:22:42.223211757 +0000 UTC m=+1405.661273035" watchObservedRunningTime="2025-12-04 12:22:42.230420824 +0000 UTC m=+1405.668482092" Dec 04 12:22:42.237783 master-0 kubenswrapper[35367]: I1204 12:22:42.237725 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx6k5\" (UniqueName: \"kubernetes.io/projected/8294f299-adc0-4d31-9475-3b425402b08a-kube-api-access-xx6k5\") pod \"dnsmasq-dns-65c9687b5f-h6zpt\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:42.313993 master-0 kubenswrapper[35367]: I1204 12:22:42.313526 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvj4z\" (UniqueName: \"kubernetes.io/projected/224a94af-e7f1-4971-be8d-d12427055eb2-kube-api-access-fvj4z\") pod \"ironic-inspector-0\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:42.313993 master-0 kubenswrapper[35367]: I1204 12:22:42.313695 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/224a94af-e7f1-4971-be8d-d12427055eb2-scripts\") pod \"ironic-inspector-0\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:42.314433 master-0 kubenswrapper[35367]: I1204 12:22:42.314338 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/224a94af-e7f1-4971-be8d-d12427055eb2-combined-ca-bundle\") pod \"ironic-inspector-0\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:42.315748 master-0 kubenswrapper[35367]: I1204 12:22:42.315317 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/224a94af-e7f1-4971-be8d-d12427055eb2-var-lib-ironic\") pod \"ironic-inspector-0\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:42.315748 master-0 kubenswrapper[35367]: I1204 12:22:42.315425 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/224a94af-e7f1-4971-be8d-d12427055eb2-config\") pod \"ironic-inspector-0\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:42.315748 master-0 kubenswrapper[35367]: I1204 12:22:42.315547 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/224a94af-e7f1-4971-be8d-d12427055eb2-etc-podinfo\") pod \"ironic-inspector-0\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:42.315748 master-0 kubenswrapper[35367]: I1204 12:22:42.315621 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/224a94af-e7f1-4971-be8d-d12427055eb2-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"ironic-inspector-0\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:42.380845 master-0 kubenswrapper[35367]: I1204 12:22:42.379869 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:42.419719 master-0 kubenswrapper[35367]: I1204 12:22:42.419064 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/224a94af-e7f1-4971-be8d-d12427055eb2-combined-ca-bundle\") pod \"ironic-inspector-0\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:42.419719 master-0 kubenswrapper[35367]: I1204 12:22:42.419316 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/224a94af-e7f1-4971-be8d-d12427055eb2-var-lib-ironic\") pod \"ironic-inspector-0\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:42.419719 master-0 kubenswrapper[35367]: I1204 12:22:42.419375 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/224a94af-e7f1-4971-be8d-d12427055eb2-config\") pod \"ironic-inspector-0\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:42.419719 master-0 kubenswrapper[35367]: I1204 12:22:42.419414 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/224a94af-e7f1-4971-be8d-d12427055eb2-etc-podinfo\") pod \"ironic-inspector-0\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:42.419719 master-0 kubenswrapper[35367]: I1204 12:22:42.419617 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/224a94af-e7f1-4971-be8d-d12427055eb2-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"ironic-inspector-0\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:42.420130 master-0 kubenswrapper[35367]: I1204 12:22:42.419854 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fvj4z\" (UniqueName: \"kubernetes.io/projected/224a94af-e7f1-4971-be8d-d12427055eb2-kube-api-access-fvj4z\") pod \"ironic-inspector-0\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:42.420130 master-0 kubenswrapper[35367]: I1204 12:22:42.419993 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/224a94af-e7f1-4971-be8d-d12427055eb2-scripts\") pod \"ironic-inspector-0\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:42.420679 master-0 kubenswrapper[35367]: I1204 12:22:42.420656 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/224a94af-e7f1-4971-be8d-d12427055eb2-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"ironic-inspector-0\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:42.421925 master-0 kubenswrapper[35367]: I1204 12:22:42.421882 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/224a94af-e7f1-4971-be8d-d12427055eb2-var-lib-ironic\") pod \"ironic-inspector-0\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:42.425533 master-0 kubenswrapper[35367]: I1204 12:22:42.425479 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/224a94af-e7f1-4971-be8d-d12427055eb2-combined-ca-bundle\") pod \"ironic-inspector-0\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:42.427517 master-0 kubenswrapper[35367]: I1204 12:22:42.427447 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/224a94af-e7f1-4971-be8d-d12427055eb2-scripts\") pod \"ironic-inspector-0\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:42.430537 master-0 kubenswrapper[35367]: I1204 12:22:42.430456 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/224a94af-e7f1-4971-be8d-d12427055eb2-config\") pod \"ironic-inspector-0\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:42.437525 master-0 kubenswrapper[35367]: I1204 12:22:42.437456 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/224a94af-e7f1-4971-be8d-d12427055eb2-etc-podinfo\") pod \"ironic-inspector-0\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:42.440754 master-0 kubenswrapper[35367]: I1204 12:22:42.440666 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvj4z\" (UniqueName: \"kubernetes.io/projected/224a94af-e7f1-4971-be8d-d12427055eb2-kube-api-access-fvj4z\") pod \"ironic-inspector-0\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:42.540717 master-0 kubenswrapper[35367]: I1204 12:22:42.540608 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-0" Dec 04 12:22:45.406777 master-0 kubenswrapper[35367]: I1204 12:22:45.406676 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-inspector-0"] Dec 04 12:22:46.748664 master-0 kubenswrapper[35367]: I1204 12:22:46.748590 35367 scope.go:117] "RemoveContainer" containerID="c699b6b1a822fa92db5217d8455e49c923287471c83b0cbaba5fd782e61cfedf" Dec 04 12:22:47.657666 master-0 kubenswrapper[35367]: I1204 12:22:47.657575 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-api-db-create-f5pbp"] Dec 04 12:22:47.681198 master-0 kubenswrapper[35367]: I1204 12:22:47.681155 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-db-create-f5pbp" Dec 04 12:22:47.686401 master-0 kubenswrapper[35367]: I1204 12:22:47.686315 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-db-create-f5pbp"] Dec 04 12:22:47.741759 master-0 kubenswrapper[35367]: I1204 12:22:47.741673 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9ae033ce-33dd-45a3-a0ff-d6f8882a04d7-operator-scripts\") pod \"nova-api-db-create-f5pbp\" (UID: \"9ae033ce-33dd-45a3-a0ff-d6f8882a04d7\") " pod="openstack/nova-api-db-create-f5pbp" Dec 04 12:22:47.742193 master-0 kubenswrapper[35367]: I1204 12:22:47.742057 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84g5q\" (UniqueName: \"kubernetes.io/projected/9ae033ce-33dd-45a3-a0ff-d6f8882a04d7-kube-api-access-84g5q\") pod \"nova-api-db-create-f5pbp\" (UID: \"9ae033ce-33dd-45a3-a0ff-d6f8882a04d7\") " pod="openstack/nova-api-db-create-f5pbp" Dec 04 12:22:47.829855 master-0 kubenswrapper[35367]: I1204 12:22:47.824772 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell0-db-create-czcw9"] Dec 04 12:22:47.840971 master-0 kubenswrapper[35367]: I1204 12:22:47.836166 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-db-create-czcw9" Dec 04 12:22:47.846259 master-0 kubenswrapper[35367]: I1204 12:22:47.845938 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-84g5q\" (UniqueName: \"kubernetes.io/projected/9ae033ce-33dd-45a3-a0ff-d6f8882a04d7-kube-api-access-84g5q\") pod \"nova-api-db-create-f5pbp\" (UID: \"9ae033ce-33dd-45a3-a0ff-d6f8882a04d7\") " pod="openstack/nova-api-db-create-f5pbp" Dec 04 12:22:47.846259 master-0 kubenswrapper[35367]: I1204 12:22:47.846269 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9ae033ce-33dd-45a3-a0ff-d6f8882a04d7-operator-scripts\") pod \"nova-api-db-create-f5pbp\" (UID: \"9ae033ce-33dd-45a3-a0ff-d6f8882a04d7\") " pod="openstack/nova-api-db-create-f5pbp" Dec 04 12:22:47.848380 master-0 kubenswrapper[35367]: I1204 12:22:47.848250 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9ae033ce-33dd-45a3-a0ff-d6f8882a04d7-operator-scripts\") pod \"nova-api-db-create-f5pbp\" (UID: \"9ae033ce-33dd-45a3-a0ff-d6f8882a04d7\") " pod="openstack/nova-api-db-create-f5pbp" Dec 04 12:22:47.857928 master-0 kubenswrapper[35367]: I1204 12:22:47.857693 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-db-create-czcw9"] Dec 04 12:22:47.884565 master-0 kubenswrapper[35367]: I1204 12:22:47.884456 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell1-db-create-rnv4x"] Dec 04 12:22:47.887003 master-0 kubenswrapper[35367]: I1204 12:22:47.886966 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-db-create-rnv4x" Dec 04 12:22:47.899780 master-0 kubenswrapper[35367]: I1204 12:22:47.899718 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-84g5q\" (UniqueName: \"kubernetes.io/projected/9ae033ce-33dd-45a3-a0ff-d6f8882a04d7-kube-api-access-84g5q\") pod \"nova-api-db-create-f5pbp\" (UID: \"9ae033ce-33dd-45a3-a0ff-d6f8882a04d7\") " pod="openstack/nova-api-db-create-f5pbp" Dec 04 12:22:47.909944 master-0 kubenswrapper[35367]: I1204 12:22:47.909881 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-api-bf96-account-create-update-6f8zt"] Dec 04 12:22:47.912382 master-0 kubenswrapper[35367]: I1204 12:22:47.912266 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-bf96-account-create-update-6f8zt" Dec 04 12:22:47.919719 master-0 kubenswrapper[35367]: I1204 12:22:47.919650 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-api-db-secret" Dec 04 12:22:47.943730 master-0 kubenswrapper[35367]: I1204 12:22:47.942919 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-db-create-rnv4x"] Dec 04 12:22:47.951951 master-0 kubenswrapper[35367]: I1204 12:22:47.951884 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/126ab2d5-6cb8-4033-8814-7c54c3038fe7-operator-scripts\") pod \"nova-api-bf96-account-create-update-6f8zt\" (UID: \"126ab2d5-6cb8-4033-8814-7c54c3038fe7\") " pod="openstack/nova-api-bf96-account-create-update-6f8zt" Dec 04 12:22:47.952348 master-0 kubenswrapper[35367]: I1204 12:22:47.952317 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdw2r\" (UniqueName: \"kubernetes.io/projected/126ab2d5-6cb8-4033-8814-7c54c3038fe7-kube-api-access-fdw2r\") pod \"nova-api-bf96-account-create-update-6f8zt\" (UID: \"126ab2d5-6cb8-4033-8814-7c54c3038fe7\") " pod="openstack/nova-api-bf96-account-create-update-6f8zt" Dec 04 12:22:47.952545 master-0 kubenswrapper[35367]: I1204 12:22:47.952514 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c1fc4958-9be9-4dd3-b986-3d35403879f2-operator-scripts\") pod \"nova-cell0-db-create-czcw9\" (UID: \"c1fc4958-9be9-4dd3-b986-3d35403879f2\") " pod="openstack/nova-cell0-db-create-czcw9" Dec 04 12:22:47.952684 master-0 kubenswrapper[35367]: I1204 12:22:47.952661 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4vhn\" (UniqueName: \"kubernetes.io/projected/bddc3ad4-ddc8-4879-a3ed-045043126b2e-kube-api-access-f4vhn\") pod \"nova-cell1-db-create-rnv4x\" (UID: \"bddc3ad4-ddc8-4879-a3ed-045043126b2e\") " pod="openstack/nova-cell1-db-create-rnv4x" Dec 04 12:22:47.952748 master-0 kubenswrapper[35367]: I1204 12:22:47.952688 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jdwn\" (UniqueName: \"kubernetes.io/projected/c1fc4958-9be9-4dd3-b986-3d35403879f2-kube-api-access-9jdwn\") pod \"nova-cell0-db-create-czcw9\" (UID: \"c1fc4958-9be9-4dd3-b986-3d35403879f2\") " pod="openstack/nova-cell0-db-create-czcw9" Dec 04 12:22:47.953374 master-0 kubenswrapper[35367]: I1204 12:22:47.953341 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bddc3ad4-ddc8-4879-a3ed-045043126b2e-operator-scripts\") pod \"nova-cell1-db-create-rnv4x\" (UID: \"bddc3ad4-ddc8-4879-a3ed-045043126b2e\") " pod="openstack/nova-cell1-db-create-rnv4x" Dec 04 12:22:47.988816 master-0 kubenswrapper[35367]: I1204 12:22:47.985397 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-65c9687b5f-h6zpt"] Dec 04 12:22:48.059764 master-0 kubenswrapper[35367]: I1204 12:22:48.059576 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bddc3ad4-ddc8-4879-a3ed-045043126b2e-operator-scripts\") pod \"nova-cell1-db-create-rnv4x\" (UID: \"bddc3ad4-ddc8-4879-a3ed-045043126b2e\") " pod="openstack/nova-cell1-db-create-rnv4x" Dec 04 12:22:48.059764 master-0 kubenswrapper[35367]: I1204 12:22:48.059705 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/126ab2d5-6cb8-4033-8814-7c54c3038fe7-operator-scripts\") pod \"nova-api-bf96-account-create-update-6f8zt\" (UID: \"126ab2d5-6cb8-4033-8814-7c54c3038fe7\") " pod="openstack/nova-api-bf96-account-create-update-6f8zt" Dec 04 12:22:48.059914 master-0 kubenswrapper[35367]: I1204 12:22:48.059837 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fdw2r\" (UniqueName: \"kubernetes.io/projected/126ab2d5-6cb8-4033-8814-7c54c3038fe7-kube-api-access-fdw2r\") pod \"nova-api-bf96-account-create-update-6f8zt\" (UID: \"126ab2d5-6cb8-4033-8814-7c54c3038fe7\") " pod="openstack/nova-api-bf96-account-create-update-6f8zt" Dec 04 12:22:48.059954 master-0 kubenswrapper[35367]: I1204 12:22:48.059913 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c1fc4958-9be9-4dd3-b986-3d35403879f2-operator-scripts\") pod \"nova-cell0-db-create-czcw9\" (UID: \"c1fc4958-9be9-4dd3-b986-3d35403879f2\") " pod="openstack/nova-cell0-db-create-czcw9" Dec 04 12:22:48.061667 master-0 kubenswrapper[35367]: I1204 12:22:48.060001 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f4vhn\" (UniqueName: \"kubernetes.io/projected/bddc3ad4-ddc8-4879-a3ed-045043126b2e-kube-api-access-f4vhn\") pod \"nova-cell1-db-create-rnv4x\" (UID: \"bddc3ad4-ddc8-4879-a3ed-045043126b2e\") " pod="openstack/nova-cell1-db-create-rnv4x" Dec 04 12:22:48.061667 master-0 kubenswrapper[35367]: I1204 12:22:48.060037 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9jdwn\" (UniqueName: \"kubernetes.io/projected/c1fc4958-9be9-4dd3-b986-3d35403879f2-kube-api-access-9jdwn\") pod \"nova-cell0-db-create-czcw9\" (UID: \"c1fc4958-9be9-4dd3-b986-3d35403879f2\") " pod="openstack/nova-cell0-db-create-czcw9" Dec 04 12:22:48.061667 master-0 kubenswrapper[35367]: I1204 12:22:48.061476 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c1fc4958-9be9-4dd3-b986-3d35403879f2-operator-scripts\") pod \"nova-cell0-db-create-czcw9\" (UID: \"c1fc4958-9be9-4dd3-b986-3d35403879f2\") " pod="openstack/nova-cell0-db-create-czcw9" Dec 04 12:22:48.062899 master-0 kubenswrapper[35367]: I1204 12:22:48.062392 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bddc3ad4-ddc8-4879-a3ed-045043126b2e-operator-scripts\") pod \"nova-cell1-db-create-rnv4x\" (UID: \"bddc3ad4-ddc8-4879-a3ed-045043126b2e\") " pod="openstack/nova-cell1-db-create-rnv4x" Dec 04 12:22:48.062899 master-0 kubenswrapper[35367]: I1204 12:22:48.062610 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/126ab2d5-6cb8-4033-8814-7c54c3038fe7-operator-scripts\") pod \"nova-api-bf96-account-create-update-6f8zt\" (UID: \"126ab2d5-6cb8-4033-8814-7c54c3038fe7\") " pod="openstack/nova-api-bf96-account-create-update-6f8zt" Dec 04 12:22:48.080838 master-0 kubenswrapper[35367]: I1204 12:22:48.079135 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-bf96-account-create-update-6f8zt"] Dec 04 12:22:48.089297 master-0 kubenswrapper[35367]: I1204 12:22:48.088773 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdw2r\" (UniqueName: \"kubernetes.io/projected/126ab2d5-6cb8-4033-8814-7c54c3038fe7-kube-api-access-fdw2r\") pod \"nova-api-bf96-account-create-update-6f8zt\" (UID: \"126ab2d5-6cb8-4033-8814-7c54c3038fe7\") " pod="openstack/nova-api-bf96-account-create-update-6f8zt" Dec 04 12:22:48.105316 master-0 kubenswrapper[35367]: I1204 12:22:48.101744 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-inspector-0"] Dec 04 12:22:48.110851 master-0 kubenswrapper[35367]: I1204 12:22:48.110779 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jdwn\" (UniqueName: \"kubernetes.io/projected/c1fc4958-9be9-4dd3-b986-3d35403879f2-kube-api-access-9jdwn\") pod \"nova-cell0-db-create-czcw9\" (UID: \"c1fc4958-9be9-4dd3-b986-3d35403879f2\") " pod="openstack/nova-cell0-db-create-czcw9" Dec 04 12:22:48.117453 master-0 kubenswrapper[35367]: I1204 12:22:48.117128 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4vhn\" (UniqueName: \"kubernetes.io/projected/bddc3ad4-ddc8-4879-a3ed-045043126b2e-kube-api-access-f4vhn\") pod \"nova-cell1-db-create-rnv4x\" (UID: \"bddc3ad4-ddc8-4879-a3ed-045043126b2e\") " pod="openstack/nova-cell1-db-create-rnv4x" Dec 04 12:22:48.122608 master-0 kubenswrapper[35367]: I1204 12:22:48.122548 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-db-create-f5pbp" Dec 04 12:22:48.171902 master-0 kubenswrapper[35367]: I1204 12:22:48.171560 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell0-06d6-account-create-update-28zsr"] Dec 04 12:22:48.173521 master-0 kubenswrapper[35367]: I1204 12:22:48.173456 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-06d6-account-create-update-28zsr" Dec 04 12:22:48.176402 master-0 kubenswrapper[35367]: I1204 12:22:48.176238 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell0-db-secret" Dec 04 12:22:48.207483 master-0 kubenswrapper[35367]: I1204 12:22:48.206963 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-06d6-account-create-update-28zsr"] Dec 04 12:22:48.240108 master-0 kubenswrapper[35367]: I1204 12:22:48.234739 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-db-create-czcw9" Dec 04 12:22:48.259138 master-0 kubenswrapper[35367]: I1204 12:22:48.259073 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell1-0aaf-account-create-update-dqn2k"] Dec 04 12:22:48.262381 master-0 kubenswrapper[35367]: I1204 12:22:48.261523 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-0aaf-account-create-update-dqn2k" Dec 04 12:22:48.262617 master-0 kubenswrapper[35367]: I1204 12:22:48.262494 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"224a94af-e7f1-4971-be8d-d12427055eb2","Type":"ContainerStarted","Data":"df44718c8b7c82254c5fe02040721aa9b5850ef3f1d2cb62e617ce6d1b622cd2"} Dec 04 12:22:48.265007 master-0 kubenswrapper[35367]: I1204 12:22:48.264971 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell1-db-secret" Dec 04 12:22:48.272170 master-0 kubenswrapper[35367]: I1204 12:22:48.270519 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-db-create-rnv4x" Dec 04 12:22:48.277015 master-0 kubenswrapper[35367]: I1204 12:22:48.276947 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p96k4\" (UniqueName: \"kubernetes.io/projected/a926be46-cd79-4cad-9105-111102f2bc57-kube-api-access-p96k4\") pod \"nova-cell0-06d6-account-create-update-28zsr\" (UID: \"a926be46-cd79-4cad-9105-111102f2bc57\") " pod="openstack/nova-cell0-06d6-account-create-update-28zsr" Dec 04 12:22:48.277379 master-0 kubenswrapper[35367]: I1204 12:22:48.277338 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a926be46-cd79-4cad-9105-111102f2bc57-operator-scripts\") pod \"nova-cell0-06d6-account-create-update-28zsr\" (UID: \"a926be46-cd79-4cad-9105-111102f2bc57\") " pod="openstack/nova-cell0-06d6-account-create-update-28zsr" Dec 04 12:22:48.355199 master-0 kubenswrapper[35367]: I1204 12:22:48.305863 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-bf96-account-create-update-6f8zt" Dec 04 12:22:48.355199 master-0 kubenswrapper[35367]: I1204 12:22:48.330890 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" event={"ID":"60937ace-8171-4692-a7a8-75df15eeb551","Type":"ContainerStarted","Data":"1fe9f153129595e1727963b961a1e202b7c692ddad88048e5874c0da4a6422e8"} Dec 04 12:22:48.355199 master-0 kubenswrapper[35367]: I1204 12:22:48.333387 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" Dec 04 12:22:48.400140 master-0 kubenswrapper[35367]: I1204 12:22:48.381179 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a926be46-cd79-4cad-9105-111102f2bc57-operator-scripts\") pod \"nova-cell0-06d6-account-create-update-28zsr\" (UID: \"a926be46-cd79-4cad-9105-111102f2bc57\") " pod="openstack/nova-cell0-06d6-account-create-update-28zsr" Dec 04 12:22:48.400140 master-0 kubenswrapper[35367]: I1204 12:22:48.381517 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p96k4\" (UniqueName: \"kubernetes.io/projected/a926be46-cd79-4cad-9105-111102f2bc57-kube-api-access-p96k4\") pod \"nova-cell0-06d6-account-create-update-28zsr\" (UID: \"a926be46-cd79-4cad-9105-111102f2bc57\") " pod="openstack/nova-cell0-06d6-account-create-update-28zsr" Dec 04 12:22:48.400140 master-0 kubenswrapper[35367]: I1204 12:22:48.381556 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88ab17ea-be2e-46db-9228-20c8350acd69-operator-scripts\") pod \"nova-cell1-0aaf-account-create-update-dqn2k\" (UID: \"88ab17ea-be2e-46db-9228-20c8350acd69\") " pod="openstack/nova-cell1-0aaf-account-create-update-dqn2k" Dec 04 12:22:48.400140 master-0 kubenswrapper[35367]: I1204 12:22:48.381638 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcgb6\" (UniqueName: \"kubernetes.io/projected/88ab17ea-be2e-46db-9228-20c8350acd69-kube-api-access-bcgb6\") pod \"nova-cell1-0aaf-account-create-update-dqn2k\" (UID: \"88ab17ea-be2e-46db-9228-20c8350acd69\") " pod="openstack/nova-cell1-0aaf-account-create-update-dqn2k" Dec 04 12:22:48.400140 master-0 kubenswrapper[35367]: I1204 12:22:48.397586 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a926be46-cd79-4cad-9105-111102f2bc57-operator-scripts\") pod \"nova-cell0-06d6-account-create-update-28zsr\" (UID: \"a926be46-cd79-4cad-9105-111102f2bc57\") " pod="openstack/nova-cell0-06d6-account-create-update-28zsr" Dec 04 12:22:48.431525 master-0 kubenswrapper[35367]: I1204 12:22:48.422561 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-conductor-0" event={"ID":"822f5f37-f2cc-4473-9544-0fb50d3d9266","Type":"ContainerStarted","Data":"07b46fa260f82be7ba81c31df16a0b51068ae98a6e7c52a33b2778cfd3341369"} Dec 04 12:22:48.460959 master-0 kubenswrapper[35367]: I1204 12:22:48.460875 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-0aaf-account-create-update-dqn2k"] Dec 04 12:22:48.468301 master-0 kubenswrapper[35367]: I1204 12:22:48.467535 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p96k4\" (UniqueName: \"kubernetes.io/projected/a926be46-cd79-4cad-9105-111102f2bc57-kube-api-access-p96k4\") pod \"nova-cell0-06d6-account-create-update-28zsr\" (UID: \"a926be46-cd79-4cad-9105-111102f2bc57\") " pod="openstack/nova-cell0-06d6-account-create-update-28zsr" Dec 04 12:22:48.503943 master-0 kubenswrapper[35367]: I1204 12:22:48.473769 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-0c69e-default-external-api-0" event={"ID":"ff693596-151c-4d87-894b-79c4457be996","Type":"ContainerStarted","Data":"89a5b2151d58ed7b6d6aaefa484c6c7b594827367425a52a065ce0350b1a14be"} Dec 04 12:22:48.503943 master-0 kubenswrapper[35367]: I1204 12:22:48.478168 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-06d6-account-create-update-28zsr" Dec 04 12:22:48.533428 master-0 kubenswrapper[35367]: I1204 12:22:48.533341 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88ab17ea-be2e-46db-9228-20c8350acd69-operator-scripts\") pod \"nova-cell1-0aaf-account-create-update-dqn2k\" (UID: \"88ab17ea-be2e-46db-9228-20c8350acd69\") " pod="openstack/nova-cell1-0aaf-account-create-update-dqn2k" Dec 04 12:22:48.533833 master-0 kubenswrapper[35367]: I1204 12:22:48.533790 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bcgb6\" (UniqueName: \"kubernetes.io/projected/88ab17ea-be2e-46db-9228-20c8350acd69-kube-api-access-bcgb6\") pod \"nova-cell1-0aaf-account-create-update-dqn2k\" (UID: \"88ab17ea-be2e-46db-9228-20c8350acd69\") " pod="openstack/nova-cell1-0aaf-account-create-update-dqn2k" Dec 04 12:22:48.538416 master-0 kubenswrapper[35367]: I1204 12:22:48.538261 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88ab17ea-be2e-46db-9228-20c8350acd69-operator-scripts\") pod \"nova-cell1-0aaf-account-create-update-dqn2k\" (UID: \"88ab17ea-be2e-46db-9228-20c8350acd69\") " pod="openstack/nova-cell1-0aaf-account-create-update-dqn2k" Dec 04 12:22:48.542759 master-0 kubenswrapper[35367]: I1204 12:22:48.542149 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" event={"ID":"8294f299-adc0-4d31-9475-3b425402b08a","Type":"ContainerStarted","Data":"2b14ed69e42639c08d45f28b293001db6f445f63ae3f54770454721a86b206ba"} Dec 04 12:22:48.582678 master-0 kubenswrapper[35367]: I1204 12:22:48.582598 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcgb6\" (UniqueName: \"kubernetes.io/projected/88ab17ea-be2e-46db-9228-20c8350acd69-kube-api-access-bcgb6\") pod \"nova-cell1-0aaf-account-create-update-dqn2k\" (UID: \"88ab17ea-be2e-46db-9228-20c8350acd69\") " pod="openstack/nova-cell1-0aaf-account-create-update-dqn2k" Dec 04 12:22:48.664135 master-0 kubenswrapper[35367]: I1204 12:22:48.663545 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/glance-0c69e-default-external-api-0" podStartSLOduration=11.663516015 podStartE2EDuration="11.663516015s" podCreationTimestamp="2025-12-04 12:22:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:22:48.60601543 +0000 UTC m=+1412.044076708" watchObservedRunningTime="2025-12-04 12:22:48.663516015 +0000 UTC m=+1412.101577283" Dec 04 12:22:48.854786 master-0 kubenswrapper[35367]: I1204 12:22:48.854330 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-0aaf-account-create-update-dqn2k" Dec 04 12:22:49.026709 master-0 kubenswrapper[35367]: I1204 12:22:49.025720 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-db-create-f5pbp"] Dec 04 12:22:49.041724 master-0 kubenswrapper[35367]: W1204 12:22:49.041559 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ae033ce_33dd_45a3_a0ff_d6f8882a04d7.slice/crio-2a066748b91f3edf8f3e2195bf01ec74be0c178f2bdd3420cb41d214ad3cdeb7 WatchSource:0}: Error finding container 2a066748b91f3edf8f3e2195bf01ec74be0c178f2bdd3420cb41d214ad3cdeb7: Status 404 returned error can't find the container with id 2a066748b91f3edf8f3e2195bf01ec74be0c178f2bdd3420cb41d214ad3cdeb7 Dec 04 12:22:49.090250 master-0 kubenswrapper[35367]: I1204 12:22:49.090094 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:49.091615 master-0 kubenswrapper[35367]: I1204 12:22:49.091505 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:49.164901 master-0 kubenswrapper[35367]: I1204 12:22:49.164842 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:49.186824 master-0 kubenswrapper[35367]: I1204 12:22:49.184640 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:49.558943 master-0 kubenswrapper[35367]: I1204 12:22:49.558887 35367 generic.go:334] "Generic (PLEG): container finished" podID="8294f299-adc0-4d31-9475-3b425402b08a" containerID="1914f30a30b8ad9f6622ce606006a3047ff0416823ad6ad5c8fc6b5cc9d9dde6" exitCode=0 Dec 04 12:22:49.559514 master-0 kubenswrapper[35367]: I1204 12:22:49.558953 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" event={"ID":"8294f299-adc0-4d31-9475-3b425402b08a","Type":"ContainerDied","Data":"1914f30a30b8ad9f6622ce606006a3047ff0416823ad6ad5c8fc6b5cc9d9dde6"} Dec 04 12:22:49.561527 master-0 kubenswrapper[35367]: I1204 12:22:49.561468 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-db-create-f5pbp" event={"ID":"9ae033ce-33dd-45a3-a0ff-d6f8882a04d7","Type":"ContainerStarted","Data":"2a066748b91f3edf8f3e2195bf01ec74be0c178f2bdd3420cb41d214ad3cdeb7"} Dec 04 12:22:49.563887 master-0 kubenswrapper[35367]: I1204 12:22:49.563800 35367 generic.go:334] "Generic (PLEG): container finished" podID="224a94af-e7f1-4971-be8d-d12427055eb2" containerID="67e773074daaf132b8e256769f74647f441f48079f2a0469d6952d6ce1798414" exitCode=0 Dec 04 12:22:49.564049 master-0 kubenswrapper[35367]: I1204 12:22:49.564010 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"224a94af-e7f1-4971-be8d-d12427055eb2","Type":"ContainerDied","Data":"67e773074daaf132b8e256769f74647f441f48079f2a0469d6952d6ce1798414"} Dec 04 12:22:49.564680 master-0 kubenswrapper[35367]: I1204 12:22:49.564631 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:49.564822 master-0 kubenswrapper[35367]: I1204 12:22:49.564778 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:49.924584 master-0 kubenswrapper[35367]: I1204 12:22:49.924452 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:49.924584 master-0 kubenswrapper[35367]: I1204 12:22:49.924539 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:49.968261 master-0 kubenswrapper[35367]: I1204 12:22:49.968188 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:49.984164 master-0 kubenswrapper[35367]: I1204 12:22:49.984065 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:50.587085 master-0 kubenswrapper[35367]: I1204 12:22:50.586963 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:50.587674 master-0 kubenswrapper[35367]: I1204 12:22:50.587609 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:51.576702 master-0 kubenswrapper[35367]: I1204 12:22:51.576618 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-db-create-czcw9"] Dec 04 12:22:51.605224 master-0 kubenswrapper[35367]: I1204 12:22:51.604632 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" event={"ID":"8294f299-adc0-4d31-9475-3b425402b08a","Type":"ContainerStarted","Data":"ad0d2c0fa08caa1fb6d3e8dc7b209a09361d9ce6dced006a2a7aae0d564866f4"} Dec 04 12:22:51.605415 master-0 kubenswrapper[35367]: I1204 12:22:51.605240 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:51.607712 master-0 kubenswrapper[35367]: I1204 12:22:51.607672 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-db-create-f5pbp" event={"ID":"9ae033ce-33dd-45a3-a0ff-d6f8882a04d7","Type":"ContainerStarted","Data":"2e0f36270ad02b118298ad2a3b3b4027cf614cf210edb9d33c147c017cfcae8e"} Dec 04 12:22:51.610693 master-0 kubenswrapper[35367]: I1204 12:22:51.610631 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-db-create-czcw9" event={"ID":"c1fc4958-9be9-4dd3-b986-3d35403879f2","Type":"ContainerStarted","Data":"4a2e3615a490d0ec5a7abd9817b2d35eaa88fdabd809388a0af1a2e209e4316d"} Dec 04 12:22:51.781521 master-0 kubenswrapper[35367]: I1204 12:22:51.781455 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:51.781904 master-0 kubenswrapper[35367]: I1204 12:22:51.781590 35367 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Dec 04 12:22:51.853741 master-0 kubenswrapper[35367]: I1204 12:22:51.853591 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/glance-0c69e-default-internal-api-0" Dec 04 12:22:52.339035 master-0 kubenswrapper[35367]: W1204 12:22:52.338970 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod126ab2d5_6cb8_4033_8814_7c54c3038fe7.slice/crio-033bb4c8021d372966fe6d5482a34cb468b73b2127ca1e26585aa7348bf33120 WatchSource:0}: Error finding container 033bb4c8021d372966fe6d5482a34cb468b73b2127ca1e26585aa7348bf33120: Status 404 returned error can't find the container with id 033bb4c8021d372966fe6d5482a34cb468b73b2127ca1e26585aa7348bf33120 Dec 04 12:22:52.349648 master-0 kubenswrapper[35367]: W1204 12:22:52.349567 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbddc3ad4_ddc8_4879_a3ed_045043126b2e.slice/crio-766f383f29e418b847a61065bbd98162619eb93ca59e99623c9f33c980858419 WatchSource:0}: Error finding container 766f383f29e418b847a61065bbd98162619eb93ca59e99623c9f33c980858419: Status 404 returned error can't find the container with id 766f383f29e418b847a61065bbd98162619eb93ca59e99623c9f33c980858419 Dec 04 12:22:52.352290 master-0 kubenswrapper[35367]: I1204 12:22:52.351845 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-db-create-rnv4x"] Dec 04 12:22:52.358336 master-0 kubenswrapper[35367]: W1204 12:22:52.357676 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda926be46_cd79_4cad_9105_111102f2bc57.slice/crio-ab7c20ad6c06a6615af8b6be90f537b3ea7d9b9c40713fd552031dfd88f08d45 WatchSource:0}: Error finding container ab7c20ad6c06a6615af8b6be90f537b3ea7d9b9c40713fd552031dfd88f08d45: Status 404 returned error can't find the container with id ab7c20ad6c06a6615af8b6be90f537b3ea7d9b9c40713fd552031dfd88f08d45 Dec 04 12:22:52.359588 master-0 kubenswrapper[35367]: W1204 12:22:52.359554 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88ab17ea_be2e_46db_9228_20c8350acd69.slice/crio-56be6117b08ac8c057c036b6c8f8de4e7b5ae1ceb584298fde3eaef313dc8f5b WatchSource:0}: Error finding container 56be6117b08ac8c057c036b6c8f8de4e7b5ae1ceb584298fde3eaef313dc8f5b: Status 404 returned error can't find the container with id 56be6117b08ac8c057c036b6c8f8de4e7b5ae1ceb584298fde3eaef313dc8f5b Dec 04 12:22:52.371365 master-0 kubenswrapper[35367]: I1204 12:22:52.371216 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-0aaf-account-create-update-dqn2k"] Dec 04 12:22:52.385137 master-0 kubenswrapper[35367]: I1204 12:22:52.385056 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-06d6-account-create-update-28zsr"] Dec 04 12:22:52.401387 master-0 kubenswrapper[35367]: I1204 12:22:52.401270 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-bf96-account-create-update-6f8zt"] Dec 04 12:22:52.632028 master-0 kubenswrapper[35367]: I1204 12:22:52.631893 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-06d6-account-create-update-28zsr" event={"ID":"a926be46-cd79-4cad-9105-111102f2bc57","Type":"ContainerStarted","Data":"ab7c20ad6c06a6615af8b6be90f537b3ea7d9b9c40713fd552031dfd88f08d45"} Dec 04 12:22:52.634587 master-0 kubenswrapper[35367]: I1204 12:22:52.634493 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-db-create-rnv4x" event={"ID":"bddc3ad4-ddc8-4879-a3ed-045043126b2e","Type":"ContainerStarted","Data":"766f383f29e418b847a61065bbd98162619eb93ca59e99623c9f33c980858419"} Dec 04 12:22:52.647431 master-0 kubenswrapper[35367]: I1204 12:22:52.647318 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-0aaf-account-create-update-dqn2k" event={"ID":"88ab17ea-be2e-46db-9228-20c8350acd69","Type":"ContainerStarted","Data":"56be6117b08ac8c057c036b6c8f8de4e7b5ae1ceb584298fde3eaef313dc8f5b"} Dec 04 12:22:52.652178 master-0 kubenswrapper[35367]: I1204 12:22:52.651871 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-db-create-czcw9" event={"ID":"c1fc4958-9be9-4dd3-b986-3d35403879f2","Type":"ContainerStarted","Data":"58a275bc5016f2928f87149e743e01413b32aedfe6f49f29727bd0127b03d9c0"} Dec 04 12:22:52.655867 master-0 kubenswrapper[35367]: I1204 12:22:52.655749 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-bf96-account-create-update-6f8zt" event={"ID":"126ab2d5-6cb8-4033-8814-7c54c3038fe7","Type":"ContainerStarted","Data":"033bb4c8021d372966fe6d5482a34cb468b73b2127ca1e26585aa7348bf33120"} Dec 04 12:22:52.806837 master-0 kubenswrapper[35367]: I1204 12:22:52.806547 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ironic-neutron-agent-776b955f8c-hd9lh" Dec 04 12:22:52.910320 master-0 kubenswrapper[35367]: I1204 12:22:52.909308 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:22:53.211147 master-0 kubenswrapper[35367]: I1204 12:22:53.209474 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-api-db-create-f5pbp" podStartSLOduration=6.209443402 podStartE2EDuration="6.209443402s" podCreationTimestamp="2025-12-04 12:22:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:22:53.148473214 +0000 UTC m=+1416.586534472" watchObservedRunningTime="2025-12-04 12:22:53.209443402 +0000 UTC m=+1416.647504670" Dec 04 12:22:53.222395 master-0 kubenswrapper[35367]: I1204 12:22:53.222195 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" podStartSLOduration=12.222174827 podStartE2EDuration="12.222174827s" podCreationTimestamp="2025-12-04 12:22:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:22:53.199114364 +0000 UTC m=+1416.637175622" watchObservedRunningTime="2025-12-04 12:22:53.222174827 +0000 UTC m=+1416.660236085" Dec 04 12:22:53.678073 master-0 kubenswrapper[35367]: I1204 12:22:53.677348 35367 generic.go:334] "Generic (PLEG): container finished" podID="126ab2d5-6cb8-4033-8814-7c54c3038fe7" containerID="3c412e31c83c764a18929b8e2a9d689f8233ce512c293b49be0681e94ff299fe" exitCode=0 Dec 04 12:22:53.678073 master-0 kubenswrapper[35367]: I1204 12:22:53.677471 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-bf96-account-create-update-6f8zt" event={"ID":"126ab2d5-6cb8-4033-8814-7c54c3038fe7","Type":"ContainerDied","Data":"3c412e31c83c764a18929b8e2a9d689f8233ce512c293b49be0681e94ff299fe"} Dec 04 12:22:53.681551 master-0 kubenswrapper[35367]: I1204 12:22:53.681061 35367 generic.go:334] "Generic (PLEG): container finished" podID="9ae033ce-33dd-45a3-a0ff-d6f8882a04d7" containerID="2e0f36270ad02b118298ad2a3b3b4027cf614cf210edb9d33c147c017cfcae8e" exitCode=0 Dec 04 12:22:53.681551 master-0 kubenswrapper[35367]: I1204 12:22:53.681204 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-db-create-f5pbp" event={"ID":"9ae033ce-33dd-45a3-a0ff-d6f8882a04d7","Type":"ContainerDied","Data":"2e0f36270ad02b118298ad2a3b3b4027cf614cf210edb9d33c147c017cfcae8e"} Dec 04 12:22:53.686264 master-0 kubenswrapper[35367]: I1204 12:22:53.686181 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"224a94af-e7f1-4971-be8d-d12427055eb2","Type":"ContainerDied","Data":"df44718c8b7c82254c5fe02040721aa9b5850ef3f1d2cb62e617ce6d1b622cd2"} Dec 04 12:22:53.686264 master-0 kubenswrapper[35367]: I1204 12:22:53.686273 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df44718c8b7c82254c5fe02040721aa9b5850ef3f1d2cb62e617ce6d1b622cd2" Dec 04 12:22:53.691107 master-0 kubenswrapper[35367]: I1204 12:22:53.691010 35367 generic.go:334] "Generic (PLEG): container finished" podID="822f5f37-f2cc-4473-9544-0fb50d3d9266" containerID="07b46fa260f82be7ba81c31df16a0b51068ae98a6e7c52a33b2778cfd3341369" exitCode=0 Dec 04 12:22:53.691341 master-0 kubenswrapper[35367]: I1204 12:22:53.691199 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-conductor-0" event={"ID":"822f5f37-f2cc-4473-9544-0fb50d3d9266","Type":"ContainerDied","Data":"07b46fa260f82be7ba81c31df16a0b51068ae98a6e7c52a33b2778cfd3341369"} Dec 04 12:22:53.694788 master-0 kubenswrapper[35367]: I1204 12:22:53.694689 35367 generic.go:334] "Generic (PLEG): container finished" podID="a926be46-cd79-4cad-9105-111102f2bc57" containerID="0e8a97428b0b1106c0c197d437e77773ece006a05bfd99c9c6668bb19bd07f70" exitCode=0 Dec 04 12:22:53.695165 master-0 kubenswrapper[35367]: I1204 12:22:53.694762 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-06d6-account-create-update-28zsr" event={"ID":"a926be46-cd79-4cad-9105-111102f2bc57","Type":"ContainerDied","Data":"0e8a97428b0b1106c0c197d437e77773ece006a05bfd99c9c6668bb19bd07f70"} Dec 04 12:22:53.708235 master-0 kubenswrapper[35367]: I1204 12:22:53.708155 35367 generic.go:334] "Generic (PLEG): container finished" podID="bddc3ad4-ddc8-4879-a3ed-045043126b2e" containerID="7fa6c5876d653f92cb6c6dcd79cef6309ac38164e08daf26311ed5cb3d94c9c9" exitCode=0 Dec 04 12:22:53.708533 master-0 kubenswrapper[35367]: I1204 12:22:53.708348 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-db-create-rnv4x" event={"ID":"bddc3ad4-ddc8-4879-a3ed-045043126b2e","Type":"ContainerDied","Data":"7fa6c5876d653f92cb6c6dcd79cef6309ac38164e08daf26311ed5cb3d94c9c9"} Dec 04 12:22:53.712109 master-0 kubenswrapper[35367]: I1204 12:22:53.712041 35367 generic.go:334] "Generic (PLEG): container finished" podID="88ab17ea-be2e-46db-9228-20c8350acd69" containerID="26c22582f734c8575c8d1230204f75746c43cb407a59f3d7dacee84ee684061d" exitCode=0 Dec 04 12:22:53.712333 master-0 kubenswrapper[35367]: I1204 12:22:53.712188 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-0aaf-account-create-update-dqn2k" event={"ID":"88ab17ea-be2e-46db-9228-20c8350acd69","Type":"ContainerDied","Data":"26c22582f734c8575c8d1230204f75746c43cb407a59f3d7dacee84ee684061d"} Dec 04 12:22:53.714543 master-0 kubenswrapper[35367]: I1204 12:22:53.714492 35367 generic.go:334] "Generic (PLEG): container finished" podID="c1fc4958-9be9-4dd3-b986-3d35403879f2" containerID="58a275bc5016f2928f87149e743e01413b32aedfe6f49f29727bd0127b03d9c0" exitCode=0 Dec 04 12:22:53.714543 master-0 kubenswrapper[35367]: I1204 12:22:53.714542 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-db-create-czcw9" event={"ID":"c1fc4958-9be9-4dd3-b986-3d35403879f2","Type":"ContainerDied","Data":"58a275bc5016f2928f87149e743e01413b32aedfe6f49f29727bd0127b03d9c0"} Dec 04 12:22:53.735032 master-0 kubenswrapper[35367]: I1204 12:22:53.730553 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-0" Dec 04 12:22:53.851950 master-0 kubenswrapper[35367]: I1204 12:22:53.851874 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/224a94af-e7f1-4971-be8d-d12427055eb2-scripts\") pod \"224a94af-e7f1-4971-be8d-d12427055eb2\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " Dec 04 12:22:53.852258 master-0 kubenswrapper[35367]: I1204 12:22:53.852015 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/224a94af-e7f1-4971-be8d-d12427055eb2-var-lib-ironic\") pod \"224a94af-e7f1-4971-be8d-d12427055eb2\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " Dec 04 12:22:53.852258 master-0 kubenswrapper[35367]: I1204 12:22:53.852203 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/224a94af-e7f1-4971-be8d-d12427055eb2-config\") pod \"224a94af-e7f1-4971-be8d-d12427055eb2\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " Dec 04 12:22:53.852258 master-0 kubenswrapper[35367]: I1204 12:22:53.852241 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/224a94af-e7f1-4971-be8d-d12427055eb2-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"224a94af-e7f1-4971-be8d-d12427055eb2\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " Dec 04 12:22:53.852400 master-0 kubenswrapper[35367]: I1204 12:22:53.852295 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/224a94af-e7f1-4971-be8d-d12427055eb2-combined-ca-bundle\") pod \"224a94af-e7f1-4971-be8d-d12427055eb2\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " Dec 04 12:22:53.852476 master-0 kubenswrapper[35367]: I1204 12:22:53.852432 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvj4z\" (UniqueName: \"kubernetes.io/projected/224a94af-e7f1-4971-be8d-d12427055eb2-kube-api-access-fvj4z\") pod \"224a94af-e7f1-4971-be8d-d12427055eb2\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " Dec 04 12:22:53.852476 master-0 kubenswrapper[35367]: I1204 12:22:53.852464 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/224a94af-e7f1-4971-be8d-d12427055eb2-etc-podinfo\") pod \"224a94af-e7f1-4971-be8d-d12427055eb2\" (UID: \"224a94af-e7f1-4971-be8d-d12427055eb2\") " Dec 04 12:22:53.853866 master-0 kubenswrapper[35367]: I1204 12:22:53.852692 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/224a94af-e7f1-4971-be8d-d12427055eb2-var-lib-ironic-inspector-dhcp-hostsdir" (OuterVolumeSpecName: "var-lib-ironic-inspector-dhcp-hostsdir") pod "224a94af-e7f1-4971-be8d-d12427055eb2" (UID: "224a94af-e7f1-4971-be8d-d12427055eb2"). InnerVolumeSpecName "var-lib-ironic-inspector-dhcp-hostsdir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:22:53.853866 master-0 kubenswrapper[35367]: I1204 12:22:53.853359 35367 reconciler_common.go:293] "Volume detached for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/224a94af-e7f1-4971-be8d-d12427055eb2-var-lib-ironic-inspector-dhcp-hostsdir\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:53.854846 master-0 kubenswrapper[35367]: I1204 12:22:53.854744 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/224a94af-e7f1-4971-be8d-d12427055eb2-var-lib-ironic" (OuterVolumeSpecName: "var-lib-ironic") pod "224a94af-e7f1-4971-be8d-d12427055eb2" (UID: "224a94af-e7f1-4971-be8d-d12427055eb2"). InnerVolumeSpecName "var-lib-ironic". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:22:53.856701 master-0 kubenswrapper[35367]: I1204 12:22:53.856050 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/224a94af-e7f1-4971-be8d-d12427055eb2-kube-api-access-fvj4z" (OuterVolumeSpecName: "kube-api-access-fvj4z") pod "224a94af-e7f1-4971-be8d-d12427055eb2" (UID: "224a94af-e7f1-4971-be8d-d12427055eb2"). InnerVolumeSpecName "kube-api-access-fvj4z". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:53.857258 master-0 kubenswrapper[35367]: I1204 12:22:53.856769 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/224a94af-e7f1-4971-be8d-d12427055eb2-config" (OuterVolumeSpecName: "config") pod "224a94af-e7f1-4971-be8d-d12427055eb2" (UID: "224a94af-e7f1-4971-be8d-d12427055eb2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:53.857385 master-0 kubenswrapper[35367]: I1204 12:22:53.857342 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/224a94af-e7f1-4971-be8d-d12427055eb2-scripts" (OuterVolumeSpecName: "scripts") pod "224a94af-e7f1-4971-be8d-d12427055eb2" (UID: "224a94af-e7f1-4971-be8d-d12427055eb2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:53.858982 master-0 kubenswrapper[35367]: I1204 12:22:53.858942 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/224a94af-e7f1-4971-be8d-d12427055eb2-etc-podinfo" (OuterVolumeSpecName: "etc-podinfo") pod "224a94af-e7f1-4971-be8d-d12427055eb2" (UID: "224a94af-e7f1-4971-be8d-d12427055eb2"). InnerVolumeSpecName "etc-podinfo". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Dec 04 12:22:53.918030 master-0 kubenswrapper[35367]: I1204 12:22:53.917387 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/224a94af-e7f1-4971-be8d-d12427055eb2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "224a94af-e7f1-4971-be8d-d12427055eb2" (UID: "224a94af-e7f1-4971-be8d-d12427055eb2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:22:53.956350 master-0 kubenswrapper[35367]: I1204 12:22:53.956268 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/224a94af-e7f1-4971-be8d-d12427055eb2-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:53.956350 master-0 kubenswrapper[35367]: I1204 12:22:53.956335 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/224a94af-e7f1-4971-be8d-d12427055eb2-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:53.956350 master-0 kubenswrapper[35367]: I1204 12:22:53.956358 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fvj4z\" (UniqueName: \"kubernetes.io/projected/224a94af-e7f1-4971-be8d-d12427055eb2-kube-api-access-fvj4z\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:53.956350 master-0 kubenswrapper[35367]: I1204 12:22:53.956370 35367 reconciler_common.go:293] "Volume detached for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/224a94af-e7f1-4971-be8d-d12427055eb2-etc-podinfo\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:53.956878 master-0 kubenswrapper[35367]: I1204 12:22:53.956380 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/224a94af-e7f1-4971-be8d-d12427055eb2-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:53.956878 master-0 kubenswrapper[35367]: I1204 12:22:53.956390 35367 reconciler_common.go:293] "Volume detached for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/224a94af-e7f1-4971-be8d-d12427055eb2-var-lib-ironic\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:54.733858 master-0 kubenswrapper[35367]: I1204 12:22:54.733438 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-0" Dec 04 12:22:55.112607 master-0 kubenswrapper[35367]: I1204 12:22:55.110617 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-inspector-0"] Dec 04 12:22:55.115608 master-0 kubenswrapper[35367]: I1204 12:22:55.115423 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ironic-inspector-0"] Dec 04 12:22:55.165272 master-0 kubenswrapper[35367]: I1204 12:22:55.165197 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-inspector-0"] Dec 04 12:22:55.166783 master-0 kubenswrapper[35367]: E1204 12:22:55.165848 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="224a94af-e7f1-4971-be8d-d12427055eb2" containerName="ironic-python-agent-init" Dec 04 12:22:55.166783 master-0 kubenswrapper[35367]: I1204 12:22:55.165870 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="224a94af-e7f1-4971-be8d-d12427055eb2" containerName="ironic-python-agent-init" Dec 04 12:22:55.166783 master-0 kubenswrapper[35367]: I1204 12:22:55.166192 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="224a94af-e7f1-4971-be8d-d12427055eb2" containerName="ironic-python-agent-init" Dec 04 12:22:55.189639 master-0 kubenswrapper[35367]: I1204 12:22:55.187129 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-0" Dec 04 12:22:55.195431 master-0 kubenswrapper[35367]: I1204 12:22:55.195338 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ironic-inspector-public-svc" Dec 04 12:22:55.196231 master-0 kubenswrapper[35367]: I1204 12:22:55.195970 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"rabbitmq-transport-url-ironic-inspector-transport" Dec 04 12:22:55.196231 master-0 kubenswrapper[35367]: I1204 12:22:55.196078 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-inspector-config-data" Dec 04 12:22:55.196398 master-0 kubenswrapper[35367]: I1204 12:22:55.196243 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ironic-inspector-internal-svc" Dec 04 12:22:55.206140 master-0 kubenswrapper[35367]: I1204 12:22:55.205796 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-inspector-scripts" Dec 04 12:22:55.209161 master-0 kubenswrapper[35367]: I1204 12:22:55.208299 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-inspector-0"] Dec 04 12:22:55.223034 master-0 kubenswrapper[35367]: I1204 12:22:55.222956 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-etc-podinfo\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.223323 master-0 kubenswrapper[35367]: I1204 12:22:55.223076 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-public-tls-certs\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.223394 master-0 kubenswrapper[35367]: I1204 12:22:55.223315 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-config\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.223394 master-0 kubenswrapper[35367]: I1204 12:22:55.223369 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.223491 master-0 kubenswrapper[35367]: I1204 12:22:55.223447 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-combined-ca-bundle\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.223660 master-0 kubenswrapper[35367]: I1204 12:22:55.223534 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-internal-tls-certs\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.223660 master-0 kubenswrapper[35367]: I1204 12:22:55.223637 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-scripts\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.223987 master-0 kubenswrapper[35367]: I1204 12:22:55.223953 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-var-lib-ironic\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.224058 master-0 kubenswrapper[35367]: I1204 12:22:55.224032 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdk24\" (UniqueName: \"kubernetes.io/projected/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-kube-api-access-bdk24\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.327077 master-0 kubenswrapper[35367]: I1204 12:22:55.326864 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-var-lib-ironic\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.327077 master-0 kubenswrapper[35367]: I1204 12:22:55.326963 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bdk24\" (UniqueName: \"kubernetes.io/projected/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-kube-api-access-bdk24\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.327619 master-0 kubenswrapper[35367]: I1204 12:22:55.327149 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-etc-podinfo\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.327619 master-0 kubenswrapper[35367]: I1204 12:22:55.327176 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-public-tls-certs\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.327619 master-0 kubenswrapper[35367]: I1204 12:22:55.327255 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-config\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.327619 master-0 kubenswrapper[35367]: I1204 12:22:55.327285 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.327619 master-0 kubenswrapper[35367]: I1204 12:22:55.327334 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-combined-ca-bundle\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.327619 master-0 kubenswrapper[35367]: I1204 12:22:55.327370 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-internal-tls-certs\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.327619 master-0 kubenswrapper[35367]: I1204 12:22:55.327410 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-scripts\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.328949 master-0 kubenswrapper[35367]: I1204 12:22:55.328912 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-ironic-inspector-dhcp-hostsdir\" (UniqueName: \"kubernetes.io/empty-dir/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-var-lib-ironic-inspector-dhcp-hostsdir\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.332174 master-0 kubenswrapper[35367]: I1204 12:22:55.332094 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-ironic\" (UniqueName: \"kubernetes.io/empty-dir/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-var-lib-ironic\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.333687 master-0 kubenswrapper[35367]: I1204 12:22:55.333528 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-public-tls-certs\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.335095 master-0 kubenswrapper[35367]: I1204 12:22:55.335060 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-config\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.335488 master-0 kubenswrapper[35367]: I1204 12:22:55.335456 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-scripts\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.347621 master-0 kubenswrapper[35367]: I1204 12:22:55.347570 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-combined-ca-bundle\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.348942 master-0 kubenswrapper[35367]: I1204 12:22:55.348907 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-etc-podinfo\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.349313 master-0 kubenswrapper[35367]: I1204 12:22:55.349279 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdk24\" (UniqueName: \"kubernetes.io/projected/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-kube-api-access-bdk24\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.352055 master-0 kubenswrapper[35367]: I1204 12:22:55.352018 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7da5cf45-5cd7-406d-b0a2-00929c81ddaf-internal-tls-certs\") pod \"ironic-inspector-0\" (UID: \"7da5cf45-5cd7-406d-b0a2-00929c81ddaf\") " pod="openstack/ironic-inspector-0" Dec 04 12:22:55.480396 master-0 kubenswrapper[35367]: I1204 12:22:55.480341 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-db-create-f5pbp" Dec 04 12:22:55.534528 master-0 kubenswrapper[35367]: I1204 12:22:55.533262 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9ae033ce-33dd-45a3-a0ff-d6f8882a04d7-operator-scripts\") pod \"9ae033ce-33dd-45a3-a0ff-d6f8882a04d7\" (UID: \"9ae033ce-33dd-45a3-a0ff-d6f8882a04d7\") " Dec 04 12:22:55.534528 master-0 kubenswrapper[35367]: I1204 12:22:55.533534 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84g5q\" (UniqueName: \"kubernetes.io/projected/9ae033ce-33dd-45a3-a0ff-d6f8882a04d7-kube-api-access-84g5q\") pod \"9ae033ce-33dd-45a3-a0ff-d6f8882a04d7\" (UID: \"9ae033ce-33dd-45a3-a0ff-d6f8882a04d7\") " Dec 04 12:22:55.553916 master-0 kubenswrapper[35367]: I1204 12:22:55.545063 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ae033ce-33dd-45a3-a0ff-d6f8882a04d7-kube-api-access-84g5q" (OuterVolumeSpecName: "kube-api-access-84g5q") pod "9ae033ce-33dd-45a3-a0ff-d6f8882a04d7" (UID: "9ae033ce-33dd-45a3-a0ff-d6f8882a04d7"). InnerVolumeSpecName "kube-api-access-84g5q". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:55.553916 master-0 kubenswrapper[35367]: I1204 12:22:55.545479 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ae033ce-33dd-45a3-a0ff-d6f8882a04d7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9ae033ce-33dd-45a3-a0ff-d6f8882a04d7" (UID: "9ae033ce-33dd-45a3-a0ff-d6f8882a04d7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:55.553916 master-0 kubenswrapper[35367]: I1204 12:22:55.551351 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-inspector-0" Dec 04 12:22:55.669511 master-0 kubenswrapper[35367]: I1204 12:22:55.669315 35367 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9ae033ce-33dd-45a3-a0ff-d6f8882a04d7-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:55.669511 master-0 kubenswrapper[35367]: I1204 12:22:55.669402 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-84g5q\" (UniqueName: \"kubernetes.io/projected/9ae033ce-33dd-45a3-a0ff-d6f8882a04d7-kube-api-access-84g5q\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:55.755844 master-0 kubenswrapper[35367]: I1204 12:22:55.755761 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-bf96-account-create-update-6f8zt" event={"ID":"126ab2d5-6cb8-4033-8814-7c54c3038fe7","Type":"ContainerDied","Data":"033bb4c8021d372966fe6d5482a34cb468b73b2127ca1e26585aa7348bf33120"} Dec 04 12:22:55.755844 master-0 kubenswrapper[35367]: I1204 12:22:55.755847 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="033bb4c8021d372966fe6d5482a34cb468b73b2127ca1e26585aa7348bf33120" Dec 04 12:22:55.761211 master-0 kubenswrapper[35367]: I1204 12:22:55.761149 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-db-create-f5pbp" Dec 04 12:22:55.761384 master-0 kubenswrapper[35367]: I1204 12:22:55.761255 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-db-create-f5pbp" event={"ID":"9ae033ce-33dd-45a3-a0ff-d6f8882a04d7","Type":"ContainerDied","Data":"2a066748b91f3edf8f3e2195bf01ec74be0c178f2bdd3420cb41d214ad3cdeb7"} Dec 04 12:22:55.761384 master-0 kubenswrapper[35367]: I1204 12:22:55.761312 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a066748b91f3edf8f3e2195bf01ec74be0c178f2bdd3420cb41d214ad3cdeb7" Dec 04 12:22:55.761612 master-0 kubenswrapper[35367]: I1204 12:22:55.761528 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-06d6-account-create-update-28zsr" Dec 04 12:22:55.776341 master-0 kubenswrapper[35367]: I1204 12:22:55.771942 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p96k4\" (UniqueName: \"kubernetes.io/projected/a926be46-cd79-4cad-9105-111102f2bc57-kube-api-access-p96k4\") pod \"a926be46-cd79-4cad-9105-111102f2bc57\" (UID: \"a926be46-cd79-4cad-9105-111102f2bc57\") " Dec 04 12:22:55.776341 master-0 kubenswrapper[35367]: I1204 12:22:55.771970 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-06d6-account-create-update-28zsr" event={"ID":"a926be46-cd79-4cad-9105-111102f2bc57","Type":"ContainerDied","Data":"ab7c20ad6c06a6615af8b6be90f537b3ea7d9b9c40713fd552031dfd88f08d45"} Dec 04 12:22:55.776341 master-0 kubenswrapper[35367]: I1204 12:22:55.772014 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab7c20ad6c06a6615af8b6be90f537b3ea7d9b9c40713fd552031dfd88f08d45" Dec 04 12:22:55.776341 master-0 kubenswrapper[35367]: I1204 12:22:55.772238 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a926be46-cd79-4cad-9105-111102f2bc57-operator-scripts\") pod \"a926be46-cd79-4cad-9105-111102f2bc57\" (UID: \"a926be46-cd79-4cad-9105-111102f2bc57\") " Dec 04 12:22:55.776341 master-0 kubenswrapper[35367]: I1204 12:22:55.773529 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a926be46-cd79-4cad-9105-111102f2bc57-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a926be46-cd79-4cad-9105-111102f2bc57" (UID: "a926be46-cd79-4cad-9105-111102f2bc57"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:55.776886 master-0 kubenswrapper[35367]: I1204 12:22:55.776794 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a926be46-cd79-4cad-9105-111102f2bc57-kube-api-access-p96k4" (OuterVolumeSpecName: "kube-api-access-p96k4") pod "a926be46-cd79-4cad-9105-111102f2bc57" (UID: "a926be46-cd79-4cad-9105-111102f2bc57"). InnerVolumeSpecName "kube-api-access-p96k4". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:55.789305 master-0 kubenswrapper[35367]: I1204 12:22:55.786266 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-0aaf-account-create-update-dqn2k" event={"ID":"88ab17ea-be2e-46db-9228-20c8350acd69","Type":"ContainerDied","Data":"56be6117b08ac8c057c036b6c8f8de4e7b5ae1ceb584298fde3eaef313dc8f5b"} Dec 04 12:22:55.789305 master-0 kubenswrapper[35367]: I1204 12:22:55.786404 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56be6117b08ac8c057c036b6c8f8de4e7b5ae1ceb584298fde3eaef313dc8f5b" Dec 04 12:22:55.789305 master-0 kubenswrapper[35367]: I1204 12:22:55.789606 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-db-create-czcw9" event={"ID":"c1fc4958-9be9-4dd3-b986-3d35403879f2","Type":"ContainerDied","Data":"4a2e3615a490d0ec5a7abd9817b2d35eaa88fdabd809388a0af1a2e209e4316d"} Dec 04 12:22:55.789305 master-0 kubenswrapper[35367]: I1204 12:22:55.789644 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a2e3615a490d0ec5a7abd9817b2d35eaa88fdabd809388a0af1a2e209e4316d" Dec 04 12:22:55.824971 master-0 kubenswrapper[35367]: I1204 12:22:55.824702 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-0aaf-account-create-update-dqn2k" Dec 04 12:22:55.872532 master-0 kubenswrapper[35367]: I1204 12:22:55.872476 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-db-create-czcw9" Dec 04 12:22:55.875833 master-0 kubenswrapper[35367]: I1204 12:22:55.875208 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-bf96-account-create-update-6f8zt" Dec 04 12:22:55.876587 master-0 kubenswrapper[35367]: I1204 12:22:55.876377 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcgb6\" (UniqueName: \"kubernetes.io/projected/88ab17ea-be2e-46db-9228-20c8350acd69-kube-api-access-bcgb6\") pod \"88ab17ea-be2e-46db-9228-20c8350acd69\" (UID: \"88ab17ea-be2e-46db-9228-20c8350acd69\") " Dec 04 12:22:55.876587 master-0 kubenswrapper[35367]: I1204 12:22:55.876562 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88ab17ea-be2e-46db-9228-20c8350acd69-operator-scripts\") pod \"88ab17ea-be2e-46db-9228-20c8350acd69\" (UID: \"88ab17ea-be2e-46db-9228-20c8350acd69\") " Dec 04 12:22:55.878028 master-0 kubenswrapper[35367]: I1204 12:22:55.877973 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88ab17ea-be2e-46db-9228-20c8350acd69-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "88ab17ea-be2e-46db-9228-20c8350acd69" (UID: "88ab17ea-be2e-46db-9228-20c8350acd69"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:55.878707 master-0 kubenswrapper[35367]: I1204 12:22:55.878672 35367 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a926be46-cd79-4cad-9105-111102f2bc57-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:55.878707 master-0 kubenswrapper[35367]: I1204 12:22:55.878702 35367 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88ab17ea-be2e-46db-9228-20c8350acd69-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:55.878847 master-0 kubenswrapper[35367]: I1204 12:22:55.878718 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-p96k4\" (UniqueName: \"kubernetes.io/projected/a926be46-cd79-4cad-9105-111102f2bc57-kube-api-access-p96k4\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:55.883497 master-0 kubenswrapper[35367]: I1204 12:22:55.883257 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88ab17ea-be2e-46db-9228-20c8350acd69-kube-api-access-bcgb6" (OuterVolumeSpecName: "kube-api-access-bcgb6") pod "88ab17ea-be2e-46db-9228-20c8350acd69" (UID: "88ab17ea-be2e-46db-9228-20c8350acd69"). InnerVolumeSpecName "kube-api-access-bcgb6". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:55.896333 master-0 kubenswrapper[35367]: I1204 12:22:55.895072 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-db-create-rnv4x" Dec 04 12:22:55.983209 master-0 kubenswrapper[35367]: I1204 12:22:55.982076 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c1fc4958-9be9-4dd3-b986-3d35403879f2-operator-scripts\") pod \"c1fc4958-9be9-4dd3-b986-3d35403879f2\" (UID: \"c1fc4958-9be9-4dd3-b986-3d35403879f2\") " Dec 04 12:22:55.983209 master-0 kubenswrapper[35367]: I1204 12:22:55.982138 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bddc3ad4-ddc8-4879-a3ed-045043126b2e-operator-scripts\") pod \"bddc3ad4-ddc8-4879-a3ed-045043126b2e\" (UID: \"bddc3ad4-ddc8-4879-a3ed-045043126b2e\") " Dec 04 12:22:55.983209 master-0 kubenswrapper[35367]: I1204 12:22:55.982257 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4vhn\" (UniqueName: \"kubernetes.io/projected/bddc3ad4-ddc8-4879-a3ed-045043126b2e-kube-api-access-f4vhn\") pod \"bddc3ad4-ddc8-4879-a3ed-045043126b2e\" (UID: \"bddc3ad4-ddc8-4879-a3ed-045043126b2e\") " Dec 04 12:22:55.983209 master-0 kubenswrapper[35367]: I1204 12:22:55.982365 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jdwn\" (UniqueName: \"kubernetes.io/projected/c1fc4958-9be9-4dd3-b986-3d35403879f2-kube-api-access-9jdwn\") pod \"c1fc4958-9be9-4dd3-b986-3d35403879f2\" (UID: \"c1fc4958-9be9-4dd3-b986-3d35403879f2\") " Dec 04 12:22:55.983209 master-0 kubenswrapper[35367]: I1204 12:22:55.982446 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdw2r\" (UniqueName: \"kubernetes.io/projected/126ab2d5-6cb8-4033-8814-7c54c3038fe7-kube-api-access-fdw2r\") pod \"126ab2d5-6cb8-4033-8814-7c54c3038fe7\" (UID: \"126ab2d5-6cb8-4033-8814-7c54c3038fe7\") " Dec 04 12:22:55.983209 master-0 kubenswrapper[35367]: I1204 12:22:55.982487 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/126ab2d5-6cb8-4033-8814-7c54c3038fe7-operator-scripts\") pod \"126ab2d5-6cb8-4033-8814-7c54c3038fe7\" (UID: \"126ab2d5-6cb8-4033-8814-7c54c3038fe7\") " Dec 04 12:22:55.983626 master-0 kubenswrapper[35367]: I1204 12:22:55.983288 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1fc4958-9be9-4dd3-b986-3d35403879f2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c1fc4958-9be9-4dd3-b986-3d35403879f2" (UID: "c1fc4958-9be9-4dd3-b986-3d35403879f2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:55.986405 master-0 kubenswrapper[35367]: I1204 12:22:55.986133 35367 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c1fc4958-9be9-4dd3-b986-3d35403879f2-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:55.986405 master-0 kubenswrapper[35367]: I1204 12:22:55.986171 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bcgb6\" (UniqueName: \"kubernetes.io/projected/88ab17ea-be2e-46db-9228-20c8350acd69-kube-api-access-bcgb6\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:55.986405 master-0 kubenswrapper[35367]: I1204 12:22:55.986205 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/126ab2d5-6cb8-4033-8814-7c54c3038fe7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "126ab2d5-6cb8-4033-8814-7c54c3038fe7" (UID: "126ab2d5-6cb8-4033-8814-7c54c3038fe7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:55.987060 master-0 kubenswrapper[35367]: I1204 12:22:55.986994 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bddc3ad4-ddc8-4879-a3ed-045043126b2e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "bddc3ad4-ddc8-4879-a3ed-045043126b2e" (UID: "bddc3ad4-ddc8-4879-a3ed-045043126b2e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:55.987296 master-0 kubenswrapper[35367]: I1204 12:22:55.987155 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bddc3ad4-ddc8-4879-a3ed-045043126b2e-kube-api-access-f4vhn" (OuterVolumeSpecName: "kube-api-access-f4vhn") pod "bddc3ad4-ddc8-4879-a3ed-045043126b2e" (UID: "bddc3ad4-ddc8-4879-a3ed-045043126b2e"). InnerVolumeSpecName "kube-api-access-f4vhn". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:55.991503 master-0 kubenswrapper[35367]: I1204 12:22:55.991380 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/126ab2d5-6cb8-4033-8814-7c54c3038fe7-kube-api-access-fdw2r" (OuterVolumeSpecName: "kube-api-access-fdw2r") pod "126ab2d5-6cb8-4033-8814-7c54c3038fe7" (UID: "126ab2d5-6cb8-4033-8814-7c54c3038fe7"). InnerVolumeSpecName "kube-api-access-fdw2r". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:55.991759 master-0 kubenswrapper[35367]: I1204 12:22:55.991502 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1fc4958-9be9-4dd3-b986-3d35403879f2-kube-api-access-9jdwn" (OuterVolumeSpecName: "kube-api-access-9jdwn") pod "c1fc4958-9be9-4dd3-b986-3d35403879f2" (UID: "c1fc4958-9be9-4dd3-b986-3d35403879f2"). InnerVolumeSpecName "kube-api-access-9jdwn". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:56.096744 master-0 kubenswrapper[35367]: I1204 12:22:56.096158 35367 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bddc3ad4-ddc8-4879-a3ed-045043126b2e-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:56.096744 master-0 kubenswrapper[35367]: I1204 12:22:56.096227 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f4vhn\" (UniqueName: \"kubernetes.io/projected/bddc3ad4-ddc8-4879-a3ed-045043126b2e-kube-api-access-f4vhn\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:56.096744 master-0 kubenswrapper[35367]: I1204 12:22:56.096249 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9jdwn\" (UniqueName: \"kubernetes.io/projected/c1fc4958-9be9-4dd3-b986-3d35403879f2-kube-api-access-9jdwn\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:56.096744 master-0 kubenswrapper[35367]: I1204 12:22:56.096263 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fdw2r\" (UniqueName: \"kubernetes.io/projected/126ab2d5-6cb8-4033-8814-7c54c3038fe7-kube-api-access-fdw2r\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:56.096744 master-0 kubenswrapper[35367]: I1204 12:22:56.096279 35367 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/126ab2d5-6cb8-4033-8814-7c54c3038fe7-operator-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:56.350043 master-0 kubenswrapper[35367]: W1204 12:22:56.349957 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7da5cf45_5cd7_406d_b0a2_00929c81ddaf.slice/crio-2f36ab9bc3fe961142ba44a5ac1a6bee88ee6675b441df2c25e79211a1e62574 WatchSource:0}: Error finding container 2f36ab9bc3fe961142ba44a5ac1a6bee88ee6675b441df2c25e79211a1e62574: Status 404 returned error can't find the container with id 2f36ab9bc3fe961142ba44a5ac1a6bee88ee6675b441df2c25e79211a1e62574 Dec 04 12:22:56.350361 master-0 kubenswrapper[35367]: I1204 12:22:56.350261 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-inspector-0"] Dec 04 12:22:56.769325 master-0 kubenswrapper[35367]: I1204 12:22:56.769258 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="224a94af-e7f1-4971-be8d-d12427055eb2" path="/var/lib/kubelet/pods/224a94af-e7f1-4971-be8d-d12427055eb2/volumes" Dec 04 12:22:56.818586 master-0 kubenswrapper[35367]: I1204 12:22:56.818537 35367 generic.go:334] "Generic (PLEG): container finished" podID="7da5cf45-5cd7-406d-b0a2-00929c81ddaf" containerID="e52ee19c297f57e0a74784318de7ab29a4a7a3b660074247fb4d7d82beba0d43" exitCode=0 Dec 04 12:22:56.818887 master-0 kubenswrapper[35367]: I1204 12:22:56.818860 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"7da5cf45-5cd7-406d-b0a2-00929c81ddaf","Type":"ContainerDied","Data":"e52ee19c297f57e0a74784318de7ab29a4a7a3b660074247fb4d7d82beba0d43"} Dec 04 12:22:56.819012 master-0 kubenswrapper[35367]: I1204 12:22:56.818992 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"7da5cf45-5cd7-406d-b0a2-00929c81ddaf","Type":"ContainerStarted","Data":"2f36ab9bc3fe961142ba44a5ac1a6bee88ee6675b441df2c25e79211a1e62574"} Dec 04 12:22:56.830133 master-0 kubenswrapper[35367]: I1204 12:22:56.827395 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-bf96-account-create-update-6f8zt" Dec 04 12:22:56.830133 master-0 kubenswrapper[35367]: I1204 12:22:56.827686 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-0aaf-account-create-update-dqn2k" Dec 04 12:22:56.830133 master-0 kubenswrapper[35367]: I1204 12:22:56.828121 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-db-create-czcw9" Dec 04 12:22:56.830133 master-0 kubenswrapper[35367]: I1204 12:22:56.828179 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-db-create-rnv4x" Dec 04 12:22:56.830133 master-0 kubenswrapper[35367]: I1204 12:22:56.828699 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-06d6-account-create-update-28zsr" Dec 04 12:22:56.830133 master-0 kubenswrapper[35367]: I1204 12:22:56.828897 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-db-create-rnv4x" event={"ID":"bddc3ad4-ddc8-4879-a3ed-045043126b2e","Type":"ContainerDied","Data":"766f383f29e418b847a61065bbd98162619eb93ca59e99623c9f33c980858419"} Dec 04 12:22:56.830133 master-0 kubenswrapper[35367]: I1204 12:22:56.828930 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="766f383f29e418b847a61065bbd98162619eb93ca59e99623c9f33c980858419" Dec 04 12:22:57.382728 master-0 kubenswrapper[35367]: I1204 12:22:57.382068 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:22:57.486688 master-0 kubenswrapper[35367]: I1204 12:22:57.485942 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-798989f845-tfbmz"] Dec 04 12:22:57.486688 master-0 kubenswrapper[35367]: I1204 12:22:57.486223 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-798989f845-tfbmz" podUID="0a6ed281-8138-49a1-b433-ff5813e6562b" containerName="dnsmasq-dns" containerID="cri-o://54fed0f73eb43d65f4ff87686eef4ac9fdc81cb37c96f1d2dab53d0ffd6c5f74" gracePeriod=10 Dec 04 12:22:57.857920 master-0 kubenswrapper[35367]: I1204 12:22:57.853979 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/dnsmasq-dns-798989f845-tfbmz" podUID="0a6ed281-8138-49a1-b433-ff5813e6562b" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.128.1.8:5353: connect: connection refused" Dec 04 12:22:57.904889 master-0 kubenswrapper[35367]: I1204 12:22:57.900686 35367 generic.go:334] "Generic (PLEG): container finished" podID="0a6ed281-8138-49a1-b433-ff5813e6562b" containerID="54fed0f73eb43d65f4ff87686eef4ac9fdc81cb37c96f1d2dab53d0ffd6c5f74" exitCode=0 Dec 04 12:22:57.904889 master-0 kubenswrapper[35367]: I1204 12:22:57.900790 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-798989f845-tfbmz" event={"ID":"0a6ed281-8138-49a1-b433-ff5813e6562b","Type":"ContainerDied","Data":"54fed0f73eb43d65f4ff87686eef4ac9fdc81cb37c96f1d2dab53d0ffd6c5f74"} Dec 04 12:22:58.343623 master-0 kubenswrapper[35367]: I1204 12:22:58.343418 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell0-conductor-db-sync-l8v2r"] Dec 04 12:22:58.344265 master-0 kubenswrapper[35367]: E1204 12:22:58.344229 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="88ab17ea-be2e-46db-9228-20c8350acd69" containerName="mariadb-account-create-update" Dec 04 12:22:58.344265 master-0 kubenswrapper[35367]: I1204 12:22:58.344258 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="88ab17ea-be2e-46db-9228-20c8350acd69" containerName="mariadb-account-create-update" Dec 04 12:22:58.344430 master-0 kubenswrapper[35367]: E1204 12:22:58.344326 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="126ab2d5-6cb8-4033-8814-7c54c3038fe7" containerName="mariadb-account-create-update" Dec 04 12:22:58.344430 master-0 kubenswrapper[35367]: I1204 12:22:58.344338 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="126ab2d5-6cb8-4033-8814-7c54c3038fe7" containerName="mariadb-account-create-update" Dec 04 12:22:58.344430 master-0 kubenswrapper[35367]: E1204 12:22:58.344365 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bddc3ad4-ddc8-4879-a3ed-045043126b2e" containerName="mariadb-database-create" Dec 04 12:22:58.344430 master-0 kubenswrapper[35367]: I1204 12:22:58.344376 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="bddc3ad4-ddc8-4879-a3ed-045043126b2e" containerName="mariadb-database-create" Dec 04 12:22:58.344430 master-0 kubenswrapper[35367]: E1204 12:22:58.344389 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a926be46-cd79-4cad-9105-111102f2bc57" containerName="mariadb-account-create-update" Dec 04 12:22:58.344430 master-0 kubenswrapper[35367]: I1204 12:22:58.344397 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="a926be46-cd79-4cad-9105-111102f2bc57" containerName="mariadb-account-create-update" Dec 04 12:22:58.344430 master-0 kubenswrapper[35367]: E1204 12:22:58.344417 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9ae033ce-33dd-45a3-a0ff-d6f8882a04d7" containerName="mariadb-database-create" Dec 04 12:22:58.344430 master-0 kubenswrapper[35367]: I1204 12:22:58.344425 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ae033ce-33dd-45a3-a0ff-d6f8882a04d7" containerName="mariadb-database-create" Dec 04 12:22:58.344732 master-0 kubenswrapper[35367]: E1204 12:22:58.344465 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c1fc4958-9be9-4dd3-b986-3d35403879f2" containerName="mariadb-database-create" Dec 04 12:22:58.344732 master-0 kubenswrapper[35367]: I1204 12:22:58.344474 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1fc4958-9be9-4dd3-b986-3d35403879f2" containerName="mariadb-database-create" Dec 04 12:22:58.344919 master-0 kubenswrapper[35367]: I1204 12:22:58.344899 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="c1fc4958-9be9-4dd3-b986-3d35403879f2" containerName="mariadb-database-create" Dec 04 12:22:58.344991 master-0 kubenswrapper[35367]: I1204 12:22:58.344956 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="bddc3ad4-ddc8-4879-a3ed-045043126b2e" containerName="mariadb-database-create" Dec 04 12:22:58.345042 master-0 kubenswrapper[35367]: I1204 12:22:58.344992 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="88ab17ea-be2e-46db-9228-20c8350acd69" containerName="mariadb-account-create-update" Dec 04 12:22:58.345042 master-0 kubenswrapper[35367]: I1204 12:22:58.345011 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="126ab2d5-6cb8-4033-8814-7c54c3038fe7" containerName="mariadb-account-create-update" Dec 04 12:22:58.345042 master-0 kubenswrapper[35367]: I1204 12:22:58.345024 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="9ae033ce-33dd-45a3-a0ff-d6f8882a04d7" containerName="mariadb-database-create" Dec 04 12:22:58.345157 master-0 kubenswrapper[35367]: I1204 12:22:58.345044 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="a926be46-cd79-4cad-9105-111102f2bc57" containerName="mariadb-account-create-update" Dec 04 12:22:58.346252 master-0 kubenswrapper[35367]: I1204 12:22:58.346226 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-conductor-db-sync-l8v2r" Dec 04 12:22:58.349245 master-0 kubenswrapper[35367]: I1204 12:22:58.349169 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell0-conductor-scripts" Dec 04 12:22:58.349245 master-0 kubenswrapper[35367]: I1204 12:22:58.349280 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell0-conductor-config-data" Dec 04 12:22:58.379641 master-0 kubenswrapper[35367]: I1204 12:22:58.377675 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-conductor-db-sync-l8v2r"] Dec 04 12:22:58.387100 master-0 kubenswrapper[35367]: I1204 12:22:58.387021 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtjkj\" (UniqueName: \"kubernetes.io/projected/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-kube-api-access-mtjkj\") pod \"nova-cell0-conductor-db-sync-l8v2r\" (UID: \"77b6e18a-8e1b-4f73-812e-80a31a9de2d3\") " pod="openstack/nova-cell0-conductor-db-sync-l8v2r" Dec 04 12:22:58.387196 master-0 kubenswrapper[35367]: I1204 12:22:58.387175 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-l8v2r\" (UID: \"77b6e18a-8e1b-4f73-812e-80a31a9de2d3\") " pod="openstack/nova-cell0-conductor-db-sync-l8v2r" Dec 04 12:22:58.387959 master-0 kubenswrapper[35367]: I1204 12:22:58.387913 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-config-data\") pod \"nova-cell0-conductor-db-sync-l8v2r\" (UID: \"77b6e18a-8e1b-4f73-812e-80a31a9de2d3\") " pod="openstack/nova-cell0-conductor-db-sync-l8v2r" Dec 04 12:22:58.388047 master-0 kubenswrapper[35367]: I1204 12:22:58.388026 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-scripts\") pod \"nova-cell0-conductor-db-sync-l8v2r\" (UID: \"77b6e18a-8e1b-4f73-812e-80a31a9de2d3\") " pod="openstack/nova-cell0-conductor-db-sync-l8v2r" Dec 04 12:22:58.491119 master-0 kubenswrapper[35367]: I1204 12:22:58.490979 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-config-data\") pod \"nova-cell0-conductor-db-sync-l8v2r\" (UID: \"77b6e18a-8e1b-4f73-812e-80a31a9de2d3\") " pod="openstack/nova-cell0-conductor-db-sync-l8v2r" Dec 04 12:22:58.491119 master-0 kubenswrapper[35367]: I1204 12:22:58.491072 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-scripts\") pod \"nova-cell0-conductor-db-sync-l8v2r\" (UID: \"77b6e18a-8e1b-4f73-812e-80a31a9de2d3\") " pod="openstack/nova-cell0-conductor-db-sync-l8v2r" Dec 04 12:22:58.493666 master-0 kubenswrapper[35367]: I1204 12:22:58.491268 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mtjkj\" (UniqueName: \"kubernetes.io/projected/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-kube-api-access-mtjkj\") pod \"nova-cell0-conductor-db-sync-l8v2r\" (UID: \"77b6e18a-8e1b-4f73-812e-80a31a9de2d3\") " pod="openstack/nova-cell0-conductor-db-sync-l8v2r" Dec 04 12:22:58.493666 master-0 kubenswrapper[35367]: I1204 12:22:58.491360 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-l8v2r\" (UID: \"77b6e18a-8e1b-4f73-812e-80a31a9de2d3\") " pod="openstack/nova-cell0-conductor-db-sync-l8v2r" Dec 04 12:22:58.499175 master-0 kubenswrapper[35367]: I1204 12:22:58.497519 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-scripts\") pod \"nova-cell0-conductor-db-sync-l8v2r\" (UID: \"77b6e18a-8e1b-4f73-812e-80a31a9de2d3\") " pod="openstack/nova-cell0-conductor-db-sync-l8v2r" Dec 04 12:22:58.499175 master-0 kubenswrapper[35367]: I1204 12:22:58.498662 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-l8v2r\" (UID: \"77b6e18a-8e1b-4f73-812e-80a31a9de2d3\") " pod="openstack/nova-cell0-conductor-db-sync-l8v2r" Dec 04 12:22:58.499175 master-0 kubenswrapper[35367]: I1204 12:22:58.498866 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-config-data\") pod \"nova-cell0-conductor-db-sync-l8v2r\" (UID: \"77b6e18a-8e1b-4f73-812e-80a31a9de2d3\") " pod="openstack/nova-cell0-conductor-db-sync-l8v2r" Dec 04 12:22:58.508528 master-0 kubenswrapper[35367]: I1204 12:22:58.508452 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtjkj\" (UniqueName: \"kubernetes.io/projected/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-kube-api-access-mtjkj\") pod \"nova-cell0-conductor-db-sync-l8v2r\" (UID: \"77b6e18a-8e1b-4f73-812e-80a31a9de2d3\") " pod="openstack/nova-cell0-conductor-db-sync-l8v2r" Dec 04 12:22:58.697095 master-0 kubenswrapper[35367]: I1204 12:22:58.696852 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-conductor-db-sync-l8v2r" Dec 04 12:22:59.659041 master-0 kubenswrapper[35367]: I1204 12:22:59.658992 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:59.715980 master-0 kubenswrapper[35367]: I1204 12:22:59.715748 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-conductor-db-sync-l8v2r"] Dec 04 12:22:59.747170 master-0 kubenswrapper[35367]: I1204 12:22:59.747087 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-config\") pod \"0a6ed281-8138-49a1-b433-ff5813e6562b\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " Dec 04 12:22:59.747374 master-0 kubenswrapper[35367]: I1204 12:22:59.747210 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-ovsdbserver-sb\") pod \"0a6ed281-8138-49a1-b433-ff5813e6562b\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " Dec 04 12:22:59.747488 master-0 kubenswrapper[35367]: I1204 12:22:59.747421 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-ovsdbserver-nb\") pod \"0a6ed281-8138-49a1-b433-ff5813e6562b\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " Dec 04 12:22:59.748259 master-0 kubenswrapper[35367]: I1204 12:22:59.748229 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-dns-swift-storage-0\") pod \"0a6ed281-8138-49a1-b433-ff5813e6562b\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " Dec 04 12:22:59.748366 master-0 kubenswrapper[35367]: I1204 12:22:59.748286 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwfmd\" (UniqueName: \"kubernetes.io/projected/0a6ed281-8138-49a1-b433-ff5813e6562b-kube-api-access-cwfmd\") pod \"0a6ed281-8138-49a1-b433-ff5813e6562b\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " Dec 04 12:22:59.748624 master-0 kubenswrapper[35367]: I1204 12:22:59.748578 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-dns-svc\") pod \"0a6ed281-8138-49a1-b433-ff5813e6562b\" (UID: \"0a6ed281-8138-49a1-b433-ff5813e6562b\") " Dec 04 12:22:59.752167 master-0 kubenswrapper[35367]: I1204 12:22:59.752125 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a6ed281-8138-49a1-b433-ff5813e6562b-kube-api-access-cwfmd" (OuterVolumeSpecName: "kube-api-access-cwfmd") pod "0a6ed281-8138-49a1-b433-ff5813e6562b" (UID: "0a6ed281-8138-49a1-b433-ff5813e6562b"). InnerVolumeSpecName "kube-api-access-cwfmd". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:22:59.837391 master-0 kubenswrapper[35367]: I1204 12:22:59.837309 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-config" (OuterVolumeSpecName: "config") pod "0a6ed281-8138-49a1-b433-ff5813e6562b" (UID: "0a6ed281-8138-49a1-b433-ff5813e6562b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:59.838908 master-0 kubenswrapper[35367]: I1204 12:22:59.838851 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "0a6ed281-8138-49a1-b433-ff5813e6562b" (UID: "0a6ed281-8138-49a1-b433-ff5813e6562b"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:59.839891 master-0 kubenswrapper[35367]: I1204 12:22:59.839786 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "0a6ed281-8138-49a1-b433-ff5813e6562b" (UID: "0a6ed281-8138-49a1-b433-ff5813e6562b"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:59.848399 master-0 kubenswrapper[35367]: I1204 12:22:59.848319 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "0a6ed281-8138-49a1-b433-ff5813e6562b" (UID: "0a6ed281-8138-49a1-b433-ff5813e6562b"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:59.849028 master-0 kubenswrapper[35367]: I1204 12:22:59.848988 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "0a6ed281-8138-49a1-b433-ff5813e6562b" (UID: "0a6ed281-8138-49a1-b433-ff5813e6562b"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:22:59.852580 master-0 kubenswrapper[35367]: I1204 12:22:59.852531 35367 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-dns-swift-storage-0\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:59.852580 master-0 kubenswrapper[35367]: I1204 12:22:59.852569 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cwfmd\" (UniqueName: \"kubernetes.io/projected/0a6ed281-8138-49a1-b433-ff5813e6562b-kube-api-access-cwfmd\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:59.852580 master-0 kubenswrapper[35367]: I1204 12:22:59.852580 35367 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:59.852734 master-0 kubenswrapper[35367]: I1204 12:22:59.852593 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:59.852734 master-0 kubenswrapper[35367]: I1204 12:22:59.852605 35367 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:59.852734 master-0 kubenswrapper[35367]: I1204 12:22:59.852616 35367 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/0a6ed281-8138-49a1-b433-ff5813e6562b-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:22:59.935829 master-0 kubenswrapper[35367]: I1204 12:22:59.935717 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"7da5cf45-5cd7-406d-b0a2-00929c81ddaf","Type":"ContainerStarted","Data":"5b6b56b8f8a5d64b326b5c32ccab67a0e9db7318f91c66d4c2024a174d8e1467"} Dec 04 12:22:59.939180 master-0 kubenswrapper[35367]: I1204 12:22:59.939133 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-798989f845-tfbmz" Dec 04 12:22:59.939375 master-0 kubenswrapper[35367]: I1204 12:22:59.939161 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-798989f845-tfbmz" event={"ID":"0a6ed281-8138-49a1-b433-ff5813e6562b","Type":"ContainerDied","Data":"8473b532c6a2a95e672c158e26c03b2291661a94264a6ffed9e78d53ca92977a"} Dec 04 12:22:59.939375 master-0 kubenswrapper[35367]: I1204 12:22:59.939262 35367 scope.go:117] "RemoveContainer" containerID="54fed0f73eb43d65f4ff87686eef4ac9fdc81cb37c96f1d2dab53d0ffd6c5f74" Dec 04 12:22:59.942019 master-0 kubenswrapper[35367]: I1204 12:22:59.941786 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-conductor-db-sync-l8v2r" event={"ID":"77b6e18a-8e1b-4f73-812e-80a31a9de2d3","Type":"ContainerStarted","Data":"f108ec7f3102d8615863a145aa19ddb984a81f9c5d1b421368f3027695f31be2"} Dec 04 12:22:59.983406 master-0 kubenswrapper[35367]: I1204 12:22:59.981018 35367 scope.go:117] "RemoveContainer" containerID="23b1943f0914d18307baa9d2da6b19fa2fd86dfc5a01f0b612668712ecbf19fb" Dec 04 12:23:00.022087 master-0 kubenswrapper[35367]: I1204 12:23:00.021997 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-798989f845-tfbmz"] Dec 04 12:23:00.045097 master-0 kubenswrapper[35367]: I1204 12:23:00.045002 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-798989f845-tfbmz"] Dec 04 12:23:00.765838 master-0 kubenswrapper[35367]: I1204 12:23:00.765727 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a6ed281-8138-49a1-b433-ff5813e6562b" path="/var/lib/kubelet/pods/0a6ed281-8138-49a1-b433-ff5813e6562b/volumes" Dec 04 12:23:00.963460 master-0 kubenswrapper[35367]: I1204 12:23:00.963345 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-conductor-0" event={"ID":"822f5f37-f2cc-4473-9544-0fb50d3d9266","Type":"ContainerStarted","Data":"be381973a54d21b0980d31002f1e2ea6cb47661f77d7cd57b3f24a6b1a705a0f"} Dec 04 12:23:00.966302 master-0 kubenswrapper[35367]: I1204 12:23:00.966170 35367 generic.go:334] "Generic (PLEG): container finished" podID="7da5cf45-5cd7-406d-b0a2-00929c81ddaf" containerID="5b6b56b8f8a5d64b326b5c32ccab67a0e9db7318f91c66d4c2024a174d8e1467" exitCode=0 Dec 04 12:23:00.966458 master-0 kubenswrapper[35367]: I1204 12:23:00.966277 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"7da5cf45-5cd7-406d-b0a2-00929c81ddaf","Type":"ContainerDied","Data":"5b6b56b8f8a5d64b326b5c32ccab67a0e9db7318f91c66d4c2024a174d8e1467"} Dec 04 12:23:03.007096 master-0 kubenswrapper[35367]: I1204 12:23:03.007022 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"7da5cf45-5cd7-406d-b0a2-00929c81ddaf","Type":"ContainerStarted","Data":"bafe3adba48b9dcd0c5548c1a38c84caf558b0e5c296f53917a780f29d345617"} Dec 04 12:23:03.007096 master-0 kubenswrapper[35367]: I1204 12:23:03.007077 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"7da5cf45-5cd7-406d-b0a2-00929c81ddaf","Type":"ContainerStarted","Data":"d1042df6f00fccd81a5d4fe04de58b0c5ed98127b16a55648702986caf5f7d6f"} Dec 04 12:23:09.102621 master-0 kubenswrapper[35367]: I1204 12:23:09.102508 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-conductor-db-sync-l8v2r" event={"ID":"77b6e18a-8e1b-4f73-812e-80a31a9de2d3","Type":"ContainerStarted","Data":"2168865c5fdd6314a61798e9d1ee525b0878f2956830fb196edf368586ae5d81"} Dec 04 12:23:09.108984 master-0 kubenswrapper[35367]: I1204 12:23:09.108736 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"7da5cf45-5cd7-406d-b0a2-00929c81ddaf","Type":"ContainerStarted","Data":"d828bb39b1bbfcd045b2011ee8c7db1dfb45d8a99b9c817e20e5f40c69fab6c9"} Dec 04 12:23:09.108984 master-0 kubenswrapper[35367]: I1204 12:23:09.108817 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"7da5cf45-5cd7-406d-b0a2-00929c81ddaf","Type":"ContainerStarted","Data":"5c15fd91d68ea3b9c75ef0a3b65dbe4ac9f2ac3684d071711e451a84f596372c"} Dec 04 12:23:09.239020 master-0 kubenswrapper[35367]: I1204 12:23:09.238905 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell0-conductor-db-sync-l8v2r" podStartSLOduration=2.854831239 podStartE2EDuration="11.238881277s" podCreationTimestamp="2025-12-04 12:22:58 +0000 UTC" firstStartedPulling="2025-12-04 12:22:59.738329508 +0000 UTC m=+1423.176390766" lastFinishedPulling="2025-12-04 12:23:08.122379556 +0000 UTC m=+1431.560440804" observedRunningTime="2025-12-04 12:23:09.22231476 +0000 UTC m=+1432.660376028" watchObservedRunningTime="2025-12-04 12:23:09.238881277 +0000 UTC m=+1432.676942545" Dec 04 12:23:10.134042 master-0 kubenswrapper[35367]: I1204 12:23:10.133969 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-inspector-0" event={"ID":"7da5cf45-5cd7-406d-b0a2-00929c81ddaf","Type":"ContainerStarted","Data":"cfda82c8ebb59bba85141eb971c107313005b5f618271b80f607e90d996cd8aa"} Dec 04 12:23:10.134042 master-0 kubenswrapper[35367]: I1204 12:23:10.134054 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-inspector-0" Dec 04 12:23:10.134861 master-0 kubenswrapper[35367]: I1204 12:23:10.134080 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-inspector-0" Dec 04 12:23:10.184458 master-0 kubenswrapper[35367]: I1204 12:23:10.184352 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ironic-inspector-0" podStartSLOduration=12.868055731 podStartE2EDuration="15.18432556s" podCreationTimestamp="2025-12-04 12:22:55 +0000 UTC" firstStartedPulling="2025-12-04 12:22:56.827970396 +0000 UTC m=+1420.266031654" lastFinishedPulling="2025-12-04 12:22:59.144240225 +0000 UTC m=+1422.582301483" observedRunningTime="2025-12-04 12:23:10.177572005 +0000 UTC m=+1433.615633263" watchObservedRunningTime="2025-12-04 12:23:10.18432556 +0000 UTC m=+1433.622386818" Dec 04 12:23:10.552732 master-0 kubenswrapper[35367]: I1204 12:23:10.552589 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-inspector-0" Dec 04 12:23:10.552732 master-0 kubenswrapper[35367]: I1204 12:23:10.552652 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-inspector-0" Dec 04 12:23:12.180906 master-0 kubenswrapper[35367]: I1204 12:23:12.180797 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/glance-0c69e-default-external-api-0" Dec 04 12:23:12.196550 master-0 kubenswrapper[35367]: I1204 12:23:12.196476 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ironic-inspector-0" Dec 04 12:23:13.172514 master-0 kubenswrapper[35367]: I1204 12:23:13.172441 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ironic-inspector-0" Dec 04 12:23:15.553302 master-0 kubenswrapper[35367]: I1204 12:23:15.553252 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/ironic-inspector-0" Dec 04 12:23:15.553770 master-0 kubenswrapper[35367]: I1204 12:23:15.553318 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/ironic-inspector-0" Dec 04 12:23:15.583101 master-0 kubenswrapper[35367]: I1204 12:23:15.583045 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/ironic-inspector-0" Dec 04 12:23:15.588067 master-0 kubenswrapper[35367]: I1204 12:23:15.588003 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/ironic-inspector-0" Dec 04 12:23:16.218329 master-0 kubenswrapper[35367]: I1204 12:23:16.218227 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ironic-inspector-0" Dec 04 12:23:16.228297 master-0 kubenswrapper[35367]: I1204 12:23:16.228247 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ironic-inspector-0" Dec 04 12:23:25.345223 master-0 kubenswrapper[35367]: I1204 12:23:25.345139 35367 generic.go:334] "Generic (PLEG): container finished" podID="77b6e18a-8e1b-4f73-812e-80a31a9de2d3" containerID="2168865c5fdd6314a61798e9d1ee525b0878f2956830fb196edf368586ae5d81" exitCode=0 Dec 04 12:23:25.345223 master-0 kubenswrapper[35367]: I1204 12:23:25.345202 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-conductor-db-sync-l8v2r" event={"ID":"77b6e18a-8e1b-4f73-812e-80a31a9de2d3","Type":"ContainerDied","Data":"2168865c5fdd6314a61798e9d1ee525b0878f2956830fb196edf368586ae5d81"} Dec 04 12:23:26.878820 master-0 kubenswrapper[35367]: I1204 12:23:26.878752 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-conductor-db-sync-l8v2r" Dec 04 12:23:26.997634 master-0 kubenswrapper[35367]: I1204 12:23:26.997491 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-config-data\") pod \"77b6e18a-8e1b-4f73-812e-80a31a9de2d3\" (UID: \"77b6e18a-8e1b-4f73-812e-80a31a9de2d3\") " Dec 04 12:23:26.998047 master-0 kubenswrapper[35367]: I1204 12:23:26.998019 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-scripts\") pod \"77b6e18a-8e1b-4f73-812e-80a31a9de2d3\" (UID: \"77b6e18a-8e1b-4f73-812e-80a31a9de2d3\") " Dec 04 12:23:26.998105 master-0 kubenswrapper[35367]: I1204 12:23:26.998050 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtjkj\" (UniqueName: \"kubernetes.io/projected/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-kube-api-access-mtjkj\") pod \"77b6e18a-8e1b-4f73-812e-80a31a9de2d3\" (UID: \"77b6e18a-8e1b-4f73-812e-80a31a9de2d3\") " Dec 04 12:23:26.998392 master-0 kubenswrapper[35367]: I1204 12:23:26.998349 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-combined-ca-bundle\") pod \"77b6e18a-8e1b-4f73-812e-80a31a9de2d3\" (UID: \"77b6e18a-8e1b-4f73-812e-80a31a9de2d3\") " Dec 04 12:23:27.000907 master-0 kubenswrapper[35367]: I1204 12:23:27.000852 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-kube-api-access-mtjkj" (OuterVolumeSpecName: "kube-api-access-mtjkj") pod "77b6e18a-8e1b-4f73-812e-80a31a9de2d3" (UID: "77b6e18a-8e1b-4f73-812e-80a31a9de2d3"). InnerVolumeSpecName "kube-api-access-mtjkj". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:23:27.002416 master-0 kubenswrapper[35367]: I1204 12:23:27.002380 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-scripts" (OuterVolumeSpecName: "scripts") pod "77b6e18a-8e1b-4f73-812e-80a31a9de2d3" (UID: "77b6e18a-8e1b-4f73-812e-80a31a9de2d3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:23:27.028247 master-0 kubenswrapper[35367]: I1204 12:23:27.028163 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-config-data" (OuterVolumeSpecName: "config-data") pod "77b6e18a-8e1b-4f73-812e-80a31a9de2d3" (UID: "77b6e18a-8e1b-4f73-812e-80a31a9de2d3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:23:27.029237 master-0 kubenswrapper[35367]: I1204 12:23:27.029179 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "77b6e18a-8e1b-4f73-812e-80a31a9de2d3" (UID: "77b6e18a-8e1b-4f73-812e-80a31a9de2d3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:23:27.102433 master-0 kubenswrapper[35367]: I1204 12:23:27.102354 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:27.102433 master-0 kubenswrapper[35367]: I1204 12:23:27.102402 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:27.102433 master-0 kubenswrapper[35367]: I1204 12:23:27.102411 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:27.102433 master-0 kubenswrapper[35367]: I1204 12:23:27.102420 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mtjkj\" (UniqueName: \"kubernetes.io/projected/77b6e18a-8e1b-4f73-812e-80a31a9de2d3-kube-api-access-mtjkj\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:27.406492 master-0 kubenswrapper[35367]: I1204 12:23:27.406379 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-conductor-db-sync-l8v2r" event={"ID":"77b6e18a-8e1b-4f73-812e-80a31a9de2d3","Type":"ContainerDied","Data":"f108ec7f3102d8615863a145aa19ddb984a81f9c5d1b421368f3027695f31be2"} Dec 04 12:23:27.406492 master-0 kubenswrapper[35367]: I1204 12:23:27.406445 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f108ec7f3102d8615863a145aa19ddb984a81f9c5d1b421368f3027695f31be2" Dec 04 12:23:27.406492 master-0 kubenswrapper[35367]: I1204 12:23:27.406465 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-conductor-db-sync-l8v2r" Dec 04 12:23:27.586211 master-0 kubenswrapper[35367]: I1204 12:23:27.585944 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell0-conductor-0"] Dec 04 12:23:27.586592 master-0 kubenswrapper[35367]: E1204 12:23:27.586561 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0a6ed281-8138-49a1-b433-ff5813e6562b" containerName="dnsmasq-dns" Dec 04 12:23:27.586592 master-0 kubenswrapper[35367]: I1204 12:23:27.586582 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a6ed281-8138-49a1-b433-ff5813e6562b" containerName="dnsmasq-dns" Dec 04 12:23:27.586669 master-0 kubenswrapper[35367]: E1204 12:23:27.586659 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="77b6e18a-8e1b-4f73-812e-80a31a9de2d3" containerName="nova-cell0-conductor-db-sync" Dec 04 12:23:27.586669 master-0 kubenswrapper[35367]: I1204 12:23:27.586667 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="77b6e18a-8e1b-4f73-812e-80a31a9de2d3" containerName="nova-cell0-conductor-db-sync" Dec 04 12:23:27.586737 master-0 kubenswrapper[35367]: E1204 12:23:27.586680 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0a6ed281-8138-49a1-b433-ff5813e6562b" containerName="init" Dec 04 12:23:27.586737 master-0 kubenswrapper[35367]: I1204 12:23:27.586689 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a6ed281-8138-49a1-b433-ff5813e6562b" containerName="init" Dec 04 12:23:27.587102 master-0 kubenswrapper[35367]: I1204 12:23:27.586994 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="0a6ed281-8138-49a1-b433-ff5813e6562b" containerName="dnsmasq-dns" Dec 04 12:23:27.587102 master-0 kubenswrapper[35367]: I1204 12:23:27.587033 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="77b6e18a-8e1b-4f73-812e-80a31a9de2d3" containerName="nova-cell0-conductor-db-sync" Dec 04 12:23:27.588507 master-0 kubenswrapper[35367]: I1204 12:23:27.588115 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-conductor-0" Dec 04 12:23:27.591577 master-0 kubenswrapper[35367]: I1204 12:23:27.591536 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell0-conductor-config-data" Dec 04 12:23:27.612255 master-0 kubenswrapper[35367]: I1204 12:23:27.612181 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-conductor-0"] Dec 04 12:23:27.723902 master-0 kubenswrapper[35367]: I1204 12:23:27.723722 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7eed1b29-07d7-4800-a273-cacd7656e15a-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"7eed1b29-07d7-4800-a273-cacd7656e15a\") " pod="openstack/nova-cell0-conductor-0" Dec 04 12:23:27.724471 master-0 kubenswrapper[35367]: I1204 12:23:27.724380 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtx9b\" (UniqueName: \"kubernetes.io/projected/7eed1b29-07d7-4800-a273-cacd7656e15a-kube-api-access-dtx9b\") pod \"nova-cell0-conductor-0\" (UID: \"7eed1b29-07d7-4800-a273-cacd7656e15a\") " pod="openstack/nova-cell0-conductor-0" Dec 04 12:23:27.724523 master-0 kubenswrapper[35367]: I1204 12:23:27.724496 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7eed1b29-07d7-4800-a273-cacd7656e15a-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"7eed1b29-07d7-4800-a273-cacd7656e15a\") " pod="openstack/nova-cell0-conductor-0" Dec 04 12:23:27.827039 master-0 kubenswrapper[35367]: I1204 12:23:27.826926 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7eed1b29-07d7-4800-a273-cacd7656e15a-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"7eed1b29-07d7-4800-a273-cacd7656e15a\") " pod="openstack/nova-cell0-conductor-0" Dec 04 12:23:27.827039 master-0 kubenswrapper[35367]: I1204 12:23:27.827009 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dtx9b\" (UniqueName: \"kubernetes.io/projected/7eed1b29-07d7-4800-a273-cacd7656e15a-kube-api-access-dtx9b\") pod \"nova-cell0-conductor-0\" (UID: \"7eed1b29-07d7-4800-a273-cacd7656e15a\") " pod="openstack/nova-cell0-conductor-0" Dec 04 12:23:27.827453 master-0 kubenswrapper[35367]: I1204 12:23:27.827376 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7eed1b29-07d7-4800-a273-cacd7656e15a-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"7eed1b29-07d7-4800-a273-cacd7656e15a\") " pod="openstack/nova-cell0-conductor-0" Dec 04 12:23:27.831825 master-0 kubenswrapper[35367]: I1204 12:23:27.831753 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7eed1b29-07d7-4800-a273-cacd7656e15a-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"7eed1b29-07d7-4800-a273-cacd7656e15a\") " pod="openstack/nova-cell0-conductor-0" Dec 04 12:23:27.833224 master-0 kubenswrapper[35367]: I1204 12:23:27.833164 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7eed1b29-07d7-4800-a273-cacd7656e15a-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"7eed1b29-07d7-4800-a273-cacd7656e15a\") " pod="openstack/nova-cell0-conductor-0" Dec 04 12:23:27.862995 master-0 kubenswrapper[35367]: I1204 12:23:27.862927 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtx9b\" (UniqueName: \"kubernetes.io/projected/7eed1b29-07d7-4800-a273-cacd7656e15a-kube-api-access-dtx9b\") pod \"nova-cell0-conductor-0\" (UID: \"7eed1b29-07d7-4800-a273-cacd7656e15a\") " pod="openstack/nova-cell0-conductor-0" Dec 04 12:23:27.920437 master-0 kubenswrapper[35367]: I1204 12:23:27.920317 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-conductor-0" Dec 04 12:23:28.422844 master-0 kubenswrapper[35367]: I1204 12:23:28.421558 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-conductor-0"] Dec 04 12:23:28.423843 master-0 kubenswrapper[35367]: W1204 12:23:28.423430 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7eed1b29_07d7_4800_a273_cacd7656e15a.slice/crio-95fa7d89d21a34d657e2fe3fda146053dd844e48cac99b4566472fe55ab49074 WatchSource:0}: Error finding container 95fa7d89d21a34d657e2fe3fda146053dd844e48cac99b4566472fe55ab49074: Status 404 returned error can't find the container with id 95fa7d89d21a34d657e2fe3fda146053dd844e48cac99b4566472fe55ab49074 Dec 04 12:23:29.448019 master-0 kubenswrapper[35367]: I1204 12:23:29.446600 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-conductor-0" event={"ID":"7eed1b29-07d7-4800-a273-cacd7656e15a","Type":"ContainerStarted","Data":"21d65edbb50d763d2186d1361d7586fd8f97c08014024faecd34a26a9a2ca32e"} Dec 04 12:23:29.448019 master-0 kubenswrapper[35367]: I1204 12:23:29.446661 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-conductor-0" event={"ID":"7eed1b29-07d7-4800-a273-cacd7656e15a","Type":"ContainerStarted","Data":"95fa7d89d21a34d657e2fe3fda146053dd844e48cac99b4566472fe55ab49074"} Dec 04 12:23:29.448019 master-0 kubenswrapper[35367]: I1204 12:23:29.446789 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-cell0-conductor-0" Dec 04 12:23:31.347131 master-0 kubenswrapper[35367]: I1204 12:23:31.346970 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell0-conductor-0" podStartSLOduration=4.346934522 podStartE2EDuration="4.346934522s" podCreationTimestamp="2025-12-04 12:23:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:23:31.337678368 +0000 UTC m=+1454.775739636" watchObservedRunningTime="2025-12-04 12:23:31.346934522 +0000 UTC m=+1454.784995780" Dec 04 12:23:37.958636 master-0 kubenswrapper[35367]: I1204 12:23:37.958537 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-cell0-conductor-0" Dec 04 12:23:38.477836 master-0 kubenswrapper[35367]: I1204 12:23:38.477744 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell0-cell-mapping-48wk7"] Dec 04 12:23:38.480110 master-0 kubenswrapper[35367]: I1204 12:23:38.480059 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-cell-mapping-48wk7" Dec 04 12:23:38.483831 master-0 kubenswrapper[35367]: I1204 12:23:38.483729 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell0-manage-scripts" Dec 04 12:23:38.486463 master-0 kubenswrapper[35367]: I1204 12:23:38.486426 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell0-manage-config-data" Dec 04 12:23:38.494107 master-0 kubenswrapper[35367]: I1204 12:23:38.493991 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-cell-mapping-48wk7"] Dec 04 12:23:38.562276 master-0 kubenswrapper[35367]: I1204 12:23:38.562157 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/861c8de8-9e85-4f7f-a30a-b2426fd8a848-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-48wk7\" (UID: \"861c8de8-9e85-4f7f-a30a-b2426fd8a848\") " pod="openstack/nova-cell0-cell-mapping-48wk7" Dec 04 12:23:38.562695 master-0 kubenswrapper[35367]: I1204 12:23:38.562351 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66j84\" (UniqueName: \"kubernetes.io/projected/861c8de8-9e85-4f7f-a30a-b2426fd8a848-kube-api-access-66j84\") pod \"nova-cell0-cell-mapping-48wk7\" (UID: \"861c8de8-9e85-4f7f-a30a-b2426fd8a848\") " pod="openstack/nova-cell0-cell-mapping-48wk7" Dec 04 12:23:38.562695 master-0 kubenswrapper[35367]: I1204 12:23:38.562415 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/861c8de8-9e85-4f7f-a30a-b2426fd8a848-config-data\") pod \"nova-cell0-cell-mapping-48wk7\" (UID: \"861c8de8-9e85-4f7f-a30a-b2426fd8a848\") " pod="openstack/nova-cell0-cell-mapping-48wk7" Dec 04 12:23:38.562695 master-0 kubenswrapper[35367]: I1204 12:23:38.562595 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/861c8de8-9e85-4f7f-a30a-b2426fd8a848-scripts\") pod \"nova-cell0-cell-mapping-48wk7\" (UID: \"861c8de8-9e85-4f7f-a30a-b2426fd8a848\") " pod="openstack/nova-cell0-cell-mapping-48wk7" Dec 04 12:23:38.570147 master-0 kubenswrapper[35367]: I1204 12:23:38.570112 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell1-compute-ironic-compute-0"] Dec 04 12:23:38.572391 master-0 kubenswrapper[35367]: I1204 12:23:38.572369 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 12:23:38.576534 master-0 kubenswrapper[35367]: I1204 12:23:38.576373 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell1-compute-ironic-compute-config-data" Dec 04 12:23:38.628718 master-0 kubenswrapper[35367]: I1204 12:23:38.628651 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-compute-ironic-compute-0"] Dec 04 12:23:38.669512 master-0 kubenswrapper[35367]: I1204 12:23:38.669432 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a06bc55-b50f-4680-8912-32ccfb969eab-combined-ca-bundle\") pod \"nova-cell1-compute-ironic-compute-0\" (UID: \"7a06bc55-b50f-4680-8912-32ccfb969eab\") " pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 12:23:38.669845 master-0 kubenswrapper[35367]: I1204 12:23:38.669764 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/861c8de8-9e85-4f7f-a30a-b2426fd8a848-scripts\") pod \"nova-cell0-cell-mapping-48wk7\" (UID: \"861c8de8-9e85-4f7f-a30a-b2426fd8a848\") " pod="openstack/nova-cell0-cell-mapping-48wk7" Dec 04 12:23:38.669905 master-0 kubenswrapper[35367]: I1204 12:23:38.669877 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9pf8\" (UniqueName: \"kubernetes.io/projected/7a06bc55-b50f-4680-8912-32ccfb969eab-kube-api-access-c9pf8\") pod \"nova-cell1-compute-ironic-compute-0\" (UID: \"7a06bc55-b50f-4680-8912-32ccfb969eab\") " pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 12:23:38.669951 master-0 kubenswrapper[35367]: I1204 12:23:38.669938 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a06bc55-b50f-4680-8912-32ccfb969eab-config-data\") pod \"nova-cell1-compute-ironic-compute-0\" (UID: \"7a06bc55-b50f-4680-8912-32ccfb969eab\") " pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 12:23:38.669998 master-0 kubenswrapper[35367]: I1204 12:23:38.669974 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/861c8de8-9e85-4f7f-a30a-b2426fd8a848-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-48wk7\" (UID: \"861c8de8-9e85-4f7f-a30a-b2426fd8a848\") " pod="openstack/nova-cell0-cell-mapping-48wk7" Dec 04 12:23:38.670690 master-0 kubenswrapper[35367]: I1204 12:23:38.670639 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-66j84\" (UniqueName: \"kubernetes.io/projected/861c8de8-9e85-4f7f-a30a-b2426fd8a848-kube-api-access-66j84\") pod \"nova-cell0-cell-mapping-48wk7\" (UID: \"861c8de8-9e85-4f7f-a30a-b2426fd8a848\") " pod="openstack/nova-cell0-cell-mapping-48wk7" Dec 04 12:23:38.670852 master-0 kubenswrapper[35367]: I1204 12:23:38.670792 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/861c8de8-9e85-4f7f-a30a-b2426fd8a848-config-data\") pod \"nova-cell0-cell-mapping-48wk7\" (UID: \"861c8de8-9e85-4f7f-a30a-b2426fd8a848\") " pod="openstack/nova-cell0-cell-mapping-48wk7" Dec 04 12:23:38.674470 master-0 kubenswrapper[35367]: I1204 12:23:38.674413 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/861c8de8-9e85-4f7f-a30a-b2426fd8a848-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-48wk7\" (UID: \"861c8de8-9e85-4f7f-a30a-b2426fd8a848\") " pod="openstack/nova-cell0-cell-mapping-48wk7" Dec 04 12:23:38.675368 master-0 kubenswrapper[35367]: I1204 12:23:38.675327 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/861c8de8-9e85-4f7f-a30a-b2426fd8a848-scripts\") pod \"nova-cell0-cell-mapping-48wk7\" (UID: \"861c8de8-9e85-4f7f-a30a-b2426fd8a848\") " pod="openstack/nova-cell0-cell-mapping-48wk7" Dec 04 12:23:38.675918 master-0 kubenswrapper[35367]: I1204 12:23:38.675863 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/861c8de8-9e85-4f7f-a30a-b2426fd8a848-config-data\") pod \"nova-cell0-cell-mapping-48wk7\" (UID: \"861c8de8-9e85-4f7f-a30a-b2426fd8a848\") " pod="openstack/nova-cell0-cell-mapping-48wk7" Dec 04 12:23:38.732069 master-0 kubenswrapper[35367]: I1204 12:23:38.729272 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-66j84\" (UniqueName: \"kubernetes.io/projected/861c8de8-9e85-4f7f-a30a-b2426fd8a848-kube-api-access-66j84\") pod \"nova-cell0-cell-mapping-48wk7\" (UID: \"861c8de8-9e85-4f7f-a30a-b2426fd8a848\") " pod="openstack/nova-cell0-cell-mapping-48wk7" Dec 04 12:23:38.778394 master-0 kubenswrapper[35367]: I1204 12:23:38.775830 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a06bc55-b50f-4680-8912-32ccfb969eab-combined-ca-bundle\") pod \"nova-cell1-compute-ironic-compute-0\" (UID: \"7a06bc55-b50f-4680-8912-32ccfb969eab\") " pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 12:23:38.778394 master-0 kubenswrapper[35367]: I1204 12:23:38.776201 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c9pf8\" (UniqueName: \"kubernetes.io/projected/7a06bc55-b50f-4680-8912-32ccfb969eab-kube-api-access-c9pf8\") pod \"nova-cell1-compute-ironic-compute-0\" (UID: \"7a06bc55-b50f-4680-8912-32ccfb969eab\") " pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 12:23:38.778394 master-0 kubenswrapper[35367]: I1204 12:23:38.776253 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a06bc55-b50f-4680-8912-32ccfb969eab-config-data\") pod \"nova-cell1-compute-ironic-compute-0\" (UID: \"7a06bc55-b50f-4680-8912-32ccfb969eab\") " pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 12:23:38.790626 master-0 kubenswrapper[35367]: I1204 12:23:38.785503 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a06bc55-b50f-4680-8912-32ccfb969eab-combined-ca-bundle\") pod \"nova-cell1-compute-ironic-compute-0\" (UID: \"7a06bc55-b50f-4680-8912-32ccfb969eab\") " pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 12:23:38.790626 master-0 kubenswrapper[35367]: I1204 12:23:38.786121 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a06bc55-b50f-4680-8912-32ccfb969eab-config-data\") pod \"nova-cell1-compute-ironic-compute-0\" (UID: \"7a06bc55-b50f-4680-8912-32ccfb969eab\") " pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 12:23:38.808585 master-0 kubenswrapper[35367]: I1204 12:23:38.808518 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9pf8\" (UniqueName: \"kubernetes.io/projected/7a06bc55-b50f-4680-8912-32ccfb969eab-kube-api-access-c9pf8\") pod \"nova-cell1-compute-ironic-compute-0\" (UID: \"7a06bc55-b50f-4680-8912-32ccfb969eab\") " pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 12:23:38.809537 master-0 kubenswrapper[35367]: I1204 12:23:38.809505 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-cell-mapping-48wk7" Dec 04 12:23:38.837922 master-0 kubenswrapper[35367]: I1204 12:23:38.834702 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-api-0"] Dec 04 12:23:38.840872 master-0 kubenswrapper[35367]: I1204 12:23:38.840784 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 12:23:38.851319 master-0 kubenswrapper[35367]: I1204 12:23:38.846648 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-api-config-data" Dec 04 12:23:38.870137 master-0 kubenswrapper[35367]: I1204 12:23:38.869182 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-0"] Dec 04 12:23:38.948516 master-0 kubenswrapper[35367]: I1204 12:23:38.948436 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 12:23:38.959545 master-0 kubenswrapper[35367]: I1204 12:23:38.959440 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-metadata-0"] Dec 04 12:23:38.967766 master-0 kubenswrapper[35367]: I1204 12:23:38.967679 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 12:23:38.972611 master-0 kubenswrapper[35367]: I1204 12:23:38.972080 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-metadata-config-data" Dec 04 12:23:38.988025 master-0 kubenswrapper[35367]: I1204 12:23:38.987469 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 12:23:39.012917 master-0 kubenswrapper[35367]: I1204 12:23:39.009946 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell1-novncproxy-0"] Dec 04 12:23:39.013413 master-0 kubenswrapper[35367]: I1204 12:23:39.013366 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:23:39.024502 master-0 kubenswrapper[35367]: I1204 12:23:39.024419 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell1-novncproxy-config-data" Dec 04 12:23:39.028212 master-0 kubenswrapper[35367]: I1204 12:23:39.026164 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11f7cf54-6506-41e8-8649-13383ca9bc5b-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"11f7cf54-6506-41e8-8649-13383ca9bc5b\") " pod="openstack/nova-api-0" Dec 04 12:23:39.028212 master-0 kubenswrapper[35367]: I1204 12:23:39.026372 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11f7cf54-6506-41e8-8649-13383ca9bc5b-config-data\") pod \"nova-api-0\" (UID: \"11f7cf54-6506-41e8-8649-13383ca9bc5b\") " pod="openstack/nova-api-0" Dec 04 12:23:39.028531 master-0 kubenswrapper[35367]: I1204 12:23:39.028431 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9bqb\" (UniqueName: \"kubernetes.io/projected/11f7cf54-6506-41e8-8649-13383ca9bc5b-kube-api-access-d9bqb\") pod \"nova-api-0\" (UID: \"11f7cf54-6506-41e8-8649-13383ca9bc5b\") " pod="openstack/nova-api-0" Dec 04 12:23:39.030575 master-0 kubenswrapper[35367]: I1204 12:23:39.029281 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/11f7cf54-6506-41e8-8649-13383ca9bc5b-logs\") pod \"nova-api-0\" (UID: \"11f7cf54-6506-41e8-8649-13383ca9bc5b\") " pod="openstack/nova-api-0" Dec 04 12:23:39.051844 master-0 kubenswrapper[35367]: I1204 12:23:39.030995 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-novncproxy-0"] Dec 04 12:23:39.129858 master-0 kubenswrapper[35367]: I1204 12:23:39.119289 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-774bc94dc7-zjvc8"] Dec 04 12:23:39.129858 master-0 kubenswrapper[35367]: I1204 12:23:39.122799 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:39.187087 master-0 kubenswrapper[35367]: I1204 12:23:39.186956 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11f7cf54-6506-41e8-8649-13383ca9bc5b-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"11f7cf54-6506-41e8-8649-13383ca9bc5b\") " pod="openstack/nova-api-0" Dec 04 12:23:39.187087 master-0 kubenswrapper[35367]: I1204 12:23:39.187081 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11f7cf54-6506-41e8-8649-13383ca9bc5b-config-data\") pod \"nova-api-0\" (UID: \"11f7cf54-6506-41e8-8649-13383ca9bc5b\") " pod="openstack/nova-api-0" Dec 04 12:23:39.187552 master-0 kubenswrapper[35367]: I1204 12:23:39.187158 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b74338d-0aef-4b92-8912-51aff56caa6d-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"3b74338d-0aef-4b92-8912-51aff56caa6d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:39.187552 master-0 kubenswrapper[35367]: I1204 12:23:39.187305 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b74338d-0aef-4b92-8912-51aff56caa6d-logs\") pod \"nova-metadata-0\" (UID: \"3b74338d-0aef-4b92-8912-51aff56caa6d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:39.187552 master-0 kubenswrapper[35367]: I1204 12:23:39.187485 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfcpt\" (UniqueName: \"kubernetes.io/projected/ca969f2b-66d7-4470-af5d-b8f6531d6d67-kube-api-access-lfcpt\") pod \"dnsmasq-dns-774bc94dc7-zjvc8\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:39.187552 master-0 kubenswrapper[35367]: I1204 12:23:39.187534 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-dns-svc\") pod \"dnsmasq-dns-774bc94dc7-zjvc8\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:39.187770 master-0 kubenswrapper[35367]: I1204 12:23:39.187579 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b74338d-0aef-4b92-8912-51aff56caa6d-config-data\") pod \"nova-metadata-0\" (UID: \"3b74338d-0aef-4b92-8912-51aff56caa6d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:39.187770 master-0 kubenswrapper[35367]: I1204 12:23:39.187743 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a9a13ce-d71b-4a1c-bee3-24761d6716b5-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"0a9a13ce-d71b-4a1c-bee3-24761d6716b5\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:23:39.187889 master-0 kubenswrapper[35367]: I1204 12:23:39.187782 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a9a13ce-d71b-4a1c-bee3-24761d6716b5-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"0a9a13ce-d71b-4a1c-bee3-24761d6716b5\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:23:39.187889 master-0 kubenswrapper[35367]: I1204 12:23:39.187854 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndv4q\" (UniqueName: \"kubernetes.io/projected/3b74338d-0aef-4b92-8912-51aff56caa6d-kube-api-access-ndv4q\") pod \"nova-metadata-0\" (UID: \"3b74338d-0aef-4b92-8912-51aff56caa6d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:39.187995 master-0 kubenswrapper[35367]: I1204 12:23:39.187887 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-ovsdbserver-sb\") pod \"dnsmasq-dns-774bc94dc7-zjvc8\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:39.187995 master-0 kubenswrapper[35367]: I1204 12:23:39.187920 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-ovsdbserver-nb\") pod \"dnsmasq-dns-774bc94dc7-zjvc8\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:39.187995 master-0 kubenswrapper[35367]: I1204 12:23:39.187976 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk54g\" (UniqueName: \"kubernetes.io/projected/0a9a13ce-d71b-4a1c-bee3-24761d6716b5-kube-api-access-rk54g\") pod \"nova-cell1-novncproxy-0\" (UID: \"0a9a13ce-d71b-4a1c-bee3-24761d6716b5\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:23:39.188121 master-0 kubenswrapper[35367]: I1204 12:23:39.188020 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d9bqb\" (UniqueName: \"kubernetes.io/projected/11f7cf54-6506-41e8-8649-13383ca9bc5b-kube-api-access-d9bqb\") pod \"nova-api-0\" (UID: \"11f7cf54-6506-41e8-8649-13383ca9bc5b\") " pod="openstack/nova-api-0" Dec 04 12:23:39.188171 master-0 kubenswrapper[35367]: I1204 12:23:39.188141 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-dns-swift-storage-0\") pod \"dnsmasq-dns-774bc94dc7-zjvc8\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:39.188329 master-0 kubenswrapper[35367]: I1204 12:23:39.188283 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-config\") pod \"dnsmasq-dns-774bc94dc7-zjvc8\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:39.188401 master-0 kubenswrapper[35367]: I1204 12:23:39.188373 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/11f7cf54-6506-41e8-8649-13383ca9bc5b-logs\") pod \"nova-api-0\" (UID: \"11f7cf54-6506-41e8-8649-13383ca9bc5b\") " pod="openstack/nova-api-0" Dec 04 12:23:39.268850 master-0 kubenswrapper[35367]: I1204 12:23:39.244744 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/11f7cf54-6506-41e8-8649-13383ca9bc5b-logs\") pod \"nova-api-0\" (UID: \"11f7cf54-6506-41e8-8649-13383ca9bc5b\") " pod="openstack/nova-api-0" Dec 04 12:23:39.268850 master-0 kubenswrapper[35367]: I1204 12:23:39.265515 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11f7cf54-6506-41e8-8649-13383ca9bc5b-config-data\") pod \"nova-api-0\" (UID: \"11f7cf54-6506-41e8-8649-13383ca9bc5b\") " pod="openstack/nova-api-0" Dec 04 12:23:39.269930 master-0 kubenswrapper[35367]: I1204 12:23:39.269855 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-774bc94dc7-zjvc8"] Dec 04 12:23:39.318841 master-0 kubenswrapper[35367]: I1204 12:23:39.293929 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11f7cf54-6506-41e8-8649-13383ca9bc5b-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"11f7cf54-6506-41e8-8649-13383ca9bc5b\") " pod="openstack/nova-api-0" Dec 04 12:23:39.318841 master-0 kubenswrapper[35367]: I1204 12:23:39.307227 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 12:23:39.362050 master-0 kubenswrapper[35367]: I1204 12:23:39.360724 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9bqb\" (UniqueName: \"kubernetes.io/projected/11f7cf54-6506-41e8-8649-13383ca9bc5b-kube-api-access-d9bqb\") pod \"nova-api-0\" (UID: \"11f7cf54-6506-41e8-8649-13383ca9bc5b\") " pod="openstack/nova-api-0" Dec 04 12:23:39.382107 master-0 kubenswrapper[35367]: I1204 12:23:39.363045 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-0" Dec 04 12:23:39.396962 master-0 kubenswrapper[35367]: I1204 12:23:39.385965 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-scheduler-config-data" Dec 04 12:23:39.486844 master-0 kubenswrapper[35367]: I1204 12:23:39.486648 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 12:23:39.581935 master-0 kubenswrapper[35367]: I1204 12:23:39.581387 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a9a13ce-d71b-4a1c-bee3-24761d6716b5-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"0a9a13ce-d71b-4a1c-bee3-24761d6716b5\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:23:39.581935 master-0 kubenswrapper[35367]: I1204 12:23:39.581510 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a9a13ce-d71b-4a1c-bee3-24761d6716b5-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"0a9a13ce-d71b-4a1c-bee3-24761d6716b5\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:23:39.581935 master-0 kubenswrapper[35367]: I1204 12:23:39.581600 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ndv4q\" (UniqueName: \"kubernetes.io/projected/3b74338d-0aef-4b92-8912-51aff56caa6d-kube-api-access-ndv4q\") pod \"nova-metadata-0\" (UID: \"3b74338d-0aef-4b92-8912-51aff56caa6d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:39.581935 master-0 kubenswrapper[35367]: I1204 12:23:39.581657 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-ovsdbserver-sb\") pod \"dnsmasq-dns-774bc94dc7-zjvc8\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:39.581935 master-0 kubenswrapper[35367]: I1204 12:23:39.581704 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-ovsdbserver-nb\") pod \"dnsmasq-dns-774bc94dc7-zjvc8\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:39.581935 master-0 kubenswrapper[35367]: I1204 12:23:39.581757 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rk54g\" (UniqueName: \"kubernetes.io/projected/0a9a13ce-d71b-4a1c-bee3-24761d6716b5-kube-api-access-rk54g\") pod \"nova-cell1-novncproxy-0\" (UID: \"0a9a13ce-d71b-4a1c-bee3-24761d6716b5\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:23:39.581935 master-0 kubenswrapper[35367]: I1204 12:23:39.581944 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-dns-swift-storage-0\") pod \"dnsmasq-dns-774bc94dc7-zjvc8\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:39.582602 master-0 kubenswrapper[35367]: I1204 12:23:39.582148 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-config\") pod \"dnsmasq-dns-774bc94dc7-zjvc8\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:39.582602 master-0 kubenswrapper[35367]: I1204 12:23:39.582326 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b74338d-0aef-4b92-8912-51aff56caa6d-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"3b74338d-0aef-4b92-8912-51aff56caa6d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:39.582602 master-0 kubenswrapper[35367]: I1204 12:23:39.582453 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b74338d-0aef-4b92-8912-51aff56caa6d-logs\") pod \"nova-metadata-0\" (UID: \"3b74338d-0aef-4b92-8912-51aff56caa6d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:39.582743 master-0 kubenswrapper[35367]: I1204 12:23:39.582600 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lfcpt\" (UniqueName: \"kubernetes.io/projected/ca969f2b-66d7-4470-af5d-b8f6531d6d67-kube-api-access-lfcpt\") pod \"dnsmasq-dns-774bc94dc7-zjvc8\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:39.582743 master-0 kubenswrapper[35367]: I1204 12:23:39.582642 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-dns-svc\") pod \"dnsmasq-dns-774bc94dc7-zjvc8\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:39.582743 master-0 kubenswrapper[35367]: I1204 12:23:39.582689 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b74338d-0aef-4b92-8912-51aff56caa6d-config-data\") pod \"nova-metadata-0\" (UID: \"3b74338d-0aef-4b92-8912-51aff56caa6d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:39.586834 master-0 kubenswrapper[35367]: I1204 12:23:39.586755 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-dns-swift-storage-0\") pod \"dnsmasq-dns-774bc94dc7-zjvc8\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:39.587727 master-0 kubenswrapper[35367]: I1204 12:23:39.587678 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b74338d-0aef-4b92-8912-51aff56caa6d-logs\") pod \"nova-metadata-0\" (UID: \"3b74338d-0aef-4b92-8912-51aff56caa6d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:39.588597 master-0 kubenswrapper[35367]: I1204 12:23:39.588493 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-dns-svc\") pod \"dnsmasq-dns-774bc94dc7-zjvc8\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:39.589993 master-0 kubenswrapper[35367]: I1204 12:23:39.589955 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-config\") pod \"dnsmasq-dns-774bc94dc7-zjvc8\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:39.590501 master-0 kubenswrapper[35367]: I1204 12:23:39.590439 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-ovsdbserver-sb\") pod \"dnsmasq-dns-774bc94dc7-zjvc8\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:39.593356 master-0 kubenswrapper[35367]: I1204 12:23:39.593304 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a9a13ce-d71b-4a1c-bee3-24761d6716b5-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"0a9a13ce-d71b-4a1c-bee3-24761d6716b5\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:23:39.594665 master-0 kubenswrapper[35367]: I1204 12:23:39.594536 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a9a13ce-d71b-4a1c-bee3-24761d6716b5-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"0a9a13ce-d71b-4a1c-bee3-24761d6716b5\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:23:39.595992 master-0 kubenswrapper[35367]: I1204 12:23:39.595938 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b74338d-0aef-4b92-8912-51aff56caa6d-config-data\") pod \"nova-metadata-0\" (UID: \"3b74338d-0aef-4b92-8912-51aff56caa6d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:39.596121 master-0 kubenswrapper[35367]: I1204 12:23:39.596025 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-ovsdbserver-nb\") pod \"dnsmasq-dns-774bc94dc7-zjvc8\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:39.599742 master-0 kubenswrapper[35367]: I1204 12:23:39.599631 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b74338d-0aef-4b92-8912-51aff56caa6d-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"3b74338d-0aef-4b92-8912-51aff56caa6d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:39.602048 master-0 kubenswrapper[35367]: I1204 12:23:39.601990 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 12:23:39.611942 master-0 kubenswrapper[35367]: I1204 12:23:39.611797 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndv4q\" (UniqueName: \"kubernetes.io/projected/3b74338d-0aef-4b92-8912-51aff56caa6d-kube-api-access-ndv4q\") pod \"nova-metadata-0\" (UID: \"3b74338d-0aef-4b92-8912-51aff56caa6d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:39.615424 master-0 kubenswrapper[35367]: I1204 12:23:39.615336 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk54g\" (UniqueName: \"kubernetes.io/projected/0a9a13ce-d71b-4a1c-bee3-24761d6716b5-kube-api-access-rk54g\") pod \"nova-cell1-novncproxy-0\" (UID: \"0a9a13ce-d71b-4a1c-bee3-24761d6716b5\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:23:39.615706 master-0 kubenswrapper[35367]: I1204 12:23:39.615385 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfcpt\" (UniqueName: \"kubernetes.io/projected/ca969f2b-66d7-4470-af5d-b8f6531d6d67-kube-api-access-lfcpt\") pod \"dnsmasq-dns-774bc94dc7-zjvc8\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:39.647854 master-0 kubenswrapper[35367]: I1204 12:23:39.647754 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 12:23:39.688889 master-0 kubenswrapper[35367]: I1204 12:23:39.687500 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1f724182-33cd-49f0-9815-f8675fb7dfd9-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"1f724182-33cd-49f0-9815-f8675fb7dfd9\") " pod="openstack/nova-scheduler-0" Dec 04 12:23:39.690399 master-0 kubenswrapper[35367]: I1204 12:23:39.690315 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2v6q\" (UniqueName: \"kubernetes.io/projected/1f724182-33cd-49f0-9815-f8675fb7dfd9-kube-api-access-h2v6q\") pod \"nova-scheduler-0\" (UID: \"1f724182-33cd-49f0-9815-f8675fb7dfd9\") " pod="openstack/nova-scheduler-0" Dec 04 12:23:39.690671 master-0 kubenswrapper[35367]: I1204 12:23:39.690500 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1f724182-33cd-49f0-9815-f8675fb7dfd9-config-data\") pod \"nova-scheduler-0\" (UID: \"1f724182-33cd-49f0-9815-f8675fb7dfd9\") " pod="openstack/nova-scheduler-0" Dec 04 12:23:39.750986 master-0 kubenswrapper[35367]: I1204 12:23:39.750513 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:23:39.803545 master-0 kubenswrapper[35367]: I1204 12:23:39.793134 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h2v6q\" (UniqueName: \"kubernetes.io/projected/1f724182-33cd-49f0-9815-f8675fb7dfd9-kube-api-access-h2v6q\") pod \"nova-scheduler-0\" (UID: \"1f724182-33cd-49f0-9815-f8675fb7dfd9\") " pod="openstack/nova-scheduler-0" Dec 04 12:23:39.803545 master-0 kubenswrapper[35367]: I1204 12:23:39.793340 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1f724182-33cd-49f0-9815-f8675fb7dfd9-config-data\") pod \"nova-scheduler-0\" (UID: \"1f724182-33cd-49f0-9815-f8675fb7dfd9\") " pod="openstack/nova-scheduler-0" Dec 04 12:23:39.803545 master-0 kubenswrapper[35367]: I1204 12:23:39.794773 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1f724182-33cd-49f0-9815-f8675fb7dfd9-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"1f724182-33cd-49f0-9815-f8675fb7dfd9\") " pod="openstack/nova-scheduler-0" Dec 04 12:23:39.804429 master-0 kubenswrapper[35367]: I1204 12:23:39.804221 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1f724182-33cd-49f0-9815-f8675fb7dfd9-config-data\") pod \"nova-scheduler-0\" (UID: \"1f724182-33cd-49f0-9815-f8675fb7dfd9\") " pod="openstack/nova-scheduler-0" Dec 04 12:23:39.824410 master-0 kubenswrapper[35367]: I1204 12:23:39.824318 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1f724182-33cd-49f0-9815-f8675fb7dfd9-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"1f724182-33cd-49f0-9815-f8675fb7dfd9\") " pod="openstack/nova-scheduler-0" Dec 04 12:23:39.836414 master-0 kubenswrapper[35367]: I1204 12:23:39.836348 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2v6q\" (UniqueName: \"kubernetes.io/projected/1f724182-33cd-49f0-9815-f8675fb7dfd9-kube-api-access-h2v6q\") pod \"nova-scheduler-0\" (UID: \"1f724182-33cd-49f0-9815-f8675fb7dfd9\") " pod="openstack/nova-scheduler-0" Dec 04 12:23:39.852061 master-0 kubenswrapper[35367]: I1204 12:23:39.851914 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-cell-mapping-48wk7"] Dec 04 12:23:39.867976 master-0 kubenswrapper[35367]: I1204 12:23:39.867870 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:39.890734 master-0 kubenswrapper[35367]: I1204 12:23:39.890686 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-0" Dec 04 12:23:40.181847 master-0 kubenswrapper[35367]: I1204 12:23:40.181094 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-compute-ironic-compute-0"] Dec 04 12:23:40.258475 master-0 kubenswrapper[35367]: I1204 12:23:40.258377 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell1-conductor-db-sync-qqvk9"] Dec 04 12:23:40.266529 master-0 kubenswrapper[35367]: I1204 12:23:40.266466 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-conductor-db-sync-qqvk9" Dec 04 12:23:40.278470 master-0 kubenswrapper[35367]: I1204 12:23:40.278403 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-conductor-db-sync-qqvk9"] Dec 04 12:23:40.292677 master-0 kubenswrapper[35367]: I1204 12:23:40.292503 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell1-conductor-scripts" Dec 04 12:23:40.296002 master-0 kubenswrapper[35367]: I1204 12:23:40.293996 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell1-conductor-config-data" Dec 04 12:23:40.337664 master-0 kubenswrapper[35367]: I1204 12:23:40.337581 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znk6x\" (UniqueName: \"kubernetes.io/projected/b6d4bf97-9d51-4065-a290-6b362c4c2096-kube-api-access-znk6x\") pod \"nova-cell1-conductor-db-sync-qqvk9\" (UID: \"b6d4bf97-9d51-4065-a290-6b362c4c2096\") " pod="openstack/nova-cell1-conductor-db-sync-qqvk9" Dec 04 12:23:40.338141 master-0 kubenswrapper[35367]: I1204 12:23:40.338072 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b6d4bf97-9d51-4065-a290-6b362c4c2096-scripts\") pod \"nova-cell1-conductor-db-sync-qqvk9\" (UID: \"b6d4bf97-9d51-4065-a290-6b362c4c2096\") " pod="openstack/nova-cell1-conductor-db-sync-qqvk9" Dec 04 12:23:40.338381 master-0 kubenswrapper[35367]: I1204 12:23:40.338313 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b6d4bf97-9d51-4065-a290-6b362c4c2096-config-data\") pod \"nova-cell1-conductor-db-sync-qqvk9\" (UID: \"b6d4bf97-9d51-4065-a290-6b362c4c2096\") " pod="openstack/nova-cell1-conductor-db-sync-qqvk9" Dec 04 12:23:40.338381 master-0 kubenswrapper[35367]: I1204 12:23:40.338352 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b6d4bf97-9d51-4065-a290-6b362c4c2096-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-qqvk9\" (UID: \"b6d4bf97-9d51-4065-a290-6b362c4c2096\") " pod="openstack/nova-cell1-conductor-db-sync-qqvk9" Dec 04 12:23:40.467864 master-0 kubenswrapper[35367]: I1204 12:23:40.460227 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b6d4bf97-9d51-4065-a290-6b362c4c2096-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-qqvk9\" (UID: \"b6d4bf97-9d51-4065-a290-6b362c4c2096\") " pod="openstack/nova-cell1-conductor-db-sync-qqvk9" Dec 04 12:23:40.467864 master-0 kubenswrapper[35367]: I1204 12:23:40.460304 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b6d4bf97-9d51-4065-a290-6b362c4c2096-config-data\") pod \"nova-cell1-conductor-db-sync-qqvk9\" (UID: \"b6d4bf97-9d51-4065-a290-6b362c4c2096\") " pod="openstack/nova-cell1-conductor-db-sync-qqvk9" Dec 04 12:23:40.467864 master-0 kubenswrapper[35367]: I1204 12:23:40.460678 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-znk6x\" (UniqueName: \"kubernetes.io/projected/b6d4bf97-9d51-4065-a290-6b362c4c2096-kube-api-access-znk6x\") pod \"nova-cell1-conductor-db-sync-qqvk9\" (UID: \"b6d4bf97-9d51-4065-a290-6b362c4c2096\") " pod="openstack/nova-cell1-conductor-db-sync-qqvk9" Dec 04 12:23:40.467864 master-0 kubenswrapper[35367]: I1204 12:23:40.461113 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b6d4bf97-9d51-4065-a290-6b362c4c2096-scripts\") pod \"nova-cell1-conductor-db-sync-qqvk9\" (UID: \"b6d4bf97-9d51-4065-a290-6b362c4c2096\") " pod="openstack/nova-cell1-conductor-db-sync-qqvk9" Dec 04 12:23:40.467864 master-0 kubenswrapper[35367]: I1204 12:23:40.464485 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 12:23:40.481849 master-0 kubenswrapper[35367]: I1204 12:23:40.478906 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b6d4bf97-9d51-4065-a290-6b362c4c2096-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-qqvk9\" (UID: \"b6d4bf97-9d51-4065-a290-6b362c4c2096\") " pod="openstack/nova-cell1-conductor-db-sync-qqvk9" Dec 04 12:23:40.481849 master-0 kubenswrapper[35367]: I1204 12:23:40.480204 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b6d4bf97-9d51-4065-a290-6b362c4c2096-scripts\") pod \"nova-cell1-conductor-db-sync-qqvk9\" (UID: \"b6d4bf97-9d51-4065-a290-6b362c4c2096\") " pod="openstack/nova-cell1-conductor-db-sync-qqvk9" Dec 04 12:23:40.490258 master-0 kubenswrapper[35367]: I1204 12:23:40.483858 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b6d4bf97-9d51-4065-a290-6b362c4c2096-config-data\") pod \"nova-cell1-conductor-db-sync-qqvk9\" (UID: \"b6d4bf97-9d51-4065-a290-6b362c4c2096\") " pod="openstack/nova-cell1-conductor-db-sync-qqvk9" Dec 04 12:23:40.508094 master-0 kubenswrapper[35367]: I1204 12:23:40.506045 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-znk6x\" (UniqueName: \"kubernetes.io/projected/b6d4bf97-9d51-4065-a290-6b362c4c2096-kube-api-access-znk6x\") pod \"nova-cell1-conductor-db-sync-qqvk9\" (UID: \"b6d4bf97-9d51-4065-a290-6b362c4c2096\") " pod="openstack/nova-cell1-conductor-db-sync-qqvk9" Dec 04 12:23:40.633773 master-0 kubenswrapper[35367]: I1204 12:23:40.633690 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-0"] Dec 04 12:23:40.687861 master-0 kubenswrapper[35367]: I1204 12:23:40.684357 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-conductor-db-sync-qqvk9" Dec 04 12:23:40.712842 master-0 kubenswrapper[35367]: I1204 12:23:40.711769 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-cell-mapping-48wk7" event={"ID":"861c8de8-9e85-4f7f-a30a-b2426fd8a848","Type":"ContainerStarted","Data":"4661d616e49ca956dcd99befa5bf8e71f9d3c6dc20e24c85e60eabda947c8c00"} Dec 04 12:23:40.712842 master-0 kubenswrapper[35367]: I1204 12:23:40.711866 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-cell-mapping-48wk7" event={"ID":"861c8de8-9e85-4f7f-a30a-b2426fd8a848","Type":"ContainerStarted","Data":"ae4bb51d997d19181a0be4c7a5324560b750dc271a383a5c8f96f20115429ae3"} Dec 04 12:23:40.725849 master-0 kubenswrapper[35367]: I1204 12:23:40.719575 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-compute-ironic-compute-0" event={"ID":"7a06bc55-b50f-4680-8912-32ccfb969eab","Type":"ContainerStarted","Data":"b6fe224df4969041095daf3a1e534252c6dc92df7a79b35231080ea52ad7687c"} Dec 04 12:23:40.725849 master-0 kubenswrapper[35367]: I1204 12:23:40.722240 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"3b74338d-0aef-4b92-8912-51aff56caa6d","Type":"ContainerStarted","Data":"ed69ece3cb468897d7c038bfa140ee7beab1b309e842762cb198383e359954a3"} Dec 04 12:23:40.725849 master-0 kubenswrapper[35367]: I1204 12:23:40.723986 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"11f7cf54-6506-41e8-8649-13383ca9bc5b","Type":"ContainerStarted","Data":"87fb5915e5c236c1a77cee9008c9bd1aeedac75244ed57d0263e4e5c4fe51b2f"} Dec 04 12:23:40.804715 master-0 kubenswrapper[35367]: I1204 12:23:40.803125 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell0-cell-mapping-48wk7" podStartSLOduration=2.803093409 podStartE2EDuration="2.803093409s" podCreationTimestamp="2025-12-04 12:23:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:23:40.753589985 +0000 UTC m=+1464.191651263" watchObservedRunningTime="2025-12-04 12:23:40.803093409 +0000 UTC m=+1464.241154687" Dec 04 12:23:40.809137 master-0 kubenswrapper[35367]: I1204 12:23:40.807024 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-774bc94dc7-zjvc8"] Dec 04 12:23:40.849833 master-0 kubenswrapper[35367]: I1204 12:23:40.849661 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-novncproxy-0"] Dec 04 12:23:40.982845 master-0 kubenswrapper[35367]: I1204 12:23:40.980346 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 12:23:41.422923 master-0 kubenswrapper[35367]: I1204 12:23:41.422391 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-conductor-db-sync-qqvk9"] Dec 04 12:23:41.463657 master-0 kubenswrapper[35367]: W1204 12:23:41.463446 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6d4bf97_9d51_4065_a290_6b362c4c2096.slice/crio-6b80a056d0a5118bb49a18274c977bbe87be87d7d2d0dce9c74fbf3e28e1ff79 WatchSource:0}: Error finding container 6b80a056d0a5118bb49a18274c977bbe87be87d7d2d0dce9c74fbf3e28e1ff79: Status 404 returned error can't find the container with id 6b80a056d0a5118bb49a18274c977bbe87be87d7d2d0dce9c74fbf3e28e1ff79 Dec 04 12:23:41.741661 master-0 kubenswrapper[35367]: I1204 12:23:41.741493 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-0" event={"ID":"1f724182-33cd-49f0-9815-f8675fb7dfd9","Type":"ContainerStarted","Data":"4198724d2b6f775a25bd9dbb4b0e3f87890171c631fa3f0f5339e6efa6993f59"} Dec 04 12:23:41.744605 master-0 kubenswrapper[35367]: I1204 12:23:41.744566 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-conductor-db-sync-qqvk9" event={"ID":"b6d4bf97-9d51-4065-a290-6b362c4c2096","Type":"ContainerStarted","Data":"6b80a056d0a5118bb49a18274c977bbe87be87d7d2d0dce9c74fbf3e28e1ff79"} Dec 04 12:23:41.747565 master-0 kubenswrapper[35367]: I1204 12:23:41.747533 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-novncproxy-0" event={"ID":"0a9a13ce-d71b-4a1c-bee3-24761d6716b5","Type":"ContainerStarted","Data":"5b630f048c982b45f217202baff519deb7bc0a20e7e286af3e56ec5f8dc64626"} Dec 04 12:23:41.752957 master-0 kubenswrapper[35367]: I1204 12:23:41.752897 35367 generic.go:334] "Generic (PLEG): container finished" podID="ca969f2b-66d7-4470-af5d-b8f6531d6d67" containerID="28849461c8ef45b401f04c3ee562cede1c5f20b9ef3fc83de4bb96a0ddfa4336" exitCode=0 Dec 04 12:23:41.752957 master-0 kubenswrapper[35367]: I1204 12:23:41.752944 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" event={"ID":"ca969f2b-66d7-4470-af5d-b8f6531d6d67","Type":"ContainerDied","Data":"28849461c8ef45b401f04c3ee562cede1c5f20b9ef3fc83de4bb96a0ddfa4336"} Dec 04 12:23:41.753298 master-0 kubenswrapper[35367]: I1204 12:23:41.752978 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" event={"ID":"ca969f2b-66d7-4470-af5d-b8f6531d6d67","Type":"ContainerStarted","Data":"28a563f5554ed1c91fc6dd4ac5287d493cf633efa08960f8e01d3acdd6b28d15"} Dec 04 12:23:42.804362 master-0 kubenswrapper[35367]: I1204 12:23:42.804121 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-conductor-db-sync-qqvk9" event={"ID":"b6d4bf97-9d51-4065-a290-6b362c4c2096","Type":"ContainerStarted","Data":"c08a09dbe0cf511ad9c6a6f1e21f98afb8d023332e382704b3e19ed34ecf50f6"} Dec 04 12:23:42.858166 master-0 kubenswrapper[35367]: I1204 12:23:42.858042 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell1-conductor-db-sync-qqvk9" podStartSLOduration=2.858017149 podStartE2EDuration="2.858017149s" podCreationTimestamp="2025-12-04 12:23:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:23:42.842859417 +0000 UTC m=+1466.280920675" watchObservedRunningTime="2025-12-04 12:23:42.858017149 +0000 UTC m=+1466.296078427" Dec 04 12:23:45.158687 master-0 kubenswrapper[35367]: I1204 12:23:45.158595 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 12:23:45.181153 master-0 kubenswrapper[35367]: I1204 12:23:45.179711 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell1-novncproxy-0"] Dec 04 12:23:45.910688 master-0 kubenswrapper[35367]: I1204 12:23:45.910155 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" event={"ID":"ca969f2b-66d7-4470-af5d-b8f6531d6d67","Type":"ContainerStarted","Data":"2b38949c91dc58166dba107a49f204cc2daaf4913c56badbdfd8256bfcf71830"} Dec 04 12:23:45.912111 master-0 kubenswrapper[35367]: I1204 12:23:45.912041 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:45.918050 master-0 kubenswrapper[35367]: I1204 12:23:45.917968 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-0" event={"ID":"1f724182-33cd-49f0-9815-f8675fb7dfd9","Type":"ContainerStarted","Data":"76d8ddcf45684663140c424034cfd48777719ea42c4c6744168322b23058a404"} Dec 04 12:23:45.921445 master-0 kubenswrapper[35367]: I1204 12:23:45.921378 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"3b74338d-0aef-4b92-8912-51aff56caa6d","Type":"ContainerStarted","Data":"3286e706f57f98de0a16afc0d648d0cbb47963fdf259ec77dd56754c456f0d94"} Dec 04 12:23:45.929470 master-0 kubenswrapper[35367]: I1204 12:23:45.926533 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"11f7cf54-6506-41e8-8649-13383ca9bc5b","Type":"ContainerStarted","Data":"54cf5f3c9931184cc2c004067d95edb41513a4d815d82499bf01aecb778a8fc0"} Dec 04 12:23:45.930862 master-0 kubenswrapper[35367]: I1204 12:23:45.930417 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-cell1-novncproxy-0" podUID="0a9a13ce-d71b-4a1c-bee3-24761d6716b5" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://b3502e0a4f79a859b0a2893de2cfbd0998b706f946d4abf78d174d675f6eb817" gracePeriod=30 Dec 04 12:23:45.930862 master-0 kubenswrapper[35367]: I1204 12:23:45.930589 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-novncproxy-0" event={"ID":"0a9a13ce-d71b-4a1c-bee3-24761d6716b5","Type":"ContainerStarted","Data":"b3502e0a4f79a859b0a2893de2cfbd0998b706f946d4abf78d174d675f6eb817"} Dec 04 12:23:45.947480 master-0 kubenswrapper[35367]: I1204 12:23:45.947383 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" podStartSLOduration=6.947361642 podStartE2EDuration="6.947361642s" podCreationTimestamp="2025-12-04 12:23:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:23:45.943415176 +0000 UTC m=+1469.381476434" watchObservedRunningTime="2025-12-04 12:23:45.947361642 +0000 UTC m=+1469.385422900" Dec 04 12:23:45.997275 master-0 kubenswrapper[35367]: I1204 12:23:45.995759 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-scheduler-0" podStartSLOduration=2.799879143 podStartE2EDuration="6.995735039s" podCreationTimestamp="2025-12-04 12:23:39 +0000 UTC" firstStartedPulling="2025-12-04 12:23:40.995142123 +0000 UTC m=+1464.433203391" lastFinishedPulling="2025-12-04 12:23:45.190998029 +0000 UTC m=+1468.629059287" observedRunningTime="2025-12-04 12:23:45.984714769 +0000 UTC m=+1469.422776027" watchObservedRunningTime="2025-12-04 12:23:45.995735039 +0000 UTC m=+1469.433796297" Dec 04 12:23:46.048831 master-0 kubenswrapper[35367]: I1204 12:23:46.047178 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell1-novncproxy-0" podStartSLOduration=3.674385916 podStartE2EDuration="8.047149414s" podCreationTimestamp="2025-12-04 12:23:38 +0000 UTC" firstStartedPulling="2025-12-04 12:23:40.805738293 +0000 UTC m=+1464.243799551" lastFinishedPulling="2025-12-04 12:23:45.178501791 +0000 UTC m=+1468.616563049" observedRunningTime="2025-12-04 12:23:46.010152118 +0000 UTC m=+1469.448213376" watchObservedRunningTime="2025-12-04 12:23:46.047149414 +0000 UTC m=+1469.485210672" Dec 04 12:23:46.969056 master-0 kubenswrapper[35367]: I1204 12:23:46.968984 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"11f7cf54-6506-41e8-8649-13383ca9bc5b","Type":"ContainerStarted","Data":"8422ec447e522f3cc3adabfe98a75f02bb4db0af699b916620f158aeb3b891cb"} Dec 04 12:23:46.980082 master-0 kubenswrapper[35367]: I1204 12:23:46.977475 35367 generic.go:334] "Generic (PLEG): container finished" podID="822f5f37-f2cc-4473-9544-0fb50d3d9266" containerID="be381973a54d21b0980d31002f1e2ea6cb47661f77d7cd57b3f24a6b1a705a0f" exitCode=0 Dec 04 12:23:46.980082 master-0 kubenswrapper[35367]: I1204 12:23:46.977595 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-conductor-0" event={"ID":"822f5f37-f2cc-4473-9544-0fb50d3d9266","Type":"ContainerDied","Data":"be381973a54d21b0980d31002f1e2ea6cb47661f77d7cd57b3f24a6b1a705a0f"} Dec 04 12:23:46.983473 master-0 kubenswrapper[35367]: I1204 12:23:46.983125 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"3b74338d-0aef-4b92-8912-51aff56caa6d","Type":"ContainerStarted","Data":"dc372332bab3edae1fa554d8f105d0ac404e3c6173b96706f73d967fb9673ff9"} Dec 04 12:23:46.984783 master-0 kubenswrapper[35367]: I1204 12:23:46.984721 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-metadata-0" podUID="3b74338d-0aef-4b92-8912-51aff56caa6d" containerName="nova-metadata-log" containerID="cri-o://3286e706f57f98de0a16afc0d648d0cbb47963fdf259ec77dd56754c456f0d94" gracePeriod=30 Dec 04 12:23:46.984974 master-0 kubenswrapper[35367]: I1204 12:23:46.984931 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-metadata-0" podUID="3b74338d-0aef-4b92-8912-51aff56caa6d" containerName="nova-metadata-metadata" containerID="cri-o://dc372332bab3edae1fa554d8f105d0ac404e3c6173b96706f73d967fb9673ff9" gracePeriod=30 Dec 04 12:23:47.027539 master-0 kubenswrapper[35367]: I1204 12:23:47.027416 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-api-0" podStartSLOduration=4.490364083 podStartE2EDuration="9.027388723s" podCreationTimestamp="2025-12-04 12:23:38 +0000 UTC" firstStartedPulling="2025-12-04 12:23:40.639439017 +0000 UTC m=+1464.077500275" lastFinishedPulling="2025-12-04 12:23:45.176463657 +0000 UTC m=+1468.614524915" observedRunningTime="2025-12-04 12:23:46.995961754 +0000 UTC m=+1470.434023012" watchObservedRunningTime="2025-12-04 12:23:47.027388723 +0000 UTC m=+1470.465449981" Dec 04 12:23:47.079380 master-0 kubenswrapper[35367]: I1204 12:23:47.079270 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-metadata-0" podStartSLOduration=4.401502918 podStartE2EDuration="9.079242091s" podCreationTimestamp="2025-12-04 12:23:38 +0000 UTC" firstStartedPulling="2025-12-04 12:23:40.502169114 +0000 UTC m=+1463.940230372" lastFinishedPulling="2025-12-04 12:23:45.179908287 +0000 UTC m=+1468.617969545" observedRunningTime="2025-12-04 12:23:47.065536346 +0000 UTC m=+1470.503597604" watchObservedRunningTime="2025-12-04 12:23:47.079242091 +0000 UTC m=+1470.517303349" Dec 04 12:23:47.138849 master-0 kubenswrapper[35367]: E1204 12:23:47.137839 35367 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b74338d_0aef_4b92_8912_51aff56caa6d.slice/crio-conmon-3286e706f57f98de0a16afc0d648d0cbb47963fdf259ec77dd56754c456f0d94.scope\": RecentStats: unable to find data in memory cache]" Dec 04 12:23:47.626951 master-0 kubenswrapper[35367]: I1204 12:23:47.626893 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 12:23:47.728461 master-0 kubenswrapper[35367]: I1204 12:23:47.728115 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndv4q\" (UniqueName: \"kubernetes.io/projected/3b74338d-0aef-4b92-8912-51aff56caa6d-kube-api-access-ndv4q\") pod \"3b74338d-0aef-4b92-8912-51aff56caa6d\" (UID: \"3b74338d-0aef-4b92-8912-51aff56caa6d\") " Dec 04 12:23:47.728461 master-0 kubenswrapper[35367]: I1204 12:23:47.728316 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b74338d-0aef-4b92-8912-51aff56caa6d-config-data\") pod \"3b74338d-0aef-4b92-8912-51aff56caa6d\" (UID: \"3b74338d-0aef-4b92-8912-51aff56caa6d\") " Dec 04 12:23:47.728842 master-0 kubenswrapper[35367]: I1204 12:23:47.728783 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b74338d-0aef-4b92-8912-51aff56caa6d-logs\") pod \"3b74338d-0aef-4b92-8912-51aff56caa6d\" (UID: \"3b74338d-0aef-4b92-8912-51aff56caa6d\") " Dec 04 12:23:47.729324 master-0 kubenswrapper[35367]: I1204 12:23:47.729286 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b74338d-0aef-4b92-8912-51aff56caa6d-combined-ca-bundle\") pod \"3b74338d-0aef-4b92-8912-51aff56caa6d\" (UID: \"3b74338d-0aef-4b92-8912-51aff56caa6d\") " Dec 04 12:23:47.729523 master-0 kubenswrapper[35367]: I1204 12:23:47.729344 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b74338d-0aef-4b92-8912-51aff56caa6d-logs" (OuterVolumeSpecName: "logs") pod "3b74338d-0aef-4b92-8912-51aff56caa6d" (UID: "3b74338d-0aef-4b92-8912-51aff56caa6d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:23:47.731197 master-0 kubenswrapper[35367]: I1204 12:23:47.730429 35367 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b74338d-0aef-4b92-8912-51aff56caa6d-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:47.734066 master-0 kubenswrapper[35367]: I1204 12:23:47.733518 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b74338d-0aef-4b92-8912-51aff56caa6d-kube-api-access-ndv4q" (OuterVolumeSpecName: "kube-api-access-ndv4q") pod "3b74338d-0aef-4b92-8912-51aff56caa6d" (UID: "3b74338d-0aef-4b92-8912-51aff56caa6d"). InnerVolumeSpecName "kube-api-access-ndv4q". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:23:47.796930 master-0 kubenswrapper[35367]: I1204 12:23:47.796856 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b74338d-0aef-4b92-8912-51aff56caa6d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3b74338d-0aef-4b92-8912-51aff56caa6d" (UID: "3b74338d-0aef-4b92-8912-51aff56caa6d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:23:47.816076 master-0 kubenswrapper[35367]: I1204 12:23:47.816007 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b74338d-0aef-4b92-8912-51aff56caa6d-config-data" (OuterVolumeSpecName: "config-data") pod "3b74338d-0aef-4b92-8912-51aff56caa6d" (UID: "3b74338d-0aef-4b92-8912-51aff56caa6d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:23:47.856690 master-0 kubenswrapper[35367]: I1204 12:23:47.847943 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b74338d-0aef-4b92-8912-51aff56caa6d-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:47.856690 master-0 kubenswrapper[35367]: I1204 12:23:47.848031 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ndv4q\" (UniqueName: \"kubernetes.io/projected/3b74338d-0aef-4b92-8912-51aff56caa6d-kube-api-access-ndv4q\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:47.856690 master-0 kubenswrapper[35367]: I1204 12:23:47.848050 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b74338d-0aef-4b92-8912-51aff56caa6d-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:48.005636 master-0 kubenswrapper[35367]: I1204 12:23:48.005495 35367 generic.go:334] "Generic (PLEG): container finished" podID="3b74338d-0aef-4b92-8912-51aff56caa6d" containerID="dc372332bab3edae1fa554d8f105d0ac404e3c6173b96706f73d967fb9673ff9" exitCode=0 Dec 04 12:23:48.005636 master-0 kubenswrapper[35367]: I1204 12:23:48.005558 35367 generic.go:334] "Generic (PLEG): container finished" podID="3b74338d-0aef-4b92-8912-51aff56caa6d" containerID="3286e706f57f98de0a16afc0d648d0cbb47963fdf259ec77dd56754c456f0d94" exitCode=143 Dec 04 12:23:48.005636 master-0 kubenswrapper[35367]: I1204 12:23:48.005594 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 12:23:48.005636 master-0 kubenswrapper[35367]: I1204 12:23:48.005630 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"3b74338d-0aef-4b92-8912-51aff56caa6d","Type":"ContainerDied","Data":"dc372332bab3edae1fa554d8f105d0ac404e3c6173b96706f73d967fb9673ff9"} Dec 04 12:23:48.006392 master-0 kubenswrapper[35367]: I1204 12:23:48.005725 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"3b74338d-0aef-4b92-8912-51aff56caa6d","Type":"ContainerDied","Data":"3286e706f57f98de0a16afc0d648d0cbb47963fdf259ec77dd56754c456f0d94"} Dec 04 12:23:48.006392 master-0 kubenswrapper[35367]: I1204 12:23:48.005749 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"3b74338d-0aef-4b92-8912-51aff56caa6d","Type":"ContainerDied","Data":"ed69ece3cb468897d7c038bfa140ee7beab1b309e842762cb198383e359954a3"} Dec 04 12:23:48.006392 master-0 kubenswrapper[35367]: I1204 12:23:48.005784 35367 scope.go:117] "RemoveContainer" containerID="dc372332bab3edae1fa554d8f105d0ac404e3c6173b96706f73d967fb9673ff9" Dec 04 12:23:48.012745 master-0 kubenswrapper[35367]: I1204 12:23:48.012658 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-conductor-0" event={"ID":"822f5f37-f2cc-4473-9544-0fb50d3d9266","Type":"ContainerStarted","Data":"83ad66f0b9054624a451fee2fd891e8650e74ca17bd1bce7b2b39890344be65d"} Dec 04 12:23:48.126997 master-0 kubenswrapper[35367]: I1204 12:23:48.118478 35367 scope.go:117] "RemoveContainer" containerID="3286e706f57f98de0a16afc0d648d0cbb47963fdf259ec77dd56754c456f0d94" Dec 04 12:23:48.142400 master-0 kubenswrapper[35367]: I1204 12:23:48.136722 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 12:23:48.153236 master-0 kubenswrapper[35367]: I1204 12:23:48.152195 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 12:23:48.181957 master-0 kubenswrapper[35367]: I1204 12:23:48.181887 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-metadata-0"] Dec 04 12:23:48.183866 master-0 kubenswrapper[35367]: E1204 12:23:48.182701 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3b74338d-0aef-4b92-8912-51aff56caa6d" containerName="nova-metadata-metadata" Dec 04 12:23:48.183866 master-0 kubenswrapper[35367]: I1204 12:23:48.182730 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b74338d-0aef-4b92-8912-51aff56caa6d" containerName="nova-metadata-metadata" Dec 04 12:23:48.183866 master-0 kubenswrapper[35367]: E1204 12:23:48.182759 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3b74338d-0aef-4b92-8912-51aff56caa6d" containerName="nova-metadata-log" Dec 04 12:23:48.183866 master-0 kubenswrapper[35367]: I1204 12:23:48.182766 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b74338d-0aef-4b92-8912-51aff56caa6d" containerName="nova-metadata-log" Dec 04 12:23:48.183866 master-0 kubenswrapper[35367]: I1204 12:23:48.183141 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="3b74338d-0aef-4b92-8912-51aff56caa6d" containerName="nova-metadata-log" Dec 04 12:23:48.183866 master-0 kubenswrapper[35367]: I1204 12:23:48.183174 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="3b74338d-0aef-4b92-8912-51aff56caa6d" containerName="nova-metadata-metadata" Dec 04 12:23:48.185865 master-0 kubenswrapper[35367]: I1204 12:23:48.184887 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 12:23:48.188536 master-0 kubenswrapper[35367]: I1204 12:23:48.188380 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-metadata-config-data" Dec 04 12:23:48.188723 master-0 kubenswrapper[35367]: I1204 12:23:48.188600 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-metadata-internal-svc" Dec 04 12:23:48.217647 master-0 kubenswrapper[35367]: I1204 12:23:48.217521 35367 scope.go:117] "RemoveContainer" containerID="dc372332bab3edae1fa554d8f105d0ac404e3c6173b96706f73d967fb9673ff9" Dec 04 12:23:48.221836 master-0 kubenswrapper[35367]: E1204 12:23:48.219545 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc372332bab3edae1fa554d8f105d0ac404e3c6173b96706f73d967fb9673ff9\": container with ID starting with dc372332bab3edae1fa554d8f105d0ac404e3c6173b96706f73d967fb9673ff9 not found: ID does not exist" containerID="dc372332bab3edae1fa554d8f105d0ac404e3c6173b96706f73d967fb9673ff9" Dec 04 12:23:48.221836 master-0 kubenswrapper[35367]: I1204 12:23:48.219624 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc372332bab3edae1fa554d8f105d0ac404e3c6173b96706f73d967fb9673ff9"} err="failed to get container status \"dc372332bab3edae1fa554d8f105d0ac404e3c6173b96706f73d967fb9673ff9\": rpc error: code = NotFound desc = could not find container \"dc372332bab3edae1fa554d8f105d0ac404e3c6173b96706f73d967fb9673ff9\": container with ID starting with dc372332bab3edae1fa554d8f105d0ac404e3c6173b96706f73d967fb9673ff9 not found: ID does not exist" Dec 04 12:23:48.221836 master-0 kubenswrapper[35367]: I1204 12:23:48.219658 35367 scope.go:117] "RemoveContainer" containerID="3286e706f57f98de0a16afc0d648d0cbb47963fdf259ec77dd56754c456f0d94" Dec 04 12:23:48.225502 master-0 kubenswrapper[35367]: E1204 12:23:48.222488 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3286e706f57f98de0a16afc0d648d0cbb47963fdf259ec77dd56754c456f0d94\": container with ID starting with 3286e706f57f98de0a16afc0d648d0cbb47963fdf259ec77dd56754c456f0d94 not found: ID does not exist" containerID="3286e706f57f98de0a16afc0d648d0cbb47963fdf259ec77dd56754c456f0d94" Dec 04 12:23:48.225502 master-0 kubenswrapper[35367]: I1204 12:23:48.222560 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3286e706f57f98de0a16afc0d648d0cbb47963fdf259ec77dd56754c456f0d94"} err="failed to get container status \"3286e706f57f98de0a16afc0d648d0cbb47963fdf259ec77dd56754c456f0d94\": rpc error: code = NotFound desc = could not find container \"3286e706f57f98de0a16afc0d648d0cbb47963fdf259ec77dd56754c456f0d94\": container with ID starting with 3286e706f57f98de0a16afc0d648d0cbb47963fdf259ec77dd56754c456f0d94 not found: ID does not exist" Dec 04 12:23:48.225502 master-0 kubenswrapper[35367]: I1204 12:23:48.223037 35367 scope.go:117] "RemoveContainer" containerID="dc372332bab3edae1fa554d8f105d0ac404e3c6173b96706f73d967fb9673ff9" Dec 04 12:23:48.225502 master-0 kubenswrapper[35367]: I1204 12:23:48.223282 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 12:23:48.225502 master-0 kubenswrapper[35367]: I1204 12:23:48.224222 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc372332bab3edae1fa554d8f105d0ac404e3c6173b96706f73d967fb9673ff9"} err="failed to get container status \"dc372332bab3edae1fa554d8f105d0ac404e3c6173b96706f73d967fb9673ff9\": rpc error: code = NotFound desc = could not find container \"dc372332bab3edae1fa554d8f105d0ac404e3c6173b96706f73d967fb9673ff9\": container with ID starting with dc372332bab3edae1fa554d8f105d0ac404e3c6173b96706f73d967fb9673ff9 not found: ID does not exist" Dec 04 12:23:48.225502 master-0 kubenswrapper[35367]: I1204 12:23:48.224283 35367 scope.go:117] "RemoveContainer" containerID="3286e706f57f98de0a16afc0d648d0cbb47963fdf259ec77dd56754c456f0d94" Dec 04 12:23:48.225502 master-0 kubenswrapper[35367]: I1204 12:23:48.224672 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3286e706f57f98de0a16afc0d648d0cbb47963fdf259ec77dd56754c456f0d94"} err="failed to get container status \"3286e706f57f98de0a16afc0d648d0cbb47963fdf259ec77dd56754c456f0d94\": rpc error: code = NotFound desc = could not find container \"3286e706f57f98de0a16afc0d648d0cbb47963fdf259ec77dd56754c456f0d94\": container with ID starting with 3286e706f57f98de0a16afc0d648d0cbb47963fdf259ec77dd56754c456f0d94 not found: ID does not exist" Dec 04 12:23:48.270599 master-0 kubenswrapper[35367]: I1204 12:23:48.270468 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-config-data\") pod \"nova-metadata-0\" (UID: \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:48.270929 master-0 kubenswrapper[35367]: I1204 12:23:48.270901 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:48.271167 master-0 kubenswrapper[35367]: I1204 12:23:48.271147 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vg5l\" (UniqueName: \"kubernetes.io/projected/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-kube-api-access-7vg5l\") pod \"nova-metadata-0\" (UID: \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:48.271291 master-0 kubenswrapper[35367]: I1204 12:23:48.271271 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:48.271462 master-0 kubenswrapper[35367]: I1204 12:23:48.271443 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-logs\") pod \"nova-metadata-0\" (UID: \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:48.374572 master-0 kubenswrapper[35367]: I1204 12:23:48.374325 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-config-data\") pod \"nova-metadata-0\" (UID: \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:48.374572 master-0 kubenswrapper[35367]: I1204 12:23:48.374399 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:48.374572 master-0 kubenswrapper[35367]: I1204 12:23:48.374472 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7vg5l\" (UniqueName: \"kubernetes.io/projected/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-kube-api-access-7vg5l\") pod \"nova-metadata-0\" (UID: \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:48.374572 master-0 kubenswrapper[35367]: I1204 12:23:48.374495 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:48.374950 master-0 kubenswrapper[35367]: I1204 12:23:48.374888 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-logs\") pod \"nova-metadata-0\" (UID: \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:48.375525 master-0 kubenswrapper[35367]: I1204 12:23:48.375487 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-logs\") pod \"nova-metadata-0\" (UID: \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:48.378622 master-0 kubenswrapper[35367]: I1204 12:23:48.378225 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:48.378622 master-0 kubenswrapper[35367]: I1204 12:23:48.378351 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-config-data\") pod \"nova-metadata-0\" (UID: \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:48.378622 master-0 kubenswrapper[35367]: I1204 12:23:48.378567 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:48.416017 master-0 kubenswrapper[35367]: I1204 12:23:48.415969 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vg5l\" (UniqueName: \"kubernetes.io/projected/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-kube-api-access-7vg5l\") pod \"nova-metadata-0\" (UID: \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\") " pod="openstack/nova-metadata-0" Dec 04 12:23:48.550320 master-0 kubenswrapper[35367]: I1204 12:23:48.550090 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 12:23:48.766938 master-0 kubenswrapper[35367]: I1204 12:23:48.766708 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b74338d-0aef-4b92-8912-51aff56caa6d" path="/var/lib/kubelet/pods/3b74338d-0aef-4b92-8912-51aff56caa6d/volumes" Dec 04 12:23:49.039316 master-0 kubenswrapper[35367]: I1204 12:23:49.039212 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-conductor-0" event={"ID":"822f5f37-f2cc-4473-9544-0fb50d3d9266","Type":"ContainerStarted","Data":"4e62727b5907a417d8dd923731c72fabbc3a7251d0de188a0e3183aed042c8e4"} Dec 04 12:23:49.603336 master-0 kubenswrapper[35367]: I1204 12:23:49.603274 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-api-0" Dec 04 12:23:49.603336 master-0 kubenswrapper[35367]: I1204 12:23:49.603341 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-api-0" Dec 04 12:23:49.752262 master-0 kubenswrapper[35367]: I1204 12:23:49.752213 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:23:49.891652 master-0 kubenswrapper[35367]: I1204 12:23:49.891452 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-scheduler-0" Dec 04 12:23:49.892085 master-0 kubenswrapper[35367]: I1204 12:23:49.892049 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-scheduler-0" Dec 04 12:23:49.942215 master-0 kubenswrapper[35367]: I1204 12:23:49.942113 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-scheduler-0" Dec 04 12:23:50.114759 master-0 kubenswrapper[35367]: I1204 12:23:50.114451 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-scheduler-0" Dec 04 12:23:50.691786 master-0 kubenswrapper[35367]: I1204 12:23:50.691652 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-api-0" podUID="11f7cf54-6506-41e8-8649-13383ca9bc5b" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.128.1.31:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Dec 04 12:23:50.691786 master-0 kubenswrapper[35367]: I1204 12:23:50.691717 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-api-0" podUID="11f7cf54-6506-41e8-8649-13383ca9bc5b" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.128.1.31:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Dec 04 12:23:51.085588 master-0 kubenswrapper[35367]: I1204 12:23:51.085489 35367 generic.go:334] "Generic (PLEG): container finished" podID="861c8de8-9e85-4f7f-a30a-b2426fd8a848" containerID="4661d616e49ca956dcd99befa5bf8e71f9d3c6dc20e24c85e60eabda947c8c00" exitCode=0 Dec 04 12:23:51.087565 master-0 kubenswrapper[35367]: I1204 12:23:51.087394 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-cell-mapping-48wk7" event={"ID":"861c8de8-9e85-4f7f-a30a-b2426fd8a848","Type":"ContainerDied","Data":"4661d616e49ca956dcd99befa5bf8e71f9d3c6dc20e24c85e60eabda947c8c00"} Dec 04 12:23:54.167890 master-0 kubenswrapper[35367]: I1204 12:23:54.167710 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-cell-mapping-48wk7" event={"ID":"861c8de8-9e85-4f7f-a30a-b2426fd8a848","Type":"ContainerDied","Data":"ae4bb51d997d19181a0be4c7a5324560b750dc271a383a5c8f96f20115429ae3"} Dec 04 12:23:54.167890 master-0 kubenswrapper[35367]: I1204 12:23:54.167781 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae4bb51d997d19181a0be4c7a5324560b750dc271a383a5c8f96f20115429ae3" Dec 04 12:23:54.230890 master-0 kubenswrapper[35367]: I1204 12:23:54.230765 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-cell-mapping-48wk7" Dec 04 12:23:54.306236 master-0 kubenswrapper[35367]: I1204 12:23:54.305517 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/861c8de8-9e85-4f7f-a30a-b2426fd8a848-scripts\") pod \"861c8de8-9e85-4f7f-a30a-b2426fd8a848\" (UID: \"861c8de8-9e85-4f7f-a30a-b2426fd8a848\") " Dec 04 12:23:54.306236 master-0 kubenswrapper[35367]: I1204 12:23:54.305679 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/861c8de8-9e85-4f7f-a30a-b2426fd8a848-combined-ca-bundle\") pod \"861c8de8-9e85-4f7f-a30a-b2426fd8a848\" (UID: \"861c8de8-9e85-4f7f-a30a-b2426fd8a848\") " Dec 04 12:23:54.306236 master-0 kubenswrapper[35367]: I1204 12:23:54.305856 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/861c8de8-9e85-4f7f-a30a-b2426fd8a848-config-data\") pod \"861c8de8-9e85-4f7f-a30a-b2426fd8a848\" (UID: \"861c8de8-9e85-4f7f-a30a-b2426fd8a848\") " Dec 04 12:23:54.306236 master-0 kubenswrapper[35367]: I1204 12:23:54.305943 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66j84\" (UniqueName: \"kubernetes.io/projected/861c8de8-9e85-4f7f-a30a-b2426fd8a848-kube-api-access-66j84\") pod \"861c8de8-9e85-4f7f-a30a-b2426fd8a848\" (UID: \"861c8de8-9e85-4f7f-a30a-b2426fd8a848\") " Dec 04 12:23:54.311397 master-0 kubenswrapper[35367]: I1204 12:23:54.311329 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/861c8de8-9e85-4f7f-a30a-b2426fd8a848-kube-api-access-66j84" (OuterVolumeSpecName: "kube-api-access-66j84") pod "861c8de8-9e85-4f7f-a30a-b2426fd8a848" (UID: "861c8de8-9e85-4f7f-a30a-b2426fd8a848"). InnerVolumeSpecName "kube-api-access-66j84". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:23:54.315374 master-0 kubenswrapper[35367]: I1204 12:23:54.315297 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/861c8de8-9e85-4f7f-a30a-b2426fd8a848-scripts" (OuterVolumeSpecName: "scripts") pod "861c8de8-9e85-4f7f-a30a-b2426fd8a848" (UID: "861c8de8-9e85-4f7f-a30a-b2426fd8a848"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:23:54.355949 master-0 kubenswrapper[35367]: I1204 12:23:54.353959 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/861c8de8-9e85-4f7f-a30a-b2426fd8a848-config-data" (OuterVolumeSpecName: "config-data") pod "861c8de8-9e85-4f7f-a30a-b2426fd8a848" (UID: "861c8de8-9e85-4f7f-a30a-b2426fd8a848"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:23:54.355949 master-0 kubenswrapper[35367]: I1204 12:23:54.354919 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/861c8de8-9e85-4f7f-a30a-b2426fd8a848-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "861c8de8-9e85-4f7f-a30a-b2426fd8a848" (UID: "861c8de8-9e85-4f7f-a30a-b2426fd8a848"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:23:54.410170 master-0 kubenswrapper[35367]: I1204 12:23:54.410091 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/861c8de8-9e85-4f7f-a30a-b2426fd8a848-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:54.410170 master-0 kubenswrapper[35367]: I1204 12:23:54.410158 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/861c8de8-9e85-4f7f-a30a-b2426fd8a848-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:54.410170 master-0 kubenswrapper[35367]: I1204 12:23:54.410176 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/861c8de8-9e85-4f7f-a30a-b2426fd8a848-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:54.410554 master-0 kubenswrapper[35367]: I1204 12:23:54.410188 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-66j84\" (UniqueName: \"kubernetes.io/projected/861c8de8-9e85-4f7f-a30a-b2426fd8a848-kube-api-access-66j84\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:54.448554 master-0 kubenswrapper[35367]: I1204 12:23:54.448444 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 12:23:54.870100 master-0 kubenswrapper[35367]: I1204 12:23:54.870019 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:23:55.052834 master-0 kubenswrapper[35367]: I1204 12:23:55.050564 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-65c9687b5f-h6zpt"] Dec 04 12:23:55.052834 master-0 kubenswrapper[35367]: I1204 12:23:55.050875 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" podUID="8294f299-adc0-4d31-9475-3b425402b08a" containerName="dnsmasq-dns" containerID="cri-o://ad0d2c0fa08caa1fb6d3e8dc7b209a09361d9ce6dced006a2a7aae0d564866f4" gracePeriod=10 Dec 04 12:23:55.265955 master-0 kubenswrapper[35367]: I1204 12:23:55.265762 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d","Type":"ContainerStarted","Data":"14f34dc66ae66255ebf8c33129df3f49dd37a01bb30038616f6ec579317825cc"} Dec 04 12:23:55.265955 master-0 kubenswrapper[35367]: I1204 12:23:55.265866 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d","Type":"ContainerStarted","Data":"388f0070871368774f5ef59380f97ea28059a3298a7a1e64668d8b616a8b9b42"} Dec 04 12:23:55.265955 master-0 kubenswrapper[35367]: I1204 12:23:55.265879 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d","Type":"ContainerStarted","Data":"a5325c2a7af45e55e0904434ce622a3bc9cfc511bfe85b7de8e4682310ca6e7c"} Dec 04 12:23:55.276398 master-0 kubenswrapper[35367]: I1204 12:23:55.275340 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-compute-ironic-compute-0" event={"ID":"7a06bc55-b50f-4680-8912-32ccfb969eab","Type":"ContainerStarted","Data":"b0c60ccf895296fa559ce68b5ad5ec5f24e016d67f3098baed323c0e6bad29d5"} Dec 04 12:23:55.277823 master-0 kubenswrapper[35367]: I1204 12:23:55.277334 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 12:23:55.317412 master-0 kubenswrapper[35367]: I1204 12:23:55.317350 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-cell-mapping-48wk7" Dec 04 12:23:55.319652 master-0 kubenswrapper[35367]: I1204 12:23:55.318695 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-conductor-0" event={"ID":"822f5f37-f2cc-4473-9544-0fb50d3d9266","Type":"ContainerStarted","Data":"1fee160c3ed4308bf028064e03761f3dcbe8dfe4a1ed39b02f62d5076066734f"} Dec 04 12:23:55.319652 master-0 kubenswrapper[35367]: I1204 12:23:55.318994 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-conductor-0" Dec 04 12:23:55.319652 master-0 kubenswrapper[35367]: I1204 12:23:55.319347 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-conductor-0" Dec 04 12:23:55.319652 master-0 kubenswrapper[35367]: I1204 12:23:55.319566 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-conductor-0" Dec 04 12:23:55.325141 master-0 kubenswrapper[35367]: I1204 12:23:55.325077 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ironic-conductor-0" Dec 04 12:23:55.330126 master-0 kubenswrapper[35367]: I1204 12:23:55.330047 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-metadata-0" podStartSLOduration=7.330024142 podStartE2EDuration="7.330024142s" podCreationTimestamp="2025-12-04 12:23:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:23:55.301706881 +0000 UTC m=+1478.739768139" watchObservedRunningTime="2025-12-04 12:23:55.330024142 +0000 UTC m=+1478.768085400" Dec 04 12:23:55.342166 master-0 kubenswrapper[35367]: I1204 12:23:55.342095 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-cell1-compute-ironic-compute-0" Dec 04 12:23:55.356166 master-0 kubenswrapper[35367]: I1204 12:23:55.356099 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ironic-conductor-0" Dec 04 12:23:55.558899 master-0 kubenswrapper[35367]: I1204 12:23:55.558782 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell1-compute-ironic-compute-0" podStartSLOduration=3.819562469 podStartE2EDuration="17.558757442s" podCreationTimestamp="2025-12-04 12:23:38 +0000 UTC" firstStartedPulling="2025-12-04 12:23:40.245702111 +0000 UTC m=+1463.683763369" lastFinishedPulling="2025-12-04 12:23:53.984897084 +0000 UTC m=+1477.422958342" observedRunningTime="2025-12-04 12:23:55.543421075 +0000 UTC m=+1478.981482333" watchObservedRunningTime="2025-12-04 12:23:55.558757442 +0000 UTC m=+1478.996818700" Dec 04 12:23:55.774687 master-0 kubenswrapper[35367]: I1204 12:23:55.774585 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ironic-conductor-0" podStartSLOduration=67.990907172 podStartE2EDuration="1m43.774554042s" podCreationTimestamp="2025-12-04 12:22:12 +0000 UTC" firstStartedPulling="2025-12-04 12:22:23.357884797 +0000 UTC m=+1386.795946055" lastFinishedPulling="2025-12-04 12:22:59.141531667 +0000 UTC m=+1422.579592925" observedRunningTime="2025-12-04 12:23:55.766493686 +0000 UTC m=+1479.204554964" watchObservedRunningTime="2025-12-04 12:23:55.774554042 +0000 UTC m=+1479.212615290" Dec 04 12:23:55.884465 master-0 kubenswrapper[35367]: I1204 12:23:55.884318 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-api-0"] Dec 04 12:23:55.884718 master-0 kubenswrapper[35367]: I1204 12:23:55.884646 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-api-0" podUID="11f7cf54-6506-41e8-8649-13383ca9bc5b" containerName="nova-api-log" containerID="cri-o://54cf5f3c9931184cc2c004067d95edb41513a4d815d82499bf01aecb778a8fc0" gracePeriod=30 Dec 04 12:23:55.885498 master-0 kubenswrapper[35367]: I1204 12:23:55.885466 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-api-0" podUID="11f7cf54-6506-41e8-8649-13383ca9bc5b" containerName="nova-api-api" containerID="cri-o://8422ec447e522f3cc3adabfe98a75f02bb4db0af699b916620f158aeb3b891cb" gracePeriod=30 Dec 04 12:23:55.913048 master-0 kubenswrapper[35367]: I1204 12:23:55.912927 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 12:23:55.913329 master-0 kubenswrapper[35367]: I1204 12:23:55.913265 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-scheduler-0" podUID="1f724182-33cd-49f0-9815-f8675fb7dfd9" containerName="nova-scheduler-scheduler" containerID="cri-o://76d8ddcf45684663140c424034cfd48777719ea42c4c6744168322b23058a404" gracePeriod=30 Dec 04 12:23:55.960236 master-0 kubenswrapper[35367]: I1204 12:23:55.960172 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 12:23:56.334004 master-0 kubenswrapper[35367]: I1204 12:23:56.333933 35367 generic.go:334] "Generic (PLEG): container finished" podID="11f7cf54-6506-41e8-8649-13383ca9bc5b" containerID="54cf5f3c9931184cc2c004067d95edb41513a4d815d82499bf01aecb778a8fc0" exitCode=143 Dec 04 12:23:56.334610 master-0 kubenswrapper[35367]: I1204 12:23:56.334017 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"11f7cf54-6506-41e8-8649-13383ca9bc5b","Type":"ContainerDied","Data":"54cf5f3c9931184cc2c004067d95edb41513a4d815d82499bf01aecb778a8fc0"} Dec 04 12:23:56.344600 master-0 kubenswrapper[35367]: I1204 12:23:56.344508 35367 generic.go:334] "Generic (PLEG): container finished" podID="8294f299-adc0-4d31-9475-3b425402b08a" containerID="ad0d2c0fa08caa1fb6d3e8dc7b209a09361d9ce6dced006a2a7aae0d564866f4" exitCode=0 Dec 04 12:23:56.344954 master-0 kubenswrapper[35367]: I1204 12:23:56.344650 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" event={"ID":"8294f299-adc0-4d31-9475-3b425402b08a","Type":"ContainerDied","Data":"ad0d2c0fa08caa1fb6d3e8dc7b209a09361d9ce6dced006a2a7aae0d564866f4"} Dec 04 12:23:56.344954 master-0 kubenswrapper[35367]: I1204 12:23:56.344685 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" event={"ID":"8294f299-adc0-4d31-9475-3b425402b08a","Type":"ContainerDied","Data":"2b14ed69e42639c08d45f28b293001db6f445f63ae3f54770454721a86b206ba"} Dec 04 12:23:56.344954 master-0 kubenswrapper[35367]: I1204 12:23:56.344698 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b14ed69e42639c08d45f28b293001db6f445f63ae3f54770454721a86b206ba" Dec 04 12:23:56.349820 master-0 kubenswrapper[35367]: I1204 12:23:56.349742 35367 generic.go:334] "Generic (PLEG): container finished" podID="b6d4bf97-9d51-4065-a290-6b362c4c2096" containerID="c08a09dbe0cf511ad9c6a6f1e21f98afb8d023332e382704b3e19ed34ecf50f6" exitCode=0 Dec 04 12:23:56.350039 master-0 kubenswrapper[35367]: I1204 12:23:56.349851 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-conductor-db-sync-qqvk9" event={"ID":"b6d4bf97-9d51-4065-a290-6b362c4c2096","Type":"ContainerDied","Data":"c08a09dbe0cf511ad9c6a6f1e21f98afb8d023332e382704b3e19ed34ecf50f6"} Dec 04 12:23:56.385315 master-0 kubenswrapper[35367]: I1204 12:23:56.385137 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:23:56.454517 master-0 kubenswrapper[35367]: I1204 12:23:56.440243 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-ovsdbserver-nb\") pod \"8294f299-adc0-4d31-9475-3b425402b08a\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " Dec 04 12:23:56.454517 master-0 kubenswrapper[35367]: I1204 12:23:56.440394 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-ovsdbserver-sb\") pod \"8294f299-adc0-4d31-9475-3b425402b08a\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " Dec 04 12:23:56.454517 master-0 kubenswrapper[35367]: I1204 12:23:56.440518 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-dns-swift-storage-0\") pod \"8294f299-adc0-4d31-9475-3b425402b08a\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " Dec 04 12:23:56.454517 master-0 kubenswrapper[35367]: I1204 12:23:56.440679 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx6k5\" (UniqueName: \"kubernetes.io/projected/8294f299-adc0-4d31-9475-3b425402b08a-kube-api-access-xx6k5\") pod \"8294f299-adc0-4d31-9475-3b425402b08a\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " Dec 04 12:23:56.454517 master-0 kubenswrapper[35367]: I1204 12:23:56.441947 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-dns-svc\") pod \"8294f299-adc0-4d31-9475-3b425402b08a\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " Dec 04 12:23:56.454517 master-0 kubenswrapper[35367]: I1204 12:23:56.442096 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-config\") pod \"8294f299-adc0-4d31-9475-3b425402b08a\" (UID: \"8294f299-adc0-4d31-9475-3b425402b08a\") " Dec 04 12:23:56.454517 master-0 kubenswrapper[35367]: I1204 12:23:56.445248 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8294f299-adc0-4d31-9475-3b425402b08a-kube-api-access-xx6k5" (OuterVolumeSpecName: "kube-api-access-xx6k5") pod "8294f299-adc0-4d31-9475-3b425402b08a" (UID: "8294f299-adc0-4d31-9475-3b425402b08a"). InnerVolumeSpecName "kube-api-access-xx6k5". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:23:56.515634 master-0 kubenswrapper[35367]: I1204 12:23:56.515560 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "8294f299-adc0-4d31-9475-3b425402b08a" (UID: "8294f299-adc0-4d31-9475-3b425402b08a"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:23:56.517337 master-0 kubenswrapper[35367]: I1204 12:23:56.517267 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-config" (OuterVolumeSpecName: "config") pod "8294f299-adc0-4d31-9475-3b425402b08a" (UID: "8294f299-adc0-4d31-9475-3b425402b08a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:23:56.521089 master-0 kubenswrapper[35367]: I1204 12:23:56.520937 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "8294f299-adc0-4d31-9475-3b425402b08a" (UID: "8294f299-adc0-4d31-9475-3b425402b08a"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:23:56.534847 master-0 kubenswrapper[35367]: I1204 12:23:56.534755 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "8294f299-adc0-4d31-9475-3b425402b08a" (UID: "8294f299-adc0-4d31-9475-3b425402b08a"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:23:56.536143 master-0 kubenswrapper[35367]: I1204 12:23:56.536107 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "8294f299-adc0-4d31-9475-3b425402b08a" (UID: "8294f299-adc0-4d31-9475-3b425402b08a"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:23:56.546263 master-0 kubenswrapper[35367]: I1204 12:23:56.546174 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xx6k5\" (UniqueName: \"kubernetes.io/projected/8294f299-adc0-4d31-9475-3b425402b08a-kube-api-access-xx6k5\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:56.546263 master-0 kubenswrapper[35367]: I1204 12:23:56.546248 35367 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:56.546263 master-0 kubenswrapper[35367]: I1204 12:23:56.546262 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:56.546263 master-0 kubenswrapper[35367]: I1204 12:23:56.546272 35367 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:56.546582 master-0 kubenswrapper[35367]: I1204 12:23:56.546287 35367 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:56.546582 master-0 kubenswrapper[35367]: I1204 12:23:56.546301 35367 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/8294f299-adc0-4d31-9475-3b425402b08a-dns-swift-storage-0\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:57.364328 master-0 kubenswrapper[35367]: I1204 12:23:57.364172 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-65c9687b5f-h6zpt" Dec 04 12:23:57.364971 master-0 kubenswrapper[35367]: I1204 12:23:57.364870 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-metadata-0" podUID="50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d" containerName="nova-metadata-log" containerID="cri-o://388f0070871368774f5ef59380f97ea28059a3298a7a1e64668d8b616a8b9b42" gracePeriod=30 Dec 04 12:23:57.364971 master-0 kubenswrapper[35367]: I1204 12:23:57.364943 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-metadata-0" podUID="50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d" containerName="nova-metadata-metadata" containerID="cri-o://14f34dc66ae66255ebf8c33129df3f49dd37a01bb30038616f6ec579317825cc" gracePeriod=30 Dec 04 12:23:57.414917 master-0 kubenswrapper[35367]: I1204 12:23:57.414785 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ironic-conductor-0" Dec 04 12:23:57.421170 master-0 kubenswrapper[35367]: I1204 12:23:57.421051 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-65c9687b5f-h6zpt"] Dec 04 12:23:57.436961 master-0 kubenswrapper[35367]: I1204 12:23:57.436849 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-65c9687b5f-h6zpt"] Dec 04 12:23:57.909080 master-0 kubenswrapper[35367]: I1204 12:23:57.909010 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-conductor-db-sync-qqvk9" Dec 04 12:23:57.998772 master-0 kubenswrapper[35367]: I1204 12:23:57.998685 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b6d4bf97-9d51-4065-a290-6b362c4c2096-config-data\") pod \"b6d4bf97-9d51-4065-a290-6b362c4c2096\" (UID: \"b6d4bf97-9d51-4065-a290-6b362c4c2096\") " Dec 04 12:23:57.999344 master-0 kubenswrapper[35367]: I1204 12:23:57.999230 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znk6x\" (UniqueName: \"kubernetes.io/projected/b6d4bf97-9d51-4065-a290-6b362c4c2096-kube-api-access-znk6x\") pod \"b6d4bf97-9d51-4065-a290-6b362c4c2096\" (UID: \"b6d4bf97-9d51-4065-a290-6b362c4c2096\") " Dec 04 12:23:57.999654 master-0 kubenswrapper[35367]: I1204 12:23:57.999442 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b6d4bf97-9d51-4065-a290-6b362c4c2096-combined-ca-bundle\") pod \"b6d4bf97-9d51-4065-a290-6b362c4c2096\" (UID: \"b6d4bf97-9d51-4065-a290-6b362c4c2096\") " Dec 04 12:23:57.999654 master-0 kubenswrapper[35367]: I1204 12:23:57.999474 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b6d4bf97-9d51-4065-a290-6b362c4c2096-scripts\") pod \"b6d4bf97-9d51-4065-a290-6b362c4c2096\" (UID: \"b6d4bf97-9d51-4065-a290-6b362c4c2096\") " Dec 04 12:23:58.007080 master-0 kubenswrapper[35367]: I1204 12:23:58.007005 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6d4bf97-9d51-4065-a290-6b362c4c2096-scripts" (OuterVolumeSpecName: "scripts") pod "b6d4bf97-9d51-4065-a290-6b362c4c2096" (UID: "b6d4bf97-9d51-4065-a290-6b362c4c2096"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:23:58.011780 master-0 kubenswrapper[35367]: I1204 12:23:58.008251 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 12:23:58.011780 master-0 kubenswrapper[35367]: I1204 12:23:58.008863 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6d4bf97-9d51-4065-a290-6b362c4c2096-kube-api-access-znk6x" (OuterVolumeSpecName: "kube-api-access-znk6x") pod "b6d4bf97-9d51-4065-a290-6b362c4c2096" (UID: "b6d4bf97-9d51-4065-a290-6b362c4c2096"). InnerVolumeSpecName "kube-api-access-znk6x". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:23:58.056507 master-0 kubenswrapper[35367]: I1204 12:23:58.056406 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6d4bf97-9d51-4065-a290-6b362c4c2096-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b6d4bf97-9d51-4065-a290-6b362c4c2096" (UID: "b6d4bf97-9d51-4065-a290-6b362c4c2096"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:23:58.070909 master-0 kubenswrapper[35367]: I1204 12:23:58.070733 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6d4bf97-9d51-4065-a290-6b362c4c2096-config-data" (OuterVolumeSpecName: "config-data") pod "b6d4bf97-9d51-4065-a290-6b362c4c2096" (UID: "b6d4bf97-9d51-4065-a290-6b362c4c2096"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:23:58.102902 master-0 kubenswrapper[35367]: I1204 12:23:58.102820 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vg5l\" (UniqueName: \"kubernetes.io/projected/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-kube-api-access-7vg5l\") pod \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\" (UID: \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\") " Dec 04 12:23:58.103167 master-0 kubenswrapper[35367]: I1204 12:23:58.103068 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-config-data\") pod \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\" (UID: \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\") " Dec 04 12:23:58.103167 master-0 kubenswrapper[35367]: I1204 12:23:58.103156 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-combined-ca-bundle\") pod \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\" (UID: \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\") " Dec 04 12:23:58.103278 master-0 kubenswrapper[35367]: I1204 12:23:58.103255 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-logs\") pod \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\" (UID: \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\") " Dec 04 12:23:58.103495 master-0 kubenswrapper[35367]: I1204 12:23:58.103465 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-nova-metadata-tls-certs\") pod \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\" (UID: \"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d\") " Dec 04 12:23:58.103852 master-0 kubenswrapper[35367]: I1204 12:23:58.103777 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-logs" (OuterVolumeSpecName: "logs") pod "50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d" (UID: "50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:23:58.104438 master-0 kubenswrapper[35367]: I1204 12:23:58.104400 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b6d4bf97-9d51-4065-a290-6b362c4c2096-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:58.104438 master-0 kubenswrapper[35367]: I1204 12:23:58.104434 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b6d4bf97-9d51-4065-a290-6b362c4c2096-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:58.104523 master-0 kubenswrapper[35367]: I1204 12:23:58.104445 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b6d4bf97-9d51-4065-a290-6b362c4c2096-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:58.104523 master-0 kubenswrapper[35367]: I1204 12:23:58.104456 35367 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:58.104523 master-0 kubenswrapper[35367]: I1204 12:23:58.104469 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-znk6x\" (UniqueName: \"kubernetes.io/projected/b6d4bf97-9d51-4065-a290-6b362c4c2096-kube-api-access-znk6x\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:58.108684 master-0 kubenswrapper[35367]: I1204 12:23:58.108537 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-kube-api-access-7vg5l" (OuterVolumeSpecName: "kube-api-access-7vg5l") pod "50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d" (UID: "50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d"). InnerVolumeSpecName "kube-api-access-7vg5l". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:23:58.145886 master-0 kubenswrapper[35367]: I1204 12:23:58.145105 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-config-data" (OuterVolumeSpecName: "config-data") pod "50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d" (UID: "50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:23:58.147852 master-0 kubenswrapper[35367]: I1204 12:23:58.147764 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d" (UID: "50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:23:58.193598 master-0 kubenswrapper[35367]: I1204 12:23:58.182325 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d" (UID: "50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:23:58.208025 master-0 kubenswrapper[35367]: I1204 12:23:58.207906 35367 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-nova-metadata-tls-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:58.208025 master-0 kubenswrapper[35367]: I1204 12:23:58.208011 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7vg5l\" (UniqueName: \"kubernetes.io/projected/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-kube-api-access-7vg5l\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:58.208025 master-0 kubenswrapper[35367]: I1204 12:23:58.208034 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:58.208025 master-0 kubenswrapper[35367]: I1204 12:23:58.208048 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:58.383173 master-0 kubenswrapper[35367]: I1204 12:23:58.383087 35367 generic.go:334] "Generic (PLEG): container finished" podID="1f724182-33cd-49f0-9815-f8675fb7dfd9" containerID="76d8ddcf45684663140c424034cfd48777719ea42c4c6744168322b23058a404" exitCode=0 Dec 04 12:23:58.383796 master-0 kubenswrapper[35367]: I1204 12:23:58.383177 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-0" event={"ID":"1f724182-33cd-49f0-9815-f8675fb7dfd9","Type":"ContainerDied","Data":"76d8ddcf45684663140c424034cfd48777719ea42c4c6744168322b23058a404"} Dec 04 12:23:58.387045 master-0 kubenswrapper[35367]: I1204 12:23:58.386987 35367 generic.go:334] "Generic (PLEG): container finished" podID="50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d" containerID="14f34dc66ae66255ebf8c33129df3f49dd37a01bb30038616f6ec579317825cc" exitCode=0 Dec 04 12:23:58.387045 master-0 kubenswrapper[35367]: I1204 12:23:58.387032 35367 generic.go:334] "Generic (PLEG): container finished" podID="50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d" containerID="388f0070871368774f5ef59380f97ea28059a3298a7a1e64668d8b616a8b9b42" exitCode=143 Dec 04 12:23:58.387237 master-0 kubenswrapper[35367]: I1204 12:23:58.387094 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d","Type":"ContainerDied","Data":"14f34dc66ae66255ebf8c33129df3f49dd37a01bb30038616f6ec579317825cc"} Dec 04 12:23:58.387237 master-0 kubenswrapper[35367]: I1204 12:23:58.387130 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d","Type":"ContainerDied","Data":"388f0070871368774f5ef59380f97ea28059a3298a7a1e64668d8b616a8b9b42"} Dec 04 12:23:58.387237 master-0 kubenswrapper[35367]: I1204 12:23:58.387148 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d","Type":"ContainerDied","Data":"a5325c2a7af45e55e0904434ce622a3bc9cfc511bfe85b7de8e4682310ca6e7c"} Dec 04 12:23:58.387237 master-0 kubenswrapper[35367]: I1204 12:23:58.387168 35367 scope.go:117] "RemoveContainer" containerID="14f34dc66ae66255ebf8c33129df3f49dd37a01bb30038616f6ec579317825cc" Dec 04 12:23:58.387419 master-0 kubenswrapper[35367]: I1204 12:23:58.387379 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 12:23:58.392924 master-0 kubenswrapper[35367]: I1204 12:23:58.392866 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-conductor-db-sync-qqvk9" event={"ID":"b6d4bf97-9d51-4065-a290-6b362c4c2096","Type":"ContainerDied","Data":"6b80a056d0a5118bb49a18274c977bbe87be87d7d2d0dce9c74fbf3e28e1ff79"} Dec 04 12:23:58.393030 master-0 kubenswrapper[35367]: I1204 12:23:58.392930 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-conductor-db-sync-qqvk9" Dec 04 12:23:58.393093 master-0 kubenswrapper[35367]: I1204 12:23:58.392941 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b80a056d0a5118bb49a18274c977bbe87be87d7d2d0dce9c74fbf3e28e1ff79" Dec 04 12:23:58.428474 master-0 kubenswrapper[35367]: I1204 12:23:58.428384 35367 scope.go:117] "RemoveContainer" containerID="388f0070871368774f5ef59380f97ea28059a3298a7a1e64668d8b616a8b9b42" Dec 04 12:23:58.454342 master-0 kubenswrapper[35367]: I1204 12:23:58.454265 35367 scope.go:117] "RemoveContainer" containerID="14f34dc66ae66255ebf8c33129df3f49dd37a01bb30038616f6ec579317825cc" Dec 04 12:23:58.454980 master-0 kubenswrapper[35367]: E1204 12:23:58.454937 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14f34dc66ae66255ebf8c33129df3f49dd37a01bb30038616f6ec579317825cc\": container with ID starting with 14f34dc66ae66255ebf8c33129df3f49dd37a01bb30038616f6ec579317825cc not found: ID does not exist" containerID="14f34dc66ae66255ebf8c33129df3f49dd37a01bb30038616f6ec579317825cc" Dec 04 12:23:58.455046 master-0 kubenswrapper[35367]: I1204 12:23:58.454989 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14f34dc66ae66255ebf8c33129df3f49dd37a01bb30038616f6ec579317825cc"} err="failed to get container status \"14f34dc66ae66255ebf8c33129df3f49dd37a01bb30038616f6ec579317825cc\": rpc error: code = NotFound desc = could not find container \"14f34dc66ae66255ebf8c33129df3f49dd37a01bb30038616f6ec579317825cc\": container with ID starting with 14f34dc66ae66255ebf8c33129df3f49dd37a01bb30038616f6ec579317825cc not found: ID does not exist" Dec 04 12:23:58.455046 master-0 kubenswrapper[35367]: I1204 12:23:58.455031 35367 scope.go:117] "RemoveContainer" containerID="388f0070871368774f5ef59380f97ea28059a3298a7a1e64668d8b616a8b9b42" Dec 04 12:23:58.455520 master-0 kubenswrapper[35367]: E1204 12:23:58.455486 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"388f0070871368774f5ef59380f97ea28059a3298a7a1e64668d8b616a8b9b42\": container with ID starting with 388f0070871368774f5ef59380f97ea28059a3298a7a1e64668d8b616a8b9b42 not found: ID does not exist" containerID="388f0070871368774f5ef59380f97ea28059a3298a7a1e64668d8b616a8b9b42" Dec 04 12:23:58.455572 master-0 kubenswrapper[35367]: I1204 12:23:58.455525 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"388f0070871368774f5ef59380f97ea28059a3298a7a1e64668d8b616a8b9b42"} err="failed to get container status \"388f0070871368774f5ef59380f97ea28059a3298a7a1e64668d8b616a8b9b42\": rpc error: code = NotFound desc = could not find container \"388f0070871368774f5ef59380f97ea28059a3298a7a1e64668d8b616a8b9b42\": container with ID starting with 388f0070871368774f5ef59380f97ea28059a3298a7a1e64668d8b616a8b9b42 not found: ID does not exist" Dec 04 12:23:58.455572 master-0 kubenswrapper[35367]: I1204 12:23:58.455546 35367 scope.go:117] "RemoveContainer" containerID="14f34dc66ae66255ebf8c33129df3f49dd37a01bb30038616f6ec579317825cc" Dec 04 12:23:58.456114 master-0 kubenswrapper[35367]: I1204 12:23:58.456054 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14f34dc66ae66255ebf8c33129df3f49dd37a01bb30038616f6ec579317825cc"} err="failed to get container status \"14f34dc66ae66255ebf8c33129df3f49dd37a01bb30038616f6ec579317825cc\": rpc error: code = NotFound desc = could not find container \"14f34dc66ae66255ebf8c33129df3f49dd37a01bb30038616f6ec579317825cc\": container with ID starting with 14f34dc66ae66255ebf8c33129df3f49dd37a01bb30038616f6ec579317825cc not found: ID does not exist" Dec 04 12:23:58.456161 master-0 kubenswrapper[35367]: I1204 12:23:58.456116 35367 scope.go:117] "RemoveContainer" containerID="388f0070871368774f5ef59380f97ea28059a3298a7a1e64668d8b616a8b9b42" Dec 04 12:23:58.456921 master-0 kubenswrapper[35367]: I1204 12:23:58.456754 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"388f0070871368774f5ef59380f97ea28059a3298a7a1e64668d8b616a8b9b42"} err="failed to get container status \"388f0070871368774f5ef59380f97ea28059a3298a7a1e64668d8b616a8b9b42\": rpc error: code = NotFound desc = could not find container \"388f0070871368774f5ef59380f97ea28059a3298a7a1e64668d8b616a8b9b42\": container with ID starting with 388f0070871368774f5ef59380f97ea28059a3298a7a1e64668d8b616a8b9b42 not found: ID does not exist" Dec 04 12:23:58.530565 master-0 kubenswrapper[35367]: I1204 12:23:58.530496 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-0" Dec 04 12:23:58.763934 master-0 kubenswrapper[35367]: I1204 12:23:58.763722 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8294f299-adc0-4d31-9475-3b425402b08a" path="/var/lib/kubelet/pods/8294f299-adc0-4d31-9475-3b425402b08a/volumes" Dec 04 12:23:58.823341 master-0 kubenswrapper[35367]: I1204 12:23:58.823228 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1f724182-33cd-49f0-9815-f8675fb7dfd9-combined-ca-bundle\") pod \"1f724182-33cd-49f0-9815-f8675fb7dfd9\" (UID: \"1f724182-33cd-49f0-9815-f8675fb7dfd9\") " Dec 04 12:23:58.823341 master-0 kubenswrapper[35367]: I1204 12:23:58.823312 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1f724182-33cd-49f0-9815-f8675fb7dfd9-config-data\") pod \"1f724182-33cd-49f0-9815-f8675fb7dfd9\" (UID: \"1f724182-33cd-49f0-9815-f8675fb7dfd9\") " Dec 04 12:23:58.823711 master-0 kubenswrapper[35367]: I1204 12:23:58.823524 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2v6q\" (UniqueName: \"kubernetes.io/projected/1f724182-33cd-49f0-9815-f8675fb7dfd9-kube-api-access-h2v6q\") pod \"1f724182-33cd-49f0-9815-f8675fb7dfd9\" (UID: \"1f724182-33cd-49f0-9815-f8675fb7dfd9\") " Dec 04 12:23:58.827233 master-0 kubenswrapper[35367]: I1204 12:23:58.827179 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f724182-33cd-49f0-9815-f8675fb7dfd9-kube-api-access-h2v6q" (OuterVolumeSpecName: "kube-api-access-h2v6q") pod "1f724182-33cd-49f0-9815-f8675fb7dfd9" (UID: "1f724182-33cd-49f0-9815-f8675fb7dfd9"). InnerVolumeSpecName "kube-api-access-h2v6q". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:23:58.855643 master-0 kubenswrapper[35367]: I1204 12:23:58.855577 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f724182-33cd-49f0-9815-f8675fb7dfd9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1f724182-33cd-49f0-9815-f8675fb7dfd9" (UID: "1f724182-33cd-49f0-9815-f8675fb7dfd9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:23:58.868164 master-0 kubenswrapper[35367]: I1204 12:23:58.868104 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f724182-33cd-49f0-9815-f8675fb7dfd9-config-data" (OuterVolumeSpecName: "config-data") pod "1f724182-33cd-49f0-9815-f8675fb7dfd9" (UID: "1f724182-33cd-49f0-9815-f8675fb7dfd9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:23:58.928949 master-0 kubenswrapper[35367]: I1204 12:23:58.928885 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1f724182-33cd-49f0-9815-f8675fb7dfd9-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:58.929320 master-0 kubenswrapper[35367]: I1204 12:23:58.929306 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1f724182-33cd-49f0-9815-f8675fb7dfd9-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:58.929406 master-0 kubenswrapper[35367]: I1204 12:23:58.929392 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-h2v6q\" (UniqueName: \"kubernetes.io/projected/1f724182-33cd-49f0-9815-f8675fb7dfd9-kube-api-access-h2v6q\") on node \"master-0\" DevicePath \"\"" Dec 04 12:23:59.409472 master-0 kubenswrapper[35367]: I1204 12:23:59.409268 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-0" Dec 04 12:23:59.409472 master-0 kubenswrapper[35367]: I1204 12:23:59.409304 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-0" event={"ID":"1f724182-33cd-49f0-9815-f8675fb7dfd9","Type":"ContainerDied","Data":"4198724d2b6f775a25bd9dbb4b0e3f87890171c631fa3f0f5339e6efa6993f59"} Dec 04 12:23:59.409472 master-0 kubenswrapper[35367]: I1204 12:23:59.409409 35367 scope.go:117] "RemoveContainer" containerID="76d8ddcf45684663140c424034cfd48777719ea42c4c6744168322b23058a404" Dec 04 12:24:00.445327 master-0 kubenswrapper[35367]: I1204 12:24:00.445256 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 12:24:00.468365 master-0 kubenswrapper[35367]: I1204 12:24:00.468207 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 12:24:00.492303 master-0 kubenswrapper[35367]: I1204 12:24:00.492225 35367 generic.go:334] "Generic (PLEG): container finished" podID="11f7cf54-6506-41e8-8649-13383ca9bc5b" containerID="8422ec447e522f3cc3adabfe98a75f02bb4db0af699b916620f158aeb3b891cb" exitCode=0 Dec 04 12:24:00.492660 master-0 kubenswrapper[35367]: I1204 12:24:00.492631 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"11f7cf54-6506-41e8-8649-13383ca9bc5b","Type":"ContainerDied","Data":"8422ec447e522f3cc3adabfe98a75f02bb4db0af699b916620f158aeb3b891cb"} Dec 04 12:24:00.521118 master-0 kubenswrapper[35367]: I1204 12:24:00.521028 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell1-conductor-0"] Dec 04 12:24:00.522651 master-0 kubenswrapper[35367]: E1204 12:24:00.522394 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8294f299-adc0-4d31-9475-3b425402b08a" containerName="init" Dec 04 12:24:00.522822 master-0 kubenswrapper[35367]: I1204 12:24:00.522791 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="8294f299-adc0-4d31-9475-3b425402b08a" containerName="init" Dec 04 12:24:00.522967 master-0 kubenswrapper[35367]: E1204 12:24:00.522950 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8294f299-adc0-4d31-9475-3b425402b08a" containerName="dnsmasq-dns" Dec 04 12:24:00.523053 master-0 kubenswrapper[35367]: I1204 12:24:00.523038 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="8294f299-adc0-4d31-9475-3b425402b08a" containerName="dnsmasq-dns" Dec 04 12:24:00.523210 master-0 kubenswrapper[35367]: E1204 12:24:00.523193 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b6d4bf97-9d51-4065-a290-6b362c4c2096" containerName="nova-cell1-conductor-db-sync" Dec 04 12:24:00.523298 master-0 kubenswrapper[35367]: I1204 12:24:00.523285 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6d4bf97-9d51-4065-a290-6b362c4c2096" containerName="nova-cell1-conductor-db-sync" Dec 04 12:24:00.523393 master-0 kubenswrapper[35367]: E1204 12:24:00.523377 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d" containerName="nova-metadata-log" Dec 04 12:24:00.523475 master-0 kubenswrapper[35367]: I1204 12:24:00.523460 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d" containerName="nova-metadata-log" Dec 04 12:24:00.523594 master-0 kubenswrapper[35367]: E1204 12:24:00.523578 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="861c8de8-9e85-4f7f-a30a-b2426fd8a848" containerName="nova-manage" Dec 04 12:24:00.523673 master-0 kubenswrapper[35367]: I1204 12:24:00.523662 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="861c8de8-9e85-4f7f-a30a-b2426fd8a848" containerName="nova-manage" Dec 04 12:24:00.523937 master-0 kubenswrapper[35367]: E1204 12:24:00.523918 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d" containerName="nova-metadata-metadata" Dec 04 12:24:00.524088 master-0 kubenswrapper[35367]: I1204 12:24:00.524073 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d" containerName="nova-metadata-metadata" Dec 04 12:24:00.524198 master-0 kubenswrapper[35367]: E1204 12:24:00.524183 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1f724182-33cd-49f0-9815-f8675fb7dfd9" containerName="nova-scheduler-scheduler" Dec 04 12:24:00.524280 master-0 kubenswrapper[35367]: I1204 12:24:00.524267 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f724182-33cd-49f0-9815-f8675fb7dfd9" containerName="nova-scheduler-scheduler" Dec 04 12:24:00.524880 master-0 kubenswrapper[35367]: I1204 12:24:00.524859 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d" containerName="nova-metadata-metadata" Dec 04 12:24:00.525123 master-0 kubenswrapper[35367]: I1204 12:24:00.525109 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="8294f299-adc0-4d31-9475-3b425402b08a" containerName="dnsmasq-dns" Dec 04 12:24:00.525230 master-0 kubenswrapper[35367]: I1204 12:24:00.525217 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d" containerName="nova-metadata-log" Dec 04 12:24:00.525340 master-0 kubenswrapper[35367]: I1204 12:24:00.525325 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="861c8de8-9e85-4f7f-a30a-b2426fd8a848" containerName="nova-manage" Dec 04 12:24:00.525437 master-0 kubenswrapper[35367]: I1204 12:24:00.525424 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="1f724182-33cd-49f0-9815-f8675fb7dfd9" containerName="nova-scheduler-scheduler" Dec 04 12:24:00.525529 master-0 kubenswrapper[35367]: I1204 12:24:00.525515 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="b6d4bf97-9d51-4065-a290-6b362c4c2096" containerName="nova-cell1-conductor-db-sync" Dec 04 12:24:00.526927 master-0 kubenswrapper[35367]: I1204 12:24:00.526901 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-conductor-0" Dec 04 12:24:00.529352 master-0 kubenswrapper[35367]: I1204 12:24:00.529291 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell1-conductor-config-data" Dec 04 12:24:00.534830 master-0 kubenswrapper[35367]: I1204 12:24:00.534741 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 12:24:00.550107 master-0 kubenswrapper[35367]: I1204 12:24:00.549623 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 12:24:00.573245 master-0 kubenswrapper[35367]: I1204 12:24:00.570830 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-conductor-0"] Dec 04 12:24:00.584223 master-0 kubenswrapper[35367]: I1204 12:24:00.584164 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-metadata-0"] Dec 04 12:24:00.586454 master-0 kubenswrapper[35367]: I1204 12:24:00.586420 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 12:24:00.589057 master-0 kubenswrapper[35367]: I1204 12:24:00.589008 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-metadata-config-data" Dec 04 12:24:00.589126 master-0 kubenswrapper[35367]: I1204 12:24:00.589075 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-metadata-internal-svc" Dec 04 12:24:00.598040 master-0 kubenswrapper[35367]: I1204 12:24:00.597973 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82078196-d1e2-4240-bce7-f95e0f1e3a04-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"82078196-d1e2-4240-bce7-f95e0f1e3a04\") " pod="openstack/nova-cell1-conductor-0" Dec 04 12:24:00.598124 master-0 kubenswrapper[35367]: I1204 12:24:00.598014 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 12:24:00.598124 master-0 kubenswrapper[35367]: I1204 12:24:00.598068 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5qmg\" (UniqueName: \"kubernetes.io/projected/82078196-d1e2-4240-bce7-f95e0f1e3a04-kube-api-access-n5qmg\") pod \"nova-cell1-conductor-0\" (UID: \"82078196-d1e2-4240-bce7-f95e0f1e3a04\") " pod="openstack/nova-cell1-conductor-0" Dec 04 12:24:00.598707 master-0 kubenswrapper[35367]: I1204 12:24:00.598655 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/82078196-d1e2-4240-bce7-f95e0f1e3a04-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"82078196-d1e2-4240-bce7-f95e0f1e3a04\") " pod="openstack/nova-cell1-conductor-0" Dec 04 12:24:00.617094 master-0 kubenswrapper[35367]: I1204 12:24:00.616959 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 12:24:00.619298 master-0 kubenswrapper[35367]: I1204 12:24:00.619035 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-0" Dec 04 12:24:00.621217 master-0 kubenswrapper[35367]: I1204 12:24:00.621167 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-scheduler-config-data" Dec 04 12:24:00.636493 master-0 kubenswrapper[35367]: I1204 12:24:00.636387 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 12:24:00.709720 master-0 kubenswrapper[35367]: I1204 12:24:00.709232 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/48092d7d-03c3-4ffe-92b1-34ade239b127-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"48092d7d-03c3-4ffe-92b1-34ade239b127\") " pod="openstack/nova-metadata-0" Dec 04 12:24:00.709720 master-0 kubenswrapper[35367]: I1204 12:24:00.709342 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46e5cf34-acb7-41c5-acf4-45bfdc3b1051-config-data\") pod \"nova-scheduler-0\" (UID: \"46e5cf34-acb7-41c5-acf4-45bfdc3b1051\") " pod="openstack/nova-scheduler-0" Dec 04 12:24:00.709720 master-0 kubenswrapper[35367]: I1204 12:24:00.709381 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82078196-d1e2-4240-bce7-f95e0f1e3a04-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"82078196-d1e2-4240-bce7-f95e0f1e3a04\") " pod="openstack/nova-cell1-conductor-0" Dec 04 12:24:00.709720 master-0 kubenswrapper[35367]: I1204 12:24:00.709463 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/48092d7d-03c3-4ffe-92b1-34ade239b127-logs\") pod \"nova-metadata-0\" (UID: \"48092d7d-03c3-4ffe-92b1-34ade239b127\") " pod="openstack/nova-metadata-0" Dec 04 12:24:00.709720 master-0 kubenswrapper[35367]: I1204 12:24:00.709490 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48092d7d-03c3-4ffe-92b1-34ade239b127-config-data\") pod \"nova-metadata-0\" (UID: \"48092d7d-03c3-4ffe-92b1-34ade239b127\") " pod="openstack/nova-metadata-0" Dec 04 12:24:00.709720 master-0 kubenswrapper[35367]: I1204 12:24:00.709553 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n5qmg\" (UniqueName: \"kubernetes.io/projected/82078196-d1e2-4240-bce7-f95e0f1e3a04-kube-api-access-n5qmg\") pod \"nova-cell1-conductor-0\" (UID: \"82078196-d1e2-4240-bce7-f95e0f1e3a04\") " pod="openstack/nova-cell1-conductor-0" Dec 04 12:24:00.714336 master-0 kubenswrapper[35367]: I1204 12:24:00.713839 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82078196-d1e2-4240-bce7-f95e0f1e3a04-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"82078196-d1e2-4240-bce7-f95e0f1e3a04\") " pod="openstack/nova-cell1-conductor-0" Dec 04 12:24:00.715139 master-0 kubenswrapper[35367]: I1204 12:24:00.715069 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8dtn\" (UniqueName: \"kubernetes.io/projected/46e5cf34-acb7-41c5-acf4-45bfdc3b1051-kube-api-access-n8dtn\") pod \"nova-scheduler-0\" (UID: \"46e5cf34-acb7-41c5-acf4-45bfdc3b1051\") " pod="openstack/nova-scheduler-0" Dec 04 12:24:00.715428 master-0 kubenswrapper[35367]: I1204 12:24:00.715403 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46e5cf34-acb7-41c5-acf4-45bfdc3b1051-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"46e5cf34-acb7-41c5-acf4-45bfdc3b1051\") " pod="openstack/nova-scheduler-0" Dec 04 12:24:00.715640 master-0 kubenswrapper[35367]: I1204 12:24:00.715619 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48092d7d-03c3-4ffe-92b1-34ade239b127-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"48092d7d-03c3-4ffe-92b1-34ade239b127\") " pod="openstack/nova-metadata-0" Dec 04 12:24:00.715939 master-0 kubenswrapper[35367]: I1204 12:24:00.715915 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/82078196-d1e2-4240-bce7-f95e0f1e3a04-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"82078196-d1e2-4240-bce7-f95e0f1e3a04\") " pod="openstack/nova-cell1-conductor-0" Dec 04 12:24:00.716839 master-0 kubenswrapper[35367]: I1204 12:24:00.716738 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll2rr\" (UniqueName: \"kubernetes.io/projected/48092d7d-03c3-4ffe-92b1-34ade239b127-kube-api-access-ll2rr\") pod \"nova-metadata-0\" (UID: \"48092d7d-03c3-4ffe-92b1-34ade239b127\") " pod="openstack/nova-metadata-0" Dec 04 12:24:00.724469 master-0 kubenswrapper[35367]: I1204 12:24:00.724314 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/82078196-d1e2-4240-bce7-f95e0f1e3a04-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"82078196-d1e2-4240-bce7-f95e0f1e3a04\") " pod="openstack/nova-cell1-conductor-0" Dec 04 12:24:00.752038 master-0 kubenswrapper[35367]: I1204 12:24:00.751649 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5qmg\" (UniqueName: \"kubernetes.io/projected/82078196-d1e2-4240-bce7-f95e0f1e3a04-kube-api-access-n5qmg\") pod \"nova-cell1-conductor-0\" (UID: \"82078196-d1e2-4240-bce7-f95e0f1e3a04\") " pod="openstack/nova-cell1-conductor-0" Dec 04 12:24:00.769366 master-0 kubenswrapper[35367]: I1204 12:24:00.769288 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f724182-33cd-49f0-9815-f8675fb7dfd9" path="/var/lib/kubelet/pods/1f724182-33cd-49f0-9815-f8675fb7dfd9/volumes" Dec 04 12:24:00.770181 master-0 kubenswrapper[35367]: I1204 12:24:00.770136 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d" path="/var/lib/kubelet/pods/50cc9cbc-57d5-4458-8bbf-ad2ae3028c0d/volumes" Dec 04 12:24:00.820894 master-0 kubenswrapper[35367]: I1204 12:24:00.820827 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/48092d7d-03c3-4ffe-92b1-34ade239b127-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"48092d7d-03c3-4ffe-92b1-34ade239b127\") " pod="openstack/nova-metadata-0" Dec 04 12:24:00.821267 master-0 kubenswrapper[35367]: I1204 12:24:00.821238 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46e5cf34-acb7-41c5-acf4-45bfdc3b1051-config-data\") pod \"nova-scheduler-0\" (UID: \"46e5cf34-acb7-41c5-acf4-45bfdc3b1051\") " pod="openstack/nova-scheduler-0" Dec 04 12:24:00.821434 master-0 kubenswrapper[35367]: I1204 12:24:00.821410 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/48092d7d-03c3-4ffe-92b1-34ade239b127-logs\") pod \"nova-metadata-0\" (UID: \"48092d7d-03c3-4ffe-92b1-34ade239b127\") " pod="openstack/nova-metadata-0" Dec 04 12:24:00.821582 master-0 kubenswrapper[35367]: I1204 12:24:00.821563 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48092d7d-03c3-4ffe-92b1-34ade239b127-config-data\") pod \"nova-metadata-0\" (UID: \"48092d7d-03c3-4ffe-92b1-34ade239b127\") " pod="openstack/nova-metadata-0" Dec 04 12:24:00.822872 master-0 kubenswrapper[35367]: I1204 12:24:00.822820 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n8dtn\" (UniqueName: \"kubernetes.io/projected/46e5cf34-acb7-41c5-acf4-45bfdc3b1051-kube-api-access-n8dtn\") pod \"nova-scheduler-0\" (UID: \"46e5cf34-acb7-41c5-acf4-45bfdc3b1051\") " pod="openstack/nova-scheduler-0" Dec 04 12:24:00.823081 master-0 kubenswrapper[35367]: I1204 12:24:00.823065 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46e5cf34-acb7-41c5-acf4-45bfdc3b1051-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"46e5cf34-acb7-41c5-acf4-45bfdc3b1051\") " pod="openstack/nova-scheduler-0" Dec 04 12:24:00.823212 master-0 kubenswrapper[35367]: I1204 12:24:00.823198 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48092d7d-03c3-4ffe-92b1-34ade239b127-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"48092d7d-03c3-4ffe-92b1-34ade239b127\") " pod="openstack/nova-metadata-0" Dec 04 12:24:00.823478 master-0 kubenswrapper[35367]: I1204 12:24:00.823431 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/48092d7d-03c3-4ffe-92b1-34ade239b127-logs\") pod \"nova-metadata-0\" (UID: \"48092d7d-03c3-4ffe-92b1-34ade239b127\") " pod="openstack/nova-metadata-0" Dec 04 12:24:00.823546 master-0 kubenswrapper[35367]: I1204 12:24:00.823467 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ll2rr\" (UniqueName: \"kubernetes.io/projected/48092d7d-03c3-4ffe-92b1-34ade239b127-kube-api-access-ll2rr\") pod \"nova-metadata-0\" (UID: \"48092d7d-03c3-4ffe-92b1-34ade239b127\") " pod="openstack/nova-metadata-0" Dec 04 12:24:00.824964 master-0 kubenswrapper[35367]: I1204 12:24:00.824884 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/48092d7d-03c3-4ffe-92b1-34ade239b127-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"48092d7d-03c3-4ffe-92b1-34ade239b127\") " pod="openstack/nova-metadata-0" Dec 04 12:24:00.826876 master-0 kubenswrapper[35367]: I1204 12:24:00.826752 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46e5cf34-acb7-41c5-acf4-45bfdc3b1051-config-data\") pod \"nova-scheduler-0\" (UID: \"46e5cf34-acb7-41c5-acf4-45bfdc3b1051\") " pod="openstack/nova-scheduler-0" Dec 04 12:24:00.828596 master-0 kubenswrapper[35367]: I1204 12:24:00.828087 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48092d7d-03c3-4ffe-92b1-34ade239b127-config-data\") pod \"nova-metadata-0\" (UID: \"48092d7d-03c3-4ffe-92b1-34ade239b127\") " pod="openstack/nova-metadata-0" Dec 04 12:24:00.831018 master-0 kubenswrapper[35367]: I1204 12:24:00.829254 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48092d7d-03c3-4ffe-92b1-34ade239b127-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"48092d7d-03c3-4ffe-92b1-34ade239b127\") " pod="openstack/nova-metadata-0" Dec 04 12:24:00.831468 master-0 kubenswrapper[35367]: I1204 12:24:00.831357 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46e5cf34-acb7-41c5-acf4-45bfdc3b1051-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"46e5cf34-acb7-41c5-acf4-45bfdc3b1051\") " pod="openstack/nova-scheduler-0" Dec 04 12:24:00.844703 master-0 kubenswrapper[35367]: I1204 12:24:00.844652 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll2rr\" (UniqueName: \"kubernetes.io/projected/48092d7d-03c3-4ffe-92b1-34ade239b127-kube-api-access-ll2rr\") pod \"nova-metadata-0\" (UID: \"48092d7d-03c3-4ffe-92b1-34ade239b127\") " pod="openstack/nova-metadata-0" Dec 04 12:24:00.846580 master-0 kubenswrapper[35367]: I1204 12:24:00.846538 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8dtn\" (UniqueName: \"kubernetes.io/projected/46e5cf34-acb7-41c5-acf4-45bfdc3b1051-kube-api-access-n8dtn\") pod \"nova-scheduler-0\" (UID: \"46e5cf34-acb7-41c5-acf4-45bfdc3b1051\") " pod="openstack/nova-scheduler-0" Dec 04 12:24:00.848784 master-0 kubenswrapper[35367]: I1204 12:24:00.848099 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-conductor-0" Dec 04 12:24:00.913737 master-0 kubenswrapper[35367]: I1204 12:24:00.913648 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 12:24:00.955836 master-0 kubenswrapper[35367]: I1204 12:24:00.954923 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-0" Dec 04 12:24:01.056536 master-0 kubenswrapper[35367]: I1204 12:24:01.055206 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 12:24:01.147209 master-0 kubenswrapper[35367]: I1204 12:24:01.131671 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11f7cf54-6506-41e8-8649-13383ca9bc5b-combined-ca-bundle\") pod \"11f7cf54-6506-41e8-8649-13383ca9bc5b\" (UID: \"11f7cf54-6506-41e8-8649-13383ca9bc5b\") " Dec 04 12:24:01.147209 master-0 kubenswrapper[35367]: I1204 12:24:01.131930 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/11f7cf54-6506-41e8-8649-13383ca9bc5b-logs\") pod \"11f7cf54-6506-41e8-8649-13383ca9bc5b\" (UID: \"11f7cf54-6506-41e8-8649-13383ca9bc5b\") " Dec 04 12:24:01.147209 master-0 kubenswrapper[35367]: I1204 12:24:01.132117 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9bqb\" (UniqueName: \"kubernetes.io/projected/11f7cf54-6506-41e8-8649-13383ca9bc5b-kube-api-access-d9bqb\") pod \"11f7cf54-6506-41e8-8649-13383ca9bc5b\" (UID: \"11f7cf54-6506-41e8-8649-13383ca9bc5b\") " Dec 04 12:24:01.147209 master-0 kubenswrapper[35367]: I1204 12:24:01.132357 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11f7cf54-6506-41e8-8649-13383ca9bc5b-config-data\") pod \"11f7cf54-6506-41e8-8649-13383ca9bc5b\" (UID: \"11f7cf54-6506-41e8-8649-13383ca9bc5b\") " Dec 04 12:24:01.147209 master-0 kubenswrapper[35367]: I1204 12:24:01.133145 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11f7cf54-6506-41e8-8649-13383ca9bc5b-logs" (OuterVolumeSpecName: "logs") pod "11f7cf54-6506-41e8-8649-13383ca9bc5b" (UID: "11f7cf54-6506-41e8-8649-13383ca9bc5b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:24:01.147209 master-0 kubenswrapper[35367]: I1204 12:24:01.134279 35367 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/11f7cf54-6506-41e8-8649-13383ca9bc5b-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:01.147209 master-0 kubenswrapper[35367]: I1204 12:24:01.143218 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11f7cf54-6506-41e8-8649-13383ca9bc5b-kube-api-access-d9bqb" (OuterVolumeSpecName: "kube-api-access-d9bqb") pod "11f7cf54-6506-41e8-8649-13383ca9bc5b" (UID: "11f7cf54-6506-41e8-8649-13383ca9bc5b"). InnerVolumeSpecName "kube-api-access-d9bqb". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:24:01.172638 master-0 kubenswrapper[35367]: I1204 12:24:01.172569 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f7cf54-6506-41e8-8649-13383ca9bc5b-config-data" (OuterVolumeSpecName: "config-data") pod "11f7cf54-6506-41e8-8649-13383ca9bc5b" (UID: "11f7cf54-6506-41e8-8649-13383ca9bc5b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:24:01.181849 master-0 kubenswrapper[35367]: I1204 12:24:01.181784 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f7cf54-6506-41e8-8649-13383ca9bc5b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "11f7cf54-6506-41e8-8649-13383ca9bc5b" (UID: "11f7cf54-6506-41e8-8649-13383ca9bc5b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:24:01.240131 master-0 kubenswrapper[35367]: I1204 12:24:01.239864 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d9bqb\" (UniqueName: \"kubernetes.io/projected/11f7cf54-6506-41e8-8649-13383ca9bc5b-kube-api-access-d9bqb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:01.240131 master-0 kubenswrapper[35367]: I1204 12:24:01.239930 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11f7cf54-6506-41e8-8649-13383ca9bc5b-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:01.240131 master-0 kubenswrapper[35367]: I1204 12:24:01.239943 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11f7cf54-6506-41e8-8649-13383ca9bc5b-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:01.510524 master-0 kubenswrapper[35367]: I1204 12:24:01.510354 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"11f7cf54-6506-41e8-8649-13383ca9bc5b","Type":"ContainerDied","Data":"87fb5915e5c236c1a77cee9008c9bd1aeedac75244ed57d0263e4e5c4fe51b2f"} Dec 04 12:24:01.510524 master-0 kubenswrapper[35367]: I1204 12:24:01.510434 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 12:24:01.510524 master-0 kubenswrapper[35367]: I1204 12:24:01.510468 35367 scope.go:117] "RemoveContainer" containerID="8422ec447e522f3cc3adabfe98a75f02bb4db0af699b916620f158aeb3b891cb" Dec 04 12:24:01.538705 master-0 kubenswrapper[35367]: I1204 12:24:01.538634 35367 scope.go:117] "RemoveContainer" containerID="54cf5f3c9931184cc2c004067d95edb41513a4d815d82499bf01aecb778a8fc0" Dec 04 12:24:01.654280 master-0 kubenswrapper[35367]: W1204 12:24:01.654196 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82078196_d1e2_4240_bce7_f95e0f1e3a04.slice/crio-87f03dd45cc0fa6e5a2645d55e95ad2aa4a1e4fd74c1e202505c0bd2e56c0a18 WatchSource:0}: Error finding container 87f03dd45cc0fa6e5a2645d55e95ad2aa4a1e4fd74c1e202505c0bd2e56c0a18: Status 404 returned error can't find the container with id 87f03dd45cc0fa6e5a2645d55e95ad2aa4a1e4fd74c1e202505c0bd2e56c0a18 Dec 04 12:24:01.661745 master-0 kubenswrapper[35367]: I1204 12:24:01.661673 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-conductor-0"] Dec 04 12:24:01.738740 master-0 kubenswrapper[35367]: I1204 12:24:01.738644 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 12:24:01.740219 master-0 kubenswrapper[35367]: W1204 12:24:01.740153 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46e5cf34_acb7_41c5_acf4_45bfdc3b1051.slice/crio-834825b973b4d9f323dd5c4acb4b23c390bb2ecbe0fc13802e3117e4cf341864 WatchSource:0}: Error finding container 834825b973b4d9f323dd5c4acb4b23c390bb2ecbe0fc13802e3117e4cf341864: Status 404 returned error can't find the container with id 834825b973b4d9f323dd5c4acb4b23c390bb2ecbe0fc13802e3117e4cf341864 Dec 04 12:24:01.751660 master-0 kubenswrapper[35367]: I1204 12:24:01.751587 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 12:24:01.772661 master-0 kubenswrapper[35367]: I1204 12:24:01.772601 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-api-0"] Dec 04 12:24:01.800374 master-0 kubenswrapper[35367]: I1204 12:24:01.800300 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-api-0"] Dec 04 12:24:01.889488 master-0 kubenswrapper[35367]: I1204 12:24:01.888363 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-api-0"] Dec 04 12:24:01.890555 master-0 kubenswrapper[35367]: E1204 12:24:01.890119 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="11f7cf54-6506-41e8-8649-13383ca9bc5b" containerName="nova-api-api" Dec 04 12:24:01.890555 master-0 kubenswrapper[35367]: I1204 12:24:01.890147 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f7cf54-6506-41e8-8649-13383ca9bc5b" containerName="nova-api-api" Dec 04 12:24:01.890555 master-0 kubenswrapper[35367]: E1204 12:24:01.890217 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="11f7cf54-6506-41e8-8649-13383ca9bc5b" containerName="nova-api-log" Dec 04 12:24:01.890555 master-0 kubenswrapper[35367]: I1204 12:24:01.890225 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f7cf54-6506-41e8-8649-13383ca9bc5b" containerName="nova-api-log" Dec 04 12:24:01.891008 master-0 kubenswrapper[35367]: I1204 12:24:01.890981 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="11f7cf54-6506-41e8-8649-13383ca9bc5b" containerName="nova-api-api" Dec 04 12:24:01.891086 master-0 kubenswrapper[35367]: I1204 12:24:01.891019 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="11f7cf54-6506-41e8-8649-13383ca9bc5b" containerName="nova-api-log" Dec 04 12:24:01.894264 master-0 kubenswrapper[35367]: I1204 12:24:01.894208 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 12:24:01.898131 master-0 kubenswrapper[35367]: I1204 12:24:01.898082 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-api-config-data" Dec 04 12:24:01.962231 master-0 kubenswrapper[35367]: I1204 12:24:01.962153 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzkll\" (UniqueName: \"kubernetes.io/projected/9d6902cc-8aef-490c-8b15-d0d70267759f-kube-api-access-vzkll\") pod \"nova-api-0\" (UID: \"9d6902cc-8aef-490c-8b15-d0d70267759f\") " pod="openstack/nova-api-0" Dec 04 12:24:01.962545 master-0 kubenswrapper[35367]: I1204 12:24:01.962336 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d6902cc-8aef-490c-8b15-d0d70267759f-config-data\") pod \"nova-api-0\" (UID: \"9d6902cc-8aef-490c-8b15-d0d70267759f\") " pod="openstack/nova-api-0" Dec 04 12:24:01.962936 master-0 kubenswrapper[35367]: I1204 12:24:01.962699 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d6902cc-8aef-490c-8b15-d0d70267759f-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"9d6902cc-8aef-490c-8b15-d0d70267759f\") " pod="openstack/nova-api-0" Dec 04 12:24:01.964236 master-0 kubenswrapper[35367]: I1204 12:24:01.964168 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9d6902cc-8aef-490c-8b15-d0d70267759f-logs\") pod \"nova-api-0\" (UID: \"9d6902cc-8aef-490c-8b15-d0d70267759f\") " pod="openstack/nova-api-0" Dec 04 12:24:01.982621 master-0 kubenswrapper[35367]: I1204 12:24:01.982535 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-0"] Dec 04 12:24:02.066791 master-0 kubenswrapper[35367]: I1204 12:24:02.066705 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vzkll\" (UniqueName: \"kubernetes.io/projected/9d6902cc-8aef-490c-8b15-d0d70267759f-kube-api-access-vzkll\") pod \"nova-api-0\" (UID: \"9d6902cc-8aef-490c-8b15-d0d70267759f\") " pod="openstack/nova-api-0" Dec 04 12:24:02.067106 master-0 kubenswrapper[35367]: I1204 12:24:02.066852 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d6902cc-8aef-490c-8b15-d0d70267759f-config-data\") pod \"nova-api-0\" (UID: \"9d6902cc-8aef-490c-8b15-d0d70267759f\") " pod="openstack/nova-api-0" Dec 04 12:24:02.067106 master-0 kubenswrapper[35367]: I1204 12:24:02.066943 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d6902cc-8aef-490c-8b15-d0d70267759f-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"9d6902cc-8aef-490c-8b15-d0d70267759f\") " pod="openstack/nova-api-0" Dec 04 12:24:02.067933 master-0 kubenswrapper[35367]: I1204 12:24:02.067477 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9d6902cc-8aef-490c-8b15-d0d70267759f-logs\") pod \"nova-api-0\" (UID: \"9d6902cc-8aef-490c-8b15-d0d70267759f\") " pod="openstack/nova-api-0" Dec 04 12:24:02.068976 master-0 kubenswrapper[35367]: I1204 12:24:02.068403 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9d6902cc-8aef-490c-8b15-d0d70267759f-logs\") pod \"nova-api-0\" (UID: \"9d6902cc-8aef-490c-8b15-d0d70267759f\") " pod="openstack/nova-api-0" Dec 04 12:24:02.071456 master-0 kubenswrapper[35367]: I1204 12:24:02.071396 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d6902cc-8aef-490c-8b15-d0d70267759f-config-data\") pod \"nova-api-0\" (UID: \"9d6902cc-8aef-490c-8b15-d0d70267759f\") " pod="openstack/nova-api-0" Dec 04 12:24:02.072665 master-0 kubenswrapper[35367]: I1204 12:24:02.072609 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d6902cc-8aef-490c-8b15-d0d70267759f-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"9d6902cc-8aef-490c-8b15-d0d70267759f\") " pod="openstack/nova-api-0" Dec 04 12:24:02.092167 master-0 kubenswrapper[35367]: I1204 12:24:02.091952 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzkll\" (UniqueName: \"kubernetes.io/projected/9d6902cc-8aef-490c-8b15-d0d70267759f-kube-api-access-vzkll\") pod \"nova-api-0\" (UID: \"9d6902cc-8aef-490c-8b15-d0d70267759f\") " pod="openstack/nova-api-0" Dec 04 12:24:02.283315 master-0 kubenswrapper[35367]: I1204 12:24:02.283261 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 12:24:02.531496 master-0 kubenswrapper[35367]: I1204 12:24:02.531427 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"48092d7d-03c3-4ffe-92b1-34ade239b127","Type":"ContainerStarted","Data":"9eaf8ad50851067371ad49b6f0534313f62a0ee496e71257060981eba35d1ad9"} Dec 04 12:24:02.531496 master-0 kubenswrapper[35367]: I1204 12:24:02.531498 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"48092d7d-03c3-4ffe-92b1-34ade239b127","Type":"ContainerStarted","Data":"83dc5f3a40cf10893a6687ccccb07882c200a202ae90488af141539a000015b5"} Dec 04 12:24:02.540065 master-0 kubenswrapper[35367]: I1204 12:24:02.539996 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-0" event={"ID":"46e5cf34-acb7-41c5-acf4-45bfdc3b1051","Type":"ContainerStarted","Data":"7b70eda49845092233b0b8884b1d0bb50b32ae874fc21a7ac62b2382cd51ee73"} Dec 04 12:24:02.540065 master-0 kubenswrapper[35367]: I1204 12:24:02.540064 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-0" event={"ID":"46e5cf34-acb7-41c5-acf4-45bfdc3b1051","Type":"ContainerStarted","Data":"834825b973b4d9f323dd5c4acb4b23c390bb2ecbe0fc13802e3117e4cf341864"} Dec 04 12:24:02.543073 master-0 kubenswrapper[35367]: I1204 12:24:02.543004 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-conductor-0" event={"ID":"82078196-d1e2-4240-bce7-f95e0f1e3a04","Type":"ContainerStarted","Data":"72f424ce36663531d914a94dda504a2e65f33a6bb70ed2ffd2b489fb5f09da41"} Dec 04 12:24:02.543233 master-0 kubenswrapper[35367]: I1204 12:24:02.543217 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-cell1-conductor-0" Dec 04 12:24:02.543322 master-0 kubenswrapper[35367]: I1204 12:24:02.543308 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-conductor-0" event={"ID":"82078196-d1e2-4240-bce7-f95e0f1e3a04","Type":"ContainerStarted","Data":"87f03dd45cc0fa6e5a2645d55e95ad2aa4a1e4fd74c1e202505c0bd2e56c0a18"} Dec 04 12:24:02.574230 master-0 kubenswrapper[35367]: I1204 12:24:02.573972 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-scheduler-0" podStartSLOduration=2.5739425970000003 podStartE2EDuration="2.573942597s" podCreationTimestamp="2025-12-04 12:24:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:24:02.560743787 +0000 UTC m=+1485.998805045" watchObservedRunningTime="2025-12-04 12:24:02.573942597 +0000 UTC m=+1486.012003875" Dec 04 12:24:02.604964 master-0 kubenswrapper[35367]: I1204 12:24:02.604856 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell1-conductor-0" podStartSLOduration=2.604828839 podStartE2EDuration="2.604828839s" podCreationTimestamp="2025-12-04 12:24:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:24:02.588020645 +0000 UTC m=+1486.026081913" watchObservedRunningTime="2025-12-04 12:24:02.604828839 +0000 UTC m=+1486.042890117" Dec 04 12:24:02.771829 master-0 kubenswrapper[35367]: I1204 12:24:02.771742 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11f7cf54-6506-41e8-8649-13383ca9bc5b" path="/var/lib/kubelet/pods/11f7cf54-6506-41e8-8649-13383ca9bc5b/volumes" Dec 04 12:24:02.844576 master-0 kubenswrapper[35367]: I1204 12:24:02.844484 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-0"] Dec 04 12:24:03.561948 master-0 kubenswrapper[35367]: I1204 12:24:03.561866 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"48092d7d-03c3-4ffe-92b1-34ade239b127","Type":"ContainerStarted","Data":"4acb0c53fd969f2a07fbaed27d57bb227241ca9e652a5f7da9abc02ec8385c6f"} Dec 04 12:24:03.566927 master-0 kubenswrapper[35367]: I1204 12:24:03.566860 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"9d6902cc-8aef-490c-8b15-d0d70267759f","Type":"ContainerStarted","Data":"72d14e54bce2243c2e8edc3fd25d4e445f36164f8d40e4967aed7580d8c4bd5c"} Dec 04 12:24:03.566999 master-0 kubenswrapper[35367]: I1204 12:24:03.566937 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"9d6902cc-8aef-490c-8b15-d0d70267759f","Type":"ContainerStarted","Data":"8860e6b9f17efd27a8c9c15863605858fc389267f8b5422889877b727c5e2e18"} Dec 04 12:24:03.566999 master-0 kubenswrapper[35367]: I1204 12:24:03.566950 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"9d6902cc-8aef-490c-8b15-d0d70267759f","Type":"ContainerStarted","Data":"e5ff3197a553148a9ad03036cc38e6d8b239c780614388e167ab8dfa20a46c40"} Dec 04 12:24:03.588633 master-0 kubenswrapper[35367]: I1204 12:24:03.588522 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-metadata-0" podStartSLOduration=3.588497927 podStartE2EDuration="3.588497927s" podCreationTimestamp="2025-12-04 12:24:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:24:03.584867781 +0000 UTC m=+1487.022929039" watchObservedRunningTime="2025-12-04 12:24:03.588497927 +0000 UTC m=+1487.026559195" Dec 04 12:24:03.616741 master-0 kubenswrapper[35367]: I1204 12:24:03.616626 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-api-0" podStartSLOduration=2.61659679 podStartE2EDuration="2.61659679s" podCreationTimestamp="2025-12-04 12:24:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:24:03.607716528 +0000 UTC m=+1487.045777786" watchObservedRunningTime="2025-12-04 12:24:03.61659679 +0000 UTC m=+1487.054658048" Dec 04 12:24:05.914488 master-0 kubenswrapper[35367]: I1204 12:24:05.914395 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-metadata-0" Dec 04 12:24:05.914488 master-0 kubenswrapper[35367]: I1204 12:24:05.914483 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-metadata-0" Dec 04 12:24:05.957016 master-0 kubenswrapper[35367]: I1204 12:24:05.956924 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-scheduler-0" Dec 04 12:24:10.887497 master-0 kubenswrapper[35367]: I1204 12:24:10.887360 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-cell1-conductor-0" Dec 04 12:24:10.915952 master-0 kubenswrapper[35367]: I1204 12:24:10.915837 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-metadata-0" Dec 04 12:24:10.915952 master-0 kubenswrapper[35367]: I1204 12:24:10.915914 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-metadata-0" Dec 04 12:24:10.957017 master-0 kubenswrapper[35367]: I1204 12:24:10.956919 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-scheduler-0" Dec 04 12:24:10.995784 master-0 kubenswrapper[35367]: I1204 12:24:10.995485 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-scheduler-0" Dec 04 12:24:11.736521 master-0 kubenswrapper[35367]: I1204 12:24:11.735778 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-scheduler-0" Dec 04 12:24:11.934236 master-0 kubenswrapper[35367]: I1204 12:24:11.934068 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-metadata-0" podUID="48092d7d-03c3-4ffe-92b1-34ade239b127" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.128.1.39:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 12:24:11.934236 master-0 kubenswrapper[35367]: I1204 12:24:11.934086 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-metadata-0" podUID="48092d7d-03c3-4ffe-92b1-34ade239b127" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.128.1.39:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 12:24:12.283712 master-0 kubenswrapper[35367]: I1204 12:24:12.283639 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-api-0" Dec 04 12:24:12.283712 master-0 kubenswrapper[35367]: I1204 12:24:12.283719 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-api-0" Dec 04 12:24:13.366298 master-0 kubenswrapper[35367]: I1204 12:24:13.366180 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-api-0" podUID="9d6902cc-8aef-490c-8b15-d0d70267759f" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.128.1.41:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Dec 04 12:24:13.367091 master-0 kubenswrapper[35367]: I1204 12:24:13.366254 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-api-0" podUID="9d6902cc-8aef-490c-8b15-d0d70267759f" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.128.1.41:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Dec 04 12:24:16.493276 master-0 kubenswrapper[35367]: I1204 12:24:16.493216 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:16.624367 master-0 kubenswrapper[35367]: I1204 12:24:16.624291 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rk54g\" (UniqueName: \"kubernetes.io/projected/0a9a13ce-d71b-4a1c-bee3-24761d6716b5-kube-api-access-rk54g\") pod \"0a9a13ce-d71b-4a1c-bee3-24761d6716b5\" (UID: \"0a9a13ce-d71b-4a1c-bee3-24761d6716b5\") " Dec 04 12:24:16.624711 master-0 kubenswrapper[35367]: I1204 12:24:16.624605 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a9a13ce-d71b-4a1c-bee3-24761d6716b5-config-data\") pod \"0a9a13ce-d71b-4a1c-bee3-24761d6716b5\" (UID: \"0a9a13ce-d71b-4a1c-bee3-24761d6716b5\") " Dec 04 12:24:16.624770 master-0 kubenswrapper[35367]: I1204 12:24:16.624730 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a9a13ce-d71b-4a1c-bee3-24761d6716b5-combined-ca-bundle\") pod \"0a9a13ce-d71b-4a1c-bee3-24761d6716b5\" (UID: \"0a9a13ce-d71b-4a1c-bee3-24761d6716b5\") " Dec 04 12:24:16.628154 master-0 kubenswrapper[35367]: I1204 12:24:16.628079 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a9a13ce-d71b-4a1c-bee3-24761d6716b5-kube-api-access-rk54g" (OuterVolumeSpecName: "kube-api-access-rk54g") pod "0a9a13ce-d71b-4a1c-bee3-24761d6716b5" (UID: "0a9a13ce-d71b-4a1c-bee3-24761d6716b5"). InnerVolumeSpecName "kube-api-access-rk54g". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:24:16.658649 master-0 kubenswrapper[35367]: I1204 12:24:16.658372 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a9a13ce-d71b-4a1c-bee3-24761d6716b5-config-data" (OuterVolumeSpecName: "config-data") pod "0a9a13ce-d71b-4a1c-bee3-24761d6716b5" (UID: "0a9a13ce-d71b-4a1c-bee3-24761d6716b5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:24:16.667901 master-0 kubenswrapper[35367]: I1204 12:24:16.667828 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a9a13ce-d71b-4a1c-bee3-24761d6716b5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0a9a13ce-d71b-4a1c-bee3-24761d6716b5" (UID: "0a9a13ce-d71b-4a1c-bee3-24761d6716b5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:24:16.735953 master-0 kubenswrapper[35367]: I1204 12:24:16.735867 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a9a13ce-d71b-4a1c-bee3-24761d6716b5-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:16.735953 master-0 kubenswrapper[35367]: I1204 12:24:16.735916 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rk54g\" (UniqueName: \"kubernetes.io/projected/0a9a13ce-d71b-4a1c-bee3-24761d6716b5-kube-api-access-rk54g\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:16.735953 master-0 kubenswrapper[35367]: I1204 12:24:16.735937 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a9a13ce-d71b-4a1c-bee3-24761d6716b5-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:16.774557 master-0 kubenswrapper[35367]: I1204 12:24:16.774389 35367 generic.go:334] "Generic (PLEG): container finished" podID="0a9a13ce-d71b-4a1c-bee3-24761d6716b5" containerID="b3502e0a4f79a859b0a2893de2cfbd0998b706f946d4abf78d174d675f6eb817" exitCode=137 Dec 04 12:24:16.774557 master-0 kubenswrapper[35367]: I1204 12:24:16.774472 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-novncproxy-0" event={"ID":"0a9a13ce-d71b-4a1c-bee3-24761d6716b5","Type":"ContainerDied","Data":"b3502e0a4f79a859b0a2893de2cfbd0998b706f946d4abf78d174d675f6eb817"} Dec 04 12:24:16.774557 master-0 kubenswrapper[35367]: I1204 12:24:16.774510 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-novncproxy-0" event={"ID":"0a9a13ce-d71b-4a1c-bee3-24761d6716b5","Type":"ContainerDied","Data":"5b630f048c982b45f217202baff519deb7bc0a20e7e286af3e56ec5f8dc64626"} Dec 04 12:24:16.774557 master-0 kubenswrapper[35367]: I1204 12:24:16.774531 35367 scope.go:117] "RemoveContainer" containerID="b3502e0a4f79a859b0a2893de2cfbd0998b706f946d4abf78d174d675f6eb817" Dec 04 12:24:16.775122 master-0 kubenswrapper[35367]: I1204 12:24:16.774728 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:16.823536 master-0 kubenswrapper[35367]: I1204 12:24:16.821934 35367 scope.go:117] "RemoveContainer" containerID="b3502e0a4f79a859b0a2893de2cfbd0998b706f946d4abf78d174d675f6eb817" Dec 04 12:24:16.823536 master-0 kubenswrapper[35367]: E1204 12:24:16.823371 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3502e0a4f79a859b0a2893de2cfbd0998b706f946d4abf78d174d675f6eb817\": container with ID starting with b3502e0a4f79a859b0a2893de2cfbd0998b706f946d4abf78d174d675f6eb817 not found: ID does not exist" containerID="b3502e0a4f79a859b0a2893de2cfbd0998b706f946d4abf78d174d675f6eb817" Dec 04 12:24:16.823536 master-0 kubenswrapper[35367]: I1204 12:24:16.823402 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3502e0a4f79a859b0a2893de2cfbd0998b706f946d4abf78d174d675f6eb817"} err="failed to get container status \"b3502e0a4f79a859b0a2893de2cfbd0998b706f946d4abf78d174d675f6eb817\": rpc error: code = NotFound desc = could not find container \"b3502e0a4f79a859b0a2893de2cfbd0998b706f946d4abf78d174d675f6eb817\": container with ID starting with b3502e0a4f79a859b0a2893de2cfbd0998b706f946d4abf78d174d675f6eb817 not found: ID does not exist" Dec 04 12:24:16.848533 master-0 kubenswrapper[35367]: I1204 12:24:16.848429 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell1-novncproxy-0"] Dec 04 12:24:16.914970 master-0 kubenswrapper[35367]: I1204 12:24:16.914789 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-cell1-novncproxy-0"] Dec 04 12:24:16.937512 master-0 kubenswrapper[35367]: I1204 12:24:16.937380 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell1-novncproxy-0"] Dec 04 12:24:16.938419 master-0 kubenswrapper[35367]: E1204 12:24:16.938385 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0a9a13ce-d71b-4a1c-bee3-24761d6716b5" containerName="nova-cell1-novncproxy-novncproxy" Dec 04 12:24:16.938419 master-0 kubenswrapper[35367]: I1204 12:24:16.938412 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a9a13ce-d71b-4a1c-bee3-24761d6716b5" containerName="nova-cell1-novncproxy-novncproxy" Dec 04 12:24:16.938730 master-0 kubenswrapper[35367]: I1204 12:24:16.938708 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="0a9a13ce-d71b-4a1c-bee3-24761d6716b5" containerName="nova-cell1-novncproxy-novncproxy" Dec 04 12:24:16.939930 master-0 kubenswrapper[35367]: I1204 12:24:16.939904 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:16.943259 master-0 kubenswrapper[35367]: I1204 12:24:16.943214 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell1-novncproxy-config-data" Dec 04 12:24:16.943451 master-0 kubenswrapper[35367]: I1204 12:24:16.943230 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-novncproxy-cell1-public-svc" Dec 04 12:24:16.944412 master-0 kubenswrapper[35367]: I1204 12:24:16.943873 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-novncproxy-cell1-vencrypt" Dec 04 12:24:16.952793 master-0 kubenswrapper[35367]: I1204 12:24:16.952721 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-novncproxy-0"] Dec 04 12:24:17.045707 master-0 kubenswrapper[35367]: I1204 12:24:17.045611 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/831da78f-580e-4cfe-8869-1aac0a5bf016-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"831da78f-580e-4cfe-8869-1aac0a5bf016\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:17.046039 master-0 kubenswrapper[35367]: I1204 12:24:17.045855 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/831da78f-580e-4cfe-8869-1aac0a5bf016-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"831da78f-580e-4cfe-8869-1aac0a5bf016\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:17.046387 master-0 kubenswrapper[35367]: I1204 12:24:17.046301 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/831da78f-580e-4cfe-8869-1aac0a5bf016-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"831da78f-580e-4cfe-8869-1aac0a5bf016\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:17.046489 master-0 kubenswrapper[35367]: I1204 12:24:17.046458 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/831da78f-580e-4cfe-8869-1aac0a5bf016-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"831da78f-580e-4cfe-8869-1aac0a5bf016\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:17.046621 master-0 kubenswrapper[35367]: I1204 12:24:17.046593 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvgn9\" (UniqueName: \"kubernetes.io/projected/831da78f-580e-4cfe-8869-1aac0a5bf016-kube-api-access-bvgn9\") pod \"nova-cell1-novncproxy-0\" (UID: \"831da78f-580e-4cfe-8869-1aac0a5bf016\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:17.148800 master-0 kubenswrapper[35367]: I1204 12:24:17.148719 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/831da78f-580e-4cfe-8869-1aac0a5bf016-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"831da78f-580e-4cfe-8869-1aac0a5bf016\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:17.149081 master-0 kubenswrapper[35367]: I1204 12:24:17.148913 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/831da78f-580e-4cfe-8869-1aac0a5bf016-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"831da78f-580e-4cfe-8869-1aac0a5bf016\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:17.149081 master-0 kubenswrapper[35367]: I1204 12:24:17.148950 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/831da78f-580e-4cfe-8869-1aac0a5bf016-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"831da78f-580e-4cfe-8869-1aac0a5bf016\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:17.149296 master-0 kubenswrapper[35367]: I1204 12:24:17.149233 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bvgn9\" (UniqueName: \"kubernetes.io/projected/831da78f-580e-4cfe-8869-1aac0a5bf016-kube-api-access-bvgn9\") pod \"nova-cell1-novncproxy-0\" (UID: \"831da78f-580e-4cfe-8869-1aac0a5bf016\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:17.150345 master-0 kubenswrapper[35367]: I1204 12:24:17.149608 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/831da78f-580e-4cfe-8869-1aac0a5bf016-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"831da78f-580e-4cfe-8869-1aac0a5bf016\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:17.153514 master-0 kubenswrapper[35367]: I1204 12:24:17.153449 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/831da78f-580e-4cfe-8869-1aac0a5bf016-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"831da78f-580e-4cfe-8869-1aac0a5bf016\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:17.153821 master-0 kubenswrapper[35367]: I1204 12:24:17.153783 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/831da78f-580e-4cfe-8869-1aac0a5bf016-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"831da78f-580e-4cfe-8869-1aac0a5bf016\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:17.154257 master-0 kubenswrapper[35367]: I1204 12:24:17.154217 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/831da78f-580e-4cfe-8869-1aac0a5bf016-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"831da78f-580e-4cfe-8869-1aac0a5bf016\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:17.168537 master-0 kubenswrapper[35367]: I1204 12:24:17.168346 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/831da78f-580e-4cfe-8869-1aac0a5bf016-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"831da78f-580e-4cfe-8869-1aac0a5bf016\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:17.169193 master-0 kubenswrapper[35367]: I1204 12:24:17.169147 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvgn9\" (UniqueName: \"kubernetes.io/projected/831da78f-580e-4cfe-8869-1aac0a5bf016-kube-api-access-bvgn9\") pod \"nova-cell1-novncproxy-0\" (UID: \"831da78f-580e-4cfe-8869-1aac0a5bf016\") " pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:17.263546 master-0 kubenswrapper[35367]: I1204 12:24:17.263404 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:18.002142 master-0 kubenswrapper[35367]: I1204 12:24:18.002040 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-novncproxy-0"] Dec 04 12:24:18.765699 master-0 kubenswrapper[35367]: I1204 12:24:18.765633 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a9a13ce-d71b-4a1c-bee3-24761d6716b5" path="/var/lib/kubelet/pods/0a9a13ce-d71b-4a1c-bee3-24761d6716b5/volumes" Dec 04 12:24:18.829381 master-0 kubenswrapper[35367]: I1204 12:24:18.829317 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-novncproxy-0" event={"ID":"831da78f-580e-4cfe-8869-1aac0a5bf016","Type":"ContainerStarted","Data":"ad9e1ed70a7c14ff49358fa31b02f30a52689c381b855dae82c5272caebceb10"} Dec 04 12:24:18.829381 master-0 kubenswrapper[35367]: I1204 12:24:18.829373 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-novncproxy-0" event={"ID":"831da78f-580e-4cfe-8869-1aac0a5bf016","Type":"ContainerStarted","Data":"57e86ac6335b93165ffb4ceb3e7f1c3a60b1dcf3ef14cfecc524d11a615847a0"} Dec 04 12:24:18.883175 master-0 kubenswrapper[35367]: I1204 12:24:18.883043 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell1-novncproxy-0" podStartSLOduration=2.882953859 podStartE2EDuration="2.882953859s" podCreationTimestamp="2025-12-04 12:24:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:24:18.863746658 +0000 UTC m=+1502.301807936" watchObservedRunningTime="2025-12-04 12:24:18.882953859 +0000 UTC m=+1502.321015127" Dec 04 12:24:20.921986 master-0 kubenswrapper[35367]: I1204 12:24:20.921904 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-metadata-0" Dec 04 12:24:20.922628 master-0 kubenswrapper[35367]: I1204 12:24:20.922026 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-metadata-0" Dec 04 12:24:20.926731 master-0 kubenswrapper[35367]: I1204 12:24:20.926517 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-metadata-0" Dec 04 12:24:20.927844 master-0 kubenswrapper[35367]: I1204 12:24:20.927818 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-metadata-0" Dec 04 12:24:22.263737 master-0 kubenswrapper[35367]: I1204 12:24:22.263647 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:22.287456 master-0 kubenswrapper[35367]: I1204 12:24:22.287406 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-api-0" Dec 04 12:24:22.287695 master-0 kubenswrapper[35367]: I1204 12:24:22.287473 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-api-0" Dec 04 12:24:22.288228 master-0 kubenswrapper[35367]: I1204 12:24:22.288162 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-api-0" Dec 04 12:24:22.288318 master-0 kubenswrapper[35367]: I1204 12:24:22.288237 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-api-0" Dec 04 12:24:22.290185 master-0 kubenswrapper[35367]: I1204 12:24:22.290138 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-api-0" Dec 04 12:24:22.291179 master-0 kubenswrapper[35367]: I1204 12:24:22.291142 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-api-0" Dec 04 12:24:22.520528 master-0 kubenswrapper[35367]: I1204 12:24:22.517005 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-5f5f8f58b9-8zsms"] Dec 04 12:24:22.524988 master-0 kubenswrapper[35367]: I1204 12:24:22.523331 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:22.564339 master-0 kubenswrapper[35367]: I1204 12:24:22.564269 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-5f5f8f58b9-8zsms"] Dec 04 12:24:22.673957 master-0 kubenswrapper[35367]: I1204 12:24:22.673024 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6c633271-68c6-476b-9e97-1ed66605642e-dns-swift-storage-0\") pod \"dnsmasq-dns-5f5f8f58b9-8zsms\" (UID: \"6c633271-68c6-476b-9e97-1ed66605642e\") " pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:22.673957 master-0 kubenswrapper[35367]: I1204 12:24:22.673285 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/6c633271-68c6-476b-9e97-1ed66605642e-ovsdbserver-nb\") pod \"dnsmasq-dns-5f5f8f58b9-8zsms\" (UID: \"6c633271-68c6-476b-9e97-1ed66605642e\") " pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:22.673957 master-0 kubenswrapper[35367]: I1204 12:24:22.673352 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r7zj\" (UniqueName: \"kubernetes.io/projected/6c633271-68c6-476b-9e97-1ed66605642e-kube-api-access-4r7zj\") pod \"dnsmasq-dns-5f5f8f58b9-8zsms\" (UID: \"6c633271-68c6-476b-9e97-1ed66605642e\") " pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:22.673957 master-0 kubenswrapper[35367]: I1204 12:24:22.673719 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c633271-68c6-476b-9e97-1ed66605642e-config\") pod \"dnsmasq-dns-5f5f8f58b9-8zsms\" (UID: \"6c633271-68c6-476b-9e97-1ed66605642e\") " pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:22.673957 master-0 kubenswrapper[35367]: I1204 12:24:22.673956 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/6c633271-68c6-476b-9e97-1ed66605642e-ovsdbserver-sb\") pod \"dnsmasq-dns-5f5f8f58b9-8zsms\" (UID: \"6c633271-68c6-476b-9e97-1ed66605642e\") " pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:22.674606 master-0 kubenswrapper[35367]: I1204 12:24:22.674340 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/6c633271-68c6-476b-9e97-1ed66605642e-dns-svc\") pod \"dnsmasq-dns-5f5f8f58b9-8zsms\" (UID: \"6c633271-68c6-476b-9e97-1ed66605642e\") " pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:22.781354 master-0 kubenswrapper[35367]: I1204 12:24:22.780700 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/6c633271-68c6-476b-9e97-1ed66605642e-dns-svc\") pod \"dnsmasq-dns-5f5f8f58b9-8zsms\" (UID: \"6c633271-68c6-476b-9e97-1ed66605642e\") " pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:22.781354 master-0 kubenswrapper[35367]: I1204 12:24:22.781039 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6c633271-68c6-476b-9e97-1ed66605642e-dns-swift-storage-0\") pod \"dnsmasq-dns-5f5f8f58b9-8zsms\" (UID: \"6c633271-68c6-476b-9e97-1ed66605642e\") " pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:22.781354 master-0 kubenswrapper[35367]: I1204 12:24:22.781090 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/6c633271-68c6-476b-9e97-1ed66605642e-ovsdbserver-nb\") pod \"dnsmasq-dns-5f5f8f58b9-8zsms\" (UID: \"6c633271-68c6-476b-9e97-1ed66605642e\") " pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:22.786581 master-0 kubenswrapper[35367]: I1204 12:24:22.781634 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4r7zj\" (UniqueName: \"kubernetes.io/projected/6c633271-68c6-476b-9e97-1ed66605642e-kube-api-access-4r7zj\") pod \"dnsmasq-dns-5f5f8f58b9-8zsms\" (UID: \"6c633271-68c6-476b-9e97-1ed66605642e\") " pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:22.786581 master-0 kubenswrapper[35367]: I1204 12:24:22.781859 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c633271-68c6-476b-9e97-1ed66605642e-config\") pod \"dnsmasq-dns-5f5f8f58b9-8zsms\" (UID: \"6c633271-68c6-476b-9e97-1ed66605642e\") " pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:22.786581 master-0 kubenswrapper[35367]: I1204 12:24:22.781984 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/6c633271-68c6-476b-9e97-1ed66605642e-ovsdbserver-sb\") pod \"dnsmasq-dns-5f5f8f58b9-8zsms\" (UID: \"6c633271-68c6-476b-9e97-1ed66605642e\") " pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:22.786581 master-0 kubenswrapper[35367]: I1204 12:24:22.782163 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6c633271-68c6-476b-9e97-1ed66605642e-dns-swift-storage-0\") pod \"dnsmasq-dns-5f5f8f58b9-8zsms\" (UID: \"6c633271-68c6-476b-9e97-1ed66605642e\") " pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:22.786581 master-0 kubenswrapper[35367]: I1204 12:24:22.783373 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/6c633271-68c6-476b-9e97-1ed66605642e-ovsdbserver-nb\") pod \"dnsmasq-dns-5f5f8f58b9-8zsms\" (UID: \"6c633271-68c6-476b-9e97-1ed66605642e\") " pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:22.786581 master-0 kubenswrapper[35367]: I1204 12:24:22.783817 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/6c633271-68c6-476b-9e97-1ed66605642e-dns-svc\") pod \"dnsmasq-dns-5f5f8f58b9-8zsms\" (UID: \"6c633271-68c6-476b-9e97-1ed66605642e\") " pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:22.786581 master-0 kubenswrapper[35367]: I1204 12:24:22.785456 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c633271-68c6-476b-9e97-1ed66605642e-config\") pod \"dnsmasq-dns-5f5f8f58b9-8zsms\" (UID: \"6c633271-68c6-476b-9e97-1ed66605642e\") " pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:22.786581 master-0 kubenswrapper[35367]: I1204 12:24:22.786078 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/6c633271-68c6-476b-9e97-1ed66605642e-ovsdbserver-sb\") pod \"dnsmasq-dns-5f5f8f58b9-8zsms\" (UID: \"6c633271-68c6-476b-9e97-1ed66605642e\") " pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:22.826323 master-0 kubenswrapper[35367]: I1204 12:24:22.826230 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r7zj\" (UniqueName: \"kubernetes.io/projected/6c633271-68c6-476b-9e97-1ed66605642e-kube-api-access-4r7zj\") pod \"dnsmasq-dns-5f5f8f58b9-8zsms\" (UID: \"6c633271-68c6-476b-9e97-1ed66605642e\") " pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:22.883046 master-0 kubenswrapper[35367]: I1204 12:24:22.882963 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:23.397192 master-0 kubenswrapper[35367]: I1204 12:24:23.393422 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-5f5f8f58b9-8zsms"] Dec 04 12:24:23.948722 master-0 kubenswrapper[35367]: I1204 12:24:23.948541 35367 generic.go:334] "Generic (PLEG): container finished" podID="6c633271-68c6-476b-9e97-1ed66605642e" containerID="e2f75d603099b6e2ecdb0ef2cccc720efb2cea7ca923ec3a638891dc8b6ac111" exitCode=0 Dec 04 12:24:23.948722 master-0 kubenswrapper[35367]: I1204 12:24:23.948612 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" event={"ID":"6c633271-68c6-476b-9e97-1ed66605642e","Type":"ContainerDied","Data":"e2f75d603099b6e2ecdb0ef2cccc720efb2cea7ca923ec3a638891dc8b6ac111"} Dec 04 12:24:23.948722 master-0 kubenswrapper[35367]: I1204 12:24:23.948718 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" event={"ID":"6c633271-68c6-476b-9e97-1ed66605642e","Type":"ContainerStarted","Data":"541b11223e59c8d5607b638c93c49fe7054cb9c5d2f5223eb51aa81d76994274"} Dec 04 12:24:24.963663 master-0 kubenswrapper[35367]: I1204 12:24:24.963590 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" event={"ID":"6c633271-68c6-476b-9e97-1ed66605642e","Type":"ContainerStarted","Data":"5bc897970cf648b180297ebe0ba3d311ace8fdb5dc8f4d307492031b01ae6ca3"} Dec 04 12:24:24.964282 master-0 kubenswrapper[35367]: I1204 12:24:24.963747 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:25.035458 master-0 kubenswrapper[35367]: I1204 12:24:25.035349 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" podStartSLOduration=3.035324106 podStartE2EDuration="3.035324106s" podCreationTimestamp="2025-12-04 12:24:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:24:25.017623494 +0000 UTC m=+1508.455684762" watchObservedRunningTime="2025-12-04 12:24:25.035324106 +0000 UTC m=+1508.473385364" Dec 04 12:24:26.504321 master-0 kubenswrapper[35367]: I1204 12:24:26.504243 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-api-0"] Dec 04 12:24:26.505101 master-0 kubenswrapper[35367]: I1204 12:24:26.505049 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-api-0" podUID="9d6902cc-8aef-490c-8b15-d0d70267759f" containerName="nova-api-log" containerID="cri-o://8860e6b9f17efd27a8c9c15863605858fc389267f8b5422889877b727c5e2e18" gracePeriod=30 Dec 04 12:24:26.506265 master-0 kubenswrapper[35367]: I1204 12:24:26.506226 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-api-0" podUID="9d6902cc-8aef-490c-8b15-d0d70267759f" containerName="nova-api-api" containerID="cri-o://72d14e54bce2243c2e8edc3fd25d4e445f36164f8d40e4967aed7580d8c4bd5c" gracePeriod=30 Dec 04 12:24:27.012364 master-0 kubenswrapper[35367]: I1204 12:24:27.012293 35367 generic.go:334] "Generic (PLEG): container finished" podID="9d6902cc-8aef-490c-8b15-d0d70267759f" containerID="8860e6b9f17efd27a8c9c15863605858fc389267f8b5422889877b727c5e2e18" exitCode=143 Dec 04 12:24:27.012664 master-0 kubenswrapper[35367]: I1204 12:24:27.012377 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"9d6902cc-8aef-490c-8b15-d0d70267759f","Type":"ContainerDied","Data":"8860e6b9f17efd27a8c9c15863605858fc389267f8b5422889877b727c5e2e18"} Dec 04 12:24:27.264887 master-0 kubenswrapper[35367]: I1204 12:24:27.264690 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:27.285613 master-0 kubenswrapper[35367]: I1204 12:24:27.285510 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:28.042430 master-0 kubenswrapper[35367]: I1204 12:24:28.042330 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-cell1-novncproxy-0" Dec 04 12:24:28.268222 master-0 kubenswrapper[35367]: I1204 12:24:28.268069 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell1-cell-mapping-vtqc2"] Dec 04 12:24:28.271634 master-0 kubenswrapper[35367]: I1204 12:24:28.271564 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-cell-mapping-vtqc2" Dec 04 12:24:28.276933 master-0 kubenswrapper[35367]: I1204 12:24:28.276755 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell1-manage-scripts" Dec 04 12:24:28.276933 master-0 kubenswrapper[35367]: I1204 12:24:28.276792 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-cell1-manage-config-data" Dec 04 12:24:28.292153 master-0 kubenswrapper[35367]: I1204 12:24:28.285280 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell1-host-discover-m4jx6"] Dec 04 12:24:28.292153 master-0 kubenswrapper[35367]: I1204 12:24:28.287253 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-host-discover-m4jx6" Dec 04 12:24:28.304998 master-0 kubenswrapper[35367]: I1204 12:24:28.304643 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-cell-mapping-vtqc2"] Dec 04 12:24:28.320524 master-0 kubenswrapper[35367]: I1204 12:24:28.320456 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-host-discover-m4jx6"] Dec 04 12:24:28.467725 master-0 kubenswrapper[35367]: I1204 12:24:28.467663 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f7a714b4-e808-4495-bccf-77861918a169-scripts\") pod \"nova-cell1-host-discover-m4jx6\" (UID: \"f7a714b4-e808-4495-bccf-77861918a169\") " pod="openstack/nova-cell1-host-discover-m4jx6" Dec 04 12:24:28.468121 master-0 kubenswrapper[35367]: I1204 12:24:28.468096 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bwwh\" (UniqueName: \"kubernetes.io/projected/f7a714b4-e808-4495-bccf-77861918a169-kube-api-access-8bwwh\") pod \"nova-cell1-host-discover-m4jx6\" (UID: \"f7a714b4-e808-4495-bccf-77861918a169\") " pod="openstack/nova-cell1-host-discover-m4jx6" Dec 04 12:24:28.468376 master-0 kubenswrapper[35367]: I1204 12:24:28.468357 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7a714b4-e808-4495-bccf-77861918a169-config-data\") pod \"nova-cell1-host-discover-m4jx6\" (UID: \"f7a714b4-e808-4495-bccf-77861918a169\") " pod="openstack/nova-cell1-host-discover-m4jx6" Dec 04 12:24:28.468701 master-0 kubenswrapper[35367]: I1204 12:24:28.468685 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c8452b4-f20d-4519-a81f-358e8e447d6e-config-data\") pod \"nova-cell1-cell-mapping-vtqc2\" (UID: \"9c8452b4-f20d-4519-a81f-358e8e447d6e\") " pod="openstack/nova-cell1-cell-mapping-vtqc2" Dec 04 12:24:28.468869 master-0 kubenswrapper[35367]: I1204 12:24:28.468851 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7a714b4-e808-4495-bccf-77861918a169-combined-ca-bundle\") pod \"nova-cell1-host-discover-m4jx6\" (UID: \"f7a714b4-e808-4495-bccf-77861918a169\") " pod="openstack/nova-cell1-host-discover-m4jx6" Dec 04 12:24:28.469021 master-0 kubenswrapper[35367]: I1204 12:24:28.469006 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c8452b4-f20d-4519-a81f-358e8e447d6e-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-vtqc2\" (UID: \"9c8452b4-f20d-4519-a81f-358e8e447d6e\") " pod="openstack/nova-cell1-cell-mapping-vtqc2" Dec 04 12:24:28.469131 master-0 kubenswrapper[35367]: I1204 12:24:28.469112 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjtnm\" (UniqueName: \"kubernetes.io/projected/9c8452b4-f20d-4519-a81f-358e8e447d6e-kube-api-access-qjtnm\") pod \"nova-cell1-cell-mapping-vtqc2\" (UID: \"9c8452b4-f20d-4519-a81f-358e8e447d6e\") " pod="openstack/nova-cell1-cell-mapping-vtqc2" Dec 04 12:24:28.469588 master-0 kubenswrapper[35367]: I1204 12:24:28.469518 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9c8452b4-f20d-4519-a81f-358e8e447d6e-scripts\") pod \"nova-cell1-cell-mapping-vtqc2\" (UID: \"9c8452b4-f20d-4519-a81f-358e8e447d6e\") " pod="openstack/nova-cell1-cell-mapping-vtqc2" Dec 04 12:24:28.572255 master-0 kubenswrapper[35367]: I1204 12:24:28.572182 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9c8452b4-f20d-4519-a81f-358e8e447d6e-scripts\") pod \"nova-cell1-cell-mapping-vtqc2\" (UID: \"9c8452b4-f20d-4519-a81f-358e8e447d6e\") " pod="openstack/nova-cell1-cell-mapping-vtqc2" Dec 04 12:24:28.572741 master-0 kubenswrapper[35367]: I1204 12:24:28.572718 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f7a714b4-e808-4495-bccf-77861918a169-scripts\") pod \"nova-cell1-host-discover-m4jx6\" (UID: \"f7a714b4-e808-4495-bccf-77861918a169\") " pod="openstack/nova-cell1-host-discover-m4jx6" Dec 04 12:24:28.572976 master-0 kubenswrapper[35367]: I1204 12:24:28.572953 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8bwwh\" (UniqueName: \"kubernetes.io/projected/f7a714b4-e808-4495-bccf-77861918a169-kube-api-access-8bwwh\") pod \"nova-cell1-host-discover-m4jx6\" (UID: \"f7a714b4-e808-4495-bccf-77861918a169\") " pod="openstack/nova-cell1-host-discover-m4jx6" Dec 04 12:24:28.573181 master-0 kubenswrapper[35367]: I1204 12:24:28.573161 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7a714b4-e808-4495-bccf-77861918a169-config-data\") pod \"nova-cell1-host-discover-m4jx6\" (UID: \"f7a714b4-e808-4495-bccf-77861918a169\") " pod="openstack/nova-cell1-host-discover-m4jx6" Dec 04 12:24:28.573421 master-0 kubenswrapper[35367]: I1204 12:24:28.573400 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c8452b4-f20d-4519-a81f-358e8e447d6e-config-data\") pod \"nova-cell1-cell-mapping-vtqc2\" (UID: \"9c8452b4-f20d-4519-a81f-358e8e447d6e\") " pod="openstack/nova-cell1-cell-mapping-vtqc2" Dec 04 12:24:28.573575 master-0 kubenswrapper[35367]: I1204 12:24:28.573553 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7a714b4-e808-4495-bccf-77861918a169-combined-ca-bundle\") pod \"nova-cell1-host-discover-m4jx6\" (UID: \"f7a714b4-e808-4495-bccf-77861918a169\") " pod="openstack/nova-cell1-host-discover-m4jx6" Dec 04 12:24:28.573763 master-0 kubenswrapper[35367]: I1204 12:24:28.573739 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c8452b4-f20d-4519-a81f-358e8e447d6e-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-vtqc2\" (UID: \"9c8452b4-f20d-4519-a81f-358e8e447d6e\") " pod="openstack/nova-cell1-cell-mapping-vtqc2" Dec 04 12:24:28.573917 master-0 kubenswrapper[35367]: I1204 12:24:28.573896 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qjtnm\" (UniqueName: \"kubernetes.io/projected/9c8452b4-f20d-4519-a81f-358e8e447d6e-kube-api-access-qjtnm\") pod \"nova-cell1-cell-mapping-vtqc2\" (UID: \"9c8452b4-f20d-4519-a81f-358e8e447d6e\") " pod="openstack/nova-cell1-cell-mapping-vtqc2" Dec 04 12:24:28.576412 master-0 kubenswrapper[35367]: I1204 12:24:28.576364 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f7a714b4-e808-4495-bccf-77861918a169-scripts\") pod \"nova-cell1-host-discover-m4jx6\" (UID: \"f7a714b4-e808-4495-bccf-77861918a169\") " pod="openstack/nova-cell1-host-discover-m4jx6" Dec 04 12:24:28.577520 master-0 kubenswrapper[35367]: I1204 12:24:28.577496 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c8452b4-f20d-4519-a81f-358e8e447d6e-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-vtqc2\" (UID: \"9c8452b4-f20d-4519-a81f-358e8e447d6e\") " pod="openstack/nova-cell1-cell-mapping-vtqc2" Dec 04 12:24:28.577671 master-0 kubenswrapper[35367]: I1204 12:24:28.577639 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9c8452b4-f20d-4519-a81f-358e8e447d6e-scripts\") pod \"nova-cell1-cell-mapping-vtqc2\" (UID: \"9c8452b4-f20d-4519-a81f-358e8e447d6e\") " pod="openstack/nova-cell1-cell-mapping-vtqc2" Dec 04 12:24:28.578148 master-0 kubenswrapper[35367]: I1204 12:24:28.578104 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7a714b4-e808-4495-bccf-77861918a169-config-data\") pod \"nova-cell1-host-discover-m4jx6\" (UID: \"f7a714b4-e808-4495-bccf-77861918a169\") " pod="openstack/nova-cell1-host-discover-m4jx6" Dec 04 12:24:28.578602 master-0 kubenswrapper[35367]: I1204 12:24:28.578560 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c8452b4-f20d-4519-a81f-358e8e447d6e-config-data\") pod \"nova-cell1-cell-mapping-vtqc2\" (UID: \"9c8452b4-f20d-4519-a81f-358e8e447d6e\") " pod="openstack/nova-cell1-cell-mapping-vtqc2" Dec 04 12:24:28.578683 master-0 kubenswrapper[35367]: I1204 12:24:28.578584 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7a714b4-e808-4495-bccf-77861918a169-combined-ca-bundle\") pod \"nova-cell1-host-discover-m4jx6\" (UID: \"f7a714b4-e808-4495-bccf-77861918a169\") " pod="openstack/nova-cell1-host-discover-m4jx6" Dec 04 12:24:28.590656 master-0 kubenswrapper[35367]: I1204 12:24:28.590586 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjtnm\" (UniqueName: \"kubernetes.io/projected/9c8452b4-f20d-4519-a81f-358e8e447d6e-kube-api-access-qjtnm\") pod \"nova-cell1-cell-mapping-vtqc2\" (UID: \"9c8452b4-f20d-4519-a81f-358e8e447d6e\") " pod="openstack/nova-cell1-cell-mapping-vtqc2" Dec 04 12:24:28.594658 master-0 kubenswrapper[35367]: I1204 12:24:28.594614 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bwwh\" (UniqueName: \"kubernetes.io/projected/f7a714b4-e808-4495-bccf-77861918a169-kube-api-access-8bwwh\") pod \"nova-cell1-host-discover-m4jx6\" (UID: \"f7a714b4-e808-4495-bccf-77861918a169\") " pod="openstack/nova-cell1-host-discover-m4jx6" Dec 04 12:24:28.608963 master-0 kubenswrapper[35367]: I1204 12:24:28.608880 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-cell-mapping-vtqc2" Dec 04 12:24:28.630236 master-0 kubenswrapper[35367]: I1204 12:24:28.630150 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-host-discover-m4jx6" Dec 04 12:24:29.116265 master-0 kubenswrapper[35367]: I1204 12:24:29.116158 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-cell-mapping-vtqc2"] Dec 04 12:24:29.379218 master-0 kubenswrapper[35367]: I1204 12:24:29.379141 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell1-host-discover-m4jx6"] Dec 04 12:24:29.379709 master-0 kubenswrapper[35367]: W1204 12:24:29.379665 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7a714b4_e808_4495_bccf_77861918a169.slice/crio-311f0e8fc7f3f55682a231f93d162c57fd60b574ef8c1ded81b3d98605b5f15e WatchSource:0}: Error finding container 311f0e8fc7f3f55682a231f93d162c57fd60b574ef8c1ded81b3d98605b5f15e: Status 404 returned error can't find the container with id 311f0e8fc7f3f55682a231f93d162c57fd60b574ef8c1ded81b3d98605b5f15e Dec 04 12:24:30.104994 master-0 kubenswrapper[35367]: I1204 12:24:30.101153 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-cell-mapping-vtqc2" event={"ID":"9c8452b4-f20d-4519-a81f-358e8e447d6e","Type":"ContainerStarted","Data":"78ca7d97355f2402097bdc2ad25c88c58ea8b5d4c3e74ddeffddf016f18e01ac"} Dec 04 12:24:30.104994 master-0 kubenswrapper[35367]: I1204 12:24:30.101240 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-cell-mapping-vtqc2" event={"ID":"9c8452b4-f20d-4519-a81f-358e8e447d6e","Type":"ContainerStarted","Data":"64eb6e45cf4ec32353be14f47ea205f957209afbfe37243372ea96a6afa349bd"} Dec 04 12:24:30.107661 master-0 kubenswrapper[35367]: I1204 12:24:30.105746 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-host-discover-m4jx6" event={"ID":"f7a714b4-e808-4495-bccf-77861918a169","Type":"ContainerStarted","Data":"2fa0c9bb5cca192b9eeca44369821cb29a738cbe201da811ef3de7ba08c9f0e3"} Dec 04 12:24:30.107661 master-0 kubenswrapper[35367]: I1204 12:24:30.105818 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-host-discover-m4jx6" event={"ID":"f7a714b4-e808-4495-bccf-77861918a169","Type":"ContainerStarted","Data":"311f0e8fc7f3f55682a231f93d162c57fd60b574ef8c1ded81b3d98605b5f15e"} Dec 04 12:24:30.119779 master-0 kubenswrapper[35367]: I1204 12:24:30.119709 35367 generic.go:334] "Generic (PLEG): container finished" podID="9d6902cc-8aef-490c-8b15-d0d70267759f" containerID="72d14e54bce2243c2e8edc3fd25d4e445f36164f8d40e4967aed7580d8c4bd5c" exitCode=0 Dec 04 12:24:30.120345 master-0 kubenswrapper[35367]: I1204 12:24:30.119795 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"9d6902cc-8aef-490c-8b15-d0d70267759f","Type":"ContainerDied","Data":"72d14e54bce2243c2e8edc3fd25d4e445f36164f8d40e4967aed7580d8c4bd5c"} Dec 04 12:24:30.130783 master-0 kubenswrapper[35367]: I1204 12:24:30.130699 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell1-cell-mapping-vtqc2" podStartSLOduration=2.130679064 podStartE2EDuration="2.130679064s" podCreationTimestamp="2025-12-04 12:24:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:24:30.124363484 +0000 UTC m=+1513.562424752" watchObservedRunningTime="2025-12-04 12:24:30.130679064 +0000 UTC m=+1513.568740322" Dec 04 12:24:30.158577 master-0 kubenswrapper[35367]: I1204 12:24:30.158462 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-cell1-host-discover-m4jx6" podStartSLOduration=2.158443036 podStartE2EDuration="2.158443036s" podCreationTimestamp="2025-12-04 12:24:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:24:30.145668741 +0000 UTC m=+1513.583730019" watchObservedRunningTime="2025-12-04 12:24:30.158443036 +0000 UTC m=+1513.596504294" Dec 04 12:24:30.260355 master-0 kubenswrapper[35367]: I1204 12:24:30.260282 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 12:24:30.439465 master-0 kubenswrapper[35367]: I1204 12:24:30.438791 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d6902cc-8aef-490c-8b15-d0d70267759f-config-data\") pod \"9d6902cc-8aef-490c-8b15-d0d70267759f\" (UID: \"9d6902cc-8aef-490c-8b15-d0d70267759f\") " Dec 04 12:24:30.439465 master-0 kubenswrapper[35367]: I1204 12:24:30.439414 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d6902cc-8aef-490c-8b15-d0d70267759f-combined-ca-bundle\") pod \"9d6902cc-8aef-490c-8b15-d0d70267759f\" (UID: \"9d6902cc-8aef-490c-8b15-d0d70267759f\") " Dec 04 12:24:30.439774 master-0 kubenswrapper[35367]: I1204 12:24:30.439528 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzkll\" (UniqueName: \"kubernetes.io/projected/9d6902cc-8aef-490c-8b15-d0d70267759f-kube-api-access-vzkll\") pod \"9d6902cc-8aef-490c-8b15-d0d70267759f\" (UID: \"9d6902cc-8aef-490c-8b15-d0d70267759f\") " Dec 04 12:24:30.439774 master-0 kubenswrapper[35367]: I1204 12:24:30.439635 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9d6902cc-8aef-490c-8b15-d0d70267759f-logs\") pod \"9d6902cc-8aef-490c-8b15-d0d70267759f\" (UID: \"9d6902cc-8aef-490c-8b15-d0d70267759f\") " Dec 04 12:24:30.440917 master-0 kubenswrapper[35367]: I1204 12:24:30.440857 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d6902cc-8aef-490c-8b15-d0d70267759f-logs" (OuterVolumeSpecName: "logs") pod "9d6902cc-8aef-490c-8b15-d0d70267759f" (UID: "9d6902cc-8aef-490c-8b15-d0d70267759f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:24:30.447823 master-0 kubenswrapper[35367]: I1204 12:24:30.445206 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d6902cc-8aef-490c-8b15-d0d70267759f-kube-api-access-vzkll" (OuterVolumeSpecName: "kube-api-access-vzkll") pod "9d6902cc-8aef-490c-8b15-d0d70267759f" (UID: "9d6902cc-8aef-490c-8b15-d0d70267759f"). InnerVolumeSpecName "kube-api-access-vzkll". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:24:30.474671 master-0 kubenswrapper[35367]: I1204 12:24:30.473671 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d6902cc-8aef-490c-8b15-d0d70267759f-config-data" (OuterVolumeSpecName: "config-data") pod "9d6902cc-8aef-490c-8b15-d0d70267759f" (UID: "9d6902cc-8aef-490c-8b15-d0d70267759f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:24:30.475016 master-0 kubenswrapper[35367]: I1204 12:24:30.474876 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d6902cc-8aef-490c-8b15-d0d70267759f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9d6902cc-8aef-490c-8b15-d0d70267759f" (UID: "9d6902cc-8aef-490c-8b15-d0d70267759f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:24:30.550798 master-0 kubenswrapper[35367]: I1204 12:24:30.549779 35367 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9d6902cc-8aef-490c-8b15-d0d70267759f-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:30.550798 master-0 kubenswrapper[35367]: I1204 12:24:30.549882 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d6902cc-8aef-490c-8b15-d0d70267759f-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:30.550798 master-0 kubenswrapper[35367]: I1204 12:24:30.549949 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d6902cc-8aef-490c-8b15-d0d70267759f-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:30.550798 master-0 kubenswrapper[35367]: I1204 12:24:30.549990 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vzkll\" (UniqueName: \"kubernetes.io/projected/9d6902cc-8aef-490c-8b15-d0d70267759f-kube-api-access-vzkll\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:31.141175 master-0 kubenswrapper[35367]: I1204 12:24:31.141079 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"9d6902cc-8aef-490c-8b15-d0d70267759f","Type":"ContainerDied","Data":"e5ff3197a553148a9ad03036cc38e6d8b239c780614388e167ab8dfa20a46c40"} Dec 04 12:24:31.141175 master-0 kubenswrapper[35367]: I1204 12:24:31.141182 35367 scope.go:117] "RemoveContainer" containerID="72d14e54bce2243c2e8edc3fd25d4e445f36164f8d40e4967aed7580d8c4bd5c" Dec 04 12:24:31.143825 master-0 kubenswrapper[35367]: I1204 12:24:31.143762 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 12:24:31.179922 master-0 kubenswrapper[35367]: I1204 12:24:31.179733 35367 scope.go:117] "RemoveContainer" containerID="8860e6b9f17efd27a8c9c15863605858fc389267f8b5422889877b727c5e2e18" Dec 04 12:24:31.186072 master-0 kubenswrapper[35367]: I1204 12:24:31.186019 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-api-0"] Dec 04 12:24:31.203238 master-0 kubenswrapper[35367]: I1204 12:24:31.203129 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-api-0"] Dec 04 12:24:31.246290 master-0 kubenswrapper[35367]: I1204 12:24:31.243907 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-api-0"] Dec 04 12:24:31.246290 master-0 kubenswrapper[35367]: E1204 12:24:31.244703 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9d6902cc-8aef-490c-8b15-d0d70267759f" containerName="nova-api-api" Dec 04 12:24:31.246290 master-0 kubenswrapper[35367]: I1204 12:24:31.244723 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d6902cc-8aef-490c-8b15-d0d70267759f" containerName="nova-api-api" Dec 04 12:24:31.246290 master-0 kubenswrapper[35367]: E1204 12:24:31.244791 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9d6902cc-8aef-490c-8b15-d0d70267759f" containerName="nova-api-log" Dec 04 12:24:31.246290 master-0 kubenswrapper[35367]: I1204 12:24:31.244822 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d6902cc-8aef-490c-8b15-d0d70267759f" containerName="nova-api-log" Dec 04 12:24:31.246290 master-0 kubenswrapper[35367]: I1204 12:24:31.245244 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="9d6902cc-8aef-490c-8b15-d0d70267759f" containerName="nova-api-log" Dec 04 12:24:31.246290 master-0 kubenswrapper[35367]: I1204 12:24:31.245298 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="9d6902cc-8aef-490c-8b15-d0d70267759f" containerName="nova-api-api" Dec 04 12:24:31.247262 master-0 kubenswrapper[35367]: I1204 12:24:31.247168 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 12:24:31.252561 master-0 kubenswrapper[35367]: I1204 12:24:31.252492 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-api-config-data" Dec 04 12:24:31.252817 master-0 kubenswrapper[35367]: I1204 12:24:31.252737 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-internal-svc" Dec 04 12:24:31.253003 master-0 kubenswrapper[35367]: I1204 12:24:31.252977 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-public-svc" Dec 04 12:24:31.264031 master-0 kubenswrapper[35367]: I1204 12:24:31.263968 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-0"] Dec 04 12:24:31.280745 master-0 kubenswrapper[35367]: I1204 12:24:31.280664 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-config-data\") pod \"nova-api-0\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " pod="openstack/nova-api-0" Dec 04 12:24:31.281047 master-0 kubenswrapper[35367]: I1204 12:24:31.281005 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " pod="openstack/nova-api-0" Dec 04 12:24:31.281312 master-0 kubenswrapper[35367]: I1204 12:24:31.281218 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xgqm\" (UniqueName: \"kubernetes.io/projected/2ea1e7a2-77eb-4694-a0db-8f912e74591b-kube-api-access-6xgqm\") pod \"nova-api-0\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " pod="openstack/nova-api-0" Dec 04 12:24:31.281366 master-0 kubenswrapper[35367]: I1204 12:24:31.281353 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2ea1e7a2-77eb-4694-a0db-8f912e74591b-logs\") pod \"nova-api-0\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " pod="openstack/nova-api-0" Dec 04 12:24:31.281458 master-0 kubenswrapper[35367]: I1204 12:24:31.281433 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-public-tls-certs\") pod \"nova-api-0\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " pod="openstack/nova-api-0" Dec 04 12:24:31.281679 master-0 kubenswrapper[35367]: I1204 12:24:31.281649 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-internal-tls-certs\") pod \"nova-api-0\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " pod="openstack/nova-api-0" Dec 04 12:24:31.384202 master-0 kubenswrapper[35367]: I1204 12:24:31.384118 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-public-tls-certs\") pod \"nova-api-0\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " pod="openstack/nova-api-0" Dec 04 12:24:31.384476 master-0 kubenswrapper[35367]: I1204 12:24:31.384295 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-internal-tls-certs\") pod \"nova-api-0\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " pod="openstack/nova-api-0" Dec 04 12:24:31.384525 master-0 kubenswrapper[35367]: I1204 12:24:31.384509 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-config-data\") pod \"nova-api-0\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " pod="openstack/nova-api-0" Dec 04 12:24:31.384693 master-0 kubenswrapper[35367]: I1204 12:24:31.384665 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " pod="openstack/nova-api-0" Dec 04 12:24:31.385426 master-0 kubenswrapper[35367]: I1204 12:24:31.385398 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6xgqm\" (UniqueName: \"kubernetes.io/projected/2ea1e7a2-77eb-4694-a0db-8f912e74591b-kube-api-access-6xgqm\") pod \"nova-api-0\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " pod="openstack/nova-api-0" Dec 04 12:24:31.385524 master-0 kubenswrapper[35367]: I1204 12:24:31.385500 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2ea1e7a2-77eb-4694-a0db-8f912e74591b-logs\") pod \"nova-api-0\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " pod="openstack/nova-api-0" Dec 04 12:24:31.385954 master-0 kubenswrapper[35367]: I1204 12:24:31.385905 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2ea1e7a2-77eb-4694-a0db-8f912e74591b-logs\") pod \"nova-api-0\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " pod="openstack/nova-api-0" Dec 04 12:24:31.388689 master-0 kubenswrapper[35367]: I1204 12:24:31.388611 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-internal-tls-certs\") pod \"nova-api-0\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " pod="openstack/nova-api-0" Dec 04 12:24:31.389536 master-0 kubenswrapper[35367]: I1204 12:24:31.389469 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " pod="openstack/nova-api-0" Dec 04 12:24:31.389938 master-0 kubenswrapper[35367]: I1204 12:24:31.389918 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-public-tls-certs\") pod \"nova-api-0\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " pod="openstack/nova-api-0" Dec 04 12:24:31.402921 master-0 kubenswrapper[35367]: I1204 12:24:31.402675 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-config-data\") pod \"nova-api-0\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " pod="openstack/nova-api-0" Dec 04 12:24:31.404992 master-0 kubenswrapper[35367]: I1204 12:24:31.404941 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xgqm\" (UniqueName: \"kubernetes.io/projected/2ea1e7a2-77eb-4694-a0db-8f912e74591b-kube-api-access-6xgqm\") pod \"nova-api-0\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " pod="openstack/nova-api-0" Dec 04 12:24:31.582171 master-0 kubenswrapper[35367]: I1204 12:24:31.582079 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 12:24:32.113341 master-0 kubenswrapper[35367]: I1204 12:24:32.113272 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-0"] Dec 04 12:24:32.113901 master-0 kubenswrapper[35367]: W1204 12:24:32.113840 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ea1e7a2_77eb_4694_a0db_8f912e74591b.slice/crio-e45ac17bf0ca635d3bcac48a9c06cb957707032206d64cdd976b3c19904b0fc4 WatchSource:0}: Error finding container e45ac17bf0ca635d3bcac48a9c06cb957707032206d64cdd976b3c19904b0fc4: Status 404 returned error can't find the container with id e45ac17bf0ca635d3bcac48a9c06cb957707032206d64cdd976b3c19904b0fc4 Dec 04 12:24:32.157562 master-0 kubenswrapper[35367]: I1204 12:24:32.157481 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"2ea1e7a2-77eb-4694-a0db-8f912e74591b","Type":"ContainerStarted","Data":"e45ac17bf0ca635d3bcac48a9c06cb957707032206d64cdd976b3c19904b0fc4"} Dec 04 12:24:32.769916 master-0 kubenswrapper[35367]: I1204 12:24:32.769846 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d6902cc-8aef-490c-8b15-d0d70267759f" path="/var/lib/kubelet/pods/9d6902cc-8aef-490c-8b15-d0d70267759f/volumes" Dec 04 12:24:32.885058 master-0 kubenswrapper[35367]: I1204 12:24:32.884977 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-5f5f8f58b9-8zsms" Dec 04 12:24:33.018920 master-0 kubenswrapper[35367]: I1204 12:24:33.013536 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-774bc94dc7-zjvc8"] Dec 04 12:24:33.018920 master-0 kubenswrapper[35367]: I1204 12:24:33.013859 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" podUID="ca969f2b-66d7-4470-af5d-b8f6531d6d67" containerName="dnsmasq-dns" containerID="cri-o://2b38949c91dc58166dba107a49f204cc2daaf4913c56badbdfd8256bfcf71830" gracePeriod=10 Dec 04 12:24:33.179024 master-0 kubenswrapper[35367]: I1204 12:24:33.178561 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"2ea1e7a2-77eb-4694-a0db-8f912e74591b","Type":"ContainerStarted","Data":"de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f"} Dec 04 12:24:33.179024 master-0 kubenswrapper[35367]: I1204 12:24:33.178750 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"2ea1e7a2-77eb-4694-a0db-8f912e74591b","Type":"ContainerStarted","Data":"548aa07944521fa8842846f1498ada47dc47d6399b08a3ec8a162f7647451265"} Dec 04 12:24:33.180054 master-0 kubenswrapper[35367]: I1204 12:24:33.180003 35367 generic.go:334] "Generic (PLEG): container finished" podID="f7a714b4-e808-4495-bccf-77861918a169" containerID="2fa0c9bb5cca192b9eeca44369821cb29a738cbe201da811ef3de7ba08c9f0e3" exitCode=0 Dec 04 12:24:33.180146 master-0 kubenswrapper[35367]: I1204 12:24:33.180082 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-host-discover-m4jx6" event={"ID":"f7a714b4-e808-4495-bccf-77861918a169","Type":"ContainerDied","Data":"2fa0c9bb5cca192b9eeca44369821cb29a738cbe201da811ef3de7ba08c9f0e3"} Dec 04 12:24:33.233882 master-0 kubenswrapper[35367]: I1204 12:24:33.233464 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-api-0" podStartSLOduration=2.233442333 podStartE2EDuration="2.233442333s" podCreationTimestamp="2025-12-04 12:24:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:24:33.199640278 +0000 UTC m=+1516.637701536" watchObservedRunningTime="2025-12-04 12:24:33.233442333 +0000 UTC m=+1516.671503591" Dec 04 12:24:33.748024 master-0 kubenswrapper[35367]: I1204 12:24:33.746166 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:24:33.809939 master-0 kubenswrapper[35367]: I1204 12:24:33.808197 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-dns-swift-storage-0\") pod \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " Dec 04 12:24:33.809939 master-0 kubenswrapper[35367]: I1204 12:24:33.808876 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfcpt\" (UniqueName: \"kubernetes.io/projected/ca969f2b-66d7-4470-af5d-b8f6531d6d67-kube-api-access-lfcpt\") pod \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " Dec 04 12:24:33.809939 master-0 kubenswrapper[35367]: I1204 12:24:33.809090 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-ovsdbserver-sb\") pod \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " Dec 04 12:24:33.809939 master-0 kubenswrapper[35367]: I1204 12:24:33.809226 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-dns-svc\") pod \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " Dec 04 12:24:33.809939 master-0 kubenswrapper[35367]: I1204 12:24:33.809254 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-ovsdbserver-nb\") pod \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " Dec 04 12:24:33.809939 master-0 kubenswrapper[35367]: I1204 12:24:33.809307 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-config\") pod \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " Dec 04 12:24:33.817721 master-0 kubenswrapper[35367]: I1204 12:24:33.816252 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca969f2b-66d7-4470-af5d-b8f6531d6d67-kube-api-access-lfcpt" (OuterVolumeSpecName: "kube-api-access-lfcpt") pod "ca969f2b-66d7-4470-af5d-b8f6531d6d67" (UID: "ca969f2b-66d7-4470-af5d-b8f6531d6d67"). InnerVolumeSpecName "kube-api-access-lfcpt". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:24:33.907288 master-0 kubenswrapper[35367]: I1204 12:24:33.907217 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-config" (OuterVolumeSpecName: "config") pod "ca969f2b-66d7-4470-af5d-b8f6531d6d67" (UID: "ca969f2b-66d7-4470-af5d-b8f6531d6d67"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:24:33.912592 master-0 kubenswrapper[35367]: I1204 12:24:33.912537 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "ca969f2b-66d7-4470-af5d-b8f6531d6d67" (UID: "ca969f2b-66d7-4470-af5d-b8f6531d6d67"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:24:33.913691 master-0 kubenswrapper[35367]: I1204 12:24:33.913307 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-ovsdbserver-nb\") pod \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\" (UID: \"ca969f2b-66d7-4470-af5d-b8f6531d6d67\") " Dec 04 12:24:33.914771 master-0 kubenswrapper[35367]: W1204 12:24:33.914737 35367 empty_dir.go:500] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/ca969f2b-66d7-4470-af5d-b8f6531d6d67/volumes/kubernetes.io~configmap/ovsdbserver-nb Dec 04 12:24:33.914854 master-0 kubenswrapper[35367]: I1204 12:24:33.914766 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "ca969f2b-66d7-4470-af5d-b8f6531d6d67" (UID: "ca969f2b-66d7-4470-af5d-b8f6531d6d67"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:24:33.915626 master-0 kubenswrapper[35367]: I1204 12:24:33.915595 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lfcpt\" (UniqueName: \"kubernetes.io/projected/ca969f2b-66d7-4470-af5d-b8f6531d6d67-kube-api-access-lfcpt\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:33.915626 master-0 kubenswrapper[35367]: I1204 12:24:33.915622 35367 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:33.915710 master-0 kubenswrapper[35367]: I1204 12:24:33.915637 35367 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:33.920376 master-0 kubenswrapper[35367]: I1204 12:24:33.920292 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "ca969f2b-66d7-4470-af5d-b8f6531d6d67" (UID: "ca969f2b-66d7-4470-af5d-b8f6531d6d67"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:24:33.933007 master-0 kubenswrapper[35367]: I1204 12:24:33.932912 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "ca969f2b-66d7-4470-af5d-b8f6531d6d67" (UID: "ca969f2b-66d7-4470-af5d-b8f6531d6d67"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:24:33.946291 master-0 kubenswrapper[35367]: I1204 12:24:33.946156 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "ca969f2b-66d7-4470-af5d-b8f6531d6d67" (UID: "ca969f2b-66d7-4470-af5d-b8f6531d6d67"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:24:34.018451 master-0 kubenswrapper[35367]: I1204 12:24:34.018094 35367 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:34.018451 master-0 kubenswrapper[35367]: I1204 12:24:34.018156 35367 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-dns-svc\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:34.018451 master-0 kubenswrapper[35367]: I1204 12:24:34.018170 35367 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/ca969f2b-66d7-4470-af5d-b8f6531d6d67-dns-swift-storage-0\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:34.194941 master-0 kubenswrapper[35367]: I1204 12:24:34.194774 35367 generic.go:334] "Generic (PLEG): container finished" podID="ca969f2b-66d7-4470-af5d-b8f6531d6d67" containerID="2b38949c91dc58166dba107a49f204cc2daaf4913c56badbdfd8256bfcf71830" exitCode=0 Dec 04 12:24:34.194941 master-0 kubenswrapper[35367]: I1204 12:24:34.194848 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" Dec 04 12:24:34.194941 master-0 kubenswrapper[35367]: I1204 12:24:34.194862 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" event={"ID":"ca969f2b-66d7-4470-af5d-b8f6531d6d67","Type":"ContainerDied","Data":"2b38949c91dc58166dba107a49f204cc2daaf4913c56badbdfd8256bfcf71830"} Dec 04 12:24:34.194941 master-0 kubenswrapper[35367]: I1204 12:24:34.194920 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-774bc94dc7-zjvc8" event={"ID":"ca969f2b-66d7-4470-af5d-b8f6531d6d67","Type":"ContainerDied","Data":"28a563f5554ed1c91fc6dd4ac5287d493cf633efa08960f8e01d3acdd6b28d15"} Dec 04 12:24:34.194941 master-0 kubenswrapper[35367]: I1204 12:24:34.194947 35367 scope.go:117] "RemoveContainer" containerID="2b38949c91dc58166dba107a49f204cc2daaf4913c56badbdfd8256bfcf71830" Dec 04 12:24:34.226329 master-0 kubenswrapper[35367]: I1204 12:24:34.226277 35367 scope.go:117] "RemoveContainer" containerID="28849461c8ef45b401f04c3ee562cede1c5f20b9ef3fc83de4bb96a0ddfa4336" Dec 04 12:24:34.252720 master-0 kubenswrapper[35367]: I1204 12:24:34.252105 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-774bc94dc7-zjvc8"] Dec 04 12:24:34.271336 master-0 kubenswrapper[35367]: I1204 12:24:34.270216 35367 scope.go:117] "RemoveContainer" containerID="2b38949c91dc58166dba107a49f204cc2daaf4913c56badbdfd8256bfcf71830" Dec 04 12:24:34.271336 master-0 kubenswrapper[35367]: E1204 12:24:34.271239 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b38949c91dc58166dba107a49f204cc2daaf4913c56badbdfd8256bfcf71830\": container with ID starting with 2b38949c91dc58166dba107a49f204cc2daaf4913c56badbdfd8256bfcf71830 not found: ID does not exist" containerID="2b38949c91dc58166dba107a49f204cc2daaf4913c56badbdfd8256bfcf71830" Dec 04 12:24:34.271336 master-0 kubenswrapper[35367]: I1204 12:24:34.271309 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b38949c91dc58166dba107a49f204cc2daaf4913c56badbdfd8256bfcf71830"} err="failed to get container status \"2b38949c91dc58166dba107a49f204cc2daaf4913c56badbdfd8256bfcf71830\": rpc error: code = NotFound desc = could not find container \"2b38949c91dc58166dba107a49f204cc2daaf4913c56badbdfd8256bfcf71830\": container with ID starting with 2b38949c91dc58166dba107a49f204cc2daaf4913c56badbdfd8256bfcf71830 not found: ID does not exist" Dec 04 12:24:34.271336 master-0 kubenswrapper[35367]: I1204 12:24:34.271343 35367 scope.go:117] "RemoveContainer" containerID="28849461c8ef45b401f04c3ee562cede1c5f20b9ef3fc83de4bb96a0ddfa4336" Dec 04 12:24:34.272419 master-0 kubenswrapper[35367]: E1204 12:24:34.271918 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28849461c8ef45b401f04c3ee562cede1c5f20b9ef3fc83de4bb96a0ddfa4336\": container with ID starting with 28849461c8ef45b401f04c3ee562cede1c5f20b9ef3fc83de4bb96a0ddfa4336 not found: ID does not exist" containerID="28849461c8ef45b401f04c3ee562cede1c5f20b9ef3fc83de4bb96a0ddfa4336" Dec 04 12:24:34.272419 master-0 kubenswrapper[35367]: I1204 12:24:34.272029 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28849461c8ef45b401f04c3ee562cede1c5f20b9ef3fc83de4bb96a0ddfa4336"} err="failed to get container status \"28849461c8ef45b401f04c3ee562cede1c5f20b9ef3fc83de4bb96a0ddfa4336\": rpc error: code = NotFound desc = could not find container \"28849461c8ef45b401f04c3ee562cede1c5f20b9ef3fc83de4bb96a0ddfa4336\": container with ID starting with 28849461c8ef45b401f04c3ee562cede1c5f20b9ef3fc83de4bb96a0ddfa4336 not found: ID does not exist" Dec 04 12:24:34.278181 master-0 kubenswrapper[35367]: I1204 12:24:34.278118 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-774bc94dc7-zjvc8"] Dec 04 12:24:34.768257 master-0 kubenswrapper[35367]: I1204 12:24:34.768175 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca969f2b-66d7-4470-af5d-b8f6531d6d67" path="/var/lib/kubelet/pods/ca969f2b-66d7-4470-af5d-b8f6531d6d67/volumes" Dec 04 12:24:34.826304 master-0 kubenswrapper[35367]: I1204 12:24:34.826267 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-host-discover-m4jx6" Dec 04 12:24:34.872484 master-0 kubenswrapper[35367]: I1204 12:24:34.872426 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7a714b4-e808-4495-bccf-77861918a169-combined-ca-bundle\") pod \"f7a714b4-e808-4495-bccf-77861918a169\" (UID: \"f7a714b4-e808-4495-bccf-77861918a169\") " Dec 04 12:24:34.880074 master-0 kubenswrapper[35367]: I1204 12:24:34.880014 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7a714b4-e808-4495-bccf-77861918a169-config-data\") pod \"f7a714b4-e808-4495-bccf-77861918a169\" (UID: \"f7a714b4-e808-4495-bccf-77861918a169\") " Dec 04 12:24:34.880357 master-0 kubenswrapper[35367]: I1204 12:24:34.880227 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f7a714b4-e808-4495-bccf-77861918a169-scripts\") pod \"f7a714b4-e808-4495-bccf-77861918a169\" (UID: \"f7a714b4-e808-4495-bccf-77861918a169\") " Dec 04 12:24:34.880357 master-0 kubenswrapper[35367]: I1204 12:24:34.880301 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bwwh\" (UniqueName: \"kubernetes.io/projected/f7a714b4-e808-4495-bccf-77861918a169-kube-api-access-8bwwh\") pod \"f7a714b4-e808-4495-bccf-77861918a169\" (UID: \"f7a714b4-e808-4495-bccf-77861918a169\") " Dec 04 12:24:34.885613 master-0 kubenswrapper[35367]: I1204 12:24:34.885559 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7a714b4-e808-4495-bccf-77861918a169-scripts" (OuterVolumeSpecName: "scripts") pod "f7a714b4-e808-4495-bccf-77861918a169" (UID: "f7a714b4-e808-4495-bccf-77861918a169"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:24:34.887125 master-0 kubenswrapper[35367]: I1204 12:24:34.887022 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7a714b4-e808-4495-bccf-77861918a169-kube-api-access-8bwwh" (OuterVolumeSpecName: "kube-api-access-8bwwh") pod "f7a714b4-e808-4495-bccf-77861918a169" (UID: "f7a714b4-e808-4495-bccf-77861918a169"). InnerVolumeSpecName "kube-api-access-8bwwh". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:24:34.907484 master-0 kubenswrapper[35367]: I1204 12:24:34.907391 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7a714b4-e808-4495-bccf-77861918a169-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f7a714b4-e808-4495-bccf-77861918a169" (UID: "f7a714b4-e808-4495-bccf-77861918a169"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:24:34.913481 master-0 kubenswrapper[35367]: I1204 12:24:34.913382 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7a714b4-e808-4495-bccf-77861918a169-config-data" (OuterVolumeSpecName: "config-data") pod "f7a714b4-e808-4495-bccf-77861918a169" (UID: "f7a714b4-e808-4495-bccf-77861918a169"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:24:34.984836 master-0 kubenswrapper[35367]: I1204 12:24:34.984687 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7a714b4-e808-4495-bccf-77861918a169-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:34.984836 master-0 kubenswrapper[35367]: I1204 12:24:34.984733 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7a714b4-e808-4495-bccf-77861918a169-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:34.984836 master-0 kubenswrapper[35367]: I1204 12:24:34.984744 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f7a714b4-e808-4495-bccf-77861918a169-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:34.984836 master-0 kubenswrapper[35367]: I1204 12:24:34.984754 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8bwwh\" (UniqueName: \"kubernetes.io/projected/f7a714b4-e808-4495-bccf-77861918a169-kube-api-access-8bwwh\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:35.209939 master-0 kubenswrapper[35367]: I1204 12:24:35.209861 35367 generic.go:334] "Generic (PLEG): container finished" podID="9c8452b4-f20d-4519-a81f-358e8e447d6e" containerID="78ca7d97355f2402097bdc2ad25c88c58ea8b5d4c3e74ddeffddf016f18e01ac" exitCode=0 Dec 04 12:24:35.210599 master-0 kubenswrapper[35367]: I1204 12:24:35.209963 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-cell-mapping-vtqc2" event={"ID":"9c8452b4-f20d-4519-a81f-358e8e447d6e","Type":"ContainerDied","Data":"78ca7d97355f2402097bdc2ad25c88c58ea8b5d4c3e74ddeffddf016f18e01ac"} Dec 04 12:24:35.214041 master-0 kubenswrapper[35367]: I1204 12:24:35.213982 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-host-discover-m4jx6" Dec 04 12:24:35.214183 master-0 kubenswrapper[35367]: I1204 12:24:35.213974 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-host-discover-m4jx6" event={"ID":"f7a714b4-e808-4495-bccf-77861918a169","Type":"ContainerDied","Data":"311f0e8fc7f3f55682a231f93d162c57fd60b574ef8c1ded81b3d98605b5f15e"} Dec 04 12:24:35.214183 master-0 kubenswrapper[35367]: I1204 12:24:35.214149 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="311f0e8fc7f3f55682a231f93d162c57fd60b574ef8c1ded81b3d98605b5f15e" Dec 04 12:24:36.705174 master-0 kubenswrapper[35367]: I1204 12:24:36.705121 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-cell-mapping-vtqc2" Dec 04 12:24:36.837794 master-0 kubenswrapper[35367]: I1204 12:24:36.837636 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9c8452b4-f20d-4519-a81f-358e8e447d6e-scripts\") pod \"9c8452b4-f20d-4519-a81f-358e8e447d6e\" (UID: \"9c8452b4-f20d-4519-a81f-358e8e447d6e\") " Dec 04 12:24:36.837794 master-0 kubenswrapper[35367]: I1204 12:24:36.837836 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c8452b4-f20d-4519-a81f-358e8e447d6e-config-data\") pod \"9c8452b4-f20d-4519-a81f-358e8e447d6e\" (UID: \"9c8452b4-f20d-4519-a81f-358e8e447d6e\") " Dec 04 12:24:36.838133 master-0 kubenswrapper[35367]: I1204 12:24:36.837879 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c8452b4-f20d-4519-a81f-358e8e447d6e-combined-ca-bundle\") pod \"9c8452b4-f20d-4519-a81f-358e8e447d6e\" (UID: \"9c8452b4-f20d-4519-a81f-358e8e447d6e\") " Dec 04 12:24:36.838235 master-0 kubenswrapper[35367]: I1204 12:24:36.838204 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjtnm\" (UniqueName: \"kubernetes.io/projected/9c8452b4-f20d-4519-a81f-358e8e447d6e-kube-api-access-qjtnm\") pod \"9c8452b4-f20d-4519-a81f-358e8e447d6e\" (UID: \"9c8452b4-f20d-4519-a81f-358e8e447d6e\") " Dec 04 12:24:36.841943 master-0 kubenswrapper[35367]: I1204 12:24:36.841863 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c8452b4-f20d-4519-a81f-358e8e447d6e-kube-api-access-qjtnm" (OuterVolumeSpecName: "kube-api-access-qjtnm") pod "9c8452b4-f20d-4519-a81f-358e8e447d6e" (UID: "9c8452b4-f20d-4519-a81f-358e8e447d6e"). InnerVolumeSpecName "kube-api-access-qjtnm". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:24:36.842243 master-0 kubenswrapper[35367]: I1204 12:24:36.842209 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c8452b4-f20d-4519-a81f-358e8e447d6e-scripts" (OuterVolumeSpecName: "scripts") pod "9c8452b4-f20d-4519-a81f-358e8e447d6e" (UID: "9c8452b4-f20d-4519-a81f-358e8e447d6e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:24:36.870744 master-0 kubenswrapper[35367]: I1204 12:24:36.870676 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c8452b4-f20d-4519-a81f-358e8e447d6e-config-data" (OuterVolumeSpecName: "config-data") pod "9c8452b4-f20d-4519-a81f-358e8e447d6e" (UID: "9c8452b4-f20d-4519-a81f-358e8e447d6e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:24:36.872428 master-0 kubenswrapper[35367]: I1204 12:24:36.872347 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c8452b4-f20d-4519-a81f-358e8e447d6e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9c8452b4-f20d-4519-a81f-358e8e447d6e" (UID: "9c8452b4-f20d-4519-a81f-358e8e447d6e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:24:36.942707 master-0 kubenswrapper[35367]: I1204 12:24:36.942653 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qjtnm\" (UniqueName: \"kubernetes.io/projected/9c8452b4-f20d-4519-a81f-358e8e447d6e-kube-api-access-qjtnm\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:36.942707 master-0 kubenswrapper[35367]: I1204 12:24:36.942702 35367 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9c8452b4-f20d-4519-a81f-358e8e447d6e-scripts\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:36.942848 master-0 kubenswrapper[35367]: I1204 12:24:36.942714 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c8452b4-f20d-4519-a81f-358e8e447d6e-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:36.942848 master-0 kubenswrapper[35367]: I1204 12:24:36.942723 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c8452b4-f20d-4519-a81f-358e8e447d6e-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:37.243767 master-0 kubenswrapper[35367]: I1204 12:24:37.243614 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell1-cell-mapping-vtqc2" event={"ID":"9c8452b4-f20d-4519-a81f-358e8e447d6e","Type":"ContainerDied","Data":"64eb6e45cf4ec32353be14f47ea205f957209afbfe37243372ea96a6afa349bd"} Dec 04 12:24:37.243767 master-0 kubenswrapper[35367]: I1204 12:24:37.243676 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64eb6e45cf4ec32353be14f47ea205f957209afbfe37243372ea96a6afa349bd" Dec 04 12:24:37.243767 master-0 kubenswrapper[35367]: I1204 12:24:37.243697 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell1-cell-mapping-vtqc2" Dec 04 12:24:37.435926 master-0 kubenswrapper[35367]: I1204 12:24:37.435756 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-api-0"] Dec 04 12:24:37.436261 master-0 kubenswrapper[35367]: I1204 12:24:37.436218 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-api-0" podUID="2ea1e7a2-77eb-4694-a0db-8f912e74591b" containerName="nova-api-log" containerID="cri-o://548aa07944521fa8842846f1498ada47dc47d6399b08a3ec8a162f7647451265" gracePeriod=30 Dec 04 12:24:37.437192 master-0 kubenswrapper[35367]: I1204 12:24:37.437152 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-api-0" podUID="2ea1e7a2-77eb-4694-a0db-8f912e74591b" containerName="nova-api-api" containerID="cri-o://de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f" gracePeriod=30 Dec 04 12:24:37.457745 master-0 kubenswrapper[35367]: I1204 12:24:37.457687 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 12:24:37.458296 master-0 kubenswrapper[35367]: I1204 12:24:37.458235 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-scheduler-0" podUID="46e5cf34-acb7-41c5-acf4-45bfdc3b1051" containerName="nova-scheduler-scheduler" containerID="cri-o://7b70eda49845092233b0b8884b1d0bb50b32ae874fc21a7ac62b2382cd51ee73" gracePeriod=30 Dec 04 12:24:37.556706 master-0 kubenswrapper[35367]: I1204 12:24:37.556643 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 12:24:37.557497 master-0 kubenswrapper[35367]: I1204 12:24:37.556977 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-metadata-0" podUID="48092d7d-03c3-4ffe-92b1-34ade239b127" containerName="nova-metadata-log" containerID="cri-o://9eaf8ad50851067371ad49b6f0534313f62a0ee496e71257060981eba35d1ad9" gracePeriod=30 Dec 04 12:24:37.557497 master-0 kubenswrapper[35367]: I1204 12:24:37.557171 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-metadata-0" podUID="48092d7d-03c3-4ffe-92b1-34ade239b127" containerName="nova-metadata-metadata" containerID="cri-o://4acb0c53fd969f2a07fbaed27d57bb227241ca9e652a5f7da9abc02ec8385c6f" gracePeriod=30 Dec 04 12:24:37.753407 master-0 kubenswrapper[35367]: E1204 12:24:37.752300 35367 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ea1e7a2_77eb_4694_a0db_8f912e74591b.slice/crio-de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ea1e7a2_77eb_4694_a0db_8f912e74591b.slice/crio-conmon-de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48092d7d_03c3_4ffe_92b1_34ade239b127.slice/crio-9eaf8ad50851067371ad49b6f0534313f62a0ee496e71257060981eba35d1ad9.scope\": RecentStats: unable to find data in memory cache]" Dec 04 12:24:37.753407 master-0 kubenswrapper[35367]: E1204 12:24:37.752421 35367 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ea1e7a2_77eb_4694_a0db_8f912e74591b.slice/crio-conmon-de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48092d7d_03c3_4ffe_92b1_34ade239b127.slice/crio-conmon-9eaf8ad50851067371ad49b6f0534313f62a0ee496e71257060981eba35d1ad9.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ea1e7a2_77eb_4694_a0db_8f912e74591b.slice/crio-de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48092d7d_03c3_4ffe_92b1_34ade239b127.slice/crio-9eaf8ad50851067371ad49b6f0534313f62a0ee496e71257060981eba35d1ad9.scope\": RecentStats: unable to find data in memory cache]" Dec 04 12:24:38.124986 master-0 kubenswrapper[35367]: I1204 12:24:38.124922 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 12:24:38.196392 master-0 kubenswrapper[35367]: I1204 12:24:38.196300 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xgqm\" (UniqueName: \"kubernetes.io/projected/2ea1e7a2-77eb-4694-a0db-8f912e74591b-kube-api-access-6xgqm\") pod \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " Dec 04 12:24:38.196392 master-0 kubenswrapper[35367]: I1204 12:24:38.196397 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-public-tls-certs\") pod \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " Dec 04 12:24:38.196731 master-0 kubenswrapper[35367]: I1204 12:24:38.196561 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-config-data\") pod \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " Dec 04 12:24:38.196918 master-0 kubenswrapper[35367]: I1204 12:24:38.196858 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-internal-tls-certs\") pod \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " Dec 04 12:24:38.197380 master-0 kubenswrapper[35367]: I1204 12:24:38.197335 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2ea1e7a2-77eb-4694-a0db-8f912e74591b-logs\") pod \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " Dec 04 12:24:38.197465 master-0 kubenswrapper[35367]: I1204 12:24:38.197420 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-combined-ca-bundle\") pod \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\" (UID: \"2ea1e7a2-77eb-4694-a0db-8f912e74591b\") " Dec 04 12:24:38.199020 master-0 kubenswrapper[35367]: I1204 12:24:38.198968 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ea1e7a2-77eb-4694-a0db-8f912e74591b-logs" (OuterVolumeSpecName: "logs") pod "2ea1e7a2-77eb-4694-a0db-8f912e74591b" (UID: "2ea1e7a2-77eb-4694-a0db-8f912e74591b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:24:38.200989 master-0 kubenswrapper[35367]: I1204 12:24:38.200926 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ea1e7a2-77eb-4694-a0db-8f912e74591b-kube-api-access-6xgqm" (OuterVolumeSpecName: "kube-api-access-6xgqm") pod "2ea1e7a2-77eb-4694-a0db-8f912e74591b" (UID: "2ea1e7a2-77eb-4694-a0db-8f912e74591b"). InnerVolumeSpecName "kube-api-access-6xgqm". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:24:38.230319 master-0 kubenswrapper[35367]: I1204 12:24:38.230251 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-config-data" (OuterVolumeSpecName: "config-data") pod "2ea1e7a2-77eb-4694-a0db-8f912e74591b" (UID: "2ea1e7a2-77eb-4694-a0db-8f912e74591b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:24:38.231739 master-0 kubenswrapper[35367]: I1204 12:24:38.231710 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2ea1e7a2-77eb-4694-a0db-8f912e74591b" (UID: "2ea1e7a2-77eb-4694-a0db-8f912e74591b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:24:38.262405 master-0 kubenswrapper[35367]: I1204 12:24:38.262268 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2ea1e7a2-77eb-4694-a0db-8f912e74591b" (UID: "2ea1e7a2-77eb-4694-a0db-8f912e74591b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:24:38.267854 master-0 kubenswrapper[35367]: I1204 12:24:38.267760 35367 generic.go:334] "Generic (PLEG): container finished" podID="2ea1e7a2-77eb-4694-a0db-8f912e74591b" containerID="de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f" exitCode=0 Dec 04 12:24:38.267854 master-0 kubenswrapper[35367]: I1204 12:24:38.267841 35367 generic.go:334] "Generic (PLEG): container finished" podID="2ea1e7a2-77eb-4694-a0db-8f912e74591b" containerID="548aa07944521fa8842846f1498ada47dc47d6399b08a3ec8a162f7647451265" exitCode=143 Dec 04 12:24:38.268096 master-0 kubenswrapper[35367]: I1204 12:24:38.267862 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2ea1e7a2-77eb-4694-a0db-8f912e74591b" (UID: "2ea1e7a2-77eb-4694-a0db-8f912e74591b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:24:38.268096 master-0 kubenswrapper[35367]: I1204 12:24:38.267969 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 12:24:38.268658 master-0 kubenswrapper[35367]: I1204 12:24:38.267958 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"2ea1e7a2-77eb-4694-a0db-8f912e74591b","Type":"ContainerDied","Data":"de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f"} Dec 04 12:24:38.268658 master-0 kubenswrapper[35367]: I1204 12:24:38.268260 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"2ea1e7a2-77eb-4694-a0db-8f912e74591b","Type":"ContainerDied","Data":"548aa07944521fa8842846f1498ada47dc47d6399b08a3ec8a162f7647451265"} Dec 04 12:24:38.268658 master-0 kubenswrapper[35367]: I1204 12:24:38.268278 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"2ea1e7a2-77eb-4694-a0db-8f912e74591b","Type":"ContainerDied","Data":"e45ac17bf0ca635d3bcac48a9c06cb957707032206d64cdd976b3c19904b0fc4"} Dec 04 12:24:38.268658 master-0 kubenswrapper[35367]: I1204 12:24:38.268326 35367 scope.go:117] "RemoveContainer" containerID="de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f" Dec 04 12:24:38.271422 master-0 kubenswrapper[35367]: I1204 12:24:38.271378 35367 generic.go:334] "Generic (PLEG): container finished" podID="48092d7d-03c3-4ffe-92b1-34ade239b127" containerID="9eaf8ad50851067371ad49b6f0534313f62a0ee496e71257060981eba35d1ad9" exitCode=143 Dec 04 12:24:38.271504 master-0 kubenswrapper[35367]: I1204 12:24:38.271428 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"48092d7d-03c3-4ffe-92b1-34ade239b127","Type":"ContainerDied","Data":"9eaf8ad50851067371ad49b6f0534313f62a0ee496e71257060981eba35d1ad9"} Dec 04 12:24:38.304021 master-0 kubenswrapper[35367]: I1204 12:24:38.303958 35367 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2ea1e7a2-77eb-4694-a0db-8f912e74591b-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:38.304021 master-0 kubenswrapper[35367]: I1204 12:24:38.303994 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:38.304021 master-0 kubenswrapper[35367]: I1204 12:24:38.304006 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6xgqm\" (UniqueName: \"kubernetes.io/projected/2ea1e7a2-77eb-4694-a0db-8f912e74591b-kube-api-access-6xgqm\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:38.304021 master-0 kubenswrapper[35367]: I1204 12:24:38.304018 35367 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-public-tls-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:38.304256 master-0 kubenswrapper[35367]: I1204 12:24:38.304027 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:38.304256 master-0 kubenswrapper[35367]: I1204 12:24:38.304039 35367 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ea1e7a2-77eb-4694-a0db-8f912e74591b-internal-tls-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:38.354546 master-0 kubenswrapper[35367]: I1204 12:24:38.354340 35367 scope.go:117] "RemoveContainer" containerID="548aa07944521fa8842846f1498ada47dc47d6399b08a3ec8a162f7647451265" Dec 04 12:24:38.359909 master-0 kubenswrapper[35367]: I1204 12:24:38.359853 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-api-0"] Dec 04 12:24:38.378502 master-0 kubenswrapper[35367]: I1204 12:24:38.378407 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-api-0"] Dec 04 12:24:38.389462 master-0 kubenswrapper[35367]: I1204 12:24:38.387735 35367 scope.go:117] "RemoveContainer" containerID="de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f" Dec 04 12:24:38.389462 master-0 kubenswrapper[35367]: E1204 12:24:38.389024 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f\": container with ID starting with de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f not found: ID does not exist" containerID="de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f" Dec 04 12:24:38.389462 master-0 kubenswrapper[35367]: I1204 12:24:38.389081 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f"} err="failed to get container status \"de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f\": rpc error: code = NotFound desc = could not find container \"de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f\": container with ID starting with de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f not found: ID does not exist" Dec 04 12:24:38.389462 master-0 kubenswrapper[35367]: I1204 12:24:38.389112 35367 scope.go:117] "RemoveContainer" containerID="548aa07944521fa8842846f1498ada47dc47d6399b08a3ec8a162f7647451265" Dec 04 12:24:38.390945 master-0 kubenswrapper[35367]: E1204 12:24:38.390856 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"548aa07944521fa8842846f1498ada47dc47d6399b08a3ec8a162f7647451265\": container with ID starting with 548aa07944521fa8842846f1498ada47dc47d6399b08a3ec8a162f7647451265 not found: ID does not exist" containerID="548aa07944521fa8842846f1498ada47dc47d6399b08a3ec8a162f7647451265" Dec 04 12:24:38.390945 master-0 kubenswrapper[35367]: I1204 12:24:38.390922 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548aa07944521fa8842846f1498ada47dc47d6399b08a3ec8a162f7647451265"} err="failed to get container status \"548aa07944521fa8842846f1498ada47dc47d6399b08a3ec8a162f7647451265\": rpc error: code = NotFound desc = could not find container \"548aa07944521fa8842846f1498ada47dc47d6399b08a3ec8a162f7647451265\": container with ID starting with 548aa07944521fa8842846f1498ada47dc47d6399b08a3ec8a162f7647451265 not found: ID does not exist" Dec 04 12:24:38.391273 master-0 kubenswrapper[35367]: I1204 12:24:38.390964 35367 scope.go:117] "RemoveContainer" containerID="de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f" Dec 04 12:24:38.392152 master-0 kubenswrapper[35367]: I1204 12:24:38.391344 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f"} err="failed to get container status \"de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f\": rpc error: code = NotFound desc = could not find container \"de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f\": container with ID starting with de3007b1784926426ca673fcc50951bc808b3568d8d32280cee7e82d90d0c30f not found: ID does not exist" Dec 04 12:24:38.392152 master-0 kubenswrapper[35367]: I1204 12:24:38.391388 35367 scope.go:117] "RemoveContainer" containerID="548aa07944521fa8842846f1498ada47dc47d6399b08a3ec8a162f7647451265" Dec 04 12:24:38.392152 master-0 kubenswrapper[35367]: I1204 12:24:38.391656 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548aa07944521fa8842846f1498ada47dc47d6399b08a3ec8a162f7647451265"} err="failed to get container status \"548aa07944521fa8842846f1498ada47dc47d6399b08a3ec8a162f7647451265\": rpc error: code = NotFound desc = could not find container \"548aa07944521fa8842846f1498ada47dc47d6399b08a3ec8a162f7647451265\": container with ID starting with 548aa07944521fa8842846f1498ada47dc47d6399b08a3ec8a162f7647451265 not found: ID does not exist" Dec 04 12:24:38.401844 master-0 kubenswrapper[35367]: I1204 12:24:38.398925 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-api-0"] Dec 04 12:24:38.401844 master-0 kubenswrapper[35367]: E1204 12:24:38.399995 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2ea1e7a2-77eb-4694-a0db-8f912e74591b" containerName="nova-api-log" Dec 04 12:24:38.401844 master-0 kubenswrapper[35367]: I1204 12:24:38.400028 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ea1e7a2-77eb-4694-a0db-8f912e74591b" containerName="nova-api-log" Dec 04 12:24:38.401844 master-0 kubenswrapper[35367]: E1204 12:24:38.400080 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f7a714b4-e808-4495-bccf-77861918a169" containerName="nova-manage" Dec 04 12:24:38.401844 master-0 kubenswrapper[35367]: I1204 12:24:38.400097 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7a714b4-e808-4495-bccf-77861918a169" containerName="nova-manage" Dec 04 12:24:38.401844 master-0 kubenswrapper[35367]: E1204 12:24:38.400120 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ca969f2b-66d7-4470-af5d-b8f6531d6d67" containerName="init" Dec 04 12:24:38.401844 master-0 kubenswrapper[35367]: I1204 12:24:38.400130 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca969f2b-66d7-4470-af5d-b8f6531d6d67" containerName="init" Dec 04 12:24:38.401844 master-0 kubenswrapper[35367]: E1204 12:24:38.400164 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2ea1e7a2-77eb-4694-a0db-8f912e74591b" containerName="nova-api-api" Dec 04 12:24:38.401844 master-0 kubenswrapper[35367]: I1204 12:24:38.400171 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ea1e7a2-77eb-4694-a0db-8f912e74591b" containerName="nova-api-api" Dec 04 12:24:38.401844 master-0 kubenswrapper[35367]: E1204 12:24:38.400188 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ca969f2b-66d7-4470-af5d-b8f6531d6d67" containerName="dnsmasq-dns" Dec 04 12:24:38.401844 master-0 kubenswrapper[35367]: I1204 12:24:38.400195 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca969f2b-66d7-4470-af5d-b8f6531d6d67" containerName="dnsmasq-dns" Dec 04 12:24:38.401844 master-0 kubenswrapper[35367]: E1204 12:24:38.400208 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9c8452b4-f20d-4519-a81f-358e8e447d6e" containerName="nova-manage" Dec 04 12:24:38.401844 master-0 kubenswrapper[35367]: I1204 12:24:38.400213 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c8452b4-f20d-4519-a81f-358e8e447d6e" containerName="nova-manage" Dec 04 12:24:38.401844 master-0 kubenswrapper[35367]: I1204 12:24:38.400472 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="2ea1e7a2-77eb-4694-a0db-8f912e74591b" containerName="nova-api-api" Dec 04 12:24:38.401844 master-0 kubenswrapper[35367]: I1204 12:24:38.400513 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="9c8452b4-f20d-4519-a81f-358e8e447d6e" containerName="nova-manage" Dec 04 12:24:38.401844 master-0 kubenswrapper[35367]: I1204 12:24:38.400537 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="f7a714b4-e808-4495-bccf-77861918a169" containerName="nova-manage" Dec 04 12:24:38.401844 master-0 kubenswrapper[35367]: I1204 12:24:38.400553 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="ca969f2b-66d7-4470-af5d-b8f6531d6d67" containerName="dnsmasq-dns" Dec 04 12:24:38.401844 master-0 kubenswrapper[35367]: I1204 12:24:38.400566 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="2ea1e7a2-77eb-4694-a0db-8f912e74591b" containerName="nova-api-log" Dec 04 12:24:38.402600 master-0 kubenswrapper[35367]: I1204 12:24:38.402217 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 12:24:38.404724 master-0 kubenswrapper[35367]: I1204 12:24:38.404661 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-internal-svc" Dec 04 12:24:38.405638 master-0 kubenswrapper[35367]: I1204 12:24:38.405616 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-api-config-data" Dec 04 12:24:38.405921 master-0 kubenswrapper[35367]: I1204 12:24:38.405907 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-public-svc" Dec 04 12:24:38.418328 master-0 kubenswrapper[35367]: I1204 12:24:38.417939 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-0"] Dec 04 12:24:38.509162 master-0 kubenswrapper[35367]: I1204 12:24:38.508918 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/40ddee50-ee8d-4c6f-b2c7-e52aed486166-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"40ddee50-ee8d-4c6f-b2c7-e52aed486166\") " pod="openstack/nova-api-0" Dec 04 12:24:38.509162 master-0 kubenswrapper[35367]: I1204 12:24:38.509042 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/40ddee50-ee8d-4c6f-b2c7-e52aed486166-logs\") pod \"nova-api-0\" (UID: \"40ddee50-ee8d-4c6f-b2c7-e52aed486166\") " pod="openstack/nova-api-0" Dec 04 12:24:38.509162 master-0 kubenswrapper[35367]: I1204 12:24:38.509103 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/40ddee50-ee8d-4c6f-b2c7-e52aed486166-config-data\") pod \"nova-api-0\" (UID: \"40ddee50-ee8d-4c6f-b2c7-e52aed486166\") " pod="openstack/nova-api-0" Dec 04 12:24:38.509162 master-0 kubenswrapper[35367]: I1204 12:24:38.509155 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p9lk\" (UniqueName: \"kubernetes.io/projected/40ddee50-ee8d-4c6f-b2c7-e52aed486166-kube-api-access-7p9lk\") pod \"nova-api-0\" (UID: \"40ddee50-ee8d-4c6f-b2c7-e52aed486166\") " pod="openstack/nova-api-0" Dec 04 12:24:38.509656 master-0 kubenswrapper[35367]: I1204 12:24:38.509216 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/40ddee50-ee8d-4c6f-b2c7-e52aed486166-public-tls-certs\") pod \"nova-api-0\" (UID: \"40ddee50-ee8d-4c6f-b2c7-e52aed486166\") " pod="openstack/nova-api-0" Dec 04 12:24:38.509656 master-0 kubenswrapper[35367]: I1204 12:24:38.509552 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/40ddee50-ee8d-4c6f-b2c7-e52aed486166-internal-tls-certs\") pod \"nova-api-0\" (UID: \"40ddee50-ee8d-4c6f-b2c7-e52aed486166\") " pod="openstack/nova-api-0" Dec 04 12:24:38.613184 master-0 kubenswrapper[35367]: I1204 12:24:38.613073 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/40ddee50-ee8d-4c6f-b2c7-e52aed486166-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"40ddee50-ee8d-4c6f-b2c7-e52aed486166\") " pod="openstack/nova-api-0" Dec 04 12:24:38.613483 master-0 kubenswrapper[35367]: I1204 12:24:38.613223 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/40ddee50-ee8d-4c6f-b2c7-e52aed486166-logs\") pod \"nova-api-0\" (UID: \"40ddee50-ee8d-4c6f-b2c7-e52aed486166\") " pod="openstack/nova-api-0" Dec 04 12:24:38.613483 master-0 kubenswrapper[35367]: I1204 12:24:38.613297 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/40ddee50-ee8d-4c6f-b2c7-e52aed486166-config-data\") pod \"nova-api-0\" (UID: \"40ddee50-ee8d-4c6f-b2c7-e52aed486166\") " pod="openstack/nova-api-0" Dec 04 12:24:38.613483 master-0 kubenswrapper[35367]: I1204 12:24:38.613325 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7p9lk\" (UniqueName: \"kubernetes.io/projected/40ddee50-ee8d-4c6f-b2c7-e52aed486166-kube-api-access-7p9lk\") pod \"nova-api-0\" (UID: \"40ddee50-ee8d-4c6f-b2c7-e52aed486166\") " pod="openstack/nova-api-0" Dec 04 12:24:38.613483 master-0 kubenswrapper[35367]: I1204 12:24:38.613375 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/40ddee50-ee8d-4c6f-b2c7-e52aed486166-public-tls-certs\") pod \"nova-api-0\" (UID: \"40ddee50-ee8d-4c6f-b2c7-e52aed486166\") " pod="openstack/nova-api-0" Dec 04 12:24:38.613736 master-0 kubenswrapper[35367]: I1204 12:24:38.613675 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/40ddee50-ee8d-4c6f-b2c7-e52aed486166-internal-tls-certs\") pod \"nova-api-0\" (UID: \"40ddee50-ee8d-4c6f-b2c7-e52aed486166\") " pod="openstack/nova-api-0" Dec 04 12:24:38.614341 master-0 kubenswrapper[35367]: I1204 12:24:38.614256 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/40ddee50-ee8d-4c6f-b2c7-e52aed486166-logs\") pod \"nova-api-0\" (UID: \"40ddee50-ee8d-4c6f-b2c7-e52aed486166\") " pod="openstack/nova-api-0" Dec 04 12:24:38.616923 master-0 kubenswrapper[35367]: I1204 12:24:38.616883 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/40ddee50-ee8d-4c6f-b2c7-e52aed486166-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"40ddee50-ee8d-4c6f-b2c7-e52aed486166\") " pod="openstack/nova-api-0" Dec 04 12:24:38.617351 master-0 kubenswrapper[35367]: I1204 12:24:38.617311 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/40ddee50-ee8d-4c6f-b2c7-e52aed486166-config-data\") pod \"nova-api-0\" (UID: \"40ddee50-ee8d-4c6f-b2c7-e52aed486166\") " pod="openstack/nova-api-0" Dec 04 12:24:38.617463 master-0 kubenswrapper[35367]: I1204 12:24:38.617332 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/40ddee50-ee8d-4c6f-b2c7-e52aed486166-internal-tls-certs\") pod \"nova-api-0\" (UID: \"40ddee50-ee8d-4c6f-b2c7-e52aed486166\") " pod="openstack/nova-api-0" Dec 04 12:24:38.618023 master-0 kubenswrapper[35367]: I1204 12:24:38.617985 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/40ddee50-ee8d-4c6f-b2c7-e52aed486166-public-tls-certs\") pod \"nova-api-0\" (UID: \"40ddee50-ee8d-4c6f-b2c7-e52aed486166\") " pod="openstack/nova-api-0" Dec 04 12:24:38.630892 master-0 kubenswrapper[35367]: I1204 12:24:38.630761 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p9lk\" (UniqueName: \"kubernetes.io/projected/40ddee50-ee8d-4c6f-b2c7-e52aed486166-kube-api-access-7p9lk\") pod \"nova-api-0\" (UID: \"40ddee50-ee8d-4c6f-b2c7-e52aed486166\") " pod="openstack/nova-api-0" Dec 04 12:24:38.730219 master-0 kubenswrapper[35367]: I1204 12:24:38.730147 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-0" Dec 04 12:24:38.763617 master-0 kubenswrapper[35367]: I1204 12:24:38.763564 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ea1e7a2-77eb-4694-a0db-8f912e74591b" path="/var/lib/kubelet/pods/2ea1e7a2-77eb-4694-a0db-8f912e74591b/volumes" Dec 04 12:24:39.209138 master-0 kubenswrapper[35367]: W1204 12:24:39.208689 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40ddee50_ee8d_4c6f_b2c7_e52aed486166.slice/crio-f0dbdfa1b7cca2a2bffc084267d2b1355508987bf9db5f08e4b944a1319b9b9b WatchSource:0}: Error finding container f0dbdfa1b7cca2a2bffc084267d2b1355508987bf9db5f08e4b944a1319b9b9b: Status 404 returned error can't find the container with id f0dbdfa1b7cca2a2bffc084267d2b1355508987bf9db5f08e4b944a1319b9b9b Dec 04 12:24:39.215201 master-0 kubenswrapper[35367]: I1204 12:24:39.211673 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-0"] Dec 04 12:24:39.288357 master-0 kubenswrapper[35367]: I1204 12:24:39.288278 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"40ddee50-ee8d-4c6f-b2c7-e52aed486166","Type":"ContainerStarted","Data":"f0dbdfa1b7cca2a2bffc084267d2b1355508987bf9db5f08e4b944a1319b9b9b"} Dec 04 12:24:40.305025 master-0 kubenswrapper[35367]: I1204 12:24:40.304974 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"40ddee50-ee8d-4c6f-b2c7-e52aed486166","Type":"ContainerStarted","Data":"899d57233404e778e6beb5450c8e5d7e8813539ee52110ef83ae8b51cec18fef"} Dec 04 12:24:40.305713 master-0 kubenswrapper[35367]: I1204 12:24:40.305693 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-0" event={"ID":"40ddee50-ee8d-4c6f-b2c7-e52aed486166","Type":"ContainerStarted","Data":"afdc1055e0058022b8765bf5d292a1e641b2f0c9d6e1c5ef061ab9d737b4b9b5"} Dec 04 12:24:40.342144 master-0 kubenswrapper[35367]: I1204 12:24:40.341958 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-api-0" podStartSLOduration=2.341931923 podStartE2EDuration="2.341931923s" podCreationTimestamp="2025-12-04 12:24:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:24:40.334091034 +0000 UTC m=+1523.772152292" watchObservedRunningTime="2025-12-04 12:24:40.341931923 +0000 UTC m=+1523.779993181" Dec 04 12:24:40.957865 master-0 kubenswrapper[35367]: E1204 12:24:40.957701 35367 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 7b70eda49845092233b0b8884b1d0bb50b32ae874fc21a7ac62b2382cd51ee73 is running failed: container process not found" containerID="7b70eda49845092233b0b8884b1d0bb50b32ae874fc21a7ac62b2382cd51ee73" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Dec 04 12:24:40.958346 master-0 kubenswrapper[35367]: E1204 12:24:40.958265 35367 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 7b70eda49845092233b0b8884b1d0bb50b32ae874fc21a7ac62b2382cd51ee73 is running failed: container process not found" containerID="7b70eda49845092233b0b8884b1d0bb50b32ae874fc21a7ac62b2382cd51ee73" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Dec 04 12:24:40.958737 master-0 kubenswrapper[35367]: E1204 12:24:40.958694 35367 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 7b70eda49845092233b0b8884b1d0bb50b32ae874fc21a7ac62b2382cd51ee73 is running failed: container process not found" containerID="7b70eda49845092233b0b8884b1d0bb50b32ae874fc21a7ac62b2382cd51ee73" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Dec 04 12:24:40.958917 master-0 kubenswrapper[35367]: E1204 12:24:40.958739 35367 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 7b70eda49845092233b0b8884b1d0bb50b32ae874fc21a7ac62b2382cd51ee73 is running failed: container process not found" probeType="Readiness" pod="openstack/nova-scheduler-0" podUID="46e5cf34-acb7-41c5-acf4-45bfdc3b1051" containerName="nova-scheduler-scheduler" Dec 04 12:24:41.323236 master-0 kubenswrapper[35367]: I1204 12:24:41.323194 35367 generic.go:334] "Generic (PLEG): container finished" podID="46e5cf34-acb7-41c5-acf4-45bfdc3b1051" containerID="7b70eda49845092233b0b8884b1d0bb50b32ae874fc21a7ac62b2382cd51ee73" exitCode=0 Dec 04 12:24:41.323945 master-0 kubenswrapper[35367]: I1204 12:24:41.323860 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-0" event={"ID":"46e5cf34-acb7-41c5-acf4-45bfdc3b1051","Type":"ContainerDied","Data":"7b70eda49845092233b0b8884b1d0bb50b32ae874fc21a7ac62b2382cd51ee73"} Dec 04 12:24:41.324062 master-0 kubenswrapper[35367]: I1204 12:24:41.324043 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-0" event={"ID":"46e5cf34-acb7-41c5-acf4-45bfdc3b1051","Type":"ContainerDied","Data":"834825b973b4d9f323dd5c4acb4b23c390bb2ecbe0fc13802e3117e4cf341864"} Dec 04 12:24:41.324171 master-0 kubenswrapper[35367]: I1204 12:24:41.324156 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="834825b973b4d9f323dd5c4acb4b23c390bb2ecbe0fc13802e3117e4cf341864" Dec 04 12:24:41.327058 master-0 kubenswrapper[35367]: I1204 12:24:41.327035 35367 generic.go:334] "Generic (PLEG): container finished" podID="48092d7d-03c3-4ffe-92b1-34ade239b127" containerID="4acb0c53fd969f2a07fbaed27d57bb227241ca9e652a5f7da9abc02ec8385c6f" exitCode=0 Dec 04 12:24:41.327439 master-0 kubenswrapper[35367]: I1204 12:24:41.327403 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"48092d7d-03c3-4ffe-92b1-34ade239b127","Type":"ContainerDied","Data":"4acb0c53fd969f2a07fbaed27d57bb227241ca9e652a5f7da9abc02ec8385c6f"} Dec 04 12:24:41.327506 master-0 kubenswrapper[35367]: I1204 12:24:41.327446 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"48092d7d-03c3-4ffe-92b1-34ade239b127","Type":"ContainerDied","Data":"83dc5f3a40cf10893a6687ccccb07882c200a202ae90488af141539a000015b5"} Dec 04 12:24:41.327506 master-0 kubenswrapper[35367]: I1204 12:24:41.327459 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83dc5f3a40cf10893a6687ccccb07882c200a202ae90488af141539a000015b5" Dec 04 12:24:41.343515 master-0 kubenswrapper[35367]: I1204 12:24:41.343460 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 12:24:41.352435 master-0 kubenswrapper[35367]: I1204 12:24:41.352259 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-0" Dec 04 12:24:41.402392 master-0 kubenswrapper[35367]: I1204 12:24:41.402238 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/48092d7d-03c3-4ffe-92b1-34ade239b127-logs\") pod \"48092d7d-03c3-4ffe-92b1-34ade239b127\" (UID: \"48092d7d-03c3-4ffe-92b1-34ade239b127\") " Dec 04 12:24:41.402392 master-0 kubenswrapper[35367]: I1204 12:24:41.402380 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48092d7d-03c3-4ffe-92b1-34ade239b127-config-data\") pod \"48092d7d-03c3-4ffe-92b1-34ade239b127\" (UID: \"48092d7d-03c3-4ffe-92b1-34ade239b127\") " Dec 04 12:24:41.402754 master-0 kubenswrapper[35367]: I1204 12:24:41.402428 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48092d7d-03c3-4ffe-92b1-34ade239b127-combined-ca-bundle\") pod \"48092d7d-03c3-4ffe-92b1-34ade239b127\" (UID: \"48092d7d-03c3-4ffe-92b1-34ade239b127\") " Dec 04 12:24:41.402754 master-0 kubenswrapper[35367]: I1204 12:24:41.402651 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/48092d7d-03c3-4ffe-92b1-34ade239b127-nova-metadata-tls-certs\") pod \"48092d7d-03c3-4ffe-92b1-34ade239b127\" (UID: \"48092d7d-03c3-4ffe-92b1-34ade239b127\") " Dec 04 12:24:41.402906 master-0 kubenswrapper[35367]: I1204 12:24:41.402846 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ll2rr\" (UniqueName: \"kubernetes.io/projected/48092d7d-03c3-4ffe-92b1-34ade239b127-kube-api-access-ll2rr\") pod \"48092d7d-03c3-4ffe-92b1-34ade239b127\" (UID: \"48092d7d-03c3-4ffe-92b1-34ade239b127\") " Dec 04 12:24:41.406721 master-0 kubenswrapper[35367]: I1204 12:24:41.406662 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48092d7d-03c3-4ffe-92b1-34ade239b127-logs" (OuterVolumeSpecName: "logs") pod "48092d7d-03c3-4ffe-92b1-34ade239b127" (UID: "48092d7d-03c3-4ffe-92b1-34ade239b127"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:24:41.409621 master-0 kubenswrapper[35367]: I1204 12:24:41.409557 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48092d7d-03c3-4ffe-92b1-34ade239b127-kube-api-access-ll2rr" (OuterVolumeSpecName: "kube-api-access-ll2rr") pod "48092d7d-03c3-4ffe-92b1-34ade239b127" (UID: "48092d7d-03c3-4ffe-92b1-34ade239b127"). InnerVolumeSpecName "kube-api-access-ll2rr". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:24:41.444832 master-0 kubenswrapper[35367]: I1204 12:24:41.444734 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48092d7d-03c3-4ffe-92b1-34ade239b127-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "48092d7d-03c3-4ffe-92b1-34ade239b127" (UID: "48092d7d-03c3-4ffe-92b1-34ade239b127"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:24:41.452087 master-0 kubenswrapper[35367]: I1204 12:24:41.452022 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48092d7d-03c3-4ffe-92b1-34ade239b127-config-data" (OuterVolumeSpecName: "config-data") pod "48092d7d-03c3-4ffe-92b1-34ade239b127" (UID: "48092d7d-03c3-4ffe-92b1-34ade239b127"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:24:41.504177 master-0 kubenswrapper[35367]: I1204 12:24:41.504051 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48092d7d-03c3-4ffe-92b1-34ade239b127-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "48092d7d-03c3-4ffe-92b1-34ade239b127" (UID: "48092d7d-03c3-4ffe-92b1-34ade239b127"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:24:41.505093 master-0 kubenswrapper[35367]: I1204 12:24:41.505041 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46e5cf34-acb7-41c5-acf4-45bfdc3b1051-combined-ca-bundle\") pod \"46e5cf34-acb7-41c5-acf4-45bfdc3b1051\" (UID: \"46e5cf34-acb7-41c5-acf4-45bfdc3b1051\") " Dec 04 12:24:41.505400 master-0 kubenswrapper[35367]: I1204 12:24:41.505369 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8dtn\" (UniqueName: \"kubernetes.io/projected/46e5cf34-acb7-41c5-acf4-45bfdc3b1051-kube-api-access-n8dtn\") pod \"46e5cf34-acb7-41c5-acf4-45bfdc3b1051\" (UID: \"46e5cf34-acb7-41c5-acf4-45bfdc3b1051\") " Dec 04 12:24:41.505634 master-0 kubenswrapper[35367]: I1204 12:24:41.505598 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46e5cf34-acb7-41c5-acf4-45bfdc3b1051-config-data\") pod \"46e5cf34-acb7-41c5-acf4-45bfdc3b1051\" (UID: \"46e5cf34-acb7-41c5-acf4-45bfdc3b1051\") " Dec 04 12:24:41.506394 master-0 kubenswrapper[35367]: I1204 12:24:41.506363 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48092d7d-03c3-4ffe-92b1-34ade239b127-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:41.506394 master-0 kubenswrapper[35367]: I1204 12:24:41.506389 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48092d7d-03c3-4ffe-92b1-34ade239b127-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:41.506528 master-0 kubenswrapper[35367]: I1204 12:24:41.506404 35367 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/48092d7d-03c3-4ffe-92b1-34ade239b127-nova-metadata-tls-certs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:41.506528 master-0 kubenswrapper[35367]: I1204 12:24:41.506416 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ll2rr\" (UniqueName: \"kubernetes.io/projected/48092d7d-03c3-4ffe-92b1-34ade239b127-kube-api-access-ll2rr\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:41.506528 master-0 kubenswrapper[35367]: I1204 12:24:41.506426 35367 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/48092d7d-03c3-4ffe-92b1-34ade239b127-logs\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:41.509358 master-0 kubenswrapper[35367]: I1204 12:24:41.509297 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46e5cf34-acb7-41c5-acf4-45bfdc3b1051-kube-api-access-n8dtn" (OuterVolumeSpecName: "kube-api-access-n8dtn") pod "46e5cf34-acb7-41c5-acf4-45bfdc3b1051" (UID: "46e5cf34-acb7-41c5-acf4-45bfdc3b1051"). InnerVolumeSpecName "kube-api-access-n8dtn". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:24:41.540733 master-0 kubenswrapper[35367]: I1204 12:24:41.540590 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46e5cf34-acb7-41c5-acf4-45bfdc3b1051-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "46e5cf34-acb7-41c5-acf4-45bfdc3b1051" (UID: "46e5cf34-acb7-41c5-acf4-45bfdc3b1051"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:24:41.543618 master-0 kubenswrapper[35367]: I1204 12:24:41.543539 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46e5cf34-acb7-41c5-acf4-45bfdc3b1051-config-data" (OuterVolumeSpecName: "config-data") pod "46e5cf34-acb7-41c5-acf4-45bfdc3b1051" (UID: "46e5cf34-acb7-41c5-acf4-45bfdc3b1051"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:24:41.608907 master-0 kubenswrapper[35367]: I1204 12:24:41.608829 35367 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46e5cf34-acb7-41c5-acf4-45bfdc3b1051-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:41.608907 master-0 kubenswrapper[35367]: I1204 12:24:41.608887 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-n8dtn\" (UniqueName: \"kubernetes.io/projected/46e5cf34-acb7-41c5-acf4-45bfdc3b1051-kube-api-access-n8dtn\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:41.608907 master-0 kubenswrapper[35367]: I1204 12:24:41.608902 35367 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46e5cf34-acb7-41c5-acf4-45bfdc3b1051-config-data\") on node \"master-0\" DevicePath \"\"" Dec 04 12:24:42.342195 master-0 kubenswrapper[35367]: I1204 12:24:42.342104 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-0" Dec 04 12:24:42.342790 master-0 kubenswrapper[35367]: I1204 12:24:42.342207 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 12:24:42.405781 master-0 kubenswrapper[35367]: I1204 12:24:42.405717 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 12:24:42.441517 master-0 kubenswrapper[35367]: I1204 12:24:42.441447 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 12:24:42.460679 master-0 kubenswrapper[35367]: I1204 12:24:42.460631 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 12:24:42.474463 master-0 kubenswrapper[35367]: I1204 12:24:42.474401 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 12:24:42.490504 master-0 kubenswrapper[35367]: I1204 12:24:42.490416 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-metadata-0"] Dec 04 12:24:42.491720 master-0 kubenswrapper[35367]: E1204 12:24:42.491696 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="48092d7d-03c3-4ffe-92b1-34ade239b127" containerName="nova-metadata-log" Dec 04 12:24:42.491855 master-0 kubenswrapper[35367]: I1204 12:24:42.491838 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="48092d7d-03c3-4ffe-92b1-34ade239b127" containerName="nova-metadata-log" Dec 04 12:24:42.491974 master-0 kubenswrapper[35367]: E1204 12:24:42.491958 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="48092d7d-03c3-4ffe-92b1-34ade239b127" containerName="nova-metadata-metadata" Dec 04 12:24:42.492065 master-0 kubenswrapper[35367]: I1204 12:24:42.492051 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="48092d7d-03c3-4ffe-92b1-34ade239b127" containerName="nova-metadata-metadata" Dec 04 12:24:42.492182 master-0 kubenswrapper[35367]: E1204 12:24:42.492167 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="46e5cf34-acb7-41c5-acf4-45bfdc3b1051" containerName="nova-scheduler-scheduler" Dec 04 12:24:42.492261 master-0 kubenswrapper[35367]: I1204 12:24:42.492247 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="46e5cf34-acb7-41c5-acf4-45bfdc3b1051" containerName="nova-scheduler-scheduler" Dec 04 12:24:42.492791 master-0 kubenswrapper[35367]: I1204 12:24:42.492769 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="46e5cf34-acb7-41c5-acf4-45bfdc3b1051" containerName="nova-scheduler-scheduler" Dec 04 12:24:42.493607 master-0 kubenswrapper[35367]: I1204 12:24:42.493582 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="48092d7d-03c3-4ffe-92b1-34ade239b127" containerName="nova-metadata-metadata" Dec 04 12:24:42.493714 master-0 kubenswrapper[35367]: I1204 12:24:42.493699 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="48092d7d-03c3-4ffe-92b1-34ade239b127" containerName="nova-metadata-log" Dec 04 12:24:42.515052 master-0 kubenswrapper[35367]: I1204 12:24:42.514963 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 12:24:42.526575 master-0 kubenswrapper[35367]: I1204 12:24:42.526508 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-metadata-config-data" Dec 04 12:24:42.527280 master-0 kubenswrapper[35367]: I1204 12:24:42.527216 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-metadata-internal-svc" Dec 04 12:24:42.540692 master-0 kubenswrapper[35367]: I1204 12:24:42.540616 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 12:24:42.545833 master-0 kubenswrapper[35367]: I1204 12:24:42.545546 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-0" Dec 04 12:24:42.567863 master-0 kubenswrapper[35367]: I1204 12:24:42.567729 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-scheduler-config-data" Dec 04 12:24:42.574574 master-0 kubenswrapper[35367]: I1204 12:24:42.574436 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 12:24:42.601020 master-0 kubenswrapper[35367]: I1204 12:24:42.598143 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 12:24:42.644286 master-0 kubenswrapper[35367]: I1204 12:24:42.644215 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkzn6\" (UniqueName: \"kubernetes.io/projected/4bb05669-5dc0-4685-aa20-8da1294f1ecb-kube-api-access-tkzn6\") pod \"nova-scheduler-0\" (UID: \"4bb05669-5dc0-4685-aa20-8da1294f1ecb\") " pod="openstack/nova-scheduler-0" Dec 04 12:24:42.644574 master-0 kubenswrapper[35367]: I1204 12:24:42.644313 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bb05669-5dc0-4685-aa20-8da1294f1ecb-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"4bb05669-5dc0-4685-aa20-8da1294f1ecb\") " pod="openstack/nova-scheduler-0" Dec 04 12:24:42.644574 master-0 kubenswrapper[35367]: I1204 12:24:42.644344 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tpkh\" (UniqueName: \"kubernetes.io/projected/ff0031d1-94e8-47d8-9c9e-9d39caa7f69e-kube-api-access-6tpkh\") pod \"nova-metadata-0\" (UID: \"ff0031d1-94e8-47d8-9c9e-9d39caa7f69e\") " pod="openstack/nova-metadata-0" Dec 04 12:24:42.644574 master-0 kubenswrapper[35367]: I1204 12:24:42.644445 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff0031d1-94e8-47d8-9c9e-9d39caa7f69e-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ff0031d1-94e8-47d8-9c9e-9d39caa7f69e\") " pod="openstack/nova-metadata-0" Dec 04 12:24:42.644680 master-0 kubenswrapper[35367]: I1204 12:24:42.644610 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff0031d1-94e8-47d8-9c9e-9d39caa7f69e-config-data\") pod \"nova-metadata-0\" (UID: \"ff0031d1-94e8-47d8-9c9e-9d39caa7f69e\") " pod="openstack/nova-metadata-0" Dec 04 12:24:42.644773 master-0 kubenswrapper[35367]: I1204 12:24:42.644745 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ff0031d1-94e8-47d8-9c9e-9d39caa7f69e-logs\") pod \"nova-metadata-0\" (UID: \"ff0031d1-94e8-47d8-9c9e-9d39caa7f69e\") " pod="openstack/nova-metadata-0" Dec 04 12:24:42.644857 master-0 kubenswrapper[35367]: I1204 12:24:42.644814 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4bb05669-5dc0-4685-aa20-8da1294f1ecb-config-data\") pod \"nova-scheduler-0\" (UID: \"4bb05669-5dc0-4685-aa20-8da1294f1ecb\") " pod="openstack/nova-scheduler-0" Dec 04 12:24:42.644977 master-0 kubenswrapper[35367]: I1204 12:24:42.644950 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff0031d1-94e8-47d8-9c9e-9d39caa7f69e-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"ff0031d1-94e8-47d8-9c9e-9d39caa7f69e\") " pod="openstack/nova-metadata-0" Dec 04 12:24:42.748913 master-0 kubenswrapper[35367]: I1204 12:24:42.748830 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ff0031d1-94e8-47d8-9c9e-9d39caa7f69e-logs\") pod \"nova-metadata-0\" (UID: \"ff0031d1-94e8-47d8-9c9e-9d39caa7f69e\") " pod="openstack/nova-metadata-0" Dec 04 12:24:42.748913 master-0 kubenswrapper[35367]: I1204 12:24:42.748907 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4bb05669-5dc0-4685-aa20-8da1294f1ecb-config-data\") pod \"nova-scheduler-0\" (UID: \"4bb05669-5dc0-4685-aa20-8da1294f1ecb\") " pod="openstack/nova-scheduler-0" Dec 04 12:24:42.749476 master-0 kubenswrapper[35367]: I1204 12:24:42.748994 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff0031d1-94e8-47d8-9c9e-9d39caa7f69e-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"ff0031d1-94e8-47d8-9c9e-9d39caa7f69e\") " pod="openstack/nova-metadata-0" Dec 04 12:24:42.749476 master-0 kubenswrapper[35367]: I1204 12:24:42.749093 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tkzn6\" (UniqueName: \"kubernetes.io/projected/4bb05669-5dc0-4685-aa20-8da1294f1ecb-kube-api-access-tkzn6\") pod \"nova-scheduler-0\" (UID: \"4bb05669-5dc0-4685-aa20-8da1294f1ecb\") " pod="openstack/nova-scheduler-0" Dec 04 12:24:42.749476 master-0 kubenswrapper[35367]: I1204 12:24:42.749138 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bb05669-5dc0-4685-aa20-8da1294f1ecb-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"4bb05669-5dc0-4685-aa20-8da1294f1ecb\") " pod="openstack/nova-scheduler-0" Dec 04 12:24:42.749476 master-0 kubenswrapper[35367]: I1204 12:24:42.749172 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6tpkh\" (UniqueName: \"kubernetes.io/projected/ff0031d1-94e8-47d8-9c9e-9d39caa7f69e-kube-api-access-6tpkh\") pod \"nova-metadata-0\" (UID: \"ff0031d1-94e8-47d8-9c9e-9d39caa7f69e\") " pod="openstack/nova-metadata-0" Dec 04 12:24:42.749476 master-0 kubenswrapper[35367]: I1204 12:24:42.749326 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff0031d1-94e8-47d8-9c9e-9d39caa7f69e-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ff0031d1-94e8-47d8-9c9e-9d39caa7f69e\") " pod="openstack/nova-metadata-0" Dec 04 12:24:42.749476 master-0 kubenswrapper[35367]: I1204 12:24:42.749387 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff0031d1-94e8-47d8-9c9e-9d39caa7f69e-config-data\") pod \"nova-metadata-0\" (UID: \"ff0031d1-94e8-47d8-9c9e-9d39caa7f69e\") " pod="openstack/nova-metadata-0" Dec 04 12:24:42.750031 master-0 kubenswrapper[35367]: I1204 12:24:42.750003 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ff0031d1-94e8-47d8-9c9e-9d39caa7f69e-logs\") pod \"nova-metadata-0\" (UID: \"ff0031d1-94e8-47d8-9c9e-9d39caa7f69e\") " pod="openstack/nova-metadata-0" Dec 04 12:24:42.755329 master-0 kubenswrapper[35367]: I1204 12:24:42.754424 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4bb05669-5dc0-4685-aa20-8da1294f1ecb-config-data\") pod \"nova-scheduler-0\" (UID: \"4bb05669-5dc0-4685-aa20-8da1294f1ecb\") " pod="openstack/nova-scheduler-0" Dec 04 12:24:42.755329 master-0 kubenswrapper[35367]: I1204 12:24:42.754535 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff0031d1-94e8-47d8-9c9e-9d39caa7f69e-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ff0031d1-94e8-47d8-9c9e-9d39caa7f69e\") " pod="openstack/nova-metadata-0" Dec 04 12:24:42.755329 master-0 kubenswrapper[35367]: I1204 12:24:42.754724 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff0031d1-94e8-47d8-9c9e-9d39caa7f69e-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"ff0031d1-94e8-47d8-9c9e-9d39caa7f69e\") " pod="openstack/nova-metadata-0" Dec 04 12:24:42.755785 master-0 kubenswrapper[35367]: I1204 12:24:42.755665 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bb05669-5dc0-4685-aa20-8da1294f1ecb-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"4bb05669-5dc0-4685-aa20-8da1294f1ecb\") " pod="openstack/nova-scheduler-0" Dec 04 12:24:42.756874 master-0 kubenswrapper[35367]: I1204 12:24:42.756849 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff0031d1-94e8-47d8-9c9e-9d39caa7f69e-config-data\") pod \"nova-metadata-0\" (UID: \"ff0031d1-94e8-47d8-9c9e-9d39caa7f69e\") " pod="openstack/nova-metadata-0" Dec 04 12:24:42.771719 master-0 kubenswrapper[35367]: I1204 12:24:42.771651 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tpkh\" (UniqueName: \"kubernetes.io/projected/ff0031d1-94e8-47d8-9c9e-9d39caa7f69e-kube-api-access-6tpkh\") pod \"nova-metadata-0\" (UID: \"ff0031d1-94e8-47d8-9c9e-9d39caa7f69e\") " pod="openstack/nova-metadata-0" Dec 04 12:24:42.773085 master-0 kubenswrapper[35367]: I1204 12:24:42.773011 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46e5cf34-acb7-41c5-acf4-45bfdc3b1051" path="/var/lib/kubelet/pods/46e5cf34-acb7-41c5-acf4-45bfdc3b1051/volumes" Dec 04 12:24:42.773892 master-0 kubenswrapper[35367]: I1204 12:24:42.773861 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48092d7d-03c3-4ffe-92b1-34ade239b127" path="/var/lib/kubelet/pods/48092d7d-03c3-4ffe-92b1-34ade239b127/volumes" Dec 04 12:24:42.787378 master-0 kubenswrapper[35367]: I1204 12:24:42.787334 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkzn6\" (UniqueName: \"kubernetes.io/projected/4bb05669-5dc0-4685-aa20-8da1294f1ecb-kube-api-access-tkzn6\") pod \"nova-scheduler-0\" (UID: \"4bb05669-5dc0-4685-aa20-8da1294f1ecb\") " pod="openstack/nova-scheduler-0" Dec 04 12:24:42.893387 master-0 kubenswrapper[35367]: I1204 12:24:42.893055 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-0" Dec 04 12:24:42.910656 master-0 kubenswrapper[35367]: I1204 12:24:42.910540 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-0" Dec 04 12:24:43.427335 master-0 kubenswrapper[35367]: W1204 12:24:43.427256 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff0031d1_94e8_47d8_9c9e_9d39caa7f69e.slice/crio-8ccc1602456ee993d2a872f08785cadeb6ddcf156234f600a727f05a541f850d WatchSource:0}: Error finding container 8ccc1602456ee993d2a872f08785cadeb6ddcf156234f600a727f05a541f850d: Status 404 returned error can't find the container with id 8ccc1602456ee993d2a872f08785cadeb6ddcf156234f600a727f05a541f850d Dec 04 12:24:43.441631 master-0 kubenswrapper[35367]: I1204 12:24:43.441401 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-metadata-0"] Dec 04 12:24:43.553481 master-0 kubenswrapper[35367]: W1204 12:24:43.550212 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bb05669_5dc0_4685_aa20_8da1294f1ecb.slice/crio-50790e62e684e5d2ca94eea56b084b5ff3a04f7e1c2676c174b514222afe095e WatchSource:0}: Error finding container 50790e62e684e5d2ca94eea56b084b5ff3a04f7e1c2676c174b514222afe095e: Status 404 returned error can't find the container with id 50790e62e684e5d2ca94eea56b084b5ff3a04f7e1c2676c174b514222afe095e Dec 04 12:24:43.553481 master-0 kubenswrapper[35367]: I1204 12:24:43.552279 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-scheduler-0"] Dec 04 12:24:44.370507 master-0 kubenswrapper[35367]: I1204 12:24:44.370408 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-0" event={"ID":"4bb05669-5dc0-4685-aa20-8da1294f1ecb","Type":"ContainerStarted","Data":"87645a46c15567e35f486da7483d826c344bf5549958ac3cf6444e1b74b7a6cc"} Dec 04 12:24:44.370783 master-0 kubenswrapper[35367]: I1204 12:24:44.370546 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-0" event={"ID":"4bb05669-5dc0-4685-aa20-8da1294f1ecb","Type":"ContainerStarted","Data":"50790e62e684e5d2ca94eea56b084b5ff3a04f7e1c2676c174b514222afe095e"} Dec 04 12:24:44.372828 master-0 kubenswrapper[35367]: I1204 12:24:44.372755 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"ff0031d1-94e8-47d8-9c9e-9d39caa7f69e","Type":"ContainerStarted","Data":"2e182c3270f4e3a4076dcf1887632eaf800a4c6f7c824a33fa24c1ff2c6d641d"} Dec 04 12:24:44.372966 master-0 kubenswrapper[35367]: I1204 12:24:44.372920 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"ff0031d1-94e8-47d8-9c9e-9d39caa7f69e","Type":"ContainerStarted","Data":"a2340a780a96100b659585a089d2aee32bc37b4e682bb01df0098a00a81aa398"} Dec 04 12:24:44.372966 master-0 kubenswrapper[35367]: I1204 12:24:44.372944 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-0" event={"ID":"ff0031d1-94e8-47d8-9c9e-9d39caa7f69e","Type":"ContainerStarted","Data":"8ccc1602456ee993d2a872f08785cadeb6ddcf156234f600a727f05a541f850d"} Dec 04 12:24:44.405654 master-0 kubenswrapper[35367]: I1204 12:24:44.405465 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-scheduler-0" podStartSLOduration=2.405439381 podStartE2EDuration="2.405439381s" podCreationTimestamp="2025-12-04 12:24:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:24:44.403565792 +0000 UTC m=+1527.841627050" watchObservedRunningTime="2025-12-04 12:24:44.405439381 +0000 UTC m=+1527.843500649" Dec 04 12:24:44.456321 master-0 kubenswrapper[35367]: I1204 12:24:44.456188 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-metadata-0" podStartSLOduration=2.456160664 podStartE2EDuration="2.456160664s" podCreationTimestamp="2025-12-04 12:24:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:24:44.435221839 +0000 UTC m=+1527.873283097" watchObservedRunningTime="2025-12-04 12:24:44.456160664 +0000 UTC m=+1527.894221922" Dec 04 12:24:45.915422 master-0 kubenswrapper[35367]: I1204 12:24:45.915313 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/nova-metadata-0" podUID="48092d7d-03c3-4ffe-92b1-34ade239b127" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.128.1.39:8775/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 12:24:45.915422 master-0 kubenswrapper[35367]: I1204 12:24:45.915394 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/nova-metadata-0" podUID="48092d7d-03c3-4ffe-92b1-34ade239b127" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.128.1.39:8775/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Dec 04 12:24:47.893860 master-0 kubenswrapper[35367]: I1204 12:24:47.893767 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-metadata-0" Dec 04 12:24:47.893860 master-0 kubenswrapper[35367]: I1204 12:24:47.893864 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-metadata-0" Dec 04 12:24:47.913862 master-0 kubenswrapper[35367]: I1204 12:24:47.910822 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-scheduler-0" Dec 04 12:24:48.731418 master-0 kubenswrapper[35367]: I1204 12:24:48.731346 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-api-0" Dec 04 12:24:48.731908 master-0 kubenswrapper[35367]: I1204 12:24:48.731890 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-api-0" Dec 04 12:24:49.743074 master-0 kubenswrapper[35367]: I1204 12:24:49.742973 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-api-0" podUID="40ddee50-ee8d-4c6f-b2c7-e52aed486166" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.128.1.47:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 12:24:49.743074 master-0 kubenswrapper[35367]: I1204 12:24:49.743022 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-api-0" podUID="40ddee50-ee8d-4c6f-b2c7-e52aed486166" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.128.1.47:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 12:24:52.893926 master-0 kubenswrapper[35367]: I1204 12:24:52.893850 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-metadata-0" Dec 04 12:24:52.893926 master-0 kubenswrapper[35367]: I1204 12:24:52.893922 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-metadata-0" Dec 04 12:24:52.911399 master-0 kubenswrapper[35367]: I1204 12:24:52.911331 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-scheduler-0" Dec 04 12:24:52.945393 master-0 kubenswrapper[35367]: I1204 12:24:52.945269 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-scheduler-0" Dec 04 12:24:53.534627 master-0 kubenswrapper[35367]: I1204 12:24:53.534569 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-scheduler-0" Dec 04 12:24:53.905140 master-0 kubenswrapper[35367]: I1204 12:24:53.905046 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-metadata-0" podUID="ff0031d1-94e8-47d8-9c9e-9d39caa7f69e" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.128.1.48:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 12:24:53.906366 master-0 kubenswrapper[35367]: I1204 12:24:53.906332 35367 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-metadata-0" podUID="ff0031d1-94e8-47d8-9c9e-9d39caa7f69e" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.128.1.48:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Dec 04 12:24:58.738657 master-0 kubenswrapper[35367]: I1204 12:24:58.738575 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-api-0" Dec 04 12:24:58.739459 master-0 kubenswrapper[35367]: I1204 12:24:58.739202 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-api-0" Dec 04 12:24:58.739598 master-0 kubenswrapper[35367]: I1204 12:24:58.739543 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-api-0" Dec 04 12:24:58.746221 master-0 kubenswrapper[35367]: I1204 12:24:58.746142 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-api-0" Dec 04 12:24:59.582886 master-0 kubenswrapper[35367]: I1204 12:24:59.582744 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-api-0" Dec 04 12:24:59.590906 master-0 kubenswrapper[35367]: I1204 12:24:59.590856 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-api-0" Dec 04 12:25:02.898786 master-0 kubenswrapper[35367]: I1204 12:25:02.898714 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-metadata-0" Dec 04 12:25:02.900548 master-0 kubenswrapper[35367]: I1204 12:25:02.900511 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-metadata-0" Dec 04 12:25:02.902740 master-0 kubenswrapper[35367]: I1204 12:25:02.902702 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-metadata-0" Dec 04 12:25:03.642322 master-0 kubenswrapper[35367]: I1204 12:25:03.642242 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-metadata-0" Dec 04 12:25:31.757335 master-0 kubenswrapper[35367]: I1204 12:25:31.757244 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["sushy-emulator/sushy-emulator-58f4c9b998-s5z49"] Dec 04 12:25:31.758501 master-0 kubenswrapper[35367]: I1204 12:25:31.758453 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" podUID="68867d4a-c865-4af5-aea8-12cdfe1eab01" containerName="sushy-emulator" containerID="cri-o://5957b2ec98e35e11b19fcc5e5fed6560a12db2d0882f0029ba4496d93d35a2e2" gracePeriod=30 Dec 04 12:25:32.030100 master-0 kubenswrapper[35367]: I1204 12:25:32.029918 35367 generic.go:334] "Generic (PLEG): container finished" podID="68867d4a-c865-4af5-aea8-12cdfe1eab01" containerID="5957b2ec98e35e11b19fcc5e5fed6560a12db2d0882f0029ba4496d93d35a2e2" exitCode=0 Dec 04 12:25:32.030100 master-0 kubenswrapper[35367]: I1204 12:25:32.030010 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" event={"ID":"68867d4a-c865-4af5-aea8-12cdfe1eab01","Type":"ContainerDied","Data":"5957b2ec98e35e11b19fcc5e5fed6560a12db2d0882f0029ba4496d93d35a2e2"} Dec 04 12:25:32.422868 master-0 kubenswrapper[35367]: I1204 12:25:32.422776 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" Dec 04 12:25:32.565848 master-0 kubenswrapper[35367]: I1204 12:25:32.565773 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"os-client-config\" (UniqueName: \"kubernetes.io/secret/68867d4a-c865-4af5-aea8-12cdfe1eab01-os-client-config\") pod \"68867d4a-c865-4af5-aea8-12cdfe1eab01\" (UID: \"68867d4a-c865-4af5-aea8-12cdfe1eab01\") " Dec 04 12:25:32.566196 master-0 kubenswrapper[35367]: I1204 12:25:32.566161 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sushy-emulator-config\" (UniqueName: \"kubernetes.io/configmap/68867d4a-c865-4af5-aea8-12cdfe1eab01-sushy-emulator-config\") pod \"68867d4a-c865-4af5-aea8-12cdfe1eab01\" (UID: \"68867d4a-c865-4af5-aea8-12cdfe1eab01\") " Dec 04 12:25:32.566288 master-0 kubenswrapper[35367]: I1204 12:25:32.566204 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bg7wh\" (UniqueName: \"kubernetes.io/projected/68867d4a-c865-4af5-aea8-12cdfe1eab01-kube-api-access-bg7wh\") pod \"68867d4a-c865-4af5-aea8-12cdfe1eab01\" (UID: \"68867d4a-c865-4af5-aea8-12cdfe1eab01\") " Dec 04 12:25:32.567354 master-0 kubenswrapper[35367]: I1204 12:25:32.566910 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68867d4a-c865-4af5-aea8-12cdfe1eab01-sushy-emulator-config" (OuterVolumeSpecName: "sushy-emulator-config") pod "68867d4a-c865-4af5-aea8-12cdfe1eab01" (UID: "68867d4a-c865-4af5-aea8-12cdfe1eab01"). InnerVolumeSpecName "sushy-emulator-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:25:32.567354 master-0 kubenswrapper[35367]: I1204 12:25:32.567253 35367 reconciler_common.go:293] "Volume detached for volume \"sushy-emulator-config\" (UniqueName: \"kubernetes.io/configmap/68867d4a-c865-4af5-aea8-12cdfe1eab01-sushy-emulator-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:25:32.574932 master-0 kubenswrapper[35367]: I1204 12:25:32.574163 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68867d4a-c865-4af5-aea8-12cdfe1eab01-kube-api-access-bg7wh" (OuterVolumeSpecName: "kube-api-access-bg7wh") pod "68867d4a-c865-4af5-aea8-12cdfe1eab01" (UID: "68867d4a-c865-4af5-aea8-12cdfe1eab01"). InnerVolumeSpecName "kube-api-access-bg7wh". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:25:32.575458 master-0 kubenswrapper[35367]: I1204 12:25:32.575411 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68867d4a-c865-4af5-aea8-12cdfe1eab01-os-client-config" (OuterVolumeSpecName: "os-client-config") pod "68867d4a-c865-4af5-aea8-12cdfe1eab01" (UID: "68867d4a-c865-4af5-aea8-12cdfe1eab01"). InnerVolumeSpecName "os-client-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:25:32.599280 master-0 kubenswrapper[35367]: I1204 12:25:32.599212 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["sushy-emulator/sushy-emulator-64488c485f-n6p6k"] Dec 04 12:25:32.600162 master-0 kubenswrapper[35367]: E1204 12:25:32.600134 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="68867d4a-c865-4af5-aea8-12cdfe1eab01" containerName="sushy-emulator" Dec 04 12:25:32.600222 master-0 kubenswrapper[35367]: I1204 12:25:32.600163 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="68867d4a-c865-4af5-aea8-12cdfe1eab01" containerName="sushy-emulator" Dec 04 12:25:32.600556 master-0 kubenswrapper[35367]: I1204 12:25:32.600529 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="68867d4a-c865-4af5-aea8-12cdfe1eab01" containerName="sushy-emulator" Dec 04 12:25:32.601925 master-0 kubenswrapper[35367]: I1204 12:25:32.601900 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="sushy-emulator/sushy-emulator-64488c485f-n6p6k" Dec 04 12:25:32.613690 master-0 kubenswrapper[35367]: I1204 12:25:32.613617 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["sushy-emulator/sushy-emulator-64488c485f-n6p6k"] Dec 04 12:25:32.670023 master-0 kubenswrapper[35367]: I1204 12:25:32.669966 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl64p\" (UniqueName: \"kubernetes.io/projected/7b0e9933-1d46-4d26-a1ac-9f5ef7dbbd07-kube-api-access-cl64p\") pod \"sushy-emulator-64488c485f-n6p6k\" (UID: \"7b0e9933-1d46-4d26-a1ac-9f5ef7dbbd07\") " pod="sushy-emulator/sushy-emulator-64488c485f-n6p6k" Dec 04 12:25:32.670310 master-0 kubenswrapper[35367]: I1204 12:25:32.670053 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sushy-emulator-config\" (UniqueName: \"kubernetes.io/configmap/7b0e9933-1d46-4d26-a1ac-9f5ef7dbbd07-sushy-emulator-config\") pod \"sushy-emulator-64488c485f-n6p6k\" (UID: \"7b0e9933-1d46-4d26-a1ac-9f5ef7dbbd07\") " pod="sushy-emulator/sushy-emulator-64488c485f-n6p6k" Dec 04 12:25:32.670310 master-0 kubenswrapper[35367]: I1204 12:25:32.670087 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-client-config\" (UniqueName: \"kubernetes.io/secret/7b0e9933-1d46-4d26-a1ac-9f5ef7dbbd07-os-client-config\") pod \"sushy-emulator-64488c485f-n6p6k\" (UID: \"7b0e9933-1d46-4d26-a1ac-9f5ef7dbbd07\") " pod="sushy-emulator/sushy-emulator-64488c485f-n6p6k" Dec 04 12:25:32.670310 master-0 kubenswrapper[35367]: I1204 12:25:32.670165 35367 reconciler_common.go:293] "Volume detached for volume \"os-client-config\" (UniqueName: \"kubernetes.io/secret/68867d4a-c865-4af5-aea8-12cdfe1eab01-os-client-config\") on node \"master-0\" DevicePath \"\"" Dec 04 12:25:32.670310 master-0 kubenswrapper[35367]: I1204 12:25:32.670179 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bg7wh\" (UniqueName: \"kubernetes.io/projected/68867d4a-c865-4af5-aea8-12cdfe1eab01-kube-api-access-bg7wh\") on node \"master-0\" DevicePath \"\"" Dec 04 12:25:32.772305 master-0 kubenswrapper[35367]: I1204 12:25:32.772234 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cl64p\" (UniqueName: \"kubernetes.io/projected/7b0e9933-1d46-4d26-a1ac-9f5ef7dbbd07-kube-api-access-cl64p\") pod \"sushy-emulator-64488c485f-n6p6k\" (UID: \"7b0e9933-1d46-4d26-a1ac-9f5ef7dbbd07\") " pod="sushy-emulator/sushy-emulator-64488c485f-n6p6k" Dec 04 12:25:32.772305 master-0 kubenswrapper[35367]: I1204 12:25:32.772323 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sushy-emulator-config\" (UniqueName: \"kubernetes.io/configmap/7b0e9933-1d46-4d26-a1ac-9f5ef7dbbd07-sushy-emulator-config\") pod \"sushy-emulator-64488c485f-n6p6k\" (UID: \"7b0e9933-1d46-4d26-a1ac-9f5ef7dbbd07\") " pod="sushy-emulator/sushy-emulator-64488c485f-n6p6k" Dec 04 12:25:32.772983 master-0 kubenswrapper[35367]: I1204 12:25:32.772359 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"os-client-config\" (UniqueName: \"kubernetes.io/secret/7b0e9933-1d46-4d26-a1ac-9f5ef7dbbd07-os-client-config\") pod \"sushy-emulator-64488c485f-n6p6k\" (UID: \"7b0e9933-1d46-4d26-a1ac-9f5ef7dbbd07\") " pod="sushy-emulator/sushy-emulator-64488c485f-n6p6k" Dec 04 12:25:32.774051 master-0 kubenswrapper[35367]: I1204 12:25:32.774000 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sushy-emulator-config\" (UniqueName: \"kubernetes.io/configmap/7b0e9933-1d46-4d26-a1ac-9f5ef7dbbd07-sushy-emulator-config\") pod \"sushy-emulator-64488c485f-n6p6k\" (UID: \"7b0e9933-1d46-4d26-a1ac-9f5ef7dbbd07\") " pod="sushy-emulator/sushy-emulator-64488c485f-n6p6k" Dec 04 12:25:32.777908 master-0 kubenswrapper[35367]: I1204 12:25:32.777857 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"os-client-config\" (UniqueName: \"kubernetes.io/secret/7b0e9933-1d46-4d26-a1ac-9f5ef7dbbd07-os-client-config\") pod \"sushy-emulator-64488c485f-n6p6k\" (UID: \"7b0e9933-1d46-4d26-a1ac-9f5ef7dbbd07\") " pod="sushy-emulator/sushy-emulator-64488c485f-n6p6k" Dec 04 12:25:32.790087 master-0 kubenswrapper[35367]: I1204 12:25:32.790014 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl64p\" (UniqueName: \"kubernetes.io/projected/7b0e9933-1d46-4d26-a1ac-9f5ef7dbbd07-kube-api-access-cl64p\") pod \"sushy-emulator-64488c485f-n6p6k\" (UID: \"7b0e9933-1d46-4d26-a1ac-9f5ef7dbbd07\") " pod="sushy-emulator/sushy-emulator-64488c485f-n6p6k" Dec 04 12:25:33.003738 master-0 kubenswrapper[35367]: I1204 12:25:33.003598 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="sushy-emulator/sushy-emulator-64488c485f-n6p6k" Dec 04 12:25:33.049976 master-0 kubenswrapper[35367]: I1204 12:25:33.049881 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" event={"ID":"68867d4a-c865-4af5-aea8-12cdfe1eab01","Type":"ContainerDied","Data":"3f6452a33c60e240011bd22b807da47011c045cfafac4479c7377bbc607d5087"} Dec 04 12:25:33.049976 master-0 kubenswrapper[35367]: I1204 12:25:33.049982 35367 scope.go:117] "RemoveContainer" containerID="5957b2ec98e35e11b19fcc5e5fed6560a12db2d0882f0029ba4496d93d35a2e2" Dec 04 12:25:33.050299 master-0 kubenswrapper[35367]: I1204 12:25:33.050008 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" Dec 04 12:25:33.168267 master-0 kubenswrapper[35367]: I1204 12:25:33.168194 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["sushy-emulator/sushy-emulator-58f4c9b998-s5z49"] Dec 04 12:25:33.187926 master-0 kubenswrapper[35367]: I1204 12:25:33.187613 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["sushy-emulator/sushy-emulator-58f4c9b998-s5z49"] Dec 04 12:25:33.259458 master-0 kubenswrapper[35367]: I1204 12:25:33.259276 35367 prober.go:107] "Probe failed" probeType="Readiness" pod="sushy-emulator/sushy-emulator-58f4c9b998-s5z49" podUID="68867d4a-c865-4af5-aea8-12cdfe1eab01" containerName="sushy-emulator" probeResult="failure" output="Get \"http://10.128.0.140:8000/redfish/v1\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Dec 04 12:25:33.582398 master-0 kubenswrapper[35367]: I1204 12:25:33.582307 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["sushy-emulator/sushy-emulator-64488c485f-n6p6k"] Dec 04 12:25:34.064966 master-0 kubenswrapper[35367]: I1204 12:25:34.064906 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="sushy-emulator/sushy-emulator-64488c485f-n6p6k" event={"ID":"7b0e9933-1d46-4d26-a1ac-9f5ef7dbbd07","Type":"ContainerStarted","Data":"0034385b09885ed121be23c9d754243df0afbdfb3ab7c5effd169ee4a13ef933"} Dec 04 12:25:34.064966 master-0 kubenswrapper[35367]: I1204 12:25:34.064970 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="sushy-emulator/sushy-emulator-64488c485f-n6p6k" event={"ID":"7b0e9933-1d46-4d26-a1ac-9f5ef7dbbd07","Type":"ContainerStarted","Data":"2412fb0b8f3d5ce2d66707ef7101fd5061cdef3d23407006800d77107133ae03"} Dec 04 12:25:34.087392 master-0 kubenswrapper[35367]: I1204 12:25:34.086596 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="sushy-emulator/sushy-emulator-64488c485f-n6p6k" podStartSLOduration=2.086575163 podStartE2EDuration="2.086575163s" podCreationTimestamp="2025-12-04 12:25:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:25:34.082610667 +0000 UTC m=+1577.520671925" watchObservedRunningTime="2025-12-04 12:25:34.086575163 +0000 UTC m=+1577.524636421" Dec 04 12:25:34.762536 master-0 kubenswrapper[35367]: I1204 12:25:34.762476 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68867d4a-c865-4af5-aea8-12cdfe1eab01" path="/var/lib/kubelet/pods/68867d4a-c865-4af5-aea8-12cdfe1eab01/volumes" Dec 04 12:25:43.004427 master-0 kubenswrapper[35367]: I1204 12:25:43.004247 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="sushy-emulator/sushy-emulator-64488c485f-n6p6k" Dec 04 12:25:43.004427 master-0 kubenswrapper[35367]: I1204 12:25:43.004375 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="sushy-emulator/sushy-emulator-64488c485f-n6p6k" Dec 04 12:25:43.017731 master-0 kubenswrapper[35367]: I1204 12:25:43.017621 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="sushy-emulator/sushy-emulator-64488c485f-n6p6k" Dec 04 12:25:43.191484 master-0 kubenswrapper[35367]: I1204 12:25:43.191409 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="sushy-emulator/sushy-emulator-64488c485f-n6p6k" Dec 04 12:26:33.891521 master-0 kubenswrapper[35367]: I1204 12:26:33.891434 35367 scope.go:117] "RemoveContainer" containerID="a913222148543b38b0b1e0fb13995110b0cb0450311b12a46bad5c5ba04ceaf2" Dec 04 12:26:33.932003 master-0 kubenswrapper[35367]: I1204 12:26:33.931936 35367 scope.go:117] "RemoveContainer" containerID="afc6f7b800f4487330bfbae59e7ef61902e013ed0ea9fdfba64f618bb4d23a22" Dec 04 12:26:33.959152 master-0 kubenswrapper[35367]: I1204 12:26:33.959095 35367 scope.go:117] "RemoveContainer" containerID="b2ec9d3e5687c1eedf0fb014c3ec7581d1b7d6a7de84cc3be719e2f052d2e220" Dec 04 12:27:34.090358 master-0 kubenswrapper[35367]: I1204 12:27:34.090285 35367 scope.go:117] "RemoveContainer" containerID="a3d463e996a76ce2d1379bf3356c4486289488e2f57b19406c3eb02c79133012" Dec 04 12:27:34.131365 master-0 kubenswrapper[35367]: I1204 12:27:34.131315 35367 scope.go:117] "RemoveContainer" containerID="d7272e51bee8f9e06cdec14f53ff7a99564d65be5814e4a7af599d830a9968ef" Dec 04 12:27:34.178622 master-0 kubenswrapper[35367]: I1204 12:27:34.178551 35367 scope.go:117] "RemoveContainer" containerID="3e2eb8b6c263a899f926c3170cf29da97564f0ab4b819fd34f371b9acff42037" Dec 04 12:28:07.413820 master-0 kubenswrapper[35367]: I1204 12:28:07.413707 35367 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack/cinder-0c69e-scheduler-0" podUID="50d10cf3-8e68-4afa-bd86-97b19b610658" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.128.1.10:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Dec 04 12:28:08.422343 master-0 kubenswrapper[35367]: I1204 12:28:08.422208 35367 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack/cinder-0c69e-backup-0" podUID="a3dabcca-0c5e-4068-b7de-ede07416b452" containerName="cinder-backup" probeResult="failure" output="Get \"http://10.128.1.4:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Dec 04 12:28:10.225220 master-0 kubenswrapper[35367]: I1204 12:28:10.225113 35367 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack/cinder-0c69e-volume-lvm-iscsi-0" podUID="b3e0fd68-8367-46c5-b57d-a9ec6c21188f" containerName="cinder-volume" probeResult="failure" output="Get \"http://10.128.1.3:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Dec 04 12:28:12.455163 master-0 kubenswrapper[35367]: I1204 12:28:12.455055 35367 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack/cinder-0c69e-scheduler-0" podUID="50d10cf3-8e68-4afa-bd86-97b19b610658" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.128.1.10:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Dec 04 12:29:24.667428 master-0 kubenswrapper[35367]: I1204 12:29:24.666750 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-dwgbt"] Dec 04 12:29:24.671693 master-0 kubenswrapper[35367]: I1204 12:29:24.671600 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-dwgbt" Dec 04 12:29:24.683316 master-0 kubenswrapper[35367]: I1204 12:29:24.682243 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-dwgbt"] Dec 04 12:29:24.734716 master-0 kubenswrapper[35367]: I1204 12:29:24.734643 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/bca90d9a-7305-4f53-b071-2fa5ef4f32d7-catalog-content\") pod \"certified-operators-dwgbt\" (UID: \"bca90d9a-7305-4f53-b071-2fa5ef4f32d7\") " pod="openshift-marketplace/certified-operators-dwgbt" Dec 04 12:29:24.735089 master-0 kubenswrapper[35367]: I1204 12:29:24.734847 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/bca90d9a-7305-4f53-b071-2fa5ef4f32d7-utilities\") pod \"certified-operators-dwgbt\" (UID: \"bca90d9a-7305-4f53-b071-2fa5ef4f32d7\") " pod="openshift-marketplace/certified-operators-dwgbt" Dec 04 12:29:24.735198 master-0 kubenswrapper[35367]: I1204 12:29:24.735153 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8tg9\" (UniqueName: \"kubernetes.io/projected/bca90d9a-7305-4f53-b071-2fa5ef4f32d7-kube-api-access-p8tg9\") pod \"certified-operators-dwgbt\" (UID: \"bca90d9a-7305-4f53-b071-2fa5ef4f32d7\") " pod="openshift-marketplace/certified-operators-dwgbt" Dec 04 12:29:24.838247 master-0 kubenswrapper[35367]: I1204 12:29:24.838166 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/bca90d9a-7305-4f53-b071-2fa5ef4f32d7-catalog-content\") pod \"certified-operators-dwgbt\" (UID: \"bca90d9a-7305-4f53-b071-2fa5ef4f32d7\") " pod="openshift-marketplace/certified-operators-dwgbt" Dec 04 12:29:24.838752 master-0 kubenswrapper[35367]: I1204 12:29:24.838661 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/bca90d9a-7305-4f53-b071-2fa5ef4f32d7-utilities\") pod \"certified-operators-dwgbt\" (UID: \"bca90d9a-7305-4f53-b071-2fa5ef4f32d7\") " pod="openshift-marketplace/certified-operators-dwgbt" Dec 04 12:29:24.839261 master-0 kubenswrapper[35367]: I1204 12:29:24.839220 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/bca90d9a-7305-4f53-b071-2fa5ef4f32d7-catalog-content\") pod \"certified-operators-dwgbt\" (UID: \"bca90d9a-7305-4f53-b071-2fa5ef4f32d7\") " pod="openshift-marketplace/certified-operators-dwgbt" Dec 04 12:29:24.839330 master-0 kubenswrapper[35367]: I1204 12:29:24.839278 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/bca90d9a-7305-4f53-b071-2fa5ef4f32d7-utilities\") pod \"certified-operators-dwgbt\" (UID: \"bca90d9a-7305-4f53-b071-2fa5ef4f32d7\") " pod="openshift-marketplace/certified-operators-dwgbt" Dec 04 12:29:24.840653 master-0 kubenswrapper[35367]: I1204 12:29:24.840561 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p8tg9\" (UniqueName: \"kubernetes.io/projected/bca90d9a-7305-4f53-b071-2fa5ef4f32d7-kube-api-access-p8tg9\") pod \"certified-operators-dwgbt\" (UID: \"bca90d9a-7305-4f53-b071-2fa5ef4f32d7\") " pod="openshift-marketplace/certified-operators-dwgbt" Dec 04 12:29:24.862395 master-0 kubenswrapper[35367]: I1204 12:29:24.862308 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8tg9\" (UniqueName: \"kubernetes.io/projected/bca90d9a-7305-4f53-b071-2fa5ef4f32d7-kube-api-access-p8tg9\") pod \"certified-operators-dwgbt\" (UID: \"bca90d9a-7305-4f53-b071-2fa5ef4f32d7\") " pod="openshift-marketplace/certified-operators-dwgbt" Dec 04 12:29:25.035400 master-0 kubenswrapper[35367]: I1204 12:29:25.035189 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-dwgbt" Dec 04 12:29:25.617825 master-0 kubenswrapper[35367]: W1204 12:29:25.617710 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca90d9a_7305_4f53_b071_2fa5ef4f32d7.slice/crio-9fa2206c148e1c2be08b32a48cb2f8e7503647e83d8a82b70c38cf993a0e99dc WatchSource:0}: Error finding container 9fa2206c148e1c2be08b32a48cb2f8e7503647e83d8a82b70c38cf993a0e99dc: Status 404 returned error can't find the container with id 9fa2206c148e1c2be08b32a48cb2f8e7503647e83d8a82b70c38cf993a0e99dc Dec 04 12:29:25.618316 master-0 kubenswrapper[35367]: I1204 12:29:25.618130 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-dwgbt"] Dec 04 12:29:26.426873 master-0 kubenswrapper[35367]: I1204 12:29:26.426788 35367 generic.go:334] "Generic (PLEG): container finished" podID="bca90d9a-7305-4f53-b071-2fa5ef4f32d7" containerID="6abec9a96feadf74a8d8964b73882e3c67db942c1c3ef13e123b9e4e7c36a51f" exitCode=0 Dec 04 12:29:26.427569 master-0 kubenswrapper[35367]: I1204 12:29:26.427519 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-dwgbt" event={"ID":"bca90d9a-7305-4f53-b071-2fa5ef4f32d7","Type":"ContainerDied","Data":"6abec9a96feadf74a8d8964b73882e3c67db942c1c3ef13e123b9e4e7c36a51f"} Dec 04 12:29:26.427679 master-0 kubenswrapper[35367]: I1204 12:29:26.427663 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-dwgbt" event={"ID":"bca90d9a-7305-4f53-b071-2fa5ef4f32d7","Type":"ContainerStarted","Data":"9fa2206c148e1c2be08b32a48cb2f8e7503647e83d8a82b70c38cf993a0e99dc"} Dec 04 12:29:26.429875 master-0 kubenswrapper[35367]: I1204 12:29:26.429837 35367 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Dec 04 12:29:27.445647 master-0 kubenswrapper[35367]: I1204 12:29:27.445574 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-dwgbt" event={"ID":"bca90d9a-7305-4f53-b071-2fa5ef4f32d7","Type":"ContainerStarted","Data":"cea76b0eadd1528ac6e33e1b1f97943f36709391308ae081417ea33d92d2835f"} Dec 04 12:29:28.465889 master-0 kubenswrapper[35367]: I1204 12:29:28.465825 35367 generic.go:334] "Generic (PLEG): container finished" podID="bca90d9a-7305-4f53-b071-2fa5ef4f32d7" containerID="cea76b0eadd1528ac6e33e1b1f97943f36709391308ae081417ea33d92d2835f" exitCode=0 Dec 04 12:29:28.465889 master-0 kubenswrapper[35367]: I1204 12:29:28.465889 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-dwgbt" event={"ID":"bca90d9a-7305-4f53-b071-2fa5ef4f32d7","Type":"ContainerDied","Data":"cea76b0eadd1528ac6e33e1b1f97943f36709391308ae081417ea33d92d2835f"} Dec 04 12:29:29.484279 master-0 kubenswrapper[35367]: I1204 12:29:29.484211 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-dwgbt" event={"ID":"bca90d9a-7305-4f53-b071-2fa5ef4f32d7","Type":"ContainerStarted","Data":"26ff7957cd5a3eea45e925297ae93530d8ec8512172268207741db38b3cabe52"} Dec 04 12:29:29.515461 master-0 kubenswrapper[35367]: I1204 12:29:29.512118 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-dwgbt" podStartSLOduration=3.066616466 podStartE2EDuration="5.512094662s" podCreationTimestamp="2025-12-04 12:29:24 +0000 UTC" firstStartedPulling="2025-12-04 12:29:26.429725102 +0000 UTC m=+1809.867786360" lastFinishedPulling="2025-12-04 12:29:28.875203288 +0000 UTC m=+1812.313264556" observedRunningTime="2025-12-04 12:29:29.508857779 +0000 UTC m=+1812.946919067" watchObservedRunningTime="2025-12-04 12:29:29.512094662 +0000 UTC m=+1812.950155920" Dec 04 12:29:34.352982 master-0 kubenswrapper[35367]: I1204 12:29:34.352883 35367 scope.go:117] "RemoveContainer" containerID="ad0d2c0fa08caa1fb6d3e8dc7b209a09361d9ce6dced006a2a7aae0d564866f4" Dec 04 12:29:34.380027 master-0 kubenswrapper[35367]: I1204 12:29:34.379978 35367 scope.go:117] "RemoveContainer" containerID="67e773074daaf132b8e256769f74647f441f48079f2a0469d6952d6ce1798414" Dec 04 12:29:34.408491 master-0 kubenswrapper[35367]: I1204 12:29:34.408419 35367 scope.go:117] "RemoveContainer" containerID="1914f30a30b8ad9f6622ce606006a3047ff0416823ad6ad5c8fc6b5cc9d9dde6" Dec 04 12:29:35.036600 master-0 kubenswrapper[35367]: I1204 12:29:35.036437 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-dwgbt" Dec 04 12:29:35.036600 master-0 kubenswrapper[35367]: I1204 12:29:35.036545 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-dwgbt" Dec 04 12:29:35.089478 master-0 kubenswrapper[35367]: I1204 12:29:35.089418 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-dwgbt" Dec 04 12:29:35.615836 master-0 kubenswrapper[35367]: I1204 12:29:35.615762 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-dwgbt" Dec 04 12:29:35.693143 master-0 kubenswrapper[35367]: I1204 12:29:35.693024 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-dwgbt"] Dec 04 12:29:37.591241 master-0 kubenswrapper[35367]: I1204 12:29:37.591118 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-dwgbt" podUID="bca90d9a-7305-4f53-b071-2fa5ef4f32d7" containerName="registry-server" containerID="cri-o://26ff7957cd5a3eea45e925297ae93530d8ec8512172268207741db38b3cabe52" gracePeriod=2 Dec 04 12:29:37.777482 master-0 kubenswrapper[35367]: E1204 12:29:37.777400 35367 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca90d9a_7305_4f53_b071_2fa5ef4f32d7.slice/crio-26ff7957cd5a3eea45e925297ae93530d8ec8512172268207741db38b3cabe52.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca90d9a_7305_4f53_b071_2fa5ef4f32d7.slice/crio-conmon-26ff7957cd5a3eea45e925297ae93530d8ec8512172268207741db38b3cabe52.scope\": RecentStats: unable to find data in memory cache]" Dec 04 12:29:37.778593 master-0 kubenswrapper[35367]: E1204 12:29:37.778319 35367 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca90d9a_7305_4f53_b071_2fa5ef4f32d7.slice/crio-conmon-26ff7957cd5a3eea45e925297ae93530d8ec8512172268207741db38b3cabe52.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca90d9a_7305_4f53_b071_2fa5ef4f32d7.slice/crio-26ff7957cd5a3eea45e925297ae93530d8ec8512172268207741db38b3cabe52.scope\": RecentStats: unable to find data in memory cache]" Dec 04 12:29:38.574605 master-0 kubenswrapper[35367]: I1204 12:29:38.574526 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-dwgbt" Dec 04 12:29:38.617340 master-0 kubenswrapper[35367]: I1204 12:29:38.617190 35367 generic.go:334] "Generic (PLEG): container finished" podID="bca90d9a-7305-4f53-b071-2fa5ef4f32d7" containerID="26ff7957cd5a3eea45e925297ae93530d8ec8512172268207741db38b3cabe52" exitCode=0 Dec 04 12:29:38.617996 master-0 kubenswrapper[35367]: I1204 12:29:38.617404 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-dwgbt" event={"ID":"bca90d9a-7305-4f53-b071-2fa5ef4f32d7","Type":"ContainerDied","Data":"26ff7957cd5a3eea45e925297ae93530d8ec8512172268207741db38b3cabe52"} Dec 04 12:29:38.617996 master-0 kubenswrapper[35367]: I1204 12:29:38.617455 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-dwgbt" event={"ID":"bca90d9a-7305-4f53-b071-2fa5ef4f32d7","Type":"ContainerDied","Data":"9fa2206c148e1c2be08b32a48cb2f8e7503647e83d8a82b70c38cf993a0e99dc"} Dec 04 12:29:38.617996 master-0 kubenswrapper[35367]: I1204 12:29:38.617506 35367 scope.go:117] "RemoveContainer" containerID="26ff7957cd5a3eea45e925297ae93530d8ec8512172268207741db38b3cabe52" Dec 04 12:29:38.617996 master-0 kubenswrapper[35367]: I1204 12:29:38.617894 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-dwgbt" Dec 04 12:29:38.649486 master-0 kubenswrapper[35367]: I1204 12:29:38.649432 35367 scope.go:117] "RemoveContainer" containerID="cea76b0eadd1528ac6e33e1b1f97943f36709391308ae081417ea33d92d2835f" Dec 04 12:29:38.681542 master-0 kubenswrapper[35367]: I1204 12:29:38.681192 35367 scope.go:117] "RemoveContainer" containerID="6abec9a96feadf74a8d8964b73882e3c67db942c1c3ef13e123b9e4e7c36a51f" Dec 04 12:29:38.695384 master-0 kubenswrapper[35367]: I1204 12:29:38.695028 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8tg9\" (UniqueName: \"kubernetes.io/projected/bca90d9a-7305-4f53-b071-2fa5ef4f32d7-kube-api-access-p8tg9\") pod \"bca90d9a-7305-4f53-b071-2fa5ef4f32d7\" (UID: \"bca90d9a-7305-4f53-b071-2fa5ef4f32d7\") " Dec 04 12:29:38.695384 master-0 kubenswrapper[35367]: I1204 12:29:38.695169 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/bca90d9a-7305-4f53-b071-2fa5ef4f32d7-catalog-content\") pod \"bca90d9a-7305-4f53-b071-2fa5ef4f32d7\" (UID: \"bca90d9a-7305-4f53-b071-2fa5ef4f32d7\") " Dec 04 12:29:38.695384 master-0 kubenswrapper[35367]: I1204 12:29:38.695243 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/bca90d9a-7305-4f53-b071-2fa5ef4f32d7-utilities\") pod \"bca90d9a-7305-4f53-b071-2fa5ef4f32d7\" (UID: \"bca90d9a-7305-4f53-b071-2fa5ef4f32d7\") " Dec 04 12:29:38.697137 master-0 kubenswrapper[35367]: I1204 12:29:38.697087 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca90d9a-7305-4f53-b071-2fa5ef4f32d7-utilities" (OuterVolumeSpecName: "utilities") pod "bca90d9a-7305-4f53-b071-2fa5ef4f32d7" (UID: "bca90d9a-7305-4f53-b071-2fa5ef4f32d7"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:29:38.698292 master-0 kubenswrapper[35367]: I1204 12:29:38.698186 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/bca90d9a-7305-4f53-b071-2fa5ef4f32d7-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:29:38.699555 master-0 kubenswrapper[35367]: I1204 12:29:38.699506 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bca90d9a-7305-4f53-b071-2fa5ef4f32d7-kube-api-access-p8tg9" (OuterVolumeSpecName: "kube-api-access-p8tg9") pod "bca90d9a-7305-4f53-b071-2fa5ef4f32d7" (UID: "bca90d9a-7305-4f53-b071-2fa5ef4f32d7"). InnerVolumeSpecName "kube-api-access-p8tg9". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:29:38.766077 master-0 kubenswrapper[35367]: I1204 12:29:38.765988 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca90d9a-7305-4f53-b071-2fa5ef4f32d7-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "bca90d9a-7305-4f53-b071-2fa5ef4f32d7" (UID: "bca90d9a-7305-4f53-b071-2fa5ef4f32d7"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:29:38.801291 master-0 kubenswrapper[35367]: I1204 12:29:38.801177 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-p8tg9\" (UniqueName: \"kubernetes.io/projected/bca90d9a-7305-4f53-b071-2fa5ef4f32d7-kube-api-access-p8tg9\") on node \"master-0\" DevicePath \"\"" Dec 04 12:29:38.801291 master-0 kubenswrapper[35367]: I1204 12:29:38.801268 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/bca90d9a-7305-4f53-b071-2fa5ef4f32d7-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:29:38.807236 master-0 kubenswrapper[35367]: I1204 12:29:38.807194 35367 scope.go:117] "RemoveContainer" containerID="26ff7957cd5a3eea45e925297ae93530d8ec8512172268207741db38b3cabe52" Dec 04 12:29:38.807854 master-0 kubenswrapper[35367]: E1204 12:29:38.807772 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26ff7957cd5a3eea45e925297ae93530d8ec8512172268207741db38b3cabe52\": container with ID starting with 26ff7957cd5a3eea45e925297ae93530d8ec8512172268207741db38b3cabe52 not found: ID does not exist" containerID="26ff7957cd5a3eea45e925297ae93530d8ec8512172268207741db38b3cabe52" Dec 04 12:29:38.807957 master-0 kubenswrapper[35367]: I1204 12:29:38.807877 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26ff7957cd5a3eea45e925297ae93530d8ec8512172268207741db38b3cabe52"} err="failed to get container status \"26ff7957cd5a3eea45e925297ae93530d8ec8512172268207741db38b3cabe52\": rpc error: code = NotFound desc = could not find container \"26ff7957cd5a3eea45e925297ae93530d8ec8512172268207741db38b3cabe52\": container with ID starting with 26ff7957cd5a3eea45e925297ae93530d8ec8512172268207741db38b3cabe52 not found: ID does not exist" Dec 04 12:29:38.807957 master-0 kubenswrapper[35367]: I1204 12:29:38.807918 35367 scope.go:117] "RemoveContainer" containerID="cea76b0eadd1528ac6e33e1b1f97943f36709391308ae081417ea33d92d2835f" Dec 04 12:29:38.808679 master-0 kubenswrapper[35367]: E1204 12:29:38.808641 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cea76b0eadd1528ac6e33e1b1f97943f36709391308ae081417ea33d92d2835f\": container with ID starting with cea76b0eadd1528ac6e33e1b1f97943f36709391308ae081417ea33d92d2835f not found: ID does not exist" containerID="cea76b0eadd1528ac6e33e1b1f97943f36709391308ae081417ea33d92d2835f" Dec 04 12:29:38.808744 master-0 kubenswrapper[35367]: I1204 12:29:38.808691 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cea76b0eadd1528ac6e33e1b1f97943f36709391308ae081417ea33d92d2835f"} err="failed to get container status \"cea76b0eadd1528ac6e33e1b1f97943f36709391308ae081417ea33d92d2835f\": rpc error: code = NotFound desc = could not find container \"cea76b0eadd1528ac6e33e1b1f97943f36709391308ae081417ea33d92d2835f\": container with ID starting with cea76b0eadd1528ac6e33e1b1f97943f36709391308ae081417ea33d92d2835f not found: ID does not exist" Dec 04 12:29:38.808886 master-0 kubenswrapper[35367]: I1204 12:29:38.808729 35367 scope.go:117] "RemoveContainer" containerID="6abec9a96feadf74a8d8964b73882e3c67db942c1c3ef13e123b9e4e7c36a51f" Dec 04 12:29:38.809255 master-0 kubenswrapper[35367]: E1204 12:29:38.809199 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6abec9a96feadf74a8d8964b73882e3c67db942c1c3ef13e123b9e4e7c36a51f\": container with ID starting with 6abec9a96feadf74a8d8964b73882e3c67db942c1c3ef13e123b9e4e7c36a51f not found: ID does not exist" containerID="6abec9a96feadf74a8d8964b73882e3c67db942c1c3ef13e123b9e4e7c36a51f" Dec 04 12:29:38.809358 master-0 kubenswrapper[35367]: I1204 12:29:38.809250 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6abec9a96feadf74a8d8964b73882e3c67db942c1c3ef13e123b9e4e7c36a51f"} err="failed to get container status \"6abec9a96feadf74a8d8964b73882e3c67db942c1c3ef13e123b9e4e7c36a51f\": rpc error: code = NotFound desc = could not find container \"6abec9a96feadf74a8d8964b73882e3c67db942c1c3ef13e123b9e4e7c36a51f\": container with ID starting with 6abec9a96feadf74a8d8964b73882e3c67db942c1c3ef13e123b9e4e7c36a51f not found: ID does not exist" Dec 04 12:29:38.968469 master-0 kubenswrapper[35367]: I1204 12:29:38.968241 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-dwgbt"] Dec 04 12:29:38.988758 master-0 kubenswrapper[35367]: I1204 12:29:38.988626 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-dwgbt"] Dec 04 12:29:40.764450 master-0 kubenswrapper[35367]: I1204 12:29:40.764370 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bca90d9a-7305-4f53-b071-2fa5ef4f32d7" path="/var/lib/kubelet/pods/bca90d9a-7305-4f53-b071-2fa5ef4f32d7/volumes" Dec 04 12:30:00.519929 master-0 kubenswrapper[35367]: I1204 12:30:00.519841 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29414190-mgzzv"] Dec 04 12:30:00.520791 master-0 kubenswrapper[35367]: E1204 12:30:00.520641 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bca90d9a-7305-4f53-b071-2fa5ef4f32d7" containerName="registry-server" Dec 04 12:30:00.520791 master-0 kubenswrapper[35367]: I1204 12:30:00.520660 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="bca90d9a-7305-4f53-b071-2fa5ef4f32d7" containerName="registry-server" Dec 04 12:30:00.520791 master-0 kubenswrapper[35367]: E1204 12:30:00.520700 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bca90d9a-7305-4f53-b071-2fa5ef4f32d7" containerName="extract-content" Dec 04 12:30:00.520791 master-0 kubenswrapper[35367]: I1204 12:30:00.520706 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="bca90d9a-7305-4f53-b071-2fa5ef4f32d7" containerName="extract-content" Dec 04 12:30:00.520791 master-0 kubenswrapper[35367]: E1204 12:30:00.520770 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bca90d9a-7305-4f53-b071-2fa5ef4f32d7" containerName="extract-utilities" Dec 04 12:30:00.520791 master-0 kubenswrapper[35367]: I1204 12:30:00.520778 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="bca90d9a-7305-4f53-b071-2fa5ef4f32d7" containerName="extract-utilities" Dec 04 12:30:00.521112 master-0 kubenswrapper[35367]: I1204 12:30:00.521077 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="bca90d9a-7305-4f53-b071-2fa5ef4f32d7" containerName="registry-server" Dec 04 12:30:00.522439 master-0 kubenswrapper[35367]: I1204 12:30:00.522399 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29414190-mgzzv" Dec 04 12:30:00.525567 master-0 kubenswrapper[35367]: I1204 12:30:00.525469 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"collect-profiles-dockercfg-hd7lj" Dec 04 12:30:00.527010 master-0 kubenswrapper[35367]: I1204 12:30:00.526957 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"collect-profiles-config" Dec 04 12:30:00.550445 master-0 kubenswrapper[35367]: I1204 12:30:00.536975 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29414190-mgzzv"] Dec 04 12:30:00.591456 master-0 kubenswrapper[35367]: I1204 12:30:00.591352 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9x5p\" (UniqueName: \"kubernetes.io/projected/030b4b0e-af00-416f-8528-0a343f60ef80-kube-api-access-m9x5p\") pod \"collect-profiles-29414190-mgzzv\" (UID: \"030b4b0e-af00-416f-8528-0a343f60ef80\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414190-mgzzv" Dec 04 12:30:00.592405 master-0 kubenswrapper[35367]: I1204 12:30:00.592328 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/030b4b0e-af00-416f-8528-0a343f60ef80-config-volume\") pod \"collect-profiles-29414190-mgzzv\" (UID: \"030b4b0e-af00-416f-8528-0a343f60ef80\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414190-mgzzv" Dec 04 12:30:00.592579 master-0 kubenswrapper[35367]: I1204 12:30:00.592511 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/030b4b0e-af00-416f-8528-0a343f60ef80-secret-volume\") pod \"collect-profiles-29414190-mgzzv\" (UID: \"030b4b0e-af00-416f-8528-0a343f60ef80\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414190-mgzzv" Dec 04 12:30:00.698312 master-0 kubenswrapper[35367]: I1204 12:30:00.697667 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/030b4b0e-af00-416f-8528-0a343f60ef80-config-volume\") pod \"collect-profiles-29414190-mgzzv\" (UID: \"030b4b0e-af00-416f-8528-0a343f60ef80\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414190-mgzzv" Dec 04 12:30:00.698312 master-0 kubenswrapper[35367]: I1204 12:30:00.697861 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/030b4b0e-af00-416f-8528-0a343f60ef80-secret-volume\") pod \"collect-profiles-29414190-mgzzv\" (UID: \"030b4b0e-af00-416f-8528-0a343f60ef80\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414190-mgzzv" Dec 04 12:30:00.698312 master-0 kubenswrapper[35367]: I1204 12:30:00.698293 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m9x5p\" (UniqueName: \"kubernetes.io/projected/030b4b0e-af00-416f-8528-0a343f60ef80-kube-api-access-m9x5p\") pod \"collect-profiles-29414190-mgzzv\" (UID: \"030b4b0e-af00-416f-8528-0a343f60ef80\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414190-mgzzv" Dec 04 12:30:00.700864 master-0 kubenswrapper[35367]: I1204 12:30:00.700218 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/030b4b0e-af00-416f-8528-0a343f60ef80-config-volume\") pod \"collect-profiles-29414190-mgzzv\" (UID: \"030b4b0e-af00-416f-8528-0a343f60ef80\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414190-mgzzv" Dec 04 12:30:00.703057 master-0 kubenswrapper[35367]: I1204 12:30:00.702938 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/030b4b0e-af00-416f-8528-0a343f60ef80-secret-volume\") pod \"collect-profiles-29414190-mgzzv\" (UID: \"030b4b0e-af00-416f-8528-0a343f60ef80\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414190-mgzzv" Dec 04 12:30:00.719854 master-0 kubenswrapper[35367]: I1204 12:30:00.719021 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9x5p\" (UniqueName: \"kubernetes.io/projected/030b4b0e-af00-416f-8528-0a343f60ef80-kube-api-access-m9x5p\") pod \"collect-profiles-29414190-mgzzv\" (UID: \"030b4b0e-af00-416f-8528-0a343f60ef80\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414190-mgzzv" Dec 04 12:30:00.856653 master-0 kubenswrapper[35367]: I1204 12:30:00.856350 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29414190-mgzzv" Dec 04 12:30:01.380026 master-0 kubenswrapper[35367]: W1204 12:30:01.379923 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod030b4b0e_af00_416f_8528_0a343f60ef80.slice/crio-1124e030eaf4675381a0a0e171e4b31f37e9c23fd14529cd1ad41fb05885ae4a WatchSource:0}: Error finding container 1124e030eaf4675381a0a0e171e4b31f37e9c23fd14529cd1ad41fb05885ae4a: Status 404 returned error can't find the container with id 1124e030eaf4675381a0a0e171e4b31f37e9c23fd14529cd1ad41fb05885ae4a Dec 04 12:30:01.385669 master-0 kubenswrapper[35367]: I1204 12:30:01.384508 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29414190-mgzzv"] Dec 04 12:30:01.944337 master-0 kubenswrapper[35367]: I1204 12:30:01.944270 35367 generic.go:334] "Generic (PLEG): container finished" podID="030b4b0e-af00-416f-8528-0a343f60ef80" containerID="feb464d78bbac0d1faa3bf5a86adc9eca34ac7be5f5b300546e4a252eb69f4a7" exitCode=0 Dec 04 12:30:01.944337 master-0 kubenswrapper[35367]: I1204 12:30:01.944317 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29414190-mgzzv" event={"ID":"030b4b0e-af00-416f-8528-0a343f60ef80","Type":"ContainerDied","Data":"feb464d78bbac0d1faa3bf5a86adc9eca34ac7be5f5b300546e4a252eb69f4a7"} Dec 04 12:30:01.945120 master-0 kubenswrapper[35367]: I1204 12:30:01.944405 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29414190-mgzzv" event={"ID":"030b4b0e-af00-416f-8528-0a343f60ef80","Type":"ContainerStarted","Data":"1124e030eaf4675381a0a0e171e4b31f37e9c23fd14529cd1ad41fb05885ae4a"} Dec 04 12:30:03.465013 master-0 kubenswrapper[35367]: I1204 12:30:03.464945 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29414190-mgzzv" Dec 04 12:30:03.610914 master-0 kubenswrapper[35367]: I1204 12:30:03.610143 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/030b4b0e-af00-416f-8528-0a343f60ef80-secret-volume\") pod \"030b4b0e-af00-416f-8528-0a343f60ef80\" (UID: \"030b4b0e-af00-416f-8528-0a343f60ef80\") " Dec 04 12:30:03.610914 master-0 kubenswrapper[35367]: I1204 12:30:03.610357 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9x5p\" (UniqueName: \"kubernetes.io/projected/030b4b0e-af00-416f-8528-0a343f60ef80-kube-api-access-m9x5p\") pod \"030b4b0e-af00-416f-8528-0a343f60ef80\" (UID: \"030b4b0e-af00-416f-8528-0a343f60ef80\") " Dec 04 12:30:03.610914 master-0 kubenswrapper[35367]: I1204 12:30:03.610564 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/030b4b0e-af00-416f-8528-0a343f60ef80-config-volume\") pod \"030b4b0e-af00-416f-8528-0a343f60ef80\" (UID: \"030b4b0e-af00-416f-8528-0a343f60ef80\") " Dec 04 12:30:03.614823 master-0 kubenswrapper[35367]: I1204 12:30:03.613162 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/030b4b0e-af00-416f-8528-0a343f60ef80-config-volume" (OuterVolumeSpecName: "config-volume") pod "030b4b0e-af00-416f-8528-0a343f60ef80" (UID: "030b4b0e-af00-416f-8528-0a343f60ef80"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:30:03.622021 master-0 kubenswrapper[35367]: I1204 12:30:03.615603 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/030b4b0e-af00-416f-8528-0a343f60ef80-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "030b4b0e-af00-416f-8528-0a343f60ef80" (UID: "030b4b0e-af00-416f-8528-0a343f60ef80"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:30:03.622021 master-0 kubenswrapper[35367]: I1204 12:30:03.616293 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/030b4b0e-af00-416f-8528-0a343f60ef80-kube-api-access-m9x5p" (OuterVolumeSpecName: "kube-api-access-m9x5p") pod "030b4b0e-af00-416f-8528-0a343f60ef80" (UID: "030b4b0e-af00-416f-8528-0a343f60ef80"). InnerVolumeSpecName "kube-api-access-m9x5p". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:30:03.714562 master-0 kubenswrapper[35367]: I1204 12:30:03.714465 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-m9x5p\" (UniqueName: \"kubernetes.io/projected/030b4b0e-af00-416f-8528-0a343f60ef80-kube-api-access-m9x5p\") on node \"master-0\" DevicePath \"\"" Dec 04 12:30:03.714562 master-0 kubenswrapper[35367]: I1204 12:30:03.714543 35367 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/030b4b0e-af00-416f-8528-0a343f60ef80-config-volume\") on node \"master-0\" DevicePath \"\"" Dec 04 12:30:03.714562 master-0 kubenswrapper[35367]: I1204 12:30:03.714553 35367 reconciler_common.go:293] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/030b4b0e-af00-416f-8528-0a343f60ef80-secret-volume\") on node \"master-0\" DevicePath \"\"" Dec 04 12:30:03.981406 master-0 kubenswrapper[35367]: I1204 12:30:03.981236 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29414190-mgzzv" event={"ID":"030b4b0e-af00-416f-8528-0a343f60ef80","Type":"ContainerDied","Data":"1124e030eaf4675381a0a0e171e4b31f37e9c23fd14529cd1ad41fb05885ae4a"} Dec 04 12:30:03.981406 master-0 kubenswrapper[35367]: I1204 12:30:03.981318 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1124e030eaf4675381a0a0e171e4b31f37e9c23fd14529cd1ad41fb05885ae4a" Dec 04 12:30:03.981406 master-0 kubenswrapper[35367]: I1204 12:30:03.981336 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29414190-mgzzv" Dec 04 12:30:27.626899 master-0 kubenswrapper[35367]: I1204 12:30:27.626787 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-722qv"] Dec 04 12:30:27.629267 master-0 kubenswrapper[35367]: E1204 12:30:27.627536 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="030b4b0e-af00-416f-8528-0a343f60ef80" containerName="collect-profiles" Dec 04 12:30:27.629267 master-0 kubenswrapper[35367]: I1204 12:30:27.627563 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="030b4b0e-af00-416f-8528-0a343f60ef80" containerName="collect-profiles" Dec 04 12:30:27.629267 master-0 kubenswrapper[35367]: I1204 12:30:27.627878 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="030b4b0e-af00-416f-8528-0a343f60ef80" containerName="collect-profiles" Dec 04 12:30:27.631696 master-0 kubenswrapper[35367]: I1204 12:30:27.631651 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-722qv" Dec 04 12:30:27.648959 master-0 kubenswrapper[35367]: I1204 12:30:27.648858 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-722qv"] Dec 04 12:30:27.654164 master-0 kubenswrapper[35367]: I1204 12:30:27.651523 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4tds\" (UniqueName: \"kubernetes.io/projected/8a65c1d7-29ae-4ead-8438-9fa8c1838e44-kube-api-access-f4tds\") pod \"community-operators-722qv\" (UID: \"8a65c1d7-29ae-4ead-8438-9fa8c1838e44\") " pod="openshift-marketplace/community-operators-722qv" Dec 04 12:30:27.654164 master-0 kubenswrapper[35367]: I1204 12:30:27.651663 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/8a65c1d7-29ae-4ead-8438-9fa8c1838e44-utilities\") pod \"community-operators-722qv\" (UID: \"8a65c1d7-29ae-4ead-8438-9fa8c1838e44\") " pod="openshift-marketplace/community-operators-722qv" Dec 04 12:30:27.654164 master-0 kubenswrapper[35367]: I1204 12:30:27.651698 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/8a65c1d7-29ae-4ead-8438-9fa8c1838e44-catalog-content\") pod \"community-operators-722qv\" (UID: \"8a65c1d7-29ae-4ead-8438-9fa8c1838e44\") " pod="openshift-marketplace/community-operators-722qv" Dec 04 12:30:27.754359 master-0 kubenswrapper[35367]: I1204 12:30:27.754269 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/8a65c1d7-29ae-4ead-8438-9fa8c1838e44-utilities\") pod \"community-operators-722qv\" (UID: \"8a65c1d7-29ae-4ead-8438-9fa8c1838e44\") " pod="openshift-marketplace/community-operators-722qv" Dec 04 12:30:27.754720 master-0 kubenswrapper[35367]: I1204 12:30:27.754575 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/8a65c1d7-29ae-4ead-8438-9fa8c1838e44-catalog-content\") pod \"community-operators-722qv\" (UID: \"8a65c1d7-29ae-4ead-8438-9fa8c1838e44\") " pod="openshift-marketplace/community-operators-722qv" Dec 04 12:30:27.754899 master-0 kubenswrapper[35367]: I1204 12:30:27.754855 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f4tds\" (UniqueName: \"kubernetes.io/projected/8a65c1d7-29ae-4ead-8438-9fa8c1838e44-kube-api-access-f4tds\") pod \"community-operators-722qv\" (UID: \"8a65c1d7-29ae-4ead-8438-9fa8c1838e44\") " pod="openshift-marketplace/community-operators-722qv" Dec 04 12:30:27.755277 master-0 kubenswrapper[35367]: I1204 12:30:27.755206 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/8a65c1d7-29ae-4ead-8438-9fa8c1838e44-utilities\") pod \"community-operators-722qv\" (UID: \"8a65c1d7-29ae-4ead-8438-9fa8c1838e44\") " pod="openshift-marketplace/community-operators-722qv" Dec 04 12:30:27.755593 master-0 kubenswrapper[35367]: I1204 12:30:27.755551 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/8a65c1d7-29ae-4ead-8438-9fa8c1838e44-catalog-content\") pod \"community-operators-722qv\" (UID: \"8a65c1d7-29ae-4ead-8438-9fa8c1838e44\") " pod="openshift-marketplace/community-operators-722qv" Dec 04 12:30:27.774920 master-0 kubenswrapper[35367]: I1204 12:30:27.774484 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4tds\" (UniqueName: \"kubernetes.io/projected/8a65c1d7-29ae-4ead-8438-9fa8c1838e44-kube-api-access-f4tds\") pod \"community-operators-722qv\" (UID: \"8a65c1d7-29ae-4ead-8438-9fa8c1838e44\") " pod="openshift-marketplace/community-operators-722qv" Dec 04 12:30:27.969937 master-0 kubenswrapper[35367]: I1204 12:30:27.968680 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-722qv" Dec 04 12:30:28.554430 master-0 kubenswrapper[35367]: I1204 12:30:28.554337 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-722qv"] Dec 04 12:30:28.561069 master-0 kubenswrapper[35367]: W1204 12:30:28.560989 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a65c1d7_29ae_4ead_8438_9fa8c1838e44.slice/crio-559072ddb84d84df0abcde9681191b437cd31f4192c2f240dc99112f305bb515 WatchSource:0}: Error finding container 559072ddb84d84df0abcde9681191b437cd31f4192c2f240dc99112f305bb515: Status 404 returned error can't find the container with id 559072ddb84d84df0abcde9681191b437cd31f4192c2f240dc99112f305bb515 Dec 04 12:30:29.339516 master-0 kubenswrapper[35367]: I1204 12:30:29.339399 35367 generic.go:334] "Generic (PLEG): container finished" podID="8a65c1d7-29ae-4ead-8438-9fa8c1838e44" containerID="61bf6cde43ef1cd57c03f0005324ecc60381632bbc060a575cec13fbde2177d8" exitCode=0 Dec 04 12:30:29.339516 master-0 kubenswrapper[35367]: I1204 12:30:29.339519 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-722qv" event={"ID":"8a65c1d7-29ae-4ead-8438-9fa8c1838e44","Type":"ContainerDied","Data":"61bf6cde43ef1cd57c03f0005324ecc60381632bbc060a575cec13fbde2177d8"} Dec 04 12:30:29.340327 master-0 kubenswrapper[35367]: I1204 12:30:29.339562 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-722qv" event={"ID":"8a65c1d7-29ae-4ead-8438-9fa8c1838e44","Type":"ContainerStarted","Data":"559072ddb84d84df0abcde9681191b437cd31f4192c2f240dc99112f305bb515"} Dec 04 12:30:33.429318 master-0 kubenswrapper[35367]: I1204 12:30:33.429063 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-722qv" event={"ID":"8a65c1d7-29ae-4ead-8438-9fa8c1838e44","Type":"ContainerStarted","Data":"c132eb3af52cd23e89cc5b8d238a8db9952225391b45376561a283b8732981bc"} Dec 04 12:30:34.445932 master-0 kubenswrapper[35367]: I1204 12:30:34.445858 35367 generic.go:334] "Generic (PLEG): container finished" podID="8a65c1d7-29ae-4ead-8438-9fa8c1838e44" containerID="c132eb3af52cd23e89cc5b8d238a8db9952225391b45376561a283b8732981bc" exitCode=0 Dec 04 12:30:34.445932 master-0 kubenswrapper[35367]: I1204 12:30:34.445927 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-722qv" event={"ID":"8a65c1d7-29ae-4ead-8438-9fa8c1838e44","Type":"ContainerDied","Data":"c132eb3af52cd23e89cc5b8d238a8db9952225391b45376561a283b8732981bc"} Dec 04 12:30:34.551186 master-0 kubenswrapper[35367]: I1204 12:30:34.551102 35367 scope.go:117] "RemoveContainer" containerID="4acb0c53fd969f2a07fbaed27d57bb227241ca9e652a5f7da9abc02ec8385c6f" Dec 04 12:30:34.578797 master-0 kubenswrapper[35367]: I1204 12:30:34.578748 35367 scope.go:117] "RemoveContainer" containerID="7b70eda49845092233b0b8884b1d0bb50b32ae874fc21a7ac62b2382cd51ee73" Dec 04 12:30:34.603020 master-0 kubenswrapper[35367]: I1204 12:30:34.602956 35367 scope.go:117] "RemoveContainer" containerID="9eaf8ad50851067371ad49b6f0534313f62a0ee496e71257060981eba35d1ad9" Dec 04 12:30:35.462445 master-0 kubenswrapper[35367]: I1204 12:30:35.462376 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-722qv" event={"ID":"8a65c1d7-29ae-4ead-8438-9fa8c1838e44","Type":"ContainerStarted","Data":"3161361dcb45447f91186e383813fd9c1909b9687d38cb5f3b6daf5c3975ea80"} Dec 04 12:30:35.491668 master-0 kubenswrapper[35367]: I1204 12:30:35.491557 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-722qv" podStartSLOduration=2.859047023 podStartE2EDuration="8.491528795s" podCreationTimestamp="2025-12-04 12:30:27 +0000 UTC" firstStartedPulling="2025-12-04 12:30:29.342659149 +0000 UTC m=+1872.780720407" lastFinishedPulling="2025-12-04 12:30:34.975140931 +0000 UTC m=+1878.413202179" observedRunningTime="2025-12-04 12:30:35.486434183 +0000 UTC m=+1878.924495461" watchObservedRunningTime="2025-12-04 12:30:35.491528795 +0000 UTC m=+1878.929590083" Dec 04 12:30:37.968955 master-0 kubenswrapper[35367]: I1204 12:30:37.968870 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-722qv" Dec 04 12:30:37.968955 master-0 kubenswrapper[35367]: I1204 12:30:37.968962 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-722qv" Dec 04 12:30:38.020253 master-0 kubenswrapper[35367]: I1204 12:30:38.020150 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-722qv" Dec 04 12:30:44.981513 master-0 kubenswrapper[35367]: I1204 12:30:44.981440 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-7db0-account-create-update-p4fn7"] Dec 04 12:30:44.997658 master-0 kubenswrapper[35367]: I1204 12:30:44.997569 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-db-create-mc686"] Dec 04 12:30:45.015831 master-0 kubenswrapper[35367]: I1204 12:30:45.014922 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/glance-db-create-mc686"] Dec 04 12:30:45.029463 master-0 kubenswrapper[35367]: I1204 12:30:45.029235 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/glance-7db0-account-create-update-p4fn7"] Dec 04 12:30:46.761734 master-0 kubenswrapper[35367]: I1204 12:30:46.761654 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11479ec7-fd05-46d7-b8ef-61505345a925" path="/var/lib/kubelet/pods/11479ec7-fd05-46d7-b8ef-61505345a925/volumes" Dec 04 12:30:46.762639 master-0 kubenswrapper[35367]: I1204 12:30:46.762606 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7491014a-fcbc-4943-9362-c3ba47079204" path="/var/lib/kubelet/pods/7491014a-fcbc-4943-9362-c3ba47079204/volumes" Dec 04 12:30:47.968791 master-0 kubenswrapper[35367]: I1204 12:30:47.967704 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-7bh6j"] Dec 04 12:30:47.972327 master-0 kubenswrapper[35367]: I1204 12:30:47.972264 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-7bh6j" Dec 04 12:30:48.000567 master-0 kubenswrapper[35367]: I1204 12:30:48.000490 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-7bh6j"] Dec 04 12:30:48.053942 master-0 kubenswrapper[35367]: I1204 12:30:48.053788 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-722qv" Dec 04 12:30:48.156566 master-0 kubenswrapper[35367]: I1204 12:30:48.156480 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/efacba88-e4fe-4aee-9d5f-467ad067e23f-utilities\") pod \"redhat-marketplace-7bh6j\" (UID: \"efacba88-e4fe-4aee-9d5f-467ad067e23f\") " pod="openshift-marketplace/redhat-marketplace-7bh6j" Dec 04 12:30:48.156885 master-0 kubenswrapper[35367]: I1204 12:30:48.156776 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qltqr\" (UniqueName: \"kubernetes.io/projected/efacba88-e4fe-4aee-9d5f-467ad067e23f-kube-api-access-qltqr\") pod \"redhat-marketplace-7bh6j\" (UID: \"efacba88-e4fe-4aee-9d5f-467ad067e23f\") " pod="openshift-marketplace/redhat-marketplace-7bh6j" Dec 04 12:30:48.156885 master-0 kubenswrapper[35367]: I1204 12:30:48.156858 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/efacba88-e4fe-4aee-9d5f-467ad067e23f-catalog-content\") pod \"redhat-marketplace-7bh6j\" (UID: \"efacba88-e4fe-4aee-9d5f-467ad067e23f\") " pod="openshift-marketplace/redhat-marketplace-7bh6j" Dec 04 12:30:48.260121 master-0 kubenswrapper[35367]: I1204 12:30:48.259916 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/efacba88-e4fe-4aee-9d5f-467ad067e23f-utilities\") pod \"redhat-marketplace-7bh6j\" (UID: \"efacba88-e4fe-4aee-9d5f-467ad067e23f\") " pod="openshift-marketplace/redhat-marketplace-7bh6j" Dec 04 12:30:48.260427 master-0 kubenswrapper[35367]: I1204 12:30:48.260233 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qltqr\" (UniqueName: \"kubernetes.io/projected/efacba88-e4fe-4aee-9d5f-467ad067e23f-kube-api-access-qltqr\") pod \"redhat-marketplace-7bh6j\" (UID: \"efacba88-e4fe-4aee-9d5f-467ad067e23f\") " pod="openshift-marketplace/redhat-marketplace-7bh6j" Dec 04 12:30:48.260487 master-0 kubenswrapper[35367]: I1204 12:30:48.260437 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/efacba88-e4fe-4aee-9d5f-467ad067e23f-catalog-content\") pod \"redhat-marketplace-7bh6j\" (UID: \"efacba88-e4fe-4aee-9d5f-467ad067e23f\") " pod="openshift-marketplace/redhat-marketplace-7bh6j" Dec 04 12:30:48.260650 master-0 kubenswrapper[35367]: I1204 12:30:48.260589 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/efacba88-e4fe-4aee-9d5f-467ad067e23f-utilities\") pod \"redhat-marketplace-7bh6j\" (UID: \"efacba88-e4fe-4aee-9d5f-467ad067e23f\") " pod="openshift-marketplace/redhat-marketplace-7bh6j" Dec 04 12:30:48.261524 master-0 kubenswrapper[35367]: I1204 12:30:48.261459 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/efacba88-e4fe-4aee-9d5f-467ad067e23f-catalog-content\") pod \"redhat-marketplace-7bh6j\" (UID: \"efacba88-e4fe-4aee-9d5f-467ad067e23f\") " pod="openshift-marketplace/redhat-marketplace-7bh6j" Dec 04 12:30:48.285135 master-0 kubenswrapper[35367]: I1204 12:30:48.285014 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qltqr\" (UniqueName: \"kubernetes.io/projected/efacba88-e4fe-4aee-9d5f-467ad067e23f-kube-api-access-qltqr\") pod \"redhat-marketplace-7bh6j\" (UID: \"efacba88-e4fe-4aee-9d5f-467ad067e23f\") " pod="openshift-marketplace/redhat-marketplace-7bh6j" Dec 04 12:30:48.308452 master-0 kubenswrapper[35367]: I1204 12:30:48.308342 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-7bh6j" Dec 04 12:30:48.827717 master-0 kubenswrapper[35367]: I1204 12:30:48.827248 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-7bh6j"] Dec 04 12:30:49.058293 master-0 kubenswrapper[35367]: I1204 12:30:49.057865 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/keystone-db-create-srv98"] Dec 04 12:30:49.075981 master-0 kubenswrapper[35367]: I1204 12:30:49.075616 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/keystone-db-create-srv98"] Dec 04 12:30:49.675634 master-0 kubenswrapper[35367]: I1204 12:30:49.675540 35367 generic.go:334] "Generic (PLEG): container finished" podID="efacba88-e4fe-4aee-9d5f-467ad067e23f" containerID="ff1cb4ed2a964ed58ccfcac1832d680f5dda11b8b4c6869645c721b4d65d332c" exitCode=0 Dec 04 12:30:49.675634 master-0 kubenswrapper[35367]: I1204 12:30:49.675604 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-7bh6j" event={"ID":"efacba88-e4fe-4aee-9d5f-467ad067e23f","Type":"ContainerDied","Data":"ff1cb4ed2a964ed58ccfcac1832d680f5dda11b8b4c6869645c721b4d65d332c"} Dec 04 12:30:49.675634 master-0 kubenswrapper[35367]: I1204 12:30:49.675636 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-7bh6j" event={"ID":"efacba88-e4fe-4aee-9d5f-467ad067e23f","Type":"ContainerStarted","Data":"da36ab8c98a1eabf3a57e145dee5e973fc1deef1527030aad8c7790fd617c747"} Dec 04 12:30:49.984156 master-0 kubenswrapper[35367]: I1204 12:30:49.983906 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-722qv"] Dec 04 12:30:50.065762 master-0 kubenswrapper[35367]: I1204 12:30:50.061922 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/keystone-9f97-account-create-update-pz8hh"] Dec 04 12:30:50.097151 master-0 kubenswrapper[35367]: I1204 12:30:50.096587 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/placement-dcfa-account-create-update-9th7n"] Dec 04 12:30:50.111515 master-0 kubenswrapper[35367]: I1204 12:30:50.111472 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/placement-db-create-7m5q7"] Dec 04 12:30:50.130838 master-0 kubenswrapper[35367]: I1204 12:30:50.130741 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/keystone-9f97-account-create-update-pz8hh"] Dec 04 12:30:50.144858 master-0 kubenswrapper[35367]: I1204 12:30:50.144766 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/placement-dcfa-account-create-update-9th7n"] Dec 04 12:30:50.159481 master-0 kubenswrapper[35367]: I1204 12:30:50.159410 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/placement-db-create-7m5q7"] Dec 04 12:30:50.532222 master-0 kubenswrapper[35367]: I1204 12:30:50.532148 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-rxhpq"] Dec 04 12:30:50.532650 master-0 kubenswrapper[35367]: I1204 12:30:50.532592 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-rxhpq" podUID="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" containerName="registry-server" containerID="cri-o://49678595908a2e2c41b725aaca9c6b1ef9e4be6d996c893089f19d41f04a3117" gracePeriod=2 Dec 04 12:30:50.731750 master-0 kubenswrapper[35367]: I1204 12:30:50.731682 35367 generic.go:334] "Generic (PLEG): container finished" podID="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" containerID="49678595908a2e2c41b725aaca9c6b1ef9e4be6d996c893089f19d41f04a3117" exitCode=0 Dec 04 12:30:50.731914 master-0 kubenswrapper[35367]: I1204 12:30:50.731766 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-rxhpq" event={"ID":"5ae25dd5-dfdb-42f6-97d0-14ad17743c95","Type":"ContainerDied","Data":"49678595908a2e2c41b725aaca9c6b1ef9e4be6d996c893089f19d41f04a3117"} Dec 04 12:30:50.813524 master-0 kubenswrapper[35367]: I1204 12:30:50.807512 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09248008-9ef2-4192-b659-99a871da63fd" path="/var/lib/kubelet/pods/09248008-9ef2-4192-b659-99a871da63fd/volumes" Dec 04 12:30:50.813524 master-0 kubenswrapper[35367]: I1204 12:30:50.809889 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a54041bc-fcee-4c9f-b184-6c6cca276c17" path="/var/lib/kubelet/pods/a54041bc-fcee-4c9f-b184-6c6cca276c17/volumes" Dec 04 12:30:50.813524 master-0 kubenswrapper[35367]: I1204 12:30:50.810762 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c77c7cce-fe37-4ebd-b63c-67e3ecedcbed" path="/var/lib/kubelet/pods/c77c7cce-fe37-4ebd-b63c-67e3ecedcbed/volumes" Dec 04 12:30:50.813524 master-0 kubenswrapper[35367]: I1204 12:30:50.811782 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee42dab4-d3fb-4934-be07-6098344a2c31" path="/var/lib/kubelet/pods/ee42dab4-d3fb-4934-be07-6098344a2c31/volumes" Dec 04 12:30:51.258833 master-0 kubenswrapper[35367]: I1204 12:30:51.258706 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-rxhpq" Dec 04 12:30:51.368129 master-0 kubenswrapper[35367]: I1204 12:30:51.367904 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-catalog-content\") pod \"5ae25dd5-dfdb-42f6-97d0-14ad17743c95\" (UID: \"5ae25dd5-dfdb-42f6-97d0-14ad17743c95\") " Dec 04 12:30:51.368129 master-0 kubenswrapper[35367]: I1204 12:30:51.368026 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-utilities\") pod \"5ae25dd5-dfdb-42f6-97d0-14ad17743c95\" (UID: \"5ae25dd5-dfdb-42f6-97d0-14ad17743c95\") " Dec 04 12:30:51.368129 master-0 kubenswrapper[35367]: I1204 12:30:51.368118 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l22ps\" (UniqueName: \"kubernetes.io/projected/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-kube-api-access-l22ps\") pod \"5ae25dd5-dfdb-42f6-97d0-14ad17743c95\" (UID: \"5ae25dd5-dfdb-42f6-97d0-14ad17743c95\") " Dec 04 12:30:51.368778 master-0 kubenswrapper[35367]: I1204 12:30:51.368701 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-utilities" (OuterVolumeSpecName: "utilities") pod "5ae25dd5-dfdb-42f6-97d0-14ad17743c95" (UID: "5ae25dd5-dfdb-42f6-97d0-14ad17743c95"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:30:51.369374 master-0 kubenswrapper[35367]: I1204 12:30:51.369228 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:30:51.371982 master-0 kubenswrapper[35367]: I1204 12:30:51.371892 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-kube-api-access-l22ps" (OuterVolumeSpecName: "kube-api-access-l22ps") pod "5ae25dd5-dfdb-42f6-97d0-14ad17743c95" (UID: "5ae25dd5-dfdb-42f6-97d0-14ad17743c95"). InnerVolumeSpecName "kube-api-access-l22ps". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:30:51.419950 master-0 kubenswrapper[35367]: I1204 12:30:51.419882 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "5ae25dd5-dfdb-42f6-97d0-14ad17743c95" (UID: "5ae25dd5-dfdb-42f6-97d0-14ad17743c95"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:30:51.472621 master-0 kubenswrapper[35367]: I1204 12:30:51.472538 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:30:51.472621 master-0 kubenswrapper[35367]: I1204 12:30:51.472611 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-l22ps\" (UniqueName: \"kubernetes.io/projected/5ae25dd5-dfdb-42f6-97d0-14ad17743c95-kube-api-access-l22ps\") on node \"master-0\" DevicePath \"\"" Dec 04 12:30:51.747540 master-0 kubenswrapper[35367]: I1204 12:30:51.747391 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-rxhpq" Dec 04 12:30:51.747832 master-0 kubenswrapper[35367]: I1204 12:30:51.747378 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-rxhpq" event={"ID":"5ae25dd5-dfdb-42f6-97d0-14ad17743c95","Type":"ContainerDied","Data":"597a9e4435c6089676e0fa68a7916eee6043cc3e40b07033c316c40839d7d999"} Dec 04 12:30:51.747832 master-0 kubenswrapper[35367]: I1204 12:30:51.747755 35367 scope.go:117] "RemoveContainer" containerID="49678595908a2e2c41b725aaca9c6b1ef9e4be6d996c893089f19d41f04a3117" Dec 04 12:30:51.754038 master-0 kubenswrapper[35367]: I1204 12:30:51.753836 35367 generic.go:334] "Generic (PLEG): container finished" podID="efacba88-e4fe-4aee-9d5f-467ad067e23f" containerID="993faf232717f72680e621f697e7b4f5aa29302d6cf62e9d60880065c449c618" exitCode=0 Dec 04 12:30:51.754038 master-0 kubenswrapper[35367]: I1204 12:30:51.753898 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-7bh6j" event={"ID":"efacba88-e4fe-4aee-9d5f-467ad067e23f","Type":"ContainerDied","Data":"993faf232717f72680e621f697e7b4f5aa29302d6cf62e9d60880065c449c618"} Dec 04 12:30:51.786501 master-0 kubenswrapper[35367]: I1204 12:30:51.786447 35367 scope.go:117] "RemoveContainer" containerID="b831427379e3db6806a6998a0a6732a8a35135454ae340aeb1971b3048c51a2b" Dec 04 12:30:51.820779 master-0 kubenswrapper[35367]: I1204 12:30:51.820671 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-rxhpq"] Dec 04 12:30:51.826794 master-0 kubenswrapper[35367]: I1204 12:30:51.826707 35367 scope.go:117] "RemoveContainer" containerID="fbb615d6c9d1ef25aa2db62084390ffbce46178d8659706ad341ef8739a6266d" Dec 04 12:30:51.839026 master-0 kubenswrapper[35367]: I1204 12:30:51.838650 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-rxhpq"] Dec 04 12:30:52.771436 master-0 kubenswrapper[35367]: I1204 12:30:52.769951 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" path="/var/lib/kubelet/pods/5ae25dd5-dfdb-42f6-97d0-14ad17743c95/volumes" Dec 04 12:30:52.787133 master-0 kubenswrapper[35367]: I1204 12:30:52.787044 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-7bh6j" event={"ID":"efacba88-e4fe-4aee-9d5f-467ad067e23f","Type":"ContainerStarted","Data":"26761053cfcd68de0e22fce393f37b587af05a56249f9d612f50bfdafc921362"} Dec 04 12:30:52.826828 master-0 kubenswrapper[35367]: I1204 12:30:52.823287 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-7bh6j" podStartSLOduration=3.334363069 podStartE2EDuration="5.823259645s" podCreationTimestamp="2025-12-04 12:30:47 +0000 UTC" firstStartedPulling="2025-12-04 12:30:49.678228522 +0000 UTC m=+1893.116289780" lastFinishedPulling="2025-12-04 12:30:52.167125098 +0000 UTC m=+1895.605186356" observedRunningTime="2025-12-04 12:30:52.822700537 +0000 UTC m=+1896.260761795" watchObservedRunningTime="2025-12-04 12:30:52.823259645 +0000 UTC m=+1896.261320903" Dec 04 12:30:57.321374 master-0 kubenswrapper[35367]: I1204 12:30:57.321293 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-db-create-kscpb"] Dec 04 12:30:57.337048 master-0 kubenswrapper[35367]: I1204 12:30:57.336980 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/neutron-db-create-46v6w"] Dec 04 12:30:57.351968 master-0 kubenswrapper[35367]: I1204 12:30:57.350553 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/cinder-db-create-kscpb"] Dec 04 12:30:57.366583 master-0 kubenswrapper[35367]: I1204 12:30:57.366500 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-a983-account-create-update-nkqvj"] Dec 04 12:30:57.380770 master-0 kubenswrapper[35367]: I1204 12:30:57.380717 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/neutron-db-create-46v6w"] Dec 04 12:30:57.393573 master-0 kubenswrapper[35367]: I1204 12:30:57.393495 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/neutron-c8b4-account-create-update-wrmr2"] Dec 04 12:30:57.406773 master-0 kubenswrapper[35367]: I1204 12:30:57.406671 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/cinder-a983-account-create-update-nkqvj"] Dec 04 12:30:57.431045 master-0 kubenswrapper[35367]: I1204 12:30:57.430923 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/neutron-c8b4-account-create-update-wrmr2"] Dec 04 12:30:58.308740 master-0 kubenswrapper[35367]: I1204 12:30:58.308661 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-7bh6j" Dec 04 12:30:58.308740 master-0 kubenswrapper[35367]: I1204 12:30:58.308737 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-7bh6j" Dec 04 12:30:58.362353 master-0 kubenswrapper[35367]: I1204 12:30:58.362297 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-7bh6j" Dec 04 12:30:58.764022 master-0 kubenswrapper[35367]: I1204 12:30:58.763900 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e577446-b134-4beb-81b4-4a3e355c3b26" path="/var/lib/kubelet/pods/7e577446-b134-4beb-81b4-4a3e355c3b26/volumes" Dec 04 12:30:58.764913 master-0 kubenswrapper[35367]: I1204 12:30:58.764893 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="920d85f6-b7a7-4720-83a0-84ca181a6453" path="/var/lib/kubelet/pods/920d85f6-b7a7-4720-83a0-84ca181a6453/volumes" Dec 04 12:30:58.765617 master-0 kubenswrapper[35367]: I1204 12:30:58.765600 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c609368c-2cc0-4322-b1f0-00abab864e02" path="/var/lib/kubelet/pods/c609368c-2cc0-4322-b1f0-00abab864e02/volumes" Dec 04 12:30:58.766384 master-0 kubenswrapper[35367]: I1204 12:30:58.766366 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7ca6286-ccd7-47ac-b456-88a38c89d97f" path="/var/lib/kubelet/pods/c7ca6286-ccd7-47ac-b456-88a38c89d97f/volumes" Dec 04 12:30:58.934059 master-0 kubenswrapper[35367]: I1204 12:30:58.933990 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-7bh6j" Dec 04 12:30:59.009980 master-0 kubenswrapper[35367]: I1204 12:30:59.009880 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-7bh6j"] Dec 04 12:31:00.911203 master-0 kubenswrapper[35367]: I1204 12:31:00.911020 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-7bh6j" podUID="efacba88-e4fe-4aee-9d5f-467ad067e23f" containerName="registry-server" containerID="cri-o://26761053cfcd68de0e22fce393f37b587af05a56249f9d612f50bfdafc921362" gracePeriod=2 Dec 04 12:31:01.486309 master-0 kubenswrapper[35367]: I1204 12:31:01.486236 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-7bh6j" Dec 04 12:31:01.679829 master-0 kubenswrapper[35367]: I1204 12:31:01.679647 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qltqr\" (UniqueName: \"kubernetes.io/projected/efacba88-e4fe-4aee-9d5f-467ad067e23f-kube-api-access-qltqr\") pod \"efacba88-e4fe-4aee-9d5f-467ad067e23f\" (UID: \"efacba88-e4fe-4aee-9d5f-467ad067e23f\") " Dec 04 12:31:01.680069 master-0 kubenswrapper[35367]: I1204 12:31:01.679859 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/efacba88-e4fe-4aee-9d5f-467ad067e23f-utilities\") pod \"efacba88-e4fe-4aee-9d5f-467ad067e23f\" (UID: \"efacba88-e4fe-4aee-9d5f-467ad067e23f\") " Dec 04 12:31:01.680327 master-0 kubenswrapper[35367]: I1204 12:31:01.680276 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/efacba88-e4fe-4aee-9d5f-467ad067e23f-catalog-content\") pod \"efacba88-e4fe-4aee-9d5f-467ad067e23f\" (UID: \"efacba88-e4fe-4aee-9d5f-467ad067e23f\") " Dec 04 12:31:01.681116 master-0 kubenswrapper[35367]: I1204 12:31:01.681077 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efacba88-e4fe-4aee-9d5f-467ad067e23f-utilities" (OuterVolumeSpecName: "utilities") pod "efacba88-e4fe-4aee-9d5f-467ad067e23f" (UID: "efacba88-e4fe-4aee-9d5f-467ad067e23f"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:31:01.683680 master-0 kubenswrapper[35367]: I1204 12:31:01.683586 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efacba88-e4fe-4aee-9d5f-467ad067e23f-kube-api-access-qltqr" (OuterVolumeSpecName: "kube-api-access-qltqr") pod "efacba88-e4fe-4aee-9d5f-467ad067e23f" (UID: "efacba88-e4fe-4aee-9d5f-467ad067e23f"). InnerVolumeSpecName "kube-api-access-qltqr". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:31:01.702915 master-0 kubenswrapper[35367]: I1204 12:31:01.702788 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efacba88-e4fe-4aee-9d5f-467ad067e23f-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "efacba88-e4fe-4aee-9d5f-467ad067e23f" (UID: "efacba88-e4fe-4aee-9d5f-467ad067e23f"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:31:01.784533 master-0 kubenswrapper[35367]: I1204 12:31:01.784385 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/efacba88-e4fe-4aee-9d5f-467ad067e23f-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:31:01.784533 master-0 kubenswrapper[35367]: I1204 12:31:01.784505 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/efacba88-e4fe-4aee-9d5f-467ad067e23f-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:31:01.784533 master-0 kubenswrapper[35367]: I1204 12:31:01.784523 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qltqr\" (UniqueName: \"kubernetes.io/projected/efacba88-e4fe-4aee-9d5f-467ad067e23f-kube-api-access-qltqr\") on node \"master-0\" DevicePath \"\"" Dec 04 12:31:01.927216 master-0 kubenswrapper[35367]: I1204 12:31:01.927153 35367 generic.go:334] "Generic (PLEG): container finished" podID="efacba88-e4fe-4aee-9d5f-467ad067e23f" containerID="26761053cfcd68de0e22fce393f37b587af05a56249f9d612f50bfdafc921362" exitCode=0 Dec 04 12:31:01.927906 master-0 kubenswrapper[35367]: I1204 12:31:01.927240 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-7bh6j" event={"ID":"efacba88-e4fe-4aee-9d5f-467ad067e23f","Type":"ContainerDied","Data":"26761053cfcd68de0e22fce393f37b587af05a56249f9d612f50bfdafc921362"} Dec 04 12:31:01.927906 master-0 kubenswrapper[35367]: I1204 12:31:01.927327 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-7bh6j" event={"ID":"efacba88-e4fe-4aee-9d5f-467ad067e23f","Type":"ContainerDied","Data":"da36ab8c98a1eabf3a57e145dee5e973fc1deef1527030aad8c7790fd617c747"} Dec 04 12:31:01.927906 master-0 kubenswrapper[35367]: I1204 12:31:01.927356 35367 scope.go:117] "RemoveContainer" containerID="26761053cfcd68de0e22fce393f37b587af05a56249f9d612f50bfdafc921362" Dec 04 12:31:01.927906 master-0 kubenswrapper[35367]: I1204 12:31:01.927258 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-7bh6j" Dec 04 12:31:01.952329 master-0 kubenswrapper[35367]: I1204 12:31:01.952273 35367 scope.go:117] "RemoveContainer" containerID="993faf232717f72680e621f697e7b4f5aa29302d6cf62e9d60880065c449c618" Dec 04 12:31:01.974260 master-0 kubenswrapper[35367]: I1204 12:31:01.974201 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-7bh6j"] Dec 04 12:31:01.987293 master-0 kubenswrapper[35367]: I1204 12:31:01.987134 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-7bh6j"] Dec 04 12:31:01.994255 master-0 kubenswrapper[35367]: I1204 12:31:01.994185 35367 scope.go:117] "RemoveContainer" containerID="ff1cb4ed2a964ed58ccfcac1832d680f5dda11b8b4c6869645c721b4d65d332c" Dec 04 12:31:02.039535 master-0 kubenswrapper[35367]: I1204 12:31:02.039331 35367 scope.go:117] "RemoveContainer" containerID="26761053cfcd68de0e22fce393f37b587af05a56249f9d612f50bfdafc921362" Dec 04 12:31:02.041420 master-0 kubenswrapper[35367]: E1204 12:31:02.041324 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26761053cfcd68de0e22fce393f37b587af05a56249f9d612f50bfdafc921362\": container with ID starting with 26761053cfcd68de0e22fce393f37b587af05a56249f9d612f50bfdafc921362 not found: ID does not exist" containerID="26761053cfcd68de0e22fce393f37b587af05a56249f9d612f50bfdafc921362" Dec 04 12:31:02.041507 master-0 kubenswrapper[35367]: I1204 12:31:02.041450 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26761053cfcd68de0e22fce393f37b587af05a56249f9d612f50bfdafc921362"} err="failed to get container status \"26761053cfcd68de0e22fce393f37b587af05a56249f9d612f50bfdafc921362\": rpc error: code = NotFound desc = could not find container \"26761053cfcd68de0e22fce393f37b587af05a56249f9d612f50bfdafc921362\": container with ID starting with 26761053cfcd68de0e22fce393f37b587af05a56249f9d612f50bfdafc921362 not found: ID does not exist" Dec 04 12:31:02.041554 master-0 kubenswrapper[35367]: I1204 12:31:02.041512 35367 scope.go:117] "RemoveContainer" containerID="993faf232717f72680e621f697e7b4f5aa29302d6cf62e9d60880065c449c618" Dec 04 12:31:02.044449 master-0 kubenswrapper[35367]: E1204 12:31:02.042736 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"993faf232717f72680e621f697e7b4f5aa29302d6cf62e9d60880065c449c618\": container with ID starting with 993faf232717f72680e621f697e7b4f5aa29302d6cf62e9d60880065c449c618 not found: ID does not exist" containerID="993faf232717f72680e621f697e7b4f5aa29302d6cf62e9d60880065c449c618" Dec 04 12:31:02.044449 master-0 kubenswrapper[35367]: I1204 12:31:02.042793 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"993faf232717f72680e621f697e7b4f5aa29302d6cf62e9d60880065c449c618"} err="failed to get container status \"993faf232717f72680e621f697e7b4f5aa29302d6cf62e9d60880065c449c618\": rpc error: code = NotFound desc = could not find container \"993faf232717f72680e621f697e7b4f5aa29302d6cf62e9d60880065c449c618\": container with ID starting with 993faf232717f72680e621f697e7b4f5aa29302d6cf62e9d60880065c449c618 not found: ID does not exist" Dec 04 12:31:02.044449 master-0 kubenswrapper[35367]: I1204 12:31:02.042856 35367 scope.go:117] "RemoveContainer" containerID="ff1cb4ed2a964ed58ccfcac1832d680f5dda11b8b4c6869645c721b4d65d332c" Dec 04 12:31:02.044698 master-0 kubenswrapper[35367]: E1204 12:31:02.044548 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff1cb4ed2a964ed58ccfcac1832d680f5dda11b8b4c6869645c721b4d65d332c\": container with ID starting with ff1cb4ed2a964ed58ccfcac1832d680f5dda11b8b4c6869645c721b4d65d332c not found: ID does not exist" containerID="ff1cb4ed2a964ed58ccfcac1832d680f5dda11b8b4c6869645c721b4d65d332c" Dec 04 12:31:02.044698 master-0 kubenswrapper[35367]: I1204 12:31:02.044584 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1cb4ed2a964ed58ccfcac1832d680f5dda11b8b4c6869645c721b4d65d332c"} err="failed to get container status \"ff1cb4ed2a964ed58ccfcac1832d680f5dda11b8b4c6869645c721b4d65d332c\": rpc error: code = NotFound desc = could not find container \"ff1cb4ed2a964ed58ccfcac1832d680f5dda11b8b4c6869645c721b4d65d332c\": container with ID starting with ff1cb4ed2a964ed58ccfcac1832d680f5dda11b8b4c6869645c721b4d65d332c not found: ID does not exist" Dec 04 12:31:02.767750 master-0 kubenswrapper[35367]: I1204 12:31:02.767639 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efacba88-e4fe-4aee-9d5f-467ad067e23f" path="/var/lib/kubelet/pods/efacba88-e4fe-4aee-9d5f-467ad067e23f/volumes" Dec 04 12:31:09.062613 master-0 kubenswrapper[35367]: I1204 12:31:09.062082 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-nlk69"] Dec 04 12:31:09.063554 master-0 kubenswrapper[35367]: E1204 12:31:09.063101 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="efacba88-e4fe-4aee-9d5f-467ad067e23f" containerName="extract-content" Dec 04 12:31:09.063554 master-0 kubenswrapper[35367]: I1204 12:31:09.063127 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="efacba88-e4fe-4aee-9d5f-467ad067e23f" containerName="extract-content" Dec 04 12:31:09.063554 master-0 kubenswrapper[35367]: E1204 12:31:09.063157 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" containerName="extract-utilities" Dec 04 12:31:09.063554 master-0 kubenswrapper[35367]: I1204 12:31:09.063167 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" containerName="extract-utilities" Dec 04 12:31:09.063554 master-0 kubenswrapper[35367]: E1204 12:31:09.063186 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="efacba88-e4fe-4aee-9d5f-467ad067e23f" containerName="registry-server" Dec 04 12:31:09.063554 master-0 kubenswrapper[35367]: I1204 12:31:09.063196 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="efacba88-e4fe-4aee-9d5f-467ad067e23f" containerName="registry-server" Dec 04 12:31:09.063554 master-0 kubenswrapper[35367]: E1204 12:31:09.063257 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" containerName="extract-content" Dec 04 12:31:09.063554 master-0 kubenswrapper[35367]: I1204 12:31:09.063269 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" containerName="extract-content" Dec 04 12:31:09.063554 master-0 kubenswrapper[35367]: E1204 12:31:09.063289 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" containerName="registry-server" Dec 04 12:31:09.063554 master-0 kubenswrapper[35367]: I1204 12:31:09.063297 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" containerName="registry-server" Dec 04 12:31:09.063554 master-0 kubenswrapper[35367]: E1204 12:31:09.063321 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="efacba88-e4fe-4aee-9d5f-467ad067e23f" containerName="extract-utilities" Dec 04 12:31:09.063554 master-0 kubenswrapper[35367]: I1204 12:31:09.063329 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="efacba88-e4fe-4aee-9d5f-467ad067e23f" containerName="extract-utilities" Dec 04 12:31:09.064733 master-0 kubenswrapper[35367]: I1204 12:31:09.063657 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" containerName="extract-utilities" Dec 04 12:31:09.064733 master-0 kubenswrapper[35367]: I1204 12:31:09.063723 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" containerName="registry-server" Dec 04 12:31:09.064733 master-0 kubenswrapper[35367]: I1204 12:31:09.063743 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="5ae25dd5-dfdb-42f6-97d0-14ad17743c95" containerName="extract-content" Dec 04 12:31:09.064733 master-0 kubenswrapper[35367]: I1204 12:31:09.063767 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="efacba88-e4fe-4aee-9d5f-467ad067e23f" containerName="registry-server" Dec 04 12:31:09.066393 master-0 kubenswrapper[35367]: I1204 12:31:09.066344 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-nlk69" Dec 04 12:31:09.099732 master-0 kubenswrapper[35367]: I1204 12:31:09.099650 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4hx4\" (UniqueName: \"kubernetes.io/projected/2fcb207a-3087-42f4-8856-8f8c98fa7d89-kube-api-access-q4hx4\") pod \"redhat-operators-nlk69\" (UID: \"2fcb207a-3087-42f4-8856-8f8c98fa7d89\") " pod="openshift-marketplace/redhat-operators-nlk69" Dec 04 12:31:09.100367 master-0 kubenswrapper[35367]: I1204 12:31:09.100282 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2fcb207a-3087-42f4-8856-8f8c98fa7d89-catalog-content\") pod \"redhat-operators-nlk69\" (UID: \"2fcb207a-3087-42f4-8856-8f8c98fa7d89\") " pod="openshift-marketplace/redhat-operators-nlk69" Dec 04 12:31:09.100490 master-0 kubenswrapper[35367]: I1204 12:31:09.100470 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2fcb207a-3087-42f4-8856-8f8c98fa7d89-utilities\") pod \"redhat-operators-nlk69\" (UID: \"2fcb207a-3087-42f4-8856-8f8c98fa7d89\") " pod="openshift-marketplace/redhat-operators-nlk69" Dec 04 12:31:09.105714 master-0 kubenswrapper[35367]: I1204 12:31:09.105619 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-nlk69"] Dec 04 12:31:09.203735 master-0 kubenswrapper[35367]: I1204 12:31:09.203391 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q4hx4\" (UniqueName: \"kubernetes.io/projected/2fcb207a-3087-42f4-8856-8f8c98fa7d89-kube-api-access-q4hx4\") pod \"redhat-operators-nlk69\" (UID: \"2fcb207a-3087-42f4-8856-8f8c98fa7d89\") " pod="openshift-marketplace/redhat-operators-nlk69" Dec 04 12:31:09.203735 master-0 kubenswrapper[35367]: I1204 12:31:09.203641 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2fcb207a-3087-42f4-8856-8f8c98fa7d89-catalog-content\") pod \"redhat-operators-nlk69\" (UID: \"2fcb207a-3087-42f4-8856-8f8c98fa7d89\") " pod="openshift-marketplace/redhat-operators-nlk69" Dec 04 12:31:09.203735 master-0 kubenswrapper[35367]: I1204 12:31:09.203704 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2fcb207a-3087-42f4-8856-8f8c98fa7d89-utilities\") pod \"redhat-operators-nlk69\" (UID: \"2fcb207a-3087-42f4-8856-8f8c98fa7d89\") " pod="openshift-marketplace/redhat-operators-nlk69" Dec 04 12:31:09.204526 master-0 kubenswrapper[35367]: I1204 12:31:09.204338 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2fcb207a-3087-42f4-8856-8f8c98fa7d89-catalog-content\") pod \"redhat-operators-nlk69\" (UID: \"2fcb207a-3087-42f4-8856-8f8c98fa7d89\") " pod="openshift-marketplace/redhat-operators-nlk69" Dec 04 12:31:09.204526 master-0 kubenswrapper[35367]: I1204 12:31:09.204408 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2fcb207a-3087-42f4-8856-8f8c98fa7d89-utilities\") pod \"redhat-operators-nlk69\" (UID: \"2fcb207a-3087-42f4-8856-8f8c98fa7d89\") " pod="openshift-marketplace/redhat-operators-nlk69" Dec 04 12:31:09.230161 master-0 kubenswrapper[35367]: I1204 12:31:09.228597 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4hx4\" (UniqueName: \"kubernetes.io/projected/2fcb207a-3087-42f4-8856-8f8c98fa7d89-kube-api-access-q4hx4\") pod \"redhat-operators-nlk69\" (UID: \"2fcb207a-3087-42f4-8856-8f8c98fa7d89\") " pod="openshift-marketplace/redhat-operators-nlk69" Dec 04 12:31:09.417377 master-0 kubenswrapper[35367]: I1204 12:31:09.417192 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-nlk69" Dec 04 12:31:09.953188 master-0 kubenswrapper[35367]: I1204 12:31:09.952548 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-nlk69"] Dec 04 12:31:10.070422 master-0 kubenswrapper[35367]: I1204 12:31:10.070327 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-nlk69" event={"ID":"2fcb207a-3087-42f4-8856-8f8c98fa7d89","Type":"ContainerStarted","Data":"bcec88ece0e2c47c30edd7f78b3f5d6351e225a249c5a07cf3ba931ad5cd69a1"} Dec 04 12:31:11.086226 master-0 kubenswrapper[35367]: I1204 12:31:11.086151 35367 generic.go:334] "Generic (PLEG): container finished" podID="2fcb207a-3087-42f4-8856-8f8c98fa7d89" containerID="0104c897e961e03852e5f3b4baaa090b3f93ec02ece325d01ca6f9b2e65bc522" exitCode=0 Dec 04 12:31:11.086226 master-0 kubenswrapper[35367]: I1204 12:31:11.086222 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-nlk69" event={"ID":"2fcb207a-3087-42f4-8856-8f8c98fa7d89","Type":"ContainerDied","Data":"0104c897e961e03852e5f3b4baaa090b3f93ec02ece325d01ca6f9b2e65bc522"} Dec 04 12:31:13.122485 master-0 kubenswrapper[35367]: I1204 12:31:13.122359 35367 generic.go:334] "Generic (PLEG): container finished" podID="2fcb207a-3087-42f4-8856-8f8c98fa7d89" containerID="1eefe1ff02f06bac3d8617d98603876b133071c0e4c41ef4cf6314d08432064c" exitCode=0 Dec 04 12:31:13.122485 master-0 kubenswrapper[35367]: I1204 12:31:13.122456 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-nlk69" event={"ID":"2fcb207a-3087-42f4-8856-8f8c98fa7d89","Type":"ContainerDied","Data":"1eefe1ff02f06bac3d8617d98603876b133071c0e4c41ef4cf6314d08432064c"} Dec 04 12:31:14.142123 master-0 kubenswrapper[35367]: I1204 12:31:14.141996 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-nlk69" event={"ID":"2fcb207a-3087-42f4-8856-8f8c98fa7d89","Type":"ContainerStarted","Data":"68002e5c82c68e8d940f2609ffbf18608d5f21011b6ff96919cc1571ed3d3175"} Dec 04 12:31:14.201205 master-0 kubenswrapper[35367]: I1204 12:31:14.200990 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-nlk69" podStartSLOduration=2.650540406 podStartE2EDuration="5.200966667s" podCreationTimestamp="2025-12-04 12:31:09 +0000 UTC" firstStartedPulling="2025-12-04 12:31:11.08823013 +0000 UTC m=+1914.526291388" lastFinishedPulling="2025-12-04 12:31:13.638656391 +0000 UTC m=+1917.076717649" observedRunningTime="2025-12-04 12:31:14.183852252 +0000 UTC m=+1917.621913520" watchObservedRunningTime="2025-12-04 12:31:14.200966667 +0000 UTC m=+1917.639027925" Dec 04 12:31:16.158945 master-0 kubenswrapper[35367]: I1204 12:31:16.158868 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/keystone-db-sync-fh8h7"] Dec 04 12:31:16.176764 master-0 kubenswrapper[35367]: I1204 12:31:16.176687 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/keystone-db-sync-fh8h7"] Dec 04 12:31:16.767783 master-0 kubenswrapper[35367]: I1204 12:31:16.767721 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ee232a5-994b-4ae0-8392-c4d5eed37c1a" path="/var/lib/kubelet/pods/3ee232a5-994b-4ae0-8392-c4d5eed37c1a/volumes" Dec 04 12:31:19.418434 master-0 kubenswrapper[35367]: I1204 12:31:19.418247 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-nlk69" Dec 04 12:31:19.423017 master-0 kubenswrapper[35367]: I1204 12:31:19.422644 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-nlk69" Dec 04 12:31:19.490353 master-0 kubenswrapper[35367]: I1204 12:31:19.490185 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-nlk69" Dec 04 12:31:20.316587 master-0 kubenswrapper[35367]: I1204 12:31:20.316515 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-nlk69" Dec 04 12:31:20.415029 master-0 kubenswrapper[35367]: I1204 12:31:20.408546 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-nlk69"] Dec 04 12:31:22.051917 master-0 kubenswrapper[35367]: I1204 12:31:22.051720 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-db-create-dsptr"] Dec 04 12:31:22.070950 master-0 kubenswrapper[35367]: I1204 12:31:22.070866 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ironic-db-create-dsptr"] Dec 04 12:31:22.274725 master-0 kubenswrapper[35367]: I1204 12:31:22.274616 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-nlk69" podUID="2fcb207a-3087-42f4-8856-8f8c98fa7d89" containerName="registry-server" containerID="cri-o://68002e5c82c68e8d940f2609ffbf18608d5f21011b6ff96919cc1571ed3d3175" gracePeriod=2 Dec 04 12:31:22.765929 master-0 kubenswrapper[35367]: I1204 12:31:22.765546 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="241869d7-8118-40e8-8550-76c59263f7c7" path="/var/lib/kubelet/pods/241869d7-8118-40e8-8550-76c59263f7c7/volumes" Dec 04 12:31:22.940271 master-0 kubenswrapper[35367]: I1204 12:31:22.940188 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-nlk69" Dec 04 12:31:23.065397 master-0 kubenswrapper[35367]: I1204 12:31:23.065216 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2fcb207a-3087-42f4-8856-8f8c98fa7d89-utilities\") pod \"2fcb207a-3087-42f4-8856-8f8c98fa7d89\" (UID: \"2fcb207a-3087-42f4-8856-8f8c98fa7d89\") " Dec 04 12:31:23.066214 master-0 kubenswrapper[35367]: I1204 12:31:23.065702 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2fcb207a-3087-42f4-8856-8f8c98fa7d89-catalog-content\") pod \"2fcb207a-3087-42f4-8856-8f8c98fa7d89\" (UID: \"2fcb207a-3087-42f4-8856-8f8c98fa7d89\") " Dec 04 12:31:23.066214 master-0 kubenswrapper[35367]: I1204 12:31:23.065992 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4hx4\" (UniqueName: \"kubernetes.io/projected/2fcb207a-3087-42f4-8856-8f8c98fa7d89-kube-api-access-q4hx4\") pod \"2fcb207a-3087-42f4-8856-8f8c98fa7d89\" (UID: \"2fcb207a-3087-42f4-8856-8f8c98fa7d89\") " Dec 04 12:31:23.067988 master-0 kubenswrapper[35367]: I1204 12:31:23.067742 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fcb207a-3087-42f4-8856-8f8c98fa7d89-utilities" (OuterVolumeSpecName: "utilities") pod "2fcb207a-3087-42f4-8856-8f8c98fa7d89" (UID: "2fcb207a-3087-42f4-8856-8f8c98fa7d89"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:31:23.073715 master-0 kubenswrapper[35367]: I1204 12:31:23.073625 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fcb207a-3087-42f4-8856-8f8c98fa7d89-kube-api-access-q4hx4" (OuterVolumeSpecName: "kube-api-access-q4hx4") pod "2fcb207a-3087-42f4-8856-8f8c98fa7d89" (UID: "2fcb207a-3087-42f4-8856-8f8c98fa7d89"). InnerVolumeSpecName "kube-api-access-q4hx4". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:31:23.078167 master-0 kubenswrapper[35367]: I1204 12:31:23.078031 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-f7e2-account-create-update-mlr6p"] Dec 04 12:31:23.092644 master-0 kubenswrapper[35367]: I1204 12:31:23.092469 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ironic-f7e2-account-create-update-mlr6p"] Dec 04 12:31:23.170161 master-0 kubenswrapper[35367]: I1204 12:31:23.170033 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q4hx4\" (UniqueName: \"kubernetes.io/projected/2fcb207a-3087-42f4-8856-8f8c98fa7d89-kube-api-access-q4hx4\") on node \"master-0\" DevicePath \"\"" Dec 04 12:31:23.170161 master-0 kubenswrapper[35367]: I1204 12:31:23.170101 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2fcb207a-3087-42f4-8856-8f8c98fa7d89-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:31:23.297103 master-0 kubenswrapper[35367]: I1204 12:31:23.297042 35367 generic.go:334] "Generic (PLEG): container finished" podID="2fcb207a-3087-42f4-8856-8f8c98fa7d89" containerID="68002e5c82c68e8d940f2609ffbf18608d5f21011b6ff96919cc1571ed3d3175" exitCode=0 Dec 04 12:31:23.297445 master-0 kubenswrapper[35367]: I1204 12:31:23.297234 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-nlk69" event={"ID":"2fcb207a-3087-42f4-8856-8f8c98fa7d89","Type":"ContainerDied","Data":"68002e5c82c68e8d940f2609ffbf18608d5f21011b6ff96919cc1571ed3d3175"} Dec 04 12:31:23.297571 master-0 kubenswrapper[35367]: I1204 12:31:23.297555 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-nlk69" event={"ID":"2fcb207a-3087-42f4-8856-8f8c98fa7d89","Type":"ContainerDied","Data":"bcec88ece0e2c47c30edd7f78b3f5d6351e225a249c5a07cf3ba931ad5cd69a1"} Dec 04 12:31:23.297664 master-0 kubenswrapper[35367]: I1204 12:31:23.297637 35367 scope.go:117] "RemoveContainer" containerID="68002e5c82c68e8d940f2609ffbf18608d5f21011b6ff96919cc1571ed3d3175" Dec 04 12:31:23.297837 master-0 kubenswrapper[35367]: I1204 12:31:23.297346 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-nlk69" Dec 04 12:31:23.324783 master-0 kubenswrapper[35367]: I1204 12:31:23.324728 35367 scope.go:117] "RemoveContainer" containerID="1eefe1ff02f06bac3d8617d98603876b133071c0e4c41ef4cf6314d08432064c" Dec 04 12:31:23.361308 master-0 kubenswrapper[35367]: I1204 12:31:23.361238 35367 scope.go:117] "RemoveContainer" containerID="0104c897e961e03852e5f3b4baaa090b3f93ec02ece325d01ca6f9b2e65bc522" Dec 04 12:31:23.437503 master-0 kubenswrapper[35367]: I1204 12:31:23.437439 35367 scope.go:117] "RemoveContainer" containerID="68002e5c82c68e8d940f2609ffbf18608d5f21011b6ff96919cc1571ed3d3175" Dec 04 12:31:23.438249 master-0 kubenswrapper[35367]: E1204 12:31:23.438195 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68002e5c82c68e8d940f2609ffbf18608d5f21011b6ff96919cc1571ed3d3175\": container with ID starting with 68002e5c82c68e8d940f2609ffbf18608d5f21011b6ff96919cc1571ed3d3175 not found: ID does not exist" containerID="68002e5c82c68e8d940f2609ffbf18608d5f21011b6ff96919cc1571ed3d3175" Dec 04 12:31:23.438327 master-0 kubenswrapper[35367]: I1204 12:31:23.438257 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68002e5c82c68e8d940f2609ffbf18608d5f21011b6ff96919cc1571ed3d3175"} err="failed to get container status \"68002e5c82c68e8d940f2609ffbf18608d5f21011b6ff96919cc1571ed3d3175\": rpc error: code = NotFound desc = could not find container \"68002e5c82c68e8d940f2609ffbf18608d5f21011b6ff96919cc1571ed3d3175\": container with ID starting with 68002e5c82c68e8d940f2609ffbf18608d5f21011b6ff96919cc1571ed3d3175 not found: ID does not exist" Dec 04 12:31:23.438327 master-0 kubenswrapper[35367]: I1204 12:31:23.438291 35367 scope.go:117] "RemoveContainer" containerID="1eefe1ff02f06bac3d8617d98603876b133071c0e4c41ef4cf6314d08432064c" Dec 04 12:31:23.439182 master-0 kubenswrapper[35367]: E1204 12:31:23.439140 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1eefe1ff02f06bac3d8617d98603876b133071c0e4c41ef4cf6314d08432064c\": container with ID starting with 1eefe1ff02f06bac3d8617d98603876b133071c0e4c41ef4cf6314d08432064c not found: ID does not exist" containerID="1eefe1ff02f06bac3d8617d98603876b133071c0e4c41ef4cf6314d08432064c" Dec 04 12:31:23.439371 master-0 kubenswrapper[35367]: I1204 12:31:23.439255 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1eefe1ff02f06bac3d8617d98603876b133071c0e4c41ef4cf6314d08432064c"} err="failed to get container status \"1eefe1ff02f06bac3d8617d98603876b133071c0e4c41ef4cf6314d08432064c\": rpc error: code = NotFound desc = could not find container \"1eefe1ff02f06bac3d8617d98603876b133071c0e4c41ef4cf6314d08432064c\": container with ID starting with 1eefe1ff02f06bac3d8617d98603876b133071c0e4c41ef4cf6314d08432064c not found: ID does not exist" Dec 04 12:31:23.439371 master-0 kubenswrapper[35367]: I1204 12:31:23.439357 35367 scope.go:117] "RemoveContainer" containerID="0104c897e961e03852e5f3b4baaa090b3f93ec02ece325d01ca6f9b2e65bc522" Dec 04 12:31:23.440963 master-0 kubenswrapper[35367]: E1204 12:31:23.440936 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0104c897e961e03852e5f3b4baaa090b3f93ec02ece325d01ca6f9b2e65bc522\": container with ID starting with 0104c897e961e03852e5f3b4baaa090b3f93ec02ece325d01ca6f9b2e65bc522 not found: ID does not exist" containerID="0104c897e961e03852e5f3b4baaa090b3f93ec02ece325d01ca6f9b2e65bc522" Dec 04 12:31:23.441044 master-0 kubenswrapper[35367]: I1204 12:31:23.440966 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0104c897e961e03852e5f3b4baaa090b3f93ec02ece325d01ca6f9b2e65bc522"} err="failed to get container status \"0104c897e961e03852e5f3b4baaa090b3f93ec02ece325d01ca6f9b2e65bc522\": rpc error: code = NotFound desc = could not find container \"0104c897e961e03852e5f3b4baaa090b3f93ec02ece325d01ca6f9b2e65bc522\": container with ID starting with 0104c897e961e03852e5f3b4baaa090b3f93ec02ece325d01ca6f9b2e65bc522 not found: ID does not exist" Dec 04 12:31:23.515593 master-0 kubenswrapper[35367]: I1204 12:31:23.515497 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fcb207a-3087-42f4-8856-8f8c98fa7d89-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "2fcb207a-3087-42f4-8856-8f8c98fa7d89" (UID: "2fcb207a-3087-42f4-8856-8f8c98fa7d89"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:31:23.584857 master-0 kubenswrapper[35367]: I1204 12:31:23.584482 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2fcb207a-3087-42f4-8856-8f8c98fa7d89-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:31:23.668735 master-0 kubenswrapper[35367]: I1204 12:31:23.666613 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-nlk69"] Dec 04 12:31:23.687568 master-0 kubenswrapper[35367]: I1204 12:31:23.687420 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-nlk69"] Dec 04 12:31:24.766318 master-0 kubenswrapper[35367]: I1204 12:31:24.766212 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fcb207a-3087-42f4-8856-8f8c98fa7d89" path="/var/lib/kubelet/pods/2fcb207a-3087-42f4-8856-8f8c98fa7d89/volumes" Dec 04 12:31:24.767348 master-0 kubenswrapper[35367]: I1204 12:31:24.767318 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de1c0574-23b1-4430-8d67-76a0f30bad90" path="/var/lib/kubelet/pods/de1c0574-23b1-4430-8d67-76a0f30bad90/volumes" Dec 04 12:31:26.129506 master-0 kubenswrapper[35367]: I1204 12:31:26.129433 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-db-sync-x46tq"] Dec 04 12:31:26.147969 master-0 kubenswrapper[35367]: I1204 12:31:26.147856 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/glance-db-sync-x46tq"] Dec 04 12:31:26.764640 master-0 kubenswrapper[35367]: I1204 12:31:26.764524 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="859636b6-4875-4193-b2b7-cf13e258fee9" path="/var/lib/kubelet/pods/859636b6-4875-4193-b2b7-cf13e258fee9/volumes" Dec 04 12:31:34.712932 master-0 kubenswrapper[35367]: I1204 12:31:34.712846 35367 scope.go:117] "RemoveContainer" containerID="1ab027d7876a464e14bda26244acf59b0a582dda9985db55a4b467abc883fec5" Dec 04 12:31:34.752910 master-0 kubenswrapper[35367]: I1204 12:31:34.752598 35367 scope.go:117] "RemoveContainer" containerID="9ae56bc3dc569fd38544ff059f567433160bd3947352cec600d3b8129e3305d4" Dec 04 12:31:34.800521 master-0 kubenswrapper[35367]: I1204 12:31:34.800461 35367 scope.go:117] "RemoveContainer" containerID="8bfc08a4c118de3419fa7616b42792efb5954388e9f4927a9dc287785e1a4eb1" Dec 04 12:31:34.863627 master-0 kubenswrapper[35367]: I1204 12:31:34.863571 35367 scope.go:117] "RemoveContainer" containerID="0f94b85f0c59d9a842717ecd748ae9b5fc6362cbca39e00de457742c4820e9de" Dec 04 12:31:34.921973 master-0 kubenswrapper[35367]: I1204 12:31:34.921910 35367 scope.go:117] "RemoveContainer" containerID="8e5a50104e0acaa557d864d8ea8e8d20e830b7a400e46badb0410d9fb9ad31c9" Dec 04 12:31:34.968367 master-0 kubenswrapper[35367]: I1204 12:31:34.968224 35367 scope.go:117] "RemoveContainer" containerID="05fd97dd460476d463bc913d79a465484536acc6e07b76dd609cebe18b895cb0" Dec 04 12:31:35.025181 master-0 kubenswrapper[35367]: I1204 12:31:35.025100 35367 scope.go:117] "RemoveContainer" containerID="90269fc47ea4a9a5d6d948fa8f94b79fdafc92837bd4ff17084473022f3b1549" Dec 04 12:31:35.056370 master-0 kubenswrapper[35367]: I1204 12:31:35.056290 35367 scope.go:117] "RemoveContainer" containerID="b4440c7c1fb1e0e357a5564182e49dc21c2e26af3c111c9a338351bcdcaf978d" Dec 04 12:31:35.096383 master-0 kubenswrapper[35367]: I1204 12:31:35.096328 35367 scope.go:117] "RemoveContainer" containerID="fc051b6c0765c8067d5af4af36530ed93e67e7824dbe051e5c5c919570ed57e7" Dec 04 12:31:35.127710 master-0 kubenswrapper[35367]: I1204 12:31:35.127622 35367 scope.go:117] "RemoveContainer" containerID="ab69daabdf92b99dfde56873a3087f3b7378f9d8f0a94de328a60c3eef977ae4" Dec 04 12:31:35.155439 master-0 kubenswrapper[35367]: I1204 12:31:35.155102 35367 scope.go:117] "RemoveContainer" containerID="2bf3a90031e21a4b6c891815c35bfe71bd45fd1d2f5acbd5c3cd3282a00789fe" Dec 04 12:31:35.192153 master-0 kubenswrapper[35367]: I1204 12:31:35.192060 35367 scope.go:117] "RemoveContainer" containerID="3a8591c1596ea44b95ee52fc9bc0af27031e3adb6580c3305ded210b9c7547f3" Dec 04 12:31:35.223551 master-0 kubenswrapper[35367]: I1204 12:31:35.223487 35367 scope.go:117] "RemoveContainer" containerID="fe12f1ceac075212dc006898ead31b732494f7516c1492e02d663aa90e07dc47" Dec 04 12:31:35.253720 master-0 kubenswrapper[35367]: I1204 12:31:35.253634 35367 scope.go:117] "RemoveContainer" containerID="2c90db8b59d7eb21277b36492e67ff74acd7ee2a4b87af5c5ec79f7846363a83" Dec 04 12:31:39.050722 master-0 kubenswrapper[35367]: I1204 12:31:39.050007 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/keystone-bootstrap-zzmjk"] Dec 04 12:31:39.067864 master-0 kubenswrapper[35367]: I1204 12:31:39.067769 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/placement-db-sync-hlw45"] Dec 04 12:31:39.082870 master-0 kubenswrapper[35367]: I1204 12:31:39.082380 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/keystone-bootstrap-zzmjk"] Dec 04 12:31:39.095591 master-0 kubenswrapper[35367]: I1204 12:31:39.095517 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/placement-db-sync-hlw45"] Dec 04 12:31:40.766252 master-0 kubenswrapper[35367]: I1204 12:31:40.766165 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="088fa28d-a668-4bcc-9038-24e9a97f25d4" path="/var/lib/kubelet/pods/088fa28d-a668-4bcc-9038-24e9a97f25d4/volumes" Dec 04 12:31:40.767122 master-0 kubenswrapper[35367]: I1204 12:31:40.767084 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0e9b193-ab20-484e-b727-c24c8aecb2c5" path="/var/lib/kubelet/pods/f0e9b193-ab20-484e-b727-c24c8aecb2c5/volumes" Dec 04 12:31:53.798077 master-0 kubenswrapper[35367]: I1204 12:31:53.797972 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-0c69e-db-sync-x9w96"] Dec 04 12:31:53.812754 master-0 kubenswrapper[35367]: I1204 12:31:53.812588 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/cinder-0c69e-db-sync-x9w96"] Dec 04 12:31:54.519438 master-0 kubenswrapper[35367]: I1204 12:31:54.519348 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/neutron-db-sync-ck757"] Dec 04 12:31:54.636071 master-0 kubenswrapper[35367]: I1204 12:31:54.636013 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/neutron-db-sync-ck757"] Dec 04 12:31:54.767631 master-0 kubenswrapper[35367]: I1204 12:31:54.767558 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b713b22-8016-49e5-999d-a69c23149635" path="/var/lib/kubelet/pods/3b713b22-8016-49e5-999d-a69c23149635/volumes" Dec 04 12:31:54.768582 master-0 kubenswrapper[35367]: I1204 12:31:54.768547 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e72935b7-293c-4160-a02a-cbf179274ab0" path="/var/lib/kubelet/pods/e72935b7-293c-4160-a02a-cbf179274ab0/volumes" Dec 04 12:32:11.206432 master-0 kubenswrapper[35367]: I1204 12:32:11.206318 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-db-sync-ql68f"] Dec 04 12:32:11.225561 master-0 kubenswrapper[35367]: I1204 12:32:11.225417 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ironic-db-sync-ql68f"] Dec 04 12:32:12.767634 master-0 kubenswrapper[35367]: I1204 12:32:12.767563 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a783310-4355-49c9-9962-b5741fb70344" path="/var/lib/kubelet/pods/0a783310-4355-49c9-9962-b5741fb70344/volumes" Dec 04 12:32:18.082527 master-0 kubenswrapper[35367]: I1204 12:32:18.082446 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-inspector-db-create-2vlsx"] Dec 04 12:32:18.100658 master-0 kubenswrapper[35367]: I1204 12:32:18.100550 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-inspector-d6e5-account-create-update-w8hkj"] Dec 04 12:32:18.115868 master-0 kubenswrapper[35367]: I1204 12:32:18.115745 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ironic-inspector-db-create-2vlsx"] Dec 04 12:32:18.129227 master-0 kubenswrapper[35367]: I1204 12:32:18.129145 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ironic-inspector-d6e5-account-create-update-w8hkj"] Dec 04 12:32:18.766184 master-0 kubenswrapper[35367]: I1204 12:32:18.765971 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42c0c08e-5eb9-4e64-b523-363d39eff4c9" path="/var/lib/kubelet/pods/42c0c08e-5eb9-4e64-b523-363d39eff4c9/volumes" Dec 04 12:32:18.767284 master-0 kubenswrapper[35367]: I1204 12:32:18.767245 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f01f664c-8d89-44ae-a467-fed3c2c32855" path="/var/lib/kubelet/pods/f01f664c-8d89-44ae-a467-fed3c2c32855/volumes" Dec 04 12:32:35.638956 master-0 kubenswrapper[35367]: I1204 12:32:35.638851 35367 scope.go:117] "RemoveContainer" containerID="63a818c26d002b5ec86f3b80790345c055ac0a9076debc358d3f81a8e7e89870" Dec 04 12:32:35.687444 master-0 kubenswrapper[35367]: I1204 12:32:35.687321 35367 scope.go:117] "RemoveContainer" containerID="3ad05b7db986ed4242ec0a5f1474166ec176aafe9b1f484f1e85eb8c71f6dc7d" Dec 04 12:32:35.761918 master-0 kubenswrapper[35367]: I1204 12:32:35.761726 35367 scope.go:117] "RemoveContainer" containerID="0b5e7513379707fe7f95495022fd8b19b4d638d2ac6ca86d4354fb8bd2aaa3f5" Dec 04 12:32:35.818602 master-0 kubenswrapper[35367]: I1204 12:32:35.818376 35367 scope.go:117] "RemoveContainer" containerID="3e0e3f13cb2d87e2c8132ee961379e19d1434a0669d5679d977ff80bb6a86470" Dec 04 12:32:35.906592 master-0 kubenswrapper[35367]: I1204 12:32:35.906524 35367 scope.go:117] "RemoveContainer" containerID="9ae87b2a13c6c4f282d04d0f5101650aa41112f61ff0576a09c80efc508b16ec" Dec 04 12:32:35.948916 master-0 kubenswrapper[35367]: I1204 12:32:35.948856 35367 scope.go:117] "RemoveContainer" containerID="89d2e2a28656ced1e0a7e37fbc365be3169225c02a2a7f219453321436644f67" Dec 04 12:32:36.027189 master-0 kubenswrapper[35367]: I1204 12:32:36.027125 35367 scope.go:117] "RemoveContainer" containerID="3e451254ceb489f64f16da9882a53b4f005ba07f9888f7dad45df4403abf3957" Dec 04 12:32:36.090118 master-0 kubenswrapper[35367]: I1204 12:32:36.090056 35367 scope.go:117] "RemoveContainer" containerID="3c2ed72cc2db710f315cdda4492ec3dcb50fc6946600edc49c893714ce0800f6" Dec 04 12:32:41.078419 master-0 kubenswrapper[35367]: I1204 12:32:41.078350 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-inspector-db-sync-wxhxv"] Dec 04 12:32:41.101349 master-0 kubenswrapper[35367]: I1204 12:32:41.101282 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ironic-inspector-db-sync-wxhxv"] Dec 04 12:32:42.766516 master-0 kubenswrapper[35367]: I1204 12:32:42.766378 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa8d8c09-968e-4c52-ac80-fd7a0a1df758" path="/var/lib/kubelet/pods/fa8d8c09-968e-4c52-ac80-fd7a0a1df758/volumes" Dec 04 12:32:56.069288 master-0 kubenswrapper[35367]: I1204 12:32:56.069192 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell1-db-create-rnv4x"] Dec 04 12:32:56.090202 master-0 kubenswrapper[35367]: I1204 12:32:56.090111 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell0-db-create-czcw9"] Dec 04 12:32:56.106510 master-0 kubenswrapper[35367]: I1204 12:32:56.106436 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-api-db-create-f5pbp"] Dec 04 12:32:56.132284 master-0 kubenswrapper[35367]: I1204 12:32:56.132088 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell1-0aaf-account-create-update-dqn2k"] Dec 04 12:32:56.160567 master-0 kubenswrapper[35367]: I1204 12:32:56.160430 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-api-bf96-account-create-update-6f8zt"] Dec 04 12:32:56.177619 master-0 kubenswrapper[35367]: I1204 12:32:56.177472 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell0-06d6-account-create-update-28zsr"] Dec 04 12:32:56.201009 master-0 kubenswrapper[35367]: I1204 12:32:56.200925 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-cell1-db-create-rnv4x"] Dec 04 12:32:56.221238 master-0 kubenswrapper[35367]: I1204 12:32:56.221134 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-cell0-db-create-czcw9"] Dec 04 12:32:56.234100 master-0 kubenswrapper[35367]: I1204 12:32:56.233982 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-api-db-create-f5pbp"] Dec 04 12:32:56.247361 master-0 kubenswrapper[35367]: I1204 12:32:56.247118 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-cell1-0aaf-account-create-update-dqn2k"] Dec 04 12:32:56.263713 master-0 kubenswrapper[35367]: I1204 12:32:56.263556 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-api-bf96-account-create-update-6f8zt"] Dec 04 12:32:56.284260 master-0 kubenswrapper[35367]: I1204 12:32:56.284178 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-cell0-06d6-account-create-update-28zsr"] Dec 04 12:32:56.767072 master-0 kubenswrapper[35367]: I1204 12:32:56.766848 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="126ab2d5-6cb8-4033-8814-7c54c3038fe7" path="/var/lib/kubelet/pods/126ab2d5-6cb8-4033-8814-7c54c3038fe7/volumes" Dec 04 12:32:56.767778 master-0 kubenswrapper[35367]: I1204 12:32:56.767741 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88ab17ea-be2e-46db-9228-20c8350acd69" path="/var/lib/kubelet/pods/88ab17ea-be2e-46db-9228-20c8350acd69/volumes" Dec 04 12:32:56.768548 master-0 kubenswrapper[35367]: I1204 12:32:56.768507 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ae033ce-33dd-45a3-a0ff-d6f8882a04d7" path="/var/lib/kubelet/pods/9ae033ce-33dd-45a3-a0ff-d6f8882a04d7/volumes" Dec 04 12:32:56.769258 master-0 kubenswrapper[35367]: I1204 12:32:56.769231 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a926be46-cd79-4cad-9105-111102f2bc57" path="/var/lib/kubelet/pods/a926be46-cd79-4cad-9105-111102f2bc57/volumes" Dec 04 12:32:56.770469 master-0 kubenswrapper[35367]: I1204 12:32:56.770439 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bddc3ad4-ddc8-4879-a3ed-045043126b2e" path="/var/lib/kubelet/pods/bddc3ad4-ddc8-4879-a3ed-045043126b2e/volumes" Dec 04 12:32:56.771147 master-0 kubenswrapper[35367]: I1204 12:32:56.771106 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1fc4958-9be9-4dd3-b986-3d35403879f2" path="/var/lib/kubelet/pods/c1fc4958-9be9-4dd3-b986-3d35403879f2/volumes" Dec 04 12:33:27.073537 master-0 kubenswrapper[35367]: I1204 12:33:27.073444 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell0-conductor-db-sync-l8v2r"] Dec 04 12:33:27.089837 master-0 kubenswrapper[35367]: I1204 12:33:27.089734 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-cell0-conductor-db-sync-l8v2r"] Dec 04 12:33:28.763908 master-0 kubenswrapper[35367]: I1204 12:33:28.763786 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77b6e18a-8e1b-4f73-812e-80a31a9de2d3" path="/var/lib/kubelet/pods/77b6e18a-8e1b-4f73-812e-80a31a9de2d3/volumes" Dec 04 12:33:36.284417 master-0 kubenswrapper[35367]: I1204 12:33:36.284303 35367 scope.go:117] "RemoveContainer" containerID="2e0f36270ad02b118298ad2a3b3b4027cf614cf210edb9d33c147c017cfcae8e" Dec 04 12:33:36.325163 master-0 kubenswrapper[35367]: I1204 12:33:36.319407 35367 scope.go:117] "RemoveContainer" containerID="7fa6c5876d653f92cb6c6dcd79cef6309ac38164e08daf26311ed5cb3d94c9c9" Dec 04 12:33:36.412144 master-0 kubenswrapper[35367]: I1204 12:33:36.411644 35367 scope.go:117] "RemoveContainer" containerID="2168865c5fdd6314a61798e9d1ee525b0878f2956830fb196edf368586ae5d81" Dec 04 12:33:36.495738 master-0 kubenswrapper[35367]: I1204 12:33:36.495676 35367 scope.go:117] "RemoveContainer" containerID="3c412e31c83c764a18929b8e2a9d689f8233ce512c293b49be0681e94ff299fe" Dec 04 12:33:36.539162 master-0 kubenswrapper[35367]: I1204 12:33:36.539095 35367 scope.go:117] "RemoveContainer" containerID="0e8a97428b0b1106c0c197d437e77773ece006a05bfd99c9c6668bb19bd07f70" Dec 04 12:33:36.584320 master-0 kubenswrapper[35367]: I1204 12:33:36.584260 35367 scope.go:117] "RemoveContainer" containerID="26c22582f734c8575c8d1230204f75746c43cb407a59f3d7dacee84ee684061d" Dec 04 12:33:36.644473 master-0 kubenswrapper[35367]: I1204 12:33:36.644418 35367 scope.go:117] "RemoveContainer" containerID="50c8a4ba75bad18f2713ed6d95e4b15c73d846c3b3df7ef6198393e8dd0c436a" Dec 04 12:33:36.690842 master-0 kubenswrapper[35367]: I1204 12:33:36.690727 35367 scope.go:117] "RemoveContainer" containerID="58a275bc5016f2928f87149e743e01413b32aedfe6f49f29727bd0127b03d9c0" Dec 04 12:33:55.199462 master-0 kubenswrapper[35367]: I1204 12:33:55.199364 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell0-cell-mapping-48wk7"] Dec 04 12:33:55.216018 master-0 kubenswrapper[35367]: I1204 12:33:55.215900 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-cell0-cell-mapping-48wk7"] Dec 04 12:33:56.765547 master-0 kubenswrapper[35367]: I1204 12:33:56.765466 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="861c8de8-9e85-4f7f-a30a-b2426fd8a848" path="/var/lib/kubelet/pods/861c8de8-9e85-4f7f-a30a-b2426fd8a848/volumes" Dec 04 12:33:58.061415 master-0 kubenswrapper[35367]: I1204 12:33:58.061301 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell1-conductor-db-sync-qqvk9"] Dec 04 12:33:58.078407 master-0 kubenswrapper[35367]: I1204 12:33:58.078324 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-cell1-conductor-db-sync-qqvk9"] Dec 04 12:33:58.767951 master-0 kubenswrapper[35367]: I1204 12:33:58.767849 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6d4bf97-9d51-4065-a290-6b362c4c2096" path="/var/lib/kubelet/pods/b6d4bf97-9d51-4065-a290-6b362c4c2096/volumes" Dec 04 12:34:35.086387 master-0 kubenswrapper[35367]: I1204 12:34:35.084876 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell1-host-discover-m4jx6"] Dec 04 12:34:35.098548 master-0 kubenswrapper[35367]: I1204 12:34:35.098466 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-cell1-host-discover-m4jx6"] Dec 04 12:34:36.765260 master-0 kubenswrapper[35367]: I1204 12:34:36.765170 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7a714b4-e808-4495-bccf-77861918a169" path="/var/lib/kubelet/pods/f7a714b4-e808-4495-bccf-77861918a169/volumes" Dec 04 12:34:36.958232 master-0 kubenswrapper[35367]: I1204 12:34:36.958144 35367 scope.go:117] "RemoveContainer" containerID="2fa0c9bb5cca192b9eeca44369821cb29a738cbe201da811ef3de7ba08c9f0e3" Dec 04 12:34:37.009529 master-0 kubenswrapper[35367]: I1204 12:34:37.009463 35367 scope.go:117] "RemoveContainer" containerID="4661d616e49ca956dcd99befa5bf8e71f9d3c6dc20e24c85e60eabda947c8c00" Dec 04 12:34:37.053766 master-0 kubenswrapper[35367]: I1204 12:34:37.053671 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell1-cell-mapping-vtqc2"] Dec 04 12:34:37.071730 master-0 kubenswrapper[35367]: I1204 12:34:37.071642 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-cell1-cell-mapping-vtqc2"] Dec 04 12:34:37.078845 master-0 kubenswrapper[35367]: I1204 12:34:37.078203 35367 scope.go:117] "RemoveContainer" containerID="c08a09dbe0cf511ad9c6a6f1e21f98afb8d023332e382704b3e19ed34ecf50f6" Dec 04 12:34:38.764456 master-0 kubenswrapper[35367]: I1204 12:34:38.764364 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c8452b4-f20d-4519-a81f-358e8e447d6e" path="/var/lib/kubelet/pods/9c8452b4-f20d-4519-a81f-358e8e447d6e/volumes" Dec 04 12:35:37.237329 master-0 kubenswrapper[35367]: I1204 12:35:37.237233 35367 scope.go:117] "RemoveContainer" containerID="78ca7d97355f2402097bdc2ad25c88c58ea8b5d4c3e74ddeffddf016f18e01ac" Dec 04 12:40:20.102191 master-0 kubenswrapper[35367]: I1204 12:40:20.102072 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-kgvrg"] Dec 04 12:40:20.104233 master-0 kubenswrapper[35367]: E1204 12:40:20.104054 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2fcb207a-3087-42f4-8856-8f8c98fa7d89" containerName="extract-content" Dec 04 12:40:20.104233 master-0 kubenswrapper[35367]: I1204 12:40:20.104227 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fcb207a-3087-42f4-8856-8f8c98fa7d89" containerName="extract-content" Dec 04 12:40:20.104408 master-0 kubenswrapper[35367]: E1204 12:40:20.104351 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2fcb207a-3087-42f4-8856-8f8c98fa7d89" containerName="extract-utilities" Dec 04 12:40:20.104408 master-0 kubenswrapper[35367]: I1204 12:40:20.104364 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fcb207a-3087-42f4-8856-8f8c98fa7d89" containerName="extract-utilities" Dec 04 12:40:20.104408 master-0 kubenswrapper[35367]: E1204 12:40:20.104383 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2fcb207a-3087-42f4-8856-8f8c98fa7d89" containerName="registry-server" Dec 04 12:40:20.104408 master-0 kubenswrapper[35367]: I1204 12:40:20.104393 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fcb207a-3087-42f4-8856-8f8c98fa7d89" containerName="registry-server" Dec 04 12:40:20.104830 master-0 kubenswrapper[35367]: I1204 12:40:20.104758 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="2fcb207a-3087-42f4-8856-8f8c98fa7d89" containerName="registry-server" Dec 04 12:40:20.115750 master-0 kubenswrapper[35367]: I1204 12:40:20.114317 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-kgvrg" Dec 04 12:40:20.155083 master-0 kubenswrapper[35367]: I1204 12:40:20.153599 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-kgvrg"] Dec 04 12:40:20.182164 master-0 kubenswrapper[35367]: I1204 12:40:20.182039 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7209be41-0d17-4236-9771-d7ca09507c5c-catalog-content\") pod \"certified-operators-kgvrg\" (UID: \"7209be41-0d17-4236-9771-d7ca09507c5c\") " pod="openshift-marketplace/certified-operators-kgvrg" Dec 04 12:40:20.182837 master-0 kubenswrapper[35367]: I1204 12:40:20.182431 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsnb6\" (UniqueName: \"kubernetes.io/projected/7209be41-0d17-4236-9771-d7ca09507c5c-kube-api-access-xsnb6\") pod \"certified-operators-kgvrg\" (UID: \"7209be41-0d17-4236-9771-d7ca09507c5c\") " pod="openshift-marketplace/certified-operators-kgvrg" Dec 04 12:40:20.182837 master-0 kubenswrapper[35367]: I1204 12:40:20.182467 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7209be41-0d17-4236-9771-d7ca09507c5c-utilities\") pod \"certified-operators-kgvrg\" (UID: \"7209be41-0d17-4236-9771-d7ca09507c5c\") " pod="openshift-marketplace/certified-operators-kgvrg" Dec 04 12:40:20.288049 master-0 kubenswrapper[35367]: I1204 12:40:20.287585 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7209be41-0d17-4236-9771-d7ca09507c5c-catalog-content\") pod \"certified-operators-kgvrg\" (UID: \"7209be41-0d17-4236-9771-d7ca09507c5c\") " pod="openshift-marketplace/certified-operators-kgvrg" Dec 04 12:40:20.288049 master-0 kubenswrapper[35367]: I1204 12:40:20.287696 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xsnb6\" (UniqueName: \"kubernetes.io/projected/7209be41-0d17-4236-9771-d7ca09507c5c-kube-api-access-xsnb6\") pod \"certified-operators-kgvrg\" (UID: \"7209be41-0d17-4236-9771-d7ca09507c5c\") " pod="openshift-marketplace/certified-operators-kgvrg" Dec 04 12:40:20.288049 master-0 kubenswrapper[35367]: I1204 12:40:20.287722 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7209be41-0d17-4236-9771-d7ca09507c5c-utilities\") pod \"certified-operators-kgvrg\" (UID: \"7209be41-0d17-4236-9771-d7ca09507c5c\") " pod="openshift-marketplace/certified-operators-kgvrg" Dec 04 12:40:20.288459 master-0 kubenswrapper[35367]: I1204 12:40:20.288223 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7209be41-0d17-4236-9771-d7ca09507c5c-catalog-content\") pod \"certified-operators-kgvrg\" (UID: \"7209be41-0d17-4236-9771-d7ca09507c5c\") " pod="openshift-marketplace/certified-operators-kgvrg" Dec 04 12:40:20.288459 master-0 kubenswrapper[35367]: I1204 12:40:20.288413 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7209be41-0d17-4236-9771-d7ca09507c5c-utilities\") pod \"certified-operators-kgvrg\" (UID: \"7209be41-0d17-4236-9771-d7ca09507c5c\") " pod="openshift-marketplace/certified-operators-kgvrg" Dec 04 12:40:20.311327 master-0 kubenswrapper[35367]: I1204 12:40:20.311133 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsnb6\" (UniqueName: \"kubernetes.io/projected/7209be41-0d17-4236-9771-d7ca09507c5c-kube-api-access-xsnb6\") pod \"certified-operators-kgvrg\" (UID: \"7209be41-0d17-4236-9771-d7ca09507c5c\") " pod="openshift-marketplace/certified-operators-kgvrg" Dec 04 12:40:20.454172 master-0 kubenswrapper[35367]: I1204 12:40:20.453941 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-kgvrg" Dec 04 12:40:21.058273 master-0 kubenswrapper[35367]: I1204 12:40:21.057702 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-kgvrg"] Dec 04 12:40:21.635036 master-0 kubenswrapper[35367]: I1204 12:40:21.634952 35367 generic.go:334] "Generic (PLEG): container finished" podID="7209be41-0d17-4236-9771-d7ca09507c5c" containerID="9f21ecc0102176b70dcf5fe58aa47ff8bb2271562c2c057ec69136122c6a2e4e" exitCode=0 Dec 04 12:40:21.635741 master-0 kubenswrapper[35367]: I1204 12:40:21.635130 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-kgvrg" event={"ID":"7209be41-0d17-4236-9771-d7ca09507c5c","Type":"ContainerDied","Data":"9f21ecc0102176b70dcf5fe58aa47ff8bb2271562c2c057ec69136122c6a2e4e"} Dec 04 12:40:21.635892 master-0 kubenswrapper[35367]: I1204 12:40:21.635866 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-kgvrg" event={"ID":"7209be41-0d17-4236-9771-d7ca09507c5c","Type":"ContainerStarted","Data":"4f050442da538486b1d69341b48720d6ab3fd20c502debf12f3f92a382a2fb80"} Dec 04 12:40:21.637100 master-0 kubenswrapper[35367]: I1204 12:40:21.637058 35367 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Dec 04 12:40:23.662800 master-0 kubenswrapper[35367]: I1204 12:40:23.662739 35367 generic.go:334] "Generic (PLEG): container finished" podID="7209be41-0d17-4236-9771-d7ca09507c5c" containerID="2a1c511a1fe94d33ec7ce593528399c85cce75995bb6080017b4abefbecd812f" exitCode=0 Dec 04 12:40:23.662800 master-0 kubenswrapper[35367]: I1204 12:40:23.662799 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-kgvrg" event={"ID":"7209be41-0d17-4236-9771-d7ca09507c5c","Type":"ContainerDied","Data":"2a1c511a1fe94d33ec7ce593528399c85cce75995bb6080017b4abefbecd812f"} Dec 04 12:40:24.689623 master-0 kubenswrapper[35367]: I1204 12:40:24.689408 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-kgvrg" event={"ID":"7209be41-0d17-4236-9771-d7ca09507c5c","Type":"ContainerStarted","Data":"52db4c46f44e26a50763287c9e77db9d3448341890dfe89282c184957243a127"} Dec 04 12:40:24.834576 master-0 kubenswrapper[35367]: I1204 12:40:24.834356 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-kgvrg" podStartSLOduration=2.363120549 podStartE2EDuration="4.834320391s" podCreationTimestamp="2025-12-04 12:40:20 +0000 UTC" firstStartedPulling="2025-12-04 12:40:21.636975524 +0000 UTC m=+2465.075036782" lastFinishedPulling="2025-12-04 12:40:24.108175366 +0000 UTC m=+2467.546236624" observedRunningTime="2025-12-04 12:40:24.824200524 +0000 UTC m=+2468.262261782" watchObservedRunningTime="2025-12-04 12:40:24.834320391 +0000 UTC m=+2468.272381649" Dec 04 12:40:30.454656 master-0 kubenswrapper[35367]: I1204 12:40:30.454466 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-kgvrg" Dec 04 12:40:30.454656 master-0 kubenswrapper[35367]: I1204 12:40:30.454550 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-kgvrg" Dec 04 12:40:30.514327 master-0 kubenswrapper[35367]: I1204 12:40:30.514249 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-kgvrg" Dec 04 12:40:30.823473 master-0 kubenswrapper[35367]: I1204 12:40:30.823392 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-kgvrg" Dec 04 12:40:30.900469 master-0 kubenswrapper[35367]: I1204 12:40:30.900367 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-kgvrg"] Dec 04 12:40:32.790612 master-0 kubenswrapper[35367]: I1204 12:40:32.790438 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-kgvrg" podUID="7209be41-0d17-4236-9771-d7ca09507c5c" containerName="registry-server" containerID="cri-o://52db4c46f44e26a50763287c9e77db9d3448341890dfe89282c184957243a127" gracePeriod=2 Dec 04 12:40:33.371940 master-0 kubenswrapper[35367]: I1204 12:40:33.371875 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-kgvrg" Dec 04 12:40:33.416790 master-0 kubenswrapper[35367]: I1204 12:40:33.416695 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7209be41-0d17-4236-9771-d7ca09507c5c-utilities\") pod \"7209be41-0d17-4236-9771-d7ca09507c5c\" (UID: \"7209be41-0d17-4236-9771-d7ca09507c5c\") " Dec 04 12:40:33.417122 master-0 kubenswrapper[35367]: I1204 12:40:33.416874 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7209be41-0d17-4236-9771-d7ca09507c5c-catalog-content\") pod \"7209be41-0d17-4236-9771-d7ca09507c5c\" (UID: \"7209be41-0d17-4236-9771-d7ca09507c5c\") " Dec 04 12:40:33.417122 master-0 kubenswrapper[35367]: I1204 12:40:33.416955 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsnb6\" (UniqueName: \"kubernetes.io/projected/7209be41-0d17-4236-9771-d7ca09507c5c-kube-api-access-xsnb6\") pod \"7209be41-0d17-4236-9771-d7ca09507c5c\" (UID: \"7209be41-0d17-4236-9771-d7ca09507c5c\") " Dec 04 12:40:33.417758 master-0 kubenswrapper[35367]: I1204 12:40:33.417674 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7209be41-0d17-4236-9771-d7ca09507c5c-utilities" (OuterVolumeSpecName: "utilities") pod "7209be41-0d17-4236-9771-d7ca09507c5c" (UID: "7209be41-0d17-4236-9771-d7ca09507c5c"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:40:33.418452 master-0 kubenswrapper[35367]: I1204 12:40:33.418410 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7209be41-0d17-4236-9771-d7ca09507c5c-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:40:33.420484 master-0 kubenswrapper[35367]: I1204 12:40:33.420388 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7209be41-0d17-4236-9771-d7ca09507c5c-kube-api-access-xsnb6" (OuterVolumeSpecName: "kube-api-access-xsnb6") pod "7209be41-0d17-4236-9771-d7ca09507c5c" (UID: "7209be41-0d17-4236-9771-d7ca09507c5c"). InnerVolumeSpecName "kube-api-access-xsnb6". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:40:33.462756 master-0 kubenswrapper[35367]: I1204 12:40:33.462659 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7209be41-0d17-4236-9771-d7ca09507c5c-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "7209be41-0d17-4236-9771-d7ca09507c5c" (UID: "7209be41-0d17-4236-9771-d7ca09507c5c"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:40:33.521066 master-0 kubenswrapper[35367]: I1204 12:40:33.520917 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7209be41-0d17-4236-9771-d7ca09507c5c-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:40:33.521066 master-0 kubenswrapper[35367]: I1204 12:40:33.520977 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xsnb6\" (UniqueName: \"kubernetes.io/projected/7209be41-0d17-4236-9771-d7ca09507c5c-kube-api-access-xsnb6\") on node \"master-0\" DevicePath \"\"" Dec 04 12:40:33.809057 master-0 kubenswrapper[35367]: I1204 12:40:33.808949 35367 generic.go:334] "Generic (PLEG): container finished" podID="7209be41-0d17-4236-9771-d7ca09507c5c" containerID="52db4c46f44e26a50763287c9e77db9d3448341890dfe89282c184957243a127" exitCode=0 Dec 04 12:40:33.809057 master-0 kubenswrapper[35367]: I1204 12:40:33.809032 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-kgvrg" event={"ID":"7209be41-0d17-4236-9771-d7ca09507c5c","Type":"ContainerDied","Data":"52db4c46f44e26a50763287c9e77db9d3448341890dfe89282c184957243a127"} Dec 04 12:40:33.809884 master-0 kubenswrapper[35367]: I1204 12:40:33.809094 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-kgvrg" Dec 04 12:40:33.809884 master-0 kubenswrapper[35367]: I1204 12:40:33.809139 35367 scope.go:117] "RemoveContainer" containerID="52db4c46f44e26a50763287c9e77db9d3448341890dfe89282c184957243a127" Dec 04 12:40:33.809884 master-0 kubenswrapper[35367]: I1204 12:40:33.809122 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-kgvrg" event={"ID":"7209be41-0d17-4236-9771-d7ca09507c5c","Type":"ContainerDied","Data":"4f050442da538486b1d69341b48720d6ab3fd20c502debf12f3f92a382a2fb80"} Dec 04 12:40:33.826068 master-0 kubenswrapper[35367]: I1204 12:40:33.825444 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-tzlrc"] Dec 04 12:40:33.826992 master-0 kubenswrapper[35367]: E1204 12:40:33.826929 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7209be41-0d17-4236-9771-d7ca09507c5c" containerName="extract-content" Dec 04 12:40:33.826992 master-0 kubenswrapper[35367]: I1204 12:40:33.826992 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="7209be41-0d17-4236-9771-d7ca09507c5c" containerName="extract-content" Dec 04 12:40:33.827109 master-0 kubenswrapper[35367]: E1204 12:40:33.827071 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7209be41-0d17-4236-9771-d7ca09507c5c" containerName="registry-server" Dec 04 12:40:33.827109 master-0 kubenswrapper[35367]: I1204 12:40:33.827083 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="7209be41-0d17-4236-9771-d7ca09507c5c" containerName="registry-server" Dec 04 12:40:33.827178 master-0 kubenswrapper[35367]: E1204 12:40:33.827128 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7209be41-0d17-4236-9771-d7ca09507c5c" containerName="extract-utilities" Dec 04 12:40:33.827178 master-0 kubenswrapper[35367]: I1204 12:40:33.827140 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="7209be41-0d17-4236-9771-d7ca09507c5c" containerName="extract-utilities" Dec 04 12:40:33.827540 master-0 kubenswrapper[35367]: I1204 12:40:33.827508 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="7209be41-0d17-4236-9771-d7ca09507c5c" containerName="registry-server" Dec 04 12:40:33.829818 master-0 kubenswrapper[35367]: I1204 12:40:33.829753 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-tzlrc" Dec 04 12:40:33.851796 master-0 kubenswrapper[35367]: I1204 12:40:33.849905 35367 scope.go:117] "RemoveContainer" containerID="2a1c511a1fe94d33ec7ce593528399c85cce75995bb6080017b4abefbecd812f" Dec 04 12:40:33.876416 master-0 kubenswrapper[35367]: I1204 12:40:33.874776 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-tzlrc"] Dec 04 12:40:33.930886 master-0 kubenswrapper[35367]: I1204 12:40:33.929646 35367 scope.go:117] "RemoveContainer" containerID="9f21ecc0102176b70dcf5fe58aa47ff8bb2271562c2c057ec69136122c6a2e4e" Dec 04 12:40:33.932847 master-0 kubenswrapper[35367]: I1204 12:40:33.932772 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f7b673fb-1df2-4233-ad6b-862c7dc0aaa2-utilities\") pod \"community-operators-tzlrc\" (UID: \"f7b673fb-1df2-4233-ad6b-862c7dc0aaa2\") " pod="openshift-marketplace/community-operators-tzlrc" Dec 04 12:40:33.933123 master-0 kubenswrapper[35367]: I1204 12:40:33.933080 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f7b673fb-1df2-4233-ad6b-862c7dc0aaa2-catalog-content\") pod \"community-operators-tzlrc\" (UID: \"f7b673fb-1df2-4233-ad6b-862c7dc0aaa2\") " pod="openshift-marketplace/community-operators-tzlrc" Dec 04 12:40:33.933242 master-0 kubenswrapper[35367]: I1204 12:40:33.933194 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfq2r\" (UniqueName: \"kubernetes.io/projected/f7b673fb-1df2-4233-ad6b-862c7dc0aaa2-kube-api-access-wfq2r\") pod \"community-operators-tzlrc\" (UID: \"f7b673fb-1df2-4233-ad6b-862c7dc0aaa2\") " pod="openshift-marketplace/community-operators-tzlrc" Dec 04 12:40:33.960455 master-0 kubenswrapper[35367]: I1204 12:40:33.960382 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-kgvrg"] Dec 04 12:40:33.962308 master-0 kubenswrapper[35367]: I1204 12:40:33.962261 35367 scope.go:117] "RemoveContainer" containerID="52db4c46f44e26a50763287c9e77db9d3448341890dfe89282c184957243a127" Dec 04 12:40:33.963404 master-0 kubenswrapper[35367]: E1204 12:40:33.963334 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52db4c46f44e26a50763287c9e77db9d3448341890dfe89282c184957243a127\": container with ID starting with 52db4c46f44e26a50763287c9e77db9d3448341890dfe89282c184957243a127 not found: ID does not exist" containerID="52db4c46f44e26a50763287c9e77db9d3448341890dfe89282c184957243a127" Dec 04 12:40:33.963449 master-0 kubenswrapper[35367]: I1204 12:40:33.963413 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52db4c46f44e26a50763287c9e77db9d3448341890dfe89282c184957243a127"} err="failed to get container status \"52db4c46f44e26a50763287c9e77db9d3448341890dfe89282c184957243a127\": rpc error: code = NotFound desc = could not find container \"52db4c46f44e26a50763287c9e77db9d3448341890dfe89282c184957243a127\": container with ID starting with 52db4c46f44e26a50763287c9e77db9d3448341890dfe89282c184957243a127 not found: ID does not exist" Dec 04 12:40:33.963449 master-0 kubenswrapper[35367]: I1204 12:40:33.963443 35367 scope.go:117] "RemoveContainer" containerID="2a1c511a1fe94d33ec7ce593528399c85cce75995bb6080017b4abefbecd812f" Dec 04 12:40:33.963779 master-0 kubenswrapper[35367]: E1204 12:40:33.963745 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a1c511a1fe94d33ec7ce593528399c85cce75995bb6080017b4abefbecd812f\": container with ID starting with 2a1c511a1fe94d33ec7ce593528399c85cce75995bb6080017b4abefbecd812f not found: ID does not exist" containerID="2a1c511a1fe94d33ec7ce593528399c85cce75995bb6080017b4abefbecd812f" Dec 04 12:40:33.963899 master-0 kubenswrapper[35367]: I1204 12:40:33.963771 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a1c511a1fe94d33ec7ce593528399c85cce75995bb6080017b4abefbecd812f"} err="failed to get container status \"2a1c511a1fe94d33ec7ce593528399c85cce75995bb6080017b4abefbecd812f\": rpc error: code = NotFound desc = could not find container \"2a1c511a1fe94d33ec7ce593528399c85cce75995bb6080017b4abefbecd812f\": container with ID starting with 2a1c511a1fe94d33ec7ce593528399c85cce75995bb6080017b4abefbecd812f not found: ID does not exist" Dec 04 12:40:33.963899 master-0 kubenswrapper[35367]: I1204 12:40:33.963891 35367 scope.go:117] "RemoveContainer" containerID="9f21ecc0102176b70dcf5fe58aa47ff8bb2271562c2c057ec69136122c6a2e4e" Dec 04 12:40:33.964434 master-0 kubenswrapper[35367]: E1204 12:40:33.964152 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f21ecc0102176b70dcf5fe58aa47ff8bb2271562c2c057ec69136122c6a2e4e\": container with ID starting with 9f21ecc0102176b70dcf5fe58aa47ff8bb2271562c2c057ec69136122c6a2e4e not found: ID does not exist" containerID="9f21ecc0102176b70dcf5fe58aa47ff8bb2271562c2c057ec69136122c6a2e4e" Dec 04 12:40:33.964434 master-0 kubenswrapper[35367]: I1204 12:40:33.964182 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f21ecc0102176b70dcf5fe58aa47ff8bb2271562c2c057ec69136122c6a2e4e"} err="failed to get container status \"9f21ecc0102176b70dcf5fe58aa47ff8bb2271562c2c057ec69136122c6a2e4e\": rpc error: code = NotFound desc = could not find container \"9f21ecc0102176b70dcf5fe58aa47ff8bb2271562c2c057ec69136122c6a2e4e\": container with ID starting with 9f21ecc0102176b70dcf5fe58aa47ff8bb2271562c2c057ec69136122c6a2e4e not found: ID does not exist" Dec 04 12:40:33.989226 master-0 kubenswrapper[35367]: I1204 12:40:33.989150 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-kgvrg"] Dec 04 12:40:34.035715 master-0 kubenswrapper[35367]: I1204 12:40:34.035638 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wfq2r\" (UniqueName: \"kubernetes.io/projected/f7b673fb-1df2-4233-ad6b-862c7dc0aaa2-kube-api-access-wfq2r\") pod \"community-operators-tzlrc\" (UID: \"f7b673fb-1df2-4233-ad6b-862c7dc0aaa2\") " pod="openshift-marketplace/community-operators-tzlrc" Dec 04 12:40:34.036144 master-0 kubenswrapper[35367]: I1204 12:40:34.035818 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f7b673fb-1df2-4233-ad6b-862c7dc0aaa2-utilities\") pod \"community-operators-tzlrc\" (UID: \"f7b673fb-1df2-4233-ad6b-862c7dc0aaa2\") " pod="openshift-marketplace/community-operators-tzlrc" Dec 04 12:40:34.036144 master-0 kubenswrapper[35367]: I1204 12:40:34.035955 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f7b673fb-1df2-4233-ad6b-862c7dc0aaa2-catalog-content\") pod \"community-operators-tzlrc\" (UID: \"f7b673fb-1df2-4233-ad6b-862c7dc0aaa2\") " pod="openshift-marketplace/community-operators-tzlrc" Dec 04 12:40:34.037002 master-0 kubenswrapper[35367]: I1204 12:40:34.036693 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f7b673fb-1df2-4233-ad6b-862c7dc0aaa2-catalog-content\") pod \"community-operators-tzlrc\" (UID: \"f7b673fb-1df2-4233-ad6b-862c7dc0aaa2\") " pod="openshift-marketplace/community-operators-tzlrc" Dec 04 12:40:34.037002 master-0 kubenswrapper[35367]: I1204 12:40:34.036680 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f7b673fb-1df2-4233-ad6b-862c7dc0aaa2-utilities\") pod \"community-operators-tzlrc\" (UID: \"f7b673fb-1df2-4233-ad6b-862c7dc0aaa2\") " pod="openshift-marketplace/community-operators-tzlrc" Dec 04 12:40:34.056942 master-0 kubenswrapper[35367]: I1204 12:40:34.055989 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfq2r\" (UniqueName: \"kubernetes.io/projected/f7b673fb-1df2-4233-ad6b-862c7dc0aaa2-kube-api-access-wfq2r\") pod \"community-operators-tzlrc\" (UID: \"f7b673fb-1df2-4233-ad6b-862c7dc0aaa2\") " pod="openshift-marketplace/community-operators-tzlrc" Dec 04 12:40:34.209842 master-0 kubenswrapper[35367]: I1204 12:40:34.209621 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-tzlrc" Dec 04 12:40:34.759735 master-0 kubenswrapper[35367]: W1204 12:40:34.759652 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b673fb_1df2_4233_ad6b_862c7dc0aaa2.slice/crio-bca4ab7535e5323f00584ed1e38471efb3af590f4b5b7c9b0ca158cca6386caf WatchSource:0}: Error finding container bca4ab7535e5323f00584ed1e38471efb3af590f4b5b7c9b0ca158cca6386caf: Status 404 returned error can't find the container with id bca4ab7535e5323f00584ed1e38471efb3af590f4b5b7c9b0ca158cca6386caf Dec 04 12:40:34.765013 master-0 kubenswrapper[35367]: I1204 12:40:34.764944 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7209be41-0d17-4236-9771-d7ca09507c5c" path="/var/lib/kubelet/pods/7209be41-0d17-4236-9771-d7ca09507c5c/volumes" Dec 04 12:40:34.765896 master-0 kubenswrapper[35367]: I1204 12:40:34.765870 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-tzlrc"] Dec 04 12:40:34.825165 master-0 kubenswrapper[35367]: I1204 12:40:34.825066 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-tzlrc" event={"ID":"f7b673fb-1df2-4233-ad6b-862c7dc0aaa2","Type":"ContainerStarted","Data":"bca4ab7535e5323f00584ed1e38471efb3af590f4b5b7c9b0ca158cca6386caf"} Dec 04 12:40:35.843831 master-0 kubenswrapper[35367]: I1204 12:40:35.843732 35367 generic.go:334] "Generic (PLEG): container finished" podID="f7b673fb-1df2-4233-ad6b-862c7dc0aaa2" containerID="46113cc92c2e46928f6b9a67776e9b3c9964402abe670d03aabe2f6a6868620b" exitCode=0 Dec 04 12:40:35.844535 master-0 kubenswrapper[35367]: I1204 12:40:35.843877 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-tzlrc" event={"ID":"f7b673fb-1df2-4233-ad6b-862c7dc0aaa2","Type":"ContainerDied","Data":"46113cc92c2e46928f6b9a67776e9b3c9964402abe670d03aabe2f6a6868620b"} Dec 04 12:40:37.874190 master-0 kubenswrapper[35367]: I1204 12:40:37.874091 35367 generic.go:334] "Generic (PLEG): container finished" podID="f7b673fb-1df2-4233-ad6b-862c7dc0aaa2" containerID="9b19607ca11b08a055efe26edcff2bb584d29724a798bcea1da53565e547e7c7" exitCode=0 Dec 04 12:40:37.874190 master-0 kubenswrapper[35367]: I1204 12:40:37.874169 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-tzlrc" event={"ID":"f7b673fb-1df2-4233-ad6b-862c7dc0aaa2","Type":"ContainerDied","Data":"9b19607ca11b08a055efe26edcff2bb584d29724a798bcea1da53565e547e7c7"} Dec 04 12:40:38.890121 master-0 kubenswrapper[35367]: I1204 12:40:38.890038 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-tzlrc" event={"ID":"f7b673fb-1df2-4233-ad6b-862c7dc0aaa2","Type":"ContainerStarted","Data":"c5baa44e38b143f04783abb808521f844ab5e59ebf489cbbb899a15eca7e1f63"} Dec 04 12:40:38.924706 master-0 kubenswrapper[35367]: I1204 12:40:38.924519 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-tzlrc" podStartSLOduration=3.470985369 podStartE2EDuration="5.924479741s" podCreationTimestamp="2025-12-04 12:40:33 +0000 UTC" firstStartedPulling="2025-12-04 12:40:35.846679671 +0000 UTC m=+2479.284740929" lastFinishedPulling="2025-12-04 12:40:38.300174043 +0000 UTC m=+2481.738235301" observedRunningTime="2025-12-04 12:40:38.912109312 +0000 UTC m=+2482.350170580" watchObservedRunningTime="2025-12-04 12:40:38.924479741 +0000 UTC m=+2482.362541009" Dec 04 12:40:44.210514 master-0 kubenswrapper[35367]: I1204 12:40:44.210407 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-tzlrc" Dec 04 12:40:44.210514 master-0 kubenswrapper[35367]: I1204 12:40:44.210545 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-tzlrc" Dec 04 12:40:44.270738 master-0 kubenswrapper[35367]: I1204 12:40:44.270276 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-tzlrc" Dec 04 12:40:45.034322 master-0 kubenswrapper[35367]: I1204 12:40:45.034264 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-tzlrc" Dec 04 12:40:45.285305 master-0 kubenswrapper[35367]: I1204 12:40:45.285072 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-tzlrc"] Dec 04 12:40:47.004461 master-0 kubenswrapper[35367]: I1204 12:40:47.004265 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-tzlrc" podUID="f7b673fb-1df2-4233-ad6b-862c7dc0aaa2" containerName="registry-server" containerID="cri-o://c5baa44e38b143f04783abb808521f844ab5e59ebf489cbbb899a15eca7e1f63" gracePeriod=2 Dec 04 12:40:47.099123 master-0 kubenswrapper[35367]: E1204 12:40:47.098982 35367 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b673fb_1df2_4233_ad6b_862c7dc0aaa2.slice/crio-conmon-c5baa44e38b143f04783abb808521f844ab5e59ebf489cbbb899a15eca7e1f63.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b673fb_1df2_4233_ad6b_862c7dc0aaa2.slice/crio-c5baa44e38b143f04783abb808521f844ab5e59ebf489cbbb899a15eca7e1f63.scope\": RecentStats: unable to find data in memory cache]" Dec 04 12:40:47.573025 master-0 kubenswrapper[35367]: I1204 12:40:47.572958 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-tzlrc" Dec 04 12:40:47.665815 master-0 kubenswrapper[35367]: I1204 12:40:47.665741 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfq2r\" (UniqueName: \"kubernetes.io/projected/f7b673fb-1df2-4233-ad6b-862c7dc0aaa2-kube-api-access-wfq2r\") pod \"f7b673fb-1df2-4233-ad6b-862c7dc0aaa2\" (UID: \"f7b673fb-1df2-4233-ad6b-862c7dc0aaa2\") " Dec 04 12:40:47.666427 master-0 kubenswrapper[35367]: I1204 12:40:47.666405 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f7b673fb-1df2-4233-ad6b-862c7dc0aaa2-utilities\") pod \"f7b673fb-1df2-4233-ad6b-862c7dc0aaa2\" (UID: \"f7b673fb-1df2-4233-ad6b-862c7dc0aaa2\") " Dec 04 12:40:47.666639 master-0 kubenswrapper[35367]: I1204 12:40:47.666620 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f7b673fb-1df2-4233-ad6b-862c7dc0aaa2-catalog-content\") pod \"f7b673fb-1df2-4233-ad6b-862c7dc0aaa2\" (UID: \"f7b673fb-1df2-4233-ad6b-862c7dc0aaa2\") " Dec 04 12:40:47.667185 master-0 kubenswrapper[35367]: I1204 12:40:47.667136 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7b673fb-1df2-4233-ad6b-862c7dc0aaa2-utilities" (OuterVolumeSpecName: "utilities") pod "f7b673fb-1df2-4233-ad6b-862c7dc0aaa2" (UID: "f7b673fb-1df2-4233-ad6b-862c7dc0aaa2"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:40:47.667711 master-0 kubenswrapper[35367]: I1204 12:40:47.667692 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f7b673fb-1df2-4233-ad6b-862c7dc0aaa2-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:40:47.669445 master-0 kubenswrapper[35367]: I1204 12:40:47.669416 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7b673fb-1df2-4233-ad6b-862c7dc0aaa2-kube-api-access-wfq2r" (OuterVolumeSpecName: "kube-api-access-wfq2r") pod "f7b673fb-1df2-4233-ad6b-862c7dc0aaa2" (UID: "f7b673fb-1df2-4233-ad6b-862c7dc0aaa2"). InnerVolumeSpecName "kube-api-access-wfq2r". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:40:47.727357 master-0 kubenswrapper[35367]: I1204 12:40:47.727287 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7b673fb-1df2-4233-ad6b-862c7dc0aaa2-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "f7b673fb-1df2-4233-ad6b-862c7dc0aaa2" (UID: "f7b673fb-1df2-4233-ad6b-862c7dc0aaa2"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:40:47.770482 master-0 kubenswrapper[35367]: I1204 12:40:47.770411 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f7b673fb-1df2-4233-ad6b-862c7dc0aaa2-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:40:47.770482 master-0 kubenswrapper[35367]: I1204 12:40:47.770462 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wfq2r\" (UniqueName: \"kubernetes.io/projected/f7b673fb-1df2-4233-ad6b-862c7dc0aaa2-kube-api-access-wfq2r\") on node \"master-0\" DevicePath \"\"" Dec 04 12:40:48.021682 master-0 kubenswrapper[35367]: I1204 12:40:48.021521 35367 generic.go:334] "Generic (PLEG): container finished" podID="f7b673fb-1df2-4233-ad6b-862c7dc0aaa2" containerID="c5baa44e38b143f04783abb808521f844ab5e59ebf489cbbb899a15eca7e1f63" exitCode=0 Dec 04 12:40:48.021682 master-0 kubenswrapper[35367]: I1204 12:40:48.021580 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-tzlrc" event={"ID":"f7b673fb-1df2-4233-ad6b-862c7dc0aaa2","Type":"ContainerDied","Data":"c5baa44e38b143f04783abb808521f844ab5e59ebf489cbbb899a15eca7e1f63"} Dec 04 12:40:48.021682 master-0 kubenswrapper[35367]: I1204 12:40:48.021613 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-tzlrc" event={"ID":"f7b673fb-1df2-4233-ad6b-862c7dc0aaa2","Type":"ContainerDied","Data":"bca4ab7535e5323f00584ed1e38471efb3af590f4b5b7c9b0ca158cca6386caf"} Dec 04 12:40:48.021682 master-0 kubenswrapper[35367]: I1204 12:40:48.021632 35367 scope.go:117] "RemoveContainer" containerID="c5baa44e38b143f04783abb808521f844ab5e59ebf489cbbb899a15eca7e1f63" Dec 04 12:40:48.022459 master-0 kubenswrapper[35367]: I1204 12:40:48.021795 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-tzlrc" Dec 04 12:40:48.048403 master-0 kubenswrapper[35367]: I1204 12:40:48.048330 35367 scope.go:117] "RemoveContainer" containerID="9b19607ca11b08a055efe26edcff2bb584d29724a798bcea1da53565e547e7c7" Dec 04 12:40:48.073395 master-0 kubenswrapper[35367]: I1204 12:40:48.073272 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-tzlrc"] Dec 04 12:40:48.089801 master-0 kubenswrapper[35367]: I1204 12:40:48.089725 35367 scope.go:117] "RemoveContainer" containerID="46113cc92c2e46928f6b9a67776e9b3c9964402abe670d03aabe2f6a6868620b" Dec 04 12:40:48.091770 master-0 kubenswrapper[35367]: I1204 12:40:48.091707 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-tzlrc"] Dec 04 12:40:48.141230 master-0 kubenswrapper[35367]: I1204 12:40:48.141010 35367 scope.go:117] "RemoveContainer" containerID="c5baa44e38b143f04783abb808521f844ab5e59ebf489cbbb899a15eca7e1f63" Dec 04 12:40:48.141879 master-0 kubenswrapper[35367]: E1204 12:40:48.141777 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5baa44e38b143f04783abb808521f844ab5e59ebf489cbbb899a15eca7e1f63\": container with ID starting with c5baa44e38b143f04783abb808521f844ab5e59ebf489cbbb899a15eca7e1f63 not found: ID does not exist" containerID="c5baa44e38b143f04783abb808521f844ab5e59ebf489cbbb899a15eca7e1f63" Dec 04 12:40:48.141975 master-0 kubenswrapper[35367]: I1204 12:40:48.141893 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5baa44e38b143f04783abb808521f844ab5e59ebf489cbbb899a15eca7e1f63"} err="failed to get container status \"c5baa44e38b143f04783abb808521f844ab5e59ebf489cbbb899a15eca7e1f63\": rpc error: code = NotFound desc = could not find container \"c5baa44e38b143f04783abb808521f844ab5e59ebf489cbbb899a15eca7e1f63\": container with ID starting with c5baa44e38b143f04783abb808521f844ab5e59ebf489cbbb899a15eca7e1f63 not found: ID does not exist" Dec 04 12:40:48.141975 master-0 kubenswrapper[35367]: I1204 12:40:48.141938 35367 scope.go:117] "RemoveContainer" containerID="9b19607ca11b08a055efe26edcff2bb584d29724a798bcea1da53565e547e7c7" Dec 04 12:40:48.142478 master-0 kubenswrapper[35367]: E1204 12:40:48.142400 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b19607ca11b08a055efe26edcff2bb584d29724a798bcea1da53565e547e7c7\": container with ID starting with 9b19607ca11b08a055efe26edcff2bb584d29724a798bcea1da53565e547e7c7 not found: ID does not exist" containerID="9b19607ca11b08a055efe26edcff2bb584d29724a798bcea1da53565e547e7c7" Dec 04 12:40:48.142569 master-0 kubenswrapper[35367]: I1204 12:40:48.142524 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b19607ca11b08a055efe26edcff2bb584d29724a798bcea1da53565e547e7c7"} err="failed to get container status \"9b19607ca11b08a055efe26edcff2bb584d29724a798bcea1da53565e547e7c7\": rpc error: code = NotFound desc = could not find container \"9b19607ca11b08a055efe26edcff2bb584d29724a798bcea1da53565e547e7c7\": container with ID starting with 9b19607ca11b08a055efe26edcff2bb584d29724a798bcea1da53565e547e7c7 not found: ID does not exist" Dec 04 12:40:48.142626 master-0 kubenswrapper[35367]: I1204 12:40:48.142568 35367 scope.go:117] "RemoveContainer" containerID="46113cc92c2e46928f6b9a67776e9b3c9964402abe670d03aabe2f6a6868620b" Dec 04 12:40:48.143033 master-0 kubenswrapper[35367]: E1204 12:40:48.142985 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46113cc92c2e46928f6b9a67776e9b3c9964402abe670d03aabe2f6a6868620b\": container with ID starting with 46113cc92c2e46928f6b9a67776e9b3c9964402abe670d03aabe2f6a6868620b not found: ID does not exist" containerID="46113cc92c2e46928f6b9a67776e9b3c9964402abe670d03aabe2f6a6868620b" Dec 04 12:40:48.143128 master-0 kubenswrapper[35367]: I1204 12:40:48.143028 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46113cc92c2e46928f6b9a67776e9b3c9964402abe670d03aabe2f6a6868620b"} err="failed to get container status \"46113cc92c2e46928f6b9a67776e9b3c9964402abe670d03aabe2f6a6868620b\": rpc error: code = NotFound desc = could not find container \"46113cc92c2e46928f6b9a67776e9b3c9964402abe670d03aabe2f6a6868620b\": container with ID starting with 46113cc92c2e46928f6b9a67776e9b3c9964402abe670d03aabe2f6a6868620b not found: ID does not exist" Dec 04 12:40:48.768393 master-0 kubenswrapper[35367]: I1204 12:40:48.768305 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7b673fb-1df2-4233-ad6b-862c7dc0aaa2" path="/var/lib/kubelet/pods/f7b673fb-1df2-4233-ad6b-862c7dc0aaa2/volumes" Dec 04 12:40:59.010455 master-0 kubenswrapper[35367]: I1204 12:40:59.010385 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-6vhlg"] Dec 04 12:40:59.011244 master-0 kubenswrapper[35367]: E1204 12:40:59.011053 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f7b673fb-1df2-4233-ad6b-862c7dc0aaa2" containerName="extract-utilities" Dec 04 12:40:59.011244 master-0 kubenswrapper[35367]: I1204 12:40:59.011071 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7b673fb-1df2-4233-ad6b-862c7dc0aaa2" containerName="extract-utilities" Dec 04 12:40:59.011244 master-0 kubenswrapper[35367]: E1204 12:40:59.011158 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f7b673fb-1df2-4233-ad6b-862c7dc0aaa2" containerName="extract-content" Dec 04 12:40:59.011244 master-0 kubenswrapper[35367]: I1204 12:40:59.011165 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7b673fb-1df2-4233-ad6b-862c7dc0aaa2" containerName="extract-content" Dec 04 12:40:59.011244 master-0 kubenswrapper[35367]: E1204 12:40:59.011188 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f7b673fb-1df2-4233-ad6b-862c7dc0aaa2" containerName="registry-server" Dec 04 12:40:59.011244 master-0 kubenswrapper[35367]: I1204 12:40:59.011197 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7b673fb-1df2-4233-ad6b-862c7dc0aaa2" containerName="registry-server" Dec 04 12:40:59.011561 master-0 kubenswrapper[35367]: I1204 12:40:59.011525 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="f7b673fb-1df2-4233-ad6b-862c7dc0aaa2" containerName="registry-server" Dec 04 12:40:59.014118 master-0 kubenswrapper[35367]: I1204 12:40:59.014067 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6vhlg" Dec 04 12:40:59.050695 master-0 kubenswrapper[35367]: I1204 12:40:59.050594 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-6vhlg"] Dec 04 12:40:59.109319 master-0 kubenswrapper[35367]: I1204 12:40:59.109001 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e20e9765-6e72-420a-9f8f-259676ad142f-catalog-content\") pod \"redhat-marketplace-6vhlg\" (UID: \"e20e9765-6e72-420a-9f8f-259676ad142f\") " pod="openshift-marketplace/redhat-marketplace-6vhlg" Dec 04 12:40:59.109319 master-0 kubenswrapper[35367]: I1204 12:40:59.109211 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e20e9765-6e72-420a-9f8f-259676ad142f-utilities\") pod \"redhat-marketplace-6vhlg\" (UID: \"e20e9765-6e72-420a-9f8f-259676ad142f\") " pod="openshift-marketplace/redhat-marketplace-6vhlg" Dec 04 12:40:59.109830 master-0 kubenswrapper[35367]: I1204 12:40:59.109704 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8mxv\" (UniqueName: \"kubernetes.io/projected/e20e9765-6e72-420a-9f8f-259676ad142f-kube-api-access-n8mxv\") pod \"redhat-marketplace-6vhlg\" (UID: \"e20e9765-6e72-420a-9f8f-259676ad142f\") " pod="openshift-marketplace/redhat-marketplace-6vhlg" Dec 04 12:40:59.213257 master-0 kubenswrapper[35367]: I1204 12:40:59.213142 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n8mxv\" (UniqueName: \"kubernetes.io/projected/e20e9765-6e72-420a-9f8f-259676ad142f-kube-api-access-n8mxv\") pod \"redhat-marketplace-6vhlg\" (UID: \"e20e9765-6e72-420a-9f8f-259676ad142f\") " pod="openshift-marketplace/redhat-marketplace-6vhlg" Dec 04 12:40:59.213737 master-0 kubenswrapper[35367]: I1204 12:40:59.213419 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e20e9765-6e72-420a-9f8f-259676ad142f-catalog-content\") pod \"redhat-marketplace-6vhlg\" (UID: \"e20e9765-6e72-420a-9f8f-259676ad142f\") " pod="openshift-marketplace/redhat-marketplace-6vhlg" Dec 04 12:40:59.213737 master-0 kubenswrapper[35367]: I1204 12:40:59.213621 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e20e9765-6e72-420a-9f8f-259676ad142f-utilities\") pod \"redhat-marketplace-6vhlg\" (UID: \"e20e9765-6e72-420a-9f8f-259676ad142f\") " pod="openshift-marketplace/redhat-marketplace-6vhlg" Dec 04 12:40:59.214317 master-0 kubenswrapper[35367]: I1204 12:40:59.214259 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e20e9765-6e72-420a-9f8f-259676ad142f-utilities\") pod \"redhat-marketplace-6vhlg\" (UID: \"e20e9765-6e72-420a-9f8f-259676ad142f\") " pod="openshift-marketplace/redhat-marketplace-6vhlg" Dec 04 12:40:59.214401 master-0 kubenswrapper[35367]: I1204 12:40:59.214256 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e20e9765-6e72-420a-9f8f-259676ad142f-catalog-content\") pod \"redhat-marketplace-6vhlg\" (UID: \"e20e9765-6e72-420a-9f8f-259676ad142f\") " pod="openshift-marketplace/redhat-marketplace-6vhlg" Dec 04 12:40:59.358502 master-0 kubenswrapper[35367]: I1204 12:40:59.358432 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8mxv\" (UniqueName: \"kubernetes.io/projected/e20e9765-6e72-420a-9f8f-259676ad142f-kube-api-access-n8mxv\") pod \"redhat-marketplace-6vhlg\" (UID: \"e20e9765-6e72-420a-9f8f-259676ad142f\") " pod="openshift-marketplace/redhat-marketplace-6vhlg" Dec 04 12:40:59.646547 master-0 kubenswrapper[35367]: I1204 12:40:59.646221 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6vhlg" Dec 04 12:41:00.178005 master-0 kubenswrapper[35367]: W1204 12:41:00.177915 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode20e9765_6e72_420a_9f8f_259676ad142f.slice/crio-252784685b9dab63cc6cb0777518639ed14fe30c541004f5c6173ed27db616c0 WatchSource:0}: Error finding container 252784685b9dab63cc6cb0777518639ed14fe30c541004f5c6173ed27db616c0: Status 404 returned error can't find the container with id 252784685b9dab63cc6cb0777518639ed14fe30c541004f5c6173ed27db616c0 Dec 04 12:41:00.179950 master-0 kubenswrapper[35367]: I1204 12:41:00.179780 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-6vhlg"] Dec 04 12:41:00.209253 master-0 kubenswrapper[35367]: I1204 12:41:00.209160 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6vhlg" event={"ID":"e20e9765-6e72-420a-9f8f-259676ad142f","Type":"ContainerStarted","Data":"252784685b9dab63cc6cb0777518639ed14fe30c541004f5c6173ed27db616c0"} Dec 04 12:41:01.239052 master-0 kubenswrapper[35367]: I1204 12:41:01.238978 35367 generic.go:334] "Generic (PLEG): container finished" podID="e20e9765-6e72-420a-9f8f-259676ad142f" containerID="c4d4b516773de0cf9386dc05d87f300cb45d0d3b54e58dab21c5c7eb8c55a8a8" exitCode=0 Dec 04 12:41:01.239672 master-0 kubenswrapper[35367]: I1204 12:41:01.239064 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6vhlg" event={"ID":"e20e9765-6e72-420a-9f8f-259676ad142f","Type":"ContainerDied","Data":"c4d4b516773de0cf9386dc05d87f300cb45d0d3b54e58dab21c5c7eb8c55a8a8"} Dec 04 12:41:02.253041 master-0 kubenswrapper[35367]: I1204 12:41:02.252973 35367 generic.go:334] "Generic (PLEG): container finished" podID="e20e9765-6e72-420a-9f8f-259676ad142f" containerID="9cd035cd0976ad12c5f9b74c198e1c3ce470a22b98363d67904fbd049fca7abd" exitCode=0 Dec 04 12:41:02.253853 master-0 kubenswrapper[35367]: I1204 12:41:02.253104 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6vhlg" event={"ID":"e20e9765-6e72-420a-9f8f-259676ad142f","Type":"ContainerDied","Data":"9cd035cd0976ad12c5f9b74c198e1c3ce470a22b98363d67904fbd049fca7abd"} Dec 04 12:41:03.268419 master-0 kubenswrapper[35367]: I1204 12:41:03.268360 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6vhlg" event={"ID":"e20e9765-6e72-420a-9f8f-259676ad142f","Type":"ContainerStarted","Data":"22c0d407c656b77aa6227c7992b72e4c1c8cee5e57343a579328c8cd17859700"} Dec 04 12:41:03.298545 master-0 kubenswrapper[35367]: I1204 12:41:03.298447 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-6vhlg" podStartSLOduration=3.880368433 podStartE2EDuration="5.298423508s" podCreationTimestamp="2025-12-04 12:40:58 +0000 UTC" firstStartedPulling="2025-12-04 12:41:01.242228239 +0000 UTC m=+2504.680289497" lastFinishedPulling="2025-12-04 12:41:02.660283314 +0000 UTC m=+2506.098344572" observedRunningTime="2025-12-04 12:41:03.291856957 +0000 UTC m=+2506.729918225" watchObservedRunningTime="2025-12-04 12:41:03.298423508 +0000 UTC m=+2506.736484766" Dec 04 12:41:09.646455 master-0 kubenswrapper[35367]: I1204 12:41:09.646400 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-6vhlg" Dec 04 12:41:09.646455 master-0 kubenswrapper[35367]: I1204 12:41:09.646468 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-6vhlg" Dec 04 12:41:09.700910 master-0 kubenswrapper[35367]: I1204 12:41:09.700838 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-6vhlg" Dec 04 12:41:10.425657 master-0 kubenswrapper[35367]: I1204 12:41:10.425086 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-6vhlg" Dec 04 12:41:10.494445 master-0 kubenswrapper[35367]: I1204 12:41:10.494350 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-6vhlg"] Dec 04 12:41:12.395144 master-0 kubenswrapper[35367]: I1204 12:41:12.395063 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-6vhlg" podUID="e20e9765-6e72-420a-9f8f-259676ad142f" containerName="registry-server" containerID="cri-o://22c0d407c656b77aa6227c7992b72e4c1c8cee5e57343a579328c8cd17859700" gracePeriod=2 Dec 04 12:41:12.984046 master-0 kubenswrapper[35367]: I1204 12:41:12.983996 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6vhlg" Dec 04 12:41:13.133258 master-0 kubenswrapper[35367]: I1204 12:41:13.133105 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e20e9765-6e72-420a-9f8f-259676ad142f-catalog-content\") pod \"e20e9765-6e72-420a-9f8f-259676ad142f\" (UID: \"e20e9765-6e72-420a-9f8f-259676ad142f\") " Dec 04 12:41:13.133258 master-0 kubenswrapper[35367]: I1204 12:41:13.133195 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8mxv\" (UniqueName: \"kubernetes.io/projected/e20e9765-6e72-420a-9f8f-259676ad142f-kube-api-access-n8mxv\") pod \"e20e9765-6e72-420a-9f8f-259676ad142f\" (UID: \"e20e9765-6e72-420a-9f8f-259676ad142f\") " Dec 04 12:41:13.133630 master-0 kubenswrapper[35367]: I1204 12:41:13.133446 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e20e9765-6e72-420a-9f8f-259676ad142f-utilities\") pod \"e20e9765-6e72-420a-9f8f-259676ad142f\" (UID: \"e20e9765-6e72-420a-9f8f-259676ad142f\") " Dec 04 12:41:13.135128 master-0 kubenswrapper[35367]: I1204 12:41:13.135083 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e20e9765-6e72-420a-9f8f-259676ad142f-utilities" (OuterVolumeSpecName: "utilities") pod "e20e9765-6e72-420a-9f8f-259676ad142f" (UID: "e20e9765-6e72-420a-9f8f-259676ad142f"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:41:13.138569 master-0 kubenswrapper[35367]: I1204 12:41:13.138504 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e20e9765-6e72-420a-9f8f-259676ad142f-kube-api-access-n8mxv" (OuterVolumeSpecName: "kube-api-access-n8mxv") pod "e20e9765-6e72-420a-9f8f-259676ad142f" (UID: "e20e9765-6e72-420a-9f8f-259676ad142f"). InnerVolumeSpecName "kube-api-access-n8mxv". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:41:13.154054 master-0 kubenswrapper[35367]: I1204 12:41:13.153957 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e20e9765-6e72-420a-9f8f-259676ad142f-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "e20e9765-6e72-420a-9f8f-259676ad142f" (UID: "e20e9765-6e72-420a-9f8f-259676ad142f"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:41:13.238058 master-0 kubenswrapper[35367]: I1204 12:41:13.237963 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e20e9765-6e72-420a-9f8f-259676ad142f-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:41:13.238058 master-0 kubenswrapper[35367]: I1204 12:41:13.238040 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e20e9765-6e72-420a-9f8f-259676ad142f-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:41:13.238058 master-0 kubenswrapper[35367]: I1204 12:41:13.238062 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-n8mxv\" (UniqueName: \"kubernetes.io/projected/e20e9765-6e72-420a-9f8f-259676ad142f-kube-api-access-n8mxv\") on node \"master-0\" DevicePath \"\"" Dec 04 12:41:13.411379 master-0 kubenswrapper[35367]: I1204 12:41:13.411234 35367 generic.go:334] "Generic (PLEG): container finished" podID="e20e9765-6e72-420a-9f8f-259676ad142f" containerID="22c0d407c656b77aa6227c7992b72e4c1c8cee5e57343a579328c8cd17859700" exitCode=0 Dec 04 12:41:13.411379 master-0 kubenswrapper[35367]: I1204 12:41:13.411302 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6vhlg" Dec 04 12:41:13.412072 master-0 kubenswrapper[35367]: I1204 12:41:13.411302 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6vhlg" event={"ID":"e20e9765-6e72-420a-9f8f-259676ad142f","Type":"ContainerDied","Data":"22c0d407c656b77aa6227c7992b72e4c1c8cee5e57343a579328c8cd17859700"} Dec 04 12:41:13.412072 master-0 kubenswrapper[35367]: I1204 12:41:13.411523 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6vhlg" event={"ID":"e20e9765-6e72-420a-9f8f-259676ad142f","Type":"ContainerDied","Data":"252784685b9dab63cc6cb0777518639ed14fe30c541004f5c6173ed27db616c0"} Dec 04 12:41:13.412072 master-0 kubenswrapper[35367]: I1204 12:41:13.411552 35367 scope.go:117] "RemoveContainer" containerID="22c0d407c656b77aa6227c7992b72e4c1c8cee5e57343a579328c8cd17859700" Dec 04 12:41:13.442610 master-0 kubenswrapper[35367]: I1204 12:41:13.442537 35367 scope.go:117] "RemoveContainer" containerID="9cd035cd0976ad12c5f9b74c198e1c3ce470a22b98363d67904fbd049fca7abd" Dec 04 12:41:13.479201 master-0 kubenswrapper[35367]: I1204 12:41:13.479102 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-6vhlg"] Dec 04 12:41:13.480437 master-0 kubenswrapper[35367]: I1204 12:41:13.480376 35367 scope.go:117] "RemoveContainer" containerID="c4d4b516773de0cf9386dc05d87f300cb45d0d3b54e58dab21c5c7eb8c55a8a8" Dec 04 12:41:13.494167 master-0 kubenswrapper[35367]: I1204 12:41:13.494047 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-6vhlg"] Dec 04 12:41:13.540007 master-0 kubenswrapper[35367]: I1204 12:41:13.539956 35367 scope.go:117] "RemoveContainer" containerID="22c0d407c656b77aa6227c7992b72e4c1c8cee5e57343a579328c8cd17859700" Dec 04 12:41:13.541082 master-0 kubenswrapper[35367]: E1204 12:41:13.541048 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22c0d407c656b77aa6227c7992b72e4c1c8cee5e57343a579328c8cd17859700\": container with ID starting with 22c0d407c656b77aa6227c7992b72e4c1c8cee5e57343a579328c8cd17859700 not found: ID does not exist" containerID="22c0d407c656b77aa6227c7992b72e4c1c8cee5e57343a579328c8cd17859700" Dec 04 12:41:13.541156 master-0 kubenswrapper[35367]: I1204 12:41:13.541094 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22c0d407c656b77aa6227c7992b72e4c1c8cee5e57343a579328c8cd17859700"} err="failed to get container status \"22c0d407c656b77aa6227c7992b72e4c1c8cee5e57343a579328c8cd17859700\": rpc error: code = NotFound desc = could not find container \"22c0d407c656b77aa6227c7992b72e4c1c8cee5e57343a579328c8cd17859700\": container with ID starting with 22c0d407c656b77aa6227c7992b72e4c1c8cee5e57343a579328c8cd17859700 not found: ID does not exist" Dec 04 12:41:13.541156 master-0 kubenswrapper[35367]: I1204 12:41:13.541124 35367 scope.go:117] "RemoveContainer" containerID="9cd035cd0976ad12c5f9b74c198e1c3ce470a22b98363d67904fbd049fca7abd" Dec 04 12:41:13.541663 master-0 kubenswrapper[35367]: E1204 12:41:13.541625 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cd035cd0976ad12c5f9b74c198e1c3ce470a22b98363d67904fbd049fca7abd\": container with ID starting with 9cd035cd0976ad12c5f9b74c198e1c3ce470a22b98363d67904fbd049fca7abd not found: ID does not exist" containerID="9cd035cd0976ad12c5f9b74c198e1c3ce470a22b98363d67904fbd049fca7abd" Dec 04 12:41:13.541717 master-0 kubenswrapper[35367]: I1204 12:41:13.541661 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cd035cd0976ad12c5f9b74c198e1c3ce470a22b98363d67904fbd049fca7abd"} err="failed to get container status \"9cd035cd0976ad12c5f9b74c198e1c3ce470a22b98363d67904fbd049fca7abd\": rpc error: code = NotFound desc = could not find container \"9cd035cd0976ad12c5f9b74c198e1c3ce470a22b98363d67904fbd049fca7abd\": container with ID starting with 9cd035cd0976ad12c5f9b74c198e1c3ce470a22b98363d67904fbd049fca7abd not found: ID does not exist" Dec 04 12:41:13.541717 master-0 kubenswrapper[35367]: I1204 12:41:13.541683 35367 scope.go:117] "RemoveContainer" containerID="c4d4b516773de0cf9386dc05d87f300cb45d0d3b54e58dab21c5c7eb8c55a8a8" Dec 04 12:41:13.542378 master-0 kubenswrapper[35367]: E1204 12:41:13.542342 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4d4b516773de0cf9386dc05d87f300cb45d0d3b54e58dab21c5c7eb8c55a8a8\": container with ID starting with c4d4b516773de0cf9386dc05d87f300cb45d0d3b54e58dab21c5c7eb8c55a8a8 not found: ID does not exist" containerID="c4d4b516773de0cf9386dc05d87f300cb45d0d3b54e58dab21c5c7eb8c55a8a8" Dec 04 12:41:13.542445 master-0 kubenswrapper[35367]: I1204 12:41:13.542377 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4d4b516773de0cf9386dc05d87f300cb45d0d3b54e58dab21c5c7eb8c55a8a8"} err="failed to get container status \"c4d4b516773de0cf9386dc05d87f300cb45d0d3b54e58dab21c5c7eb8c55a8a8\": rpc error: code = NotFound desc = could not find container \"c4d4b516773de0cf9386dc05d87f300cb45d0d3b54e58dab21c5c7eb8c55a8a8\": container with ID starting with c4d4b516773de0cf9386dc05d87f300cb45d0d3b54e58dab21c5c7eb8c55a8a8 not found: ID does not exist" Dec 04 12:41:14.761843 master-0 kubenswrapper[35367]: I1204 12:41:14.761750 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e20e9765-6e72-420a-9f8f-259676ad142f" path="/var/lib/kubelet/pods/e20e9765-6e72-420a-9f8f-259676ad142f/volumes" Dec 04 12:41:30.047295 master-0 kubenswrapper[35367]: I1204 12:41:30.046191 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-97qj5"] Dec 04 12:41:30.047295 master-0 kubenswrapper[35367]: E1204 12:41:30.047199 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e20e9765-6e72-420a-9f8f-259676ad142f" containerName="extract-utilities" Dec 04 12:41:30.047295 master-0 kubenswrapper[35367]: I1204 12:41:30.047220 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e20e9765-6e72-420a-9f8f-259676ad142f" containerName="extract-utilities" Dec 04 12:41:30.047295 master-0 kubenswrapper[35367]: E1204 12:41:30.047244 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e20e9765-6e72-420a-9f8f-259676ad142f" containerName="registry-server" Dec 04 12:41:30.047295 master-0 kubenswrapper[35367]: I1204 12:41:30.047270 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e20e9765-6e72-420a-9f8f-259676ad142f" containerName="registry-server" Dec 04 12:41:30.048381 master-0 kubenswrapper[35367]: E1204 12:41:30.047363 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e20e9765-6e72-420a-9f8f-259676ad142f" containerName="extract-content" Dec 04 12:41:30.048381 master-0 kubenswrapper[35367]: I1204 12:41:30.047376 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="e20e9765-6e72-420a-9f8f-259676ad142f" containerName="extract-content" Dec 04 12:41:30.048381 master-0 kubenswrapper[35367]: I1204 12:41:30.047764 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="e20e9765-6e72-420a-9f8f-259676ad142f" containerName="registry-server" Dec 04 12:41:30.051844 master-0 kubenswrapper[35367]: I1204 12:41:30.051070 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-97qj5" Dec 04 12:41:30.080145 master-0 kubenswrapper[35367]: I1204 12:41:30.080027 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-97qj5"] Dec 04 12:41:30.136487 master-0 kubenswrapper[35367]: I1204 12:41:30.136213 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/eaf705da-a561-4458-b7af-c0f800bde473-catalog-content\") pod \"redhat-operators-97qj5\" (UID: \"eaf705da-a561-4458-b7af-c0f800bde473\") " pod="openshift-marketplace/redhat-operators-97qj5" Dec 04 12:41:30.136898 master-0 kubenswrapper[35367]: I1204 12:41:30.136856 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/eaf705da-a561-4458-b7af-c0f800bde473-utilities\") pod \"redhat-operators-97qj5\" (UID: \"eaf705da-a561-4458-b7af-c0f800bde473\") " pod="openshift-marketplace/redhat-operators-97qj5" Dec 04 12:41:30.137895 master-0 kubenswrapper[35367]: I1204 12:41:30.137786 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl6kq\" (UniqueName: \"kubernetes.io/projected/eaf705da-a561-4458-b7af-c0f800bde473-kube-api-access-jl6kq\") pod \"redhat-operators-97qj5\" (UID: \"eaf705da-a561-4458-b7af-c0f800bde473\") " pod="openshift-marketplace/redhat-operators-97qj5" Dec 04 12:41:30.244694 master-0 kubenswrapper[35367]: I1204 12:41:30.244598 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/eaf705da-a561-4458-b7af-c0f800bde473-catalog-content\") pod \"redhat-operators-97qj5\" (UID: \"eaf705da-a561-4458-b7af-c0f800bde473\") " pod="openshift-marketplace/redhat-operators-97qj5" Dec 04 12:41:30.245061 master-0 kubenswrapper[35367]: I1204 12:41:30.244782 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/eaf705da-a561-4458-b7af-c0f800bde473-utilities\") pod \"redhat-operators-97qj5\" (UID: \"eaf705da-a561-4458-b7af-c0f800bde473\") " pod="openshift-marketplace/redhat-operators-97qj5" Dec 04 12:41:30.245061 master-0 kubenswrapper[35367]: I1204 12:41:30.244982 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jl6kq\" (UniqueName: \"kubernetes.io/projected/eaf705da-a561-4458-b7af-c0f800bde473-kube-api-access-jl6kq\") pod \"redhat-operators-97qj5\" (UID: \"eaf705da-a561-4458-b7af-c0f800bde473\") " pod="openshift-marketplace/redhat-operators-97qj5" Dec 04 12:41:30.245842 master-0 kubenswrapper[35367]: I1204 12:41:30.245782 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/eaf705da-a561-4458-b7af-c0f800bde473-catalog-content\") pod \"redhat-operators-97qj5\" (UID: \"eaf705da-a561-4458-b7af-c0f800bde473\") " pod="openshift-marketplace/redhat-operators-97qj5" Dec 04 12:41:30.249561 master-0 kubenswrapper[35367]: I1204 12:41:30.247856 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/eaf705da-a561-4458-b7af-c0f800bde473-utilities\") pod \"redhat-operators-97qj5\" (UID: \"eaf705da-a561-4458-b7af-c0f800bde473\") " pod="openshift-marketplace/redhat-operators-97qj5" Dec 04 12:41:30.264345 master-0 kubenswrapper[35367]: I1204 12:41:30.264253 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl6kq\" (UniqueName: \"kubernetes.io/projected/eaf705da-a561-4458-b7af-c0f800bde473-kube-api-access-jl6kq\") pod \"redhat-operators-97qj5\" (UID: \"eaf705da-a561-4458-b7af-c0f800bde473\") " pod="openshift-marketplace/redhat-operators-97qj5" Dec 04 12:41:30.408585 master-0 kubenswrapper[35367]: I1204 12:41:30.408512 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-97qj5" Dec 04 12:41:30.915468 master-0 kubenswrapper[35367]: I1204 12:41:30.915389 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-97qj5"] Dec 04 12:41:30.923733 master-0 kubenswrapper[35367]: W1204 12:41:30.923665 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaf705da_a561_4458_b7af_c0f800bde473.slice/crio-745ce5a1f669c66d3fa45959d5d5d6b2248dfa6c9702704b921cd4be91155ab8 WatchSource:0}: Error finding container 745ce5a1f669c66d3fa45959d5d5d6b2248dfa6c9702704b921cd4be91155ab8: Status 404 returned error can't find the container with id 745ce5a1f669c66d3fa45959d5d5d6b2248dfa6c9702704b921cd4be91155ab8 Dec 04 12:41:31.649282 master-0 kubenswrapper[35367]: I1204 12:41:31.649207 35367 generic.go:334] "Generic (PLEG): container finished" podID="eaf705da-a561-4458-b7af-c0f800bde473" containerID="dc348e73a232df6b623a7de383abf941f1580af404969f4b824062ff2e914693" exitCode=0 Dec 04 12:41:31.649978 master-0 kubenswrapper[35367]: I1204 12:41:31.649285 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-97qj5" event={"ID":"eaf705da-a561-4458-b7af-c0f800bde473","Type":"ContainerDied","Data":"dc348e73a232df6b623a7de383abf941f1580af404969f4b824062ff2e914693"} Dec 04 12:41:31.649978 master-0 kubenswrapper[35367]: I1204 12:41:31.649400 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-97qj5" event={"ID":"eaf705da-a561-4458-b7af-c0f800bde473","Type":"ContainerStarted","Data":"745ce5a1f669c66d3fa45959d5d5d6b2248dfa6c9702704b921cd4be91155ab8"} Dec 04 12:41:33.697706 master-0 kubenswrapper[35367]: I1204 12:41:33.697630 35367 generic.go:334] "Generic (PLEG): container finished" podID="eaf705da-a561-4458-b7af-c0f800bde473" containerID="b5a500c1cc7a75b450458abe988f096cf6d5369dcfbb68c0b47fb4093e09ab5c" exitCode=0 Dec 04 12:41:33.697706 master-0 kubenswrapper[35367]: I1204 12:41:33.697713 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-97qj5" event={"ID":"eaf705da-a561-4458-b7af-c0f800bde473","Type":"ContainerDied","Data":"b5a500c1cc7a75b450458abe988f096cf6d5369dcfbb68c0b47fb4093e09ab5c"} Dec 04 12:41:34.731916 master-0 kubenswrapper[35367]: I1204 12:41:34.731856 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-97qj5" event={"ID":"eaf705da-a561-4458-b7af-c0f800bde473","Type":"ContainerStarted","Data":"7a5d98cd06fab3a5adce696cf5c3b465c3ef0bdbb62934da193dbf6dd1b44623"} Dec 04 12:41:34.772965 master-0 kubenswrapper[35367]: I1204 12:41:34.772733 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-97qj5" podStartSLOduration=2.231397048 podStartE2EDuration="4.772713424s" podCreationTimestamp="2025-12-04 12:41:30 +0000 UTC" firstStartedPulling="2025-12-04 12:41:31.653307191 +0000 UTC m=+2535.091368449" lastFinishedPulling="2025-12-04 12:41:34.194623567 +0000 UTC m=+2537.632684825" observedRunningTime="2025-12-04 12:41:34.767691472 +0000 UTC m=+2538.205752730" watchObservedRunningTime="2025-12-04 12:41:34.772713424 +0000 UTC m=+2538.210774682" Dec 04 12:41:40.409757 master-0 kubenswrapper[35367]: I1204 12:41:40.409678 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-97qj5" Dec 04 12:41:40.410546 master-0 kubenswrapper[35367]: I1204 12:41:40.410371 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-97qj5" Dec 04 12:41:40.470855 master-0 kubenswrapper[35367]: I1204 12:41:40.470755 35367 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-97qj5" Dec 04 12:41:40.886154 master-0 kubenswrapper[35367]: I1204 12:41:40.886089 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-97qj5" Dec 04 12:41:41.400380 master-0 kubenswrapper[35367]: I1204 12:41:41.400303 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-97qj5"] Dec 04 12:41:42.846552 master-0 kubenswrapper[35367]: I1204 12:41:42.846426 35367 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-97qj5" podUID="eaf705da-a561-4458-b7af-c0f800bde473" containerName="registry-server" containerID="cri-o://7a5d98cd06fab3a5adce696cf5c3b465c3ef0bdbb62934da193dbf6dd1b44623" gracePeriod=2 Dec 04 12:41:43.435432 master-0 kubenswrapper[35367]: I1204 12:41:43.435255 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-97qj5" Dec 04 12:41:43.465007 master-0 kubenswrapper[35367]: I1204 12:41:43.464520 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/eaf705da-a561-4458-b7af-c0f800bde473-utilities\") pod \"eaf705da-a561-4458-b7af-c0f800bde473\" (UID: \"eaf705da-a561-4458-b7af-c0f800bde473\") " Dec 04 12:41:43.465007 master-0 kubenswrapper[35367]: I1204 12:41:43.464598 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl6kq\" (UniqueName: \"kubernetes.io/projected/eaf705da-a561-4458-b7af-c0f800bde473-kube-api-access-jl6kq\") pod \"eaf705da-a561-4458-b7af-c0f800bde473\" (UID: \"eaf705da-a561-4458-b7af-c0f800bde473\") " Dec 04 12:41:43.465007 master-0 kubenswrapper[35367]: I1204 12:41:43.464712 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/eaf705da-a561-4458-b7af-c0f800bde473-catalog-content\") pod \"eaf705da-a561-4458-b7af-c0f800bde473\" (UID: \"eaf705da-a561-4458-b7af-c0f800bde473\") " Dec 04 12:41:43.465742 master-0 kubenswrapper[35367]: I1204 12:41:43.465675 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaf705da-a561-4458-b7af-c0f800bde473-utilities" (OuterVolumeSpecName: "utilities") pod "eaf705da-a561-4458-b7af-c0f800bde473" (UID: "eaf705da-a561-4458-b7af-c0f800bde473"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:41:43.466638 master-0 kubenswrapper[35367]: I1204 12:41:43.466566 35367 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/eaf705da-a561-4458-b7af-c0f800bde473-utilities\") on node \"master-0\" DevicePath \"\"" Dec 04 12:41:43.477880 master-0 kubenswrapper[35367]: I1204 12:41:43.474342 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaf705da-a561-4458-b7af-c0f800bde473-kube-api-access-jl6kq" (OuterVolumeSpecName: "kube-api-access-jl6kq") pod "eaf705da-a561-4458-b7af-c0f800bde473" (UID: "eaf705da-a561-4458-b7af-c0f800bde473"). InnerVolumeSpecName "kube-api-access-jl6kq". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:41:43.568484 master-0 kubenswrapper[35367]: I1204 12:41:43.568416 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jl6kq\" (UniqueName: \"kubernetes.io/projected/eaf705da-a561-4458-b7af-c0f800bde473-kube-api-access-jl6kq\") on node \"master-0\" DevicePath \"\"" Dec 04 12:41:43.593058 master-0 kubenswrapper[35367]: I1204 12:41:43.592939 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaf705da-a561-4458-b7af-c0f800bde473-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "eaf705da-a561-4458-b7af-c0f800bde473" (UID: "eaf705da-a561-4458-b7af-c0f800bde473"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Dec 04 12:41:43.670692 master-0 kubenswrapper[35367]: I1204 12:41:43.670515 35367 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/eaf705da-a561-4458-b7af-c0f800bde473-catalog-content\") on node \"master-0\" DevicePath \"\"" Dec 04 12:41:43.871285 master-0 kubenswrapper[35367]: I1204 12:41:43.871222 35367 generic.go:334] "Generic (PLEG): container finished" podID="eaf705da-a561-4458-b7af-c0f800bde473" containerID="7a5d98cd06fab3a5adce696cf5c3b465c3ef0bdbb62934da193dbf6dd1b44623" exitCode=0 Dec 04 12:41:43.872036 master-0 kubenswrapper[35367]: I1204 12:41:43.871286 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-97qj5" event={"ID":"eaf705da-a561-4458-b7af-c0f800bde473","Type":"ContainerDied","Data":"7a5d98cd06fab3a5adce696cf5c3b465c3ef0bdbb62934da193dbf6dd1b44623"} Dec 04 12:41:43.872036 master-0 kubenswrapper[35367]: I1204 12:41:43.871429 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-97qj5" event={"ID":"eaf705da-a561-4458-b7af-c0f800bde473","Type":"ContainerDied","Data":"745ce5a1f669c66d3fa45959d5d5d6b2248dfa6c9702704b921cd4be91155ab8"} Dec 04 12:41:43.872036 master-0 kubenswrapper[35367]: I1204 12:41:43.871460 35367 scope.go:117] "RemoveContainer" containerID="7a5d98cd06fab3a5adce696cf5c3b465c3ef0bdbb62934da193dbf6dd1b44623" Dec 04 12:41:43.872259 master-0 kubenswrapper[35367]: I1204 12:41:43.872222 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-97qj5" Dec 04 12:41:43.931935 master-0 kubenswrapper[35367]: I1204 12:41:43.931884 35367 scope.go:117] "RemoveContainer" containerID="b5a500c1cc7a75b450458abe988f096cf6d5369dcfbb68c0b47fb4093e09ab5c" Dec 04 12:41:43.956990 master-0 kubenswrapper[35367]: I1204 12:41:43.956918 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-97qj5"] Dec 04 12:41:43.971968 master-0 kubenswrapper[35367]: I1204 12:41:43.971887 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-97qj5"] Dec 04 12:41:43.975392 master-0 kubenswrapper[35367]: I1204 12:41:43.975326 35367 scope.go:117] "RemoveContainer" containerID="dc348e73a232df6b623a7de383abf941f1580af404969f4b824062ff2e914693" Dec 04 12:41:44.021238 master-0 kubenswrapper[35367]: I1204 12:41:44.021186 35367 scope.go:117] "RemoveContainer" containerID="7a5d98cd06fab3a5adce696cf5c3b465c3ef0bdbb62934da193dbf6dd1b44623" Dec 04 12:41:44.021889 master-0 kubenswrapper[35367]: E1204 12:41:44.021830 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a5d98cd06fab3a5adce696cf5c3b465c3ef0bdbb62934da193dbf6dd1b44623\": container with ID starting with 7a5d98cd06fab3a5adce696cf5c3b465c3ef0bdbb62934da193dbf6dd1b44623 not found: ID does not exist" containerID="7a5d98cd06fab3a5adce696cf5c3b465c3ef0bdbb62934da193dbf6dd1b44623" Dec 04 12:41:44.021964 master-0 kubenswrapper[35367]: I1204 12:41:44.021898 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a5d98cd06fab3a5adce696cf5c3b465c3ef0bdbb62934da193dbf6dd1b44623"} err="failed to get container status \"7a5d98cd06fab3a5adce696cf5c3b465c3ef0bdbb62934da193dbf6dd1b44623\": rpc error: code = NotFound desc = could not find container \"7a5d98cd06fab3a5adce696cf5c3b465c3ef0bdbb62934da193dbf6dd1b44623\": container with ID starting with 7a5d98cd06fab3a5adce696cf5c3b465c3ef0bdbb62934da193dbf6dd1b44623 not found: ID does not exist" Dec 04 12:41:44.021964 master-0 kubenswrapper[35367]: I1204 12:41:44.021929 35367 scope.go:117] "RemoveContainer" containerID="b5a500c1cc7a75b450458abe988f096cf6d5369dcfbb68c0b47fb4093e09ab5c" Dec 04 12:41:44.022489 master-0 kubenswrapper[35367]: E1204 12:41:44.022439 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5a500c1cc7a75b450458abe988f096cf6d5369dcfbb68c0b47fb4093e09ab5c\": container with ID starting with b5a500c1cc7a75b450458abe988f096cf6d5369dcfbb68c0b47fb4093e09ab5c not found: ID does not exist" containerID="b5a500c1cc7a75b450458abe988f096cf6d5369dcfbb68c0b47fb4093e09ab5c" Dec 04 12:41:44.022589 master-0 kubenswrapper[35367]: I1204 12:41:44.022486 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5a500c1cc7a75b450458abe988f096cf6d5369dcfbb68c0b47fb4093e09ab5c"} err="failed to get container status \"b5a500c1cc7a75b450458abe988f096cf6d5369dcfbb68c0b47fb4093e09ab5c\": rpc error: code = NotFound desc = could not find container \"b5a500c1cc7a75b450458abe988f096cf6d5369dcfbb68c0b47fb4093e09ab5c\": container with ID starting with b5a500c1cc7a75b450458abe988f096cf6d5369dcfbb68c0b47fb4093e09ab5c not found: ID does not exist" Dec 04 12:41:44.022589 master-0 kubenswrapper[35367]: I1204 12:41:44.022501 35367 scope.go:117] "RemoveContainer" containerID="dc348e73a232df6b623a7de383abf941f1580af404969f4b824062ff2e914693" Dec 04 12:41:44.022933 master-0 kubenswrapper[35367]: E1204 12:41:44.022909 35367 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc348e73a232df6b623a7de383abf941f1580af404969f4b824062ff2e914693\": container with ID starting with dc348e73a232df6b623a7de383abf941f1580af404969f4b824062ff2e914693 not found: ID does not exist" containerID="dc348e73a232df6b623a7de383abf941f1580af404969f4b824062ff2e914693" Dec 04 12:41:44.023000 master-0 kubenswrapper[35367]: I1204 12:41:44.022933 35367 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc348e73a232df6b623a7de383abf941f1580af404969f4b824062ff2e914693"} err="failed to get container status \"dc348e73a232df6b623a7de383abf941f1580af404969f4b824062ff2e914693\": rpc error: code = NotFound desc = could not find container \"dc348e73a232df6b623a7de383abf941f1580af404969f4b824062ff2e914693\": container with ID starting with dc348e73a232df6b623a7de383abf941f1580af404969f4b824062ff2e914693 not found: ID does not exist" Dec 04 12:41:44.763613 master-0 kubenswrapper[35367]: I1204 12:41:44.763535 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaf705da-a561-4458-b7af-c0f800bde473" path="/var/lib/kubelet/pods/eaf705da-a561-4458-b7af-c0f800bde473/volumes" Dec 04 12:45:00.176134 master-0 kubenswrapper[35367]: I1204 12:45:00.175640 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29414205-lw5ls"] Dec 04 12:45:00.177159 master-0 kubenswrapper[35367]: E1204 12:45:00.176600 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="eaf705da-a561-4458-b7af-c0f800bde473" containerName="extract-content" Dec 04 12:45:00.177159 master-0 kubenswrapper[35367]: I1204 12:45:00.176621 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf705da-a561-4458-b7af-c0f800bde473" containerName="extract-content" Dec 04 12:45:00.177159 master-0 kubenswrapper[35367]: E1204 12:45:00.176674 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="eaf705da-a561-4458-b7af-c0f800bde473" containerName="extract-utilities" Dec 04 12:45:00.177159 master-0 kubenswrapper[35367]: I1204 12:45:00.176684 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf705da-a561-4458-b7af-c0f800bde473" containerName="extract-utilities" Dec 04 12:45:00.177159 master-0 kubenswrapper[35367]: E1204 12:45:00.176711 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="eaf705da-a561-4458-b7af-c0f800bde473" containerName="registry-server" Dec 04 12:45:00.177159 master-0 kubenswrapper[35367]: I1204 12:45:00.176717 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf705da-a561-4458-b7af-c0f800bde473" containerName="registry-server" Dec 04 12:45:00.177159 master-0 kubenswrapper[35367]: I1204 12:45:00.177089 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="eaf705da-a561-4458-b7af-c0f800bde473" containerName="registry-server" Dec 04 12:45:00.178858 master-0 kubenswrapper[35367]: I1204 12:45:00.178349 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29414205-lw5ls" Dec 04 12:45:00.185719 master-0 kubenswrapper[35367]: I1204 12:45:00.185661 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"collect-profiles-config" Dec 04 12:45:00.186069 master-0 kubenswrapper[35367]: I1204 12:45:00.185946 35367 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"collect-profiles-dockercfg-hd7lj" Dec 04 12:45:00.204642 master-0 kubenswrapper[35367]: I1204 12:45:00.204387 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29414205-lw5ls"] Dec 04 12:45:00.335594 master-0 kubenswrapper[35367]: I1204 12:45:00.334391 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7b64b8de-9043-4c0c-9e8b-aa04993bc8e4-config-volume\") pod \"collect-profiles-29414205-lw5ls\" (UID: \"7b64b8de-9043-4c0c-9e8b-aa04993bc8e4\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414205-lw5ls" Dec 04 12:45:00.335594 master-0 kubenswrapper[35367]: I1204 12:45:00.334465 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmpkr\" (UniqueName: \"kubernetes.io/projected/7b64b8de-9043-4c0c-9e8b-aa04993bc8e4-kube-api-access-wmpkr\") pod \"collect-profiles-29414205-lw5ls\" (UID: \"7b64b8de-9043-4c0c-9e8b-aa04993bc8e4\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414205-lw5ls" Dec 04 12:45:00.335594 master-0 kubenswrapper[35367]: I1204 12:45:00.334521 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/7b64b8de-9043-4c0c-9e8b-aa04993bc8e4-secret-volume\") pod \"collect-profiles-29414205-lw5ls\" (UID: \"7b64b8de-9043-4c0c-9e8b-aa04993bc8e4\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414205-lw5ls" Dec 04 12:45:00.439909 master-0 kubenswrapper[35367]: I1204 12:45:00.439689 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wmpkr\" (UniqueName: \"kubernetes.io/projected/7b64b8de-9043-4c0c-9e8b-aa04993bc8e4-kube-api-access-wmpkr\") pod \"collect-profiles-29414205-lw5ls\" (UID: \"7b64b8de-9043-4c0c-9e8b-aa04993bc8e4\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414205-lw5ls" Dec 04 12:45:00.439909 master-0 kubenswrapper[35367]: I1204 12:45:00.439794 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/7b64b8de-9043-4c0c-9e8b-aa04993bc8e4-secret-volume\") pod \"collect-profiles-29414205-lw5ls\" (UID: \"7b64b8de-9043-4c0c-9e8b-aa04993bc8e4\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414205-lw5ls" Dec 04 12:45:00.440254 master-0 kubenswrapper[35367]: I1204 12:45:00.440143 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7b64b8de-9043-4c0c-9e8b-aa04993bc8e4-config-volume\") pod \"collect-profiles-29414205-lw5ls\" (UID: \"7b64b8de-9043-4c0c-9e8b-aa04993bc8e4\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414205-lw5ls" Dec 04 12:45:00.441303 master-0 kubenswrapper[35367]: I1204 12:45:00.441272 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7b64b8de-9043-4c0c-9e8b-aa04993bc8e4-config-volume\") pod \"collect-profiles-29414205-lw5ls\" (UID: \"7b64b8de-9043-4c0c-9e8b-aa04993bc8e4\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414205-lw5ls" Dec 04 12:45:00.445310 master-0 kubenswrapper[35367]: I1204 12:45:00.445261 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/7b64b8de-9043-4c0c-9e8b-aa04993bc8e4-secret-volume\") pod \"collect-profiles-29414205-lw5ls\" (UID: \"7b64b8de-9043-4c0c-9e8b-aa04993bc8e4\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414205-lw5ls" Dec 04 12:45:00.477600 master-0 kubenswrapper[35367]: I1204 12:45:00.477518 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmpkr\" (UniqueName: \"kubernetes.io/projected/7b64b8de-9043-4c0c-9e8b-aa04993bc8e4-kube-api-access-wmpkr\") pod \"collect-profiles-29414205-lw5ls\" (UID: \"7b64b8de-9043-4c0c-9e8b-aa04993bc8e4\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29414205-lw5ls" Dec 04 12:45:00.550959 master-0 kubenswrapper[35367]: I1204 12:45:00.550883 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29414205-lw5ls" Dec 04 12:45:01.083944 master-0 kubenswrapper[35367]: I1204 12:45:01.083871 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29414205-lw5ls"] Dec 04 12:45:01.358092 master-0 kubenswrapper[35367]: I1204 12:45:01.357936 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29414205-lw5ls" event={"ID":"7b64b8de-9043-4c0c-9e8b-aa04993bc8e4","Type":"ContainerStarted","Data":"b6d0a0577568931353616ea512e4d8552b63e64b1f91320955d5ecea8b95353f"} Dec 04 12:45:01.358092 master-0 kubenswrapper[35367]: I1204 12:45:01.358009 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29414205-lw5ls" event={"ID":"7b64b8de-9043-4c0c-9e8b-aa04993bc8e4","Type":"ContainerStarted","Data":"01614e996a272d685434131d2f5457e07ab678dfb1c1c45ba0c1afb324cbcd09"} Dec 04 12:45:01.389131 master-0 kubenswrapper[35367]: I1204 12:45:01.382741 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/collect-profiles-29414205-lw5ls" podStartSLOduration=1.3827175299999999 podStartE2EDuration="1.38271753s" podCreationTimestamp="2025-12-04 12:45:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:45:01.379776246 +0000 UTC m=+2744.817837514" watchObservedRunningTime="2025-12-04 12:45:01.38271753 +0000 UTC m=+2744.820778798" Dec 04 12:45:02.374877 master-0 kubenswrapper[35367]: I1204 12:45:02.374793 35367 generic.go:334] "Generic (PLEG): container finished" podID="7b64b8de-9043-4c0c-9e8b-aa04993bc8e4" containerID="b6d0a0577568931353616ea512e4d8552b63e64b1f91320955d5ecea8b95353f" exitCode=0 Dec 04 12:45:02.374877 master-0 kubenswrapper[35367]: I1204 12:45:02.374875 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29414205-lw5ls" event={"ID":"7b64b8de-9043-4c0c-9e8b-aa04993bc8e4","Type":"ContainerDied","Data":"b6d0a0577568931353616ea512e4d8552b63e64b1f91320955d5ecea8b95353f"} Dec 04 12:45:03.863738 master-0 kubenswrapper[35367]: I1204 12:45:03.863687 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29414205-lw5ls" Dec 04 12:45:03.955832 master-0 kubenswrapper[35367]: I1204 12:45:03.955367 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/7b64b8de-9043-4c0c-9e8b-aa04993bc8e4-secret-volume\") pod \"7b64b8de-9043-4c0c-9e8b-aa04993bc8e4\" (UID: \"7b64b8de-9043-4c0c-9e8b-aa04993bc8e4\") " Dec 04 12:45:03.955832 master-0 kubenswrapper[35367]: I1204 12:45:03.955575 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmpkr\" (UniqueName: \"kubernetes.io/projected/7b64b8de-9043-4c0c-9e8b-aa04993bc8e4-kube-api-access-wmpkr\") pod \"7b64b8de-9043-4c0c-9e8b-aa04993bc8e4\" (UID: \"7b64b8de-9043-4c0c-9e8b-aa04993bc8e4\") " Dec 04 12:45:03.955832 master-0 kubenswrapper[35367]: I1204 12:45:03.955620 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7b64b8de-9043-4c0c-9e8b-aa04993bc8e4-config-volume\") pod \"7b64b8de-9043-4c0c-9e8b-aa04993bc8e4\" (UID: \"7b64b8de-9043-4c0c-9e8b-aa04993bc8e4\") " Dec 04 12:45:03.958615 master-0 kubenswrapper[35367]: I1204 12:45:03.956661 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b64b8de-9043-4c0c-9e8b-aa04993bc8e4-config-volume" (OuterVolumeSpecName: "config-volume") pod "7b64b8de-9043-4c0c-9e8b-aa04993bc8e4" (UID: "7b64b8de-9043-4c0c-9e8b-aa04993bc8e4"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" Dec 04 12:45:03.959631 master-0 kubenswrapper[35367]: I1204 12:45:03.959587 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b64b8de-9043-4c0c-9e8b-aa04993bc8e4-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "7b64b8de-9043-4c0c-9e8b-aa04993bc8e4" (UID: "7b64b8de-9043-4c0c-9e8b-aa04993bc8e4"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Dec 04 12:45:03.968385 master-0 kubenswrapper[35367]: I1204 12:45:03.967307 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b64b8de-9043-4c0c-9e8b-aa04993bc8e4-kube-api-access-wmpkr" (OuterVolumeSpecName: "kube-api-access-wmpkr") pod "7b64b8de-9043-4c0c-9e8b-aa04993bc8e4" (UID: "7b64b8de-9043-4c0c-9e8b-aa04993bc8e4"). InnerVolumeSpecName "kube-api-access-wmpkr". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:45:04.058221 master-0 kubenswrapper[35367]: I1204 12:45:04.058133 35367 reconciler_common.go:293] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/7b64b8de-9043-4c0c-9e8b-aa04993bc8e4-secret-volume\") on node \"master-0\" DevicePath \"\"" Dec 04 12:45:04.058221 master-0 kubenswrapper[35367]: I1204 12:45:04.058203 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wmpkr\" (UniqueName: \"kubernetes.io/projected/7b64b8de-9043-4c0c-9e8b-aa04993bc8e4-kube-api-access-wmpkr\") on node \"master-0\" DevicePath \"\"" Dec 04 12:45:04.058221 master-0 kubenswrapper[35367]: I1204 12:45:04.058217 35367 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7b64b8de-9043-4c0c-9e8b-aa04993bc8e4-config-volume\") on node \"master-0\" DevicePath \"\"" Dec 04 12:45:04.401150 master-0 kubenswrapper[35367]: I1204 12:45:04.401075 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29414205-lw5ls" event={"ID":"7b64b8de-9043-4c0c-9e8b-aa04993bc8e4","Type":"ContainerDied","Data":"01614e996a272d685434131d2f5457e07ab678dfb1c1c45ba0c1afb324cbcd09"} Dec 04 12:45:04.401150 master-0 kubenswrapper[35367]: I1204 12:45:04.401130 35367 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01614e996a272d685434131d2f5457e07ab678dfb1c1c45ba0c1afb324cbcd09" Dec 04 12:45:04.401481 master-0 kubenswrapper[35367]: I1204 12:45:04.401166 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29414205-lw5ls" Dec 04 12:45:04.495574 master-0 kubenswrapper[35367]: I1204 12:45:04.495462 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv"] Dec 04 12:45:04.510992 master-0 kubenswrapper[35367]: I1204 12:45:04.510865 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29414160-dmjlv"] Dec 04 12:45:04.765476 master-0 kubenswrapper[35367]: I1204 12:45:04.765256 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18a37b73-52bc-444b-be63-5b7f7b4419ab" path="/var/lib/kubelet/pods/18a37b73-52bc-444b-be63-5b7f7b4419ab/volumes" Dec 04 12:45:37.657295 master-0 kubenswrapper[35367]: I1204 12:45:37.657219 35367 scope.go:117] "RemoveContainer" containerID="65d4adb50e9475c1094a0a214de6dde18cb1ca9e2c3daf843488c72586e7a86e" Dec 04 12:47:05.148802 master-0 kubenswrapper[35367]: I1204 12:47:05.148077 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mxk7d/must-gather-wsc8n"] Dec 04 12:47:05.149632 master-0 kubenswrapper[35367]: E1204 12:47:05.148861 35367 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7b64b8de-9043-4c0c-9e8b-aa04993bc8e4" containerName="collect-profiles" Dec 04 12:47:05.149632 master-0 kubenswrapper[35367]: I1204 12:47:05.148878 35367 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b64b8de-9043-4c0c-9e8b-aa04993bc8e4" containerName="collect-profiles" Dec 04 12:47:05.149632 master-0 kubenswrapper[35367]: I1204 12:47:05.149223 35367 memory_manager.go:354] "RemoveStaleState removing state" podUID="7b64b8de-9043-4c0c-9e8b-aa04993bc8e4" containerName="collect-profiles" Dec 04 12:47:05.151156 master-0 kubenswrapper[35367]: I1204 12:47:05.150745 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mxk7d/must-gather-wsc8n" Dec 04 12:47:05.154426 master-0 kubenswrapper[35367]: I1204 12:47:05.153383 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-must-gather-mxk7d"/"openshift-service-ca.crt" Dec 04 12:47:05.154426 master-0 kubenswrapper[35367]: I1204 12:47:05.153687 35367 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-must-gather-mxk7d"/"kube-root-ca.crt" Dec 04 12:47:05.171985 master-0 kubenswrapper[35367]: I1204 12:47:05.171897 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mxk7d/must-gather-xshfp"] Dec 04 12:47:05.176550 master-0 kubenswrapper[35367]: I1204 12:47:05.174614 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mxk7d/must-gather-xshfp" Dec 04 12:47:05.209831 master-0 kubenswrapper[35367]: I1204 12:47:05.208409 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mxk7d/must-gather-wsc8n"] Dec 04 12:47:05.233833 master-0 kubenswrapper[35367]: I1204 12:47:05.224670 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mxk7d/must-gather-xshfp"] Dec 04 12:47:05.280598 master-0 kubenswrapper[35367]: I1204 12:47:05.280499 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hccn4\" (UniqueName: \"kubernetes.io/projected/57cd0a0c-2c01-43d4-82a4-f8c88dbb0f5e-kube-api-access-hccn4\") pod \"must-gather-xshfp\" (UID: \"57cd0a0c-2c01-43d4-82a4-f8c88dbb0f5e\") " pod="openshift-must-gather-mxk7d/must-gather-xshfp" Dec 04 12:47:05.280946 master-0 kubenswrapper[35367]: I1204 12:47:05.280699 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmmwx\" (UniqueName: \"kubernetes.io/projected/2e579a12-a640-468b-b010-aff814dd7411-kube-api-access-mmmwx\") pod \"must-gather-wsc8n\" (UID: \"2e579a12-a640-468b-b010-aff814dd7411\") " pod="openshift-must-gather-mxk7d/must-gather-wsc8n" Dec 04 12:47:05.280946 master-0 kubenswrapper[35367]: I1204 12:47:05.280767 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2e579a12-a640-468b-b010-aff814dd7411-must-gather-output\") pod \"must-gather-wsc8n\" (UID: \"2e579a12-a640-468b-b010-aff814dd7411\") " pod="openshift-must-gather-mxk7d/must-gather-wsc8n" Dec 04 12:47:05.280946 master-0 kubenswrapper[35367]: I1204 12:47:05.280877 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/57cd0a0c-2c01-43d4-82a4-f8c88dbb0f5e-must-gather-output\") pod \"must-gather-xshfp\" (UID: \"57cd0a0c-2c01-43d4-82a4-f8c88dbb0f5e\") " pod="openshift-must-gather-mxk7d/must-gather-xshfp" Dec 04 12:47:05.383504 master-0 kubenswrapper[35367]: I1204 12:47:05.383415 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hccn4\" (UniqueName: \"kubernetes.io/projected/57cd0a0c-2c01-43d4-82a4-f8c88dbb0f5e-kube-api-access-hccn4\") pod \"must-gather-xshfp\" (UID: \"57cd0a0c-2c01-43d4-82a4-f8c88dbb0f5e\") " pod="openshift-must-gather-mxk7d/must-gather-xshfp" Dec 04 12:47:05.383857 master-0 kubenswrapper[35367]: I1204 12:47:05.383603 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mmmwx\" (UniqueName: \"kubernetes.io/projected/2e579a12-a640-468b-b010-aff814dd7411-kube-api-access-mmmwx\") pod \"must-gather-wsc8n\" (UID: \"2e579a12-a640-468b-b010-aff814dd7411\") " pod="openshift-must-gather-mxk7d/must-gather-wsc8n" Dec 04 12:47:05.383857 master-0 kubenswrapper[35367]: I1204 12:47:05.383672 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2e579a12-a640-468b-b010-aff814dd7411-must-gather-output\") pod \"must-gather-wsc8n\" (UID: \"2e579a12-a640-468b-b010-aff814dd7411\") " pod="openshift-must-gather-mxk7d/must-gather-wsc8n" Dec 04 12:47:05.383857 master-0 kubenswrapper[35367]: I1204 12:47:05.383767 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/57cd0a0c-2c01-43d4-82a4-f8c88dbb0f5e-must-gather-output\") pod \"must-gather-xshfp\" (UID: \"57cd0a0c-2c01-43d4-82a4-f8c88dbb0f5e\") " pod="openshift-must-gather-mxk7d/must-gather-xshfp" Dec 04 12:47:05.384486 master-0 kubenswrapper[35367]: I1204 12:47:05.384442 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/57cd0a0c-2c01-43d4-82a4-f8c88dbb0f5e-must-gather-output\") pod \"must-gather-xshfp\" (UID: \"57cd0a0c-2c01-43d4-82a4-f8c88dbb0f5e\") " pod="openshift-must-gather-mxk7d/must-gather-xshfp" Dec 04 12:47:05.384692 master-0 kubenswrapper[35367]: I1204 12:47:05.384634 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2e579a12-a640-468b-b010-aff814dd7411-must-gather-output\") pod \"must-gather-wsc8n\" (UID: \"2e579a12-a640-468b-b010-aff814dd7411\") " pod="openshift-must-gather-mxk7d/must-gather-wsc8n" Dec 04 12:47:05.595839 master-0 kubenswrapper[35367]: I1204 12:47:05.595695 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmmwx\" (UniqueName: \"kubernetes.io/projected/2e579a12-a640-468b-b010-aff814dd7411-kube-api-access-mmmwx\") pod \"must-gather-wsc8n\" (UID: \"2e579a12-a640-468b-b010-aff814dd7411\") " pod="openshift-must-gather-mxk7d/must-gather-wsc8n" Dec 04 12:47:05.596121 master-0 kubenswrapper[35367]: I1204 12:47:05.596028 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hccn4\" (UniqueName: \"kubernetes.io/projected/57cd0a0c-2c01-43d4-82a4-f8c88dbb0f5e-kube-api-access-hccn4\") pod \"must-gather-xshfp\" (UID: \"57cd0a0c-2c01-43d4-82a4-f8c88dbb0f5e\") " pod="openshift-must-gather-mxk7d/must-gather-xshfp" Dec 04 12:47:05.795027 master-0 kubenswrapper[35367]: I1204 12:47:05.791581 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mxk7d/must-gather-wsc8n" Dec 04 12:47:05.810135 master-0 kubenswrapper[35367]: I1204 12:47:05.809640 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mxk7d/must-gather-xshfp" Dec 04 12:47:06.314787 master-0 kubenswrapper[35367]: I1204 12:47:06.314694 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mxk7d/must-gather-wsc8n"] Dec 04 12:47:06.318227 master-0 kubenswrapper[35367]: I1204 12:47:06.318146 35367 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Dec 04 12:47:06.413870 master-0 kubenswrapper[35367]: W1204 12:47:06.413395 35367 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57cd0a0c_2c01_43d4_82a4_f8c88dbb0f5e.slice/crio-793b5a2a47cf3f904483a39a1828169f2e8259b7ce285c6577acfcc2f7bbae06 WatchSource:0}: Error finding container 793b5a2a47cf3f904483a39a1828169f2e8259b7ce285c6577acfcc2f7bbae06: Status 404 returned error can't find the container with id 793b5a2a47cf3f904483a39a1828169f2e8259b7ce285c6577acfcc2f7bbae06 Dec 04 12:47:06.418427 master-0 kubenswrapper[35367]: I1204 12:47:06.418354 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mxk7d/must-gather-xshfp"] Dec 04 12:47:07.023772 master-0 kubenswrapper[35367]: I1204 12:47:07.023691 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxk7d/must-gather-xshfp" event={"ID":"57cd0a0c-2c01-43d4-82a4-f8c88dbb0f5e","Type":"ContainerStarted","Data":"793b5a2a47cf3f904483a39a1828169f2e8259b7ce285c6577acfcc2f7bbae06"} Dec 04 12:47:07.026699 master-0 kubenswrapper[35367]: I1204 12:47:07.026607 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxk7d/must-gather-wsc8n" event={"ID":"2e579a12-a640-468b-b010-aff814dd7411","Type":"ContainerStarted","Data":"cc26e685a1d41496967c41b9e60aed5043eaaf1dba273c0d5ee97d9b3e31deb4"} Dec 04 12:47:08.041755 master-0 kubenswrapper[35367]: I1204 12:47:08.041667 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxk7d/must-gather-xshfp" event={"ID":"57cd0a0c-2c01-43d4-82a4-f8c88dbb0f5e","Type":"ContainerStarted","Data":"efa87ea095fb4b550093961e0dcdfb1ceb6e53855c117f2db22f3845609be040"} Dec 04 12:47:08.638659 master-0 kubenswrapper[35367]: I1204 12:47:08.638063 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-version_cluster-version-operator-6d5d5dcc89-cw2hx_a399a87b-8153-4045-a8d3-63fd88ae280f/cluster-version-operator/1.log" Dec 04 12:47:09.070587 master-0 kubenswrapper[35367]: I1204 12:47:09.070510 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxk7d/must-gather-xshfp" event={"ID":"57cd0a0c-2c01-43d4-82a4-f8c88dbb0f5e","Type":"ContainerStarted","Data":"d20f2c3d3f68d4799ddf15dda68ac3c363e256cc68a48a3eabeffc61ba354f8e"} Dec 04 12:47:09.118444 master-0 kubenswrapper[35367]: I1204 12:47:09.114201 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-mxk7d/must-gather-xshfp" podStartSLOduration=3.006567913 podStartE2EDuration="4.114171522s" podCreationTimestamp="2025-12-04 12:47:05 +0000 UTC" firstStartedPulling="2025-12-04 12:47:06.416095747 +0000 UTC m=+2869.854157005" lastFinishedPulling="2025-12-04 12:47:07.523699356 +0000 UTC m=+2870.961760614" observedRunningTime="2025-12-04 12:47:09.094192015 +0000 UTC m=+2872.532253283" watchObservedRunningTime="2025-12-04 12:47:09.114171522 +0000 UTC m=+2872.552232780" Dec 04 12:47:11.110518 master-0 kubenswrapper[35367]: I1204 12:47:11.105587 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxk7d/must-gather-wsc8n" event={"ID":"2e579a12-a640-468b-b010-aff814dd7411","Type":"ContainerStarted","Data":"df2ae3abbd4d66c4c8c9f26b332d1290bc2db7efad05eb3c18aef02ce6186154"} Dec 04 12:47:11.557545 master-0 kubenswrapper[35367]: I1204 12:47:11.557487 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-version_cluster-version-operator-6d5d5dcc89-cw2hx_a399a87b-8153-4045-a8d3-63fd88ae280f/cluster-version-operator/2.log" Dec 04 12:47:12.201836 master-0 kubenswrapper[35367]: I1204 12:47:12.201374 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxk7d/must-gather-wsc8n" event={"ID":"2e579a12-a640-468b-b010-aff814dd7411","Type":"ContainerStarted","Data":"bc3d29cc6b8a7dc73d596c8733e8028bde241a1ccf46adc6311145e4a25b7af0"} Dec 04 12:47:12.969852 master-0 kubenswrapper[35367]: I1204 12:47:12.964376 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-mxk7d/must-gather-wsc8n" podStartSLOduration=3.5703666160000003 podStartE2EDuration="7.964347543s" podCreationTimestamp="2025-12-04 12:47:05 +0000 UTC" firstStartedPulling="2025-12-04 12:47:06.318045495 +0000 UTC m=+2869.756106753" lastFinishedPulling="2025-12-04 12:47:10.712026422 +0000 UTC m=+2874.150087680" observedRunningTime="2025-12-04 12:47:12.944915744 +0000 UTC m=+2876.382977032" watchObservedRunningTime="2025-12-04 12:47:12.964347543 +0000 UTC m=+2876.402408801" Dec 04 12:47:13.655456 master-0 kubenswrapper[35367]: I1204 12:47:13.655384 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-console-plugin-7fbb5f6569-gdhpp_b8a1f199-55e6-45e6-8451-93e73b5b35fd/nmstate-console-plugin/0.log" Dec 04 12:47:13.692847 master-0 kubenswrapper[35367]: I1204 12:47:13.692063 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-handler-qthsq_405e5fc6-b5f3-44e5-9e79-d7bfdd9cabe8/nmstate-handler/0.log" Dec 04 12:47:13.710931 master-0 kubenswrapper[35367]: I1204 12:47:13.710100 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-metrics-7f946cbc9-xmkjr_d492b639-676b-4f37-b2b9-3d7578cb6066/nmstate-metrics/0.log" Dec 04 12:47:13.735405 master-0 kubenswrapper[35367]: I1204 12:47:13.733934 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-metrics-7f946cbc9-xmkjr_d492b639-676b-4f37-b2b9-3d7578cb6066/kube-rbac-proxy/0.log" Dec 04 12:47:13.748873 master-0 kubenswrapper[35367]: I1204 12:47:13.747413 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-operator-5b5b58f5c8-kv2p5_c45c5482-cbe4-4d60-b484-e99f18925788/nmstate-operator/0.log" Dec 04 12:47:13.787835 master-0 kubenswrapper[35367]: I1204 12:47:13.787742 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-webhook-5f6d4c5ccb-zg9dh_a7c48154-d095-44b4-9a06-cce86f50ddde/nmstate-webhook/0.log" Dec 04 12:47:14.431903 master-0 kubenswrapper[35367]: I1204 12:47:14.431743 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_controller-f8648f98b-v2fsc_197979ad-247d-457f-9529-63bcb6ce15c0/controller/0.log" Dec 04 12:47:14.443307 master-0 kubenswrapper[35367]: I1204 12:47:14.443235 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_controller-f8648f98b-v2fsc_197979ad-247d-457f-9529-63bcb6ce15c0/kube-rbac-proxy/0.log" Dec 04 12:47:14.531747 master-0 kubenswrapper[35367]: I1204 12:47:14.531703 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-ckzx9_4e0c1dd6-ebe9-4ba0-b204-7ebde784706d/controller/0.log" Dec 04 12:47:15.994251 master-0 kubenswrapper[35367]: I1204 12:47:15.994183 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-ckzx9_4e0c1dd6-ebe9-4ba0-b204-7ebde784706d/frr/0.log" Dec 04 12:47:16.009833 master-0 kubenswrapper[35367]: I1204 12:47:16.009383 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-ckzx9_4e0c1dd6-ebe9-4ba0-b204-7ebde784706d/reloader/0.log" Dec 04 12:47:16.025560 master-0 kubenswrapper[35367]: I1204 12:47:16.025489 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-ckzx9_4e0c1dd6-ebe9-4ba0-b204-7ebde784706d/frr-metrics/0.log" Dec 04 12:47:16.041764 master-0 kubenswrapper[35367]: I1204 12:47:16.039184 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-ckzx9_4e0c1dd6-ebe9-4ba0-b204-7ebde784706d/kube-rbac-proxy/0.log" Dec 04 12:47:16.046617 master-0 kubenswrapper[35367]: I1204 12:47:16.046549 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-ckzx9_4e0c1dd6-ebe9-4ba0-b204-7ebde784706d/kube-rbac-proxy-frr/0.log" Dec 04 12:47:16.056919 master-0 kubenswrapper[35367]: I1204 12:47:16.056456 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-ckzx9_4e0c1dd6-ebe9-4ba0-b204-7ebde784706d/cp-frr-files/0.log" Dec 04 12:47:16.063086 master-0 kubenswrapper[35367]: I1204 12:47:16.062838 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-ckzx9_4e0c1dd6-ebe9-4ba0-b204-7ebde784706d/cp-reloader/0.log" Dec 04 12:47:16.074683 master-0 kubenswrapper[35367]: I1204 12:47:16.074621 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-ckzx9_4e0c1dd6-ebe9-4ba0-b204-7ebde784706d/cp-metrics/0.log" Dec 04 12:47:16.092472 master-0 kubenswrapper[35367]: I1204 12:47:16.092347 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-webhook-server-7fcb986d4-hfnqb_077af73f-4190-4c72-b167-9cc36f6482df/frr-k8s-webhook-server/0.log" Dec 04 12:47:16.109650 master-0 kubenswrapper[35367]: I1204 12:47:16.108155 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_metallb-operator-controller-manager-6f8cddc44c-f979v_70729025-94a7-4a9b-98b8-e68b73d59a3e/manager/2.log" Dec 04 12:47:16.116207 master-0 kubenswrapper[35367]: I1204 12:47:16.116063 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_metallb-operator-controller-manager-6f8cddc44c-f979v_70729025-94a7-4a9b-98b8-e68b73d59a3e/manager/1.log" Dec 04 12:47:16.138362 master-0 kubenswrapper[35367]: I1204 12:47:16.135031 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_metallb-operator-webhook-server-567cbcbb98-h2n4q_89355b8e-cca3-4c80-a9da-8834812d73e6/webhook-server/0.log" Dec 04 12:47:16.543369 master-0 kubenswrapper[35367]: I1204 12:47:16.543129 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_speaker-868rl_e044043e-2b10-4c93-89bb-2610a5793e69/speaker/0.log" Dec 04 12:47:16.551488 master-0 kubenswrapper[35367]: I1204 12:47:16.551431 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_speaker-868rl_e044043e-2b10-4c93-89bb-2610a5793e69/kube-rbac-proxy/0.log" Dec 04 12:47:17.673834 master-0 kubenswrapper[35367]: I1204 12:47:17.672882 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mxk7d/master-0-debug-9st4g"] Dec 04 12:47:17.677843 master-0 kubenswrapper[35367]: I1204 12:47:17.674747 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mxk7d/master-0-debug-9st4g" Dec 04 12:47:17.758101 master-0 kubenswrapper[35367]: I1204 12:47:17.757989 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b8km\" (UniqueName: \"kubernetes.io/projected/198e2752-93df-4c2e-b73c-de055c406458-kube-api-access-2b8km\") pod \"master-0-debug-9st4g\" (UID: \"198e2752-93df-4c2e-b73c-de055c406458\") " pod="openshift-must-gather-mxk7d/master-0-debug-9st4g" Dec 04 12:47:17.761130 master-0 kubenswrapper[35367]: I1204 12:47:17.761040 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/198e2752-93df-4c2e-b73c-de055c406458-host\") pod \"master-0-debug-9st4g\" (UID: \"198e2752-93df-4c2e-b73c-de055c406458\") " pod="openshift-must-gather-mxk7d/master-0-debug-9st4g" Dec 04 12:47:17.867844 master-0 kubenswrapper[35367]: I1204 12:47:17.865283 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2b8km\" (UniqueName: \"kubernetes.io/projected/198e2752-93df-4c2e-b73c-de055c406458-kube-api-access-2b8km\") pod \"master-0-debug-9st4g\" (UID: \"198e2752-93df-4c2e-b73c-de055c406458\") " pod="openshift-must-gather-mxk7d/master-0-debug-9st4g" Dec 04 12:47:17.867844 master-0 kubenswrapper[35367]: I1204 12:47:17.865604 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/198e2752-93df-4c2e-b73c-de055c406458-host\") pod \"master-0-debug-9st4g\" (UID: \"198e2752-93df-4c2e-b73c-de055c406458\") " pod="openshift-must-gather-mxk7d/master-0-debug-9st4g" Dec 04 12:47:17.867844 master-0 kubenswrapper[35367]: I1204 12:47:17.866202 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/198e2752-93df-4c2e-b73c-de055c406458-host\") pod \"master-0-debug-9st4g\" (UID: \"198e2752-93df-4c2e-b73c-de055c406458\") " pod="openshift-must-gather-mxk7d/master-0-debug-9st4g" Dec 04 12:47:17.891152 master-0 kubenswrapper[35367]: I1204 12:47:17.890899 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b8km\" (UniqueName: \"kubernetes.io/projected/198e2752-93df-4c2e-b73c-de055c406458-kube-api-access-2b8km\") pod \"master-0-debug-9st4g\" (UID: \"198e2752-93df-4c2e-b73c-de055c406458\") " pod="openshift-must-gather-mxk7d/master-0-debug-9st4g" Dec 04 12:47:18.070686 master-0 kubenswrapper[35367]: I1204 12:47:18.070604 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mxk7d/master-0-debug-9st4g" Dec 04 12:47:18.391920 master-0 kubenswrapper[35367]: I1204 12:47:18.389730 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxk7d/master-0-debug-9st4g" event={"ID":"198e2752-93df-4c2e-b73c-de055c406458","Type":"ContainerStarted","Data":"897604f777a0bf769dbb302c3827b6a9977f23825cd1a39794a0388a6d041f63"} Dec 04 12:47:18.536317 master-0 kubenswrapper[35367]: I1204 12:47:18.536262 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication_oauth-openshift-5b466d87-4hv4r_69f92ed9-1a7c-4830-95d3-18f88b1775b7/oauth-openshift/0.log" Dec 04 12:47:19.884587 master-0 kubenswrapper[35367]: I1204 12:47:19.884280 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_58d12e893528ad53a994f10901a644ea/etcdctl/0.log" Dec 04 12:47:20.256927 master-0 kubenswrapper[35367]: I1204 12:47:20.255712 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication-operator_authentication-operator-6c968fdfdf-nrrfw_42b3be0f-1d82-4a64-abb4-0118a6960efd/authentication-operator/2.log" Dec 04 12:47:20.447432 master-0 kubenswrapper[35367]: I1204 12:47:20.445650 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication-operator_authentication-operator-6c968fdfdf-nrrfw_42b3be0f-1d82-4a64-abb4-0118a6960efd/authentication-operator/3.log" Dec 04 12:47:21.710606 master-0 kubenswrapper[35367]: I1204 12:47:21.710102 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_58d12e893528ad53a994f10901a644ea/etcd/0.log" Dec 04 12:47:21.741109 master-0 kubenswrapper[35367]: I1204 12:47:21.739508 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_58d12e893528ad53a994f10901a644ea/etcd-metrics/0.log" Dec 04 12:47:21.741109 master-0 kubenswrapper[35367]: I1204 12:47:21.739677 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5465c8b4db-58d52_b321ddb3-08ce-4101-bfa3-4200006f11ac/router/0.log" Dec 04 12:47:21.768093 master-0 kubenswrapper[35367]: I1204 12:47:21.768039 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_58d12e893528ad53a994f10901a644ea/etcd-readyz/0.log" Dec 04 12:47:21.795262 master-0 kubenswrapper[35367]: I1204 12:47:21.794247 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_58d12e893528ad53a994f10901a644ea/etcd-rev/0.log" Dec 04 12:47:21.813265 master-0 kubenswrapper[35367]: I1204 12:47:21.813216 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_58d12e893528ad53a994f10901a644ea/setup/0.log" Dec 04 12:47:21.831833 master-0 kubenswrapper[35367]: I1204 12:47:21.830648 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_58d12e893528ad53a994f10901a644ea/etcd-ensure-env-vars/0.log" Dec 04 12:47:21.860163 master-0 kubenswrapper[35367]: I1204 12:47:21.859135 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_58d12e893528ad53a994f10901a644ea/etcd-resources-copy/0.log" Dec 04 12:47:21.912833 master-0 kubenswrapper[35367]: I1204 12:47:21.912655 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_installer-1-master-0_f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3/installer/0.log" Dec 04 12:47:21.967899 master-0 kubenswrapper[35367]: I1204 12:47:21.966162 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_installer-2-master-0_c6335f99-eb41-4b1d-93df-4a24f0ce23bc/installer/0.log" Dec 04 12:47:22.195776 master-0 kubenswrapper[35367]: I1204 12:47:22.195655 35367 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm"] Dec 04 12:47:22.198334 master-0 kubenswrapper[35367]: I1204 12:47:22.198298 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" Dec 04 12:47:22.215736 master-0 kubenswrapper[35367]: I1204 12:47:22.215654 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm"] Dec 04 12:47:22.270233 master-0 kubenswrapper[35367]: I1204 12:47:22.270142 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3af62c5-a5e8-499c-9911-1372b50e960a-sys\") pod \"perf-node-gather-daemonset-rphtm\" (UID: \"d3af62c5-a5e8-499c-9911-1372b50e960a\") " pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" Dec 04 12:47:22.270558 master-0 kubenswrapper[35367]: I1204 12:47:22.270337 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d3af62c5-a5e8-499c-9911-1372b50e960a-proc\") pod \"perf-node-gather-daemonset-rphtm\" (UID: \"d3af62c5-a5e8-499c-9911-1372b50e960a\") " pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" Dec 04 12:47:22.270558 master-0 kubenswrapper[35367]: I1204 12:47:22.270455 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d3af62c5-a5e8-499c-9911-1372b50e960a-podres\") pod \"perf-node-gather-daemonset-rphtm\" (UID: \"d3af62c5-a5e8-499c-9911-1372b50e960a\") " pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" Dec 04 12:47:22.270558 master-0 kubenswrapper[35367]: I1204 12:47:22.270527 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3af62c5-a5e8-499c-9911-1372b50e960a-lib-modules\") pod \"perf-node-gather-daemonset-rphtm\" (UID: \"d3af62c5-a5e8-499c-9911-1372b50e960a\") " pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" Dec 04 12:47:22.270795 master-0 kubenswrapper[35367]: I1204 12:47:22.270686 35367 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqz7q\" (UniqueName: \"kubernetes.io/projected/d3af62c5-a5e8-499c-9911-1372b50e960a-kube-api-access-lqz7q\") pod \"perf-node-gather-daemonset-rphtm\" (UID: \"d3af62c5-a5e8-499c-9911-1372b50e960a\") " pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" Dec 04 12:47:22.374310 master-0 kubenswrapper[35367]: I1204 12:47:22.374211 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3af62c5-a5e8-499c-9911-1372b50e960a-sys\") pod \"perf-node-gather-daemonset-rphtm\" (UID: \"d3af62c5-a5e8-499c-9911-1372b50e960a\") " pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" Dec 04 12:47:22.374727 master-0 kubenswrapper[35367]: I1204 12:47:22.374702 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d3af62c5-a5e8-499c-9911-1372b50e960a-proc\") pod \"perf-node-gather-daemonset-rphtm\" (UID: \"d3af62c5-a5e8-499c-9911-1372b50e960a\") " pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" Dec 04 12:47:22.374883 master-0 kubenswrapper[35367]: I1204 12:47:22.374864 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d3af62c5-a5e8-499c-9911-1372b50e960a-podres\") pod \"perf-node-gather-daemonset-rphtm\" (UID: \"d3af62c5-a5e8-499c-9911-1372b50e960a\") " pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" Dec 04 12:47:22.375011 master-0 kubenswrapper[35367]: I1204 12:47:22.374993 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3af62c5-a5e8-499c-9911-1372b50e960a-lib-modules\") pod \"perf-node-gather-daemonset-rphtm\" (UID: \"d3af62c5-a5e8-499c-9911-1372b50e960a\") " pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" Dec 04 12:47:22.375214 master-0 kubenswrapper[35367]: I1204 12:47:22.375175 35367 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lqz7q\" (UniqueName: \"kubernetes.io/projected/d3af62c5-a5e8-499c-9911-1372b50e960a-kube-api-access-lqz7q\") pod \"perf-node-gather-daemonset-rphtm\" (UID: \"d3af62c5-a5e8-499c-9911-1372b50e960a\") " pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" Dec 04 12:47:22.377022 master-0 kubenswrapper[35367]: I1204 12:47:22.376967 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d3af62c5-a5e8-499c-9911-1372b50e960a-proc\") pod \"perf-node-gather-daemonset-rphtm\" (UID: \"d3af62c5-a5e8-499c-9911-1372b50e960a\") " pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" Dec 04 12:47:22.377022 master-0 kubenswrapper[35367]: I1204 12:47:22.374464 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3af62c5-a5e8-499c-9911-1372b50e960a-sys\") pod \"perf-node-gather-daemonset-rphtm\" (UID: \"d3af62c5-a5e8-499c-9911-1372b50e960a\") " pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" Dec 04 12:47:22.377209 master-0 kubenswrapper[35367]: I1204 12:47:22.377102 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d3af62c5-a5e8-499c-9911-1372b50e960a-podres\") pod \"perf-node-gather-daemonset-rphtm\" (UID: \"d3af62c5-a5e8-499c-9911-1372b50e960a\") " pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" Dec 04 12:47:22.377209 master-0 kubenswrapper[35367]: I1204 12:47:22.377157 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3af62c5-a5e8-499c-9911-1372b50e960a-lib-modules\") pod \"perf-node-gather-daemonset-rphtm\" (UID: \"d3af62c5-a5e8-499c-9911-1372b50e960a\") " pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" Dec 04 12:47:22.397644 master-0 kubenswrapper[35367]: I1204 12:47:22.397581 35367 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqz7q\" (UniqueName: \"kubernetes.io/projected/d3af62c5-a5e8-499c-9911-1372b50e960a-kube-api-access-lqz7q\") pod \"perf-node-gather-daemonset-rphtm\" (UID: \"d3af62c5-a5e8-499c-9911-1372b50e960a\") " pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" Dec 04 12:47:22.542656 master-0 kubenswrapper[35367]: I1204 12:47:22.540381 35367 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" Dec 04 12:47:23.018038 master-0 kubenswrapper[35367]: I1204 12:47:23.014653 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-oauth-apiserver_apiserver-7467446c4b-dlj7g_cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9/oauth-apiserver/0.log" Dec 04 12:47:23.041679 master-0 kubenswrapper[35367]: I1204 12:47:23.034102 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-oauth-apiserver_apiserver-7467446c4b-dlj7g_cd0c3bfe-7dc3-4996-aa80-1ad438dca0b9/fix-audit-permissions/0.log" Dec 04 12:47:23.123936 master-0 kubenswrapper[35367]: I1204 12:47:23.123362 35367 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm"] Dec 04 12:47:23.221618 master-0 kubenswrapper[35367]: I1204 12:47:23.221570 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/assisted-installer_assisted-installer-controller-lj5rn_3e64e99a-b3b9-4db7-aec4-8e61d1370e7e/assisted-installer-controller/0.log" Dec 04 12:47:23.488325 master-0 kubenswrapper[35367]: I1204 12:47:23.487388 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" event={"ID":"d3af62c5-a5e8-499c-9911-1372b50e960a","Type":"ContainerStarted","Data":"29af6b6092051a1fe8dd18eb92b4f3d7dd9d4ebf8ffde8f657abc82e0cb96e7c"} Dec 04 12:47:24.150352 master-0 kubenswrapper[35367]: I1204 12:47:24.150181 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-autoscaler-operator-5f49d774cd-894dk_e7fc7c16-5bca-49e5-aff0-7a8f80c6b639/kube-rbac-proxy/0.log" Dec 04 12:47:24.180338 master-0 kubenswrapper[35367]: I1204 12:47:24.180224 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-autoscaler-operator-5f49d774cd-894dk_e7fc7c16-5bca-49e5-aff0-7a8f80c6b639/cluster-autoscaler-operator/2.log" Dec 04 12:47:24.202671 master-0 kubenswrapper[35367]: I1204 12:47:24.202605 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-autoscaler-operator-5f49d774cd-894dk_e7fc7c16-5bca-49e5-aff0-7a8f80c6b639/cluster-autoscaler-operator/3.log" Dec 04 12:47:24.227844 master-0 kubenswrapper[35367]: I1204 12:47:24.227619 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-78f758c7b9-zgkh5_7e3160a9-11d1-4845-ba30-1a49ae7339a9/cluster-baremetal-operator/4.log" Dec 04 12:47:24.228224 master-0 kubenswrapper[35367]: I1204 12:47:24.227949 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-78f758c7b9-zgkh5_7e3160a9-11d1-4845-ba30-1a49ae7339a9/cluster-baremetal-operator/3.log" Dec 04 12:47:24.245232 master-0 kubenswrapper[35367]: I1204 12:47:24.245160 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_cluster-baremetal-operator-78f758c7b9-zgkh5_7e3160a9-11d1-4845-ba30-1a49ae7339a9/baremetal-kube-rbac-proxy/0.log" Dec 04 12:47:24.272289 master-0 kubenswrapper[35367]: I1204 12:47:24.272190 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_control-plane-machine-set-operator-7df95c79b5-7w5lm_14bd3485-aa02-4984-b4a3-59f360b1b327/control-plane-machine-set-operator/1.log" Dec 04 12:47:24.273161 master-0 kubenswrapper[35367]: I1204 12:47:24.273122 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_control-plane-machine-set-operator-7df95c79b5-7w5lm_14bd3485-aa02-4984-b4a3-59f360b1b327/control-plane-machine-set-operator/2.log" Dec 04 12:47:24.301737 master-0 kubenswrapper[35367]: I1204 12:47:24.301617 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_machine-api-operator-88d48b57d-9fjtd_c50317d3-f7cd-4133-845e-44add57ac378/kube-rbac-proxy/0.log" Dec 04 12:47:24.316744 master-0 kubenswrapper[35367]: I1204 12:47:24.316622 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_machine-api-operator-88d48b57d-9fjtd_c50317d3-f7cd-4133-845e-44add57ac378/machine-api-operator/0.log" Dec 04 12:47:24.317725 master-0 kubenswrapper[35367]: I1204 12:47:24.317697 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_machine-api-operator-88d48b57d-9fjtd_c50317d3-f7cd-4133-845e-44add57ac378/machine-api-operator/1.log" Dec 04 12:47:24.502336 master-0 kubenswrapper[35367]: I1204 12:47:24.502178 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" event={"ID":"d3af62c5-a5e8-499c-9911-1372b50e960a","Type":"ContainerStarted","Data":"55fa891014c67dde2aa8adeec0ad3273434f7dda7c2eccf34548fb6e0cb470ce"} Dec 04 12:47:24.503518 master-0 kubenswrapper[35367]: I1204 12:47:24.503467 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" Dec 04 12:47:24.533414 master-0 kubenswrapper[35367]: I1204 12:47:24.533147 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" podStartSLOduration=2.533120255 podStartE2EDuration="2.533120255s" podCreationTimestamp="2025-12-04 12:47:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-12-04 12:47:24.524633055 +0000 UTC m=+2887.962694323" watchObservedRunningTime="2025-12-04 12:47:24.533120255 +0000 UTC m=+2887.971181503" Dec 04 12:47:25.671883 master-0 kubenswrapper[35367]: I1204 12:47:25.671492 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw_5cd130d9-7309-4ec9-812f-7685934fbd36/cluster-cloud-controller-manager/0.log" Dec 04 12:47:25.696876 master-0 kubenswrapper[35367]: I1204 12:47:25.695933 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw_5cd130d9-7309-4ec9-812f-7685934fbd36/config-sync-controllers/0.log" Dec 04 12:47:25.719215 master-0 kubenswrapper[35367]: I1204 12:47:25.719153 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-controller-manager-operator_cluster-cloud-controller-manager-operator-758cf9d97b-gcfhw_5cd130d9-7309-4ec9-812f-7685934fbd36/kube-rbac-proxy/0.log" Dec 04 12:47:28.250968 master-0 kubenswrapper[35367]: I1204 12:47:28.250764 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-credential-operator_cloud-credential-operator-698c598cfc-95jdn_64d30b80-2336-49c2-a2c2-1e0694036a84/kube-rbac-proxy/0.log" Dec 04 12:47:28.300001 master-0 kubenswrapper[35367]: I1204 12:47:28.299938 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cloud-credential-operator_cloud-credential-operator-698c598cfc-95jdn_64d30b80-2336-49c2-a2c2-1e0694036a84/cloud-credential-operator/0.log" Dec 04 12:47:30.445863 master-0 kubenswrapper[35367]: I1204 12:47:30.445771 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-config-operator_openshift-config-operator-68758cbcdb-zh8g5_00601c1a-efd4-4366-bdc9-d768afa252b0/openshift-config-operator/1.log" Dec 04 12:47:30.448084 master-0 kubenswrapper[35367]: I1204 12:47:30.447970 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-config-operator_openshift-config-operator-68758cbcdb-zh8g5_00601c1a-efd4-4366-bdc9-d768afa252b0/openshift-config-operator/2.log" Dec 04 12:47:30.469776 master-0 kubenswrapper[35367]: I1204 12:47:30.469702 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-config-operator_openshift-config-operator-68758cbcdb-zh8g5_00601c1a-efd4-4366-bdc9-d768afa252b0/openshift-api/0.log" Dec 04 12:47:31.385416 master-0 kubenswrapper[35367]: I1204 12:47:31.385329 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-54dbc87ccb-n8qgg_3767f36c-5cb6-4dd1-8d04-812aeb193dad/console-operator/0.log" Dec 04 12:47:31.999324 master-0 kubenswrapper[35367]: I1204 12:47:31.998960 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-648b6fc966-ml84x_899bfa0e-c00b-43ff-9aaf-87d6b61b2a3b/console/0.log" Dec 04 12:47:32.043652 master-0 kubenswrapper[35367]: I1204 12:47:32.043576 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-69cd4c69bf-wlssv_0f017aaf-c4b2-46c5-aaff-ba7d5bce6371/download-server/0.log" Dec 04 12:47:32.582009 master-0 kubenswrapper[35367]: I1204 12:47:32.580983 35367 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mxk7d/perf-node-gather-daemonset-rphtm" Dec 04 12:47:32.892909 master-0 kubenswrapper[35367]: I1204 12:47:32.892732 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_cluster-storage-operator-dcf7fc84b-fncfd_f797ab14-0eb5-48b4-b914-f434f67c4c49/cluster-storage-operator/2.log" Dec 04 12:47:32.899549 master-0 kubenswrapper[35367]: I1204 12:47:32.899415 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_cluster-storage-operator-dcf7fc84b-fncfd_f797ab14-0eb5-48b4-b914-f434f67c4c49/cluster-storage-operator/3.log" Dec 04 12:47:32.919212 master-0 kubenswrapper[35367]: I1204 12:47:32.919154 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/5.log" Dec 04 12:47:32.920001 master-0 kubenswrapper[35367]: I1204 12:47:32.919236 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-6b958b6f94-w74zr_38fc8086-a00c-4a2a-8a0e-c57e9d9d0103/snapshot-controller/6.log" Dec 04 12:47:32.953913 master-0 kubenswrapper[35367]: I1204 12:47:32.950717 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-operator-6bc8656fdc-2q7f5_031d300e-24b4-481c-8b82-fe8cdb3fcef7/csi-snapshot-controller-operator/1.log" Dec 04 12:47:32.961182 master-0 kubenswrapper[35367]: I1204 12:47:32.961094 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_csi-snapshot-controller-operator-6bc8656fdc-2q7f5_031d300e-24b4-481c-8b82-fe8cdb3fcef7/csi-snapshot-controller-operator/2.log" Dec 04 12:47:33.677082 master-0 kubenswrapper[35367]: I1204 12:47:33.677013 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns-operator_dns-operator-7c56cf9b74-xz27r_7c017c69-b24e-4a7a-b888-133bed34c174/dns-operator/0.log" Dec 04 12:47:33.694183 master-0 kubenswrapper[35367]: I1204 12:47:33.694092 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns-operator_dns-operator-7c56cf9b74-xz27r_7c017c69-b24e-4a7a-b888-133bed34c174/kube-rbac-proxy/0.log" Dec 04 12:47:34.426452 master-0 kubenswrapper[35367]: I1204 12:47:34.426081 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xg7vh_0c092f5d-bd33-4d91-9206-ce9c0b9e1aae/dns/0.log" Dec 04 12:47:34.441328 master-0 kubenswrapper[35367]: I1204 12:47:34.441263 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xg7vh_0c092f5d-bd33-4d91-9206-ce9c0b9e1aae/kube-rbac-proxy/0.log" Dec 04 12:47:34.462641 master-0 kubenswrapper[35367]: I1204 12:47:34.462386 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qq64m_7ba7c7aa-9b4c-40c9-b5ea-87494a6a22b7/dns-node-resolver/0.log" Dec 04 12:47:35.119739 master-0 kubenswrapper[35367]: I1204 12:47:35.119664 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd-operator_etcd-operator-5bf4d88c6f-2bpmr_c6e9271a-44ea-4612-ab60-4a9d489ed062/etcd-operator/2.log" Dec 04 12:47:35.120485 master-0 kubenswrapper[35367]: I1204 12:47:35.120211 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd-operator_etcd-operator-5bf4d88c6f-2bpmr_c6e9271a-44ea-4612-ab60-4a9d489ed062/etcd-operator/3.log" Dec 04 12:47:35.741982 master-0 kubenswrapper[35367]: I1204 12:47:35.741878 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_58d12e893528ad53a994f10901a644ea/etcdctl/0.log" Dec 04 12:47:36.414562 master-0 kubenswrapper[35367]: E1204 12:47:36.414279 35367 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 192.168.32.10:58010->192.168.32.10:37655: write tcp 192.168.32.10:58010->192.168.32.10:37655: write: broken pipe Dec 04 12:47:36.774822 master-0 kubenswrapper[35367]: I1204 12:47:36.774712 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxk7d/master-0-debug-9st4g" event={"ID":"198e2752-93df-4c2e-b73c-de055c406458","Type":"ContainerStarted","Data":"5ef919fb54462201b20b8ea441ef1ca1fd6c8b073f873a98242e27c6693cff01"} Dec 04 12:47:36.788746 master-0 kubenswrapper[35367]: I1204 12:47:36.784742 35367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-mxk7d/master-0-debug-9st4g" podStartSLOduration=3.2364895479999998 podStartE2EDuration="19.784721632s" podCreationTimestamp="2025-12-04 12:47:17 +0000 UTC" firstStartedPulling="2025-12-04 12:47:18.128555725 +0000 UTC m=+2881.566616983" lastFinishedPulling="2025-12-04 12:47:34.676787819 +0000 UTC m=+2898.114849067" observedRunningTime="2025-12-04 12:47:36.782366717 +0000 UTC m=+2900.220427985" watchObservedRunningTime="2025-12-04 12:47:36.784721632 +0000 UTC m=+2900.222782890" Dec 04 12:47:37.299953 master-0 kubenswrapper[35367]: I1204 12:47:37.299827 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_58d12e893528ad53a994f10901a644ea/etcd/0.log" Dec 04 12:47:37.318741 master-0 kubenswrapper[35367]: I1204 12:47:37.318675 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_58d12e893528ad53a994f10901a644ea/etcd-metrics/0.log" Dec 04 12:47:37.329617 master-0 kubenswrapper[35367]: I1204 12:47:37.329516 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_58d12e893528ad53a994f10901a644ea/etcd-readyz/0.log" Dec 04 12:47:37.345775 master-0 kubenswrapper[35367]: I1204 12:47:37.345701 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_58d12e893528ad53a994f10901a644ea/etcd-rev/0.log" Dec 04 12:47:37.427071 master-0 kubenswrapper[35367]: I1204 12:47:37.427008 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_58d12e893528ad53a994f10901a644ea/setup/0.log" Dec 04 12:47:37.443152 master-0 kubenswrapper[35367]: I1204 12:47:37.443067 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_58d12e893528ad53a994f10901a644ea/etcd-ensure-env-vars/0.log" Dec 04 12:47:37.466323 master-0 kubenswrapper[35367]: I1204 12:47:37.466254 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_58d12e893528ad53a994f10901a644ea/etcd-resources-copy/0.log" Dec 04 12:47:37.506406 master-0 kubenswrapper[35367]: I1204 12:47:37.506332 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_installer-1-master-0_f24bc354-1fe3-4dd1-b0a0-3dc86a14aff3/installer/0.log" Dec 04 12:47:37.566871 master-0 kubenswrapper[35367]: I1204 12:47:37.566780 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_installer-2-master-0_c6335f99-eb41-4b1d-93df-4a24f0ce23bc/installer/0.log" Dec 04 12:47:38.514699 master-0 kubenswrapper[35367]: I1204 12:47:38.514543 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_cluster-image-registry-operator-6fb9f88b7-tgvfl_1ade9186-b262-4b5e-9c6f-ba89f0130fb6/cluster-image-registry-operator/1.log" Dec 04 12:47:38.540000 master-0 kubenswrapper[35367]: I1204 12:47:38.539688 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_cluster-image-registry-operator-6fb9f88b7-tgvfl_1ade9186-b262-4b5e-9c6f-ba89f0130fb6/cluster-image-registry-operator/2.log" Dec 04 12:47:38.555821 master-0 kubenswrapper[35367]: I1204 12:47:38.555737 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g49xm_d8a32876-8fcd-4297-8ae3-274e88039a41/node-ca/0.log" Dec 04 12:47:39.236140 master-0 kubenswrapper[35367]: I1204 12:47:39.236043 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/5.log" Dec 04 12:47:39.243587 master-0 kubenswrapper[35367]: I1204 12:47:39.243521 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/ingress-operator/6.log" Dec 04 12:47:39.259614 master-0 kubenswrapper[35367]: I1204 12:47:39.259293 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-operator_ingress-operator-8649c48786-cx2b2_b011b1f1-3235-4e20-825b-ce711c052407/kube-rbac-proxy/0.log" Dec 04 12:47:40.080238 master-0 kubenswrapper[35367]: I1204 12:47:40.080168 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pz4lp_d8fa6831-60e8-415e-978a-d203d46ecbdc/serve-healthcheck-canary/0.log" Dec 04 12:47:40.743142 master-0 kubenswrapper[35367]: I1204 12:47:40.742800 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-55965856b6-skbmb_b668f740-dbc3-48e0-9ebc-83bae3a43c83/insights-operator/1.log" Dec 04 12:47:40.793834 master-0 kubenswrapper[35367]: I1204 12:47:40.793599 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-55965856b6-skbmb_b668f740-dbc3-48e0-9ebc-83bae3a43c83/insights-operator/2.log" Dec 04 12:47:45.225175 master-0 kubenswrapper[35367]: I1204 12:47:45.225106 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5113c857-78d3-4133-82de-5e28735eacb4/alertmanager/0.log" Dec 04 12:47:45.276980 master-0 kubenswrapper[35367]: I1204 12:47:45.276907 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5113c857-78d3-4133-82de-5e28735eacb4/config-reloader/0.log" Dec 04 12:47:45.309159 master-0 kubenswrapper[35367]: I1204 12:47:45.308839 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5113c857-78d3-4133-82de-5e28735eacb4/kube-rbac-proxy-web/0.log" Dec 04 12:47:45.452585 master-0 kubenswrapper[35367]: I1204 12:47:45.452530 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5113c857-78d3-4133-82de-5e28735eacb4/kube-rbac-proxy/0.log" Dec 04 12:47:45.480172 master-0 kubenswrapper[35367]: I1204 12:47:45.480047 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5113c857-78d3-4133-82de-5e28735eacb4/kube-rbac-proxy-metric/0.log" Dec 04 12:47:45.501791 master-0 kubenswrapper[35367]: I1204 12:47:45.501718 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5113c857-78d3-4133-82de-5e28735eacb4/prom-label-proxy/0.log" Dec 04 12:47:45.520560 master-0 kubenswrapper[35367]: I1204 12:47:45.520482 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5113c857-78d3-4133-82de-5e28735eacb4/init-config-reloader/0.log" Dec 04 12:47:45.587992 master-0 kubenswrapper[35367]: I1204 12:47:45.587344 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-7ff994598c-p82nn_2ab26ae5-0607-4dfd-840e-531d204b5030/cluster-monitoring-operator/0.log" Dec 04 12:47:45.609050 master-0 kubenswrapper[35367]: I1204 12:47:45.608977 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5857974f64-4rstk_071abc3c-51a4-46ae-a2aa-35cf3bace606/kube-state-metrics/0.log" Dec 04 12:47:45.632616 master-0 kubenswrapper[35367]: I1204 12:47:45.632540 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5857974f64-4rstk_071abc3c-51a4-46ae-a2aa-35cf3bace606/kube-rbac-proxy-main/0.log" Dec 04 12:47:45.650461 master-0 kubenswrapper[35367]: I1204 12:47:45.650404 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5857974f64-4rstk_071abc3c-51a4-46ae-a2aa-35cf3bace606/kube-rbac-proxy-self/0.log" Dec 04 12:47:45.674826 master-0 kubenswrapper[35367]: I1204 12:47:45.674712 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-88f9c775c-fw4ls_e173cc4d-77b4-4af3-94b7-e9fc4f8db701/metrics-server/0.log" Dec 04 12:47:45.723582 master-0 kubenswrapper[35367]: I1204 12:47:45.723509 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-58f547f9c9-wnpsq_898ad5e8-757e-4faa-a118-67eac3f76c73/monitoring-plugin/0.log" Dec 04 12:47:45.767078 master-0 kubenswrapper[35367]: I1204 12:47:45.766965 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z89ck_2d3a9769-2a09-41ce-b1ab-6fe3bd192832/node-exporter/0.log" Dec 04 12:47:45.785134 master-0 kubenswrapper[35367]: I1204 12:47:45.785069 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z89ck_2d3a9769-2a09-41ce-b1ab-6fe3bd192832/kube-rbac-proxy/0.log" Dec 04 12:47:45.802706 master-0 kubenswrapper[35367]: I1204 12:47:45.802651 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z89ck_2d3a9769-2a09-41ce-b1ab-6fe3bd192832/init-textfile/0.log" Dec 04 12:47:45.839691 master-0 kubenswrapper[35367]: I1204 12:47:45.839520 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-5974b6b869-5fzg8_f40cbd35-aa53-4e7c-82c1-3abc0455cf51/kube-rbac-proxy-main/0.log" Dec 04 12:47:45.859703 master-0 kubenswrapper[35367]: I1204 12:47:45.858851 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-5974b6b869-5fzg8_f40cbd35-aa53-4e7c-82c1-3abc0455cf51/kube-rbac-proxy-self/0.log" Dec 04 12:47:45.890076 master-0 kubenswrapper[35367]: I1204 12:47:45.890018 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-5974b6b869-5fzg8_f40cbd35-aa53-4e7c-82c1-3abc0455cf51/openshift-state-metrics/0.log" Dec 04 12:47:45.942671 master-0 kubenswrapper[35367]: I1204 12:47:45.942619 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_58981c23-3a3a-47f3-b416-71c5b7ba2f6e/prometheus/0.log" Dec 04 12:47:45.958587 master-0 kubenswrapper[35367]: I1204 12:47:45.958537 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_58981c23-3a3a-47f3-b416-71c5b7ba2f6e/config-reloader/0.log" Dec 04 12:47:45.985428 master-0 kubenswrapper[35367]: I1204 12:47:45.984480 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_58981c23-3a3a-47f3-b416-71c5b7ba2f6e/thanos-sidecar/0.log" Dec 04 12:47:46.008790 master-0 kubenswrapper[35367]: I1204 12:47:46.007559 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_58981c23-3a3a-47f3-b416-71c5b7ba2f6e/kube-rbac-proxy-web/0.log" Dec 04 12:47:46.048927 master-0 kubenswrapper[35367]: I1204 12:47:46.048475 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_58981c23-3a3a-47f3-b416-71c5b7ba2f6e/kube-rbac-proxy/0.log" Dec 04 12:47:46.067286 master-0 kubenswrapper[35367]: I1204 12:47:46.067227 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_58981c23-3a3a-47f3-b416-71c5b7ba2f6e/kube-rbac-proxy-thanos/0.log" Dec 04 12:47:46.086464 master-0 kubenswrapper[35367]: I1204 12:47:46.086072 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_58981c23-3a3a-47f3-b416-71c5b7ba2f6e/init-config-reloader/0.log" Dec 04 12:47:46.118793 master-0 kubenswrapper[35367]: I1204 12:47:46.118733 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6c74d9cb9f-pxd98_e62ab42a-086e-451b-a036-1171285d7d24/prometheus-operator/0.log" Dec 04 12:47:46.142654 master-0 kubenswrapper[35367]: I1204 12:47:46.142597 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6c74d9cb9f-pxd98_e62ab42a-086e-451b-a036-1171285d7d24/kube-rbac-proxy/0.log" Dec 04 12:47:46.164787 master-0 kubenswrapper[35367]: I1204 12:47:46.164724 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7c85c4dffd-xv2wn_ae0f644f-a31c-4b6c-b854-e01417aa448e/prometheus-operator-admission-webhook/0.log" Dec 04 12:47:46.196451 master-0 kubenswrapper[35367]: I1204 12:47:46.195342 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7487d49bdb-7f2xj_6546d9a8-710e-4166-a36f-cea7ba5ba41c/telemeter-client/0.log" Dec 04 12:47:46.222583 master-0 kubenswrapper[35367]: I1204 12:47:46.222430 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7487d49bdb-7f2xj_6546d9a8-710e-4166-a36f-cea7ba5ba41c/reload/0.log" Dec 04 12:47:46.242502 master-0 kubenswrapper[35367]: I1204 12:47:46.242425 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7487d49bdb-7f2xj_6546d9a8-710e-4166-a36f-cea7ba5ba41c/kube-rbac-proxy/0.log" Dec 04 12:47:46.274164 master-0 kubenswrapper[35367]: I1204 12:47:46.274093 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c5fbf6b84-vvhts_4c8907fe-87b6-4290-af7a-22ae41f3ff16/thanos-query/0.log" Dec 04 12:47:46.295566 master-0 kubenswrapper[35367]: I1204 12:47:46.294717 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c5fbf6b84-vvhts_4c8907fe-87b6-4290-af7a-22ae41f3ff16/kube-rbac-proxy-web/0.log" Dec 04 12:47:46.315421 master-0 kubenswrapper[35367]: I1204 12:47:46.315338 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c5fbf6b84-vvhts_4c8907fe-87b6-4290-af7a-22ae41f3ff16/kube-rbac-proxy/0.log" Dec 04 12:47:46.334190 master-0 kubenswrapper[35367]: I1204 12:47:46.334138 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c5fbf6b84-vvhts_4c8907fe-87b6-4290-af7a-22ae41f3ff16/prom-label-proxy/0.log" Dec 04 12:47:46.351151 master-0 kubenswrapper[35367]: I1204 12:47:46.351094 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c5fbf6b84-vvhts_4c8907fe-87b6-4290-af7a-22ae41f3ff16/kube-rbac-proxy-rules/0.log" Dec 04 12:47:46.372181 master-0 kubenswrapper[35367]: I1204 12:47:46.372124 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c5fbf6b84-vvhts_4c8907fe-87b6-4290-af7a-22ae41f3ff16/kube-rbac-proxy-metrics/0.log" Dec 04 12:47:48.332719 master-0 kubenswrapper[35367]: I1204 12:47:48.332670 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_controller-f8648f98b-v2fsc_197979ad-247d-457f-9529-63bcb6ce15c0/controller/0.log" Dec 04 12:47:48.354526 master-0 kubenswrapper[35367]: I1204 12:47:48.354464 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_controller-f8648f98b-v2fsc_197979ad-247d-457f-9529-63bcb6ce15c0/kube-rbac-proxy/0.log" Dec 04 12:47:48.380944 master-0 kubenswrapper[35367]: I1204 12:47:48.380889 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-ckzx9_4e0c1dd6-ebe9-4ba0-b204-7ebde784706d/controller/0.log" Dec 04 12:47:49.684325 master-0 kubenswrapper[35367]: I1204 12:47:49.683193 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-ckzx9_4e0c1dd6-ebe9-4ba0-b204-7ebde784706d/frr/0.log" Dec 04 12:47:49.702447 master-0 kubenswrapper[35367]: I1204 12:47:49.702393 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-ckzx9_4e0c1dd6-ebe9-4ba0-b204-7ebde784706d/reloader/0.log" Dec 04 12:47:49.723989 master-0 kubenswrapper[35367]: I1204 12:47:49.723774 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-ckzx9_4e0c1dd6-ebe9-4ba0-b204-7ebde784706d/frr-metrics/0.log" Dec 04 12:47:49.742685 master-0 kubenswrapper[35367]: I1204 12:47:49.741718 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-ckzx9_4e0c1dd6-ebe9-4ba0-b204-7ebde784706d/kube-rbac-proxy/0.log" Dec 04 12:47:49.771374 master-0 kubenswrapper[35367]: I1204 12:47:49.771318 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-ckzx9_4e0c1dd6-ebe9-4ba0-b204-7ebde784706d/kube-rbac-proxy-frr/0.log" Dec 04 12:47:49.787154 master-0 kubenswrapper[35367]: I1204 12:47:49.787091 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-ckzx9_4e0c1dd6-ebe9-4ba0-b204-7ebde784706d/cp-frr-files/0.log" Dec 04 12:47:49.807162 master-0 kubenswrapper[35367]: I1204 12:47:49.806877 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-ckzx9_4e0c1dd6-ebe9-4ba0-b204-7ebde784706d/cp-reloader/0.log" Dec 04 12:47:49.829562 master-0 kubenswrapper[35367]: I1204 12:47:49.827711 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-ckzx9_4e0c1dd6-ebe9-4ba0-b204-7ebde784706d/cp-metrics/0.log" Dec 04 12:47:49.850585 master-0 kubenswrapper[35367]: I1204 12:47:49.850536 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-webhook-server-7fcb986d4-hfnqb_077af73f-4190-4c72-b167-9cc36f6482df/frr-k8s-webhook-server/0.log" Dec 04 12:47:49.881346 master-0 kubenswrapper[35367]: I1204 12:47:49.881284 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_metallb-operator-controller-manager-6f8cddc44c-f979v_70729025-94a7-4a9b-98b8-e68b73d59a3e/manager/2.log" Dec 04 12:47:49.883013 master-0 kubenswrapper[35367]: I1204 12:47:49.882994 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_metallb-operator-controller-manager-6f8cddc44c-f979v_70729025-94a7-4a9b-98b8-e68b73d59a3e/manager/1.log" Dec 04 12:47:49.905876 master-0 kubenswrapper[35367]: I1204 12:47:49.905821 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_metallb-operator-webhook-server-567cbcbb98-h2n4q_89355b8e-cca3-4c80-a9da-8834812d73e6/webhook-server/0.log" Dec 04 12:47:50.336265 master-0 kubenswrapper[35367]: I1204 12:47:50.335892 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_speaker-868rl_e044043e-2b10-4c93-89bb-2610a5793e69/speaker/0.log" Dec 04 12:47:50.362977 master-0 kubenswrapper[35367]: I1204 12:47:50.361605 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_speaker-868rl_e044043e-2b10-4c93-89bb-2610a5793e69/kube-rbac-proxy/0.log" Dec 04 12:47:52.561467 master-0 kubenswrapper[35367]: I1204 12:47:52.559067 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_cluster-node-tuning-operator-85cff47f46-4gv5j_6f15dcdb-c968-429c-9d1d-63c2becad337/cluster-node-tuning-operator/2.log" Dec 04 12:47:52.561467 master-0 kubenswrapper[35367]: I1204 12:47:52.559464 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_cluster-node-tuning-operator-85cff47f46-4gv5j_6f15dcdb-c968-429c-9d1d-63c2becad337/cluster-node-tuning-operator/1.log" Dec 04 12:47:52.582837 master-0 kubenswrapper[35367]: I1204 12:47:52.581741 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-dp5s8_c91e6234-52c5-41c0-a1ff-6a92932b83cd/tuned/0.log" Dec 04 12:47:54.179317 master-0 kubenswrapper[35367]: I1204 12:47:54.179250 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver-operator_kube-apiserver-operator-765d9ff747-gr68k_ccf81538-4d5a-4c26-8e54-fe39331a625d/kube-apiserver-operator/1.log" Dec 04 12:47:54.256134 master-0 kubenswrapper[35367]: I1204 12:47:54.256074 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver-operator_kube-apiserver-operator-765d9ff747-gr68k_ccf81538-4d5a-4c26-8e54-fe39331a625d/kube-apiserver-operator/2.log" Dec 04 12:47:54.990854 master-0 kubenswrapper[35367]: I1204 12:47:54.990780 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-1-master-0_0a3dbe2b-a659-46c2-93e8-19bd30ee2260/installer/0.log" Dec 04 12:47:55.019698 master-0 kubenswrapper[35367]: I1204 12:47:55.019625 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-3-master-0_0fad065c-94c9-4a38-ab76-cf0266bdc04b/installer/0.log" Dec 04 12:47:55.050304 master-0 kubenswrapper[35367]: I1204 12:47:55.050204 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-4-master-0_a58ec846-7add-4bef-8382-556bb578824d/installer/0.log" Dec 04 12:47:55.081077 master-0 kubenswrapper[35367]: I1204 12:47:55.079724 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_installer-6-master-0_7f04fa4e-8587-43ad-bd31-0d6cb1067e28/installer/0.log" Dec 04 12:47:55.760702 master-0 kubenswrapper[35367]: I1204 12:47:55.760526 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_b1fa13939a6c6bc926f15f953210c126/kube-apiserver/0.log" Dec 04 12:47:55.787683 master-0 kubenswrapper[35367]: I1204 12:47:55.787617 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_b1fa13939a6c6bc926f15f953210c126/kube-apiserver-cert-syncer/0.log" Dec 04 12:47:55.820224 master-0 kubenswrapper[35367]: I1204 12:47:55.820161 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_b1fa13939a6c6bc926f15f953210c126/kube-apiserver-cert-regeneration-controller/0.log" Dec 04 12:47:55.837366 master-0 kubenswrapper[35367]: I1204 12:47:55.837281 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_b1fa13939a6c6bc926f15f953210c126/kube-apiserver-insecure-readyz/0.log" Dec 04 12:47:55.862836 master-0 kubenswrapper[35367]: I1204 12:47:55.862732 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_b1fa13939a6c6bc926f15f953210c126/kube-apiserver-check-endpoints/0.log" Dec 04 12:47:55.877781 master-0 kubenswrapper[35367]: I1204 12:47:55.877386 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_b1fa13939a6c6bc926f15f953210c126/setup/0.log" Dec 04 12:47:56.724251 master-0 kubenswrapper[35367]: I1204 12:47:56.724166 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-catalogd_catalogd-controller-manager-7cc89f4c4c-fd9pv_ee9a47b1-cdd9-43bc-8115-8851f29106e6/kube-rbac-proxy/0.log" Dec 04 12:47:56.755333 master-0 kubenswrapper[35367]: I1204 12:47:56.755265 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-catalogd_catalogd-controller-manager-7cc89f4c4c-fd9pv_ee9a47b1-cdd9-43bc-8115-8851f29106e6/manager/2.log" Dec 04 12:47:56.755626 master-0 kubenswrapper[35367]: I1204 12:47:56.755483 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-catalogd_catalogd-controller-manager-7cc89f4c4c-fd9pv_ee9a47b1-cdd9-43bc-8115-8851f29106e6/manager/1.log" Dec 04 12:47:57.141845 master-0 kubenswrapper[35367]: I1204 12:47:57.141743 35367 generic.go:334] "Generic (PLEG): container finished" podID="198e2752-93df-4c2e-b73c-de055c406458" containerID="5ef919fb54462201b20b8ea441ef1ca1fd6c8b073f873a98242e27c6693cff01" exitCode=0 Dec 04 12:47:57.142433 master-0 kubenswrapper[35367]: I1204 12:47:57.141862 35367 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxk7d/master-0-debug-9st4g" event={"ID":"198e2752-93df-4c2e-b73c-de055c406458","Type":"ContainerDied","Data":"5ef919fb54462201b20b8ea441ef1ca1fd6c8b073f873a98242e27c6693cff01"} Dec 04 12:47:57.431927 master-0 kubenswrapper[35367]: I1204 12:47:57.431756 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-86cb77c54b-db45f_128bacca-6d0f-48a8-82d4-4a036c315b22/cert-manager-controller/0.log" Dec 04 12:47:57.463979 master-0 kubenswrapper[35367]: I1204 12:47:57.463910 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-cainjector-855d9ccff4-lh4km_df3010d8-f616-45da-8182-972499fa7ea2/cert-manager-cainjector/0.log" Dec 04 12:47:57.483036 master-0 kubenswrapper[35367]: I1204 12:47:57.482969 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-webhook-f4fb5df64-42npf_6ee63d3e-4191-4b3c-83c2-e2d38c50bcf0/cert-manager-webhook/0.log" Dec 04 12:47:58.030481 master-0 kubenswrapper[35367]: I1204 12:47:58.030412 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj_e2a10c48-e236-4e54-8e4a-d3c5af9164b5/extract/0.log" Dec 04 12:47:58.046402 master-0 kubenswrapper[35367]: I1204 12:47:58.046234 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj_e2a10c48-e236-4e54-8e4a-d3c5af9164b5/util/0.log" Dec 04 12:47:58.063017 master-0 kubenswrapper[35367]: I1204 12:47:58.062944 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_917aae072417a6c2fc5ddd97ca05bfedb9fc1cad89a3b1c4d989b78eafcwbgj_e2a10c48-e236-4e54-8e4a-d3c5af9164b5/pull/0.log" Dec 04 12:47:58.083779 master-0 kubenswrapper[35367]: I1204 12:47:58.083574 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_barbican-operator-controller-manager-5cd89994b5-974hd_52816b97-42b0-4b68-b094-4227045f15e9/manager/0.log" Dec 04 12:47:58.102304 master-0 kubenswrapper[35367]: I1204 12:47:58.101511 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_barbican-operator-controller-manager-5cd89994b5-974hd_52816b97-42b0-4b68-b094-4227045f15e9/kube-rbac-proxy/0.log" Dec 04 12:47:58.174359 master-0 kubenswrapper[35367]: I1204 12:47:58.174293 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_cinder-operator-controller-manager-f8856dd79-mfhwn_c8387f48-c8e5-4e93-9f95-ef081bd895f7/manager/0.log" Dec 04 12:47:58.194036 master-0 kubenswrapper[35367]: I1204 12:47:58.193976 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_cinder-operator-controller-manager-f8856dd79-mfhwn_c8387f48-c8e5-4e93-9f95-ef081bd895f7/kube-rbac-proxy/0.log" Dec 04 12:47:58.217168 master-0 kubenswrapper[35367]: I1204 12:47:58.217073 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_designate-operator-controller-manager-84bc9f68f5-jjlq7_8b2beff3-c98e-40a9-b02f-4bc0be3f246d/manager/0.log" Dec 04 12:47:58.229046 master-0 kubenswrapper[35367]: I1204 12:47:58.228989 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_designate-operator-controller-manager-84bc9f68f5-jjlq7_8b2beff3-c98e-40a9-b02f-4bc0be3f246d/kube-rbac-proxy/0.log" Dec 04 12:47:58.310860 master-0 kubenswrapper[35367]: I1204 12:47:58.309823 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_glance-operator-controller-manager-78cd4f7769-58c6v_4c0b68d8-54cd-4caa-8045-4eebdf756bdc/manager/0.log" Dec 04 12:47:58.324389 master-0 kubenswrapper[35367]: I1204 12:47:58.322263 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_glance-operator-controller-manager-78cd4f7769-58c6v_4c0b68d8-54cd-4caa-8045-4eebdf756bdc/kube-rbac-proxy/0.log" Dec 04 12:47:58.358409 master-0 kubenswrapper[35367]: I1204 12:47:58.353606 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_heat-operator-controller-manager-7fd96594c7-xnrjg_cc133071-6e0d-4b0d-bcb4-d6864efdb0ef/manager/0.log" Dec 04 12:47:58.374784 master-0 kubenswrapper[35367]: I1204 12:47:58.374726 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_heat-operator-controller-manager-7fd96594c7-xnrjg_cc133071-6e0d-4b0d-bcb4-d6864efdb0ef/kube-rbac-proxy/0.log" Dec 04 12:47:58.397885 master-0 kubenswrapper[35367]: I1204 12:47:58.397822 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_horizon-operator-controller-manager-f6cc97788-dtxsw_999f0b7d-c17f-4181-b5bc-d380540d456b/manager/0.log" Dec 04 12:47:58.417544 master-0 kubenswrapper[35367]: I1204 12:47:58.417478 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_horizon-operator-controller-manager-f6cc97788-dtxsw_999f0b7d-c17f-4181-b5bc-d380540d456b/kube-rbac-proxy/0.log" Dec 04 12:47:58.452330 master-0 kubenswrapper[35367]: I1204 12:47:58.452268 35367 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mxk7d/master-0-debug-9st4g" Dec 04 12:47:58.509169 master-0 kubenswrapper[35367]: I1204 12:47:58.509106 35367 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-mxk7d/master-0-debug-9st4g"] Dec 04 12:47:58.525302 master-0 kubenswrapper[35367]: I1204 12:47:58.524739 35367 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-mxk7d/master-0-debug-9st4g"] Dec 04 12:47:58.572199 master-0 kubenswrapper[35367]: I1204 12:47:58.570389 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_infra-operator-controller-manager-7d9c9d7fd8-f228s_51d21c61-912d-477f-a586-2bcb537015f0/manager/0.log" Dec 04 12:47:58.584178 master-0 kubenswrapper[35367]: I1204 12:47:58.584062 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_infra-operator-controller-manager-7d9c9d7fd8-f228s_51d21c61-912d-477f-a586-2bcb537015f0/kube-rbac-proxy/0.log" Dec 04 12:47:58.586613 master-0 kubenswrapper[35367]: I1204 12:47:58.586487 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2b8km\" (UniqueName: \"kubernetes.io/projected/198e2752-93df-4c2e-b73c-de055c406458-kube-api-access-2b8km\") pod \"198e2752-93df-4c2e-b73c-de055c406458\" (UID: \"198e2752-93df-4c2e-b73c-de055c406458\") " Dec 04 12:47:58.586848 master-0 kubenswrapper[35367]: I1204 12:47:58.586724 35367 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/198e2752-93df-4c2e-b73c-de055c406458-host\") pod \"198e2752-93df-4c2e-b73c-de055c406458\" (UID: \"198e2752-93df-4c2e-b73c-de055c406458\") " Dec 04 12:47:58.586848 master-0 kubenswrapper[35367]: I1204 12:47:58.586793 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/198e2752-93df-4c2e-b73c-de055c406458-host" (OuterVolumeSpecName: "host") pod "198e2752-93df-4c2e-b73c-de055c406458" (UID: "198e2752-93df-4c2e-b73c-de055c406458"). InnerVolumeSpecName "host". PluginName "kubernetes.io/host-path", VolumeGidValue "" Dec 04 12:47:58.587631 master-0 kubenswrapper[35367]: I1204 12:47:58.587602 35367 reconciler_common.go:293] "Volume detached for volume \"host\" (UniqueName: \"kubernetes.io/host-path/198e2752-93df-4c2e-b73c-de055c406458-host\") on node \"master-0\" DevicePath \"\"" Dec 04 12:47:58.590789 master-0 kubenswrapper[35367]: I1204 12:47:58.590743 35367 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/198e2752-93df-4c2e-b73c-de055c406458-kube-api-access-2b8km" (OuterVolumeSpecName: "kube-api-access-2b8km") pod "198e2752-93df-4c2e-b73c-de055c406458" (UID: "198e2752-93df-4c2e-b73c-de055c406458"). InnerVolumeSpecName "kube-api-access-2b8km". PluginName "kubernetes.io/projected", VolumeGidValue "" Dec 04 12:47:58.624405 master-0 kubenswrapper[35367]: I1204 12:47:58.624329 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_ironic-operator-controller-manager-7c9bfd6967-782xf_5ef048b0-c28e-455e-af91-337c8cb37aba/manager/0.log" Dec 04 12:47:58.690185 master-0 kubenswrapper[35367]: I1204 12:47:58.690116 35367 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2b8km\" (UniqueName: \"kubernetes.io/projected/198e2752-93df-4c2e-b73c-de055c406458-kube-api-access-2b8km\") on node \"master-0\" DevicePath \"\"" Dec 04 12:47:58.694309 master-0 kubenswrapper[35367]: I1204 12:47:58.694264 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_ironic-operator-controller-manager-7c9bfd6967-782xf_5ef048b0-c28e-455e-af91-337c8cb37aba/manager/1.log" Dec 04 12:47:58.711121 master-0 kubenswrapper[35367]: I1204 12:47:58.710963 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_ironic-operator-controller-manager-7c9bfd6967-782xf_5ef048b0-c28e-455e-af91-337c8cb37aba/kube-rbac-proxy/0.log" Dec 04 12:47:58.769494 master-0 kubenswrapper[35367]: I1204 12:47:58.769403 35367 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="198e2752-93df-4c2e-b73c-de055c406458" path="/var/lib/kubelet/pods/198e2752-93df-4c2e-b73c-de055c406458/volumes" Dec 04 12:47:58.798847 master-0 kubenswrapper[35367]: I1204 12:47:58.798740 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_keystone-operator-controller-manager-58b8dcc5fb-bpmdw_2bd1182d-69fc-4e8b-a066-1b90a559a37e/manager/0.log" Dec 04 12:47:58.813887 master-0 kubenswrapper[35367]: I1204 12:47:58.813799 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_keystone-operator-controller-manager-58b8dcc5fb-bpmdw_2bd1182d-69fc-4e8b-a066-1b90a559a37e/kube-rbac-proxy/0.log" Dec 04 12:47:58.866591 master-0 kubenswrapper[35367]: I1204 12:47:58.866420 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_manila-operator-controller-manager-56f9fbf74b-hq5jr_5cf205b8-6eb2-4125-940c-ac798d0a9fcd/manager/0.log" Dec 04 12:47:58.892093 master-0 kubenswrapper[35367]: I1204 12:47:58.892040 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_manila-operator-controller-manager-56f9fbf74b-hq5jr_5cf205b8-6eb2-4125-940c-ac798d0a9fcd/kube-rbac-proxy/0.log" Dec 04 12:47:58.936014 master-0 kubenswrapper[35367]: I1204 12:47:58.935950 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_mariadb-operator-controller-manager-647d75769b-8dqxm_2e7741e9-d8cb-46a0-ae9e-f6fc948cd05e/manager/0.log" Dec 04 12:47:58.955598 master-0 kubenswrapper[35367]: I1204 12:47:58.955531 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_mariadb-operator-controller-manager-647d75769b-8dqxm_2e7741e9-d8cb-46a0-ae9e-f6fc948cd05e/kube-rbac-proxy/0.log" Dec 04 12:47:59.019151 master-0 kubenswrapper[35367]: I1204 12:47:59.018847 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_neutron-operator-controller-manager-7cdd6b54fb-4jl24_e16e68f5-a79c-4a58-82e8-bd8b713f038d/manager/0.log" Dec 04 12:47:59.033967 master-0 kubenswrapper[35367]: I1204 12:47:59.033528 35367 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_neutron-operator-controller-manager-7cdd6b54fb-4jl24_e16e68f5-a79c-4a58-82e8-bd8b713f038d/kube-rbac-proxy/0.log"